2024-01-17T20:39:05.301 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-17T20:39:05.301 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/valgrind} --verbose --owner scheduled_leonidus@teuthology --name leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi --archive /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519259 -- /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519259/orig.config.yaml 2024-01-17T20:39:05.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T20:39:05.445 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519259 branch: main description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/valgrind} email: null first_in_suite: false job_id: '7519259' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 ms die on skipped message: false osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: 1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 valgrind: exit_on_first_error: false mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: 1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 owner: scheduled_leonidus@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 5791 sha1: 1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 sleep_before_teardown: 0 subset: 209/512 suite: fs suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCFeRXVyQi8037FG5pYx64D+ttT6fno9jm3W/UyT4g7VB+mjbzOEgJBGbBfvRrHdz3HH/KZN/uXXBARJyY5VNvc= smithi190.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPACka/qChOqhnfuphJXksaCCVdZNZiliJFEnQ5I68xbpN2+6WRPFeWy09PR1xKOyaG+Zs7DXUR2GTgcZqY+vvg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: cd45576300487d997e5a85abed65500b9f5d143b timestamp: 2024-01-17_20:20:37 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-17T20:39:05.446 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa; will attempt to use it 2024-01-17T20:39:05.446 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks 2024-01-17T20:39:05.446 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-17T20:39:05.449 INFO:teuthology.task.internal:Checking packages... 2024-01-17T20:39:05.473 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4' 2024-01-17T20:39:05.473 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-17T20:39:05.473 INFO:teuthology.packaging:ref: None 2024-01-17T20:39:05.473 INFO:teuthology.packaging:tag: None 2024-01-17T20:39:05.473 INFO:teuthology.packaging:branch: main 2024-01-17T20:39:05.473 INFO:teuthology.packaging:sha1: 1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 2024-01-17T20:39:05.474 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-01-17T20:39:05.812 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-716-gb5d03370-1jammy 2024-01-17T20:39:05.813 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-17T20:39:05.823 INFO:teuthology.task.internal:no buildpackages task found 2024-01-17T20:39:05.823 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-17T20:39:05.837 INFO:teuthology.task.internal:Saving configuration 2024-01-17T20:39:05.853 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-17T20:39:05.864 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-17T20:39:05.891 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519259', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 20:33:10.520172', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIH2R1qQYOtxk/FYxJAHPrMthj+uq9DcMvsC58g7CwqSD'} 2024-01-17T20:39:05.914 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519259', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 20:33:10.518410', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEVrIu69j4Ql7FdwZPtXVyNfuMvqdfraHmg+MQtb291G'} 2024-01-17T20:39:05.914 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-17T20:39:05.926 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-01-17T20:39:05.926 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-01-17T20:39:05.926 INFO:teuthology.run_tasks:Running task console_log... 2024-01-17T20:39:06.005 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7b91e01430>, signals=[15]) 2024-01-17T20:39:06.005 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-17T20:39:06.014 INFO:teuthology.task.internal:Opening connections... 2024-01-17T20:39:06.014 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2024-01-17T20:39:06.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T20:39:06.110 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi190.front.sepia.ceph.com 2024-01-17T20:39:06.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T20:39:06.199 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-17T20:39:06.224 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-01-17T20:39:06.230 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-01-17T20:39:06.230 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-01-17T20:39:06.276 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-17T20:39:06.277 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2024-01-17T20:39:06.277 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="22.04" 2024-01-17T20:39:06.277 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-17T20:39:06.277 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=jammy 2024-01-17T20:39:06.277 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2024-01-17T20:39:06.277 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2024-01-17T20:39:06.277 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-17T20:39:06.277 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-17T20:39:06.277 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-17T20:39:06.277 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-17T20:39:06.277 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=jammy 2024-01-17T20:39:06.278 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-01-17T20:39:06.302 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2024-01-17T20:39:06.307 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2024-01-17T20:39:06.308 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-01-17T20:39:06.354 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-17T20:39:06.354 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Ubuntu" 2024-01-17T20:39:06.354 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="22.04" 2024-01-17T20:39:06.354 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-17T20:39:06.354 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_CODENAME=jammy 2024-01-17T20:39:06.354 INFO:teuthology.orchestra.run.smithi190.stdout:ID=ubuntu 2024-01-17T20:39:06.354 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE=debian 2024-01-17T20:39:06.354 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-17T20:39:06.354 INFO:teuthology.orchestra.run.smithi190.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-17T20:39:06.354 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-17T20:39:06.354 INFO:teuthology.orchestra.run.smithi190.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-17T20:39:06.355 INFO:teuthology.orchestra.run.smithi190.stdout:UBUNTU_CODENAME=jammy 2024-01-17T20:39:06.355 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-01-17T20:39:06.376 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-17T20:39:06.388 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-17T20:39:06.398 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-17T20:39:06.399 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2024-01-17T20:39:06.401 DEBUG:teuthology.orchestra.run.smithi190:> test '!' -e /home/ubuntu/cephtest 2024-01-17T20:39:06.406 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-17T20:39:06.417 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-17T20:39:06.417 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2024-01-17T20:39:06.450 DEBUG:teuthology.orchestra.run.smithi190:> test -z $(ls -A /var/lib/ceph) 2024-01-17T20:39:06.473 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-17T20:39:06.530 INFO:teuthology.run_tasks:Running task kernel... 2024-01-17T20:39:06.544 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-01-17T20:39:06.544 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-01-17T20:39:06.544 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-01-17T20:39:06.544 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-17T20:39:06.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T20:39:06.550 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-01-17T20:39:06.810 DEBUG:teuthology.task.kernel:sha1 for client.0 is 064ffc2b249f42d6c6a333d6e6f3d5392519ee92 2024-01-17T20:39:06.811 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "064ffc2b249f42d6c6a333d6e6f3d5392519ee92"... 2024-01-17T20:39:06.811 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-01-17T20:39:06.817 INFO:teuthology.orchestra.run.smithi161.stdout:5.15.0-56-generic 2024-01-17T20:39:06.817 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 064ffc2b249f42d6c6a333d6e6f3d5392519ee92 2024-01-17T20:39:06.818 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-17T20:39:06.818 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-01-17T20:39:06.818 DEBUG:teuthology.orchestra.run.smithi161:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-01-17T20:39:06.888 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-01-17T20:39:07.032 INFO:teuthology.orchestra.run.smithi161.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-01-17T20:39:07.033 INFO:teuthology.orchestra.run.smithi161.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-01-17T20:39:07.033 INFO:teuthology.orchestra.run.smithi161.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-01-17T20:39:07.033 INFO:teuthology.orchestra.run.smithi161.stderr:hint: 2024-01-17T20:39:07.033 INFO:teuthology.orchestra.run.smithi161.stderr:hint: git config --global init.defaultBranch 2024-01-17T20:39:07.033 INFO:teuthology.orchestra.run.smithi161.stderr:hint: 2024-01-17T20:39:07.033 INFO:teuthology.orchestra.run.smithi161.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-01-17T20:39:07.033 INFO:teuthology.orchestra.run.smithi161.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-01-17T20:39:07.033 INFO:teuthology.orchestra.run.smithi161.stderr:hint: 2024-01-17T20:39:07.033 INFO:teuthology.orchestra.run.smithi161.stderr:hint: git branch -m 2024-01-17T20:39:07.033 INFO:teuthology.orchestra.run.smithi161.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-01-17T20:39:07.036 DEBUG:teuthology.orchestra.run.smithi161:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-01-17T20:39:07.106 DEBUG:teuthology.orchestra.run.smithi161:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-01-17T20:39:07.162 DEBUG:teuthology.orchestra.run.smithi161:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-01-17T20:41:21.773 INFO:teuthology.orchestra.run.smithi161.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-01-17T20:41:21.774 INFO:teuthology.orchestra.run.smithi161.stderr: * [new branch] main -> origin/main 2024-01-17T20:41:21.807 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190312 -> 20190312 2024-01-17T20:41:21.807 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190416 -> 20190416 2024-01-17T20:41:21.807 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190514 -> 20190514 2024-01-17T20:41:21.807 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190618 -> 20190618 2024-01-17T20:41:21.808 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190717 -> 20190717 2024-01-17T20:41:21.808 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190815 -> 20190815 2024-01-17T20:41:21.809 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190923 -> 20190923 2024-01-17T20:41:21.809 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20191022 -> 20191022 2024-01-17T20:41:21.809 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20191215 -> 20191215 2024-01-17T20:41:21.809 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200122 -> 20200122 2024-01-17T20:41:21.809 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200316 -> 20200316 2024-01-17T20:41:21.809 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200421 -> 20200421 2024-01-17T20:41:21.810 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200519 -> 20200519 2024-01-17T20:41:21.810 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200619 -> 20200619 2024-01-17T20:41:21.810 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200721 -> 20200721 2024-01-17T20:41:21.810 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200817 -> 20200817 2024-01-17T20:41:21.810 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200918 -> 20200918 2024-01-17T20:41:21.810 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20201022 -> 20201022 2024-01-17T20:41:21.810 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20201118 -> 20201118 2024-01-17T20:41:21.810 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20201218 -> 20201218 2024-01-17T20:41:21.811 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20210208 -> 20210208 2024-01-17T20:41:21.811 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20210315 -> 20210315 2024-01-17T20:41:21.811 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20210511 -> 20210511 2024-01-17T20:41:21.812 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20210716 -> 20210716 2024-01-17T20:41:21.812 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20210818 -> 20210818 2024-01-17T20:41:21.812 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20210919 -> 20210919 2024-01-17T20:41:21.812 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20211027 -> 20211027 2024-01-17T20:41:21.813 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20211216 -> 20211216 2024-01-17T20:41:21.813 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220209 -> 20220209 2024-01-17T20:41:21.813 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220310 -> 20220310 2024-01-17T20:41:21.813 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220411 -> 20220411 2024-01-17T20:41:21.813 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220509 -> 20220509 2024-01-17T20:41:21.813 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220610 -> 20220610 2024-01-17T20:41:21.813 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220708 -> 20220708 2024-01-17T20:41:21.814 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220815 -> 20220815 2024-01-17T20:41:21.814 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220913 -> 20220913 2024-01-17T20:41:21.814 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20221012 -> 20221012 2024-01-17T20:41:21.814 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20221109 -> 20221109 2024-01-17T20:41:21.814 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20221214 -> 20221214 2024-01-17T20:41:21.814 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230117 -> 20230117 2024-01-17T20:41:21.815 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230210 -> 20230210 2024-01-17T20:41:21.815 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230310 -> 20230310 2024-01-17T20:41:21.816 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230404 -> 20230404 2024-01-17T20:41:21.816 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230515 -> 20230515 2024-01-17T20:41:21.816 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230625 -> 20230625 2024-01-17T20:41:21.816 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230804 -> 20230804 2024-01-17T20:41:21.816 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230919 -> 20230919 2024-01-17T20:41:21.816 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20231030 -> 20231030 2024-01-17T20:41:21.816 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20231111 -> 20231111 2024-01-17T20:41:21.817 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20231211 -> 20231211 2024-01-17T20:41:21.817 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20240115 -> 20240115 2024-01-17T20:41:25.889 INFO:teuthology.orchestra.run.smithi161.stderr:Updating files: 49% (1704/3421) Updating files: 50% (1711/3421) Updating files: 51% (1745/3421) Updating files: 52% (1779/3421) Updating files: 53% (1814/3421) Updating files: 54% (1848/3421) Updating files: 55% (1882/3421) Updating files: 56% (1916/3421) Updating files: 57% (1950/3421) Updating files: 58% (1985/3421) Updating files: 59% (2019/3421) Updating files: 60% (2053/3421) Updating files: 61% (2087/3421) Updating files: 62% (2122/3421) Updating files: 63% (2156/3421) Updating files: 64% (2190/3421) Updating files: 64% (2215/3421) Updating files: 65% (2224/3421) Updating files: 66% (2258/3421) Updating files: 67% (2293/3421) Updating files: 68% (2327/3421) Updating files: 69% (2361/3421) Updating files: 70% (2395/3421) Updating files: 71% (2429/3421) Updating files: 72% (2464/3421) Updating files: 73% (2498/3421) Updating files: 74% (2532/3421) Updating files: 75% (2566/3421) Updating files: 76% (2600/3421) Updating files: 77% (2635/3421) Updating files: 78% (2669/3421) Updating files: 79% (2703/3421) Updating files: 80% (2737/3421) Updating files: 81% (2772/3421) Updating files: 81% (2780/3421) Updating files: 82% (2806/3421) Updating files: 83% (2840/3421) Updating files: 84% (2874/3421) Updating files: 85% (2908/3421) Updating files: 86% (2943/3421) Updating files: 87% (2977/3421) Updating files: 88% (3011/3421) Updating files: 89% (3045/3421) Updating files: 90% (3079/3421) Updating files: 91% (3114/3421) Updating files: 92% (3148/3421) Updating files: 93% (3182/3421) Updating files: 94% (3216/3421) Updating files: 95% (3250/3421) Updating files: 96% (3285/3421) Updating files: 96% (3303/3421) Updating files: 97% (3319/3421) Updating files: 98% (3353/3421) Updating files: 99% (3387/3421) Updating files: 100% (3421/3421) Updating files: 100% (3421/3421), done. 2024-01-17T20:41:25.894 INFO:teuthology.orchestra.run.smithi161.stdout:HEAD is now at bf0987d3 Merge branch 'robot/patch-0-1705440424' into 'main' 2024-01-17T20:41:25.915 INFO:teuthology.task.kernel:Downloading kernel 064ffc2b249f42d6c6a333d6e6f3d5392519ee92 on client.0... 2024-01-17T20:41:25.916 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=064ffc2b249f42d6c6a333d6e6f3d5392519ee92 2024-01-17T20:41:26.153 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/064ffc2b249f42d6c6a333d6e6f3d5392519ee92/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-g064ffc2b249f/ 2024-01-17T20:41:26.153 DEBUG:teuthology.orchestra.run.smithi161:> rm -f /tmp/linux-image.deb && echo linux-image-6.7.0-g064ffc2b249f_6.7.0-g064ffc2b249f-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/064ffc2b249f42d6c6a333d6e6f3d5392519ee92/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-g064ffc2b249f/ --input-file=- 2024-01-17T20:41:26.156 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi161.front.sepia.ceph.com to complete... 2024-01-17T20:41:27.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17 20:41:28 URL:https://4.chacra.ceph.com/r/kernel/testing/064ffc2b249f42d6c6a333d6e6f3d5392519ee92/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-g064ffc2b249f/linux-image-6.7.0-g064ffc2b249f_6.7.0-g064ffc2b249f-1_amd64.deb [39123014/39123014] -> "/tmp/linux-image.deb" [1] 2024-01-17T20:41:27.865 INFO:teuthology.orchestra.run.smithi161.stderr:FINISHED --2024-01-17 20:41:28-- 2024-01-17T20:41:27.866 INFO:teuthology.orchestra.run.smithi161.stderr:Total wall clock time: 1.7s 2024-01-17T20:41:27.866 INFO:teuthology.orchestra.run.smithi161.stderr:Downloaded: 1 files, 37M in 1.5s (25.3 MB/s) 2024-01-17T20:41:27.873 INFO:teuthology.task.kernel:Installing kernel 064ffc2b249f42d6c6a333d6e6f3d5392519ee92 on client.0... 2024-01-17T20:41:27.873 DEBUG:teuthology.orchestra.run.smithi161:> sudo dpkg -i /tmp/linux-image.deb 2024-01-17T20:41:28.140 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-image-6.7.0-g064ffc2b249f. 2024-01-17T20:41:30.167 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-01-17T20:41:30.171 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-01-17T20:41:30.428 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-image-6.7.0-g064ffc2b249f (6.7.0-g064ffc2b249f-1) ... 2024-01-17T20:41:33.672 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-image-6.7.0-g064ffc2b249f (6.7.0-g064ffc2b249f-1) ... 2024-01-17T20:41:33.787 INFO:teuthology.orchestra.run.smithi161.stderr:update-initramfs: Generating /boot/initrd.img-6.7.0-g064ffc2b249f 2024-01-17T20:41:55.134 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub' 2024-01-17T20:41:55.142 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-17T20:41:55.171 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2024-01-17T20:41:55.532 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-6.7.0-g064ffc2b249f 2024-01-17T20:41:55.551 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-6.7.0-g064ffc2b249f 2024-01-17T20:41:55.840 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-17T20:41:55.857 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-17T20:41:55.923 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-17T20:41:55.928 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-17T20:41:56.086 INFO:teuthology.orchestra.run.smithi161.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-17T20:41:56.087 INFO:teuthology.orchestra.run.smithi161.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-17T20:41:56.087 INFO:teuthology.orchestra.run.smithi161.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-17T20:41:56.134 INFO:teuthology.orchestra.run.smithi161.stderr:done 2024-01-17T20:41:56.309 DEBUG:teuthology.orchestra.run.smithi161:> dpkg-deb -c /tmp/linux-image.deb 2024-01-17T20:41:56.317 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./ 2024-01-17T20:41:56.317 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./boot/ 2024-01-17T20:41:56.317 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 4444641 2024-01-17 06:30 ./boot/System.map-6.7.0-g064ffc2b249f 2024-01-17T20:41:56.329 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 170149 2024-01-17 06:30 ./boot/config-6.7.0-g064ffc2b249f 2024-01-17T20:41:56.329 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11441152 2024-01-17 06:30 ./boot/vmlinuz-6.7.0-g064ffc2b249f 2024-01-17T20:41:56.348 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./etc/ 2024-01-17T20:41:56.348 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./etc/kernel/ 2024-01-17T20:41:56.348 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./etc/kernel/postinst.d/ 2024-01-17T20:41:56.349 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./etc/kernel/postrm.d/ 2024-01-17T20:41:56.349 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./etc/kernel/preinst.d/ 2024-01-17T20:41:56.349 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./etc/kernel/prerm.d/ 2024-01-17T20:41:56.349 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/ 2024-01-17T20:41:56.349 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/ 2024-01-17T20:41:56.349 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/ 2024-01-17T20:41:56.349 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/ 2024-01-17T20:41:56.349 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/ 2024-01-17T20:41:56.349 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/ 2024-01-17T20:41:56.349 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/ 2024-01-17T20:41:56.349 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 490345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/aesni-intel.ko 2024-01-17T20:41:56.352 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-17T20:41:56.352 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-17T20:41:56.352 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-17T20:41:56.352 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 93113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-17T20:41:56.352 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 106729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-17T20:41:56.353 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 152241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-17T20:41:56.353 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-17T20:41:56.353 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-17T20:41:56.353 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 83889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-17T20:41:56.353 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-17T20:41:56.353 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-17T20:41:56.353 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-17T20:41:56.353 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-17T20:41:56.353 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-17T20:41:56.353 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-17T20:41:56.353 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-17T20:41:56.353 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-17T20:41:56.353 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-17T20:41:56.354 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-17T20:41:56.354 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kernel/ 2024-01-17T20:41:56.354 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kernel/cpu/ 2024-01-17T20:41:56.354 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kernel/cpu/mce/ 2024-01-17T20:41:56.354 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-17T20:41:56.354 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kernel/cpuid.ko 2024-01-17T20:41:56.354 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kernel/msr.ko 2024-01-17T20:41:56.354 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kvm/ 2024-01-17T20:41:56.354 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 353705 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-17T20:41:56.354 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 881649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-17T20:41:56.355 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 2276625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kvm/kvm.ko 2024-01-17T20:41:56.432 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/ 2024-01-17T20:41:56.435 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/af_alg.ko 2024-01-17T20:41:56.435 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/algif_hash.ko 2024-01-17T20:41:56.435 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/algif_skcipher.ko 2024-01-17T20:41:56.435 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/ansi_cprng.ko 2024-01-17T20:41:56.435 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19641 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/anubis.ko 2024-01-17T20:41:56.435 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/arc4.ko 2024-01-17T20:41:56.436 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/asymmetric_keys/ 2024-01-17T20:41:56.436 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-01-17T20:41:56.436 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/async_tx/ 2024-01-17T20:41:56.436 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/async_tx/async_memcpy.ko 2024-01-17T20:41:56.436 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/async_tx/async_pq.ko 2024-01-17T20:41:56.436 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-17T20:41:56.436 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/async_tx/async_tx.ko 2024-01-17T20:41:56.436 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/async_tx/async_xor.ko 2024-01-17T20:41:56.436 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/async_tx/raid6test.ko 2024-01-17T20:41:56.436 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/authenc.ko 2024-01-17T20:41:56.436 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/authencesn.ko 2024-01-17T20:41:56.436 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/blake2b_generic.ko 2024-01-17T20:41:56.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/blowfish_common.ko 2024-01-17T20:41:56.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/blowfish_generic.ko 2024-01-17T20:41:56.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/camellia_generic.ko 2024-01-17T20:41:56.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/cast5_generic.ko 2024-01-17T20:41:56.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/cast6_generic.ko 2024-01-17T20:41:56.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/cast_common.ko 2024-01-17T20:41:56.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/ccm.ko 2024-01-17T20:41:56.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/cmac.ko 2024-01-17T20:41:56.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/crc32_generic.ko 2024-01-17T20:41:56.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/cryptd.ko 2024-01-17T20:41:56.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/crypto_engine.ko 2024-01-17T20:41:56.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/crypto_simd.ko 2024-01-17T20:41:56.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/crypto_user.ko 2024-01-17T20:41:56.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/cts.ko 2024-01-17T20:41:56.438 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/des_generic.ko 2024-01-17T20:41:56.438 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/dh_generic.ko 2024-01-17T20:41:56.438 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/echainiv.ko 2024-01-17T20:41:56.438 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/essiv.ko 2024-01-17T20:41:56.438 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/fcrypt.ko 2024-01-17T20:41:56.438 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/khazad.ko 2024-01-17T20:41:56.438 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/lrw.ko 2024-01-17T20:41:56.438 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/lz4.ko 2024-01-17T20:41:56.438 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/lz4hc.ko 2024-01-17T20:41:56.438 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/md4.ko 2024-01-17T20:41:56.438 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/michael_mic.ko 2024-01-17T20:41:56.438 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/pcbc.ko 2024-01-17T20:41:56.438 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/pcrypt.ko 2024-01-17T20:41:56.439 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/rmd160.ko 2024-01-17T20:41:56.439 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/seed.ko 2024-01-17T20:41:56.439 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/serpent_generic.ko 2024-01-17T20:41:56.439 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 149481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/tcrypt.ko 2024-01-17T20:41:56.439 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/tea.ko 2024-01-17T20:41:56.439 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/twofish_common.ko 2024-01-17T20:41:56.439 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/twofish_generic.ko 2024-01-17T20:41:56.439 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/vmac.ko 2024-01-17T20:41:56.439 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/wp512.ko 2024-01-17T20:41:56.439 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/xcbc.ko 2024-01-17T20:41:56.440 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/xor.ko 2024-01-17T20:41:56.440 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/xts.ko 2024-01-17T20:41:56.440 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/xxhash_generic.ko 2024-01-17T20:41:56.440 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ 2024-01-17T20:41:56.440 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/ 2024-01-17T20:41:56.440 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/acpi_extlog.ko 2024-01-17T20:41:56.440 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-17T20:41:56.440 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/acpi_pad.ko 2024-01-17T20:41:56.440 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/apei/ 2024-01-17T20:41:56.440 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/apei/einj.ko 2024-01-17T20:41:56.440 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/ec_sys.ko 2024-01-17T20:41:56.440 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/platform_profile.ko 2024-01-17T20:41:56.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/sbs.ko 2024-01-17T20:41:56.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/sbshc.ko 2024-01-17T20:41:56.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 104729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/video.ko 2024-01-17T20:41:56.441 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/ 2024-01-17T20:41:56.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/acard-ahci.ko 2024-01-17T20:41:56.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/ahci.ko 2024-01-17T20:41:56.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/ahci_platform.ko 2024-01-17T20:41:56.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 88401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/libahci.ko 2024-01-17T20:41:56.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/libahci_platform.ko 2024-01-17T20:41:56.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_acpi.ko 2024-01-17T20:41:56.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_ali.ko 2024-01-17T20:41:56.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_amd.ko 2024-01-17T20:41:56.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_artop.ko 2024-01-17T20:41:56.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_atiixp.ko 2024-01-17T20:41:56.442 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_atp867x.ko 2024-01-17T20:41:56.442 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_cmd640.ko 2024-01-17T20:41:56.442 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_cmd64x.ko 2024-01-17T20:41:56.442 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_cypress.ko 2024-01-17T20:41:56.442 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_efar.ko 2024-01-17T20:41:56.442 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_hpt366.ko 2024-01-17T20:41:56.442 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_hpt37x.ko 2024-01-17T20:41:56.442 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-17T20:41:56.442 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-17T20:41:56.442 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_it8213.ko 2024-01-17T20:41:56.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_it821x.ko 2024-01-17T20:41:56.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_jmicron.ko 2024-01-17T20:41:56.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_legacy.ko 2024-01-17T20:41:56.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_marvell.ko 2024-01-17T20:41:56.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_mpiix.ko 2024-01-17T20:41:56.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_netcell.ko 2024-01-17T20:41:56.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_ninja32.ko 2024-01-17T20:41:56.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_ns87410.ko 2024-01-17T20:41:56.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17361 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_ns87415.ko 2024-01-17T20:41:56.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_oldpiix.ko 2024-01-17T20:41:56.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15377 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_opti.ko 2024-01-17T20:41:56.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_optidma.ko 2024-01-17T20:41:56.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_pcmcia.ko 2024-01-17T20:41:56.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-17T20:41:56.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-17T20:41:56.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_piccolo.ko 2024-01-17T20:41:56.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_radisys.ko 2024-01-17T20:41:56.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_rdc.ko 2024-01-17T20:41:56.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_rz1000.ko 2024-01-17T20:41:56.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_sch.ko 2024-01-17T20:41:56.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_serverworks.ko 2024-01-17T20:41:56.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_sil680.ko 2024-01-17T20:41:56.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_sl82c105.ko 2024-01-17T20:41:56.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_triflex.ko 2024-01-17T20:41:56.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_via.ko 2024-01-17T20:41:56.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pdc_adma.ko 2024-01-17T20:41:56.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_inic162x.ko 2024-01-17T20:41:56.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 83345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_mv.ko 2024-01-17T20:41:56.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_nv.ko 2024-01-17T20:41:56.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37377 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_promise.ko 2024-01-17T20:41:56.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_qstor.ko 2024-01-17T20:41:56.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_sil.ko 2024-01-17T20:41:56.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_sil24.ko 2024-01-17T20:41:56.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_sis.ko 2024-01-17T20:41:56.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_svw.ko 2024-01-17T20:41:56.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_sx4.ko 2024-01-17T20:41:56.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_uli.ko 2024-01-17T20:41:56.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_via.ko 2024-01-17T20:41:56.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_vsc.ko 2024-01-17T20:41:56.445 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/auxdisplay/ 2024-01-17T20:41:56.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/auxdisplay/ks0108.ko 2024-01-17T20:41:56.445 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/bcma/ 2024-01-17T20:41:56.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 124473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/bcma/bcma.ko 2024-01-17T20:41:56.446 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/ 2024-01-17T20:41:56.446 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/aoe/ 2024-01-17T20:41:56.446 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 113753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/aoe/aoe.ko 2024-01-17T20:41:56.446 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/drbd/ 2024-01-17T20:41:56.446 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 965305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/drbd/drbd.ko 2024-01-17T20:41:56.446 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 173353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/floppy.ko 2024-01-17T20:41:56.446 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/mtip32xx/ 2024-01-17T20:41:56.446 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 94297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-17T20:41:56.446 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 116321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/nbd.ko 2024-01-17T20:41:56.446 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/null_blk/ 2024-01-17T20:41:56.446 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 110737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/null_blk/null_blk.ko 2024-01-17T20:41:56.446 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 98281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/pktcdvd.ko 2024-01-17T20:41:56.446 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 263769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/rbd.ko 2024-01-17T20:41:56.446 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/xen-blkback/ 2024-01-17T20:41:56.446 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 98185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-17T20:41:56.447 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/zram/ 2024-01-17T20:41:56.447 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/zram/zram.ko 2024-01-17T20:41:56.447 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/ 2024-01-17T20:41:56.447 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30705 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/applicom.ko 2024-01-17T20:41:56.447 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/hangcheck-timer.ko 2024-01-17T20:41:56.447 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/hw_random/ 2024-01-17T20:41:56.447 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-17T20:41:56.447 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-17T20:41:56.447 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-17T20:41:56.447 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/hw_random/via-rng.ko 2024-01-17T20:41:56.447 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-17T20:41:56.447 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/ipmi/ 2024-01-17T20:41:56.448 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-17T20:41:56.448 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 148609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-17T20:41:56.448 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-17T20:41:56.448 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 139313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-17T20:41:56.448 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-17T20:41:56.448 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-17T20:41:56.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/lp.ko 2024-01-17T20:41:56.449 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/mwave/ 2024-01-17T20:41:56.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 84097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/mwave/mwave.ko 2024-01-17T20:41:56.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/nvram.ko 2024-01-17T20:41:56.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/ppdev.ko 2024-01-17T20:41:56.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/tlclk.ko 2024-01-17T20:41:56.450 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/tpm/ 2024-01-17T20:41:56.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-17T20:41:56.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-01-17T20:41:56.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-01-17T20:41:56.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-01-17T20:41:56.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-17T20:41:56.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-17T20:41:56.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-01-17T20:41:56.451 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/xillybus/ 2024-01-17T20:41:56.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/xillybus/xillybus_class.ko 2024-01-17T20:41:56.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/xillybus/xillybus_core.ko 2024-01-17T20:41:56.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-01-17T20:41:56.451 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/clk/ 2024-01-17T20:41:56.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/clk/clk-palmas.ko 2024-01-17T20:41:56.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47761 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/clk/clk-si5351.ko 2024-01-17T20:41:56.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/clk/clk-twl6040.ko 2024-01-17T20:41:56.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/clk/clk-wm831x.ko 2024-01-17T20:41:56.451 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/cpufreq/ 2024-01-17T20:41:56.452 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-17T20:41:56.452 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-17T20:41:56.452 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-17T20:41:56.452 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/ 2024-01-17T20:41:56.452 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/ccp/ 2024-01-17T20:41:56.452 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-17T20:41:56.452 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 246841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/ccp/ccp.ko 2024-01-17T20:41:56.452 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/intel/ 2024-01-17T20:41:56.452 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/intel/qat/ 2024-01-17T20:41:56.452 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/intel/qat/qat_common/ 2024-01-17T20:41:56.452 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 517033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-17T20:41:56.452 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-01-17T20:41:56.453 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-17T20:41:56.453 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/padlock-aes.ko 2024-01-17T20:41:56.453 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/padlock-sha.ko 2024-01-17T20:41:56.453 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/virtio/ 2024-01-17T20:41:56.453 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-17T20:41:56.453 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/dca/ 2024-01-17T20:41:56.453 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/dca/dca.ko 2024-01-17T20:41:56.454 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/dma/ 2024-01-17T20:41:56.454 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/dma/dw/ 2024-01-17T20:41:56.454 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-17T20:41:56.454 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/dma/ioat/ 2024-01-17T20:41:56.454 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 122569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-17T20:41:56.454 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/ 2024-01-17T20:41:56.454 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 79953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/amd64_edac.ko 2024-01-17T20:41:56.454 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/e752x_edac.ko 2024-01-17T20:41:56.454 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 63617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/edac_mce_amd.ko 2024-01-17T20:41:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/i3000_edac.ko 2024-01-17T20:41:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/i3200_edac.ko 2024-01-17T20:41:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/i5100_edac.ko 2024-01-17T20:41:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/i5400_edac.ko 2024-01-17T20:41:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/i7300_edac.ko 2024-01-17T20:41:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/i7core_edac.ko 2024-01-17T20:41:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/i82975x_edac.ko 2024-01-17T20:41:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/ie31200_edac.ko 2024-01-17T20:41:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/sb_edac.ko 2024-01-17T20:41:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/x38_edac.ko 2024-01-17T20:41:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/extcon/ 2024-01-17T20:41:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/extcon/extcon-gpio.ko 2024-01-17T20:41:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/extcon/extcon-max14577.ko 2024-01-17T20:41:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/extcon/extcon-max77693.ko 2024-01-17T20:41:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/extcon/extcon-max8997.ko 2024-01-17T20:41:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/extcon/extcon-palmas.ko 2024-01-17T20:41:56.456 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/extcon/extcon-rt8973a.ko 2024-01-17T20:41:56.456 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/extcon/extcon-sm5502.ko 2024-01-17T20:41:56.456 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/firmware/ 2024-01-17T20:41:56.456 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/firmware/dmi-sysfs.ko 2024-01-17T20:41:56.456 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/firmware/efi/ 2024-01-17T20:41:56.456 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/firmware/efi/efi-pstore.ko 2024-01-17T20:41:56.456 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-17T20:41:56.456 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/ 2024-01-17T20:41:56.456 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-adp5520.ko 2024-01-17T20:41:56.456 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-amd8111.ko 2024-01-17T20:41:56.456 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-arizona.ko 2024-01-17T20:41:56.456 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-da9052.ko 2024-01-17T20:41:56.456 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-da9055.ko 2024-01-17T20:41:56.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-dln2.ko 2024-01-17T20:41:56.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 77849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-f7188x.ko 2024-01-17T20:41:56.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-generic.ko 2024-01-17T20:41:56.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-ich.ko 2024-01-17T20:41:56.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-01-17T20:41:56.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-kempld.ko 2024-01-17T20:41:56.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-lp3943.ko 2024-01-17T20:41:56.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-max7300.ko 2024-01-17T20:41:56.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-max730x.ko 2024-01-17T20:41:56.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-max732x.ko 2024-01-17T20:41:56.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-01-17T20:41:56.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-pca953x.ko 2024-01-17T20:41:56.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-pcf857x.ko 2024-01-17T20:41:56.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14377 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-rdc321x.ko 2024-01-17T20:41:56.458 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-sch.ko 2024-01-17T20:41:56.458 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-sch311x.ko 2024-01-17T20:41:56.458 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-tps65912.ko 2024-01-17T20:41:56.458 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-twl4030.ko 2024-01-17T20:41:56.458 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-twl6040.ko 2024-01-17T20:41:56.458 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-17T20:41:56.458 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15377 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-vx855.ko 2024-01-17T20:41:56.458 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-wm831x.ko 2024-01-17T20:41:56.458 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-wm8350.ko 2024-01-17T20:41:56.458 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-wm8994.ko 2024-01-17T20:41:56.458 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/ 2024-01-17T20:41:56.459 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-a4tech.ko 2024-01-17T20:41:56.459 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-apple.ko 2024-01-17T20:41:56.459 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-appleir.ko 2024-01-17T20:41:56.459 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-aureal.ko 2024-01-17T20:41:56.459 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-axff.ko 2024-01-17T20:41:56.459 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-belkin.ko 2024-01-17T20:41:56.459 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-cherry.ko 2024-01-17T20:41:56.459 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-chicony.ko 2024-01-17T20:41:56.459 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60761 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-cp2112.ko 2024-01-17T20:41:56.459 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-cypress.ko 2024-01-17T20:41:56.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-dr.ko 2024-01-17T20:41:56.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-elecom.ko 2024-01-17T20:41:56.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-elo.ko 2024-01-17T20:41:56.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-emsff.ko 2024-01-17T20:41:56.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-ezkey.ko 2024-01-17T20:41:56.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-gaff.ko 2024-01-17T20:41:56.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-generic.ko 2024-01-17T20:41:56.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-gt683r.ko 2024-01-17T20:41:56.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-gyration.ko 2024-01-17T20:41:56.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-17T20:41:56.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-17T20:41:56.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-holtekff.ko 2024-01-17T20:41:56.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-hyperv.ko 2024-01-17T20:41:56.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-icade.ko 2024-01-17T20:41:56.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-kensington.ko 2024-01-17T20:41:56.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-keytouch.ko 2024-01-17T20:41:56.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-kye.ko 2024-01-17T20:41:56.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-lcpower.ko 2024-01-17T20:41:56.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-led.ko 2024-01-17T20:41:56.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-lenovo.ko 2024-01-17T20:41:56.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-lg-g15.ko 2024-01-17T20:41:56.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-17T20:41:56.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-17T20:41:56.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 80993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-logitech.ko 2024-01-17T20:41:56.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-magicmouse.ko 2024-01-17T20:41:56.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-microsoft.ko 2024-01-17T20:41:56.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10361 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-monterey.ko 2024-01-17T20:41:56.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-multitouch.ko 2024-01-17T20:41:56.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-ntrig.ko 2024-01-17T20:41:56.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-ortek.ko 2024-01-17T20:41:56.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-penmount.ko 2024-01-17T20:41:56.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-petalynx.ko 2024-01-17T20:41:56.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 72937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-picolcd.ko 2024-01-17T20:41:56.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-pl.ko 2024-01-17T20:41:56.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-plantronics.ko 2024-01-17T20:41:56.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8417 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-primax.ko 2024-01-17T20:41:56.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-rmi.ko 2024-01-17T20:41:56.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-17T20:41:56.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-common.ko 2024-01-17T20:41:56.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-17T20:41:56.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-17T20:41:56.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-17T20:41:56.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-17T20:41:56.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-17T20:41:56.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-17T20:41:56.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-17T20:41:56.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-17T20:41:56.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-17T20:41:56.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat.ko 2024-01-17T20:41:56.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-saitek.ko 2024-01-17T20:41:56.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-samsung.ko 2024-01-17T20:41:56.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-17T20:41:56.464 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-sjoy.ko 2024-01-17T20:41:56.464 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-sony.ko 2024-01-17T20:41:56.464 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-speedlink.ko 2024-01-17T20:41:56.464 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-steelseries.ko 2024-01-17T20:41:56.464 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-sunplus.ko 2024-01-17T20:41:56.464 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-17T20:41:56.464 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-tivo.ko 2024-01-17T20:41:56.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-tmff.ko 2024-01-17T20:41:56.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-topseed.ko 2024-01-17T20:41:56.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-twinhan.ko 2024-01-17T20:41:56.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 71073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-uclogic.ko 2024-01-17T20:41:56.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-waltop.ko 2024-01-17T20:41:56.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 143473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-wiimote.ko 2024-01-17T20:41:56.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-xinmo.ko 2024-01-17T20:41:56.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-zpff.ko 2024-01-17T20:41:56.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-zydacron.ko 2024-01-17T20:41:56.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 269281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid.ko 2024-01-17T20:41:56.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/uhid.ko 2024-01-17T20:41:56.465 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/usbhid/ 2024-01-17T20:41:56.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 125785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/usbhid/usbhid.ko 2024-01-17T20:41:56.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/usbhid/usbkbd.ko 2024-01-17T20:41:56.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/usbhid/usbmouse.ko 2024-01-17T20:41:56.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 217873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/wacom.ko 2024-01-17T20:41:56.466 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hv/ 2024-01-17T20:41:56.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 64201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hv/hv_balloon.ko 2024-01-17T20:41:56.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hv/hv_utils.ko 2024-01-17T20:41:56.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 305321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hv/hv_vmbus.ko 2024-01-17T20:41:56.466 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ 2024-01-17T20:41:56.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/abituguru.ko 2024-01-17T20:41:56.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/abituguru3.ko 2024-01-17T20:41:56.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-17T20:41:56.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ad7414.ko 2024-01-17T20:41:56.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ad7418.ko 2024-01-17T20:41:56.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adc128d818.ko 2024-01-17T20:41:56.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adm1025.ko 2024-01-17T20:41:56.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 97977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adm1026.ko 2024-01-17T20:41:56.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adm1029.ko 2024-01-17T20:41:56.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adm1031.ko 2024-01-17T20:41:56.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adm9240.ko 2024-01-17T20:41:56.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ads7828.ko 2024-01-17T20:41:56.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adt7410.ko 2024-01-17T20:41:56.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adt7411.ko 2024-01-17T20:41:56.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 74409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adt7462.ko 2024-01-17T20:41:56.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adt7470.ko 2024-01-17T20:41:56.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adt7475.ko 2024-01-17T20:41:56.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adt7x10.ko 2024-01-17T20:41:56.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/amc6821.ko 2024-01-17T20:41:56.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/applesmc.ko 2024-01-17T20:41:56.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/asb100.ko 2024-01-17T20:41:56.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/asc7621.ko 2024-01-17T20:41:56.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-17T20:41:56.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/atxp1.ko 2024-01-17T20:41:56.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/coretemp.ko 2024-01-17T20:41:56.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/da9052-hwmon.ko 2024-01-17T20:41:56.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/da9055-hwmon.ko 2024-01-17T20:41:56.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-17T20:41:56.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 99601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/dme1737.ko 2024-01-17T20:41:56.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ds1621.ko 2024-01-17T20:41:56.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ds620.ko 2024-01-17T20:41:56.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/emc1403.ko 2024-01-17T20:41:56.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/emc2103.ko 2024-01-17T20:41:56.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/emc6w201.ko 2024-01-17T20:41:56.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/f71805f.ko 2024-01-17T20:41:56.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 94689 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/f71882fg.ko 2024-01-17T20:41:56.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/f75375s.ko 2024-01-17T20:41:56.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/fam15h_power.ko 2024-01-17T20:41:56.469 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/fschmd.ko 2024-01-17T20:41:56.469 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/g760a.ko 2024-01-17T20:41:56.469 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/g762.ko 2024-01-17T20:41:56.469 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/gl518sm.ko 2024-01-17T20:41:56.469 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/gl520sm.ko 2024-01-17T20:41:56.469 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/hih6130.ko 2024-01-17T20:41:56.469 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-17T20:41:56.469 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/i5500_temp.ko 2024-01-17T20:41:56.469 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/i5k_amb.ko 2024-01-17T20:41:56.469 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ibmaem.ko 2024-01-17T20:41:56.469 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ibmpex.ko 2024-01-17T20:41:56.469 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ina209.ko 2024-01-17T20:41:56.469 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ina2xx.ko 2024-01-17T20:41:56.469 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 130449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/it87.ko 2024-01-17T20:41:56.470 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/jc42.ko 2024-01-17T20:41:56.470 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/k10temp.ko 2024-01-17T20:41:56.470 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/k8temp.ko 2024-01-17T20:41:56.470 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lineage-pem.ko 2024-01-17T20:41:56.470 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm63.ko 2024-01-17T20:41:56.470 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm73.ko 2024-01-17T20:41:56.470 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm75.ko 2024-01-17T20:41:56.470 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm77.ko 2024-01-17T20:41:56.470 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm78.ko 2024-01-17T20:41:56.471 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm80.ko 2024-01-17T20:41:56.471 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm83.ko 2024-01-17T20:41:56.471 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 72833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm85.ko 2024-01-17T20:41:56.471 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm87.ko 2024-01-17T20:41:56.471 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm90.ko 2024-01-17T20:41:56.471 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm92.ko 2024-01-17T20:41:56.471 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 108841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm93.ko 2024-01-17T20:41:56.471 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm95234.ko 2024-01-17T20:41:56.471 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm95241.ko 2024-01-17T20:41:56.471 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm95245.ko 2024-01-17T20:41:56.471 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ltc2945.ko 2024-01-17T20:41:56.471 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ltc4151.ko 2024-01-17T20:41:56.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ltc4215.ko 2024-01-17T20:41:56.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ltc4222.ko 2024-01-17T20:41:56.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ltc4245.ko 2024-01-17T20:41:56.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ltc4260.ko 2024-01-17T20:41:56.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ltc4261.ko 2024-01-17T20:41:56.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/max16065.ko 2024-01-17T20:41:56.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/max1619.ko 2024-01-17T20:41:56.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/max1668.ko 2024-01-17T20:41:56.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/max197.ko 2024-01-17T20:41:56.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/max6639.ko 2024-01-17T20:41:56.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/max6650.ko 2024-01-17T20:41:56.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/max6697.ko 2024-01-17T20:41:56.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/mc13783-adc.ko 2024-01-17T20:41:56.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/mcp3021.ko 2024-01-17T20:41:56.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-01-17T20:41:56.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/nct6683.ko 2024-01-17T20:41:56.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 119689 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/nct6775-core.ko 2024-01-17T20:41:56.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/nct6775.ko 2024-01-17T20:41:56.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/nct7802.ko 2024-01-17T20:41:56.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 82337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pc87360.ko 2024-01-17T20:41:56.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pc87427.ko 2024-01-17T20:41:56.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pcf8591.ko 2024-01-17T20:41:56.473 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/ 2024-01-17T20:41:56.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-17T20:41:56.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-17T20:41:56.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-17T20:41:56.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-17T20:41:56.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-17T20:41:56.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-17T20:41:56.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-17T20:41:56.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 82577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-17T20:41:56.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-17T20:41:56.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-17T20:41:56.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-17T20:41:56.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-17T20:41:56.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/powr1220.ko 2024-01-17T20:41:56.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/sch5627.ko 2024-01-17T20:41:56.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/sch5636.ko 2024-01-17T20:41:56.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-17T20:41:56.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/sht15.ko 2024-01-17T20:41:56.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/sht21.ko 2024-01-17T20:41:56.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/shtc1.ko 2024-01-17T20:41:56.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/sis5595.ko 2024-01-17T20:41:56.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/smsc47b397.ko 2024-01-17T20:41:56.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/smsc47m1.ko 2024-01-17T20:41:56.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/smsc47m192.ko 2024-01-17T20:41:56.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/thmc50.ko 2024-01-17T20:41:56.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/tmp102.ko 2024-01-17T20:41:56.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/tmp103.ko 2024-01-17T20:41:56.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/tmp401.ko 2024-01-17T20:41:56.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/tmp421.ko 2024-01-17T20:41:56.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/via-cputemp.ko 2024-01-17T20:41:56.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/via686a.ko 2024-01-17T20:41:56.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/vt1211.ko 2024-01-17T20:41:56.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/vt8231.ko 2024-01-17T20:41:56.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/w83627ehf.ko 2024-01-17T20:41:56.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/w83627hf.ko 2024-01-17T20:41:56.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 71345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/w83781d.ko 2024-01-17T20:41:56.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 63225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/w83791d.ko 2024-01-17T20:41:56.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 71321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/w83792d.ko 2024-01-17T20:41:56.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 101473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/w83793.ko 2024-01-17T20:41:56.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 119505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/w83795.ko 2024-01-17T20:41:56.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/w83l785ts.ko 2024-01-17T20:41:56.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/w83l786ng.ko 2024-01-17T20:41:56.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-01-17T20:41:56.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-01-17T20:41:56.477 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/ 2024-01-17T20:41:56.477 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/algos/ 2024-01-17T20:41:56.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-17T20:41:56.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-17T20:41:56.477 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/ 2024-01-17T20:41:56.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-01-17T20:41:56.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-01-17T20:41:56.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-01-17T20:41:56.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-17T20:41:56.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-17T20:41:56.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-17T20:41:56.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-01-17T20:41:56.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-17T20:41:56.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-01-17T20:41:56.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-17T20:41:56.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-17T20:41:56.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-17T20:41:56.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-17T20:41:56.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-01-17T20:41:56.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-01-17T20:41:56.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 62681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-17T20:41:56.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-17T20:41:56.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-17T20:41:56.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-01-17T20:41:56.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-17T20:41:56.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-17T20:41:56.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-01-17T20:41:56.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-17T20:41:56.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-17T20:41:56.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-17T20:41:56.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-01-17T20:41:56.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-17T20:41:56.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-17T20:41:56.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-01-17T20:41:56.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29361 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-01-17T20:41:56.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-17T20:41:56.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-01-17T20:41:56.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-17T20:41:56.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-17T20:41:56.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-17T20:41:56.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-17T20:41:56.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-01-17T20:41:56.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/i2c-mux.ko 2024-01-17T20:41:56.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/i2c-smbus.ko 2024-01-17T20:41:56.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/i2c-stub.ko 2024-01-17T20:41:56.480 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/muxes/ 2024-01-17T20:41:56.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-01-17T20:41:56.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-01-17T20:41:56.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-01-17T20:41:56.480 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ 2024-01-17T20:41:56.480 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/core/ 2024-01-17T20:41:56.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 273609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-17T20:41:56.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 883681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/core/ib_core.ko 2024-01-17T20:41:56.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-17T20:41:56.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 324329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-17T20:41:56.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 97921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-17T20:41:56.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 282601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-17T20:41:56.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-17T20:41:56.481 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/ 2024-01-17T20:41:56.481 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/cxgb4/ 2024-01-17T20:41:56.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 493217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-17T20:41:56.481 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/mlx4/ 2024-01-17T20:41:56.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 420561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-17T20:41:56.481 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/mlx5/ 2024-01-17T20:41:56.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 741449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-17T20:41:56.482 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/mthca/ 2024-01-17T20:41:56.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 296881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-17T20:41:56.482 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/ocrdma/ 2024-01-17T20:41:56.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 153801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-01-17T20:41:56.482 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/usnic/ 2024-01-17T20:41:56.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 168969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-01-17T20:41:56.482 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/ 2024-01-17T20:41:56.482 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/ipoib/ 2024-01-17T20:41:56.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 263081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-17T20:41:56.482 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/iser/ 2024-01-17T20:41:56.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-17T20:41:56.482 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/isert/ 2024-01-17T20:41:56.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 111425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-17T20:41:56.482 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/srp/ 2024-01-17T20:41:56.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 128753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-17T20:41:56.483 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/srpt/ 2024-01-17T20:41:56.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 129529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-17T20:41:56.483 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/ 2024-01-17T20:41:56.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/evbug.ko 2024-01-17T20:41:56.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/ff-memless.ko 2024-01-17T20:41:56.483 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/gameport/ 2024-01-17T20:41:56.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-17T20:41:56.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-17T20:41:56.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/gameport/gameport.ko 2024-01-17T20:41:56.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/joydev.ko 2024-01-17T20:41:56.483 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/ 2024-01-17T20:41:56.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-01-17T20:41:56.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12705 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-01-17T20:41:56.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-01-17T20:41:56.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-01-17T20:41:56.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-17T20:41:56.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-01-17T20:41:56.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/lkkbd.ko 2024-01-17T20:41:56.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/lm8323.ko 2024-01-17T20:41:56.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/lm8333.ko 2024-01-17T20:41:56.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-01-17T20:41:56.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-01-17T20:41:56.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-01-17T20:41:56.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-01-17T20:41:56.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/newtonkbd.ko 2024-01-17T20:41:56.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-01-17T20:41:56.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/qt1070.ko 2024-01-17T20:41:56.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/qt2160.ko 2024-01-17T20:41:56.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-01-17T20:41:56.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/stowaway.ko 2024-01-17T20:41:56.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/sunkbd.ko 2024-01-17T20:41:56.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-01-17T20:41:56.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-01-17T20:41:56.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-01-17T20:41:56.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/xtkbd.ko 2024-01-17T20:41:56.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/matrix-keymap.ko 2024-01-17T20:41:56.485 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/ 2024-01-17T20:41:56.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/appletouch.ko 2024-01-17T20:41:56.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/bcm5974.ko 2024-01-17T20:41:56.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 123417 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/cyapatp.ko 2024-01-17T20:41:56.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-17T20:41:56.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/gpio_mouse.ko 2024-01-17T20:41:56.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 335953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/psmouse.ko 2024-01-17T20:41:56.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/sermouse.ko 2024-01-17T20:41:56.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-17T20:41:56.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-17T20:41:56.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-17T20:41:56.486 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/rmi4/ 2024-01-17T20:41:56.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 109873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-17T20:41:56.486 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/ 2024-01-17T20:41:56.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/altera_ps2.ko 2024-01-17T20:41:56.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/arc_ps2.ko 2024-01-17T20:41:56.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/ct82c710.ko 2024-01-17T20:41:56.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-17T20:41:56.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/parkbd.ko 2024-01-17T20:41:56.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/pcips2.ko 2024-01-17T20:41:56.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/ps2mult.ko 2024-01-17T20:41:56.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/serio_raw.ko 2024-01-17T20:41:56.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/serport.ko 2024-01-17T20:41:56.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/sparse-keymap.ko 2024-01-17T20:41:56.487 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/ 2024-01-17T20:41:56.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-88pm860x.ko 2024-01-17T20:41:56.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-adp5520.ko 2024-01-17T20:41:56.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-bd2802.ko 2024-01-17T20:41:56.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-blinkm.ko 2024-01-17T20:41:56.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-da903x.ko 2024-01-17T20:41:56.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-da9052.ko 2024-01-17T20:41:56.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-gpio.ko 2024-01-17T20:41:56.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-lm3530.ko 2024-01-17T20:41:56.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-lm3533.ko 2024-01-17T20:41:56.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-lm355x.ko 2024-01-17T20:41:56.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-lm3642.ko 2024-01-17T20:41:56.488 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-lp3944.ko 2024-01-17T20:41:56.488 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-lp8788.ko 2024-01-17T20:41:56.488 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-max8997.ko 2024-01-17T20:41:56.488 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-mc13783.ko 2024-01-17T20:41:56.488 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-menf21bmc.ko 2024-01-17T20:41:56.488 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-pca9532.ko 2024-01-17T20:41:56.488 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-pca955x.ko 2024-01-17T20:41:56.488 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-pca963x.ko 2024-01-17T20:41:56.488 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-ss4200.ko 2024-01-17T20:41:56.488 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-tca6507.ko 2024-01-17T20:41:56.488 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-wm831x-status.ko 2024-01-17T20:41:56.488 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-wm8350.ko 2024-01-17T20:41:56.488 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ 2024-01-17T20:41:56.488 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-17T20:41:56.489 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-17T20:41:56.489 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-17T20:41:56.489 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-17T20:41:56.489 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-17T20:41:56.489 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-17T20:41:56.489 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-17T20:41:56.489 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-17T20:41:56.489 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-17T20:41:56.489 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/ 2024-01-17T20:41:56.489 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/bcache/ 2024-01-17T20:41:56.489 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 647193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/bcache/bcache.ko 2024-01-17T20:41:56.489 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-bio-prison.ko 2024-01-17T20:41:56.489 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 93409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-bufio.ko 2024-01-17T20:41:56.489 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-cache-smq.ko 2024-01-17T20:41:56.489 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 155897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-cache.ko 2024-01-17T20:41:56.490 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 107257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-crypt.ko 2024-01-17T20:41:56.490 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-delay.ko 2024-01-17T20:41:56.490 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-era.ko 2024-01-17T20:41:56.490 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-flakey.ko 2024-01-17T20:41:56.490 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-log-userspace.ko 2024-01-17T20:41:56.490 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-log.ko 2024-01-17T20:41:56.490 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-mirror.ko 2024-01-17T20:41:56.490 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-multipath.ko 2024-01-17T20:41:56.490 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-queue-length.ko 2024-01-17T20:41:56.490 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 71073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-raid.ko 2024-01-17T20:41:56.490 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-region-hash.ko 2024-01-17T20:41:56.490 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-round-robin.ko 2024-01-17T20:41:56.490 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-service-time.ko 2024-01-17T20:41:56.490 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 109529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-snapshot.ko 2024-01-17T20:41:56.491 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19361 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-switch.ko 2024-01-17T20:41:56.491 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 181865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-thin-pool.ko 2024-01-17T20:41:56.491 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-verity.ko 2024-01-17T20:41:56.491 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-zero.ko 2024-01-17T20:41:56.491 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/faulty.ko 2024-01-17T20:41:56.491 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19369 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/linear.ko 2024-01-17T20:41:56.491 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32417 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/multipath.ko 2024-01-17T20:41:56.491 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/persistent-data/ 2024-01-17T20:41:56.491 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 199937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-17T20:41:56.491 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/raid0.ko 2024-01-17T20:41:56.491 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 113001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/raid1.ko 2024-01-17T20:41:56.491 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 158657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/raid10.ko 2024-01-17T20:41:56.491 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 393777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/raid456.ko 2024-01-17T20:41:56.492 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/message/ 2024-01-17T20:41:56.492 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/message/fusion/ 2024-01-17T20:41:56.492 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 178137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/message/fusion/mptbase.ko 2024-01-17T20:41:56.492 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 63321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/message/fusion/mptctl.ko 2024-01-17T20:41:56.492 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/message/fusion/mptfc.ko 2024-01-17T20:41:56.492 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/message/fusion/mptlan.ko 2024-01-17T20:41:56.492 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 123321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/message/fusion/mptsas.ko 2024-01-17T20:41:56.492 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 81009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/message/fusion/mptscsih.ko 2024-01-17T20:41:56.492 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/message/fusion/mptspi.ko 2024-01-17T20:41:56.492 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/ 2024-01-17T20:41:56.492 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/88pm800.ko 2024-01-17T20:41:56.492 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12761 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/88pm805.ko 2024-01-17T20:41:56.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/88pm80x.ko 2024-01-17T20:41:56.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/arizona-i2c.ko 2024-01-17T20:41:56.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 123721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/arizona.ko 2024-01-17T20:41:56.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/bcm590xx.ko 2024-01-17T20:41:56.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/cros_ec_dev.ko 2024-01-17T20:41:56.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/dln2.ko 2024-01-17T20:41:56.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16689 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/janz-cmodio.ko 2024-01-17T20:41:56.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/kempld-core.ko 2024-01-17T20:41:56.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/lm3533-core.ko 2024-01-17T20:41:56.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-01-17T20:41:56.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/lp3943.ko 2024-01-17T20:41:56.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/lpc_ich.ko 2024-01-17T20:41:56.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/lpc_sch.ko 2024-01-17T20:41:56.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/max8907.ko 2024-01-17T20:41:56.494 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/mc13xxx-core.ko 2024-01-17T20:41:56.494 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-01-17T20:41:56.494 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/menf21bmc.ko 2024-01-17T20:41:56.494 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/pcf50633-adc.ko 2024-01-17T20:41:56.494 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/pcf50633-gpio.ko 2024-01-17T20:41:56.494 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/pcf50633.ko 2024-01-17T20:41:56.494 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-01-17T20:41:56.494 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/retu-mfd.ko 2024-01-17T20:41:56.494 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 80425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/si476x-core.ko 2024-01-17T20:41:56.494 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/sm501.ko 2024-01-17T20:41:56.494 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/ti_am335x_tscadc.ko 2024-01-17T20:41:56.494 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/tps65010.ko 2024-01-17T20:41:56.495 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/tps6507x.ko 2024-01-17T20:41:56.495 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/viperboard.ko 2024-01-17T20:41:56.495 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/vx855.ko 2024-01-17T20:41:56.495 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/wl1273-core.ko 2024-01-17T20:41:56.495 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/wm8994.ko 2024-01-17T20:41:56.495 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/ 2024-01-17T20:41:56.495 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-01-17T20:41:56.495 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/ad525x_dpot.ko 2024-01-17T20:41:56.495 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/altera-stapl/ 2024-01-17T20:41:56.495 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-17T20:41:56.495 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/apds9802als.ko 2024-01-17T20:41:56.495 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/apds990x.ko 2024-01-17T20:41:56.496 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/bh1770glc.ko 2024-01-17T20:41:56.496 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/c2port/ 2024-01-17T20:41:56.496 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-01-17T20:41:56.496 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/c2port/core.ko 2024-01-17T20:41:56.496 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/cb710/ 2024-01-17T20:41:56.496 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/cb710/cb710.ko 2024-01-17T20:41:56.496 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/ds1682.ko 2024-01-17T20:41:56.496 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/dummy-irq.ko 2024-01-17T20:41:56.496 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/echo/ 2024-01-17T20:41:56.496 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/echo/echo.ko 2024-01-17T20:41:56.496 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/eeprom/ 2024-01-17T20:41:56.496 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/eeprom/at24.ko 2024-01-17T20:41:56.496 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-17T20:41:56.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/eeprom/max6875.ko 2024-01-17T20:41:56.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/enclosure.ko 2024-01-17T20:41:56.497 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/genwqe/ 2024-01-17T20:41:56.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 152201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-01-17T20:41:56.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/hmc6352.ko 2024-01-17T20:41:56.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/hpilo.ko 2024-01-17T20:41:56.497 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/ibmasm/ 2024-01-17T20:41:56.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 72601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-01-17T20:41:56.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/ics932s401.ko 2024-01-17T20:41:56.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/isl29003.ko 2024-01-17T20:41:56.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/isl29020.ko 2024-01-17T20:41:56.497 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/lis3lv02d/ 2024-01-17T20:41:56.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-17T20:41:56.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-17T20:41:56.497 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/mei/ 2024-01-17T20:41:56.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 125945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/mei/mei-me.ko 2024-01-17T20:41:56.498 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/mei/mei-txe.ko 2024-01-17T20:41:56.498 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 313641 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/mei/mei.ko 2024-01-17T20:41:56.498 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/phantom.ko 2024-01-17T20:41:56.498 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/ti-st/ 2024-01-17T20:41:56.498 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 74377 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/ti-st/st_drv.ko 2024-01-17T20:41:56.498 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/tifm_7xx1.ko 2024-01-17T20:41:56.498 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/tifm_core.ko 2024-01-17T20:41:56.498 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/tsl2550.ko 2024-01-17T20:41:56.498 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/vmw_balloon.ko 2024-01-17T20:41:56.498 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/vmw_vmci/ 2024-01-17T20:41:56.498 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 183609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-17T20:41:56.498 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ 2024-01-17T20:41:56.498 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/bonding/ 2024-01-17T20:41:56.498 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 490849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/bonding/bonding.ko 2024-01-17T20:41:56.499 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/dsa/ 2024-01-17T20:41:56.499 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/dsa/b53/ 2024-01-17T20:41:56.499 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 106033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-17T20:41:56.499 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-17T20:41:56.499 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-17T20:41:56.499 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/dsa/mv88e6xxx/ 2024-01-17T20:41:56.499 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 455065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-17T20:41:56.499 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/dummy.ko 2024-01-17T20:41:56.499 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/eql.ko 2024-01-17T20:41:56.499 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/ 2024-01-17T20:41:56.499 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/3com/ 2024-01-17T20:41:56.499 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-17T20:41:56.499 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-17T20:41:56.499 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 130553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-17T20:41:56.499 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 68849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-17T20:41:56.500 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/8390/ 2024-01-17T20:41:56.500 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-17T20:41:56.500 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59689 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-17T20:41:56.500 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-17T20:41:56.500 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 99049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-17T20:41:56.500 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/adaptec/ 2024-01-17T20:41:56.500 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-17T20:41:56.500 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/agere/ 2024-01-17T20:41:56.500 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-17T20:41:56.500 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/alteon/ 2024-01-17T20:41:56.500 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-17T20:41:56.500 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/altera/ 2024-01-17T20:41:56.500 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-17T20:41:56.500 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/amd/ 2024-01-17T20:41:56.501 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-17T20:41:56.501 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-17T20:41:56.501 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 87297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-17T20:41:56.501 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/ 2024-01-17T20:41:56.501 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/alx/ 2024-01-17T20:41:56.501 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 97337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-17T20:41:56.501 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-01-17T20:41:56.501 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 102497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-17T20:41:56.501 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-01-17T20:41:56.501 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 90345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-17T20:41:56.501 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/atlx/ 2024-01-17T20:41:56.501 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 81569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-17T20:41:56.501 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-17T20:41:56.501 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/broadcom/ 2024-01-17T20:41:56.501 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-17T20:41:56.502 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 176761 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-17T20:41:56.502 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-01-17T20:41:56.502 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1421529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-17T20:41:56.502 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 128569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-17T20:41:56.502 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/broadcom/genet/ 2024-01-17T20:41:56.502 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 131337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-17T20:41:56.502 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 314553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-17T20:41:56.502 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/brocade/ 2024-01-17T20:41:56.502 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/brocade/bna/ 2024-01-17T20:41:56.502 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 323745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-17T20:41:56.502 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/ 2024-01-17T20:41:56.502 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-01-17T20:41:56.502 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 193497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-17T20:41:56.503 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-01-17T20:41:56.503 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 347257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-17T20:41:56.503 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-01-17T20:41:56.503 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1044793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-17T20:41:56.503 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-01-17T20:41:56.503 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 166193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-17T20:41:56.648 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-01-17T20:41:56.648 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-17T20:41:56.648 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/cisco/ 2024-01-17T20:41:56.648 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/cisco/enic/ 2024-01-17T20:41:56.648 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 204345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-17T20:41:56.648 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dec/ 2024-01-17T20:41:56.648 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dec/tulip/ 2024-01-17T20:41:56.648 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-17T20:41:56.648 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-17T20:41:56.648 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 141225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-17T20:41:56.648 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-17T20:41:56.649 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 62817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-17T20:41:56.649 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31369 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-17T20:41:56.649 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dlink/ 2024-01-17T20:41:56.649 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-17T20:41:56.649 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 62833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-17T20:41:56.649 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dnet.ko 2024-01-17T20:41:56.649 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/ec_bhf.ko 2024-01-17T20:41:56.649 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/emulex/ 2024-01-17T20:41:56.649 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/emulex/benet/ 2024-01-17T20:41:56.649 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 281137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-17T20:41:56.649 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/ethoc.ko 2024-01-17T20:41:56.649 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/fealnx.ko 2024-01-17T20:41:56.649 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/fujitsu/ 2024-01-17T20:41:56.650 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-01-17T20:41:56.650 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/ 2024-01-17T20:41:56.650 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 90369 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-17T20:41:56.650 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/e1000/ 2024-01-17T20:41:56.650 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 295481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-17T20:41:56.650 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/e1000e/ 2024-01-17T20:41:56.650 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 584497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-17T20:41:56.650 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/fm10k/ 2024-01-17T20:41:56.651 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 246209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-17T20:41:56.651 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/i40e/ 2024-01-17T20:41:56.651 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 937673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-17T20:41:56.651 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/iavf/ 2024-01-17T20:41:56.651 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 287305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-17T20:41:56.651 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/igb/ 2024-01-17T20:41:56.651 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 514569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-17T20:41:56.651 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/igbvf/ 2024-01-17T20:41:56.651 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 93497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-17T20:41:56.651 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-01-17T20:41:56.651 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 734353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-17T20:41:56.651 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-01-17T20:41:56.651 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 151769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-17T20:41:56.651 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 86921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/jme.ko 2024-01-17T20:41:56.651 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/marvell/ 2024-01-17T20:41:56.652 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-17T20:41:56.652 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 102289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-17T20:41:56.652 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 122601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-17T20:41:56.652 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/mellanox/ 2024-01-17T20:41:56.652 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-01-17T20:41:56.652 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 727473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-17T20:41:56.652 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 278961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-17T20:41:56.652 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-01-17T20:41:56.652 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-01-17T20:41:56.652 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1118201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-17T20:41:56.652 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/micrel/ 2024-01-17T20:41:56.652 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-01-17T20:41:56.652 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-01-17T20:41:56.652 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-01-17T20:41:56.653 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 95665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-17T20:41:56.653 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/myricom/ 2024-01-17T20:41:56.653 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-01-17T20:41:56.653 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 108649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-17T20:41:56.653 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/natsemi/ 2024-01-17T20:41:56.653 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-17T20:41:56.653 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-17T20:41:56.653 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/neterion/ 2024-01-17T20:41:56.653 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 150905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-17T20:41:56.653 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/nvidia/ 2024-01-17T20:41:56.653 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 136721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-17T20:41:56.654 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/packetengines/ 2024-01-17T20:41:56.654 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-17T20:41:56.654 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-17T20:41:56.654 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/qlogic/ 2024-01-17T20:41:56.654 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-01-17T20:41:56.654 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 227897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-17T20:41:56.654 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 87105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-17T20:41:56.654 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-01-17T20:41:56.654 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 671937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-17T20:41:56.654 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/rdc/ 2024-01-17T20:41:56.654 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-17T20:41:56.654 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/realtek/ 2024-01-17T20:41:56.654 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-17T20:41:56.655 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 83985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-17T20:41:56.655 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-17T20:41:56.655 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 192353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-17T20:41:56.655 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/samsung/ 2024-01-17T20:41:56.655 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-01-17T20:41:56.655 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 104241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-01-17T20:41:56.655 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sfc/ 2024-01-17T20:41:56.655 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1064737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-17T20:41:56.656 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/silan/ 2024-01-17T20:41:56.656 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-17T20:41:56.656 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sis/ 2024-01-17T20:41:56.656 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-17T20:41:56.656 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 63337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-17T20:41:56.656 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/smsc/ 2024-01-17T20:41:56.656 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-17T20:41:56.656 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-17T20:41:56.656 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-17T20:41:56.656 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 68177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-17T20:41:56.656 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/stmicro/ 2024-01-17T20:41:56.656 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-01-17T20:41:56.656 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-01-17T20:41:56.657 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-17T20:41:56.657 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-01-17T20:41:56.657 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 487593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-17T20:41:56.657 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sun/ 2024-01-17T20:41:56.657 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 103337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-17T20:41:56.657 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 166097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-17T20:41:56.657 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-17T20:41:56.657 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-17T20:41:56.657 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/tehuti/ 2024-01-17T20:41:56.657 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-17T20:41:56.657 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/ti/ 2024-01-17T20:41:56.657 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 86529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-17T20:41:56.657 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/via/ 2024-01-17T20:41:56.657 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 80273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-17T20:41:56.658 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 83793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-17T20:41:56.658 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/wiznet/ 2024-01-17T20:41:56.658 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-17T20:41:56.658 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-17T20:41:56.658 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/xircom/ 2024-01-17T20:41:56.658 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-17T20:41:56.658 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/fddi/ 2024-01-17T20:41:56.658 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/fddi/defxx.ko 2024-01-17T20:41:56.658 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/fddi/skfp/ 2024-01-17T20:41:56.658 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 216985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/fddi/skfp/skfp.ko 2024-01-17T20:41:56.658 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 74569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/geneve.ko 2024-01-17T20:41:56.658 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/hyperv/ 2024-01-17T20:41:56.658 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 236225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-17T20:41:56.658 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ieee802154/ 2024-01-17T20:41:56.659 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-17T20:41:56.659 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ifb.ko 2024-01-17T20:41:56.659 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ipvlan/ 2024-01-17T20:41:56.659 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 85817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-17T20:41:56.659 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 62769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/macvlan.ko 2024-01-17T20:41:56.659 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/macvtap.ko 2024-01-17T20:41:56.659 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/mdio/ 2024-01-17T20:41:56.659 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-17T20:41:56.659 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-17T20:41:56.659 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/mdio/mdio-gpio.ko 2024-01-17T20:41:56.659 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-17T20:41:56.659 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/mdio.ko 2024-01-17T20:41:56.660 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/mii.ko 2024-01-17T20:41:56.660 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/netconsole.ko 2024-01-17T20:41:56.660 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/nlmon.ko 2024-01-17T20:41:56.660 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/pcs/ 2024-01-17T20:41:56.660 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-17T20:41:56.660 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-17T20:41:56.660 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/ 2024-01-17T20:41:56.660 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/amd.ko 2024-01-17T20:41:56.660 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-17T20:41:56.661 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-17T20:41:56.661 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11641 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/bcm87xx.ko 2024-01-17T20:41:56.661 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/broadcom.ko 2024-01-17T20:41:56.661 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/cicada.ko 2024-01-17T20:41:56.661 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/davicom.ko 2024-01-17T20:41:56.661 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/et1011c.ko 2024-01-17T20:41:56.661 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/icplus.ko 2024-01-17T20:41:56.661 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/lxt.ko 2024-01-17T20:41:56.661 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 82049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/marvell.ko 2024-01-17T20:41:56.661 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 76409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/micrel.ko 2024-01-17T20:41:56.661 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/national.ko 2024-01-17T20:41:56.661 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 95561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/phylink.ko 2024-01-17T20:41:56.661 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/qsemi.ko 2024-01-17T20:41:56.661 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/realtek.ko 2024-01-17T20:41:56.662 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/smsc.ko 2024-01-17T20:41:56.662 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/ste10Xp.ko 2024-01-17T20:41:56.662 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/vitesse.ko 2024-01-17T20:41:56.662 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/plip/ 2024-01-17T20:41:56.662 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/plip/plip.ko 2024-01-17T20:41:56.662 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ppp/ 2024-01-17T20:41:56.662 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-17T20:41:56.662 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ppp/ppp_async.ko 2024-01-17T20:41:56.662 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-17T20:41:56.662 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-17T20:41:56.662 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-17T20:41:56.662 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ppp/pppoe.ko 2024-01-17T20:41:56.662 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ppp/pppox.ko 2024-01-17T20:41:56.662 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ppp/pptp.ko 2024-01-17T20:41:56.663 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/sb1000.ko 2024-01-17T20:41:56.663 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/slip/ 2024-01-17T20:41:56.663 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/slip/slip.ko 2024-01-17T20:41:56.663 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/sungem_phy.ko 2024-01-17T20:41:56.663 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 64585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/tap.ko 2024-01-17T20:41:56.663 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/team/ 2024-01-17T20:41:56.663 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 107089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/team/team.ko 2024-01-17T20:41:56.663 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-17T20:41:56.663 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-17T20:41:56.663 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-17T20:41:56.663 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9641 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/team/team_mode_random.ko 2024-01-17T20:41:56.663 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-17T20:41:56.663 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 86945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/veth.ko 2024-01-17T20:41:56.663 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/vmxnet3/ 2024-01-17T20:41:56.663 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 144361 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-17T20:41:56.663 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/vxlan/ 2024-01-17T20:41:56.664 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 301281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/vxlan/vxlan.ko 2024-01-17T20:41:56.664 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/xen-netback/ 2024-01-17T20:41:56.664 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 144001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-17T20:41:56.664 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ntb/ 2024-01-17T20:41:56.664 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ntb/ntb.ko 2024-01-17T20:41:56.664 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/nvme/ 2024-01-17T20:41:56.664 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/nvme/host/ 2024-01-17T20:41:56.664 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 265777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/nvme/host/nvme-core.ko 2024-01-17T20:41:56.664 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 102545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/nvme/host/nvme.ko 2024-01-17T20:41:56.664 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/parport/ 2024-01-17T20:41:56.664 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 131249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/parport/parport.ko 2024-01-17T20:41:56.664 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/parport/parport_cs.ko 2024-01-17T20:41:56.665 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 85377 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/parport/parport_pc.ko 2024-01-17T20:41:56.665 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/parport/parport_serial.ko 2024-01-17T20:41:56.665 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pci/ 2024-01-17T20:41:56.665 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pci/hotplug/ 2024-01-17T20:41:56.665 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-17T20:41:56.665 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-01-17T20:41:56.665 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-01-17T20:41:56.665 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pci/pci-stub.ko 2024-01-17T20:41:56.665 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pci/xen-pcifront.ko 2024-01-17T20:41:56.665 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pcmcia/ 2024-01-17T20:41:56.665 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pcmcia/i82092.ko 2024-01-17T20:41:56.665 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 146289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pcmcia/pcmcia.ko 2024-01-17T20:41:56.665 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 62161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pcmcia/pcmcia_core.ko 2024-01-17T20:41:56.665 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-01-17T20:41:56.666 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pcmcia/pd6729.ko 2024-01-17T20:41:56.666 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 112889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-17T20:41:56.666 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/phy/ 2024-01-17T20:41:56.666 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/phy/broadcom/ 2024-01-17T20:41:56.666 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-01-17T20:41:56.666 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/phy/samsung/ 2024-01-17T20:41:56.666 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-01-17T20:41:56.666 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pinctrl/ 2024-01-17T20:41:56.666 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pinctrl/intel/ 2024-01-17T20:41:56.666 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-17T20:41:56.666 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/ 2024-01-17T20:41:56.666 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/chrome/ 2024-01-17T20:41:56.666 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-01-17T20:41:56.666 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/chrome/cros_ec.ko 2024-01-17T20:41:56.666 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-01-17T20:41:56.666 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-01-17T20:41:56.667 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-01-17T20:41:56.667 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-01-17T20:41:56.667 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17361 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-01-17T20:41:56.667 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/ 2024-01-17T20:41:56.667 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-17T20:41:56.667 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/acerhdf.ko 2024-01-17T20:41:56.667 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-17T20:41:56.667 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-17T20:41:56.667 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-17T20:41:56.667 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 132025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-17T20:41:56.667 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-17T20:41:56.667 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-17T20:41:56.667 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-17T20:41:56.668 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-17T20:41:56.668 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-17T20:41:56.668 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/hdaps.ko 2024-01-17T20:41:56.668 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/ibm_rtl.ko 2024-01-17T20:41:56.668 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/intel/ 2024-01-17T20:41:56.668 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-17T20:41:56.668 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-01-17T20:41:56.669 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/intel_ips.ko 2024-01-17T20:41:56.669 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-17T20:41:56.669 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10377 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-17T20:41:56.669 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-17T20:41:56.669 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-17T20:41:56.669 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-17T20:41:56.669 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-17T20:41:56.669 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-17T20:41:56.670 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-17T20:41:56.670 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-17T20:41:56.670 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/wmi.ko 2024-01-17T20:41:56.670 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/ 2024-01-17T20:41:56.670 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/ 2024-01-17T20:41:56.670 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/88pm860x_battery.ko 2024-01-17T20:41:56.671 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/88pm860x_charger.ko 2024-01-17T20:41:56.671 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/bq2415x_charger.ko 2024-01-17T20:41:56.671 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/bq24190_charger.ko 2024-01-17T20:41:56.671 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/bq24735-charger.ko 2024-01-17T20:41:56.671 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-01-17T20:41:56.671 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/da9030_battery.ko 2024-01-17T20:41:56.671 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/da9052-battery.ko 2024-01-17T20:41:56.672 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/ds2760_battery.ko 2024-01-17T20:41:56.672 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/ds2780_battery.ko 2024-01-17T20:41:56.672 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/ds2781_battery.ko 2024-01-17T20:41:56.672 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/ds2782_battery.ko 2024-01-17T20:41:56.672 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/gpio-charger.ko 2024-01-17T20:41:56.672 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/isp1704_charger.ko 2024-01-17T20:41:56.672 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/lp8727_charger.ko 2024-01-17T20:41:56.673 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/max14577_charger.ko 2024-01-17T20:41:56.673 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/max17042_battery.ko 2024-01-17T20:41:56.673 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/max8903_charger.ko 2024-01-17T20:41:56.673 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/max8925_power.ko 2024-01-17T20:41:56.673 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/pcf50633-charger.ko 2024-01-17T20:41:56.673 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/sbs-battery.ko 2024-01-17T20:41:56.673 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/test_power.ko 2024-01-17T20:41:56.673 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/tps65090-charger.ko 2024-01-17T20:41:56.674 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/wm831x_backup.ko 2024-01-17T20:41:56.674 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/wm831x_power.ko 2024-01-17T20:41:56.674 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22417 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/wm8350_power.ko 2024-01-17T20:41:56.674 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/powercap/ 2024-01-17T20:41:56.674 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-17T20:41:56.674 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-17T20:41:56.674 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pps/ 2024-01-17T20:41:56.675 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pps/clients/ 2024-01-17T20:41:56.675 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-17T20:41:56.675 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-17T20:41:56.675 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pps/clients/pps_parport.ko 2024-01-17T20:41:56.675 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pps/pps_core.ko 2024-01-17T20:41:56.675 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ptp/ 2024-01-17T20:41:56.676 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ptp/ptp.ko 2024-01-17T20:41:56.676 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ptp/ptp_kvm.ko 2024-01-17T20:41:56.676 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/ 2024-01-17T20:41:56.676 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-88pm80x.ko 2024-01-17T20:41:56.676 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-88pm860x.ko 2024-01-17T20:41:56.676 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-17T20:41:56.677 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-da9052.ko 2024-01-17T20:41:56.677 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-da9055.ko 2024-01-17T20:41:56.677 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-da9063.ko 2024-01-17T20:41:56.677 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-17T20:41:56.677 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 68577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-17T20:41:56.677 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-17T20:41:56.677 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-17T20:41:56.677 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-17T20:41:56.678 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-17T20:41:56.678 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13369 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-17T20:41:56.678 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-17T20:41:56.678 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23705 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-17T20:41:56.678 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-em3027.ko 2024-01-17T20:41:56.678 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-17T20:41:56.678 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-17T20:41:56.678 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-17T20:41:56.678 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-lp8788.ko 2024-01-17T20:41:56.678 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-17T20:41:56.678 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-17T20:41:56.678 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-17T20:41:56.679 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-m48t86.ko 2024-01-17T20:41:56.679 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-max6900.ko 2024-01-17T20:41:56.679 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-max8907.ko 2024-01-17T20:41:56.679 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-max8925.ko 2024-01-17T20:41:56.679 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-max8997.ko 2024-01-17T20:41:56.679 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-max8998.ko 2024-01-17T20:41:56.679 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-01-17T20:41:56.679 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-17T20:41:56.679 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-palmas.ko 2024-01-17T20:41:56.679 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-17T20:41:56.679 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-pcf50633.ko 2024-01-17T20:41:56.679 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-17T20:41:56.679 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-17T20:41:56.679 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-17T20:41:56.680 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-17T20:41:56.680 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-rc5t583.ko 2024-01-17T20:41:56.680 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-17T20:41:56.680 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-17T20:41:56.680 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-17T20:41:56.680 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-17T20:41:56.680 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-17T20:41:56.680 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-s35390a.ko 2024-01-17T20:41:56.680 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-17T20:41:56.680 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-tps6586x.ko 2024-01-17T20:41:56.680 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-tps65910.ko 2024-01-17T20:41:56.680 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-wm831x.ko 2024-01-17T20:41:56.681 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-wm8350.ko 2024-01-17T20:41:56.681 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-x1205.ko 2024-01-17T20:41:56.681 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/ 2024-01-17T20:41:56.681 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 77617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/3w-9xxx.ko 2024-01-17T20:41:56.681 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/3w-sas.ko 2024-01-17T20:41:56.681 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/3w-xxxx.ko 2024-01-17T20:41:56.681 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 135185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/BusLogic.ko 2024-01-17T20:41:56.681 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/a100u2w.ko 2024-01-17T20:41:56.681 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/aacraid/ 2024-01-17T20:41:56.681 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 271113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-17T20:41:56.681 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/advansys.ko 2024-01-17T20:41:56.681 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/aic7xxx/ 2024-01-17T20:41:56.681 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 356929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-17T20:41:56.681 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 296049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-17T20:41:56.682 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/aic94xx/ 2024-01-17T20:41:56.682 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 189185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-01-17T20:41:56.682 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/am53c974.ko 2024-01-17T20:41:56.682 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/arcmsr/ 2024-01-17T20:41:56.682 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 106881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-17T20:41:56.682 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/atp870u.ko 2024-01-17T20:41:56.682 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/be2iscsi/ 2024-01-17T20:41:56.682 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 247009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-17T20:41:56.682 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/bfa/ 2024-01-17T20:41:56.682 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1171945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/bfa/bfa.ko 2024-01-17T20:41:56.682 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/bnx2fc/ 2024-01-17T20:41:56.682 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 237721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-17T20:41:56.682 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/bnx2i/ 2024-01-17T20:41:56.682 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 115369 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-17T20:41:56.682 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/ch.ko 2024-01-17T20:41:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/csiostor/ 2024-01-17T20:41:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 308921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-17T20:41:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/cxgbi/ 2024-01-17T20:41:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-01-17T20:41:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 76145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-17T20:41:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-01-17T20:41:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 101449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-17T20:41:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 146625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-17T20:41:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 75553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/dc395x.ko 2024-01-17T20:41:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/dmx3191d.ko 2024-01-17T20:41:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/esas2r/ 2024-01-17T20:41:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 212425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-17T20:41:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/esp_scsi.ko 2024-01-17T20:41:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/fcoe/ 2024-01-17T20:41:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-17T20:41:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 158505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-17T20:41:56.684 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/fdomain.ko 2024-01-17T20:41:56.684 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/fnic/ 2024-01-17T20:41:56.684 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 263489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/fnic/fnic.ko 2024-01-17T20:41:56.684 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 201817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/hpsa.ko 2024-01-17T20:41:56.684 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/hptiop.ko 2024-01-17T20:41:56.684 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/hv_storvsc.ko 2024-01-17T20:41:56.684 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/imm.ko 2024-01-17T20:41:56.684 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/initio.ko 2024-01-17T20:41:56.684 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 266537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/ipr.ko 2024-01-17T20:41:56.684 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 101473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/ips.ko 2024-01-17T20:41:56.684 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/isci/ 2024-01-17T20:41:56.684 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 317153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/isci/isci.ko 2024-01-17T20:41:56.684 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-17T20:41:56.684 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-17T20:41:56.685 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/libfc/ 2024-01-17T20:41:56.685 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 315209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/libfc/libfc.ko 2024-01-17T20:41:56.685 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 145585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/libiscsi.ko 2024-01-17T20:41:56.685 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-17T20:41:56.685 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/libsas/ 2024-01-17T20:41:56.685 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 216441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/libsas/libsas.ko 2024-01-17T20:41:56.685 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/lpfc/ 2024-01-17T20:41:56.685 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 2197481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-17T20:41:56.685 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/megaraid/ 2024-01-17T20:41:56.685 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-17T20:41:56.685 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-17T20:41:56.685 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 310841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-17T20:41:56.685 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 84649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/megaraid.ko 2024-01-17T20:41:56.686 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/mpt3sas/ 2024-01-17T20:41:56.686 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 659801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-17T20:41:56.686 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/mvsas/ 2024-01-17T20:41:56.686 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 119561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-17T20:41:56.686 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/mvumi.ko 2024-01-17T20:41:56.686 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/pcmcia/ 2024-01-17T20:41:56.686 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 81649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-01-17T20:41:56.686 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-01-17T20:41:56.686 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-01-17T20:41:56.686 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-01-17T20:41:56.686 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/pm8001/ 2024-01-17T20:41:56.686 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 366401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-17T20:41:56.686 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 124633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/pmcraid.ko 2024-01-17T20:41:56.686 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/ppa.ko 2024-01-17T20:41:56.686 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/qla1280.ko 2024-01-17T20:41:56.686 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/qla2xxx/ 2024-01-17T20:41:56.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1876633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-17T20:41:56.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 85289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-17T20:41:56.687 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/qla4xxx/ 2024-01-17T20:41:56.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 559033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-17T20:41:56.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/qlogicfas408.ko 2024-01-17T20:41:56.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/raid_class.ko 2024-01-17T20:41:56.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 261241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/scsi_debug.ko 2024-01-17T20:41:56.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 173937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-17T20:41:56.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 279313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-17T20:41:56.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 97729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-17T20:41:56.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-17T20:41:56.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-17T20:41:56.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/ses.ko 2024-01-17T20:41:56.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 115889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/st.ko 2024-01-17T20:41:56.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/stex.ko 2024-01-17T20:41:56.687 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/sym53c8xx_2/ 2024-01-17T20:41:56.688 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 164961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-17T20:41:56.688 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/virtio_scsi.ko 2024-01-17T20:41:56.688 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-17T20:41:56.688 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/wd719x.ko 2024-01-17T20:41:56.688 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/xen-scsifront.ko 2024-01-17T20:41:56.688 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ssb/ 2024-01-17T20:41:56.688 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 129441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ssb/ssb.ko 2024-01-17T20:41:56.688 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/ 2024-01-17T20:41:56.688 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/iscsi/ 2024-01-17T20:41:56.688 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 736769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-17T20:41:56.688 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/loopback/ 2024-01-17T20:41:56.688 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-17T20:41:56.688 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/target_core_file.ko 2024-01-17T20:41:56.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/target_core_iblock.ko 2024-01-17T20:41:56.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 930697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/target_core_mod.ko 2024-01-17T20:41:56.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/target_core_pscsi.ko 2024-01-17T20:41:56.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 122521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/target_core_user.ko 2024-01-17T20:41:56.689 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/tcm_fc/ 2024-01-17T20:41:56.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 75593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-17T20:41:56.689 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/ 2024-01-17T20:41:56.689 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/ 2024-01-17T20:41:56.689 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/ 2024-01-17T20:41:56.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-17T20:41:56.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-17T20:41:56.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-17T20:41:56.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-17T20:41:56.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-17T20:41:56.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-17T20:41:56.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-17T20:41:56.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-17T20:41:56.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-17T20:41:56.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-17T20:41:56.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-17T20:41:56.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-17T20:41:56.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-17T20:41:56.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-17T20:41:56.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-17T20:41:56.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-01-17T20:41:56.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-17T20:41:56.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-17T20:41:56.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-17T20:41:56.690 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/ 2024-01-17T20:41:56.690 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/ipwireless/ 2024-01-17T20:41:56.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-17T20:41:56.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/moxa.ko 2024-01-17T20:41:56.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/mxser.ko 2024-01-17T20:41:56.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 108601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/n_gsm.ko 2024-01-17T20:41:56.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/n_hdlc.ko 2024-01-17T20:41:56.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/nozomi.ko 2024-01-17T20:41:56.691 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/ 2024-01-17T20:41:56.691 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/8250/ 2024-01-17T20:41:56.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-01-17T20:41:56.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-17T20:41:56.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-01-17T20:41:56.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/altera_uart.ko 2024-01-17T20:41:56.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/arc_uart.ko 2024-01-17T20:41:56.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 72425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-01-17T20:41:56.691 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/jsm/ 2024-01-17T20:41:56.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 103073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-17T20:41:56.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/rp2.ko 2024-01-17T20:41:56.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/sc16is7xx.ko 2024-01-17T20:41:56.692 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ufs/ 2024-01-17T20:41:56.692 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ufs/core/ 2024-01-17T20:41:56.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 535985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-17T20:41:56.692 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ufs/host/ 2024-01-17T20:41:56.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-17T20:41:56.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-01-17T20:41:56.692 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/ 2024-01-17T20:41:56.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/uio.ko 2024-01-17T20:41:56.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/uio_aec.ko 2024-01-17T20:41:56.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/uio_cif.ko 2024-01-17T20:41:56.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/uio_dmem_genirq.ko 2024-01-17T20:41:56.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/uio_mf624.ko 2024-01-17T20:41:56.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/uio_netx.ko 2024-01-17T20:41:56.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/uio_pci_generic.ko 2024-01-17T20:41:56.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-01-17T20:41:56.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/uio_sercos3.ko 2024-01-17T20:41:56.693 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/ 2024-01-17T20:41:56.693 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/c67x00/ 2024-01-17T20:41:56.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/c67x00/c67x00.ko 2024-01-17T20:41:56.693 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/chipidea/ 2024-01-17T20:41:56.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 144617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-01-17T20:41:56.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-01-17T20:41:56.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-01-17T20:41:56.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-01-17T20:41:56.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-01-17T20:41:56.694 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/class/ 2024-01-17T20:41:56.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 87073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/class/cdc-acm.ko 2024-01-17T20:41:56.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-17T20:41:56.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/class/usblp.ko 2024-01-17T20:41:56.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/class/usbtmc.ko 2024-01-17T20:41:56.694 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/common/ 2024-01-17T20:41:56.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/common/ulpi.ko 2024-01-17T20:41:56.694 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/dwc2/ 2024-01-17T20:41:56.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-01-17T20:41:56.695 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/dwc3/ 2024-01-17T20:41:56.695 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-01-17T20:41:56.695 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-01-17T20:41:56.695 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 454385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/dwc3/dwc3.ko 2024-01-17T20:41:56.695 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/ 2024-01-17T20:41:56.695 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/ 2024-01-17T20:41:56.695 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/u_ether.ko 2024-01-17T20:41:56.695 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/u_serial.ko 2024-01-17T20:41:56.695 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-01-17T20:41:56.695 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-01-17T20:41:56.696 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-01-17T20:41:56.696 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-01-17T20:41:56.696 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 92489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-01-17T20:41:56.696 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-01-17T20:41:56.696 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 122081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-01-17T20:41:56.696 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-01-17T20:41:56.696 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-01-17T20:41:56.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-01-17T20:41:56.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-01-17T20:41:56.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 85609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-01-17T20:41:56.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-01-17T20:41:56.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-01-17T20:41:56.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-01-17T20:41:56.697 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/ 2024-01-17T20:41:56.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-01-17T20:41:56.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-01-17T20:41:56.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-01-17T20:41:56.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-01-17T20:41:56.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-01-17T20:41:56.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-01-17T20:41:56.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-01-17T20:41:56.698 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-01-17T20:41:56.698 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-01-17T20:41:56.698 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-01-17T20:41:56.698 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-01-17T20:41:56.698 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-01-17T20:41:56.698 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 62361 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-01-17T20:41:56.698 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-01-17T20:41:56.698 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 161225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/libcomposite.ko 2024-01-17T20:41:56.698 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/ 2024-01-17T20:41:56.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17705 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-01-17T20:41:56.699 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/bdc/ 2024-01-17T20:41:56.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 157681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-01-17T20:41:56.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-01-17T20:41:56.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-01-17T20:41:56.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69705 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-01-17T20:41:56.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-01-17T20:41:56.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 76057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/net2272.ko 2024-01-17T20:41:56.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 75073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/net2280.ko 2024-01-17T20:41:56.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-01-17T20:41:56.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 65809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-01-17T20:41:56.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-01-17T20:41:56.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 81505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-01-17T20:41:56.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 156409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-01-17T20:41:56.700 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/host/ 2024-01-17T20:41:56.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/host/bcma-hcd.ko 2024-01-17T20:41:56.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 80113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/host/isp116x-hcd.ko 2024-01-17T20:41:56.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 87353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-01-17T20:41:56.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-01-17T20:41:56.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-17T20:41:56.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/host/sl811_cs.ko 2024-01-17T20:41:56.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/host/ssb-hcd.ko 2024-01-17T20:41:56.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-01-17T20:41:56.700 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/image/ 2024-01-17T20:41:56.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/image/mdc800.ko 2024-01-17T20:41:56.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/image/microtek.ko 2024-01-17T20:41:56.701 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/ 2024-01-17T20:41:56.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/adutux.ko 2024-01-17T20:41:56.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/appledisplay.ko 2024-01-17T20:41:56.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-01-17T20:41:56.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/cytherm.ko 2024-01-17T20:41:56.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/ehset.ko 2024-01-17T20:41:56.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/emi26.ko 2024-01-17T20:41:56.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/emi62.ko 2024-01-17T20:41:56.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/ezusb.ko 2024-01-17T20:41:56.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/idmouse.ko 2024-01-17T20:41:56.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/iowarrior.ko 2024-01-17T20:41:56.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-17T20:41:56.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/ldusb.ko 2024-01-17T20:41:56.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/legousbtower.ko 2024-01-17T20:41:56.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/lvstest.ko 2024-01-17T20:41:56.702 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/sisusbvga/ 2024-01-17T20:41:56.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 64841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-17T20:41:56.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-17T20:41:56.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/usb3503.ko 2024-01-17T20:41:56.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/usblcd.ko 2024-01-17T20:41:56.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-17T20:41:56.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/usbtest.ko 2024-01-17T20:41:56.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/uss720.ko 2024-01-17T20:41:56.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/yurex.ko 2024-01-17T20:41:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/mon/ 2024-01-17T20:41:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 72953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/mon/usbmon.ko 2024-01-17T20:41:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/musb/ 2024-01-17T20:41:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 301697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/musb/musb_hdrc.ko 2024-01-17T20:41:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/phy/ 2024-01-17T20:41:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/phy/phy-generic.ko 2024-01-17T20:41:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-01-17T20:41:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/phy/phy-isp1301.ko 2024-01-17T20:41:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/phy/phy-tahvo.ko 2024-01-17T20:41:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/ 2024-01-17T20:41:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/aircable.ko 2024-01-17T20:41:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/ark3116.ko 2024-01-17T20:41:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-17T20:41:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/ch341.ko 2024-01-17T20:41:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/cp210x.ko 2024-01-17T20:41:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/cyberjack.ko 2024-01-17T20:41:56.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-17T20:41:56.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-17T20:41:56.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/empeg.ko 2024-01-17T20:41:56.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/f81232.ko 2024-01-17T20:41:56.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 175193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-17T20:41:56.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-17T20:41:56.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 137081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-17T20:41:56.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 124833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/io_ti.ko 2024-01-17T20:41:56.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/ipaq.ko 2024-01-17T20:41:56.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/ipw.ko 2024-01-17T20:41:56.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/ir-usb.ko 2024-01-17T20:41:56.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-17T20:41:56.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 107521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/keyspan.ko 2024-01-17T20:41:56.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-17T20:41:56.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-17T20:41:56.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33689 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-17T20:41:56.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/mct_u232.ko 2024-01-17T20:41:56.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/metro-usb.ko 2024-01-17T20:41:56.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/mos7720.ko 2024-01-17T20:41:56.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/mos7840.ko 2024-01-17T20:41:56.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/mxuport.ko 2024-01-17T20:41:56.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/navman.ko 2024-01-17T20:41:56.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/omninet.ko 2024-01-17T20:41:56.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/opticon.ko 2024-01-17T20:41:56.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 191801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/option.ko 2024-01-17T20:41:56.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/oti6858.ko 2024-01-17T20:41:56.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/pl2303.ko 2024-01-17T20:41:56.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/qcaux.ko 2024-01-17T20:41:56.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/qcserial.ko 2024-01-17T20:41:56.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/quatech2.ko 2024-01-17T20:41:56.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/safe_serial.ko 2024-01-17T20:41:56.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/sierra.ko 2024-01-17T20:41:56.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-17T20:41:56.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/ssu100.ko 2024-01-17T20:41:56.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/symbolserial.ko 2024-01-17T20:41:56.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-17T20:41:56.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-17T20:41:56.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/usb_debug.ko 2024-01-17T20:41:56.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-17T20:41:56.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 125609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/usbserial.ko 2024-01-17T20:41:56.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/visor.ko 2024-01-17T20:41:56.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/whiteheat.ko 2024-01-17T20:41:56.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/wishbone-serial.ko 2024-01-17T20:41:56.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-17T20:41:56.707 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ 2024-01-17T20:41:56.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/uas.ko 2024-01-17T20:41:56.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-17T20:41:56.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-17T20:41:56.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-17T20:41:56.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-17T20:41:56.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-17T20:41:56.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-17T20:41:56.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19361 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-17T20:41:56.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-karma.ko 2024-01-17T20:41:56.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-17T20:41:56.708 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-17T20:41:56.708 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-17T20:41:56.708 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-17T20:41:56.708 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-17T20:41:56.708 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 180225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/usb-storage.ko 2024-01-17T20:41:56.708 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/usbip/ 2024-01-17T20:41:56.708 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-17T20:41:56.708 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 71097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-17T20:41:56.708 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 103977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-17T20:41:56.708 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vfio/ 2024-01-17T20:41:56.708 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vfio/pci/ 2024-01-17T20:41:56.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 154297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-17T20:41:56.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-17T20:41:56.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 103737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vfio/vfio.ko 2024-01-17T20:41:56.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 77609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-17T20:41:56.709 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vhost/ 2024-01-17T20:41:56.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 113785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vhost/vhost.ko 2024-01-17T20:41:56.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-17T20:41:56.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vhost/vhost_net.ko 2024-01-17T20:41:56.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vhost/vhost_scsi.ko 2024-01-17T20:41:56.709 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/ 2024-01-17T20:41:56.709 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/ 2024-01-17T20:41:56.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15417 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-01-17T20:41:56.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/aat2870_bl.ko 2024-01-17T20:41:56.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/adp5520_bl.ko 2024-01-17T20:41:56.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/adp8860_bl.ko 2024-01-17T20:41:56.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/adp8870_bl.ko 2024-01-17T20:41:56.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/apple_bl.ko 2024-01-17T20:41:56.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/as3711_bl.ko 2024-01-17T20:41:56.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/bd6107.ko 2024-01-17T20:41:56.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/da903x_bl.ko 2024-01-17T20:41:56.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/da9052_bl.ko 2024-01-17T20:41:56.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/gpio_backlight.ko 2024-01-17T20:41:56.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/kb3886_bl.ko 2024-01-17T20:41:56.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/lcd.ko 2024-01-17T20:41:56.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/lm3533_bl.ko 2024-01-17T20:41:56.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/lm3639_bl.ko 2024-01-17T20:41:56.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/lv5207lp.ko 2024-01-17T20:41:56.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/max8925_bl.ko 2024-01-17T20:41:56.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/pandora_bl.ko 2024-01-17T20:41:56.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-01-17T20:41:56.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-17T20:41:56.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/wm831x_bl.ko 2024-01-17T20:41:56.711 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/ 2024-01-17T20:41:56.711 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/masters/ 2024-01-17T20:41:56.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/masters/ds2482.ko 2024-01-17T20:41:56.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/masters/ds2490.ko 2024-01-17T20:41:56.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/masters/matrox_w1.ko 2024-01-17T20:41:56.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12417 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/masters/w1-gpio.ko 2024-01-17T20:41:56.711 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/ 2024-01-17T20:41:56.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-17T20:41:56.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-17T20:41:56.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-17T20:41:56.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-17T20:41:56.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-17T20:41:56.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-17T20:41:56.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-17T20:41:56.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-17T20:41:56.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-17T20:41:56.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-17T20:41:56.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-17T20:41:56.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 102673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/wire.ko 2024-01-17T20:41:56.712 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/ 2024-01-17T20:41:56.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/acquirewdt.ko 2024-01-17T20:41:56.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/advantechwdt.ko 2024-01-17T20:41:56.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-17T20:41:56.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-17T20:41:56.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/cpu5wdt.ko 2024-01-17T20:41:56.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/da9052_wdt.ko 2024-01-17T20:41:56.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/da9055_wdt.ko 2024-01-17T20:41:56.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/da9063_wdt.ko 2024-01-17T20:41:56.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/dw_wdt.ko 2024-01-17T20:41:56.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/eurotechwdt.ko 2024-01-17T20:41:56.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-17T20:41:56.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/hpwdt.ko 2024-01-17T20:41:56.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/i6300esb.ko 2024-01-17T20:41:56.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-17T20:41:56.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-17T20:41:56.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/ib700wdt.ko 2024-01-17T20:41:56.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18689 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/ibmasr.ko 2024-01-17T20:41:56.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-17T20:41:56.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-17T20:41:56.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/it87_wdt.ko 2024-01-17T20:41:56.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/kempld_wdt.ko 2024-01-17T20:41:56.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/machzwd.ko 2024-01-17T20:41:56.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/mena21_wdt.ko 2024-01-17T20:41:56.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-01-17T20:41:56.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/nv_tco.ko 2024-01-17T20:41:56.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-01-17T20:41:56.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/pc87413_wdt.ko 2024-01-17T20:41:56.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-17T20:41:56.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-17T20:41:56.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/retu_wdt.ko 2024-01-17T20:41:56.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-01-17T20:41:56.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-01-17T20:41:56.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-17T20:41:56.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/sc1200wdt.ko 2024-01-17T20:41:56.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-17T20:41:56.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-01-17T20:41:56.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/softdog.ko 2024-01-17T20:41:56.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-17T20:41:56.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/twl4030_wdt.ko 2024-01-17T20:41:56.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/via_wdt.ko 2024-01-17T20:41:56.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-17T20:41:56.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-17T20:41:56.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-17T20:41:56.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/wafer5823wdt.ko 2024-01-17T20:41:56.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/wdt_pci.ko 2024-01-17T20:41:56.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/wm831x_wdt.ko 2024-01-17T20:41:56.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/wm8350_wdt.ko 2024-01-17T20:41:56.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/xen_wdt.ko 2024-01-17T20:41:56.715 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/ 2024-01-17T20:41:56.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/xen-evtchn.ko 2024-01-17T20:41:56.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/xen-gntalloc.ko 2024-01-17T20:41:56.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/xen-gntdev.ko 2024-01-17T20:41:56.716 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/xen-pciback/ 2024-01-17T20:41:56.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 176441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-17T20:41:56.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/xen-privcmd.ko 2024-01-17T20:41:56.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 71249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/xen-scsiback.ko 2024-01-17T20:41:56.716 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/xenfs/ 2024-01-17T20:41:56.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-17T20:41:56.716 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ 2024-01-17T20:41:56.716 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/9p/ 2024-01-17T20:41:56.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 166753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/9p/9p.ko 2024-01-17T20:41:56.716 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/adfs/ 2024-01-17T20:41:56.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/adfs/adfs.ko 2024-01-17T20:41:56.716 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/affs/ 2024-01-17T20:41:56.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 163449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/affs/affs.ko 2024-01-17T20:41:56.717 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/afs/ 2024-01-17T20:41:56.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 935033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/afs/kafs.ko 2024-01-17T20:41:56.717 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/autofs/ 2024-01-17T20:41:56.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 103401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/autofs/autofs4.ko 2024-01-17T20:41:56.717 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/befs/ 2024-01-17T20:41:56.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 64681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/befs/befs.ko 2024-01-17T20:41:56.717 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/bfs/ 2024-01-17T20:41:56.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/bfs/bfs.ko 2024-01-17T20:41:56.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/binfmt_misc.ko 2024-01-17T20:41:56.717 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/btrfs/ 2024-01-17T20:41:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 3455857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/btrfs/btrfs.ko 2024-01-17T20:41:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/cachefiles/ 2024-01-17T20:41:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 306009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/cachefiles/cachefiles.ko 2024-01-17T20:41:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ceph/ 2024-01-17T20:41:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1336985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ceph/ceph.ko 2024-01-17T20:41:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/coda/ 2024-01-17T20:41:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/coda/coda.ko 2024-01-17T20:41:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/configfs/ 2024-01-17T20:41:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 108641 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/configfs/configfs.ko 2024-01-17T20:41:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/cramfs/ 2024-01-17T20:41:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/cramfs/cramfs.ko 2024-01-17T20:41:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/dlm/ 2024-01-17T20:41:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 644073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/dlm/dlm.ko 2024-01-17T20:41:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/efs/ 2024-01-17T20:41:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/efs/efs.ko 2024-01-17T20:41:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/f2fs/ 2024-01-17T20:41:56.719 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1506641 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/f2fs/f2fs.ko 2024-01-17T20:41:56.719 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/fat/ 2024-01-17T20:41:56.719 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/fat/msdos.ko 2024-01-17T20:41:56.719 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/freevxfs/ 2024-01-17T20:41:56.719 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/freevxfs/freevxfs.ko 2024-01-17T20:41:56.719 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/fscache/ 2024-01-17T20:41:56.719 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 226481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/fscache/fscache.ko 2024-01-17T20:41:56.719 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/fuse/ 2024-01-17T20:41:56.719 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/fuse/cuse.ko 2024-01-17T20:41:56.719 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/gfs2/ 2024-01-17T20:41:56.719 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1229913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/gfs2/gfs2.ko 2024-01-17T20:41:56.720 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/hfs/ 2024-01-17T20:41:56.720 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 141985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/hfs/hfs.ko 2024-01-17T20:41:56.720 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/hfsplus/ 2024-01-17T20:41:56.720 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 223225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/hfsplus/hfsplus.ko 2024-01-17T20:41:56.720 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/hpfs/ 2024-01-17T20:41:56.720 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 193569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/hpfs/hpfs.ko 2024-01-17T20:41:56.720 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/isofs/ 2024-01-17T20:41:56.720 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 74785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/isofs/isofs.ko 2024-01-17T20:41:56.720 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/jfs/ 2024-01-17T20:41:56.720 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 419881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/jfs/jfs.ko 2024-01-17T20:41:56.720 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/lockd/ 2024-01-17T20:41:56.720 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 282049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/lockd/lockd.ko 2024-01-17T20:41:56.720 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/minix/ 2024-01-17T20:41:56.720 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89761 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/minix/minix.ko 2024-01-17T20:41:56.720 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/netfs/ 2024-01-17T20:41:56.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 124649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/netfs/netfs.ko 2024-01-17T20:41:56.721 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/ 2024-01-17T20:41:56.721 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/blocklayout/ 2024-01-17T20:41:56.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 81513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-17T20:41:56.721 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/filelayout/ 2024-01-17T20:41:56.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-17T20:41:56.721 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/flexfilelayout/ 2024-01-17T20:41:56.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 117465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-17T20:41:56.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1057969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/nfs.ko 2024-01-17T20:41:56.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/nfsv2.ko 2024-01-17T20:41:56.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 120265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/nfsv3.ko 2024-01-17T20:41:56.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 2042153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/nfsv4.ko 2024-01-17T20:41:56.721 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs_common/ 2024-01-17T20:41:56.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs_common/grace.ko 2024-01-17T20:41:56.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs_common/nfs_acl.ko 2024-01-17T20:41:56.722 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfsd/ 2024-01-17T20:41:56.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1563929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfsd/nfsd.ko 2024-01-17T20:41:56.722 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nilfs2/ 2024-01-17T20:41:56.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 590713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nilfs2/nilfs2.ko 2024-01-17T20:41:56.722 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/ 2024-01-17T20:41:56.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-celtic.ko 2024-01-17T20:41:56.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-centeuro.ko 2024-01-17T20:41:56.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-croatian.ko 2024-01-17T20:41:56.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-cyrillic.ko 2024-01-17T20:41:56.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-gaelic.ko 2024-01-17T20:41:56.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-greek.ko 2024-01-17T20:41:56.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-iceland.ko 2024-01-17T20:41:56.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-inuit.ko 2024-01-17T20:41:56.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-roman.ko 2024-01-17T20:41:56.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-romanian.ko 2024-01-17T20:41:56.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-turkish.ko 2024-01-17T20:41:56.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_ascii.ko 2024-01-17T20:41:56.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp1250.ko 2024-01-17T20:41:56.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp1251.ko 2024-01-17T20:41:56.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp1255.ko 2024-01-17T20:41:56.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp737.ko 2024-01-17T20:41:56.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp775.ko 2024-01-17T20:41:56.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp850.ko 2024-01-17T20:41:56.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp852.ko 2024-01-17T20:41:56.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp855.ko 2024-01-17T20:41:56.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp857.ko 2024-01-17T20:41:56.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp860.ko 2024-01-17T20:41:56.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp861.ko 2024-01-17T20:41:56.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp862.ko 2024-01-17T20:41:56.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp863.ko 2024-01-17T20:41:56.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp864.ko 2024-01-17T20:41:56.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp865.ko 2024-01-17T20:41:56.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp866.ko 2024-01-17T20:41:56.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp869.ko 2024-01-17T20:41:56.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp874.ko 2024-01-17T20:41:56.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 94137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp932.ko 2024-01-17T20:41:56.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 142673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp936.ko 2024-01-17T20:41:56.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 165745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp949.ko 2024-01-17T20:41:56.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 118121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp950.ko 2024-01-17T20:41:56.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_euc-jp.ko 2024-01-17T20:41:56.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-1.ko 2024-01-17T20:41:56.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-13.ko 2024-01-17T20:41:56.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-14.ko 2024-01-17T20:41:56.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-15.ko 2024-01-17T20:41:56.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-2.ko 2024-01-17T20:41:56.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-3.ko 2024-01-17T20:41:56.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-4.ko 2024-01-17T20:41:56.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-5.ko 2024-01-17T20:41:56.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-6.ko 2024-01-17T20:41:56.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-7.ko 2024-01-17T20:41:56.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-9.ko 2024-01-17T20:41:56.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_koi8-r.ko 2024-01-17T20:41:56.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_koi8-ru.ko 2024-01-17T20:41:56.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_koi8-u.ko 2024-01-17T20:41:56.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-17T20:41:56.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_utf8.ko 2024-01-17T20:41:56.726 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ntfs/ 2024-01-17T20:41:56.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 220553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ntfs/ntfs.ko 2024-01-17T20:41:56.726 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/ 2024-01-17T20:41:56.726 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/cluster/ 2024-01-17T20:41:56.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 244737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-17T20:41:56.726 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/dlm/ 2024-01-17T20:41:56.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 440737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-17T20:41:56.726 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/dlmfs/ 2024-01-17T20:41:56.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-17T20:41:56.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 2593521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/ocfs2.ko 2024-01-17T20:41:56.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-17T20:41:56.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-17T20:41:56.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-17T20:41:56.726 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/omfs/ 2024-01-17T20:41:56.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/omfs/omfs.ko 2024-01-17T20:41:56.727 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/overlayfs/ 2024-01-17T20:41:56.727 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 370697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/overlayfs/overlay.ko 2024-01-17T20:41:56.727 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/pstore/ 2024-01-17T20:41:56.727 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/pstore/ramoops.ko 2024-01-17T20:41:56.727 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/qnx4/ 2024-01-17T20:41:56.727 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/qnx4/qnx4.ko 2024-01-17T20:41:56.727 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/qnx6/ 2024-01-17T20:41:56.727 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46689 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/qnx6/qnx6.ko 2024-01-17T20:41:56.727 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/quota/ 2024-01-17T20:41:56.727 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/quota/quota_tree.ko 2024-01-17T20:41:56.727 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/quota/quota_v1.ko 2024-01-17T20:41:56.728 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/quota/quota_v2.ko 2024-01-17T20:41:56.728 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/reiserfs/ 2024-01-17T20:41:56.728 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 532025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/reiserfs/reiserfs.ko 2024-01-17T20:41:56.728 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/romfs/ 2024-01-17T20:41:56.728 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/romfs/romfs.ko 2024-01-17T20:41:56.728 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/smb/ 2024-01-17T20:41:56.728 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/smb/client/ 2024-01-17T20:41:56.728 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 2683249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/smb/client/cifs.ko 2024-01-17T20:41:56.728 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/smb/common/ 2024-01-17T20:41:56.728 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/smb/common/cifs_arc4.ko 2024-01-17T20:41:56.728 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/smb/common/cifs_md4.ko 2024-01-17T20:41:56.728 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/squashfs/ 2024-01-17T20:41:56.728 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 134777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/squashfs/squashfs.ko 2024-01-17T20:41:56.729 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/sysv/ 2024-01-17T20:41:56.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 91249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/sysv/sysv.ko 2024-01-17T20:41:56.729 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/udf/ 2024-01-17T20:41:56.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 248425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/udf/udf.ko 2024-01-17T20:41:56.729 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ufs/ 2024-01-17T20:41:56.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 162537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ufs/ufs.ko 2024-01-17T20:41:56.729 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/xfs/ 2024-01-17T20:41:56.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 4014433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/xfs/xfs.ko 2024-01-17T20:41:56.729 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/kernel/ 2024-01-17T20:41:56.729 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/kernel/locking/ 2024-01-17T20:41:56.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 80585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/kernel/locking/locktorture.ko 2024-01-17T20:41:56.730 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/kernel/time/ 2024-01-17T20:41:56.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/kernel/time/test_udelay.ko 2024-01-17T20:41:56.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/kernel/torture.ko 2024-01-17T20:41:56.730 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/ 2024-01-17T20:41:56.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/crc-itu-t.ko 2024-01-17T20:41:56.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/crc7.ko 2024-01-17T20:41:56.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/crc8.ko 2024-01-17T20:41:56.730 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/crypto/ 2024-01-17T20:41:56.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/crypto/libarc4.ko 2024-01-17T20:41:56.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/crypto/libdes.ko 2024-01-17T20:41:56.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/interval_tree_test.ko 2024-01-17T20:41:56.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/libcrc32c.ko 2024-01-17T20:41:56.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/lru_cache.ko 2024-01-17T20:41:56.730 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/lz4/ 2024-01-17T20:41:56.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/lz4/lz4_compress.ko 2024-01-17T20:41:56.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/lz4/lz4hc_compress.ko 2024-01-17T20:41:56.731 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/math/ 2024-01-17T20:41:56.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/math/cordic.ko 2024-01-17T20:41:56.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/memory-notifier-error-inject.ko 2024-01-17T20:41:56.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/notifier-error-inject.ko 2024-01-17T20:41:56.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/percpu_test.ko 2024-01-17T20:41:56.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/pm-notifier-error-inject.ko 2024-01-17T20:41:56.731 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/raid6/ 2024-01-17T20:41:56.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 143353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/raid6/raid6_pq.ko 2024-01-17T20:41:56.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/rbtree_test.ko 2024-01-17T20:41:56.731 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/reed_solomon/ 2024-01-17T20:41:56.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-17T20:41:56.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/test-kstrtox.ko 2024-01-17T20:41:56.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/test-string_helpers.ko 2024-01-17T20:41:56.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 4876633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/test_bpf.ko 2024-01-17T20:41:56.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/test_firmware.ko 2024-01-17T20:41:56.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6369 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/test_module.ko 2024-01-17T20:41:56.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/test_user_copy.ko 2024-01-17T20:41:56.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/ts_bm.ko 2024-01-17T20:41:56.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/ts_fsm.ko 2024-01-17T20:41:56.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/ts_kmp.ko 2024-01-17T20:41:56.732 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/xz/ 2024-01-17T20:41:56.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/xz/xz_dec_test.ko 2024-01-17T20:41:56.732 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/mm/ 2024-01-17T20:41:56.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/mm/hwpoison-inject.ko 2024-01-17T20:41:56.732 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ 2024-01-17T20:41:56.732 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/6lowpan/ 2024-01-17T20:41:56.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/6lowpan/6lowpan.ko 2024-01-17T20:41:56.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/6lowpan/nhc_dest.ko 2024-01-17T20:41:56.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/6lowpan/nhc_fragment.ko 2024-01-17T20:41:56.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/6lowpan/nhc_hop.ko 2024-01-17T20:41:56.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-17T20:41:56.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/6lowpan/nhc_mobility.ko 2024-01-17T20:41:56.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/6lowpan/nhc_routing.ko 2024-01-17T20:41:56.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/6lowpan/nhc_udp.ko 2024-01-17T20:41:56.733 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/802/ 2024-01-17T20:41:56.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/802/garp.ko 2024-01-17T20:41:56.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/802/mrp.ko 2024-01-17T20:41:56.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/802/p8022.ko 2024-01-17T20:41:56.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/802/psnap.ko 2024-01-17T20:41:56.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/802/stp.ko 2024-01-17T20:41:56.734 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/8021q/ 2024-01-17T20:41:56.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 82593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/8021q/8021q.ko 2024-01-17T20:41:56.734 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/9p/ 2024-01-17T20:41:56.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 198905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/9p/9pnet.ko 2024-01-17T20:41:56.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/9p/9pnet_fd.ko 2024-01-17T20:41:56.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/9p/9pnet_rdma.ko 2024-01-17T20:41:56.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/9p/9pnet_virtio.ko 2024-01-17T20:41:56.734 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/batman-adv/ 2024-01-17T20:41:56.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 649977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/batman-adv/batman-adv.ko 2024-01-17T20:41:56.734 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/ 2024-01-17T20:41:56.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 65137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/br_netfilter.ko 2024-01-17T20:41:56.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 785817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/bridge.ko 2024-01-17T20:41:56.734 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ 2024-01-17T20:41:56.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-17T20:41:56.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-17T20:41:56.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-17T20:41:56.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-17T20:41:56.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-17T20:41:56.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-17T20:41:56.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-17T20:41:56.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-17T20:41:56.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-17T20:41:56.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-17T20:41:56.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-17T20:41:56.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-17T20:41:56.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-17T20:41:56.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-17T20:41:56.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-17T20:41:56.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-17T20:41:56.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-17T20:41:56.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11641 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-17T20:41:56.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-17T20:41:56.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-17T20:41:56.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebtables.ko 2024-01-17T20:41:56.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-17T20:41:56.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-17T20:41:56.736 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ceph/ 2024-01-17T20:41:56.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1046969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ceph/libceph.ko 2024-01-17T20:41:56.736 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/core/ 2024-01-17T20:41:56.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 126041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/core/pktgen.ko 2024-01-17T20:41:56.736 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dccp/ 2024-01-17T20:41:56.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 194529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dccp/dccp.ko 2024-01-17T20:41:56.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dccp/dccp_diag.ko 2024-01-17T20:41:56.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dccp/dccp_ipv4.ko 2024-01-17T20:41:56.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dccp/dccp_ipv6.ko 2024-01-17T20:41:56.737 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dsa/ 2024-01-17T20:41:56.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 390129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dsa/dsa_core.ko 2024-01-17T20:41:56.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dsa/tag_brcm.ko 2024-01-17T20:41:56.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dsa/tag_dsa.ko 2024-01-17T20:41:56.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dsa/tag_none.ko 2024-01-17T20:41:56.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dsa/tag_trailer.ko 2024-01-17T20:41:56.737 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/hsr/ 2024-01-17T20:41:56.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 99881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/hsr/hsr.ko 2024-01-17T20:41:56.737 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ieee802154/ 2024-01-17T20:41:56.737 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ieee802154/6lowpan/ 2024-01-17T20:41:56.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-17T20:41:56.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 255849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ieee802154/ieee802154.ko 2024-01-17T20:41:56.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-17T20:41:56.738 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/ 2024-01-17T20:41:56.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24761 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/ah4.ko 2024-01-17T20:41:56.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/esp4.ko 2024-01-17T20:41:56.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/fou.ko 2024-01-17T20:41:56.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/gre.ko 2024-01-17T20:41:56.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/inet_diag.ko 2024-01-17T20:41:56.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/ip_gre.ko 2024-01-17T20:41:56.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/ip_tunnel.ko 2024-01-17T20:41:56.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/ip_vti.ko 2024-01-17T20:41:56.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/ipcomp.ko 2024-01-17T20:41:56.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/ipip.ko 2024-01-17T20:41:56.739 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/ 2024-01-17T20:41:56.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-17T20:41:56.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-17T20:41:56.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-17T20:41:56.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/ip_tables.ko 2024-01-17T20:41:56.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-17T20:41:56.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-01-17T20:41:56.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-17T20:41:56.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-17T20:41:56.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-17T20:41:56.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-01-17T20:41:56.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-17T20:41:56.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-17T20:41:56.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-17T20:41:56.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-17T20:41:56.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-17T20:41:56.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-17T20:41:56.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-17T20:41:56.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-17T20:41:56.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-17T20:41:56.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-01-17T20:41:56.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-17T20:41:56.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-17T20:41:56.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-17T20:41:56.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-17T20:41:56.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-17T20:41:56.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_bic.ko 2024-01-17T20:41:56.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_dctcp.ko 2024-01-17T20:41:56.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_diag.ko 2024-01-17T20:41:56.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_highspeed.ko 2024-01-17T20:41:56.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_htcp.ko 2024-01-17T20:41:56.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_hybla.ko 2024-01-17T20:41:56.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_illinois.ko 2024-01-17T20:41:56.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_lp.ko 2024-01-17T20:41:56.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_scalable.ko 2024-01-17T20:41:56.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_vegas.ko 2024-01-17T20:41:56.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_veno.ko 2024-01-17T20:41:56.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_westwood.ko 2024-01-17T20:41:56.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_yeah.ko 2024-01-17T20:41:56.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tunnel4.ko 2024-01-17T20:41:56.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/udp_diag.ko 2024-01-17T20:41:56.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/udp_tunnel.ko 2024-01-17T20:41:56.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11361 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-17T20:41:56.742 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/ 2024-01-17T20:41:56.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/ah6.ko 2024-01-17T20:41:56.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39705 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/esp6.ko 2024-01-17T20:41:56.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/fou6.ko 2024-01-17T20:41:56.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 80105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/ip6_gre.ko 2024-01-17T20:41:56.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 93977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/ip6_tunnel.ko 2024-01-17T20:41:56.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-17T20:41:56.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/ip6_vti.ko 2024-01-17T20:41:56.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/ipcomp6.ko 2024-01-17T20:41:56.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/mip6.ko 2024-01-17T20:41:56.743 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ 2024-01-17T20:41:56.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-17T20:41:56.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-01-17T20:41:56.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-17T20:41:56.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-17T20:41:56.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-17T20:41:56.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-17T20:41:56.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-17T20:41:56.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-17T20:41:56.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-17T20:41:56.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-17T20:41:56.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-17T20:41:56.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-17T20:41:56.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-17T20:41:56.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-17T20:41:56.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-17T20:41:56.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-17T20:41:56.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-17T20:41:56.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-17T20:41:56.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-17T20:41:56.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-17T20:41:56.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-17T20:41:56.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-17T20:41:56.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-17T20:41:56.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-17T20:41:56.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-17T20:41:56.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 74921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/sit.ko 2024-01-17T20:41:56.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/tunnel6.ko 2024-01-17T20:41:56.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-17T20:41:56.745 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/key/ 2024-01-17T20:41:56.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 84433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/key/af_key.ko 2024-01-17T20:41:56.745 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/l2tp/ 2024-01-17T20:41:56.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 125305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/l2tp/l2tp_core.ko 2024-01-17T20:41:56.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-17T20:41:56.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/l2tp/l2tp_eth.ko 2024-01-17T20:41:56.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/l2tp/l2tp_ip.ko 2024-01-17T20:41:56.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/l2tp/l2tp_ip6.ko 2024-01-17T20:41:56.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/l2tp/l2tp_netlink.ko 2024-01-17T20:41:56.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/l2tp/l2tp_ppp.ko 2024-01-17T20:41:56.746 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/lapb/ 2024-01-17T20:41:56.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/lapb/lapb.ko 2024-01-17T20:41:56.746 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/llc/ 2024-01-17T20:41:56.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/llc/llc.ko 2024-01-17T20:41:56.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 268265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/llc/llc2.ko 2024-01-17T20:41:56.746 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/mac802154/ 2024-01-17T20:41:56.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 290441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/mac802154/mac802154.ko 2024-01-17T20:41:56.746 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/mpls/ 2024-01-17T20:41:56.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/mpls/mpls_gso.ko 2024-01-17T20:41:56.747 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ 2024-01-17T20:41:56.747 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ 2024-01-17T20:41:56.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 118801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set.ko 2024-01-17T20:41:56.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-17T20:41:56.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-17T20:41:56.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26369 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-17T20:41:56.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-17T20:41:56.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-17T20:41:56.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 102881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-17T20:41:56.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 102649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-17T20:41:56.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 112017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-17T20:41:56.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-17T20:41:56.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 108761 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-17T20:41:56.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 112297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-17T20:41:56.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 112649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-17T20:41:56.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 110753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-17T20:41:56.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 113633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-17T20:41:56.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-17T20:41:56.748 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ 2024-01-17T20:41:56.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 412561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-17T20:41:56.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-17T20:41:56.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-17T20:41:56.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-17T20:41:56.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-17T20:41:56.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-17T20:41:56.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-17T20:41:56.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-17T20:41:56.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-17T20:41:56.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-17T20:41:56.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-17T20:41:56.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-17T20:41:56.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-17T20:41:56.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-17T20:41:56.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conncount.ko 2024-01-17T20:41:56.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 411489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack.ko 2024-01-17T20:41:56.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-17T20:41:56.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-17T20:41:56.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33761 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-17T20:41:56.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 118193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-17T20:41:56.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-17T20:41:56.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-17T20:41:56.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 108105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-17T20:41:56.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-17T20:41:56.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-17T20:41:56.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-17T20:41:56.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-17T20:41:56.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-17T20:41:56.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-17T20:41:56.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 91737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_flow_table.ko 2024-01-17T20:41:56.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-17T20:41:56.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_log_syslog.ko 2024-01-17T20:41:56.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 96545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_nat.ko 2024-01-17T20:41:56.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-17T20:41:56.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-17T20:41:56.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_nat_irc.ko 2024-01-17T20:41:56.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_nat_sip.ko 2024-01-17T20:41:56.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-17T20:41:56.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-17T20:41:56.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 614025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_tables.ko 2024-01-17T20:41:56.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nfnetlink.ko 2024-01-17T20:41:56.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-17T20:41:56.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-01-17T20:41:56.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nfnetlink_log.ko 2024-01-17T20:41:56.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-17T20:41:56.752 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-17T20:41:56.752 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_chain_nat.ko 2024-01-17T20:41:56.752 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_compat.ko 2024-01-17T20:41:56.752 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_ct.ko 2024-01-17T20:41:56.752 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-17T20:41:56.752 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_fib.ko 2024-01-17T20:41:56.752 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-17T20:41:56.752 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_hash.ko 2024-01-17T20:41:56.752 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_limit.ko 2024-01-17T20:41:56.752 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_log.ko 2024-01-17T20:41:56.752 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_masq.ko 2024-01-17T20:41:56.752 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_nat.ko 2024-01-17T20:41:56.752 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_numgen.ko 2024-01-17T20:41:56.752 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_osf.ko 2024-01-17T20:41:56.753 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_queue.ko 2024-01-17T20:41:56.753 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_redir.ko 2024-01-17T20:41:56.753 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_reject.ko 2024-01-17T20:41:56.753 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_reject_inet.ko 2024-01-17T20:41:56.753 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_socket.ko 2024-01-17T20:41:56.753 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20369 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_synproxy.ko 2024-01-17T20:41:56.753 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_tproxy.ko 2024-01-17T20:41:56.753 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/x_tables.ko 2024-01-17T20:41:56.753 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_AUDIT.ko 2024-01-17T20:41:56.753 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-17T20:41:56.753 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-17T20:41:56.753 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-17T20:41:56.753 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_CT.ko 2024-01-17T20:41:56.754 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_DSCP.ko 2024-01-17T20:41:56.754 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_HL.ko 2024-01-17T20:41:56.754 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13369 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_HMARK.ko 2024-01-17T20:41:56.754 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-17T20:41:56.754 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_LED.ko 2024-01-17T20:41:56.754 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_LOG.ko 2024-01-17T20:41:56.754 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-17T20:41:56.754 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_NETMAP.ko 2024-01-17T20:41:56.754 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_NFLOG.ko 2024-01-17T20:41:56.754 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-17T20:41:56.755 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_RATEEST.ko 2024-01-17T20:41:56.755 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-17T20:41:56.755 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_SECMARK.ko 2024-01-17T20:41:56.755 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-17T20:41:56.755 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-17T20:41:56.755 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_TEE.ko 2024-01-17T20:41:56.755 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_TPROXY.ko 2024-01-17T20:41:56.755 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_TRACE.ko 2024-01-17T20:41:56.755 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_addrtype.ko 2024-01-17T20:41:56.755 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_bpf.ko 2024-01-17T20:41:56.755 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_cgroup.ko 2024-01-17T20:41:56.755 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_cluster.ko 2024-01-17T20:41:56.755 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_comment.ko 2024-01-17T20:41:56.755 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_connbytes.ko 2024-01-17T20:41:56.755 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_connlabel.ko 2024-01-17T20:41:56.756 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_connlimit.ko 2024-01-17T20:41:56.756 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_connmark.ko 2024-01-17T20:41:56.756 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_conntrack.ko 2024-01-17T20:41:56.756 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_cpu.ko 2024-01-17T20:41:56.756 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_dccp.ko 2024-01-17T20:41:56.756 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_devgroup.ko 2024-01-17T20:41:56.756 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_dscp.ko 2024-01-17T20:41:56.756 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_ecn.ko 2024-01-17T20:41:56.756 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_esp.ko 2024-01-17T20:41:56.756 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_hashlimit.ko 2024-01-17T20:41:56.756 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_helper.ko 2024-01-17T20:41:56.756 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_hl.ko 2024-01-17T20:41:56.756 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_ipcomp.ko 2024-01-17T20:41:56.757 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_iprange.ko 2024-01-17T20:41:56.757 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_ipvs.ko 2024-01-17T20:41:56.757 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_l2tp.ko 2024-01-17T20:41:56.757 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_length.ko 2024-01-17T20:41:56.757 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_limit.ko 2024-01-17T20:41:56.757 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_mac.ko 2024-01-17T20:41:56.757 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_mark.ko 2024-01-17T20:41:56.757 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_multiport.ko 2024-01-17T20:41:56.757 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_nat.ko 2024-01-17T20:41:56.757 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_nfacct.ko 2024-01-17T20:41:56.757 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_osf.ko 2024-01-17T20:41:56.757 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_owner.ko 2024-01-17T20:41:56.757 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_physdev.ko 2024-01-17T20:41:56.757 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_pkttype.ko 2024-01-17T20:41:56.758 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_policy.ko 2024-01-17T20:41:56.758 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_quota.ko 2024-01-17T20:41:56.758 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_rateest.ko 2024-01-17T20:41:56.758 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_realm.ko 2024-01-17T20:41:56.758 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_recent.ko 2024-01-17T20:41:56.758 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_sctp.ko 2024-01-17T20:41:56.758 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_set.ko 2024-01-17T20:41:56.758 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_socket.ko 2024-01-17T20:41:56.758 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_state.ko 2024-01-17T20:41:56.758 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_statistic.ko 2024-01-17T20:41:56.758 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_string.ko 2024-01-17T20:41:56.758 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_tcpmss.ko 2024-01-17T20:41:56.758 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_tcpudp.ko 2024-01-17T20:41:56.758 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_time.ko 2024-01-17T20:41:56.758 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_u32.ko 2024-01-17T20:41:56.759 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netlink/ 2024-01-17T20:41:56.759 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netlink/netlink_diag.ko 2024-01-17T20:41:56.759 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/nsh/ 2024-01-17T20:41:56.759 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/nsh/nsh.ko 2024-01-17T20:41:56.759 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/openvswitch/ 2024-01-17T20:41:56.759 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 383481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/openvswitch/openvswitch.ko 2024-01-17T20:41:56.759 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/openvswitch/vport-geneve.ko 2024-01-17T20:41:56.759 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/openvswitch/vport-gre.ko 2024-01-17T20:41:56.759 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/openvswitch/vport-vxlan.ko 2024-01-17T20:41:56.759 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/packet/ 2024-01-17T20:41:56.760 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/packet/af_packet_diag.ko 2024-01-17T20:41:56.760 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/phonet/ 2024-01-17T20:41:56.760 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 112057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/phonet/phonet.ko 2024-01-17T20:41:56.760 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/phonet/pn_pep.ko 2024-01-17T20:41:56.760 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/rds/ 2024-01-17T20:41:56.760 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 252953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/rds/rds.ko 2024-01-17T20:41:56.760 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 164937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/rds/rds_rdma.ko 2024-01-17T20:41:56.760 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 68161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/rds/rds_tcp.ko 2024-01-17T20:41:56.760 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/rxrpc/ 2024-01-17T20:41:56.760 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 818777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/rxrpc/rxrpc.ko 2024-01-17T20:41:56.760 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/ 2024-01-17T20:41:56.760 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_csum.ko 2024-01-17T20:41:56.760 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_gact.ko 2024-01-17T20:41:56.761 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_ipt.ko 2024-01-17T20:41:56.761 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_mirred.ko 2024-01-17T20:41:56.761 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_nat.ko 2024-01-17T20:41:56.761 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_pedit.ko 2024-01-17T20:41:56.761 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_police.ko 2024-01-17T20:41:56.761 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_simple.ko 2024-01-17T20:41:56.761 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_skbedit.ko 2024-01-17T20:41:56.761 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_vlan.ko 2024-01-17T20:41:56.761 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/cls_basic.ko 2024-01-17T20:41:56.761 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/cls_bpf.ko 2024-01-17T20:41:56.762 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/cls_cgroup.ko 2024-01-17T20:41:56.762 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/cls_flow.ko 2024-01-17T20:41:56.762 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32377 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/cls_fw.ko 2024-01-17T20:41:56.762 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/cls_route.ko 2024-01-17T20:41:56.762 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/cls_u32.ko 2024-01-17T20:41:56.762 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/em_cmp.ko 2024-01-17T20:41:56.762 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/em_ipset.ko 2024-01-17T20:41:56.762 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/em_meta.ko 2024-01-17T20:41:56.762 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/em_nbyte.ko 2024-01-17T20:41:56.762 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/em_text.ko 2024-01-17T20:41:56.762 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/em_u32.ko 2024-01-17T20:41:56.762 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_choke.ko 2024-01-17T20:41:56.762 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_codel.ko 2024-01-17T20:41:56.762 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_drr.ko 2024-01-17T20:41:56.763 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_fq.ko 2024-01-17T20:41:56.763 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_fq_codel.ko 2024-01-17T20:41:56.763 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_gred.ko 2024-01-17T20:41:56.763 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_hfsc.ko 2024-01-17T20:41:56.763 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_hhf.ko 2024-01-17T20:41:56.763 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_htb.ko 2024-01-17T20:41:56.763 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_ingress.ko 2024-01-17T20:41:56.763 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_mqprio.ko 2024-01-17T20:41:56.763 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_mqprio_lib.ko 2024-01-17T20:41:56.763 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_multiq.ko 2024-01-17T20:41:56.763 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_netem.ko 2024-01-17T20:41:56.763 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_pie.ko 2024-01-17T20:41:56.763 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_plug.ko 2024-01-17T20:41:56.763 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_prio.ko 2024-01-17T20:41:56.763 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_qfq.ko 2024-01-17T20:41:56.764 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_red.ko 2024-01-17T20:41:56.764 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_sfb.ko 2024-01-17T20:41:56.764 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_sfq.ko 2024-01-17T20:41:56.764 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_tbf.ko 2024-01-17T20:41:56.764 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_teql.ko 2024-01-17T20:41:56.764 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sctp/ 2024-01-17T20:41:56.764 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 932169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sctp/sctp.ko 2024-01-17T20:41:56.764 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sctp/sctp_diag.ko 2024-01-17T20:41:56.764 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sunrpc/ 2024-01-17T20:41:56.765 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sunrpc/auth_gss/ 2024-01-17T20:41:56.765 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 336777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-17T20:41:56.765 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-17T20:41:56.765 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1518417 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sunrpc/sunrpc.ko 2024-01-17T20:41:56.765 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sunrpc/xprtrdma/ 2024-01-17T20:41:56.765 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 708281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-17T20:41:56.765 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/tipc/ 2024-01-17T20:41:56.765 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/tipc/diag.ko 2024-01-17T20:41:56.765 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 866345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/tipc/tipc.ko 2024-01-17T20:41:56.765 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/unix/ 2024-01-17T20:41:56.765 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/unix/unix_diag.ko 2024-01-17T20:41:56.765 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/vmw_vsock/ 2024-01-17T20:41:56.765 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 86417 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-17T20:41:56.765 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 68049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-17T20:41:56.766 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 98017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/vmw_vsock/vsock.ko 2024-01-17T20:41:56.766 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-17T20:41:56.766 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17761 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-17T20:41:56.766 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/x25/ 2024-01-17T20:41:56.766 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 125409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/x25/x25.ko 2024-01-17T20:41:56.766 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/xfrm/ 2024-01-17T20:41:56.766 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/xfrm/xfrm_algo.ko 2024-01-17T20:41:56.766 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-17T20:41:56.766 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 104161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/xfrm/xfrm_user.ko 2024-01-17T20:41:56.766 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/virt/ 2024-01-17T20:41:56.766 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/virt/lib/ 2024-01-17T20:41:56.766 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/virt/lib/irqbypass.ko 2024-01-17T20:41:56.766 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 641009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.alias 2024-01-17T20:41:56.766 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 625033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.alias.bin 2024-01-17T20:41:56.766 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7677 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.builtin 2024-01-17T20:41:56.767 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23634 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.builtin.alias.bin 2024-01-17T20:41:56.767 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9916 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.builtin.bin 2024-01-17T20:41:56.767 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70653 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.builtin.modinfo 2024-01-17T20:41:56.767 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 147734 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.dep 2024-01-17T20:41:56.767 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 234045 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.dep.bin 2024-01-17T20:41:56.767 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 210 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.devname 2024-01-17T20:41:56.767 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 72797 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.order 2024-01-17T20:41:56.767 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 879 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.softdep 2024-01-17T20:41:56.767 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 255175 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.symbols 2024-01-17T20:41:56.767 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 309826 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.symbols.bin 2024-01-17T20:41:56.767 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./usr/ 2024-01-17T20:41:56.767 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./usr/share/ 2024-01-17T20:41:56.767 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./usr/share/doc/ 2024-01-17T20:41:56.767 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./usr/share/doc/linux-image-6.7.0-g064ffc2b249f/ 2024-01-17T20:41:56.767 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 171 2024-01-17 06:30 ./usr/share/doc/linux-image-6.7.0-g064ffc2b249f/changelog.Debian.gz 2024-01-17T20:41:56.768 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 691 2024-01-17 06:30 ./usr/share/doc/linux-image-6.7.0-g064ffc2b249f/copyright 2024-01-17T20:41:56.768 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-g064ffc2b249f 2024-01-17T20:41:56.768 INFO:teuthology.task.kernel:searching for kernel 6.7.0-g064ffc2b249f 2024-01-17T20:41:56.769 DEBUG:teuthology.orchestra.run.smithi161:> egrep '(submenu|menuentry.*6.7.0-g064ffc2b249f).*{' /boot/grub/grub.cfg 2024-01-17T20:41:56.776 INFO:teuthology.orchestra.run.smithi161.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-17T20:41:56.776 INFO:teuthology.orchestra.run.smithi161.stdout: menuentry 'Ubuntu, with Linux 6.7.0-g064ffc2b249f' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-g064ffc2b249f-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-17T20:41:56.777 INFO:teuthology.orchestra.run.smithi161.stdout: menuentry 'Ubuntu, with Linux 6.7.0-g064ffc2b249f (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-g064ffc2b249f-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-17T20:41:56.778 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-01-17T20:41:56.778 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.7.0-g064ffc2b249f 2024-01-17T20:41:56.778 DEBUG:teuthology.orchestra.run.smithi161:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-01-17T20:41:56.820 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi161.front.sepia.ceph.com to complete... 2024-01-17T20:41:57.228 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub' 2024-01-17T20:41:57.229 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-17T20:41:57.236 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2024-01-17T20:41:57.472 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-6.7.0-g064ffc2b249f 2024-01-17T20:41:57.478 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-6.7.0-g064ffc2b249f 2024-01-17T20:41:57.729 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-17T20:41:57.734 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-17T20:41:57.777 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-17T20:41:57.782 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-17T20:41:57.914 INFO:teuthology.orchestra.run.smithi161.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-17T20:41:57.914 INFO:teuthology.orchestra.run.smithi161.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-17T20:41:57.914 INFO:teuthology.orchestra.run.smithi161.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-17T20:41:57.941 INFO:teuthology.orchestra.run.smithi161.stderr:done 2024-01-17T20:42:29.051 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-01-17T20:42:29.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-01-17T20:42:29.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T20:42:47.484 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-17T20:42:56.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-01-17T20:42:56.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T20:42:59.552 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-17T20:43:11.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-01-17T20:43:11.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T20:44:11.556 DEBUG:teuthology.orchestra.remote:timed out 2024-01-17T20:44:26.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-01-17T20:44:26.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T20:44:26.748 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-01-17T20:44:27.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-01-17T20:44:27.405 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.7.0-g064ffc2b249f"... 2024-01-17T20:44:27.405 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-01-17T20:44:27.456 INFO:teuthology.orchestra.run.smithi161.stdout:6.7.0-g064ffc2b249f 2024-01-17T20:44:27.456 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-g064ffc2b249f vs 6.7.0-g064ffc2b249f 2024-01-17T20:44:27.457 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-17T20:44:27.457 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-17T20:44:28.459 DEBUG:teuthology.parallel:result is None 2024-01-17T20:44:28.460 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-17T20:44:28.467 INFO:teuthology.task.internal:Creating test directory... 2024-01-17T20:44:28.468 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-17T20:44:28.471 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-17T20:44:28.477 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-17T20:44:28.484 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-17T20:44:28.492 INFO:teuthology.task.internal:Creating archive directory... 2024-01-17T20:44:28.492 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-17T20:44:28.524 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-17T20:44:28.620 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-17T20:44:28.627 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-17T20:44:28.627 DEBUG:teuthology.orchestra.run.smithi190:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-17T20:44:28.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T20:44:28.632 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-17T20:44:28.636 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-17T20:44:28.711 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-17T20:44:28.713 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-17T20:44:28.728 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-17T20:44:28.733 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-17T20:44:28.735 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-17T20:44:28.743 INFO:teuthology.task.internal:Configuring sudo... 2024-01-17T20:44:28.743 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-17T20:44:28.747 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-17T20:44:28.783 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-17T20:44:28.792 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-17T20:44:28.792 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-17T20:44:28.812 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-17T20:44:28.832 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-17T20:44:28.869 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-17T20:44:28.921 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T20:44:28.921 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-17T20:44:28.994 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-17T20:44:29.000 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-17T20:44:29.048 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T20:44:29.048 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-17T20:44:29.113 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2024-01-17T20:44:29.117 DEBUG:teuthology.orchestra.run.smithi190:> sudo service rsyslog restart 2024-01-17T20:44:29.223 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-17T20:44:29.232 INFO:teuthology.task.internal:Starting timer... 2024-01-17T20:44:29.232 INFO:teuthology.run_tasks:Running task pcp... 2024-01-17T20:44:29.242 INFO:teuthology.run_tasks:Running task selinux... 2024-01-17T20:44:29.250 DEBUG:teuthology.task.selinux:Excluding smithi161: OS 'ubuntu' does not support SELinux 2024-01-17T20:44:29.250 DEBUG:teuthology.task.selinux:Excluding smithi190: OS 'ubuntu' does not support SELinux 2024-01-17T20:44:29.250 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-17T20:44:29.250 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-01-17T20:44:29.250 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-17T20:44:29.250 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-17T20:44:29.259 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-17T20:44:29.276 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-17T20:44:29.277 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi161.front.sepia.ceph.com,smithi190.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-17T20:51:38.398 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi161.front.sepia.ceph.com'), Remote(name='ubuntu@smithi190.front.sepia.ceph.com')] 2024-01-17T20:51:38.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-01-17T20:51:38.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T20:51:38.480 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-01-17T20:51:38.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-01-17T20:51:38.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-01-17T20:51:38.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T20:51:38.678 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-01-17T20:51:38.776 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-01-17T20:51:38.776 INFO:teuthology.run_tasks:Running task clock... 2024-01-17T20:51:38.789 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-17T20:51:38.789 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-17T20:51:38.790 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-17T20:51:38.793 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-17T20:51:38.793 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-17T20:51:38.828 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-17T20:51:38.828 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: Command line: ntpd -gq 2024-01-17T20:51:38.828 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: ---------------------------------------------------- 2024-01-17T20:51:38.828 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: ntp-4 is maintained by Network Time Foundation, 2024-01-17T20:51:38.828 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-17T20:51:38.828 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: corporation. Support and training for ntp-4 are 2024-01-17T20:51:38.828 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: available at https://www.nwtime.org/support 2024-01-17T20:51:38.828 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: ---------------------------------------------------- 2024-01-17T20:51:38.829 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: proto: precision = 0.041 usec (-24) 2024-01-17T20:51:38.829 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: basedate set to 2022-02-04 2024-01-17T20:51:38.829 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: gps base set to 2022-02-06 (week 2196) 2024-01-17T20:51:38.829 INFO:teuthology.orchestra.run.smithi161.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-17T20:51:38.830 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-17T20:51:38.830 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: restrict ::: KOD does nothing without LIMITED. 2024-01-17T20:51:38.830 INFO:teuthology.orchestra.run.smithi161.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-17T20:51:38.831 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: Listen and drop on 0 v6wildcard [::]:123 2024-01-17T20:51:38.831 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-17T20:51:38.831 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: Listen normally on 2 lo 127.0.0.1:123 2024-01-17T20:51:38.831 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: Listen normally on 3 enp3s0f1 172.21.15.161:123 2024-01-17T20:51:38.831 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: Listen normally on 4 lo [::1]:123 2024-01-17T20:51:38.831 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7251%5]:123 2024-01-17T20:51:38.831 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:38 ntpd[16840]: Listening on routing socket on fd #22 for interface updates 2024-01-17T20:51:38.839 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-17T20:51:38.839 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: Command line: ntpd -gq 2024-01-17T20:51:38.839 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: ---------------------------------------------------- 2024-01-17T20:51:38.839 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: ntp-4 is maintained by Network Time Foundation, 2024-01-17T20:51:38.839 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-17T20:51:38.839 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: corporation. Support and training for ntp-4 are 2024-01-17T20:51:38.839 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: available at https://www.nwtime.org/support 2024-01-17T20:51:38.839 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: ---------------------------------------------------- 2024-01-17T20:51:38.840 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: proto: precision = 0.045 usec (-24) 2024-01-17T20:51:38.840 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: basedate set to 2022-02-04 2024-01-17T20:51:38.840 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: gps base set to 2022-02-06 (week 2196) 2024-01-17T20:51:38.840 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-17T20:51:38.841 INFO:teuthology.orchestra.run.smithi190.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-17T20:51:38.841 INFO:teuthology.orchestra.run.smithi190.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-17T20:51:38.842 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: restrict ::: KOD does nothing without LIMITED. 2024-01-17T20:51:38.842 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: Listen and drop on 0 v6wildcard [::]:123 2024-01-17T20:51:38.842 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-17T20:51:38.842 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: Listen normally on 2 lo 127.0.0.1:123 2024-01-17T20:51:38.842 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: Listen normally on 3 enp3s0f1 172.21.15.190:123 2024-01-17T20:51:38.842 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: Listen normally on 4 lo [::1]:123 2024-01-17T20:51:38.842 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7763%5]:123 2024-01-17T20:51:38.842 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:38 ntpd[17289]: Listening on routing socket on fd #22 for interface updates 2024-01-17T20:51:39.840 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:39 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:39.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:39 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:39.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:39 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:39.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:39 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:39.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:39 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:39.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:39 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:39.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:39 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:39.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:39 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:39.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:39 ntpd[17289]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:39.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:39 ntpd[17289]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:39.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:39 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:39.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:39 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:39.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:39 ntpd[17289]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:39.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:39 ntpd[17289]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:39.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:39 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:39.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:39 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:39.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:39 ntpd[17289]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:39.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:39 ntpd[17289]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:41.828 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:41 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:41.828 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:41 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:41.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:41 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:41.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:41 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:41.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:41 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:41.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:41 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:41.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:41 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:41.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:41 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:41.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:41 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:41.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:41 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:41.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:41 ntpd[17289]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:41.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:41 ntpd[17289]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:41.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:41 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:41.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:41 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:41.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:41 ntpd[17289]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:41.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:41 ntpd[17289]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:41.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:41 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:41.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:41 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:41.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:41 ntpd[17289]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:41.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:41 ntpd[17289]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:42.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:42 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:42.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:42 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:42.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:42 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:42.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:42 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:42.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:42 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:42.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:42 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:42.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:42 ntpd[16840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:42.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:42 ntpd[16840]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:42.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:42 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:42.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:42 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:42.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:42 ntpd[16840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:42.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:42 ntpd[16840]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:42.839 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:42 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:42.839 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:42 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:43.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:43 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:43.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:43 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:43.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:43 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:43.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:43 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:43.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:43 ntpd[16840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:43.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:43 ntpd[16840]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:43.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:43 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:43.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:43 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:43.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:43 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:43.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:43 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:43.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:43 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:43.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:43 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:43.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:43 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:43.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:43 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:43.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:43 ntpd[17289]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:43.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:43 ntpd[17289]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:43.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:43 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:43.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:43 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:43.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:43 ntpd[17289]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:43.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:43 ntpd[17289]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:43.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:43 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:43.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:43 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:43.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:43 ntpd[17289]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:43.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:43 ntpd[17289]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:44.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:44 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:44.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:44 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:44.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:44 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:44.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:44 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:44 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:44 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:44 ntpd[16840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:44 ntpd[16840]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:44 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:44 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:44 ntpd[16840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:44 ntpd[16840]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:45.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:45 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:45.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:45 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:45.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:45 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:45.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:45 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:45.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:45 ntpd[16840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:45.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:45 ntpd[16840]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:45.840 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:45 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:45.840 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:45 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:45.840 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:45 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:45.840 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:45 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:45.840 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:45 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:45.840 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:45 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:45.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:45 ntpd[17289]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:45.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:45 ntpd[17289]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:45.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:45 ntpd[17289]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:45.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:45 ntpd[17289]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:45.841 INFO:teuthology.orchestra.run.smithi190.stdout:17 Jan 20:51:45 ntpd[17289]: ntpd: time slew -0.006721 s 2024-01-17T20:51:45.841 INFO:teuthology.orchestra.run.smithi190.stdout:ntpd: time slew -0.006721s 2024-01-17T20:51:45.841 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:45 ntpd[17289]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-17T20:51:45.842 INFO:teuthology.orchestra.run.smithi190.stderr:17 Jan 20:51:45 ntpd[17289]: can't open /var/log/ntpstats/loopstats.20240117: Permission denied 2024-01-17T20:51:45.920 INFO:teuthology.orchestra.run.smithi190.stdout: remote refid st t when poll reach delay offset jitter 2024-01-17T20:51:45.920 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================== 2024-01-17T20:51:45.920 INFO:teuthology.orchestra.run.smithi190.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-17T20:51:45.920 INFO:teuthology.orchestra.run.smithi190.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-17T20:51:45.920 INFO:teuthology.orchestra.run.smithi190.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-17T20:51:45.921 INFO:teuthology.orchestra.run.smithi190.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-17T20:51:46.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:46 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:46.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:46 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:46.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:46 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:46.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:46 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:46.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:46 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:46.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:46 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:46.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:46 ntpd[16840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:46.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:46 ntpd[16840]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:46.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:46 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:46.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:46 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:46.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:46 ntpd[16840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:46.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:46 ntpd[16840]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:47.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:47 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:47.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:47 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:47.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:47 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:47.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:47 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:47.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:47 ntpd[16840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:47.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:47 ntpd[16840]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:48.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:48 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:48.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:48 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:48.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:48 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:48.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:48 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:48.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:48 ntpd[16840]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T20:51:48.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:48 ntpd[16840]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T20:51:48.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:48 ntpd[16840]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T20:51:48.829 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:48 ntpd[16840]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T20:51:48.830 INFO:teuthology.orchestra.run.smithi161.stdout:17 Jan 20:51:48 ntpd[16840]: ntpd: time slew -0.000914 s 2024-01-17T20:51:48.830 INFO:teuthology.orchestra.run.smithi161.stdout:ntpd: time slew -0.000914s 2024-01-17T20:51:48.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:48 ntpd[16840]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-17T20:51:48.830 INFO:teuthology.orchestra.run.smithi161.stderr:17 Jan 20:51:48 ntpd[16840]: can't open /var/log/ntpstats/loopstats.20240117: Permission denied 2024-01-17T20:51:48.924 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2024-01-17T20:51:48.924 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2024-01-17T20:51:48.924 INFO:teuthology.orchestra.run.smithi161.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-17T20:51:48.924 INFO:teuthology.orchestra.run.smithi161.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-17T20:51:48.924 INFO:teuthology.orchestra.run.smithi161.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-17T20:51:48.925 INFO:teuthology.orchestra.run.smithi161.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-17T20:51:48.926 INFO:teuthology.run_tasks:Running task install... 2024-01-17T20:51:48.938 DEBUG:teuthology.task.install:project ceph 2024-01-17T20:51:48.938 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4'}} 2024-01-17T20:51:48.939 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4'} 2024-01-17T20:51:48.939 INFO:teuthology.task.install:Using flavor: default 2024-01-17T20:51:48.945 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-01-17T20:51:48.945 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-01-17T20:51:48.945 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-key list | grep Ceph 2024-01-17T20:51:48.946 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-key list | grep Ceph 2024-01-17T20:51:49.013 INFO:teuthology.orchestra.run.smithi190.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-17T20:51:49.043 INFO:teuthology.orchestra.run.smithi190.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-17T20:51:49.044 INFO:teuthology.orchestra.run.smithi190.stdout:uid [ unknown] Ceph.com (release key) 2024-01-17T20:51:49.044 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-17T20:51:49.044 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-17T20:51:49.045 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 2024-01-17T20:51:49.066 INFO:teuthology.orchestra.run.smithi161.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-17T20:51:49.117 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-17T20:51:49.118 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph.com (release key) 2024-01-17T20:51:49.119 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-17T20:51:49.119 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-17T20:51:49.119 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 2024-01-17T20:51:49.266 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default/ 2024-01-17T20:51:49.266 INFO:teuthology.task.install.deb:Package version is 19.0.0-653-g1ec1182e-1jammy 2024-01-17T20:51:49.340 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default/ 2024-01-17T20:51:49.340 INFO:teuthology.task.install.deb:Package version is 19.0.0-653-g1ec1182e-1jammy 2024-01-17T20:51:49.681 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T20:51:49.681 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-17T20:51:49.695 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get update 2024-01-17T20:51:49.736 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T20:51:49.736 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-17T20:51:49.756 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2024-01-17T20:51:49.866 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-17T20:51:49.879 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-17T20:51:49.899 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-17T20:51:49.945 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-17T20:51:49.955 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-17T20:51:49.976 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-17T20:51:49.982 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-17T20:51:50.058 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-17T20:51:50.136 INFO:teuthology.orchestra.run.smithi190.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy InRelease 2024-01-17T20:51:50.207 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy InRelease 2024-01-17T20:51:50.211 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-17T20:51:50.286 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-17T20:51:50.290 INFO:teuthology.orchestra.run.smithi190.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-17T20:51:50.367 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-17T20:51:50.369 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,408 B] 2024-01-17T20:51:50.444 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-01-17T20:51:50.460 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-01-17T20:51:50.556 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 28.8 kB in 1s (43.2 kB/s) 2024-01-17T20:51:50.607 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,408 B] 2024-01-17T20:51:50.713 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 28.8 kB in 1s (39.1 kB/s) 2024-01-17T20:51:51.488 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-01-17T20:51:51.504 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-653-g1ec1182e-1jammy cephadm=19.0.0-653-g1ec1182e-1jammy ceph-mds=19.0.0-653-g1ec1182e-1jammy ceph-mgr=19.0.0-653-g1ec1182e-1jammy ceph-common=19.0.0-653-g1ec1182e-1jammy ceph-fuse=19.0.0-653-g1ec1182e-1jammy ceph-test=19.0.0-653-g1ec1182e-1jammy ceph-volume=19.0.0-653-g1ec1182e-1jammy radosgw=19.0.0-653-g1ec1182e-1jammy python3-rados=19.0.0-653-g1ec1182e-1jammy python3-rgw=19.0.0-653-g1ec1182e-1jammy python3-cephfs=19.0.0-653-g1ec1182e-1jammy python3-rbd=19.0.0-653-g1ec1182e-1jammy libcephfs2=19.0.0-653-g1ec1182e-1jammy libcephfs-dev=19.0.0-653-g1ec1182e-1jammy librados2=19.0.0-653-g1ec1182e-1jammy librbd1=19.0.0-653-g1ec1182e-1jammy rbd-fuse=19.0.0-653-g1ec1182e-1jammy ceph-common-dbg=19.0.0-653-g1ec1182e-1jammy ceph-fuse-dbg=19.0.0-653-g1ec1182e-1jammy ceph-mds-dbg=19.0.0-653-g1ec1182e-1jammy ceph-mgr-dbg=19.0.0-653-g1ec1182e-1jammy ceph-mon-dbg=19.0.0-653-g1ec1182e-1jammy ceph-osd-dbg=19.0.0-653-g1ec1182e-1jammy ceph-test-dbg=19.0.0-653-g1ec1182e-1jammy libcephfs2-dbg=19.0.0-653-g1ec1182e-1jammy librados2-dbg=19.0.0-653-g1ec1182e-1jammy libradosstriper1-dbg=19.0.0-653-g1ec1182e-1jammy librbd1-dbg=19.0.0-653-g1ec1182e-1jammy librgw2-dbg=19.0.0-653-g1ec1182e-1jammy radosgw-dbg=19.0.0-653-g1ec1182e-1jammy rbd-fuse-dbg=19.0.0-653-g1ec1182e-1jammy rbd-mirror-dbg=19.0.0-653-g1ec1182e-1jammy rbd-nbd-dbg=19.0.0-653-g1ec1182e-1jammy python3-cephfs=19.0.0-653-g1ec1182e-1jammy cephfs-shell=19.0.0-653-g1ec1182e-1jammy cephfs-top=19.0.0-653-g1ec1182e-1jammy cephfs-mirror=19.0.0-653-g1ec1182e-1jammy 2024-01-17T20:51:51.556 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-01-17T20:51:51.637 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-01-17T20:51:51.651 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-653-g1ec1182e-1jammy cephadm=19.0.0-653-g1ec1182e-1jammy ceph-mds=19.0.0-653-g1ec1182e-1jammy ceph-mgr=19.0.0-653-g1ec1182e-1jammy ceph-common=19.0.0-653-g1ec1182e-1jammy ceph-fuse=19.0.0-653-g1ec1182e-1jammy ceph-test=19.0.0-653-g1ec1182e-1jammy ceph-volume=19.0.0-653-g1ec1182e-1jammy radosgw=19.0.0-653-g1ec1182e-1jammy python3-rados=19.0.0-653-g1ec1182e-1jammy python3-rgw=19.0.0-653-g1ec1182e-1jammy python3-cephfs=19.0.0-653-g1ec1182e-1jammy python3-rbd=19.0.0-653-g1ec1182e-1jammy libcephfs2=19.0.0-653-g1ec1182e-1jammy libcephfs-dev=19.0.0-653-g1ec1182e-1jammy librados2=19.0.0-653-g1ec1182e-1jammy librbd1=19.0.0-653-g1ec1182e-1jammy rbd-fuse=19.0.0-653-g1ec1182e-1jammy ceph-common-dbg=19.0.0-653-g1ec1182e-1jammy ceph-fuse-dbg=19.0.0-653-g1ec1182e-1jammy ceph-mds-dbg=19.0.0-653-g1ec1182e-1jammy ceph-mgr-dbg=19.0.0-653-g1ec1182e-1jammy ceph-mon-dbg=19.0.0-653-g1ec1182e-1jammy ceph-osd-dbg=19.0.0-653-g1ec1182e-1jammy ceph-test-dbg=19.0.0-653-g1ec1182e-1jammy libcephfs2-dbg=19.0.0-653-g1ec1182e-1jammy librados2-dbg=19.0.0-653-g1ec1182e-1jammy libradosstriper1-dbg=19.0.0-653-g1ec1182e-1jammy librbd1-dbg=19.0.0-653-g1ec1182e-1jammy librgw2-dbg=19.0.0-653-g1ec1182e-1jammy radosgw-dbg=19.0.0-653-g1ec1182e-1jammy rbd-fuse-dbg=19.0.0-653-g1ec1182e-1jammy rbd-mirror-dbg=19.0.0-653-g1ec1182e-1jammy rbd-nbd-dbg=19.0.0-653-g1ec1182e-1jammy python3-cephfs=19.0.0-653-g1ec1182e-1jammy cephfs-shell=19.0.0-653-g1ec1182e-1jammy cephfs-top=19.0.0-653-g1ec1182e-1jammy cephfs-mirror=19.0.0-653-g1ec1182e-1jammy 2024-01-17T20:51:51.724 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2024-01-17T20:51:51.724 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-01-17T20:51:51.724 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2024-01-17T20:51:51.876 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2024-01-17T20:51:51.876 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-17T20:51:51.876 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-17T20:51:51.876 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-17T20:51:51.876 INFO:teuthology.orchestra.run.smithi190.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-01-17T20:51:51.877 INFO:teuthology.orchestra.run.smithi190.stdout: python2.7-minimal 2024-01-17T20:51:51.877 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-17T20:51:51.878 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2024-01-17T20:51:51.878 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-17T20:51:51.878 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-17T20:51:51.878 INFO:teuthology.orchestra.run.smithi190.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-17T20:51:51.878 INFO:teuthology.orchestra.run.smithi190.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-17T20:51:51.878 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-17T20:51:51.879 INFO:teuthology.orchestra.run.smithi190.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-17T20:51:51.879 INFO:teuthology.orchestra.run.smithi190.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-17T20:51:51.879 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-17T20:51:51.879 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-17T20:51:51.879 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-17T20:51:51.879 INFO:teuthology.orchestra.run.smithi190.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-17T20:51:51.879 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-17T20:51:51.879 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-17T20:51:51.879 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-17T20:51:51.879 INFO:teuthology.orchestra.run.smithi190.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-17T20:51:51.879 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-17T20:51:51.880 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-17T20:51:51.880 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-17T20:51:51.880 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-17T20:51:51.880 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-17T20:51:51.880 INFO:teuthology.orchestra.run.smithi190.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-17T20:51:51.880 INFO:teuthology.orchestra.run.smithi190.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-17T20:51:51.880 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-17T20:51:51.880 INFO:teuthology.orchestra.run.smithi190.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2024-01-17T20:51:51.881 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2024-01-17T20:51:51.881 INFO:teuthology.orchestra.run.smithi190.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-17T20:51:51.881 INFO:teuthology.orchestra.run.smithi190.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-17T20:51:51.881 INFO:teuthology.orchestra.run.smithi190.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-17T20:51:51.881 INFO:teuthology.orchestra.run.smithi190.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-17T20:51:51.881 INFO:teuthology.orchestra.run.smithi190.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-17T20:51:51.881 INFO:teuthology.orchestra.run.smithi190.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-17T20:51:51.881 INFO:teuthology.orchestra.run.smithi190.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-17T20:51:51.881 INFO:teuthology.orchestra.run.smithi190.stdout:Recommended packages: 2024-01-17T20:51:51.882 INFO:teuthology.orchestra.run.smithi190.stdout: btrfs-tools 2024-01-17T20:51:51.888 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2024-01-17T20:51:51.889 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2024-01-17T20:51:52.011 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2024-01-17T20:51:52.012 INFO:teuthology.orchestra.run.smithi190.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-01-17T20:51:52.012 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-01-17T20:51:52.012 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-01-17T20:51:52.012 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-01-17T20:51:52.012 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2024-01-17T20:51:52.013 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2024-01-17T20:51:52.013 INFO:teuthology.orchestra.run.smithi190.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-01-17T20:51:52.013 INFO:teuthology.orchestra.run.smithi190.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2024-01-17T20:51:52.013 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2024-01-17T20:51:52.013 INFO:teuthology.orchestra.run.smithi190.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-17T20:51:52.013 INFO:teuthology.orchestra.run.smithi190.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-17T20:51:52.013 INFO:teuthology.orchestra.run.smithi190.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-17T20:51:52.013 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-17T20:51:52.014 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-17T20:51:52.014 INFO:teuthology.orchestra.run.smithi190.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-17T20:51:52.014 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-17T20:51:52.014 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-17T20:51:52.014 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-17T20:51:52.014 INFO:teuthology.orchestra.run.smithi190.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-17T20:51:52.014 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-17T20:51:52.014 INFO:teuthology.orchestra.run.smithi190.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-17T20:51:52.014 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-17T20:51:52.014 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-17T20:51:52.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-17T20:51:52.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-17T20:51:52.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-17T20:51:52.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-17T20:51:52.015 INFO:teuthology.orchestra.run.smithi190.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-17T20:51:52.016 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-01-17T20:51:52.016 INFO:teuthology.orchestra.run.smithi190.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-01-17T20:51:52.016 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-01-17T20:51:52.049 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2024-01-17T20:51:52.049 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-17T20:51:52.049 INFO:teuthology.orchestra.run.smithi161.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-17T20:51:52.050 INFO:teuthology.orchestra.run.smithi161.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-17T20:51:52.050 INFO:teuthology.orchestra.run.smithi161.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-17T20:51:52.050 INFO:teuthology.orchestra.run.smithi161.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-17T20:51:52.050 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-17T20:51:52.050 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2024-01-17T20:51:52.050 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-17T20:51:52.051 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-17T20:51:52.051 INFO:teuthology.orchestra.run.smithi161.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-17T20:51:52.051 INFO:teuthology.orchestra.run.smithi161.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-17T20:51:52.051 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-17T20:51:52.051 INFO:teuthology.orchestra.run.smithi161.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-17T20:51:52.051 INFO:teuthology.orchestra.run.smithi161.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-17T20:51:52.052 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-17T20:51:52.052 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-17T20:51:52.052 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-17T20:51:52.052 INFO:teuthology.orchestra.run.smithi161.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-17T20:51:52.052 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-17T20:51:52.052 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-17T20:51:52.052 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-17T20:51:52.053 INFO:teuthology.orchestra.run.smithi161.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-17T20:51:52.053 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-17T20:51:52.053 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-17T20:51:52.053 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-17T20:51:52.053 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-17T20:51:52.053 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-17T20:51:52.054 INFO:teuthology.orchestra.run.smithi161.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-17T20:51:52.054 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-17T20:51:52.054 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-17T20:51:52.054 INFO:teuthology.orchestra.run.smithi161.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2024-01-17T20:51:52.054 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2024-01-17T20:51:52.054 INFO:teuthology.orchestra.run.smithi161.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-17T20:51:52.054 INFO:teuthology.orchestra.run.smithi161.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-17T20:51:52.055 INFO:teuthology.orchestra.run.smithi161.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-17T20:51:52.055 INFO:teuthology.orchestra.run.smithi161.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-17T20:51:52.055 INFO:teuthology.orchestra.run.smithi161.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-17T20:51:52.055 INFO:teuthology.orchestra.run.smithi161.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-17T20:51:52.055 INFO:teuthology.orchestra.run.smithi161.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-17T20:51:52.055 INFO:teuthology.orchestra.run.smithi161.stdout:Recommended packages: 2024-01-17T20:51:52.056 INFO:teuthology.orchestra.run.smithi161.stdout: btrfs-tools 2024-01-17T20:51:52.199 INFO:teuthology.orchestra.run.smithi190.stdout:0 upgraded, 142 newly installed, 0 to remove and 269 not upgraded. 2024-01-17T20:51:52.199 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 3,638 MB of archives. 2024-01-17T20:51:52.199 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 4,427 MB of additional disk space will be used. 2024-01-17T20:51:52.199 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-17T20:51:52.232 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2024-01-17T20:51:52.232 INFO:teuthology.orchestra.run.smithi161.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-01-17T20:51:52.232 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-01-17T20:51:52.232 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-01-17T20:51:52.232 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-01-17T20:51:52.233 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2024-01-17T20:51:52.233 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2024-01-17T20:51:52.233 INFO:teuthology.orchestra.run.smithi161.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-01-17T20:51:52.233 INFO:teuthology.orchestra.run.smithi161.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2024-01-17T20:51:52.233 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2024-01-17T20:51:52.233 INFO:teuthology.orchestra.run.smithi161.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-17T20:51:52.233 INFO:teuthology.orchestra.run.smithi161.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-17T20:51:52.233 INFO:teuthology.orchestra.run.smithi161.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-17T20:51:52.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-17T20:51:52.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-17T20:51:52.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-17T20:51:52.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-17T20:51:52.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-17T20:51:52.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-17T20:51:52.234 INFO:teuthology.orchestra.run.smithi161.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-17T20:51:52.234 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-17T20:51:52.234 INFO:teuthology.orchestra.run.smithi161.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-17T20:51:52.234 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-17T20:51:52.234 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-17T20:51:52.234 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-17T20:51:52.234 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-17T20:51:52.234 INFO:teuthology.orchestra.run.smithi161.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-17T20:51:52.234 INFO:teuthology.orchestra.run.smithi161.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-17T20:51:52.234 INFO:teuthology.orchestra.run.smithi161.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-17T20:51:52.234 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-01-17T20:51:52.234 INFO:teuthology.orchestra.run.smithi161.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-01-17T20:51:52.235 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-01-17T20:51:52.281 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-17T20:51:52.309 INFO:teuthology.orchestra.run.smithi161.stdout:0 upgraded, 142 newly installed, 0 to remove and 269 not upgraded. 2024-01-17T20:51:52.309 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 3,638 MB of archives. 2024-01-17T20:51:52.310 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 4,427 MB of additional disk space will be used. 2024-01-17T20:51:52.310 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-17T20:51:52.327 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-17T20:51:52.330 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-17T20:51:52.342 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-17T20:51:52.389 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-17T20:51:52.415 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-17T20:51:52.417 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-17T20:51:52.430 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-17T20:51:52.491 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-17T20:51:52.493 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-17T20:51:52.504 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-17T20:51:52.508 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-17T20:51:52.509 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-17T20:51:52.517 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-17T20:51:52.519 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-17T20:51:52.521 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-17T20:51:52.522 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-17T20:51:52.522 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-17T20:51:52.530 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-17T20:51:52.542 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-17T20:51:52.544 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-17T20:51:52.546 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-17T20:51:52.547 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-17T20:51:52.547 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-17T20:51:52.548 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-17T20:51:52.548 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-17T20:51:52.550 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-653-g1ec1182e-1jammy [3,502 kB] 2024-01-17T20:51:52.562 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-17T20:51:52.562 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-17T20:51:52.563 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-17T20:51:52.581 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-17T20:51:52.581 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-17T20:51:52.584 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-17T20:51:52.584 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-17T20:51:52.585 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-17T20:51:52.585 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-17T20:51:52.586 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-17T20:51:52.600 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-17T20:51:52.601 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-17T20:51:52.602 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-17T20:51:52.620 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-17T20:51:52.620 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-17T20:51:52.624 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-17T20:51:52.625 INFO:teuthology.orchestra.run.smithi161.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-17T20:51:52.626 INFO:teuthology.orchestra.run.smithi161.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-17T20:51:52.626 INFO:teuthology.orchestra.run.smithi161.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-17T20:51:52.627 INFO:teuthology.orchestra.run.smithi161.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-17T20:51:52.628 INFO:teuthology.orchestra.run.smithi161.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-17T20:51:52.638 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-17T20:51:52.640 INFO:teuthology.orchestra.run.smithi161.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-17T20:51:52.641 INFO:teuthology.orchestra.run.smithi161.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-17T20:51:52.642 INFO:teuthology.orchestra.run.smithi161.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-17T20:51:52.659 INFO:teuthology.orchestra.run.smithi161.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-17T20:51:52.661 INFO:teuthology.orchestra.run.smithi161.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-17T20:51:52.662 INFO:teuthology.orchestra.run.smithi161.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-17T20:51:52.663 INFO:teuthology.orchestra.run.smithi161.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-17T20:51:52.665 INFO:teuthology.orchestra.run.smithi161.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-17T20:51:52.690 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-17T20:51:52.728 INFO:teuthology.orchestra.run.smithi161.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-17T20:51:52.731 INFO:teuthology.orchestra.run.smithi161.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-17T20:51:52.733 INFO:teuthology.orchestra.run.smithi161.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-17T20:51:52.733 INFO:teuthology.orchestra.run.smithi161.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-17T20:51:52.734 INFO:teuthology.orchestra.run.smithi161.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-17T20:51:52.763 INFO:teuthology.orchestra.run.smithi161.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-17T20:51:52.764 INFO:teuthology.orchestra.run.smithi161.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-653-g1ec1182e-1jammy [3,502 kB] 2024-01-17T20:51:52.766 INFO:teuthology.orchestra.run.smithi161.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-17T20:51:52.766 INFO:teuthology.orchestra.run.smithi161.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-17T20:51:52.794 INFO:teuthology.orchestra.run.smithi161.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-17T20:51:52.794 INFO:teuthology.orchestra.run.smithi161.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-17T20:51:52.795 INFO:teuthology.orchestra.run.smithi161.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-17T20:51:52.796 INFO:teuthology.orchestra.run.smithi161.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-17T20:51:52.797 INFO:teuthology.orchestra.run.smithi161.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-17T20:51:52.797 INFO:teuthology.orchestra.run.smithi161.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-17T20:51:52.812 INFO:teuthology.orchestra.run.smithi161.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-17T20:51:52.812 INFO:teuthology.orchestra.run.smithi161.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-17T20:51:52.816 INFO:teuthology.orchestra.run.smithi161.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-17T20:51:52.831 INFO:teuthology.orchestra.run.smithi161.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-17T20:51:52.833 INFO:teuthology.orchestra.run.smithi161.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-17T20:51:52.834 INFO:teuthology.orchestra.run.smithi161.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-17T20:51:52.838 INFO:teuthology.orchestra.run.smithi161.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-17T20:51:52.841 INFO:teuthology.orchestra.run.smithi161.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-17T20:51:52.841 INFO:teuthology.orchestra.run.smithi161.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-17T20:51:52.842 INFO:teuthology.orchestra.run.smithi161.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-17T20:51:52.851 INFO:teuthology.orchestra.run.smithi161.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-17T20:51:52.856 INFO:teuthology.orchestra.run.smithi161.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-17T20:51:52.857 INFO:teuthology.orchestra.run.smithi161.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-17T20:51:52.864 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-17T20:51:52.870 INFO:teuthology.orchestra.run.smithi161.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-17T20:51:52.871 INFO:teuthology.orchestra.run.smithi161.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-17T20:51:52.872 INFO:teuthology.orchestra.run.smithi161.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-17T20:51:52.872 INFO:teuthology.orchestra.run.smithi161.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-17T20:51:52.873 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-17T20:51:52.874 INFO:teuthology.orchestra.run.smithi161.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-17T20:51:52.875 INFO:teuthology.orchestra.run.smithi161.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-17T20:51:52.882 INFO:teuthology.orchestra.run.smithi161.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-17T20:51:52.890 INFO:teuthology.orchestra.run.smithi161.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-17T20:51:52.890 INFO:teuthology.orchestra.run.smithi161.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-17T20:51:52.893 INFO:teuthology.orchestra.run.smithi161.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-17T20:51:52.900 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-17T20:51:52.908 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-17T20:51:52.909 INFO:teuthology.orchestra.run.smithi161.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-17T20:51:53.073 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-17T20:51:53.640 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-17T20:51:53.655 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-17T20:51:53.671 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-17T20:51:53.679 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-17T20:51:53.680 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-17T20:51:53.696 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-17T20:51:53.734 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-17T20:51:53.747 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-17T20:51:53.751 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-17T20:51:53.751 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-17T20:51:53.922 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-17T20:51:54.004 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-17T20:51:54.011 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-17T20:51:54.086 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-17T20:51:54.111 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-17T20:51:54.127 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-17T20:51:54.145 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-17T20:51:54.336 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-17T20:51:54.352 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-17T20:51:54.360 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-17T20:51:54.364 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-17T20:51:54.548 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-17T20:51:54.631 INFO:teuthology.orchestra.run.smithi190.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-17T20:51:54.647 INFO:teuthology.orchestra.run.smithi190.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-17T20:51:54.831 INFO:teuthology.orchestra.run.smithi190.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-17T20:51:54.882 INFO:teuthology.orchestra.run.smithi190.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-17T20:51:54.896 INFO:teuthology.orchestra.run.smithi190.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-17T20:51:55.054 INFO:teuthology.orchestra.run.smithi190.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-17T20:51:55.054 INFO:teuthology.orchestra.run.smithi190.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-17T20:51:55.061 INFO:teuthology.orchestra.run.smithi190.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-17T20:51:55.064 INFO:teuthology.orchestra.run.smithi190.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-17T20:51:55.079 INFO:teuthology.orchestra.run.smithi190.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-17T20:51:55.264 INFO:teuthology.orchestra.run.smithi190.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-17T20:51:55.528 INFO:teuthology.orchestra.run.smithi190.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-17T20:51:55.643 INFO:teuthology.orchestra.run.smithi190.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-17T20:51:55.688 INFO:teuthology.orchestra.run.smithi190.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-17T20:51:55.771 INFO:teuthology.orchestra.run.smithi190.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-17T20:51:55.782 INFO:teuthology.orchestra.run.smithi190.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-17T20:51:55.796 INFO:teuthology.orchestra.run.smithi190.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-17T20:51:55.836 INFO:teuthology.orchestra.run.smithi190.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-17T20:51:56.099 INFO:teuthology.orchestra.run.smithi190.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-17T20:51:56.103 INFO:teuthology.orchestra.run.smithi190.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-17T20:51:56.103 INFO:teuthology.orchestra.run.smithi190.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-17T20:51:56.268 INFO:teuthology.orchestra.run.smithi190.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-17T20:51:56.593 INFO:teuthology.orchestra.run.smithi190.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-17T20:51:57.003 INFO:teuthology.orchestra.run.smithi190.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-17T20:51:57.012 INFO:teuthology.orchestra.run.smithi190.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-17T20:51:57.014 INFO:teuthology.orchestra.run.smithi190.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-17T20:51:57.087 INFO:teuthology.orchestra.run.smithi190.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-17T20:51:57.088 INFO:teuthology.orchestra.run.smithi190.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-17T20:51:57.090 INFO:teuthology.orchestra.run.smithi190.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-17T20:51:57.091 INFO:teuthology.orchestra.run.smithi190.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-17T20:51:57.092 INFO:teuthology.orchestra.run.smithi190.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-17T20:51:57.258 INFO:teuthology.orchestra.run.smithi190.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-17T20:51:57.359 INFO:teuthology.orchestra.run.smithi190.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-17T20:51:57.450 INFO:teuthology.orchestra.run.smithi190.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-17T20:51:57.692 INFO:teuthology.orchestra.run.smithi190.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-17T20:51:57.735 INFO:teuthology.orchestra.run.smithi190.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-17T20:51:57.759 INFO:teuthology.orchestra.run.smithi190.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-17T20:51:57.768 INFO:teuthology.orchestra.run.smithi190.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-17T20:51:57.811 INFO:teuthology.orchestra.run.smithi190.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-17T20:51:57.836 INFO:teuthology.orchestra.run.smithi190.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-17T20:51:57.839 INFO:teuthology.orchestra.run.smithi190.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-17T20:51:57.845 INFO:teuthology.orchestra.run.smithi190.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-17T20:51:58.012 INFO:teuthology.orchestra.run.smithi190.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-17T20:51:58.542 INFO:teuthology.orchestra.run.smithi190.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-17T20:51:58.548 INFO:teuthology.orchestra.run.smithi190.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-17T20:51:58.588 INFO:teuthology.orchestra.run.smithi190.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-17T20:51:58.588 INFO:teuthology.orchestra.run.smithi190.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-17T20:51:58.595 INFO:teuthology.orchestra.run.smithi190.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-17T20:51:58.597 INFO:teuthology.orchestra.run.smithi190.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-17T20:51:58.638 INFO:teuthology.orchestra.run.smithi190.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-17T20:51:58.647 INFO:teuthology.orchestra.run.smithi190.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-17T20:51:58.719 INFO:teuthology.orchestra.run.smithi190.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-17T20:51:58.720 INFO:teuthology.orchestra.run.smithi190.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-17T20:51:58.885 INFO:teuthology.orchestra.run.smithi190.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-17T20:51:59.317 INFO:teuthology.orchestra.run.smithi190.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-17T20:51:59.332 INFO:teuthology.orchestra.run.smithi190.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-17T20:51:59.750 INFO:teuthology.orchestra.run.smithi161.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-653-g1ec1182e-1jammy [3,206 kB] 2024-01-17T20:52:00.208 INFO:teuthology.orchestra.run.smithi190.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-653-g1ec1182e-1jammy [3,206 kB] 2024-01-17T20:52:05.671 INFO:teuthology.orchestra.run.smithi190.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-653-g1ec1182e-1jammy [709 kB] 2024-01-17T20:52:06.883 INFO:teuthology.orchestra.run.smithi190.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-653-g1ec1182e-1jammy [356 kB] 2024-01-17T20:52:07.083 INFO:teuthology.orchestra.run.smithi161.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-653-g1ec1182e-1jammy [709 kB] 2024-01-17T20:52:07.387 INFO:teuthology.orchestra.run.smithi190.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-653-g1ec1182e-1jammy [32.8 kB] 2024-01-17T20:52:07.435 INFO:teuthology.orchestra.run.smithi190.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-653-g1ec1182e-1jammy [180 kB] 2024-01-17T20:52:07.658 INFO:teuthology.orchestra.run.smithi190.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-653-g1ec1182e-1jammy [64.1 kB] 2024-01-17T20:52:07.749 INFO:teuthology.orchestra.run.smithi190.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-653-g1ec1182e-1jammy [330 kB] 2024-01-17T20:52:08.174 INFO:teuthology.orchestra.run.smithi190.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-653-g1ec1182e-1jammy [6,226 kB] 2024-01-17T20:52:08.275 INFO:teuthology.orchestra.run.smithi161.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-653-g1ec1182e-1jammy [356 kB] 2024-01-17T20:52:08.836 INFO:teuthology.orchestra.run.smithi161.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-653-g1ec1182e-1jammy [32.8 kB] 2024-01-17T20:52:08.903 INFO:teuthology.orchestra.run.smithi161.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-653-g1ec1182e-1jammy [180 kB] 2024-01-17T20:52:09.184 INFO:teuthology.orchestra.run.smithi161.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-653-g1ec1182e-1jammy [64.1 kB] 2024-01-17T20:52:09.364 INFO:teuthology.orchestra.run.smithi161.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-653-g1ec1182e-1jammy [330 kB] 2024-01-17T20:52:09.931 INFO:teuthology.orchestra.run.smithi161.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-653-g1ec1182e-1jammy [6,226 kB] 2024-01-17T20:52:18.612 INFO:teuthology.orchestra.run.smithi190.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-653-g1ec1182e-1jammy [112 kB] 2024-01-17T20:52:18.821 INFO:teuthology.orchestra.run.smithi190.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-653-g1ec1182e-1jammy [465 kB] 2024-01-17T20:52:19.849 INFO:teuthology.orchestra.run.smithi190.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-653-g1ec1182e-1jammy [23.0 MB] 2024-01-17T20:52:22.049 INFO:teuthology.orchestra.run.smithi161.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-653-g1ec1182e-1jammy [112 kB] 2024-01-17T20:52:22.239 INFO:teuthology.orchestra.run.smithi161.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-653-g1ec1182e-1jammy [465 kB] 2024-01-17T20:52:23.168 INFO:teuthology.orchestra.run.smithi161.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-653-g1ec1182e-1jammy [23.0 MB] 2024-01-17T20:53:00.148 INFO:teuthology.orchestra.run.smithi161.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-653-g1ec1182e-1jammy [5,055 kB] 2024-01-17T20:53:03.398 INFO:teuthology.orchestra.run.smithi190.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-653-g1ec1182e-1jammy [5,055 kB] 2024-01-17T20:53:10.395 INFO:teuthology.orchestra.run.smithi161.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-653-g1ec1182e-1jammy [240 kB] 2024-01-17T20:53:10.941 INFO:teuthology.orchestra.run.smithi161.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-653-g1ec1182e-1jammy [124 kB] 2024-01-17T20:53:11.179 INFO:teuthology.orchestra.run.smithi161.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-653-g1ec1182e-1jammy [1,517 kB] 2024-01-17T20:53:14.280 INFO:teuthology.orchestra.run.smithi161.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-653-g1ec1182e-1jammy [6,237 kB] 2024-01-17T20:53:14.436 INFO:teuthology.orchestra.run.smithi190.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-653-g1ec1182e-1jammy [240 kB] 2024-01-17T20:53:14.855 INFO:teuthology.orchestra.run.smithi190.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-653-g1ec1182e-1jammy [124 kB] 2024-01-17T20:53:15.131 INFO:teuthology.orchestra.run.smithi190.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-653-g1ec1182e-1jammy [1,517 kB] 2024-01-17T20:53:17.818 INFO:teuthology.orchestra.run.smithi190.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-653-g1ec1182e-1jammy [6,237 kB] 2024-01-17T20:53:21.867 INFO:teuthology.orchestra.run.smithi161.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-653-g1ec1182e-1jammy [22.7 MB] 2024-01-17T20:53:27.686 INFO:teuthology.orchestra.run.smithi190.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-653-g1ec1182e-1jammy [22.7 MB] 2024-01-17T20:53:59.195 INFO:teuthology.orchestra.run.smithi161.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-653-g1ec1182e-1jammy [14.0 kB] 2024-01-17T20:53:59.225 INFO:teuthology.orchestra.run.smithi161.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-653-g1ec1182e-1jammy [865 kB] 2024-01-17T20:54:00.615 INFO:teuthology.orchestra.run.smithi161.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-653-g1ec1182e-1jammy [2,181 kB] 2024-01-17T20:54:03.705 INFO:teuthology.orchestra.run.smithi161.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-653-g1ec1182e-1jammy [770 kB] 2024-01-17T20:54:05.002 INFO:teuthology.orchestra.run.smithi161.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-653-g1ec1182e-1jammy [139 kB] 2024-01-17T20:54:05.276 INFO:teuthology.orchestra.run.smithi161.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-653-g1ec1182e-1jammy [1,876 kB] 2024-01-17T20:54:08.378 INFO:teuthology.orchestra.run.smithi161.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-653-g1ec1182e-1jammy [8,625 kB] 2024-01-17T20:54:09.529 INFO:teuthology.orchestra.run.smithi190.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-653-g1ec1182e-1jammy [14.0 kB] 2024-01-17T20:54:09.538 INFO:teuthology.orchestra.run.smithi190.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-653-g1ec1182e-1jammy [865 kB] 2024-01-17T20:54:11.076 INFO:teuthology.orchestra.run.smithi190.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-653-g1ec1182e-1jammy [2,181 kB] 2024-01-17T20:54:14.809 INFO:teuthology.orchestra.run.smithi190.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-653-g1ec1182e-1jammy [770 kB] 2024-01-17T20:54:17.009 INFO:teuthology.orchestra.run.smithi190.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-653-g1ec1182e-1jammy [139 kB] 2024-01-17T20:54:17.420 INFO:teuthology.orchestra.run.smithi190.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-653-g1ec1182e-1jammy [1,876 kB] 2024-01-17T20:54:21.577 INFO:teuthology.orchestra.run.smithi190.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-653-g1ec1182e-1jammy [8,625 kB] 2024-01-17T20:54:25.385 INFO:teuthology.orchestra.run.smithi161.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-653-g1ec1182e-1jammy [14.2 kB] 2024-01-17T20:54:25.429 INFO:teuthology.orchestra.run.smithi161.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-653-g1ec1182e-1jammy [48.3 MB] 2024-01-17T20:54:36.402 INFO:teuthology.orchestra.run.smithi190.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-653-g1ec1182e-1jammy [14.2 kB] 2024-01-17T20:54:36.444 INFO:teuthology.orchestra.run.smithi190.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-653-g1ec1182e-1jammy [48.3 MB] 2024-01-17T20:55:45.166 INFO:teuthology.orchestra.run.smithi161.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-653-g1ec1182e-1jammy [121 kB] 2024-01-17T20:55:45.298 INFO:teuthology.orchestra.run.smithi161.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-653-g1ec1182e-1jammy [226 kB] 2024-01-17T20:55:45.518 INFO:teuthology.orchestra.run.smithi161.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-653-g1ec1182e-1jammy [34.0 kB] 2024-01-17T20:55:45.579 INFO:teuthology.orchestra.run.smithi161.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-653-g1ec1182e-1jammy [23.4 kB] 2024-01-17T20:55:45.584 INFO:teuthology.orchestra.run.smithi161.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-653-g1ec1182e-1jammy [38.4 kB] 2024-01-17T20:55:45.628 INFO:teuthology.orchestra.run.smithi161.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-653-g1ec1182e-1jammy [12.3 MB] 2024-01-17T20:55:55.430 INFO:teuthology.orchestra.run.smithi161.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-653-g1ec1182e-1jammy [91.7 kB] 2024-01-17T20:55:55.521 INFO:teuthology.orchestra.run.smithi161.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-653-g1ec1182e-1jammy [3,119 kB] 2024-01-17T20:55:58.311 INFO:teuthology.orchestra.run.smithi161.stdout:Get:126 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-653-g1ec1182e-1jammy [178 kB] 2024-01-17T20:55:58.490 INFO:teuthology.orchestra.run.smithi161.stdout:Get:127 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-653-g1ec1182e-1jammy [702 MB] 2024-01-17T20:55:59.237 INFO:teuthology.orchestra.run.smithi190.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-653-g1ec1182e-1jammy [121 kB] 2024-01-17T20:55:59.327 INFO:teuthology.orchestra.run.smithi190.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-653-g1ec1182e-1jammy [226 kB] 2024-01-17T20:55:59.607 INFO:teuthology.orchestra.run.smithi190.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-653-g1ec1182e-1jammy [34.0 kB] 2024-01-17T20:55:59.632 INFO:teuthology.orchestra.run.smithi190.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-653-g1ec1182e-1jammy [23.4 kB] 2024-01-17T20:55:59.674 INFO:teuthology.orchestra.run.smithi190.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-653-g1ec1182e-1jammy [38.4 kB] 2024-01-17T20:55:59.703 INFO:teuthology.orchestra.run.smithi190.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-653-g1ec1182e-1jammy [12.3 MB] 2024-01-17T20:56:27.483 INFO:teuthology.orchestra.run.smithi190.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-653-g1ec1182e-1jammy [91.7 kB] 2024-01-17T20:56:27.672 INFO:teuthology.orchestra.run.smithi190.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-653-g1ec1182e-1jammy [3,119 kB] 2024-01-17T20:56:41.009 INFO:teuthology.orchestra.run.smithi190.stdout:Get:126 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-653-g1ec1182e-1jammy [178 kB] 2024-01-17T20:56:41.466 INFO:teuthology.orchestra.run.smithi190.stdout:Get:127 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-653-g1ec1182e-1jammy [702 MB] 2024-01-17T21:19:09.547 INFO:teuthology.orchestra.run.smithi161.stdout:Get:128 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-653-g1ec1182e-1jammy [18.1 MB] 2024-01-17T21:19:53.393 INFO:teuthology.orchestra.run.smithi161.stdout:Get:129 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-653-g1ec1182e-1jammy [77.6 MB] 2024-01-17T21:22:51.037 INFO:teuthology.orchestra.run.smithi161.stdout:Get:130 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-653-g1ec1182e-1jammy [41.3 MB] 2024-01-17T21:24:14.329 INFO:teuthology.orchestra.run.smithi161.stdout:Get:131 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-653-g1ec1182e-1jammy [158 MB] 2024-01-17T21:26:44.050 INFO:teuthology.orchestra.run.smithi190.stdout:Get:128 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-653-g1ec1182e-1jammy [18.1 MB] 2024-01-17T21:27:41.141 INFO:teuthology.orchestra.run.smithi190.stdout:Get:129 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-653-g1ec1182e-1jammy [77.6 MB] 2024-01-17T21:31:07.595 INFO:teuthology.orchestra.run.smithi161.stdout:Get:132 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-653-g1ec1182e-1jammy [535 MB] 2024-01-17T21:31:42.119 INFO:teuthology.orchestra.run.smithi190.stdout:Get:130 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-653-g1ec1182e-1jammy [41.3 MB] 2024-01-17T21:33:48.823 INFO:teuthology.orchestra.run.smithi190.stdout:Get:131 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-653-g1ec1182e-1jammy [158 MB] 2024-01-17T21:40:20.205 INFO:teuthology.orchestra.run.smithi190.stdout:Get:132 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-653-g1ec1182e-1jammy [535 MB] 2024-01-17T21:49:37.211 INFO:teuthology.orchestra.run.smithi161.stdout:Get:133 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-653-g1ec1182e-1jammy [1,134 MB] 2024-01-17T22:04:18.275 INFO:teuthology.orchestra.run.smithi190.stdout:Get:133 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-653-g1ec1182e-1jammy [1,134 MB] 2024-01-17T22:26:33.785 INFO:teuthology.orchestra.run.smithi161.stdout:Get:134 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-653-g1ec1182e-1jammy [16.3 MB] 2024-01-17T22:26:42.082 INFO:teuthology.orchestra.run.smithi161.stdout:Get:135 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-653-g1ec1182e-1jammy [81.3 MB] 2024-01-17T22:28:48.755 INFO:teuthology.orchestra.run.smithi161.stdout:Get:136 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-653-g1ec1182e-1jammy [11.2 MB] 2024-01-17T22:29:06.130 INFO:teuthology.orchestra.run.smithi161.stdout:Get:137 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-653-g1ec1182e-1jammy [103 MB] 2024-01-17T22:31:21.993 INFO:teuthology.orchestra.run.smithi161.stdout:Get:138 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-653-g1ec1182e-1jammy [163 MB] 2024-01-17T22:35:36.494 INFO:teuthology.orchestra.run.smithi161.stdout:Get:139 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-653-g1ec1182e-1jammy [319 MB] 2024-01-17T22:43:37.266 INFO:teuthology.orchestra.run.smithi161.stdout:Get:140 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-653-g1ec1182e-1jammy [1,697 kB] 2024-01-17T22:43:39.284 INFO:teuthology.orchestra.run.smithi161.stdout:Get:141 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-653-g1ec1182e-1jammy [97.0 MB] 2024-01-17T22:44:54.182 INFO:teuthology.orchestra.run.smithi190.stdout:Get:134 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-653-g1ec1182e-1jammy [16.3 MB] 2024-01-17T22:45:14.948 INFO:teuthology.orchestra.run.smithi190.stdout:Get:135 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-653-g1ec1182e-1jammy [81.3 MB] 2024-01-17T22:45:17.925 INFO:teuthology.orchestra.run.smithi161.stdout:Get:142 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-653-g1ec1182e-1jammy [2,998 kB] 2024-01-17T22:45:23.515 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 3,638 MB in 1h 53min 31s (534 kB/s) 2024-01-17T22:45:23.651 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-17T22:45:23.717 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2024-01-17T22:45:23.720 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-17T22:45:23.766 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-17T22:45:24.019 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-17T22:45:24.032 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-17T22:45:24.077 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-17T22:45:24.405 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cmd2. 2024-01-17T22:45:24.418 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-17T22:45:24.463 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-17T22:45:24.816 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-17T22:45:24.830 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-17T22:45:24.916 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-17T22:45:25.295 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-17T22:45:25.309 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-17T22:45:25.361 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-17T22:45:25.656 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-17T22:45:25.671 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-17T22:45:25.706 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-17T22:45:26.109 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-17T22:45:26.124 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-17T22:45:26.175 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:45:26.629 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-17T22:45:26.644 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-17T22:45:26.687 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:45:26.998 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-17T22:45:27.013 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-17T22:45:27.048 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:45:27.368 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-17T22:45:27.383 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-17T22:45:27.425 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-17T22:45:27.729 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librados2. 2024-01-17T22:45:27.743 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../010-librados2_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:27.812 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librados2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:28.232 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librbd1. 2024-01-17T22:45:28.245 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../011-librbd1_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:28.290 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librbd1 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:28.667 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs2. 2024-01-17T22:45:28.681 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:28.717 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:28.986 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rados. 2024-01-17T22:45:29.000 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../013-python3-rados_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:29.044 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rados (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:29.414 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-17T22:45:29.428 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:45:29.472 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-argparse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:29.708 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cephfs. 2024-01-17T22:45:29.722 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:29.766 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cephfs (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:30.044 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-17T22:45:30.058 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:45:30.093 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-common (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:30.413 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-prettytable. 2024-01-17T22:45:30.428 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-17T22:45:30.471 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-17T22:45:30.766 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rbd. 2024-01-17T22:45:30.781 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:30.824 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rbd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:31.168 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-17T22:45:31.183 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-17T22:45:31.226 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-17T22:45:31.504 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-17T22:45:31.519 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-17T22:45:31.562 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-17T22:45:31.907 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-17T22:45:31.922 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-17T22:45:31.956 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-17T22:45:32.276 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package lua5.1. 2024-01-17T22:45:32.291 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-17T22:45:32.334 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-17T22:45:32.648 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package lua-any. 2024-01-17T22:45:32.663 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-17T22:45:32.706 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-17T22:45:32.942 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package zip. 2024-01-17T22:45:32.957 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-17T22:45:32.992 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking zip (3.0-12build2) ... 2024-01-17T22:45:33.337 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package unzip. 2024-01-17T22:45:33.352 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-17T22:45:33.395 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-17T22:45:33.766 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package luarocks. 2024-01-17T22:45:33.781 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-17T22:45:33.824 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-17T22:45:34.198 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librgw2. 2024-01-17T22:45:34.212 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../027-librgw2_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:34.248 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librgw2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:34.717 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rgw. 2024-01-17T22:45:34.731 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:34.775 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rgw (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:35.087 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-17T22:45:35.101 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-17T22:45:35.145 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-17T22:45:35.456 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libradosstriper1. 2024-01-17T22:45:35.471 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:35.514 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libradosstriper1 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:35.985 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-common. 2024-01-17T22:45:36.000 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../031-ceph-common_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:36.034 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-common (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:37.031 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-base. 2024-01-17T22:45:37.046 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../032-ceph-base_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:37.098 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-base (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:37.677 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-17T22:45:37.691 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-17T22:45:37.735 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-17T22:45:38.021 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cheroot. 2024-01-17T22:45:38.036 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-17T22:45:38.080 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-17T22:45:38.391 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-17T22:45:38.406 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-17T22:45:38.466 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-17T22:45:38.810 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-17T22:45:38.826 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-17T22:45:38.869 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-17T22:45:39.180 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-17T22:45:39.195 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-17T22:45:39.238 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-17T22:45:39.500 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tempora. 2024-01-17T22:45:39.515 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-17T22:45:39.549 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-17T22:45:39.827 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-portend. 2024-01-17T22:45:39.842 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-17T22:45:39.885 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-17T22:45:40.230 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-17T22:45:40.245 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-17T22:45:40.288 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-17T22:45:40.608 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-17T22:45:40.623 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-17T22:45:40.666 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-17T22:45:41.011 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-natsort. 2024-01-17T22:45:41.026 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-17T22:45:41.069 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-17T22:45:41.381 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-logutils. 2024-01-17T22:45:41.396 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-17T22:45:41.438 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-17T22:45:41.776 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-17T22:45:41.791 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-17T22:45:41.833 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-17T22:45:42.111 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-mako. 2024-01-17T22:45:42.127 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-17T22:45:42.169 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-17T22:45:42.481 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-17T22:45:42.496 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-17T22:45:42.539 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-17T22:45:42.850 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-17T22:45:42.865 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-17T22:45:42.950 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-17T22:45:43.236 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webob. 2024-01-17T22:45:43.251 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-17T22:45:43.296 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-17T22:45:43.631 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-waitress. 2024-01-17T22:45:43.646 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-17T22:45:43.683 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-17T22:45:43.959 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tempita. 2024-01-17T22:45:43.974 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-17T22:45:44.008 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-17T22:45:44.353 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-paste. 2024-01-17T22:45:44.369 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-17T22:45:44.411 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-17T22:45:44.690 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-17T22:45:44.704 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-17T22:45:44.748 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-17T22:45:45.051 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-17T22:45:45.066 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-17T22:45:45.109 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-17T22:45:45.412 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webtest. 2024-01-17T22:45:45.427 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-17T22:45:45.470 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-17T22:45:45.823 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pecan. 2024-01-17T22:45:45.838 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-17T22:45:45.881 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-17T22:45:46.236 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-certifi. 2024-01-17T22:45:46.251 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-17T22:45:46.286 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-17T22:45:46.580 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-idna. 2024-01-17T22:45:46.595 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-17T22:45:46.638 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-17T22:45:46.950 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-urllib3. 2024-01-17T22:45:46.965 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-17T22:45:47.041 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-17T22:45:47.345 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-requests. 2024-01-17T22:45:47.360 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-17T22:45:47.403 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-17T22:45:47.714 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-17T22:45:47.729 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-17T22:45:47.772 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-17T22:45:48.050 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-17T22:45:48.066 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:45:48.108 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-modules-core (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:48.538 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-17T22:45:48.553 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:48.596 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:48.924 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-17T22:45:48.940 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-17T22:45:48.983 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-17T22:45:49.269 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-openssl. 2024-01-17T22:45:49.284 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-17T22:45:49.327 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-17T22:45:49.663 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr. 2024-01-17T22:45:49.679 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:49.754 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:50.100 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mon. 2024-01-17T22:45:50.115 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:50.150 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mon (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:50.712 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-osd. 2024-01-17T22:45:50.726 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:50.769 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-osd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:51.556 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph. 2024-01-17T22:45:51.571 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../068-ceph_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:51.614 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:51.909 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-fuse. 2024-01-17T22:45:51.924 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:51.958 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-fuse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:52.320 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mds. 2024-01-17T22:45:52.335 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:52.378 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mds (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:52.781 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephadm. 2024-01-17T22:45:52.796 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../071-cephadm_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:45:52.839 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephadm (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:53.167 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-17T22:45:53.182 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-17T22:45:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-17T22:45:53.536 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-17T22:45:53.551 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-17T22:45:53.594 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-17T22:45:54.899 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-babel. 2024-01-17T22:45:54.913 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-17T22:45:54.957 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-17T22:45:55.310 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jinja2. 2024-01-17T22:45:55.324 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2024-01-17T22:45:55.368 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-17T22:45:55.672 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-17T22:45:55.685 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:45:55.729 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-cephadm (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:56.058 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-17T22:45:56.072 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-17T22:45:56.116 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-17T22:45:56.419 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-routes. 2024-01-17T22:45:56.433 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-17T22:45:56.477 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-17T22:45:56.855 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-17T22:45:56.869 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:45:56.913 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-dashboard (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:45:57.342 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-17T22:45:57.356 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-17T22:45:57.400 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-17T22:45:57.895 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-joblib. 2024-01-17T22:45:57.909 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-17T22:45:57.995 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-17T22:45:58.357 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-17T22:45:58.371 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-17T22:45:58.501 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-17T22:45:58.803 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn. 2024-01-17T22:45:58.818 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-17T22:45:58.853 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-17T22:45:59.529 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-17T22:45:59.544 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:45:59.587 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:00.507 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cachetools. 2024-01-17T22:46:00.521 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-17T22:46:00.557 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-17T22:46:00.893 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-17T22:46:00.908 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-17T22:46:00.951 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-17T22:46:01.280 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-17T22:46:01.294 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-17T22:46:01.338 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-17T22:46:01.650 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rsa. 2024-01-17T22:46:01.663 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-17T22:46:01.708 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-17T22:46:02.003 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-google-auth. 2024-01-17T22:46:02.017 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-17T22:46:02.087 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-17T22:46:02.356 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-17T22:46:02.370 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-17T22:46:02.406 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-17T22:46:02.726 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-websocket. 2024-01-17T22:46:02.740 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-17T22:46:02.784 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-17T22:46:03.112 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-17T22:46:03.127 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-17T22:46:03.170 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-17T22:46:03.918 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-17T22:46:03.932 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:46:03.968 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:04.287 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-17T22:46:04.301 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-17T22:46:04.345 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-17T22:46:04.682 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-17T22:46:04.696 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-17T22:46:04.740 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-17T22:46:05.043 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package jq. 2024-01-17T22:46:05.057 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-17T22:46:05.101 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-17T22:46:05.329 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package socat. 2024-01-17T22:46:05.344 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-17T22:46:05.387 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-17T22:46:05.715 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package xmlstarlet. 2024-01-17T22:46:05.730 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-17T22:46:05.773 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-17T22:46:06.094 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-test. 2024-01-17T22:46:06.109 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../099-ceph-test_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:06.161 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-test (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:08.041 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-volume. 2024-01-17T22:46:08.056 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:46:08.098 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-volume (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:08.461 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-17T22:46:08.476 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:08.519 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephfs-mirror (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:08.831 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-colorama. 2024-01-17T22:46:08.846 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-17T22:46:08.888 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-17T22:46:09.199 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephfs-shell. 2024-01-17T22:46:09.215 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:46:09.257 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephfs-shell (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:09.519 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephfs-top. 2024-01-17T22:46:09.534 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:46:09.576 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephfs-top (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:09.829 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-17T22:46:09.845 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:09.887 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs-dev (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:10.234 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-17T22:46:10.249 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-17T22:46:10.488 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-17T22:46:10.813 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-17T22:46:10.828 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-17T22:46:10.871 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-17T22:46:11.241 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package nvme-cli. 2024-01-17T22:46:11.257 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-17T22:46:11.291 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-17T22:46:11.688 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package pkg-config. 2024-01-17T22:46:11.703 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-17T22:46:11.746 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-17T22:46:12.041 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-17T22:46:12.056 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-17T22:46:12.091 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-17T22:46:12.511 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-17T22:46:12.525 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-17T22:46:12.560 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-17T22:46:12.830 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastescript. 2024-01-17T22:46:12.845 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-17T22:46:12.888 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-17T22:46:13.235 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pluggy. 2024-01-17T22:46:13.250 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-17T22:46:13.299 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-17T22:46:13.611 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-psutil. 2024-01-17T22:46:13.626 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-17T22:46:13.669 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-17T22:46:13.997 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-py. 2024-01-17T22:46:14.012 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-17T22:46:14.055 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-17T22:46:14.408 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pygments. 2024-01-17T22:46:14.424 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-17T22:46:14.466 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-17T22:46:14.937 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-17T22:46:14.952 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-17T22:46:14.995 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-17T22:46:15.273 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-toml. 2024-01-17T22:46:15.287 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-17T22:46:15.322 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-17T22:46:15.600 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pytest. 2024-01-17T22:46:15.616 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-17T22:46:15.658 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-17T22:46:16.029 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplejson. 2024-01-17T22:46:16.045 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-17T22:46:16.078 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-17T22:46:16.306 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-17T22:46:16.322 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-17T22:46:16.356 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-17T22:46:17.068 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package radosgw. 2024-01-17T22:46:17.082 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../122-radosgw_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:17.126 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking radosgw (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:17.738 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package rbd-fuse. 2024-01-17T22:46:17.752 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:17.796 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking rbd-fuse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:18.132 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package rbd-mirror. 2024-01-17T22:46:18.147 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:18.190 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking rbd-mirror (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:18.559 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package rbd-nbd. 2024-01-17T22:46:18.574 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:18.619 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking rbd-nbd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:18.937 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-common-dbg. 2024-01-17T22:46:18.952 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:18.987 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-common-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:25.333 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-01-17T22:46:25.348 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:25.390 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-fuse-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:25.826 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-01-17T22:46:25.842 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:25.893 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mds-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:26.871 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-01-17T22:46:26.886 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:26.928 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:27.589 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-01-17T22:46:27.605 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:27.639 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mon-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:29.158 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-01-17T22:46:29.173 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:29.216 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-osd-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:34.136 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-test-dbg. 2024-01-17T22:46:34.152 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:34.194 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-test-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:44.168 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-01-17T22:46:44.183 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:44.226 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:44.629 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librados2-dbg. 2024-01-17T22:46:44.644 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:44.687 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librados2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:45.706 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-01-17T22:46:45.723 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:45.764 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libradosstriper1-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:46.142 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librbd1-dbg. 2024-01-17T22:46:46.158 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:46.200 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librbd1-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:47.403 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librgw2-dbg. 2024-01-17T22:46:47.419 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:47.461 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librgw2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:49.264 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package radosgw-dbg. 2024-01-17T22:46:49.279 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:49.322 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking radosgw-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:52.508 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-01-17T22:46:52.524 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:52.566 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking rbd-fuse-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:52.810 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-01-17T22:46:52.826 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:52.860 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking rbd-mirror-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:54.037 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-01-17T22:46:54.053 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:46:54.095 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking rbd-nbd-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:54.423 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-17T22:46:54.692 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-17T22:46:54.818 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-17T22:46:55.064 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-17T22:46:55.153 INFO:teuthology.orchestra.run.smithi190.stdout:Get:136 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-653-g1ec1182e-1jammy [11.2 MB] 2024-01-17T22:46:55.460 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-17T22:46:56.015 INFO:teuthology.orchestra.run.smithi161.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-17T22:46:56.080 INFO:teuthology.orchestra.run.smithi161.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-01-17T22:46:56.120 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephadm (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:46:56.681 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user cephadm....done 2024-01-17T22:46:56.834 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-17T22:46:57.111 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-17T22:46:57.370 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-17T22:46:57.496 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-17T22:46:57.755 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-17T22:46:58.040 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-17T22:46:58.166 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-17T22:46:58.468 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-17T22:46:58.844 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-17T22:46:59.121 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-17T22:46:59.380 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-17T22:46:59.673 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-17T22:46:59.958 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-17T22:47:00.009 INFO:teuthology.orchestra.run.smithi190.stdout:Get:137 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-653-g1ec1182e-1jammy [103 MB] 2024-01-17T22:47:00.242 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-17T22:47:00.510 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-17T22:47:00.753 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-argparse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:01.021 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-17T22:47:01.146 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-17T22:47:01.281 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-17T22:47:01.549 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-17T22:47:01.666 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-17T22:47:01.918 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-17T22:47:02.400 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-17T22:47:02.431 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-17T22:47:02.496 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-17T22:47:02.622 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-17T22:47:02.998 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-17T22:47:03.124 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-17T22:47:03.400 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-17T22:47:03.660 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-17T22:47:03.969 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up zip (3.0-12build2) ... 2024-01-17T22:47:04.095 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-17T22:47:04.789 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-17T22:47:05.057 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-17T22:47:05.183 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-17T22:47:05.292 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-17T22:47:05.594 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-17T22:47:05.978 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-17T22:47:06.287 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-17T22:47:06.681 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-17T22:47:06.982 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-17T22:47:07.300 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-17T22:47:07.643 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-17T22:47:07.894 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-17T22:47:08.020 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-common (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:08.321 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-idna (3.3-1) ... 2024-01-17T22:47:08.665 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-17T22:47:09.879 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-17T22:47:10.155 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:47:10.298 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-17T22:47:10.574 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-17T22:47:10.692 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-17T22:47:10.793 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-17T22:47:11.078 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-17T22:47:11.354 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-17T22:47:11.622 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:47:11.756 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-17T22:47:12.074 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-17T22:47:12.342 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-17T22:47:12.601 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-17T22:47:12.886 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-17T22:47:13.145 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-17T22:47:13.421 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-17T22:47:13.547 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-17T22:47:13.857 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-17T22:47:13.983 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-17T22:47:14.276 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-17T22:47:14.560 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-17T22:47:14.811 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-17T22:47:14.937 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-17T22:47:15.063 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-17T22:47:15.151 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-17T22:47:15.382 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-17T22:47:15.508 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-17T22:47:15.918 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-17T22:47:16.169 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-17T22:47:16.295 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-17T22:47:16.554 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:47:16.680 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-17T22:47:17.031 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-17T22:47:17.341 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-17T22:47:17.617 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-17T22:47:17.803 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-17T22:47:18.473 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-17T22:47:18.756 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-17T22:47:19.024 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-17T22:47:19.401 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-17T22:47:19.669 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-17T22:47:20.013 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-17T22:47:20.139 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librados2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:20.265 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libsqlite3-mod-ceph (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:20.391 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-17T22:47:20.669 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:20.795 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libradosstriper1 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:20.921 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-17T22:47:21.231 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librados2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:21.357 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librbd1 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:21.483 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:21.609 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-modules-core (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:21.726 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-fuse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:21.923 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-17T22:47:21.923 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-17T22:47:22.520 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libradosstriper1-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:22.645 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs-dev (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:22.772 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-fuse-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:22.897 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rados (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:23.024 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librgw2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:23.149 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephfs-top (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:23.276 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-17T22:47:24.546 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librbd1-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:24.672 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rbd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:24.798 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librgw2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:24.924 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up rbd-fuse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:25.033 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up rbd-nbd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:25.134 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rgw (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:25.277 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cephfs (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:25.403 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up rbd-nbd-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:25.529 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephfs-shell (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:25.655 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up rbd-fuse-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:25.798 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-common (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:26.284 INFO:teuthology.orchestra.run.smithi161.stdout:Adding group ceph....done 2024-01-17T22:47:26.686 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user ceph....done 2024-01-17T22:47:26.857 INFO:teuthology.orchestra.run.smithi161.stdout:Setting system user ceph properties....done 2024-01-17T22:47:26.878 INFO:teuthology.orchestra.run.smithi161.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-17T22:47:27.017 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-17T22:47:27.400 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-17T22:47:28.001 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephfs-mirror (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:28.193 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-17T22:47:28.193 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-17T22:47:28.803 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-test (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:28.928 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up radosgw (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:29.451 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-17T22:47:29.451 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-17T22:47:30.013 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-base (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:30.368 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-17T22:47:30.998 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mds (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:31.220 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-17T22:47:31.220 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-17T22:47:31.825 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-common-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:31.926 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up rbd-mirror (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:32.168 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-01-17T22:47:32.169 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-01-17T22:47:32.786 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:32.997 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-17T22:47:32.997 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-17T22:47:33.612 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mds-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:33.771 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up radosgw-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:33.898 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-test-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:34.023 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-osd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:34.327 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-17T22:47:34.327 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-17T22:47:34.942 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:35.051 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-osd-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:35.177 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up rbd-mirror-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:35.303 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-k8sevents (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:35.437 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:35.580 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mon (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:35.789 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-17T22:47:35.789 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-17T22:47:36.390 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-cephadm (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:36.532 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:36.642 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-dashboard (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:36.767 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mon-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:36.885 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-volume (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:47:37.246 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-17T22:47:37.364 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-17T22:47:37.557 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-17T22:47:38.683 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-17T22:47:39.456 INFO:teuthology.orchestra.run.smithi161.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-17T22:47:39.460 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-17T22:47:39.534 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-01-17T22:47:39.699 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2024-01-17T22:47:39.700 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2024-01-17T22:47:39.852 INFO:teuthology.orchestra.run.smithi161.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-17T22:47:39.852 INFO:teuthology.orchestra.run.smithi161.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-17T22:47:39.852 INFO:teuthology.orchestra.run.smithi161.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-17T22:47:39.853 INFO:teuthology.orchestra.run.smithi161.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-17T22:47:39.853 INFO:teuthology.orchestra.run.smithi161.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-17T22:47:39.853 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2024-01-17T22:47:39.853 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-17T22:47:39.853 INFO:teuthology.orchestra.run.smithi161.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-17T22:47:39.853 INFO:teuthology.orchestra.run.smithi161.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-17T22:47:39.853 INFO:teuthology.orchestra.run.smithi161.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-17T22:47:39.854 INFO:teuthology.orchestra.run.smithi161.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-17T22:47:39.854 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-17T22:47:39.854 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2024-01-17T22:47:39.854 INFO:teuthology.orchestra.run.smithi161.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-17T22:47:39.854 INFO:teuthology.orchestra.run.smithi161.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-17T22:47:39.855 INFO:teuthology.orchestra.run.smithi161.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-17T22:47:39.855 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-17T22:47:39.855 INFO:teuthology.orchestra.run.smithi161.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-17T22:47:39.855 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2024-01-17T22:47:39.855 INFO:teuthology.orchestra.run.smithi161.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-17T22:47:39.856 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-17T22:47:39.856 INFO:teuthology.orchestra.run.smithi161.stdout: libengine-pkcs11-openssl 2024-01-17T22:47:39.904 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2024-01-17T22:47:39.905 INFO:teuthology.orchestra.run.smithi161.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-17T22:47:39.905 INFO:teuthology.orchestra.run.smithi161.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-17T22:47:39.905 INFO:teuthology.orchestra.run.smithi161.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-17T22:47:39.905 INFO:teuthology.orchestra.run.smithi161.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-17T22:47:39.906 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-17T22:47:39.906 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-17T22:47:39.906 INFO:teuthology.orchestra.run.smithi161.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-17T22:47:39.906 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages will be upgraded: 2024-01-17T22:47:39.907 INFO:teuthology.orchestra.run.smithi161.stdout: libssl3 2024-01-17T22:47:40.114 INFO:teuthology.orchestra.run.smithi161.stdout:1 upgraded, 39 newly installed, 0 to remove and 268 not upgraded. 2024-01-17T22:47:40.114 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 54.6 MB of archives. 2024-01-17T22:47:40.114 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-17T22:47:40.114 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-17T22:47:40.611 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-17T22:47:40.868 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-17T22:47:40.902 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-17T22:47:40.904 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-17T22:47:40.909 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-17T22:47:40.913 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-17T22:47:40.913 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-17T22:47:40.916 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-17T22:47:40.918 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-17T22:47:40.919 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-17T22:47:41.083 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-17T22:47:41.416 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-17T22:47:42.475 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-17T22:47:42.477 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-17T22:47:42.477 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2024-01-17T22:47:42.480 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-17T22:47:42.480 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-17T22:47:42.502 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-17T22:47:42.504 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-17T22:47:42.511 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-17T22:47:42.511 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-17T22:47:42.752 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-17T22:47:42.835 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2024-01-17T22:47:43.308 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-17T22:47:43.438 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-17T22:47:43.448 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-17T22:47:43.449 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-17T22:47:43.450 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-17T22:47:43.452 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-17T22:47:43.485 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-17T22:47:43.489 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-17T22:47:43.926 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-17T22:47:44.091 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-17T22:47:44.173 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-17T22:47:44.173 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-17T22:47:44.255 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-17T22:47:44.263 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-17T22:47:44.732 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-17T22:47:44.734 INFO:teuthology.orchestra.run.smithi161.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-17T22:47:45.122 INFO:teuthology.orchestra.run.smithi161.stdout:Preconfiguring packages ... 2024-01-17T22:47:45.266 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 54.6 MB in 5s (11.3 MB/s) 2024-01-17T22:47:45.408 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package flex. 2024-01-17T22:47:45.479 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140861 files and directories currently installed.) 2024-01-17T22:47:45.483 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-17T22:47:45.549 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-17T22:47:46.076 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-17T22:47:46.270 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-17T22:47:46.668 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-17T22:47:47.204 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package bison. 2024-01-17T22:47:47.273 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140934 files and directories currently installed.) 2024-01-17T22:47:47.277 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-17T22:47:47.323 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-17T22:47:47.875 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-17T22:47:47.889 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-17T22:47:47.933 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-17T22:47:48.294 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package dump. 2024-01-17T22:47:48.308 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-17T22:47:48.352 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking dump (0.4b47-3) ... 2024-01-17T22:47:48.647 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package indent. 2024-01-17T22:47:48.662 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:47:48.705 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-17T22:47:48.974 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-17T22:47:48.991 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-17T22:47:49.467 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-17T22:47:49.837 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-17T22:47:49.853 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-17T22:47:49.895 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-17T22:47:50.148 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-17T22:47:50.163 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-17T22:47:50.206 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-17T22:47:50.543 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-17T22:47:50.558 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-17T22:47:50.600 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-17T22:47:50.853 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-17T22:47:50.869 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-17T22:47:50.945 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-17T22:47:51.197 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjson-perl. 2024-01-17T22:47:51.213 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-17T22:47:51.255 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-17T22:47:51.575 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-17T22:47:51.591 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-17T22:47:51.633 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-17T22:47:53.044 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-17T22:47:53.060 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-17T22:47:53.102 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-17T22:47:53.346 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-17T22:47:53.362 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-17T22:47:53.404 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-17T22:47:53.766 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-17T22:47:53.781 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2024-01-17T22:47:53.832 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2024-01-17T22:47:54.176 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-17T22:47:54.192 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-17T22:47:54.235 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-17T22:47:54.697 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-17T22:47:54.712 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-17T22:47:54.755 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-17T22:47:55.142 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-17T22:47:55.158 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:47:55.200 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:47:55.552 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-17T22:47:55.568 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:47:55.611 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-17T22:47:55.905 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-17T22:47:55.921 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:47:55.955 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-17T22:47:56.190 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-17T22:47:56.206 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-17T22:47:56.248 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-17T22:47:56.810 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-17T22:47:56.825 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-17T22:47:56.868 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-17T22:47:57.213 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package modemmanager. 2024-01-17T22:47:57.229 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2024-01-17T22:47:57.271 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2024-01-17T22:47:57.910 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package network-manager. 2024-01-17T22:47:57.926 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-17T22:47:57.976 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-17T22:47:58.601 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ppp. 2024-01-17T22:47:58.617 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-17T22:47:58.929 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-17T22:47:59.296 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package pptp-linux. 2024-01-17T22:47:59.311 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-17T22:47:59.355 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-17T22:47:59.616 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-17T22:47:59.631 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-17T22:47:59.674 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-17T22:47:59.977 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-17T22:47:59.992 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-17T22:48:00.035 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-client-common (238) ... 2024-01-17T22:48:00.339 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-17T22:48:00.353 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:48:00.397 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:48:00.985 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-common. 2024-01-17T22:48:01.000 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-17T22:48:01.060 INFO:teuthology.orchestra.run.smithi161.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-17T22:48:01.091 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-common (238) ... 2024-01-17T22:48:01.559 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-14. 2024-01-17T22:48:01.573 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:48:01.619 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:48:02.786 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql. 2024-01-17T22:48:02.801 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-17T22:48:02.844 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql (14+238) ... 2024-01-17T22:48:03.088 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-client. 2024-01-17T22:48:03.103 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-17T22:48:03.146 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-client (14+238) ... 2024-01-17T22:48:03.432 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-17T22:48:03.446 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-17T22:48:03.490 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-17T22:48:03.809 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package tcl8.6. 2024-01-17T22:48:03.824 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-17T22:48:03.867 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-17T22:48:04.161 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package tcl. 2024-01-17T22:48:04.177 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-17T22:48:04.224 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-17T22:48:04.573 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package wpasupplicant. 2024-01-17T22:48:04.589 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-17T22:48:04.630 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-17T22:48:05.043 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-17T22:48:05.059 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-17T22:48:05.101 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-17T22:48:05.471 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-17T22:48:05.487 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-17T22:48:05.537 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-17T22:48:05.822 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-client-common (238) ... 2024-01-17T22:48:06.063 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-17T22:48:06.195 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-17T22:48:06.320 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:48:06.446 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-17T22:48:06.572 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-17T22:48:06.698 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:48:07.653 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-17T22:48:07.753 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-17T22:48:08.129 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-17T22:48:08.129 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-17T22:48:08.823 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-17T22:48:08.948 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-17T22:48:09.074 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-17T22:48:09.184 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-17T22:48:09.310 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-17T22:48:09.436 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-17T22:48:09.562 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-17T22:48:10.651 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-17T22:48:10.777 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up dump (0.4b47-3) ... 2024-01-17T22:48:10.872 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-17T22:48:10.937 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2024-01-17T22:48:11.063 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-17T22:48:11.188 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-17T22:48:11.314 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-17T22:48:11.440 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-17T22:48:11.596 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-17T22:48:11.667 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-17T22:48:11.776 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-17T22:48:11.952 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-17T22:48:12.078 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-17T22:48:12.204 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-17T22:48:12.372 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-client (14+238) ... 2024-01-17T22:48:12.498 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-17T22:48:13.077 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:48:13.078 INFO:teuthology.orchestra.run.smithi161.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-17T22:48:13.078 INFO:teuthology.orchestra.run.smithi161.stdout:which means they are currently configured by ifupdown: 2024-01-17T22:48:13.078 INFO:teuthology.orchestra.run.smithi161.stdout:- enp3s0f1 2024-01-17T22:48:13.078 INFO:teuthology.orchestra.run.smithi161.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-17T22:48:13.078 INFO:teuthology.orchestra.run.smithi161.stdout:remove their configuration from /etc/network/interfaces. 2024-01-17T22:48:13.078 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:48:13.208 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-17T22:48:13.616 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-17T22:48:14.020 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-17T22:48:14.692 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-17T22:48:14.835 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-17T22:48:14.961 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-17T22:48:15.087 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-common (238) ... 2024-01-17T22:48:16.056 INFO:teuthology.orchestra.run.smithi161.stdout:Adding user postgres to group ssl-cert 2024-01-17T22:48:16.336 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:48:16.337 INFO:teuthology.orchestra.run.smithi161.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-17T22:48:16.617 INFO:teuthology.orchestra.run.smithi161.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-17T22:48:16.618 INFO:teuthology.orchestra.run.smithi161.stdout:Removing obsolete dictionary files: 2024-01-17T22:48:17.296 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-17T22:48:17.740 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:48:18.123 INFO:teuthology.orchestra.run.smithi161.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-17T22:48:18.140 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-17T22:48:18.198 INFO:teuthology.orchestra.run.smithi161.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-17T22:48:18.198 INFO:teuthology.orchestra.run.smithi161.stdout:This user must also own the server process. 2024-01-17T22:48:18.198 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:48:18.198 INFO:teuthology.orchestra.run.smithi161.stdout:The database cluster will be initialized with locale "en_US". 2024-01-17T22:48:18.198 INFO:teuthology.orchestra.run.smithi161.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-17T22:48:18.198 INFO:teuthology.orchestra.run.smithi161.stdout:The default text search configuration will be set to "english". 2024-01-17T22:48:18.198 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:48:18.198 INFO:teuthology.orchestra.run.smithi161.stdout:Data page checksums are disabled. 2024-01-17T22:48:18.198 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:48:18.198 INFO:teuthology.orchestra.run.smithi161.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-17T22:48:18.199 INFO:teuthology.orchestra.run.smithi161.stdout:creating subdirectories ... ok 2024-01-17T22:48:18.199 INFO:teuthology.orchestra.run.smithi161.stdout:selecting dynamic shared memory implementation ... posix 2024-01-17T22:48:18.223 INFO:teuthology.orchestra.run.smithi161.stdout:selecting default max_connections ... 100 2024-01-17T22:48:18.257 INFO:teuthology.orchestra.run.smithi161.stdout:selecting default shared_buffers ... 128MB 2024-01-17T22:48:18.271 INFO:teuthology.orchestra.run.smithi161.stdout:selecting default time zone ... Etc/UTC 2024-01-17T22:48:18.271 INFO:teuthology.orchestra.run.smithi161.stdout:creating configuration files ... ok 2024-01-17T22:48:18.435 INFO:teuthology.orchestra.run.smithi161.stdout:running bootstrap script ... ok 2024-01-17T22:48:19.051 INFO:teuthology.orchestra.run.smithi161.stdout:performing post-bootstrap initialization ... ok 2024-01-17T22:48:19.563 INFO:teuthology.orchestra.run.smithi161.stdout:syncing data to disk ... ok 2024-01-17T22:48:20.058 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-17T22:48:23.506 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-17T22:48:23.631 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-17T22:48:23.749 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql (14+238) ... 2024-01-17T22:48:23.897 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-17T22:48:24.034 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2024-01-17T22:48:24.301 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-17T22:48:24.302 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-17T22:48:25.061 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-17T22:48:25.413 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-17T22:48:25.565 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-17T22:48:26.992 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-17T22:48:27.092 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-17T22:48:27.610 INFO:teuthology.orchestra.run.smithi161.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-17T22:48:27.617 DEBUG:teuthology.parallel:result is None 2024-01-17T22:48:28.516 INFO:teuthology.orchestra.run.smithi190.stdout:Get:138 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-653-g1ec1182e-1jammy [163 MB] 2024-01-17T22:50:28.173 INFO:teuthology.orchestra.run.smithi190.stdout:Get:139 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-653-g1ec1182e-1jammy [319 MB] 2024-01-17T22:53:26.785 INFO:teuthology.orchestra.run.smithi190.stdout:Get:140 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-653-g1ec1182e-1jammy [1,697 kB] 2024-01-17T22:53:27.662 INFO:teuthology.orchestra.run.smithi190.stdout:Get:141 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-653-g1ec1182e-1jammy [97.0 MB] 2024-01-17T22:53:55.007 INFO:teuthology.orchestra.run.smithi190.stdout:Get:142 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-653-g1ec1182e-1jammy [2,998 kB] 2024-01-17T22:53:55.943 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 3,638 MB in 2h 2min 3s (497 kB/s) 2024-01-17T22:53:56.067 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-17T22:53:56.150 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-01-17T22:53:56.155 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-17T22:53:56.190 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-17T22:53:56.401 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-17T22:53:56.413 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-17T22:53:56.443 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-17T22:53:56.787 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cmd2. 2024-01-17T22:53:56.808 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-17T22:53:56.845 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-17T22:53:57.182 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-17T22:53:57.227 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-17T22:53:57.282 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-17T22:53:57.635 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-17T22:53:57.656 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-17T22:53:57.693 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-17T22:53:58.238 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-17T22:53:58.258 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-17T22:53:58.288 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-17T22:53:58.744 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-17T22:53:58.764 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-17T22:53:58.810 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:53:59.196 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-17T22:53:59.217 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-17T22:53:59.246 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:53:59.608 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-17T22:53:59.628 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-17T22:53:59.666 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:54:00.011 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-17T22:54:00.031 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-17T22:54:00.069 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-17T22:54:00.405 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librados2. 2024-01-17T22:54:00.427 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../010-librados2_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:00.463 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librados2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:00.941 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librbd1. 2024-01-17T22:54:00.962 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../011-librbd1_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:01.016 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librbd1 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:01.419 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcephfs2. 2024-01-17T22:54:01.439 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:01.469 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcephfs2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:01.704 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rados. 2024-01-17T22:54:01.716 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../013-python3-rados_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:01.754 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rados (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:02.090 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-17T22:54:02.110 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:54:02.148 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-ceph-argparse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:02.401 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cephfs. 2024-01-17T22:54:02.421 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:02.459 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cephfs (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:02.745 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-17T22:54:02.765 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:54:02.795 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-ceph-common (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:03.123 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-prettytable. 2024-01-17T22:54:03.143 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-17T22:54:03.181 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-17T22:54:03.459 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rbd. 2024-01-17T22:54:03.476 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:03.517 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rbd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:03.878 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-17T22:54:03.899 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-17T22:54:03.936 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-17T22:54:04.206 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-17T22:54:04.218 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-17T22:54:04.247 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-17T22:54:04.550 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-17T22:54:04.562 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-17T22:54:04.600 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-17T22:54:04.937 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua5.1. 2024-01-17T22:54:04.957 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-17T22:54:04.995 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-17T22:54:05.322 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua-any. 2024-01-17T22:54:05.343 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-17T22:54:05.381 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-17T22:54:05.583 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package zip. 2024-01-17T22:54:05.595 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-17T22:54:05.625 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking zip (3.0-12build2) ... 2024-01-17T22:54:05.928 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package unzip. 2024-01-17T22:54:05.949 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-17T22:54:05.986 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-17T22:54:06.374 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package luarocks. 2024-01-17T22:54:06.394 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-17T22:54:06.432 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-17T22:54:06.814 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librgw2. 2024-01-17T22:54:06.835 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../027-librgw2_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:06.872 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librgw2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:07.425 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rgw. 2024-01-17T22:54:07.446 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:07.483 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rgw (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:07.778 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-17T22:54:07.798 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-17T22:54:07.827 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-17T22:54:08.139 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libradosstriper1. 2024-01-17T22:54:08.159 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:08.197 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libradosstriper1 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:08.642 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-common. 2024-01-17T22:54:08.663 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../031-ceph-common_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:08.700 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-common (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:09.922 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-base. 2024-01-17T22:54:09.942 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../032-ceph-base_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:09.989 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-base (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:10.543 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-17T22:54:10.563 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-17T22:54:10.601 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-17T22:54:10.887 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cheroot. 2024-01-17T22:54:10.907 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-17T22:54:10.945 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-17T22:54:11.323 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-17T22:54:11.344 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-17T22:54:11.381 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-17T22:54:11.692 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-17T22:54:11.713 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-17T22:54:11.750 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-17T22:54:12.003 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-17T22:54:12.015 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-17T22:54:12.045 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-17T22:54:12.339 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-tempora. 2024-01-17T22:54:12.360 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-17T22:54:12.397 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-17T22:54:12.709 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-portend. 2024-01-17T22:54:12.729 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-17T22:54:12.767 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-17T22:54:13.070 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-17T22:54:13.091 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-17T22:54:13.128 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-17T22:54:13.406 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-17T22:54:13.426 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-17T22:54:13.464 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-17T22:54:13.809 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-natsort. 2024-01-17T22:54:13.830 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-17T22:54:13.867 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-17T22:54:14.153 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-logutils. 2024-01-17T22:54:14.174 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-17T22:54:14.203 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-17T22:54:14.489 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-17T22:54:14.510 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-17T22:54:14.547 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-17T22:54:14.859 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-mako. 2024-01-17T22:54:14.879 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-17T22:54:14.917 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-17T22:54:15.245 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-17T22:54:15.266 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-17T22:54:15.303 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-17T22:54:15.631 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-17T22:54:15.652 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-17T22:54:15.689 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-17T22:54:15.958 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-webob. 2024-01-17T22:54:15.979 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-17T22:54:16.025 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-17T22:54:16.386 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-waitress. 2024-01-17T22:54:16.407 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-17T22:54:16.447 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-17T22:54:16.764 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-tempita. 2024-01-17T22:54:16.785 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-17T22:54:16.822 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-17T22:54:17.125 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-paste. 2024-01-17T22:54:17.146 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-17T22:54:17.183 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-17T22:54:17.512 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-17T22:54:17.524 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-17T22:54:17.561 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-17T22:54:17.864 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-17T22:54:17.885 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-17T22:54:17.922 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-17T22:54:18.217 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-webtest. 2024-01-17T22:54:18.237 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-17T22:54:18.275 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-17T22:54:18.595 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pecan. 2024-01-17T22:54:18.615 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-17T22:54:18.653 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-17T22:54:19.024 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-certifi. 2024-01-17T22:54:19.045 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-17T22:54:19.082 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-17T22:54:19.410 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-idna. 2024-01-17T22:54:19.431 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-17T22:54:19.485 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-17T22:54:19.804 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-urllib3. 2024-01-17T22:54:19.825 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-17T22:54:19.862 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-17T22:54:20.182 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-requests. 2024-01-17T22:54:20.203 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-17T22:54:20.240 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-17T22:54:20.552 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-17T22:54:20.572 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-17T22:54:20.610 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-17T22:54:20.929 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-17T22:54:20.941 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:54:20.979 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-modules-core (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:21.368 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-17T22:54:21.388 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:21.417 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:21.737 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-17T22:54:21.757 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-17T22:54:21.795 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-17T22:54:22.098 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-openssl. 2024-01-17T22:54:22.119 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-17T22:54:22.156 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-17T22:54:22.500 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr. 2024-01-17T22:54:22.521 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:22.567 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:22.920 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mon. 2024-01-17T22:54:22.941 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:22.978 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mon (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:23.640 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-osd. 2024-01-17T22:54:23.661 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:23.698 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-osd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:24.776 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph. 2024-01-17T22:54:24.788 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../068-ceph_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:24.826 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:25.112 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-fuse. 2024-01-17T22:54:25.133 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:25.162 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-fuse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:25.540 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mds. 2024-01-17T22:54:25.560 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:25.598 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mds (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:25.992 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephadm. 2024-01-17T22:54:26.013 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../071-cephadm_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:26.059 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephadm (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:26.378 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-17T22:54:26.399 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-17T22:54:26.436 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-17T22:54:26.772 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-17T22:54:26.784 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-17T22:54:26.822 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-17T22:54:27.911 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-babel. 2024-01-17T22:54:27.956 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-17T22:54:27.968 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-17T22:54:28.296 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jinja2. 2024-01-17T22:54:28.317 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2024-01-17T22:54:28.355 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-17T22:54:28.683 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-17T22:54:28.703 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:54:28.740 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-cephadm (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:29.386 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-17T22:54:29.407 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-17T22:54:29.444 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-17T22:54:29.747 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-routes. 2024-01-17T22:54:29.768 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-17T22:54:29.805 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-17T22:54:30.166 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-17T22:54:30.187 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:54:30.224 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-dashboard (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:30.636 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-17T22:54:30.648 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-17T22:54:30.700 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-17T22:54:31.198 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-joblib. 2024-01-17T22:54:31.219 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-17T22:54:31.264 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-17T22:54:31.592 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-17T22:54:31.613 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-17T22:54:31.803 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-17T22:54:32.114 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-sklearn. 2024-01-17T22:54:32.135 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-17T22:54:32.172 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-17T22:54:32.856 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-17T22:54:32.878 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:54:32.923 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:33.884 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cachetools. 2024-01-17T22:54:33.905 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-17T22:54:33.950 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-17T22:54:34.220 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-17T22:54:34.242 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-17T22:54:34.287 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-17T22:54:34.623 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-17T22:54:34.645 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-17T22:54:34.690 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-17T22:54:34.967 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rsa. 2024-01-17T22:54:34.980 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-17T22:54:35.017 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-17T22:54:35.338 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-google-auth. 2024-01-17T22:54:35.359 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-17T22:54:35.404 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-17T22:54:35.724 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-17T22:54:35.747 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-17T22:54:35.791 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-17T22:54:36.137 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-websocket. 2024-01-17T22:54:36.159 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-17T22:54:36.204 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-17T22:54:36.490 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-17T22:54:36.512 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-17T22:54:36.557 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-17T22:54:37.238 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-17T22:54:37.260 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:54:37.304 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:37.623 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-17T22:54:37.645 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-17T22:54:37.690 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-17T22:54:38.018 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-17T22:54:38.039 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-17T22:54:38.076 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-17T22:54:38.328 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package jq. 2024-01-17T22:54:38.341 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-17T22:54:38.387 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-17T22:54:38.640 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package socat. 2024-01-17T22:54:38.652 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-17T22:54:38.689 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-17T22:54:39.017 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package xmlstarlet. 2024-01-17T22:54:39.030 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-17T22:54:39.075 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-17T22:54:39.446 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-test. 2024-01-17T22:54:39.468 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../099-ceph-test_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:39.513 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-test (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:41.617 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-volume. 2024-01-17T22:54:41.639 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:54:41.683 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-volume (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:42.054 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-17T22:54:42.076 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:42.120 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephfs-mirror (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:42.499 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-colorama. 2024-01-17T22:54:42.520 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-17T22:54:42.565 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-17T22:54:42.776 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephfs-shell. 2024-01-17T22:54:42.788 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:54:42.817 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephfs-shell (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:43.079 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephfs-top. 2024-01-17T22:54:43.100 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:54:43.145 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephfs-top (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:43.398 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-17T22:54:43.410 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:43.448 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcephfs-dev (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:43.759 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-17T22:54:43.777 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-17T22:54:43.817 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-17T22:54:44.197 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-17T22:54:44.219 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-17T22:54:44.263 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-17T22:54:44.642 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package nvme-cli. 2024-01-17T22:54:44.664 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-17T22:54:44.708 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-17T22:54:45.114 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package pkg-config. 2024-01-17T22:54:45.130 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-17T22:54:45.172 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-17T22:54:45.450 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-17T22:54:45.462 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-17T22:54:45.499 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-17T22:54:45.953 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-17T22:54:45.975 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-17T22:54:46.019 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-17T22:54:46.297 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pastescript. 2024-01-17T22:54:46.319 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-17T22:54:46.363 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-17T22:54:46.675 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pluggy. 2024-01-17T22:54:46.697 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-17T22:54:46.741 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-17T22:54:47.053 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-psutil. 2024-01-17T22:54:47.075 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-17T22:54:47.119 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-17T22:54:47.464 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-py. 2024-01-17T22:54:47.486 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-17T22:54:47.547 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-17T22:54:47.875 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pygments. 2024-01-17T22:54:47.897 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-17T22:54:47.942 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-17T22:54:48.446 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-17T22:54:48.468 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-17T22:54:48.512 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-17T22:54:48.824 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-toml. 2024-01-17T22:54:48.845 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-17T22:54:48.890 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-17T22:54:49.201 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pytest. 2024-01-17T22:54:49.223 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-17T22:54:49.267 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-17T22:54:49.631 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-simplejson. 2024-01-17T22:54:49.651 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-17T22:54:49.696 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-17T22:54:49.948 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-17T22:54:49.961 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-17T22:54:49.998 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-17T22:54:50.736 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package radosgw. 2024-01-17T22:54:50.755 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../122-radosgw_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:50.793 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking radosgw (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:51.547 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package rbd-fuse. 2024-01-17T22:54:51.568 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:51.613 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking rbd-fuse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:51.958 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package rbd-mirror. 2024-01-17T22:54:51.980 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:52.024 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking rbd-mirror (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:52.461 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package rbd-nbd. 2024-01-17T22:54:52.482 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:52.527 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking rbd-nbd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:54:52.763 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-common-dbg. 2024-01-17T22:54:52.776 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:54:52.813 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-common-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:00.008 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-01-17T22:55:00.037 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:00.074 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-fuse-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:00.559 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-01-17T22:55:00.572 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:00.609 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mds-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:01.646 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-01-17T22:55:01.667 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:01.712 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:02.398 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-01-17T22:55:02.410 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:02.447 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mon-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:04.158 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-01-17T22:55:04.171 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:04.208 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-osd-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:09.636 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-test-dbg. 2024-01-17T22:55:09.648 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:09.685 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-test-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:20.610 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-01-17T22:55:20.623 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:20.660 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcephfs2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:21.121 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librados2-dbg. 2024-01-17T22:55:21.133 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:21.170 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librados2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:22.256 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-01-17T22:55:22.269 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:22.306 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libradosstriper1-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:22.709 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librbd1-dbg. 2024-01-17T22:55:22.721 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:22.767 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librbd1-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:24.144 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librgw2-dbg. 2024-01-17T22:55:24.157 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:24.186 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librgw2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:25.955 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package radosgw-dbg. 2024-01-17T22:55:25.977 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:26.021 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking radosgw-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:29.366 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-01-17T22:55:29.388 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:29.432 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking rbd-fuse-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:29.693 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-01-17T22:55:29.706 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:29.743 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking rbd-mirror-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:31.204 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-01-17T22:55:31.226 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:31.270 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking rbd-nbd-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:31.614 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-17T22:55:31.883 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-17T22:55:32.010 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-17T22:55:32.245 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-17T22:55:32.583 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-17T22:55:33.059 INFO:teuthology.orchestra.run.smithi190.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-17T22:55:33.137 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephadm (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:33.847 INFO:teuthology.orchestra.run.smithi190.stdout:Adding system user cephadm....done 2024-01-17T22:55:34.070 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-17T22:55:34.460 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-17T22:55:34.853 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-17T22:55:34.980 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-17T22:55:35.248 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-17T22:55:35.516 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-17T22:55:35.633 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-17T22:55:35.935 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-17T22:55:36.295 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-17T22:55:36.546 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-17T22:55:36.814 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-17T22:55:37.090 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-17T22:55:37.375 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-17T22:55:37.635 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-17T22:55:37.878 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-17T22:55:38.137 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-ceph-argparse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:38.413 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-17T22:55:38.539 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-17T22:55:38.665 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-17T22:55:38.941 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-17T22:55:39.042 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-17T22:55:39.293 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-17T22:55:39.659 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-17T22:55:39.683 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-17T22:55:39.746 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-17T22:55:39.872 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-17T22:55:40.248 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-17T22:55:40.375 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-17T22:55:40.626 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-17T22:55:40.877 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-17T22:55:41.203 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up zip (3.0-12build2) ... 2024-01-17T22:55:41.329 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-17T22:55:42.073 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-17T22:55:42.348 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-17T22:55:42.475 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-17T22:55:42.601 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-17T22:55:42.902 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-17T22:55:43.278 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-17T22:55:43.529 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-17T22:55:43.914 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-17T22:55:44.207 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-17T22:55:44.542 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-17T22:55:44.876 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-17T22:55:45.127 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-17T22:55:45.253 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-ceph-common (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:45.538 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-idna (3.3-1) ... 2024-01-17T22:55:45.839 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-17T22:55:47.011 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-17T22:55:47.263 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:55:47.398 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-17T22:55:47.673 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-17T22:55:47.783 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-17T22:55:47.901 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-17T22:55:48.210 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-17T22:55:48.461 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-17T22:55:48.721 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:55:48.822 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-17T22:55:49.132 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-17T22:55:49.408 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-17T22:55:49.676 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-17T22:55:49.935 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-17T22:55:50.194 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-17T22:55:50.445 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-17T22:55:50.572 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-17T22:55:50.856 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-17T22:55:50.982 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-17T22:55:51.275 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-17T22:55:51.576 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-17T22:55:51.852 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-17T22:55:51.978 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-17T22:55:52.104 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-17T22:55:52.192 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-17T22:55:52.456 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-17T22:55:52.582 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-17T22:55:52.985 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-17T22:55:53.228 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-17T22:55:53.329 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-17T22:55:53.588 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:55:53.739 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-17T22:55:54.074 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-17T22:55:54.375 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-17T22:55:54.660 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-17T22:55:54.879 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-17T22:55:55.146 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-17T22:55:55.414 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-17T22:55:55.665 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-17T22:55:56.042 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-17T22:55:56.344 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-17T22:55:56.654 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-17T22:55:56.755 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librados2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:56.881 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libsqlite3-mod-ceph (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:57.007 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-17T22:55:57.343 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcephfs2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:57.461 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libradosstriper1 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:57.562 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-17T22:55:57.830 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librados2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:57.956 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librbd1 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:58.082 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcephfs2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:58.191 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-modules-core (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:58.309 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-fuse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:58.533 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-17T22:55:58.533 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-17T22:55:59.060 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libradosstriper1-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:59.169 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcephfs-dev (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:59.270 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-fuse-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:59.379 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rados (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:59.481 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librgw2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:59.606 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephfs-top (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:59.732 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-17T22:56:00.928 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librbd1-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:01.054 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rbd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:01.180 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librgw2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:01.306 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up rbd-fuse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:01.432 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up rbd-nbd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:01.557 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rgw (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:01.667 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cephfs (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:01.801 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up rbd-nbd-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:02.403 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephfs-shell (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:02.504 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up rbd-fuse-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:02.604 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-common (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:03.113 INFO:teuthology.orchestra.run.smithi190.stdout:Adding group ceph....done 2024-01-17T22:56:03.457 INFO:teuthology.orchestra.run.smithi190.stdout:Adding system user ceph....done 2024-01-17T22:56:03.701 INFO:teuthology.orchestra.run.smithi190.stdout:Setting system user ceph properties....done 2024-01-17T22:56:03.717 INFO:teuthology.orchestra.run.smithi190.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-17T22:56:03.860 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-17T22:56:04.219 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-17T22:56:04.764 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephfs-mirror (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:04.974 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-17T22:56:04.974 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-17T22:56:05.482 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-test (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:05.608 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up radosgw (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:06.090 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-17T22:56:06.090 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-17T22:56:06.576 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-base (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:06.934 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-17T22:56:07.444 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mds (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:07.876 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-17T22:56:07.876 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-17T22:56:08.355 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-common-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:08.482 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up rbd-mirror (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:08.694 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-01-17T22:56:08.694 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-01-17T22:56:09.191 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:09.410 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-17T22:56:09.411 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-17T22:56:09.950 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mds-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:10.110 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up radosgw-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:10.236 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-test-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:10.362 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-osd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:10.682 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-17T22:56:10.682 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-17T22:56:11.230 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:11.348 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-osd-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:11.449 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up rbd-mirror-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:11.575 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-k8sevents (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:11.701 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:11.852 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mon (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:12.061 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-17T22:56:12.061 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-17T22:56:12.545 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-cephadm (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:12.662 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:12.789 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-dashboard (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:13.032 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mon-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:13.158 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-volume (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:13.495 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-17T22:56:13.603 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-17T22:56:13.747 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-17T22:56:14.864 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-17T22:56:15.511 INFO:teuthology.orchestra.run.smithi190.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-17T22:56:15.514 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-17T22:56:15.611 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-01-17T22:56:15.781 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2024-01-17T22:56:15.782 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2024-01-17T22:56:15.931 INFO:teuthology.orchestra.run.smithi190.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-17T22:56:15.931 INFO:teuthology.orchestra.run.smithi190.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-17T22:56:15.932 INFO:teuthology.orchestra.run.smithi190.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-17T22:56:15.932 INFO:teuthology.orchestra.run.smithi190.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-17T22:56:15.932 INFO:teuthology.orchestra.run.smithi190.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-17T22:56:15.932 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2024-01-17T22:56:15.932 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-17T22:56:15.932 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-17T22:56:15.933 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-17T22:56:15.933 INFO:teuthology.orchestra.run.smithi190.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-01-17T22:56:15.933 INFO:teuthology.orchestra.run.smithi190.stdout: python2.7-minimal 2024-01-17T22:56:15.933 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-17T22:56:15.934 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2024-01-17T22:56:15.934 INFO:teuthology.orchestra.run.smithi190.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-17T22:56:15.934 INFO:teuthology.orchestra.run.smithi190.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-17T22:56:15.934 INFO:teuthology.orchestra.run.smithi190.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-17T22:56:15.934 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-17T22:56:15.934 INFO:teuthology.orchestra.run.smithi190.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-17T22:56:15.935 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2024-01-17T22:56:15.935 INFO:teuthology.orchestra.run.smithi190.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-17T22:56:15.935 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-17T22:56:15.935 INFO:teuthology.orchestra.run.smithi190.stdout: libengine-pkcs11-openssl 2024-01-17T22:56:15.971 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2024-01-17T22:56:15.972 INFO:teuthology.orchestra.run.smithi190.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-17T22:56:15.972 INFO:teuthology.orchestra.run.smithi190.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-17T22:56:15.973 INFO:teuthology.orchestra.run.smithi190.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-17T22:56:15.973 INFO:teuthology.orchestra.run.smithi190.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-17T22:56:15.973 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-17T22:56:15.973 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-17T22:56:15.973 INFO:teuthology.orchestra.run.smithi190.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-17T22:56:15.974 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages will be upgraded: 2024-01-17T22:56:15.975 INFO:teuthology.orchestra.run.smithi190.stdout: libssl3 2024-01-17T22:56:16.033 INFO:teuthology.orchestra.run.smithi190.stdout:1 upgraded, 39 newly installed, 0 to remove and 268 not upgraded. 2024-01-17T22:56:16.033 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 54.6 MB of archives. 2024-01-17T22:56:16.033 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-17T22:56:16.033 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-17T22:56:16.148 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-17T22:56:16.219 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-17T22:56:16.233 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-17T22:56:16.233 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-17T22:56:16.236 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-17T22:56:16.237 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-17T22:56:16.238 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-17T22:56:16.239 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-17T22:56:16.241 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-17T22:56:16.241 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-17T22:56:16.243 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-17T22:56:16.261 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-17T22:56:16.634 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-17T22:56:16.636 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-17T22:56:16.636 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2024-01-17T22:56:16.640 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-17T22:56:16.640 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-17T22:56:16.644 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-17T22:56:16.646 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-17T22:56:16.653 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-17T22:56:16.653 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-17T22:56:16.673 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-17T22:56:16.675 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2024-01-17T22:56:16.685 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-17T22:56:16.710 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-17T22:56:16.714 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-17T22:56:16.714 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-17T22:56:16.715 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-17T22:56:16.715 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-17T22:56:16.728 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-17T22:56:16.730 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-17T22:56:16.990 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-17T22:56:16.990 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-17T22:56:16.990 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-17T22:56:16.990 INFO:teuthology.orchestra.run.smithi190.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-17T22:56:16.990 INFO:teuthology.orchestra.run.smithi190.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-17T22:56:16.991 INFO:teuthology.orchestra.run.smithi190.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-17T22:56:17.000 INFO:teuthology.orchestra.run.smithi190.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-17T22:56:17.001 INFO:teuthology.orchestra.run.smithi190.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-17T22:56:17.403 INFO:teuthology.orchestra.run.smithi190.stdout:Preconfiguring packages ... 2024-01-17T22:56:17.564 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 54.6 MB in 1s (53.6 MB/s) 2024-01-17T22:56:17.704 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package flex. 2024-01-17T22:56:17.793 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138435 files and directories currently installed.) 2024-01-17T22:56:17.798 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-17T22:56:17.852 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-17T22:56:18.471 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-17T22:56:18.632 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-17T22:56:19.049 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-17T22:56:19.583 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package bison. 2024-01-17T22:56:19.673 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138508 files and directories currently installed.) 2024-01-17T22:56:19.678 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-17T22:56:19.735 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-17T22:56:20.169 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-17T22:56:20.191 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-17T22:56:20.236 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-17T22:56:20.539 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package dump. 2024-01-17T22:56:20.561 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-17T22:56:20.597 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking dump (0.4b47-3) ... 2024-01-17T22:56:21.170 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package indent. 2024-01-17T22:56:21.191 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:56:21.236 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-17T22:56:21.505 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-17T22:56:21.527 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-17T22:56:21.563 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-17T22:56:21.867 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-17T22:56:21.889 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-17T22:56:21.933 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-17T22:56:22.203 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-17T22:56:22.216 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-17T22:56:22.253 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-17T22:56:22.623 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-17T22:56:22.645 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-17T22:56:22.689 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-17T22:56:22.925 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-17T22:56:22.938 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-17T22:56:22.967 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-17T22:56:23.211 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjson-perl. 2024-01-17T22:56:23.234 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-17T22:56:23.278 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-17T22:56:23.589 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-17T22:56:23.612 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-17T22:56:23.647 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-17T22:56:25.376 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-17T22:56:25.398 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-17T22:56:25.442 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-17T22:56:25.720 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-17T22:56:25.733 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-17T22:56:25.769 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-17T22:56:26.097 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-17T22:56:26.119 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2024-01-17T22:56:26.281 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2024-01-17T22:56:26.659 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-17T22:56:26.681 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-17T22:56:26.726 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-17T22:56:27.062 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-17T22:56:27.084 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-17T22:56:27.128 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-17T22:56:27.481 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-17T22:56:27.503 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:56:27.548 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:56:27.876 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-17T22:56:27.897 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:56:27.934 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-17T22:56:28.253 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-17T22:56:28.275 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:56:28.320 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-17T22:56:28.564 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-17T22:56:28.586 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-17T22:56:28.630 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-17T22:56:29.117 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-17T22:56:29.140 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-17T22:56:29.184 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-17T22:56:29.495 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package modemmanager. 2024-01-17T22:56:29.517 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2024-01-17T22:56:29.561 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2024-01-17T22:56:30.160 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package network-manager. 2024-01-17T22:56:30.181 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-17T22:56:30.226 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-17T22:56:30.850 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ppp. 2024-01-17T22:56:30.872 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-17T22:56:31.193 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-17T22:56:31.848 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package pptp-linux. 2024-01-17T22:56:31.870 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-17T22:56:31.906 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-17T22:56:32.142 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-17T22:56:32.164 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-17T22:56:32.208 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-17T22:56:32.520 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-17T22:56:32.542 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-17T22:56:32.586 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-client-common (238) ... 2024-01-17T22:56:32.890 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-17T22:56:32.912 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:56:32.956 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:56:33.520 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-common. 2024-01-17T22:56:33.542 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-17T22:56:33.604 INFO:teuthology.orchestra.run.smithi190.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-17T22:56:33.634 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-common (238) ... 2024-01-17T22:56:34.052 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-14. 2024-01-17T22:56:34.073 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:56:34.121 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:56:35.454 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql. 2024-01-17T22:56:35.467 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-17T22:56:35.504 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql (14+238) ... 2024-01-17T22:56:35.748 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-client. 2024-01-17T22:56:35.770 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-17T22:56:35.814 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-client (14+238) ... 2024-01-17T22:56:36.058 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-17T22:56:36.071 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-17T22:56:36.108 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-17T22:56:36.394 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package tcl8.6. 2024-01-17T22:56:36.417 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-17T22:56:36.461 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-17T22:56:37.247 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package tcl. 2024-01-17T22:56:37.269 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-17T22:56:37.317 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-17T22:56:37.675 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package wpasupplicant. 2024-01-17T22:56:37.697 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-17T22:56:37.741 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-17T22:56:38.098 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-17T22:56:38.110 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-17T22:56:38.148 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-17T22:56:38.526 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-17T22:56:38.548 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-17T22:56:38.600 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-17T22:56:38.920 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-client-common (238) ... 2024-01-17T22:56:39.132 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-17T22:56:39.258 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-17T22:56:39.375 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:56:39.493 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-17T22:56:39.619 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-17T22:56:39.831 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:56:40.400 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-17T22:56:40.500 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-17T22:56:40.877 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-17T22:56:40.877 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-17T22:56:41.420 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-17T22:56:41.554 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-17T22:56:41.680 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-17T22:56:41.790 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-17T22:56:41.894 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-17T22:56:41.992 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-17T22:56:42.110 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-17T22:56:42.749 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-17T22:56:42.892 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up dump (0.4b47-3) ... 2024-01-17T22:56:42.968 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-17T22:56:43.035 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2024-01-17T22:56:43.161 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-17T22:56:43.287 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-17T22:56:43.422 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-17T22:56:43.548 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-17T22:56:43.629 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-17T22:56:43.683 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-17T22:56:43.784 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-17T22:56:43.944 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-17T22:56:44.070 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-17T22:56:44.196 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-17T22:56:44.372 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-client (14+238) ... 2024-01-17T22:56:44.498 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-17T22:56:44.974 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:56:44.974 INFO:teuthology.orchestra.run.smithi190.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-17T22:56:44.975 INFO:teuthology.orchestra.run.smithi190.stdout:which means they are currently configured by ifupdown: 2024-01-17T22:56:44.975 INFO:teuthology.orchestra.run.smithi190.stdout:- enp3s0f1 2024-01-17T22:56:44.975 INFO:teuthology.orchestra.run.smithi190.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-17T22:56:44.975 INFO:teuthology.orchestra.run.smithi190.stdout:remove their configuration from /etc/network/interfaces. 2024-01-17T22:56:44.975 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:56:45.102 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-17T22:56:45.457 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-17T22:56:45.810 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-17T22:56:46.367 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-17T22:56:46.511 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-17T22:56:46.637 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-17T22:56:46.772 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-common (238) ... 2024-01-17T22:56:48.137 INFO:teuthology.orchestra.run.smithi190.stdout:Adding user postgres to group ssl-cert 2024-01-17T22:56:48.328 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:56:48.328 INFO:teuthology.orchestra.run.smithi190.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-17T22:56:48.497 INFO:teuthology.orchestra.run.smithi190.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-17T22:56:48.497 INFO:teuthology.orchestra.run.smithi190.stdout:Removing obsolete dictionary files: 2024-01-17T22:56:49.123 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-17T22:56:49.549 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:56:49.865 INFO:teuthology.orchestra.run.smithi190.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-17T22:56:49.888 INFO:teuthology.orchestra.run.smithi190.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-17T22:56:49.931 INFO:teuthology.orchestra.run.smithi190.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-17T22:56:49.931 INFO:teuthology.orchestra.run.smithi190.stdout:This user must also own the server process. 2024-01-17T22:56:49.932 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:56:49.932 INFO:teuthology.orchestra.run.smithi190.stdout:The database cluster will be initialized with locale "en_US". 2024-01-17T22:56:49.932 INFO:teuthology.orchestra.run.smithi190.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-17T22:56:49.932 INFO:teuthology.orchestra.run.smithi190.stdout:The default text search configuration will be set to "english". 2024-01-17T22:56:49.932 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:56:49.932 INFO:teuthology.orchestra.run.smithi190.stdout:Data page checksums are disabled. 2024-01-17T22:56:49.932 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:56:49.932 INFO:teuthology.orchestra.run.smithi190.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-17T22:56:49.932 INFO:teuthology.orchestra.run.smithi190.stdout:creating subdirectories ... ok 2024-01-17T22:56:49.932 INFO:teuthology.orchestra.run.smithi190.stdout:selecting dynamic shared memory implementation ... posix 2024-01-17T22:56:49.946 INFO:teuthology.orchestra.run.smithi190.stdout:selecting default max_connections ... 100 2024-01-17T22:56:49.965 INFO:teuthology.orchestra.run.smithi190.stdout:selecting default shared_buffers ... 128MB 2024-01-17T22:56:49.975 INFO:teuthology.orchestra.run.smithi190.stdout:selecting default time zone ... Etc/UTC 2024-01-17T22:56:49.975 INFO:teuthology.orchestra.run.smithi190.stdout:creating configuration files ... ok 2024-01-17T22:56:50.089 INFO:teuthology.orchestra.run.smithi190.stdout:running bootstrap script ... ok 2024-01-17T22:56:50.724 INFO:teuthology.orchestra.run.smithi190.stdout:performing post-bootstrap initialization ... ok 2024-01-17T22:56:51.537 INFO:teuthology.orchestra.run.smithi190.stdout:syncing data to disk ... ok 2024-01-17T22:56:51.969 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-17T22:56:54.756 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-17T22:56:54.882 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-17T22:56:54.999 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql (14+238) ... 2024-01-17T22:56:55.150 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-17T22:56:55.276 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2024-01-17T22:56:55.529 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-17T22:56:55.529 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-17T22:56:56.112 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-17T22:56:56.423 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-17T22:56:56.575 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-17T22:56:57.945 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-17T22:56:58.044 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-17T22:56:58.525 INFO:teuthology.orchestra.run.smithi190.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-17T22:56:58.530 DEBUG:teuthology.parallel:result is None 2024-01-17T22:56:58.531 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 2024-01-17T22:56:58.760 DEBUG:teuthology.orchestra.run.smithi161:> dpkg-query -W -f '${Version}' ceph 2024-01-17T22:56:58.784 INFO:teuthology.orchestra.run.smithi161.stdout:19.0.0-653-g1ec1182e-1jammy 2024-01-17T22:56:58.784 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-653-g1ec1182e-1jammy 2024-01-17T22:56:58.785 INFO:teuthology.task.install:The correct ceph version 19.0.0-653-g1ec1182e-1jammy is installed. 2024-01-17T22:56:58.786 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 2024-01-17T22:56:59.013 DEBUG:teuthology.orchestra.run.smithi190:> dpkg-query -W -f '${Version}' ceph 2024-01-17T22:56:59.032 INFO:teuthology.orchestra.run.smithi190.stdout:19.0.0-653-g1ec1182e-1jammy 2024-01-17T22:56:59.032 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-653-g1ec1182e-1jammy 2024-01-17T22:56:59.032 INFO:teuthology.task.install:The correct ceph version 19.0.0-653-g1ec1182e-1jammy is installed. 2024-01-17T22:56:59.034 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-17T22:56:59.034 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:56:59.034 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-17T22:56:59.056 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:56:59.056 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-17T22:56:59.086 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-17T22:56:59.086 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:56:59.086 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2024-01-17T22:56:59.119 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-17T22:56:59.183 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:56:59.183 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/daemon-helper 2024-01-17T22:56:59.196 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-17T22:56:59.251 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-17T22:56:59.252 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:56:59.252 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-17T22:56:59.272 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-17T22:56:59.339 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:56:59.339 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-17T22:56:59.351 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-17T22:56:59.405 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-17T22:56:59.405 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:56:59.405 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/stdin-killer 2024-01-17T22:56:59.426 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-17T22:56:59.487 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:56:59.487 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/stdin-killer 2024-01-17T22:56:59.500 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-17T22:56:59.557 INFO:teuthology.run_tasks:Running task ceph... 2024-01-17T22:56:59.636 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-17T22:56:59.637 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /var/log/ceph 2024-01-17T22:56:59.640 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 777 /var/log/ceph 2024-01-17T22:56:59.657 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-17T22:56:59.657 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-17T22:56:59.706 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-17T22:56:59.723 INFO:tasks.ceph:Creating extra log directories... 2024-01-17T22:56:59.723 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-17T22:56:59.766 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-17T22:56:59.790 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-17T22:56:59.790 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-17T22:56:59.790 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-17T22:56:59.790 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:56:59.790 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-17T22:56:59.840 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-17T22:56:59.931 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:56:59.931 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-17T22:56:59.936 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-17T22:57:00.015 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-17T22:57:00.015 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-17T22:57:00.015 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519259', 'branch': 'main', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7519259', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 5791, 'sha1': '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4', 'sleep_before_teardown': 0, 'subset': '209/512', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi161.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCFeRXVyQi8037FG5pYx64D+ttT6fno9jm3W/UyT4g7VB+mjbzOEgJBGbBfvRrHdz3HH/KZN/uXXBARJyY5VNvc=', 'smithi190.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPACka/qChOqhnfuphJXksaCCVdZNZiliJFEnQ5I68xbpN2+6WRPFeWy09PR1xKOyaG+Zs7DXUR2GTgcZqY+vvg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'kclient': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'cd45576300487d997e5a85abed65500b9f5d143b', 'timestamp': '2024-01-17_20:20:37', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-17T22:57:00.016 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-17T22:57:00.019 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-17T22:57:00.062 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2024-01-17T22:57:00.070 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/run/ceph 2024-01-17T22:57:00.121 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:57:00.121 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2024-01-17T22:57:00.135 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-17T22:57:00.135 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2024-01-17T22:57:00.183 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-17T22:57:00.183 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T22:57:00.183 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-01-17T22:57:00.183 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T22:57:00.183 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-01-17 20:48:17.313565728 +0000 2024-01-17T22:57:00.183 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-01-17 20:48:17.053568052 +0000 2024-01-17T22:57:00.183 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-01-17 20:48:17.053568052 +0000 2024-01-17T22:57:00.183 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-01-17 20:48:17.053568052 +0000 2024-01-17T22:57:00.184 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-17T22:57:00.240 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-01-17T22:57:00.240 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-01-17T22:57:00.240 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000368846 s, 1.4 MB/s 2024-01-17T22:57:00.242 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-17T22:57:00.292 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2024-01-17T22:57:00.347 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-17T22:57:00.347 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T22:57:00.347 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-01-17T22:57:00.347 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T22:57:00.348 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-01-17 20:48:17.849560941 +0000 2024-01-17T22:57:00.348 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-01-17 20:48:17.581563336 +0000 2024-01-17T22:57:00.348 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-01-17 20:48:17.581563336 +0000 2024-01-17T22:57:00.348 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-01-17 20:48:17.581563336 +0000 2024-01-17T22:57:00.348 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-17T22:57:00.408 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-01-17T22:57:00.408 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-01-17T22:57:00.408 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000328731 s, 1.6 MB/s 2024-01-17T22:57:00.410 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-17T22:57:00.465 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2024-01-17T22:57:00.515 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-17T22:57:00.515 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T22:57:00.515 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-01-17T22:57:00.515 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T22:57:00.516 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-01-17 20:48:18.361556367 +0000 2024-01-17T22:57:00.516 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-01-17 20:48:18.109558619 +0000 2024-01-17T22:57:00.516 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-01-17 20:48:18.109558619 +0000 2024-01-17T22:57:00.516 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-01-17 20:48:18.109558619 +0000 2024-01-17T22:57:00.516 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-17T22:57:00.576 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-01-17T22:57:00.576 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-01-17T22:57:00.576 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000349904 s, 1.5 MB/s 2024-01-17T22:57:00.578 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-17T22:57:00.633 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2024-01-17T22:57:00.687 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-17T22:57:00.687 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T22:57:00.687 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-01-17T22:57:00.687 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T22:57:00.688 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-01-17 20:48:18.897551580 +0000 2024-01-17T22:57:00.688 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-01-17 20:48:18.625554009 +0000 2024-01-17T22:57:00.688 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-01-17 20:48:18.625554009 +0000 2024-01-17T22:57:00.688 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-01-17 20:48:18.625554009 +0000 2024-01-17T22:57:00.688 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-17T22:57:00.748 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-01-17T22:57:00.748 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-01-17T22:57:00.748 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000385424 s, 1.3 MB/s 2024-01-17T22:57:00.750 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-17T22:57:00.801 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-17T22:57:00.801 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:57:00.801 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/scratch_devs of=/dev/stdout 2024-01-17T22:57:00.807 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-17T22:57:00.807 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_1 2024-01-17T22:57:00.855 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-17T22:57:00.855 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T22:57:00.855 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-01-17T22:57:00.855 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T22:57:00.855 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-01-17 20:47:59.943160250 +0000 2024-01-17T22:57:00.855 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-01-17 20:47:59.687162538 +0000 2024-01-17T22:57:00.855 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-01-17 20:47:59.687162538 +0000 2024-01-17T22:57:00.855 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-01-17T22:57:00.856 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-17T22:57:00.910 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-01-17T22:57:00.910 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-01-17T22:57:00.910 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.00060187 s, 851 kB/s 2024-01-17T22:57:00.911 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-17T22:57:00.960 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_2 2024-01-17T22:57:01.007 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-17T22:57:01.007 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T22:57:01.007 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-01-17T22:57:01.007 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T22:57:01.007 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-01-17 20:48:00.439155820 +0000 2024-01-17T22:57:01.007 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-01-17 20:48:00.179158144 +0000 2024-01-17T22:57:01.008 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-01-17 20:48:00.179158144 +0000 2024-01-17T22:57:01.008 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-01-17T22:57:01.008 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-17T22:57:01.066 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-01-17T22:57:01.066 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-01-17T22:57:01.066 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000503468 s, 1.0 MB/s 2024-01-17T22:57:01.067 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-17T22:57:01.116 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_3 2024-01-17T22:57:01.163 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-17T22:57:01.163 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T22:57:01.163 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-01-17T22:57:01.163 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T22:57:01.163 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-01-17 20:48:00.923151498 +0000 2024-01-17T22:57:01.163 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-01-17 20:48:00.675153713 +0000 2024-01-17T22:57:01.163 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-01-17 20:48:00.675153713 +0000 2024-01-17T22:57:01.163 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-01-17T22:57:01.164 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-17T22:57:01.217 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-01-17T22:57:01.217 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-01-17T22:57:01.218 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000464506 s, 1.1 MB/s 2024-01-17T22:57:01.219 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-17T22:57:01.268 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_4 2024-01-17T22:57:01.319 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-17T22:57:01.319 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T22:57:01.319 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 941 Links: 1 2024-01-17T22:57:01.319 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T22:57:01.319 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-01-17 20:48:01.455146746 +0000 2024-01-17T22:57:01.319 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-01-17 20:48:01.167149318 +0000 2024-01-17T22:57:01.319 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-01-17 20:48:01.167149318 +0000 2024-01-17T22:57:01.319 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-01-17T22:57:01.319 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-17T22:57:01.373 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-01-17T22:57:01.373 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-01-17T22:57:01.373 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000565528 s, 905 kB/s 2024-01-17T22:57:01.374 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-17T22:57:01.428 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-17T22:57:01.428 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-17T22:57:01.428 INFO:tasks.ceph:Generating config... 2024-01-17T22:57:01.429 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-17T22:57:01.430 INFO:tasks.ceph:[client] debug client = 20 2024-01-17T22:57:01.430 INFO:tasks.ceph:[client] debug ms = 1 2024-01-17T22:57:01.430 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-17T22:57:01.430 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-17T22:57:01.430 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-01-17T22:57:01.430 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-01-17T22:57:01.430 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-01-17T22:57:01.430 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-01-17T22:57:01.430 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-17T22:57:01.430 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-17T22:57:01.430 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-17T22:57:01.430 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-17T22:57:01.430 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-17T22:57:01.430 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-17T22:57:01.430 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-01-17T22:57:01.430 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-17T22:57:01.430 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-17T22:57:01.431 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-17T22:57:01.431 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-17T22:57:01.431 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-17T22:57:01.431 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-17T22:57:01.431 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-17T22:57:01.431 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-17T22:57:01.431 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-17T22:57:01.431 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-17T22:57:01.431 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-01-17T22:57:01.431 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-17T22:57:01.431 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-01-17T22:57:01.431 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-17T22:57:01.431 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-01-17T22:57:01.432 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-01-17T22:57:01.432 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-17T22:57:01.432 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-17T22:57:01.432 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-01-17T22:57:01.432 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-17T22:57:01.432 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-17T22:57:01.432 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-17T22:57:01.432 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-17T22:57:01.432 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-01-17T22:57:01.432 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-17T22:57:01.432 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-17T22:57:01.432 INFO:tasks.ceph:Setting up mon.a... 2024-01-17T22:57:01.432 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-17T22:57:01.477 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.keyring 2024-01-17T22:57:01.498 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-17T22:57:01.591 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-17T22:57:01.611 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.161'), ('mon.b', '172.21.15.190'), ('mon.c', '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]')] 2024-01-17T22:57:01.611 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.161,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-17T22:57:01.612 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:57:01.612 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-17T22:57:01.659 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.161 --add b 172.21.15.190 --addv c '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:57:01.745 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:57:01.745 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: generated fsid 58c3361f-c527-4d53-a987-e30062ef8beb 2024-01-17T22:57:01.745 INFO:teuthology.orchestra.run.smithi161.stdout:setting min_mon_release = quincy 2024-01-17T22:57:01.745 INFO:teuthology.orchestra.run.smithi161.stdout:epoch 0 2024-01-17T22:57:01.745 INFO:teuthology.orchestra.run.smithi161.stdout:fsid 58c3361f-c527-4d53-a987-e30062ef8beb 2024-01-17T22:57:01.745 INFO:teuthology.orchestra.run.smithi161.stdout:last_changed 2024-01-17T22:57:01.750351+0000 2024-01-17T22:57:01.745 INFO:teuthology.orchestra.run.smithi161.stdout:created 2024-01-17T22:57:01.750351+0000 2024-01-17T22:57:01.745 INFO:teuthology.orchestra.run.smithi161.stdout:min_mon_release 17 (quincy) 2024-01-17T22:57:01.746 INFO:teuthology.orchestra.run.smithi161.stdout:election_strategy: 1 2024-01-17T22:57:01.746 INFO:teuthology.orchestra.run.smithi161.stdout:0: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.a 2024-01-17T22:57:01.746 INFO:teuthology.orchestra.run.smithi161.stdout:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-01-17T22:57:01.746 INFO:teuthology.orchestra.run.smithi161.stdout:2: [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] mon.c 2024-01-17T22:57:01.746 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-17T22:57:01.748 DEBUG:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-17T22:57:01.799 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 58c3361f-c527-4d53-a987-e30062ef8beb... 2024-01-17T22:57:01.800 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-17T22:57:01.850 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-17T22:57:01.880 INFO:teuthology.orchestra.run.smithi190.stdout:[global] 2024-01-17T22:57:01.881 INFO:teuthology.orchestra.run.smithi190.stdout: chdir = "" 2024-01-17T22:57:01.881 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-17T22:57:01.881 INFO:teuthology.orchestra.run.smithi190.stdout: auth supported = cephx 2024-01-17T22:57:01.881 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.881 INFO:teuthology.orchestra.run.smithi190.stdout: filestore xattr use omap = true 2024-01-17T22:57:01.881 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.881 INFO:teuthology.orchestra.run.smithi190.stdout: mon clock drift allowed = 1.000 2024-01-17T22:57:01.881 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.881 INFO:teuthology.orchestra.run.smithi190.stdout: osd crush chooseleaf type = 0 2024-01-17T22:57:01.881 INFO:teuthology.orchestra.run.smithi190.stdout: auth debug = true 2024-01-17T22:57:01.881 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.881 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on old message = true 2024-01-17T22:57:01.881 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on bug = true 2024-01-17T22:57:01.881 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.882 INFO:teuthology.orchestra.run.smithi190.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-17T22:57:01.882 INFO:teuthology.orchestra.run.smithi190.stdout: mon pg warn max object skew = 0 2024-01-17T22:57:01.882 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.882 INFO:teuthology.orchestra.run.smithi190.stdout: # disable pg_autoscaler by default for new pools 2024-01-17T22:57:01.882 INFO:teuthology.orchestra.run.smithi190.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-17T22:57:01.882 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.882 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default size = 2 2024-01-17T22:57:01.882 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.882 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow primary affinity = true 2024-01-17T22:57:01.882 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow pg remap = true 2024-01-17T22:57:01.882 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on legacy crush tunables = false 2024-01-17T22:57:01.882 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on crush straw calc version zero = false 2024-01-17T22:57:01.883 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on no sortbitwise = false 2024-01-17T22:57:01.883 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on osd down out interval zero = false 2024-01-17T22:57:01.883 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on too few osds = false 2024-01-17T22:57:01.883 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-17T22:57:01.883 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-17T22:57:01.883 INFO:teuthology.orchestra.run.smithi190.stdout: mon_allow_pool_size_one = true 2024-01-17T22:57:01.883 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.883 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-17T22:57:01.883 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.883 INFO:teuthology.orchestra.run.smithi190.stdout: osd default data pool replay window = 5 2024-01-17T22:57:01.883 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.883 INFO:teuthology.orchestra.run.smithi190.stdout: mon allow pool delete = true 2024-01-17T22:57:01.883 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.883 INFO:teuthology.orchestra.run.smithi190.stdout: mon cluster log file level = debug 2024-01-17T22:57:01.884 INFO:teuthology.orchestra.run.smithi190.stdout: debug asserts on shutdown = true 2024-01-17T22:57:01.884 INFO:teuthology.orchestra.run.smithi190.stdout: mon health detail to clog = false 2024-01-17T22:57:01.884 INFO:teuthology.orchestra.run.smithi190.stdout: mon host = "172.21.15.161,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2024-01-17T22:57:01.884 INFO:teuthology.orchestra.run.smithi190.stdout: mds beacon grace = 60 2024-01-17T22:57:01.884 INFO:teuthology.orchestra.run.smithi190.stdout: mds heartbeat grace = 60 2024-01-17T22:57:01.884 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on skipped message = False 2024-01-17T22:57:01.884 INFO:teuthology.orchestra.run.smithi190.stdout: osd heartbeat grace = 60 2024-01-17T22:57:01.884 INFO:teuthology.orchestra.run.smithi190.stdout: fsid = 58c3361f-c527-4d53-a987-e30062ef8beb 2024-01-17T22:57:01.884 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.884 INFO:teuthology.orchestra.run.smithi190.stdout:[osd] 2024-01-17T22:57:01.884 INFO:teuthology.orchestra.run.smithi190.stdout: osd journal size = 100 2024-01-17T22:57:01.884 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.884 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub load threshold = 5.0 2024-01-17T22:57:01.884 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub max interval = 600 2024-01-17T22:57:01.884 INFO:teuthology.orchestra.run.smithi190.stdout: osd mclock profile = high_recovery_ops 2024-01-17T22:57:01.885 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.885 INFO:teuthology.orchestra.run.smithi190.stdout: osd recover clone overlap = true 2024-01-17T22:57:01.885 INFO:teuthology.orchestra.run.smithi190.stdout: osd recovery max chunk = 1048576 2024-01-17T22:57:01.885 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.885 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug shutdown = true 2024-01-17T22:57:01.885 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug op order = true 2024-01-17T22:57:01.885 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug verify stray on activate = true 2024-01-17T22:57:01.885 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug trim objects = true 2024-01-17T22:57:01.885 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.885 INFO:teuthology.orchestra.run.smithi190.stdout: osd open classes on start = true 2024-01-17T22:57:01.885 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug pg log writeout = true 2024-01-17T22:57:01.885 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.885 INFO:teuthology.orchestra.run.smithi190.stdout: osd deep scrub update digest min age = 30 2024-01-17T22:57:01.885 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.886 INFO:teuthology.orchestra.run.smithi190.stdout: osd map max advance = 10 2024-01-17T22:57:01.886 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.886 INFO:teuthology.orchestra.run.smithi190.stdout: journal zero on create = true 2024-01-17T22:57:01.886 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.886 INFO:teuthology.orchestra.run.smithi190.stdout: filestore ondisk finisher threads = 3 2024-01-17T22:57:01.886 INFO:teuthology.orchestra.run.smithi190.stdout: filestore apply finisher threads = 3 2024-01-17T22:57:01.886 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.886 INFO:teuthology.orchestra.run.smithi190.stdout: bdev debug aio = true 2024-01-17T22:57:01.886 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug misdirected ops = true 2024-01-17T22:57:01.886 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore block size = 96636764160 2024-01-17T22:57:01.886 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore compression mode = aggressive 2024-01-17T22:57:01.886 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore fsck on mount = True 2024-01-17T22:57:01.886 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluefs = 20 2024-01-17T22:57:01.886 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluestore = 20 2024-01-17T22:57:01.886 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-01-17T22:57:01.886 INFO:teuthology.orchestra.run.smithi190.stdout: debug osd = 20 2024-01-17T22:57:01.887 INFO:teuthology.orchestra.run.smithi190.stdout: debug rocksdb = 10 2024-01-17T22:57:01.887 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd backfillfull_ratio = 0.85 2024-01-17T22:57:01.887 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd full ratio = 0.9 2024-01-17T22:57:01.887 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd nearfull ratio = 0.8 2024-01-17T22:57:01.887 INFO:teuthology.orchestra.run.smithi190.stdout: osd failsafe full ratio = 0.95 2024-01-17T22:57:01.887 INFO:teuthology.orchestra.run.smithi190.stdout: osd fast shutdown = False 2024-01-17T22:57:01.887 INFO:teuthology.orchestra.run.smithi190.stdout: osd objectstore = bluestore 2024-01-17T22:57:01.887 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2024-01-17T22:57:01.887 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.887 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr] 2024-01-17T22:57:01.887 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-01-17T22:57:01.887 INFO:teuthology.orchestra.run.smithi190.stdout: debug mgr = 20 2024-01-17T22:57:01.887 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-01-17T22:57:01.887 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-01-17T22:57:01.887 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-01-17T22:57:01.887 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-01-17T22:57:01.888 INFO:teuthology.orchestra.run.smithi190.stdout: mgr/telemetry/nag = false 2024-01-17T22:57:01.888 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.888 INFO:teuthology.orchestra.run.smithi190.stdout:[mon] 2024-01-17T22:57:01.888 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-01-17T22:57:01.888 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-01-17T22:57:01.888 INFO:teuthology.orchestra.run.smithi190.stdout: debug paxos = 20 2024-01-17T22:57:01.888 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-01-17T22:57:01.888 INFO:teuthology.orchestra.run.smithi190.stdout: mon data avail warn = 5 2024-01-17T22:57:01.888 INFO:teuthology.orchestra.run.smithi190.stdout: mon mgr mkfs grace = 240 2024-01-17T22:57:01.888 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-01-17T22:57:01.888 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd reporter subtree level = osd 2024-01-17T22:57:01.888 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd prime pg temp = true 2024-01-17T22:57:01.888 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-01-17T22:57:01.889 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.889 INFO:teuthology.orchestra.run.smithi190.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-17T22:57:01.889 INFO:teuthology.orchestra.run.smithi190.stdout: auth mon ticket ttl = 660 # 11m 2024-01-17T22:57:01.889 INFO:teuthology.orchestra.run.smithi190.stdout: auth service ticket ttl = 240 # 4m 2024-01-17T22:57:01.889 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.889 INFO:teuthology.orchestra.run.smithi190.stdout: # don't complain about insecure global_id in the test suite 2024-01-17T22:57:01.889 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-17T22:57:01.889 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-17T22:57:01.889 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.889 INFO:teuthology.orchestra.run.smithi190.stdout: # 1m isn't quite enough 2024-01-17T22:57:01.889 INFO:teuthology.orchestra.run.smithi190.stdout: mon_down_mkfs_grace = 2m 2024-01-17T22:57:01.889 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.889 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_filestore_osds = false 2024-01-17T22:57:01.889 INFO:teuthology.orchestra.run.smithi190.stdout: mon op complaint time = 120 2024-01-17T22:57:01.889 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd crush smoke test = False 2024-01-17T22:57:01.890 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-17T22:57:01.890 INFO:teuthology.orchestra.run.smithi190.stdout:[client] 2024-01-17T22:57:01.890 INFO:teuthology.orchestra.run.smithi190.stdout: rgw cache enabled = true 2024-01-17T22:57:01.890 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable ops log = true 2024-01-17T22:57:01.890 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable usage log = true 2024-01-17T22:57:01.890 INFO:teuthology.orchestra.run.smithi190.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-17T22:57:01.890 INFO:teuthology.orchestra.run.smithi190.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-17T22:57:01.890 INFO:teuthology.orchestra.run.smithi190.stdout: client mount timeout = 600 2024-01-17T22:57:01.890 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2024-01-17T22:57:01.890 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-01-17T22:57:01.890 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2024-01-17T22:57:01.890 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2024-01-17T22:57:01.890 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.a] 2024-01-17T22:57:01.890 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.b] 2024-01-17T22:57:01.890 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.c] 2024-01-17T22:57:01.891 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2024-01-17T22:57:01.891 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2024-01-17T22:57:01.891 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.e] 2024-01-17T22:57:01.891 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2024-01-17T22:57:01.891 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2024-01-17T22:57:01.891 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.f] 2024-01-17T22:57:01.891 INFO:teuthology.orchestra.run.smithi190.stdout:[mds] 2024-01-17T22:57:01.891 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds = 20 2024-01-17T22:57:01.891 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds balancer = 20 2024-01-17T22:57:01.891 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-01-17T22:57:01.891 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug frag = True 2024-01-17T22:57:01.891 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug scatterstat = True 2024-01-17T22:57:01.891 INFO:teuthology.orchestra.run.smithi190.stdout: mds op complaint time = 180 2024-01-17T22:57:01.891 INFO:teuthology.orchestra.run.smithi190.stdout: mds valgrind exit = True 2024-01-17T22:57:01.891 INFO:teuthology.orchestra.run.smithi190.stdout: mds verify scatter = True 2024-01-17T22:57:01.891 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2024-01-17T22:57:01.891 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2024-01-17T22:57:01.892 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2024-01-17T22:57:01.892 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2024-01-17T22:57:01.892 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2024-01-17T22:57:01.892 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-17T22:57:01.892 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2024-01-17T22:57:01.892 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.892 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2024-01-17T22:57:01.893 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.893 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2024-01-17T22:57:01.893 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.893 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2024-01-17T22:57:01.893 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2024-01-17T22:57:01.893 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.893 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2024-01-17T22:57:01.893 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2024-01-17T22:57:01.893 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.893 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-17T22:57:01.893 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2024-01-17T22:57:01.893 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.893 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2024-01-17T22:57:01.893 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-17T22:57:01.894 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.894 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2024-01-17T22:57:01.894 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.894 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2024-01-17T22:57:01.894 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2024-01-17T22:57:01.894 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2024-01-17T22:57:01.894 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2024-01-17T22:57:01.894 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2024-01-17T22:57:01.894 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2024-01-17T22:57:01.894 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2024-01-17T22:57:01.894 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-17T22:57:01.894 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-17T22:57:01.894 INFO:teuthology.orchestra.run.smithi161.stdout: mon_allow_pool_size_one = true 2024-01-17T22:57:01.895 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.895 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-17T22:57:01.895 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.895 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2024-01-17T22:57:01.895 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.895 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2024-01-17T22:57:01.895 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.895 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2024-01-17T22:57:01.895 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2024-01-17T22:57:01.895 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2024-01-17T22:57:01.895 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = "172.21.15.161,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2024-01-17T22:57:01.895 INFO:teuthology.orchestra.run.smithi161.stdout: mds beacon grace = 60 2024-01-17T22:57:01.895 INFO:teuthology.orchestra.run.smithi161.stdout: mds heartbeat grace = 60 2024-01-17T22:57:01.895 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on skipped message = False 2024-01-17T22:57:01.896 INFO:teuthology.orchestra.run.smithi161.stdout: osd heartbeat grace = 60 2024-01-17T22:57:01.896 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = 58c3361f-c527-4d53-a987-e30062ef8beb 2024-01-17T22:57:01.896 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.896 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2024-01-17T22:57:01.896 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2024-01-17T22:57:01.896 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.896 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2024-01-17T22:57:01.896 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2024-01-17T22:57:01.896 INFO:teuthology.orchestra.run.smithi161.stdout: osd mclock profile = high_recovery_ops 2024-01-17T22:57:01.896 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.896 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2024-01-17T22:57:01.896 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2024-01-17T22:57:01.896 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.896 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2024-01-17T22:57:01.896 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2024-01-17T22:57:01.897 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2024-01-17T22:57:01.897 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug trim objects = true 2024-01-17T22:57:01.897 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.897 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2024-01-17T22:57:01.897 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2024-01-17T22:57:01.897 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.897 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2024-01-17T22:57:01.897 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.897 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2024-01-17T22:57:01.897 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.897 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2024-01-17T22:57:01.897 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.897 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2024-01-17T22:57:01.897 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2024-01-17T22:57:01.897 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.897 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2024-01-17T22:57:01.897 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2024-01-17T22:57:01.898 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2024-01-17T22:57:01.898 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore compression mode = aggressive 2024-01-17T22:57:01.898 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2024-01-17T22:57:01.898 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 20 2024-01-17T22:57:01.898 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 20 2024-01-17T22:57:01.898 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-01-17T22:57:01.898 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2024-01-17T22:57:01.898 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 10 2024-01-17T22:57:01.898 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2024-01-17T22:57:01.898 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2024-01-17T22:57:01.898 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2024-01-17T22:57:01.898 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2024-01-17T22:57:01.898 INFO:teuthology.orchestra.run.smithi161.stdout: osd fast shutdown = False 2024-01-17T22:57:01.898 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2024-01-17T22:57:01.898 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2024-01-17T22:57:01.898 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.898 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2024-01-17T22:57:01.899 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-01-17T22:57:01.899 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2024-01-17T22:57:01.899 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2024-01-17T22:57:01.899 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2024-01-17T22:57:01.899 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2024-01-17T22:57:01.899 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2024-01-17T22:57:01.899 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2024-01-17T22:57:01.899 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.899 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2024-01-17T22:57:01.899 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-01-17T22:57:01.899 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2024-01-17T22:57:01.899 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2024-01-17T22:57:01.899 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2024-01-17T22:57:01.899 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2024-01-17T22:57:01.899 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2024-01-17T22:57:01.899 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2024-01-17T22:57:01.899 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2024-01-17T22:57:01.900 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2024-01-17T22:57:01.900 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2024-01-17T22:57:01.900 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.900 INFO:teuthology.orchestra.run.smithi161.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-17T22:57:01.900 INFO:teuthology.orchestra.run.smithi161.stdout: auth mon ticket ttl = 660 # 11m 2024-01-17T22:57:01.900 INFO:teuthology.orchestra.run.smithi161.stdout: auth service ticket ttl = 240 # 4m 2024-01-17T22:57:01.900 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.900 INFO:teuthology.orchestra.run.smithi161.stdout: # don't complain about insecure global_id in the test suite 2024-01-17T22:57:01.900 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-17T22:57:01.900 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-17T22:57:01.900 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.900 INFO:teuthology.orchestra.run.smithi161.stdout: # 1m isn't quite enough 2024-01-17T22:57:01.900 INFO:teuthology.orchestra.run.smithi161.stdout: mon_down_mkfs_grace = 2m 2024-01-17T22:57:01.900 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.900 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_filestore_osds = false 2024-01-17T22:57:01.901 INFO:teuthology.orchestra.run.smithi161.stdout: mon op complaint time = 120 2024-01-17T22:57:01.901 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd crush smoke test = False 2024-01-17T22:57:01.901 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:57:01.901 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2024-01-17T22:57:01.901 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2024-01-17T22:57:01.901 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2024-01-17T22:57:01.901 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2024-01-17T22:57:01.901 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-17T22:57:01.901 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-17T22:57:01.901 INFO:teuthology.orchestra.run.smithi161.stdout: client mount timeout = 600 2024-01-17T22:57:01.901 INFO:teuthology.orchestra.run.smithi161.stdout: debug client = 20 2024-01-17T22:57:01.901 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-01-17T22:57:01.901 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2024-01-17T22:57:01.901 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2024-01-17T22:57:01.901 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2024-01-17T22:57:01.902 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.b] 2024-01-17T22:57:01.902 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.c] 2024-01-17T22:57:01.902 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2024-01-17T22:57:01.902 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2024-01-17T22:57:01.902 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.e] 2024-01-17T22:57:01.902 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2024-01-17T22:57:01.902 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.d] 2024-01-17T22:57:01.902 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.f] 2024-01-17T22:57:01.902 INFO:teuthology.orchestra.run.smithi161.stdout:[mds] 2024-01-17T22:57:01.902 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds = 20 2024-01-17T22:57:01.902 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds balancer = 20 2024-01-17T22:57:01.902 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-01-17T22:57:01.902 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug frag = True 2024-01-17T22:57:01.902 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug scatterstat = True 2024-01-17T22:57:01.902 INFO:teuthology.orchestra.run.smithi161.stdout: mds op complaint time = 180 2024-01-17T22:57:01.902 INFO:teuthology.orchestra.run.smithi161.stdout: mds valgrind exit = True 2024-01-17T22:57:01.902 INFO:teuthology.orchestra.run.smithi161.stdout: mds verify scatter = True 2024-01-17T22:57:01.903 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2024-01-17T22:57:01.903 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2024-01-17T22:57:01.903 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2024-01-17T22:57:01.904 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-17T22:57:01.905 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-17T22:57:02.008 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-17T22:57:02.008 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:57:02.008 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-17T22:57:02.017 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:57:02.017 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-17T22:57:02.067 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2024-01-17T22:57:02.067 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:57:02.067 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-17T22:57:02.067 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-17T22:57:02.138 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:57:02.138 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:57:02.188 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi190.front.sepia.ceph.com 2024-01-17T22:57:02.188 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:57:02.188 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-17T22:57:02.188 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-17T22:57:02.211 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:57:02.211 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:57:02.259 INFO:tasks.ceph:Setting up mon nodes... 2024-01-17T22:57:02.259 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-17T22:57:02.259 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-17T22:57:02.312 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-17T22:57:02.318 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-17T22:57:02.359 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-17T22:57:02.372 INFO:tasks.ceph:Setting up mds nodes... 2024-01-17T22:57:02.372 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-17T22:57:02.425 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-17T22:57:02.430 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-17T22:57:02.449 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-17T22:57:02.544 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-17T22:57:02.548 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-17T22:57:02.567 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-01-17T22:57:02.668 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-01-17T22:57:02.673 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-01-17T22:57:02.692 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-17T22:57:02.736 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-17T22:57:02.739 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-17T22:57:02.794 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-01-17T22:57:02.877 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-01-17T22:57:02.879 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-01-17T22:57:02.933 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-01-17T22:57:03.014 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-01-17T22:57:03.016 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-01-17T22:57:03.074 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-17T22:57:03.074 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-17T22:57:03.117 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-17T22:57:03.133 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-17T22:57:03.133 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-17T22:57:03.133 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-17T22:57:03.194 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-17T22:57:03.194 INFO:tasks.ceph:role: osd.0 2024-01-17T22:57:03.194 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com 2024-01-17T22:57:03.194 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-17T22:57:03.261 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T22:57:03.261 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T22:57:03.261 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T22:57:03.261 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-17T22:57:03.261 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T22:57:03.261 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-01-17T22:57:03.261 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T22:57:03.261 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-17T22:57:03.261 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T22:57:03.262 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T22:57:03.721 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-01-17T22:57:03.724 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-01-17T22:57:03.724 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-17T22:57:03.830 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-17T22:57:03.846 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2024-01-17T22:57:03.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T22:57:03.847 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-17T22:57:03.905 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-17T22:57:03.906 INFO:tasks.ceph:role: osd.1 2024-01-17T22:57:03.906 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com 2024-01-17T22:57:03.906 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-17T22:57:03.974 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T22:57:03.974 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T22:57:03.974 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T22:57:03.974 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-17T22:57:03.974 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T22:57:03.974 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-01-17T22:57:03.974 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T22:57:03.974 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-17T22:57:03.974 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T22:57:03.974 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T22:57:04.446 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-01-17T22:57:04.448 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-01-17T22:57:04.449 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-17T22:57:04.609 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-17T22:57:04.625 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2024-01-17T22:57:04.626 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T22:57:04.626 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-17T22:57:04.691 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-17T22:57:04.691 INFO:tasks.ceph:role: osd.2 2024-01-17T22:57:04.691 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com 2024-01-17T22:57:04.691 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-17T22:57:04.758 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T22:57:04.758 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T22:57:04.758 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T22:57:04.758 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-17T22:57:04.758 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T22:57:04.758 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-01-17T22:57:04.758 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T22:57:04.758 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-17T22:57:04.758 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T22:57:04.758 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T22:57:05.240 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-01-17T22:57:05.243 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-01-17T22:57:05.244 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-17T22:57:05.407 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-17T22:57:05.424 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2024-01-17T22:57:05.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T22:57:05.426 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-17T22:57:05.491 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-17T22:57:05.491 INFO:tasks.ceph:role: osd.3 2024-01-17T22:57:05.492 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com 2024-01-17T22:57:05.492 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-17T22:57:05.567 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T22:57:05.567 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T22:57:05.567 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T22:57:05.567 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-17T22:57:05.567 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T22:57:05.567 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-01-17T22:57:05.567 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T22:57:05.567 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-17T22:57:05.568 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T22:57:05.568 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T22:57:06.014 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-01-17T22:57:06.017 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-01-17T22:57:06.017 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-17T22:57:06.127 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-17T22:57:06.144 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2024-01-17T22:57:06.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T22:57:06.145 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:57:06.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:06.279+0000 7f098efb6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-17T22:57:06.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:06.283+0000 7f098efb6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-17T22:57:06.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:06.283+0000 7f098efb6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-17T22:57:06.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:06.283+0000 7f098efb6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-17T22:57:06.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:06.283+0000 7f098efb6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-17T22:57:06.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:06.291+0000 7f098efb6640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-17T22:57:09.266 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-17T22:57:09.286 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:57:09.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:09.379+0000 7fa5dba8c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-17T22:57:09.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:09.379+0000 7fa5dba8c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-17T22:57:09.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:09.379+0000 7fa5dba8c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-17T22:57:09.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:09.379+0000 7fa5dba8c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-17T22:57:09.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:09.379+0000 7fa5dba8c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-17T22:57:09.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:09.383+0000 7fa5dba8c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-17T22:57:12.357 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-17T22:57:12.377 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:57:12.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:12.475+0000 7f759db09640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-17T22:57:12.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:12.475+0000 7f759db09640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-17T22:57:12.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:12.475+0000 7f759db09640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-17T22:57:12.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:12.475+0000 7f759db09640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-17T22:57:12.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:12.475+0000 7f759db09640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-17T22:57:12.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:12.479+0000 7f759db09640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-17T22:57:15.457 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-17T22:57:15.477 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:57:15.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:15.575+0000 7f67190ba640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-17T22:57:15.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:15.579+0000 7f67190ba640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-17T22:57:15.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:15.579+0000 7f67190ba640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-17T22:57:15.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:15.579+0000 7f67190ba640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-17T22:57:15.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:15.579+0000 7f67190ba640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-17T22:57:15.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:15.579+0000 7f67190ba640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-17T22:57:18.541 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-17T22:57:18.560 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-17T22:57:18.575 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-17T22:57:18.575 INFO:tasks.ceph:role: osd.4 2024-01-17T22:57:18.575 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com 2024-01-17T22:57:18.575 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-17T22:57:18.638 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T22:57:18.638 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T22:57:18.638 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T22:57:18.638 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-17T22:57:18.638 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T22:57:18.638 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-01-17T22:57:18.638 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T22:57:18.638 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-17T22:57:18.638 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T22:57:18.639 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T22:57:19.085 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-01-17T22:57:19.087 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-01-17T22:57:19.087 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-17T22:57:19.185 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-17T22:57:19.194 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2024-01-17T22:57:19.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T22:57:19.195 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-17T22:57:19.248 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-17T22:57:19.248 INFO:tasks.ceph:role: osd.5 2024-01-17T22:57:19.248 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com 2024-01-17T22:57:19.248 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-17T22:57:19.314 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T22:57:19.314 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T22:57:19.314 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T22:57:19.315 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-17T22:57:19.315 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T22:57:19.315 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-01-17T22:57:19.315 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T22:57:19.315 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-17T22:57:19.315 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T22:57:19.315 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T22:57:19.783 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-01-17T22:57:19.785 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-01-17T22:57:19.785 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-17T22:57:19.943 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-17T22:57:19.954 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2024-01-17T22:57:19.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T22:57:19.955 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-17T22:57:20.010 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-17T22:57:20.010 INFO:tasks.ceph:role: osd.6 2024-01-17T22:57:20.010 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com 2024-01-17T22:57:20.010 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-17T22:57:20.073 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T22:57:20.073 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T22:57:20.073 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T22:57:20.073 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-17T22:57:20.073 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T22:57:20.073 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-01-17T22:57:20.073 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T22:57:20.073 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-17T22:57:20.073 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T22:57:20.073 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T22:57:20.559 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-01-17T22:57:20.561 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-01-17T22:57:20.561 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-17T22:57:20.706 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-17T22:57:20.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T22:57:20.719 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2024-01-17T22:57:20.719 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-17T22:57:20.774 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-17T22:57:20.774 INFO:tasks.ceph:role: osd.7 2024-01-17T22:57:20.774 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com 2024-01-17T22:57:20.775 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-17T22:57:20.839 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T22:57:20.839 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T22:57:20.839 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T22:57:20.839 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-17T22:57:20.839 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T22:57:20.839 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-01-17T22:57:20.839 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T22:57:20.839 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-17T22:57:20.839 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T22:57:20.839 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T22:57:21.266 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-01-17T22:57:21.268 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-01-17T22:57:21.268 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-17T22:57:21.365 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-17T22:57:21.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T22:57:21.376 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2024-01-17T22:57:21.376 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:57:21.485 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:21.480+0000 7f3a57149640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-17T22:57:21.488 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:21.484+0000 7f3a57149640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-17T22:57:21.488 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:21.484+0000 7f3a57149640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-17T22:57:21.489 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:21.484+0000 7f3a57149640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-17T22:57:21.489 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:21.484+0000 7f3a57149640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-17T22:57:21.489 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:21.484+0000 7f3a57149640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-17T22:57:24.450 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-17T22:57:24.464 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:57:24.544 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:24.540+0000 7fab7aba9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-17T22:57:24.545 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:24.540+0000 7fab7aba9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-17T22:57:24.545 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:24.540+0000 7fab7aba9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-17T22:57:24.545 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:24.540+0000 7fab7aba9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-17T22:57:24.545 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:24.540+0000 7fab7aba9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-17T22:57:24.546 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:24.540+0000 7fab7aba9640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-17T22:57:27.527 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-17T22:57:27.583 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:57:27.665 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:27.660+0000 7f7ff4a4c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-17T22:57:27.666 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:27.660+0000 7f7ff4a4c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-17T22:57:27.666 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:27.660+0000 7f7ff4a4c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-17T22:57:27.666 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:27.660+0000 7f7ff4a4c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-17T22:57:27.666 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:27.660+0000 7f7ff4a4c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-17T22:57:27.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:27.664+0000 7f7ff4a4c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-17T22:57:30.017 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T22:57:30.020 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T22:57:30.650 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-17T22:57:30.663 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:57:30.741 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:30.736+0000 7f39978de640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-17T22:57:30.742 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:30.736+0000 7f39978de640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-17T22:57:30.742 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:30.736+0000 7f39978de640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-17T22:57:30.743 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:30.736+0000 7f39978de640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-17T22:57:30.743 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:30.736+0000 7f39978de640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-17T22:57:30.743 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:57:30.740+0000 7f39978de640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-17T22:57:33.705 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-17T22:57:33.758 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-17T22:57:33.759 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:57:33.759 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-17T22:57:33.780 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:57:33.780 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-17T22:57:33.844 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:57:33.844 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-17T22:57:33.907 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:57:33.907 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-01-17T22:57:33.967 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:57:33.967 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-17T22:57:34.027 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:57:34.027 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-17T22:57:34.087 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:57:34.087 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-17T22:57:34.147 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:57:34.147 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-17T22:57:34.207 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:57:34.207 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-17T22:57:34.220 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:57:34.220 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-17T22:57:34.274 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:57:34.274 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-01-17T22:57:34.330 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:57:34.330 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-01-17T22:57:34.385 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:57:34.385 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-17T22:57:34.438 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:57:34.438 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-17T22:57:34.493 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:57:34.493 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-17T22:57:34.546 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:57:34.546 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-17T22:57:34.602 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:57:34.602 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-17T22:57:34.611 INFO:tasks.ceph:Adding keys to all mons... 2024-01-17T22:57:34.611 DEBUG:teuthology.orchestra.run.smithi161:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-17T22:57:34.654 DEBUG:teuthology.orchestra.run.smithi190:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-17T22:57:34.666 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.y] 2024-01-17T22:57:34.666 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA+W6hlnijzEhAAdVQixTRL25+iYSBz0rcfzA== 2024-01-17T22:57:34.666 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2024-01-17T22:57:34.666 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA+W6hliPSuGRAAr6z4o69bLn7PsU6/1HBPtw== 2024-01-17T22:57:34.666 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2024-01-17T22:57:34.666 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA+W6hlGsTAIBAAxlkbyZ2PAUJIYpkoyBAMfQ== 2024-01-17T22:57:34.666 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.e] 2024-01-17T22:57:34.666 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA+W6hlPTwqKBAACIemgwykT4+q8VwsuemIxg== 2024-01-17T22:57:34.666 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.0] 2024-01-17T22:57:34.666 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBCW6hljTX+EBAAZJEII3UdL9vErOQUy4VtPg== 2024-01-17T22:57:34.666 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.1] 2024-01-17T22:57:34.666 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBFW6hlINvbFhAABsejEx7JbXnb/3EGD5VuMg== 2024-01-17T22:57:34.667 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.2] 2024-01-17T22:57:34.667 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBIW6hlXMiTHBAAsXplPBbCxMBYzxTJZUFJNQ== 2024-01-17T22:57:34.667 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.3] 2024-01-17T22:57:34.667 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBLW6hlB/ShIhAADMN09b/PoQkqbBC256YccQ== 2024-01-17T22:57:34.667 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.x] 2024-01-17T22:57:34.667 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA+W6hlZp9oFRAA387ZJe5QAueQIfpGiazzGA== 2024-01-17T22:57:34.667 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2024-01-17T22:57:34.667 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA+W6hlhsrjKxAA0aeiDEKPr/xB20HibdIVvg== 2024-01-17T22:57:34.667 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2024-01-17T22:57:34.667 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA+W6hl6A9ENBAA5F3aR5K744+zlJXyQxCl+g== 2024-01-17T22:57:34.667 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.f] 2024-01-17T22:57:34.667 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA/W6hlv2HVABAAWvhzgaKANXiw6M+cHA+Xdg== 2024-01-17T22:57:34.667 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.4] 2024-01-17T22:57:34.667 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBRW6hlRIbuHBAAW/nsNp+87tw0Agy4LqpibA== 2024-01-17T22:57:34.667 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.5] 2024-01-17T22:57:34.667 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBUW6hloPBvIBAARLJCxg4bVR08NmqML3SKbw== 2024-01-17T22:57:34.668 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.6] 2024-01-17T22:57:34.668 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBXW6hl1MCeJxAAS39o3uDkp4b5XjPVzKf8JA== 2024-01-17T22:57:34.668 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.7] 2024-01-17T22:57:34.668 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBaW6hluBA0LBAA+ALCvDuLSYvg1UN05ZvKbg== 2024-01-17T22:57:34.668 INFO:teuthology.orchestra.run.smithi190.stdout:[client.0] 2024-01-17T22:57:34.668 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA/W6hlMbdKBxAAjVIUbK8QHyYovZDX8oKC6A== 2024-01-17T22:57:34.670 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.y] 2024-01-17T22:57:34.670 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQA+W6hlnijzEhAAdVQixTRL25+iYSBz0rcfzA== 2024-01-17T22:57:34.670 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2024-01-17T22:57:34.670 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQA+W6hliPSuGRAAr6z4o69bLn7PsU6/1HBPtw== 2024-01-17T22:57:34.670 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2024-01-17T22:57:34.670 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQA+W6hlGsTAIBAAxlkbyZ2PAUJIYpkoyBAMfQ== 2024-01-17T22:57:34.670 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.e] 2024-01-17T22:57:34.670 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQA+W6hlPTwqKBAACIemgwykT4+q8VwsuemIxg== 2024-01-17T22:57:34.670 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.0] 2024-01-17T22:57:34.670 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBCW6hljTX+EBAAZJEII3UdL9vErOQUy4VtPg== 2024-01-17T22:57:34.670 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.1] 2024-01-17T22:57:34.670 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBFW6hlINvbFhAABsejEx7JbXnb/3EGD5VuMg== 2024-01-17T22:57:34.671 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.2] 2024-01-17T22:57:34.671 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBIW6hlXMiTHBAAsXplPBbCxMBYzxTJZUFJNQ== 2024-01-17T22:57:34.671 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.3] 2024-01-17T22:57:34.671 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBLW6hlB/ShIhAADMN09b/PoQkqbBC256YccQ== 2024-01-17T22:57:34.671 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.x] 2024-01-17T22:57:34.671 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQA+W6hlZp9oFRAA387ZJe5QAueQIfpGiazzGA== 2024-01-17T22:57:34.671 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2024-01-17T22:57:34.671 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQA+W6hlhsrjKxAA0aeiDEKPr/xB20HibdIVvg== 2024-01-17T22:57:34.671 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.d] 2024-01-17T22:57:34.671 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQA+W6hl6A9ENBAA5F3aR5K744+zlJXyQxCl+g== 2024-01-17T22:57:34.671 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.f] 2024-01-17T22:57:34.671 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQA/W6hlv2HVABAAWvhzgaKANXiw6M+cHA+Xdg== 2024-01-17T22:57:34.671 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.4] 2024-01-17T22:57:34.671 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBRW6hlRIbuHBAAW/nsNp+87tw0Agy4LqpibA== 2024-01-17T22:57:34.671 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.5] 2024-01-17T22:57:34.671 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBUW6hloPBvIBAARLJCxg4bVR08NmqML3SKbw== 2024-01-17T22:57:34.672 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.6] 2024-01-17T22:57:34.672 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBXW6hl1MCeJxAAS39o3uDkp4b5XjPVzKf8JA== 2024-01-17T22:57:34.672 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.7] 2024-01-17T22:57:34.672 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBaW6hluBA0LBAA+ALCvDuLSYvg1UN05ZvKbg== 2024-01-17T22:57:34.672 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2024-01-17T22:57:34.672 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQA/W6hlMbdKBxAAjVIUbK8QHyYovZDX8oKC6A== 2024-01-17T22:57:34.673 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-17T22:57:34.718 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-17T22:57:34.772 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:57:34.775 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:57:34.831 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:57:34.834 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:57:34.888 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:57:34.891 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:57:34.960 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:57:34.964 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:57:35.045 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:57:35.048 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:57:35.128 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:57:35.131 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:57:35.210 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:57:35.213 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:57:35.289 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-17T22:57:35.292 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-17T22:57:35.371 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:57:35.374 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:57:35.456 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:57:35.459 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:57:35.537 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:57:35.541 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:57:35.628 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:57:35.631 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:57:35.681 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:57:35.685 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:57:35.756 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:57:35.759 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:57:35.838 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:57:35.841 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:57:35.920 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-17T22:57:35.924 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-17T22:57:36.010 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-17T22:57:36.010 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-17T22:57:36.030 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-17T22:57:36.139 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-17T22:57:36.157 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-17T22:57:36.171 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-17T22:57:36.263 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-17T22:57:36.274 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-17T22:57:36.328 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-17T22:57:36.413 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-17T22:57:36.465 DEBUG:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:57:36.467 DEBUG:teuthology.orchestra.run.smithi190:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:57:36.510 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-17T22:57:36.511 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-17T22:57:36.511 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-17T22:57:36.511 DEBUG:teuthology.orchestra.run.smithi161:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-01-17T22:57:36.518 INFO:tasks.ceph.mon.a:Started 2024-01-17T22:57:36.519 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-17T22:57:36.519 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-17T22:57:36.519 DEBUG:teuthology.orchestra.run.smithi190:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-01-17T22:57:36.556 INFO:tasks.ceph.mon.b:Started 2024-01-17T22:57:36.556 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-17T22:57:36.556 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-17T22:57:36.556 DEBUG:teuthology.orchestra.run.smithi190:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-01-17T22:57:36.559 INFO:tasks.ceph.mon.c:Started 2024-01-17T22:57:36.559 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-17T22:57:36.559 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-17T22:57:36.559 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-01-17T22:57:36.562 INFO:tasks.ceph.mgr.y:Started 2024-01-17T22:57:36.562 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-17T22:57:36.562 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-01-17T22:57:36.565 INFO:tasks.ceph.mgr.x:Started 2024-01-17T22:57:36.565 INFO:tasks.ceph:Setting crush tunables to default 2024-01-17T22:57:36.565 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd crush tunables default 2024-01-17T22:57:36.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:36.702+0000 7f9c2ca00640 1 Processor -- start 2024-01-17T22:57:36.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:36.706+0000 7f9c2ca00640 1 -- start start 2024-01-17T22:57:36.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:36.706+0000 7f9c2ca00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9c240c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:57:36.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:36.706+0000 7f9c2ca00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9c24157e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:57:36.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:36.706+0000 7f9c2ca00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c24157540 con 0x7f9c240ca410 2024-01-17T22:57:36.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:36.706+0000 7f9c2ca00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c241583a0 con 0x7f9c241579d0 2024-01-17T22:57:36.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:36.706+0000 7f9c2ca00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24151b40 con 0x7f9c24151760 2024-01-17T22:57:36.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:36.706+0000 7f9c29600640 1 -- >> v1:172.21.15.161:6789/0 conn(0x7f9c240ca410 legacy=0x7f9c24070d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.161:6789/0 2024-01-17T22:57:36.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:36.706+0000 7f9c2a000640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9c240c2a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2024-01-17T22:57:36.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:36.706+0000 7f9c2aa00640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9c24157e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2024-01-17T22:57:36.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:36.706+0000 7f9c2a000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9c240c2a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:57:36.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:36.706+0000 7f9c2aa00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9c24157e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:57:36.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:36.910+0000 7f9c29600640 1 -- >> v1:172.21.15.161:6789/0 conn(0x7f9c240ca410 legacy=0x7f9c24070d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.161:6789/0 2024-01-17T22:57:36.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:36.910+0000 7f9c2aa00640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9c24157e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2024-01-17T22:57:36.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:36.910+0000 7f9c2a000640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9c240c2a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2024-01-17T22:57:36.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:36.910+0000 7f9c2aa00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9c24157e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:57:36.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:36.910+0000 7f9c2a000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9c240c2a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:57:37.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:37.314+0000 7f9c29600640 1 -- >> v1:172.21.15.161:6789/0 conn(0x7f9c240ca410 legacy=0x7f9c24070d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.161:6789/0 2024-01-17T22:57:37.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:37.314+0000 7f9c2aa00640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9c24157e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2024-01-17T22:57:37.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:37.314+0000 7f9c2a000640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9c240c2a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2024-01-17T22:57:37.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:37.314+0000 7f9c2aa00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9c24157e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:57:37.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:37.314+0000 7f9c2a000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9c240c2a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:57:38.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:38.118+0000 7f9c29600640 1 -- >> v1:172.21.15.161:6789/0 conn(0x7f9c240ca410 legacy=0x7f9c24070d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.161:6789/0 2024-01-17T22:57:38.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:38.118+0000 7f9c2aa00640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9c24157e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2024-01-17T22:57:38.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:38.118+0000 7f9c2a000640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9c240c2a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2024-01-17T22:57:38.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:38.118+0000 7f9c2aa00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9c24157e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:57:38.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:38.118+0000 7f9c2a000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9c240c2a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:57:39.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:39.706+0000 7f9c23400640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9c240c2a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:57:39.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:39.706+0000 7f9c23400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9c240c2a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:57:39.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:39.706+0000 7f9c23400640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9c24157e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:57:39.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:39.706+0000 7f9c23400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9c24157e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:57:39.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:39.706+0000 7f9c23400640 1 -- >> v1:172.21.15.161:6789/0 conn(0x7f9c240ca410 legacy=0x7f9c24070d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:57:39.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:39.706+0000 7f9c23400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:57:39.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:39.706+0000 7f9c23400640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2415aa30 con 0x7f9bfc006230 2024-01-17T22:57:39.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:39.706+0000 7f9c23400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c241583a0 con 0x7f9bfc0036d0 2024-01-17T22:57:39.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:39.706+0000 7f9c2a000640 1 -- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.161:3300/0 2024-01-17T22:57:39.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:39.706+0000 7f9c2a000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:57:39.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:39.706+0000 7f9c29600640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f9bfc006230 legacy=0x7f9bfc0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2024-01-17T22:57:39.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:39.910+0000 7f9c2a000640 1 -- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.161:3300/0 2024-01-17T22:57:39.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:39.910+0000 7f9c2a000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:57:39.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:39.910+0000 7f9c29600640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f9bfc006230 legacy=0x7f9bfc0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2024-01-17T22:57:40.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:40.314+0000 7f9c2a000640 1 -- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.161:3300/0 2024-01-17T22:57:40.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:40.314+0000 7f9c2a000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:57:40.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:40.314+0000 7f9c29600640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f9bfc006230 legacy=0x7f9bfc0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2024-01-17T22:57:41.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:41.118+0000 7f9c2a000640 1 -- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.161:3300/0 2024-01-17T22:57:41.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:41.118+0000 7f9c2a000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:57:41.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:41.118+0000 7f9c29600640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f9bfc006230 legacy=0x7f9bfc0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2024-01-17T22:57:42.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.706+0000 7f9c23400640 1 -- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:57:42.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.706+0000 7f9c23400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:57:42.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.706+0000 7f9c23400640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f9bfc006230 legacy=0x7f9bfc0086f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:57:42.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.706+0000 7f9c2aa00640 1 -- reap_dead start 2024-01-17T22:57:42.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.706+0000 7f9c23400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc009f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:57:42.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.706+0000 7f9c23400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:57:42.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.706+0000 7f9c23400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:57:42.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.706+0000 7f9c23400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c241583a0 con 0x7f9bfc0036d0 2024-01-17T22:57:42.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.706+0000 7f9c23400640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c24151b40 con 0x7f9c241579d0 2024-01-17T22:57:42.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.706+0000 7f9c23400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc00ab40 con 0x7f9c24151760 2024-01-17T22:57:42.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.706+0000 7f9c29600640 1 -- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.161:3300/0 2024-01-17T22:57:42.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.706+0000 7f9c2a000640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9bfc009f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2024-01-17T22:57:42.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.706+0000 7f9c29600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:57:42.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.706+0000 7f9c2a000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc009f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:57:42.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.706+0000 7f9c2aa00640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9bfc00a550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2024-01-17T22:57:42.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.706+0000 7f9c2aa00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:57:42.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.910+0000 7f9c29600640 1 -- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.161:3300/0 2024-01-17T22:57:42.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.910+0000 7f9c29600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:57:42.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.910+0000 7f9c2a000640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9bfc009f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2024-01-17T22:57:42.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.910+0000 7f9c2aa00640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9bfc00a550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2024-01-17T22:57:42.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.910+0000 7f9c2a000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc009f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:57:42.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:42.910+0000 7f9c2aa00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:57:43.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:43.314+0000 7f9c29600640 1 -- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.161:3300/0 2024-01-17T22:57:43.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:43.314+0000 7f9c29600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:57:43.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:43.314+0000 7f9c2aa00640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9bfc00a550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2024-01-17T22:57:43.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:43.314+0000 7f9c2a000640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9bfc009f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2024-01-17T22:57:43.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:43.314+0000 7f9c2aa00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:57:43.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:43.314+0000 7f9c2a000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc009f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:57:44.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:44.118+0000 7f9c29600640 1 -- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.161:3300/0 2024-01-17T22:57:44.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:44.118+0000 7f9c2a000640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9bfc009f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2024-01-17T22:57:44.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:44.118+0000 7f9c29600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:57:44.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:44.118+0000 7f9c2aa00640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9bfc00a550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2024-01-17T22:57:44.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:44.118+0000 7f9c2a000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc009f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:57:44.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:44.118+0000 7f9c2aa00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:57:44.653 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:00:08.014 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T22:57:44.918 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:00:08.193 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T22:57:44.922 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:00:08.198 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T22:57:45.011 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:00:08.372 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T22:57:45.244 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:00:08.520 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T22:57:45.248 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:00:08.524 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T22:57:45.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:45.706+0000 7f9c23400640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9bfc009f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:57:45.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:45.706+0000 7f9c23400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc009f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:57:45.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:45.706+0000 7f9c23400640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9bfc00a550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:57:45.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:45.706+0000 7f9c23400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:57:45.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:45.706+0000 7f9c23400640 1 -- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:57:45.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:45.706+0000 7f9c23400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:57:45.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:45.706+0000 7f9c23400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c24157540 con 0x7f9bfc009200 2024-01-17T22:57:45.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:45.706+0000 7f9c23400640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2415aa30 con 0x7f9bfc008e20 2024-01-17T22:57:45.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:45.706+0000 7f9c29600640 1 -- >> v1:172.21.15.161:6789/0 conn(0x7f9bfc009200 legacy=0x7f9bfc009610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.161:6789/0 2024-01-17T22:57:45.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:45.706+0000 7f9c2a000640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f9bfc008e20 legacy=0x7f9bfc0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2024-01-17T22:57:45.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:45.910+0000 7f9c29600640 1 -- >> v1:172.21.15.161:6789/0 conn(0x7f9bfc009200 legacy=0x7f9bfc009610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.161:6789/0 2024-01-17T22:57:45.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:45.910+0000 7f9c2a000640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f9bfc008e20 legacy=0x7f9bfc0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2024-01-17T22:57:46.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:46.314+0000 7f9c2a000640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f9bfc008e20 legacy=0x7f9bfc0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2024-01-17T22:57:46.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:46.474+0000 7f9c29600640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f9bfc009200 0x7f9bfc009610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59714/0 (socket says 172.21.15.161:59714) 2024-01-17T22:57:46.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:46.474+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 learned_addr learned my addr 172.21.15.161:0/3382236396 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:57:46.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:46.686+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> v1:172.21.15.161:6789/0 conn(0x7f9bfc009200 legacy=0x7f9bfc009610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-17T22:57:46.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:46.686+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> v1:172.21.15.161:6789/0 conn(0x7f9bfc009200 legacy=0x7f9bfc009610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:46.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:46.686+0000 7f9c29600640 1 --1- 172.21.15.161:0/3382236396 >> v1:172.21.15.161:6789/0 conn(0x7f9bfc009200 0x7f9bfc009610 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2024-01-17T22:57:48.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 >> v1:172.21.15.190:6789/0 conn(0x7f9bfc008e20 legacy=0x7f9bfc0086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:57:48.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 >> v1:172.21.15.161:6789/0 conn(0x7f9bfc009200 legacy=0x7f9bfc009610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:57:48.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.706+0000 7f9c2aa00640 1 -- 172.21.15.161:0/3382236396 reap_dead start 2024-01-17T22:57:48.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.706+0000 7f9c23400640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc0131c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:57:48.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.706+0000 7f9c23400640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:57:48.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.706+0000 7f9c23400640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:57:48.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c241583a0 con 0x7f9bfc0036d0 2024-01-17T22:57:48.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c24151b40 con 0x7f9c241579d0 2024-01-17T22:57:48.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc00ab40 con 0x7f9c24151760 2024-01-17T22:57:48.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.710+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc0131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:48.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.714+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:48.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.718+0000 7f9c2aa00640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-17T22:57:48.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.718+0000 7f9c2aa00640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:48.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.718+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:48.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.718+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:57:48.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.722+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9bfc0131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:48.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.722+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9bfc0131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:48.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.722+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc0131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:48.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.722+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc0131c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:57:48.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.750+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:48.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.754+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9bfc00a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-17T22:57:48.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.754+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9bfc00a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:48.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.754+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:48.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.754+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:57:48.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.922+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:48.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.922+0000 7f9c2aa00640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:48.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.922+0000 7f9c2aa00640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:48.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.922+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:48.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.922+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:57:48.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.926+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc0131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:48.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.930+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9bfc0131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:48.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.930+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9bfc0131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:48.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.930+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc0131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:48.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.930+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc0131c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:57:48.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.958+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:48.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.962+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9bfc00a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:48.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.962+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9bfc00a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:48.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.962+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:48.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:48.962+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:57:49.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:49.326+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:49.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:49.326+0000 7f9c2aa00640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:49.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:49.326+0000 7f9c2aa00640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:49.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:49.326+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:49.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:49.326+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:57:49.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:49.334+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc0131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:49.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:49.354+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9bfc0131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:49.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:49.354+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9bfc0131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:49.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:49.354+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc0131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:49.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:49.354+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc0131c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:57:49.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:49.366+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:49.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:49.370+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9bfc00a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:49.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:49.370+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9bfc00a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:49.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:49.370+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:49.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:49.370+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:57:50.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:50.130+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:50.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:50.130+0000 7f9c2aa00640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:50.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:50.130+0000 7f9c2aa00640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:50.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:50.130+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:50.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:50.130+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:57:50.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:50.158+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc0131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:50.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:50.158+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9bfc0131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:50.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:50.158+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9bfc0131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:50.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:50.158+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc0131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:50.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:50.158+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc0131c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:57:50.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:50.174+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:50.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:50.178+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9bfc00a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:50.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:50.178+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9bfc00a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:50.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:50.178+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:50.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:50.178+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:57:51.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:51.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 msgr2=0x7f9bfc0131c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:57:51.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:51.706+0000 7f9c23400640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c24151760 0x7f9bfc0131c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:57:51.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:51.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 msgr2=0x7f9bfc00a550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:57:51.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:51.706+0000 7f9c23400640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9c241579d0 0x7f9bfc00a550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:57:51.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:51.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:57:51.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:51.706+0000 7f9c23400640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:57:51.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:51.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bfc00ada0 con 0x7f9bfc009610 2024-01-17T22:57:51.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:51.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bfc0099f0 con 0x7f9bfc014710 2024-01-17T22:57:54.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:54.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 >> v1:172.21.15.190:6789/0 conn(0x7f9bfc014710 legacy=0x7f9bfc011180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:57:54.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:54.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 >> v1:172.21.15.161:6789/0 conn(0x7f9bfc009610 legacy=0x7f9bfc0086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:57:54.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:54.706+0000 7f9c2aa00640 1 -- 172.21.15.161:0/3382236396 reap_dead start 2024-01-17T22:57:54.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:54.706+0000 7f9c23400640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:57:54.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:54.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bfc014f50 con 0x7f9bfc00a550 2024-01-17T22:57:54.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:54.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bfc0140b0 con 0x7f9bfc014af0 2024-01-17T22:57:54.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:54.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c241583a0 con 0x7f9bfc0036d0 2024-01-17T22:57:54.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:54.710+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:54.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:54.710+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:54.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:54.710+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:54.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:54.710+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:54.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:54.710+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:57:54.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:54.914+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:54.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:54.914+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:54.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:54.914+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:54.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:54.914+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:54.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:54.914+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:57:55.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:55.318+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:55.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:55.318+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:55.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:55.318+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:55.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:55.318+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:55.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:55.318+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:57:56.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:56.122+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:56.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:56.122+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:56.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:56.122+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:56.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:56.122+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:56.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:56.122+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:57:57.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 msgr2=0x7f9bfc005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:57:57.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.706+0000 7f9c23400640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.161:3300/0 conn(0x7f9bfc0036d0 0x7f9bfc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:57:57.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 >> v1:172.21.15.190:6789/0 conn(0x7f9bfc014af0 legacy=0x7f9bfc0128a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:57:57.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 >> v1:172.21.15.161:6789/0 conn(0x7f9bfc00a550 legacy=0x7f9bfc0086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:57:57.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.706+0000 7f9c23400640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 0x7f9bfc00d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:57:57.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.706+0000 7f9c23400640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 0x7f9bfc00ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:57:57.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c241583a0 con 0x7f9bfc00b150 2024-01-17T22:57:57.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.706+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24151b40 con 0x7f9bfc00da80 2024-01-17T22:57:57.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.710+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 0x7f9bfc00ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:57.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.710+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 0x7f9bfc00d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:57.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.710+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 msgr2=0x7f9bfc00ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-17T22:57:57.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.710+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 msgr2=0x7f9bfc00ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:57.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.710+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 0x7f9bfc00ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:57.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.710+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 0x7f9bfc00ff20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:57:57.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.714+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 msgr2=0x7f9bfc00d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:57.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.714+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 msgr2=0x7f9bfc00d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:57.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.714+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 0x7f9bfc00d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:57.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.714+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 0x7f9bfc00d540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:57:57.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.914+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 0x7f9bfc00ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:57.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.918+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 msgr2=0x7f9bfc00ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:57.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.918+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 msgr2=0x7f9bfc00ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:57.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.918+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 0x7f9bfc00ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:57.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.918+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 0x7f9bfc00ff20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:57:57.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.918+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 0x7f9bfc00d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:57.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.922+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 msgr2=0x7f9bfc00d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-17T22:57:57.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.922+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 msgr2=0x7f9bfc00d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:57.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.922+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 0x7f9bfc00d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:57.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:57.922+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 0x7f9bfc00d540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:57:58.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:58.322+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 0x7f9bfc00ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:58.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:58.322+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 msgr2=0x7f9bfc00ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:58.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:58.322+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 msgr2=0x7f9bfc00ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:58.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:58.322+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 0x7f9bfc00ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:58.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:58.322+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 0x7f9bfc00ff20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:57:58.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:58.326+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 0x7f9bfc00d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:58.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:58.326+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 msgr2=0x7f9bfc00d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:58.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:58.326+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 msgr2=0x7f9bfc00d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:58.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:58.326+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 0x7f9bfc00d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:58.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:58.326+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 0x7f9bfc00d540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:57:59.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:59.126+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 0x7f9bfc00ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:59.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:59.130+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 msgr2=0x7f9bfc00ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:59.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:59.130+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 msgr2=0x7f9bfc00ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:59.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:59.130+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 0x7f9bfc00ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:59.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:59.130+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 0x7f9bfc00ff20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:57:59.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:59.130+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 0x7f9bfc00d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:57:59.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:59.134+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 msgr2=0x7f9bfc00d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T22:57:59.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:59.134+0000 7f9c2a000640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 msgr2=0x7f9bfc00d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:57:59.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:59.134+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 0x7f9bfc00d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:57:59.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:57:59.134+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 0x7f9bfc00d540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:58:00.092 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T22:58:00.095 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T22:58:00.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.710+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 msgr2=0x7f9bfc00ff20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:58:00.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.710+0000 7f9c23400640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00da80 0x7f9bfc00ff20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:00.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.710+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 msgr2=0x7f9bfc00d540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:58:00.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.710+0000 7f9c23400640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc00b150 0x7f9bfc00d540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:00.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.710+0000 7f9c2aa00640 1 -- 172.21.15.161:0/3382236396 reap_dead start 2024-01-17T22:58:00.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.710+0000 7f9c23400640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00a550 0x7f9bfc005b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:00.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.710+0000 7f9c23400640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc0137b0 0x7f9bfc0125b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:00.710 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.710+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bfc014240 con 0x7f9bfc0036d0 2024-01-17T22:58:00.710 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.710+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c241583a0 con 0x7f9bfc0137b0 2024-01-17T22:58:00.710 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.710+0000 7f9c23400640 1 -- 172.21.15.161:0/3382236396 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24151b40 con 0x7f9bfc00a550 2024-01-17T22:58:00.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.734+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc0137b0 0x7f9bfc0125b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:00.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.742+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00a550 0x7f9bfc005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:00.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.746+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00a550 msgr2=0x7f9bfc005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-17T22:58:00.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.746+0000 7f9c29600640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00a550 msgr2=0x7f9bfc005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:58:00.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.746+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00a550 0x7f9bfc005b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:58:00.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.746+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00a550 0x7f9bfc005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:58:00.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.774+0000 7f9c2aa00640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc0137b0 msgr2=0x7f9bfc0125b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-17T22:58:00.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.774+0000 7f9c2aa00640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc0137b0 msgr2=0x7f9bfc0125b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:58:00.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.774+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc0137b0 0x7f9bfc0125b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:58:00.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.774+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc0137b0 0x7f9bfc0125b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:58:00.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.918+0000 7f9c28c00640 1 -- 172.21.15.161:0/3382236396 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879247775 0 0) 0x7f9bfc014240 con 0x7f9bfc0036d0 2024-01-17T22:58:00.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:00.918+0000 7f9c28c00640 1 -- 172.21.15.161:0/3382236396 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c04003530 con 0x7f9bfc0036d0 2024-01-17T22:58:01.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.010+0000 7f9c28c00640 1 -- 172.21.15.161:0/3382236396 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1495733359 0 0) 0x7f9c04003530 con 0x7f9bfc0036d0 2024-01-17T22:58:01.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.010+0000 7f9c28c00640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00a550 msgr2=0x7f9bfc005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:01.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.010+0000 7f9c28c00640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00a550 0x7f9bfc005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:01.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.010+0000 7f9c28c00640 1 -- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc0137b0 msgr2=0x7f9bfc0125b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:01.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.010+0000 7f9c28c00640 1 --2- 172.21.15.161:0/3382236396 >> v2:172.21.15.190:3300/0 conn(0x7f9bfc0137b0 0x7f9bfc0125b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:01.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.010+0000 7f9c28c00640 1 -- 172.21.15.161:0/3382236396 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc013d80 con 0x7f9bfc0036d0 2024-01-17T22:58:01.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.010+0000 7f9c28c00640 1 -- 172.21.15.161:0/3382236396 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f9c14009a30 con 0x7f9bfc0036d0 2024-01-17T22:58:01.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.010+0000 7f9c28c00640 1 -- 172.21.15.161:0/3382236396 >> v1:172.21.15.161:6789/0 conn(0x7f9bfc0036d0 legacy=0x7f9bfc0130a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:01.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.010+0000 7f9c28c00640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00a550 0x7f9c04003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:01.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.010+0000 7f9c28c00640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c04003f90 0x7f9c040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:01.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.010+0000 7f9c28c00640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c04004d10 0x7f9c04005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:01.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.010+0000 7f9c28c00640 1 -- 172.21.15.161:0/3382236396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c241583a0 con 0x7f9c04004d10 2024-01-17T22:58:01.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.010+0000 7f9c28c00640 1 -- 172.21.15.161:0/3382236396 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24151b40 con 0x7f9c04003f90 2024-01-17T22:58:01.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.010+0000 7f9c28c00640 1 -- 172.21.15.161:0/3382236396 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0400bb20 con 0x7f9bfc00a550 2024-01-17T22:58:01.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.050+0000 7f9c2a000640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00a550 0x7f9c04003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:01.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.058+0000 7f9c29600640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c04003f90 0x7f9c040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:01.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.066+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c04004d10 0x7f9c04005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:01.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.098+0000 7f9c2aa00640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00a550 msgr2=0x7f9c04003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:01.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.098+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bfc00a550 0x7f9c04003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:01.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.098+0000 7f9c2aa00640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c04003f90 msgr2=0x7f9c040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:01.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.098+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c04003f90 0x7f9c040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:01.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.098+0000 7f9c2aa00640 1 -- 172.21.15.161:0/3382236396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c04003530 con 0x7f9c04004d10 2024-01-17T22:58:01.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.114+0000 7f9c2aa00640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c04004d10 0x7f9c04005190 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9c2408b300 tx=0x7f9c1c01d6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69efcd69556fd042 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:01.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.122+0000 7f9c28c00640 1 -- 172.21.15.161:0/3382236396 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c0ae5b0 con 0x7f9c04004d10 2024-01-17T22:58:01.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.122+0000 7f9c28c00640 1 -- 172.21.15.161:0/3382236396 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c0a9070 con 0x7f9c04004d10 2024-01-17T22:58:01.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.122+0000 7f9c28c00640 1 -- 172.21.15.161:0/3382236396 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c0ae970 con 0x7f9c04004d10 2024-01-17T22:58:01.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.126+0000 7f9c2ca00640 1 -- 172.21.15.161:0/3382236396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c04004d10 msgr2=0x7f9c04005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:01.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.126+0000 7f9c2ca00640 1 --2- 172.21.15.161:0/3382236396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c04004d10 0x7f9c04005190 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9c2408b300 tx=0x7f9c1c01d6c0 comp rx=0 tx=0).stop 2024-01-17T22:58:01.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.126+0000 7f9c2aa00640 1 -- 172.21.15.161:0/3382236396 reap_dead start 2024-01-17T22:58:01.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.126+0000 7f9c2ca00640 1 -- 172.21.15.161:0/3382236396 shutdown_connections 2024-01-17T22:58:01.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.126+0000 7f9c2ca00640 1 -- 172.21.15.161:0/3382236396 >> 172.21.15.161:0/3382236396 conn(0x7f9c24070390 msgr2=0x7f9c2406f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:01.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.126+0000 7f9c2ca00640 1 -- 172.21.15.161:0/3382236396 shutdown_connections 2024-01-17T22:58:01.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.126+0000 7f9c2ca00640 1 -- 172.21.15.161:0/3382236396 wait complete. 2024-01-17T22:58:01.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.126+0000 7f9c2ca00640 1 Processor -- start 2024-01-17T22:58:01.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.126+0000 7f9c2ca00640 1 -- start start 2024-01-17T22:58:01.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.130+0000 7f9c2ca00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c04004d10 0x7f9c24159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:01.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.130+0000 7f9c2ca00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c241570d0 0x7f9c24155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:01.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.130+0000 7f9c2ca00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c2414fe60 0x7f9c241470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:01.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.130+0000 7f9c2ca00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24159e80 con 0x7f9c04004d10 2024-01-17T22:58:01.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.130+0000 7f9c2ca00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2406d3a0 con 0x7f9c241570d0 2024-01-17T22:58:01.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.130+0000 7f9c2ca00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24146c30 con 0x7f9c2414fe60 2024-01-17T22:58:01.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.158+0000 7f9c2a000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c04004d10 0x7f9c24159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:01.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.162+0000 7f9c2a000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c04004d10 0x7f9c24159940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43078/0 (socket says 172.21.15.161:43078) 2024-01-17T22:58:01.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.162+0000 7f9c2a000640 1 -- 172.21.15.161:0/918456103 learned_addr learned my addr 172.21.15.161:0/918456103 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:01.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.166+0000 7f9c2a000640 1 -- 172.21.15.161:0/918456103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c2414fe60 msgr2=0x7f9c241470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:01.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.166+0000 7f9c2a000640 1 --2- 172.21.15.161:0/918456103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c2414fe60 0x7f9c241470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:01.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.166+0000 7f9c2a000640 1 -- 172.21.15.161:0/918456103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c241570d0 msgr2=0x7f9c24155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:01.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.166+0000 7f9c2a000640 1 --2- 172.21.15.161:0/918456103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c241570d0 0x7f9c24155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:01.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.166+0000 7f9c2a000640 1 -- 172.21.15.161:0/918456103 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2415a1b0 con 0x7f9c04004d10 2024-01-17T22:58:01.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.182+0000 7f9c2a000640 1 --2- 172.21.15.161:0/918456103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c04004d10 0x7f9c24159940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9c140098d0 tx=0x7f9c14006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:01.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.190+0000 7f9c22000640 1 -- 172.21.15.161:0/918456103 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1401b430 con 0x7f9c04004d10 2024-01-17T22:58:01.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.194+0000 7f9c22000640 1 -- 172.21.15.161:0/918456103 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c14011040 con 0x7f9c04004d10 2024-01-17T22:58:01.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.194+0000 7f9c2ca00640 1 -- 172.21.15.161:0/918456103 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2415a490 con 0x7f9c04004d10 2024-01-17T22:58:01.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.194+0000 7f9c22000640 1 -- 172.21.15.161:0/918456103 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1401b5f0 con 0x7f9c04004d10 2024-01-17T22:58:01.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.194+0000 7f9c2ca00640 1 -- 172.21.15.161:0/918456103 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c24148990 con 0x7f9c04004d10 2024-01-17T22:58:01.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.194+0000 7f9c2ca00640 1 -- 172.21.15.161:0/918456103 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c24148510 con 0x7f9c04004d10 2024-01-17T22:58:01.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.370+0000 7f9c22000640 1 -- 172.21.15.161:0/918456103 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f9c1401b750 con 0x7f9c04004d10 2024-01-17T22:58:01.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.370+0000 7f9c22000640 1 -- 172.21.15.161:0/918456103 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9c14030410 con 0x7f9c04004d10 2024-01-17T22:58:01.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.370+0000 7f9c22000640 1 -- 172.21.15.161:0/918456103 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f9c24148510 con 0x7f9c04004d10 2024-01-17T22:58:01.423 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:01.422+0000 7f5c9909b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-17T22:58:01.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.458+0000 7f9c2ca00640 1 -- 172.21.15.161:0/918456103 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f9c240746a0 con 0x7f9c04004d10 2024-01-17T22:58:01.639 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:01.635+0000 7f240b9be180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-17T22:58:01.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.646+0000 7f9c22000640 1 -- 172.21.15.161:0/918456103 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9c1402b030 con 0x7f9c04004d10 2024-01-17T22:58:01.646 INFO:teuthology.orchestra.run.smithi161.stderr:adjusted tunables profile to default 2024-01-17T22:58:01.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.646+0000 7f9c2ca00640 1 -- 172.21.15.161:0/918456103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c04004d10 msgr2=0x7f9c24159940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:01.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.646+0000 7f9c2ca00640 1 --2- 172.21.15.161:0/918456103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c04004d10 0x7f9c24159940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9c140098d0 tx=0x7f9c14006420 comp rx=0 tx=0).stop 2024-01-17T22:58:01.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.646+0000 7f9c2ca00640 1 -- 172.21.15.161:0/918456103 shutdown_connections 2024-01-17T22:58:01.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.646+0000 7f9c2ca00640 1 --2- 172.21.15.161:0/918456103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c241570d0 0x7f9c24155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:01.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.646+0000 7f9c2ca00640 1 --2- 172.21.15.161:0/918456103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c2414fe60 0x7f9c241470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:01.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.646+0000 7f9c2ca00640 1 --2- 172.21.15.161:0/918456103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c04004d10 0x7f9c24159940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:01.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.646+0000 7f9c2ca00640 1 -- 172.21.15.161:0/918456103 >> 172.21.15.161:0/918456103 conn(0x7f9c24070390 msgr2=0x7f9c240c8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:01.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.646+0000 7f9c2ca00640 1 -- 172.21.15.161:0/918456103 shutdown_connections 2024-01-17T22:58:01.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:01.646+0000 7f9c2ca00640 1 -- 172.21.15.161:0/918456103 wait complete. 2024-01-17T22:58:01.668 INFO:tasks.ceph:check_enable_crimson: False 2024-01-17T22:58:01.668 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-17T22:58:01.669 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:58:01.669 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-17T22:58:01.688 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:58:01.688 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-17T22:58:01.752 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:58:01.752 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-17T22:58:01.819 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:58:01.819 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-17T22:58:01.885 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:58:01.885 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-17T22:58:01.896 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:58:01.897 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-17T22:58:01.950 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:58:01.950 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-17T22:58:01.953 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:01.954+0000 7f5c9909b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-17T22:58:02.004 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-01-17T22:58:02.004 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-17T22:58:02.057 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new d013c8c8-b2d5-4c32-9512-889ec824946b 0 2024-01-17T22:58:02.154 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:02.154+0000 7f5c9909b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-17T22:58:02.162 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:02.159+0000 7f240b9be180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-17T22:58:02.218 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.211+0000 7ff42cdde640 1 Processor -- start 2024-01-17T22:58:02.218 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.211+0000 7ff42cdde640 1 -- start start 2024-01-17T22:58:02.219 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.215+0000 7ff42cdde640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff4280c63c0 0x7ff4280c7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:02.219 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.215+0000 7ff42cdde640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff428157240 con 0x7ff428150680 2024-01-17T22:58:02.219 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.215+0000 7ff42cdde640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff428150b70 con 0x7ff4280c7bc0 2024-01-17T22:58:02.219 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.215+0000 7ff42cdde640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff428156460 con 0x7ff4280c63c0 2024-01-17T22:58:02.220 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.215+0000 7ff426d9d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff428150680 0x7ff4280c2e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.190:33194/0 (socket says 172.21.15.190:33194) 2024-01-17T22:58:02.220 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.215+0000 7ff426d9d640 1 -- 172.21.15.190:0/3224144030 learned_addr learned my addr 172.21.15.190:0/3224144030 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-01-17T22:58:02.220 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.215+0000 7ff42659c640 1 --2- 172.21.15.190:0/3224144030 >> v2:172.21.15.190:3300/0 conn(0x7ff4280c63c0 0x7ff4280c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:02.223 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.219+0000 7ff42559a640 1 -- 172.21.15.190:0/3224144030 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120451478 0 0) 0x7ff428157240 con 0x7ff428150680 2024-01-17T22:58:02.223 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.219+0000 7ff42559a640 1 -- 172.21.15.190:0/3224144030 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff410005740 con 0x7ff428150680 2024-01-17T22:58:02.225 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.219+0000 7ff42659c640 1 -- 172.21.15.190:0/3224144030 >> v1:172.21.15.190:6789/0 conn(0x7ff4280c7bc0 legacy=0x7ff42814ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:02.225 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.219+0000 7ff42659c640 1 -- 172.21.15.190:0/3224144030 >> v1:172.21.15.161:6789/0 conn(0x7ff428150680 legacy=0x7ff4280c2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:02.225 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.219+0000 7ff42659c640 1 -- 172.21.15.190:0/3224144030 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff428156650 con 0x7ff4280c63c0 2024-01-17T22:58:02.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.227+0000 7ff42659c640 1 --2- 172.21.15.190:0/3224144030 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4280c63c0 0x7ff4280c7680 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0097c0 tx=0x7ff41c01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2aa519714fbedcb4 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:02.267 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.263+0000 7ff42559a640 1 -- 172.21.15.190:0/3224144030 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c0a8970 con 0x7ff4280c63c0 2024-01-17T22:58:02.267 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.263+0000 7ff42559a640 1 -- 172.21.15.190:0/3224144030 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c0a8ad0 con 0x7ff4280c63c0 2024-01-17T22:58:02.267 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.263+0000 7ff42559a640 1 -- 172.21.15.190:0/3224144030 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c0a8e60 con 0x7ff4280c63c0 2024-01-17T22:58:02.269 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.263+0000 7ff42cdde640 1 -- 172.21.15.190:0/3224144030 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4280c63c0 msgr2=0x7ff4280c7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:02.269 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.263+0000 7ff42cdde640 1 --2- 172.21.15.190:0/3224144030 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4280c63c0 0x7ff4280c7680 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0097c0 tx=0x7ff41c01ec70 comp rx=0 tx=0).stop 2024-01-17T22:58:02.269 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.263+0000 7ff42cdde640 1 -- 172.21.15.190:0/3224144030 shutdown_connections 2024-01-17T22:58:02.269 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.263+0000 7ff42cdde640 1 --2- 172.21.15.190:0/3224144030 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4280c63c0 0x7ff4280c7680 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:02.269 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.263+0000 7ff42cdde640 1 -- 172.21.15.190:0/3224144030 >> 172.21.15.190:0/3224144030 conn(0x7ff4280c8260 msgr2=0x7ff4280c8670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:02.269 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.263+0000 7ff42cdde640 1 -- 172.21.15.190:0/3224144030 shutdown_connections 2024-01-17T22:58:02.269 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.263+0000 7ff42cdde640 1 -- 172.21.15.190:0/3224144030 wait complete. 2024-01-17T22:58:02.270 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.263+0000 7ff42cdde640 1 Processor -- start 2024-01-17T22:58:02.270 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.263+0000 7ff42cdde640 1 -- start start 2024-01-17T22:58:02.270 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.263+0000 7ff42cdde640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4280c63c0 0x7ff42814c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:02.270 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.263+0000 7ff42cdde640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4280c7bc0 0x7ff4281ee9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:02.270 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.263+0000 7ff42cdde640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff428150680 0x7ff42814b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:02.271 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.263+0000 7ff42cdde640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42814b0e0 con 0x7ff4280c63c0 2024-01-17T22:58:02.271 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.263+0000 7ff42cdde640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff428151c70 con 0x7ff428150680 2024-01-17T22:58:02.271 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.263+0000 7ff42cdde640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4281ef270 con 0x7ff4280c7bc0 2024-01-17T22:58:02.271 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.267+0000 7ff42659c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4280c63c0 0x7ff42814c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:02.272 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.267+0000 7ff425d9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4280c7bc0 0x7ff4281ee9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:02.272 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.267+0000 7ff42659c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4280c63c0 0x7ff42814c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.190:54830/0 (socket says 172.21.15.190:54830) 2024-01-17T22:58:02.272 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.267+0000 7ff42659c640 1 -- 172.21.15.190:0/75783954 learned_addr learned my addr 172.21.15.190:0/75783954 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-01-17T22:58:02.272 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.267+0000 7ff426d9d640 1 --2- 172.21.15.190:0/75783954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff428150680 0x7ff42814b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:02.275 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.271+0000 7ff42659c640 1 -- 172.21.15.190:0/75783954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4280c7bc0 msgr2=0x7ff4281ee9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:02.275 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.271+0000 7ff42659c640 1 --2- 172.21.15.190:0/75783954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4280c7bc0 0x7ff4281ee9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:02.275 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.271+0000 7ff42659c640 1 -- 172.21.15.190:0/75783954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff428150680 msgr2=0x7ff42814b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:02.275 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.271+0000 7ff42659c640 1 --2- 172.21.15.190:0/75783954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff428150680 0x7ff42814b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:02.275 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.271+0000 7ff42659c640 1 -- 172.21.15.190:0/75783954 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c009420 con 0x7ff4280c63c0 2024-01-17T22:58:02.277 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.271+0000 7ff42659c640 1 --2- 172.21.15.190:0/75783954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4280c63c0 0x7ff42814c2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0b3040 tx=0x7ff41c01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:02.282 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.275+0000 7ff416ffd640 1 -- 172.21.15.190:0/75783954 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c0b9630 con 0x7ff4280c63c0 2024-01-17T22:58:02.282 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.275+0000 7ff416ffd640 1 -- 172.21.15.190:0/75783954 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c0b97b0 con 0x7ff4280c63c0 2024-01-17T22:58:02.282 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.275+0000 7ff416ffd640 1 -- 172.21.15.190:0/75783954 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c0b9b60 con 0x7ff4280c63c0 2024-01-17T22:58:02.282 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.275+0000 7ff42cdde640 1 -- 172.21.15.190:0/75783954 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4281ef550 con 0x7ff4280c63c0 2024-01-17T22:58:02.282 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.275+0000 7ff42cdde640 1 -- 172.21.15.190:0/75783954 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42814aa20 con 0x7ff4280c63c0 2024-01-17T22:58:02.283 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.279+0000 7ff42cdde640 1 -- 172.21.15.190:0/75783954 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42814b220 con 0x7ff4280c63c0 2024-01-17T22:58:02.286 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.279+0000 7ff416ffd640 1 -- 172.21.15.190:0/75783954 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7ff41c0b7040 con 0x7ff4280c63c0 2024-01-17T22:58:02.286 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.279+0000 7ff416ffd640 1 -- 172.21.15.190:0/75783954 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff41c0ce430 con 0x7ff4280c63c0 2024-01-17T22:58:02.385 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:02.379+0000 7f240b9be180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-17T22:58:02.432 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.427+0000 7ff416ffd640 1 -- 172.21.15.190:0/75783954 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7ff42814b220 con 0x7ff4280c63c0 2024-01-17T22:58:02.501 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.495+0000 7ff42cdde640 1 -- 172.21.15.190:0/75783954 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d013c8c8-b2d5-4c32-9512-889ec824946b", "id": 0} v 0) v1 -- 0x7ff4280746a0 con 0x7ff4280c63c0 2024-01-17T22:58:02.623 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.619+0000 7ff416ffd640 1 -- 172.21.15.190:0/75783954 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d013c8c8-b2d5-4c32-9512-889ec824946b", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff41c0b5070 con 0x7ff4280c63c0 2024-01-17T22:58:02.624 INFO:teuthology.orchestra.run.smithi190.stdout:0 2024-01-17T22:58:02.626 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.619+0000 7ff42cdde640 1 -- 172.21.15.190:0/75783954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4280c63c0 msgr2=0x7ff42814c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:02.626 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.619+0000 7ff42cdde640 1 --2- 172.21.15.190:0/75783954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4280c63c0 0x7ff42814c2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0b3040 tx=0x7ff41c01ba10 comp rx=0 tx=0).stop 2024-01-17T22:58:02.626 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.619+0000 7ff42cdde640 1 -- 172.21.15.190:0/75783954 shutdown_connections 2024-01-17T22:58:02.626 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.619+0000 7ff42cdde640 1 --2- 172.21.15.190:0/75783954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff428150680 0x7ff42814b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:02.626 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.619+0000 7ff42cdde640 1 --2- 172.21.15.190:0/75783954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4280c7bc0 0x7ff4281ee9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:02.626 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.619+0000 7ff42cdde640 1 --2- 172.21.15.190:0/75783954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4280c63c0 0x7ff42814c2f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:02.626 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.619+0000 7ff42cdde640 1 -- 172.21.15.190:0/75783954 >> 172.21.15.190:0/75783954 conn(0x7ff4280c8260 msgr2=0x7ff428061440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:02.626 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.619+0000 7ff42cdde640 1 -- 172.21.15.190:0/75783954 shutdown_connections 2024-01-17T22:58:02.627 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.619+0000 7ff42cdde640 1 -- 172.21.15.190:0/75783954 wait complete. 2024-01-17T22:58:02.646 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 023339bd-53e4-49ac-b5a1-d24c569229ad 1 2024-01-17T22:58:02.766 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.759+0000 7f797d613640 1 Processor -- start 2024-01-17T22:58:02.766 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.759+0000 7f797d613640 1 -- start start 2024-01-17T22:58:02.767 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.763+0000 7f797d613640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f797815d720 0x7f7978165250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:02.767 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.763+0000 7f797d613640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797806aab0 con 0x7f79781571e0 2024-01-17T22:58:02.767 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.763+0000 7f797d613640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797806b1e0 con 0x7f797806e490 2024-01-17T22:58:02.767 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.763+0000 7f797d613640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797806aff0 con 0x7f797815d720 2024-01-17T22:58:02.767 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.763+0000 7f7976ffd640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f797806e490 0x7f7978156ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:43764/0 (socket says 172.21.15.190:43764) 2024-01-17T22:58:02.768 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.763+0000 7f79777fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f797815d720 0x7f7978165250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:02.768 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.763+0000 7f7976ffd640 1 -- 172.21.15.190:0/1809232756 learned_addr learned my addr 172.21.15.190:0/1809232756 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-01-17T22:58:02.771 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.767+0000 7f7975ffb640 1 -- 172.21.15.190:0/1809232756 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516069538 0 0) 0x7f797806aab0 con 0x7f79781571e0 2024-01-17T22:58:02.771 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.767+0000 7f7975ffb640 1 -- 172.21.15.190:0/1809232756 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7960003530 con 0x7f79781571e0 2024-01-17T22:58:02.771 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.767+0000 7f7975ffb640 1 -- 172.21.15.190:0/1809232756 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237137679 0 0) 0x7f797806b1e0 con 0x7f797806e490 2024-01-17T22:58:02.771 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.767+0000 7f7975ffb640 1 -- 172.21.15.190:0/1809232756 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f797806aab0 con 0x7f797806e490 2024-01-17T22:58:02.771 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.767+0000 7f79777fe640 1 -- 172.21.15.190:0/1809232756 >> v1:172.21.15.190:6789/0 conn(0x7f797806e490 legacy=0x7f7978156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:02.771 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.767+0000 7f79777fe640 1 -- 172.21.15.190:0/1809232756 >> v1:172.21.15.161:6789/0 conn(0x7f79781571e0 legacy=0x7f797815d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:02.771 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.767+0000 7f79777fe640 1 -- 172.21.15.190:0/1809232756 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797806b4c0 con 0x7f797815d720 2024-01-17T22:58:02.776 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.771+0000 7f79777fe640 1 --2- 172.21.15.190:0/1809232756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f797815d720 0x7f7978165250 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f79680097f0 tx=0x7f796801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52b39f48526f7fe3 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:02.823 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.819+0000 7f7975ffb640 1 -- 172.21.15.190:0/1809232756 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79680aa620 con 0x7f797815d720 2024-01-17T22:58:02.823 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.819+0000 7f7975ffb640 1 -- 172.21.15.190:0/1809232756 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79680aa780 con 0x7f797815d720 2024-01-17T22:58:02.824 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.819+0000 7f7975ffb640 1 -- 172.21.15.190:0/1809232756 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79680aab10 con 0x7f797815d720 2024-01-17T22:58:02.824 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.819+0000 7f797d613640 1 -- 172.21.15.190:0/1809232756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f797815d720 msgr2=0x7f7978165250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:02.824 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.819+0000 7f797d613640 1 --2- 172.21.15.190:0/1809232756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f797815d720 0x7f7978165250 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f79680097f0 tx=0x7f796801c4c0 comp rx=0 tx=0).stop 2024-01-17T22:58:02.824 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.819+0000 7f797d613640 1 -- 172.21.15.190:0/1809232756 shutdown_connections 2024-01-17T22:58:02.825 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.819+0000 7f797d613640 1 --2- 172.21.15.190:0/1809232756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f797815d720 0x7f7978165250 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:02.825 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.819+0000 7f797d613640 1 -- 172.21.15.190:0/1809232756 >> 172.21.15.190:0/1809232756 conn(0x7f79780617e0 msgr2=0x7f7978072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:02.825 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.819+0000 7f797d613640 1 -- 172.21.15.190:0/1809232756 shutdown_connections 2024-01-17T22:58:02.825 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.819+0000 7f797d613640 1 -- 172.21.15.190:0/1809232756 wait complete. 2024-01-17T22:58:02.826 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.819+0000 7f797d613640 1 Processor -- start 2024-01-17T22:58:02.826 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.819+0000 7f797d613640 1 -- start start 2024-01-17T22:58:02.826 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.823+0000 7f797d613640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f797806e490 0x7f79780ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:02.826 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.823+0000 7f797d613640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79781571e0 0x7f79781f2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:02.827 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.823+0000 7f797d613640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f797815d720 0x7f79781428d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:02.827 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.823+0000 7f797d613640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79781f2a50 con 0x7f797806e490 2024-01-17T22:58:02.827 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.823+0000 7f797d613640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7978146fb0 con 0x7f79781571e0 2024-01-17T22:58:02.827 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.823+0000 7f797d613640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797815cb00 con 0x7f797815d720 2024-01-17T22:58:02.827 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.823+0000 7f7976ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f797806e490 0x7f79780ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:02.827 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.823+0000 7f79767fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79781571e0 0x7f79781f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:02.827 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.823+0000 7f7976ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f797806e490 0x7f79780ca900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.190:54834/0 (socket says 172.21.15.190:54834) 2024-01-17T22:58:02.827 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.823+0000 7f7976ffd640 1 -- 172.21.15.190:0/4272538987 learned_addr learned my addr 172.21.15.190:0/4272538987 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-01-17T22:58:02.830 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:02.830+0000 7f5c9909b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-17T22:58:02.831 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.827+0000 7f7976ffd640 1 -- 172.21.15.190:0/4272538987 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f797815d720 msgr2=0x7f79781428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:02.831 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.827+0000 7f7976ffd640 1 --2- 172.21.15.190:0/4272538987 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f797815d720 0x7f79781428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:02.831 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.827+0000 7f7976ffd640 1 -- 172.21.15.190:0/4272538987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79781571e0 msgr2=0x7f79781f2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:02.831 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.827+0000 7f7976ffd640 1 --2- 172.21.15.190:0/4272538987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79781571e0 0x7f79781f2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:02.831 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.827+0000 7f7976ffd640 1 -- 172.21.15.190:0/4272538987 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7968009420 con 0x7f797806e490 2024-01-17T22:58:02.833 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.827+0000 7f7976ffd640 1 --2- 172.21.15.190:0/4272538987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f797806e490 0x7f79780ca900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f797000c480 tx=0x7f797000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:02.837 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.831+0000 7f795f7fe640 1 -- 172.21.15.190:0/4272538987 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7970005cf0 con 0x7f797806e490 2024-01-17T22:58:02.837 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.831+0000 7f795f7fe640 1 -- 172.21.15.190:0/4272538987 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7970005e50 con 0x7f797806e490 2024-01-17T22:58:02.837 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.831+0000 7f795f7fe640 1 -- 172.21.15.190:0/4272538987 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79700072f0 con 0x7f797806e490 2024-01-17T22:58:02.837 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.831+0000 7f797d613640 1 -- 172.21.15.190:0/4272538987 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7978147a80 con 0x7f797806e490 2024-01-17T22:58:02.837 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.831+0000 7f797d613640 1 -- 172.21.15.190:0/4272538987 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79781474c0 con 0x7f797806e490 2024-01-17T22:58:02.838 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.831+0000 7f797d613640 1 -- 172.21.15.190:0/4272538987 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79780746a0 con 0x7f797806e490 2024-01-17T22:58:02.893 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:02.894+0000 7f5c9909b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-17T22:58:02.932 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.927+0000 7f795f7fe640 1 -- 172.21.15.190:0/4272538987 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f797001c440 con 0x7f797806e490 2024-01-17T22:58:02.936 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.931+0000 7f795f7fe640 1 -- 172.21.15.190:0/4272538987 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f7970012b00 con 0x7f797806e490 2024-01-17T22:58:02.942 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:02.935+0000 7f795f7fe640 1 -- 172.21.15.190:0/4272538987 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f7970017070 con 0x7f797806e490 2024-01-17T22:58:02.956 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:02.954+0000 7f5c9909b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-17T22:58:02.964 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:02.959+0000 7f240b9be180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-17T22:58:03.013 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.007+0000 7f797d613640 1 -- 172.21.15.190:0/4272538987 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "023339bd-53e4-49ac-b5a1-d24c569229ad", "id": 1} v 0) v1 -- 0x7f79780c7430 con 0x7f797806e490 2024-01-17T22:58:03.021 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:03.015+0000 7f240b9be180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-17T22:58:03.049 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:03.050+0000 7f5c9909b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-17T22:58:03.078 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:03.071+0000 7f240b9be180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-17T22:58:03.083 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.079+0000 7f795f7fe640 1 -- 172.21.15.190:0/4272538987 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "023339bd-53e4-49ac-b5a1-d24c569229ad", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f797001c8d0 con 0x7f797806e490 2024-01-17T22:58:03.083 INFO:teuthology.orchestra.run.smithi190.stdout:1 2024-01-17T22:58:03.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.079+0000 7f797d613640 1 -- 172.21.15.190:0/4272538987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f797806e490 msgr2=0x7f79780ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:03.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.079+0000 7f797d613640 1 --2- 172.21.15.190:0/4272538987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f797806e490 0x7f79780ca900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f797000c480 tx=0x7f797000c940 comp rx=0 tx=0).stop 2024-01-17T22:58:03.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.079+0000 7f797d613640 1 -- 172.21.15.190:0/4272538987 shutdown_connections 2024-01-17T22:58:03.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.079+0000 7f797d613640 1 --2- 172.21.15.190:0/4272538987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79781571e0 0x7f79781f2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.079+0000 7f797d613640 1 --2- 172.21.15.190:0/4272538987 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f797815d720 0x7f79781428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.079+0000 7f797d613640 1 --2- 172.21.15.190:0/4272538987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f797806e490 0x7f79780ca900 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.079+0000 7f797d613640 1 -- 172.21.15.190:0/4272538987 >> 172.21.15.190:0/4272538987 conn(0x7f79780617e0 msgr2=0x7f7978154ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:03.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.079+0000 7f797d613640 1 -- 172.21.15.190:0/4272538987 shutdown_connections 2024-01-17T22:58:03.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.079+0000 7f797d613640 1 -- 172.21.15.190:0/4272538987 wait complete. 2024-01-17T22:58:03.110 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 627dc52e-6bf8-4845-91b2-d9f2cb1be607 2 2024-01-17T22:58:03.113 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:03.114+0000 7f5c9909b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-17T22:58:03.163 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:03.159+0000 7f240b9be180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-17T22:58:03.202 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:03.202+0000 7f5c9909b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-17T22:58:03.216 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:03.211+0000 7f240b9be180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-17T22:58:03.229 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.223+0000 7f731369b640 1 Processor -- start 2024-01-17T22:58:03.230 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.223+0000 7f731369b640 1 -- start start 2024-01-17T22:58:03.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.227+0000 7f731369b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f730c0c3820 0x7f730c156e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:03.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.227+0000 7f731369b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f730c0c3c00 0x7f730c157380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:03.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.227+0000 7f731369b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730c0c62d0 con 0x7f730c0c7ef0 2024-01-17T22:58:03.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.227+0000 7f731369b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730c0c5e80 con 0x7f730c0c3c00 2024-01-17T22:58:03.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.227+0000 7f731369b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730c156710 con 0x7f730c0c3820 2024-01-17T22:58:03.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.227+0000 7f7311437640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f730c0c3820 0x7f730c156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:03.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.227+0000 7f7311437640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f730c0c3820 0x7f730c156e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:33096/0 (socket says 172.21.15.190:33096) 2024-01-17T22:58:03.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.227+0000 7f7311437640 1 -- 172.21.15.190:0/3220072132 learned_addr learned my addr 172.21.15.190:0/3220072132 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-01-17T22:58:03.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.227+0000 7f7310c36640 1 --2- 172.21.15.190:0/3220072132 >> v2:172.21.15.161:3300/0 conn(0x7f730c0c3c00 0x7f730c157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:03.234 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.227+0000 7f7311437640 1 -- 172.21.15.190:0/3220072132 >> v2:172.21.15.161:3300/0 conn(0x7f730c0c3c00 msgr2=0x7f730c157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:03.234 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.227+0000 7f7311437640 1 --2- 172.21.15.190:0/3220072132 >> v2:172.21.15.161:3300/0 conn(0x7f730c0c3c00 0x7f730c157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.234 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.227+0000 7f7311437640 1 -- 172.21.15.190:0/3220072132 >> v1:172.21.15.161:6789/0 conn(0x7f730c0c7ef0 legacy=0x7f730c1505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:03.234 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.227+0000 7f7311437640 1 -- 172.21.15.190:0/3220072132 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c1569b0 con 0x7f730c0c3820 2024-01-17T22:58:03.237 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.231+0000 7f7311437640 1 --2- 172.21.15.190:0/3220072132 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f730c0c3820 0x7f730c156e40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7308009870 tx=0x7f730801ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7921207b77345ab1 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:03.243 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f7303fff640 1 -- 172.21.15.190:0/3220072132 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73080a8a30 con 0x7f730c0c3820 2024-01-17T22:58:03.243 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f7303fff640 1 -- 172.21.15.190:0/3220072132 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73080a8b90 con 0x7f730c0c3820 2024-01-17T22:58:03.243 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f7303fff640 1 -- 172.21.15.190:0/3220072132 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73080b0440 con 0x7f730c0c3820 2024-01-17T22:58:03.244 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f731369b640 1 -- 172.21.15.190:0/3220072132 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f730c0c3820 msgr2=0x7f730c156e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:03.244 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f731369b640 1 --2- 172.21.15.190:0/3220072132 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f730c0c3820 0x7f730c156e40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7308009870 tx=0x7f730801ed30 comp rx=0 tx=0).stop 2024-01-17T22:58:03.244 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f731369b640 1 -- 172.21.15.190:0/3220072132 shutdown_connections 2024-01-17T22:58:03.244 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f731369b640 1 --2- 172.21.15.190:0/3220072132 >> v2:172.21.15.161:3300/0 conn(0x7f730c0c3c00 0x7f730c157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.244 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f731369b640 1 --2- 172.21.15.190:0/3220072132 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f730c0c3820 0x7f730c156e40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.244 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f731369b640 1 -- 172.21.15.190:0/3220072132 >> 172.21.15.190:0/3220072132 conn(0x7f730c0c83d0 msgr2=0x7f730c0c87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:03.244 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f731369b640 1 -- 172.21.15.190:0/3220072132 shutdown_connections 2024-01-17T22:58:03.244 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f731369b640 1 -- 172.21.15.190:0/3220072132 wait complete. 2024-01-17T22:58:03.245 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f731369b640 1 Processor -- start 2024-01-17T22:58:03.245 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f731369b640 1 -- start start 2024-01-17T22:58:03.246 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f731369b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f730c0c3820 0x7f730c144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:03.246 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f731369b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f730c0c3c00 0x7f730c1447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:03.246 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f731369b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f730c0c7ef0 0x7f730c1f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:03.246 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f731369b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c153150 con 0x7f730c0c3c00 2024-01-17T22:58:03.246 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f731369b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c1416b0 con 0x7f730c0c3820 2024-01-17T22:58:03.246 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f731369b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730c145430 con 0x7f730c0c7ef0 2024-01-17T22:58:03.246 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.239+0000 7f7311c38640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f730c0c7ef0 0x7f730c1f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:03.246 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.243+0000 7f7311437640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f730c0c3820 0x7f730c144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:03.247 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.243+0000 7f7310c36640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f730c0c3c00 0x7f730c1447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:03.247 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.243+0000 7f7311c38640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f730c0c7ef0 0x7f730c1f2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:33104/0 (socket says 172.21.15.190:33104) 2024-01-17T22:58:03.247 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.243+0000 7f7311c38640 1 -- 172.21.15.190:0/1077758286 learned_addr learned my addr 172.21.15.190:0/1077758286 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-01-17T22:58:03.250 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.243+0000 7f7310c36640 1 -- 172.21.15.190:0/1077758286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f730c0c7ef0 msgr2=0x7f730c1f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:03.250 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.243+0000 7f7310c36640 1 --2- 172.21.15.190:0/1077758286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f730c0c7ef0 0x7f730c1f2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.250 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.243+0000 7f7310c36640 1 -- 172.21.15.190:0/1077758286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f730c0c3820 msgr2=0x7f730c144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:03.250 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.243+0000 7f7310c36640 1 --2- 172.21.15.190:0/1077758286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f730c0c3820 0x7f730c144280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.250 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.243+0000 7f7310c36640 1 -- 172.21.15.190:0/1077758286 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73080094d0 con 0x7f730c0c3c00 2024-01-17T22:58:03.252 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.247+0000 7f7310c36640 1 --2- 172.21.15.190:0/1077758286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f730c0c3c00 0x7f730c1447c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00e840 tx=0x7f72fc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:03.256 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.251+0000 7f7301ffb640 1 -- 172.21.15.190:0/1077758286 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc00c940 con 0x7f730c0c3c00 2024-01-17T22:58:03.256 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.251+0000 7f7301ffb640 1 -- 172.21.15.190:0/1077758286 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc00caa0 con 0x7f730c0c3c00 2024-01-17T22:58:03.256 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.251+0000 7f731369b640 1 -- 172.21.15.190:0/1077758286 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730c141970 con 0x7f730c0c3c00 2024-01-17T22:58:03.256 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.251+0000 7f7301ffb640 1 -- 172.21.15.190:0/1077758286 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc00ce10 con 0x7f730c0c3c00 2024-01-17T22:58:03.256 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.251+0000 7f731369b640 1 -- 172.21.15.190:0/1077758286 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730c143d60 con 0x7f730c0c3c00 2024-01-17T22:58:03.257 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.251+0000 7f731369b640 1 -- 172.21.15.190:0/1077758286 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730c143f20 con 0x7f730c0c3c00 2024-01-17T22:58:03.263 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:03.262+0000 7f5c9909b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-17T22:58:03.298 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:03.291+0000 7f240b9be180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-17T22:58:03.348 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:03.343+0000 7f240b9be180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-17T22:58:03.351 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.347+0000 7f7301ffb640 1 -- 172.21.15.190:0/1077758286 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f72fc0059a0 con 0x7f730c0c3c00 2024-01-17T22:58:03.355 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.351+0000 7f7301ffb640 1 -- 172.21.15.190:0/1077758286 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f72fc013890 con 0x7f730c0c3c00 2024-01-17T22:58:03.357 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.351+0000 7f7301ffb640 1 -- 172.21.15.190:0/1077758286 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f72fc021060 con 0x7f730c0c3c00 2024-01-17T22:58:03.419 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:03.418+0000 7f5c9909b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-17T22:58:03.432 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.427+0000 7f731369b640 1 -- 172.21.15.190:0/1077758286 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "627dc52e-6bf8-4845-91b2-d9f2cb1be607", "id": 2} v 0) v1 -- 0x7f730c0746a0 con 0x7f730c0c3c00 2024-01-17T22:58:03.489 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.483+0000 7f7301ffb640 1 -- 172.21.15.190:0/1077758286 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "627dc52e-6bf8-4845-91b2-d9f2cb1be607", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f72fc017070 con 0x7f730c0c3c00 2024-01-17T22:58:03.489 INFO:teuthology.orchestra.run.smithi190.stdout:2 2024-01-17T22:58:03.491 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.487+0000 7f731369b640 1 -- 172.21.15.190:0/1077758286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f730c0c3c00 msgr2=0x7f730c1447c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:03.491 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.487+0000 7f731369b640 1 --2- 172.21.15.190:0/1077758286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f730c0c3c00 0x7f730c1447c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00e840 tx=0x7f72fc00ed00 comp rx=0 tx=0).stop 2024-01-17T22:58:03.491 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.487+0000 7f731369b640 1 -- 172.21.15.190:0/1077758286 shutdown_connections 2024-01-17T22:58:03.491 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.487+0000 7f731369b640 1 --2- 172.21.15.190:0/1077758286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f730c0c7ef0 0x7f730c1f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.491 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.487+0000 7f731369b640 1 --2- 172.21.15.190:0/1077758286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f730c0c3c00 0x7f730c1447c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.491 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.487+0000 7f731369b640 1 --2- 172.21.15.190:0/1077758286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f730c0c3820 0x7f730c144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.491 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.487+0000 7f731369b640 1 -- 172.21.15.190:0/1077758286 >> 172.21.15.190:0/1077758286 conn(0x7f730c0c83d0 msgr2=0x7f730c06fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:03.492 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.487+0000 7f731369b640 1 -- 172.21.15.190:0/1077758286 shutdown_connections 2024-01-17T22:58:03.492 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.487+0000 7f731369b640 1 -- 172.21.15.190:0/1077758286 wait complete. 2024-01-17T22:58:03.493 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:03.494+0000 7f5c9909b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-17T22:58:03.493 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:03.487+0000 7f240b9be180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-17T22:58:03.509 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 61318d5c-4ff3-4e73-92aa-a7bb2e5ab996 3 2024-01-17T22:58:03.564 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:03.559+0000 7f240b9be180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-17T22:58:03.617 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.611+0000 7f0726cd6640 1 Processor -- start 2024-01-17T22:58:03.618 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.611+0000 7f0726cd6640 1 -- start start 2024-01-17T22:58:03.619 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.615+0000 7f0726cd6640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f072014fed0 0x7f07200c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:03.619 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.615+0000 7f0726cd6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07200c57d0 0x7f07200c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:03.619 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.615+0000 7f0726cd6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0720155e10 con 0x7f0720072670 2024-01-17T22:58:03.619 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.615+0000 7f0726cd6640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07200c3c70 con 0x7f072014fed0 2024-01-17T22:58:03.619 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.615+0000 7f0726cd6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0720156c30 con 0x7f07200c57d0 2024-01-17T22:58:03.620 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.615+0000 7f0725273640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07200c57d0 0x7f07200c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:03.620 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.615+0000 7f071ffff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f0720072670 0x7f07200c50c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:58460/0 (socket says 172.21.15.190:58460) 2024-01-17T22:58:03.620 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.615+0000 7f071ffff640 1 -- 172.21.15.190:0/3036086602 learned_addr learned my addr 172.21.15.190:0/3036086602 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-01-17T22:58:03.620 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.615+0000 7f0724a72640 1 --2- 172.21.15.190:0/3036086602 >> v2:172.21.15.161:3300/0 conn(0x7f072014fed0 0x7f07200c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:03.622 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.619+0000 7f0724a72640 1 -- 172.21.15.190:0/3036086602 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07200c57d0 msgr2=0x7f07200c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:03.622 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.619+0000 7f0724a72640 1 --2- 172.21.15.190:0/3036086602 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07200c57d0 0x7f07200c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.623 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.619+0000 7f0724a72640 1 -- 172.21.15.190:0/3036086602 >> v1:172.21.15.190:6789/0 conn(0x7f0720072670 legacy=0x7f07200c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:03.623 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.619+0000 7f0724a72640 1 -- 172.21.15.190:0/3036086602 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07201560b0 con 0x7f072014fed0 2024-01-17T22:58:03.626 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.619+0000 7f0724a72640 1 --2- 172.21.15.190:0/3036086602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f072014fed0 0x7f07200c62d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f07140097c0 tx=0x7f071401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe0e143aa4a0dbb server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:03.630 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.623+0000 7f071f7fe640 1 -- 172.21.15.190:0/3036086602 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07140ab400 con 0x7f072014fed0 2024-01-17T22:58:03.630 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.623+0000 7f071f7fe640 1 -- 172.21.15.190:0/3036086602 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07140a7050 con 0x7f072014fed0 2024-01-17T22:58:03.630 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.623+0000 7f071f7fe640 1 -- 172.21.15.190:0/3036086602 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07140ab780 con 0x7f072014fed0 2024-01-17T22:58:03.631 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f0726cd6640 1 -- 172.21.15.190:0/3036086602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f072014fed0 msgr2=0x7f07200c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:03.631 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f0726cd6640 1 --2- 172.21.15.190:0/3036086602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f072014fed0 0x7f07200c62d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f07140097c0 tx=0x7f071401c3f0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.631 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f0726cd6640 1 -- 172.21.15.190:0/3036086602 shutdown_connections 2024-01-17T22:58:03.631 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f0726cd6640 1 --2- 172.21.15.190:0/3036086602 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07200c57d0 0x7f07200c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.631 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f0726cd6640 1 --2- 172.21.15.190:0/3036086602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f072014fed0 0x7f07200c62d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.631 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f0726cd6640 1 -- 172.21.15.190:0/3036086602 >> 172.21.15.190:0/3036086602 conn(0x7f0720071b50 msgr2=0x7f0720071f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:03.631 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f0726cd6640 1 -- 172.21.15.190:0/3036086602 shutdown_connections 2024-01-17T22:58:03.631 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f0726cd6640 1 -- 172.21.15.190:0/3036086602 wait complete. 2024-01-17T22:58:03.632 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f0726cd6640 1 Processor -- start 2024-01-17T22:58:03.632 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f0726cd6640 1 -- start start 2024-01-17T22:58:03.633 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f0726cd6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0720072670 0x7f0720154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:03.634 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f0726cd6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07200c57d0 0x7f0720149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:03.634 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f0726cd6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f072014fed0 0x7f072014bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:03.634 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f0726cd6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072014db60 con 0x7f072014fed0 2024-01-17T22:58:03.634 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f0726cd6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072014df80 con 0x7f0720072670 2024-01-17T22:58:03.634 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f0726cd6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0720149d20 con 0x7f07200c57d0 2024-01-17T22:58:03.634 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f071ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07200c57d0 0x7f0720149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:03.634 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f0725273640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f072014fed0 0x7f072014bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:03.634 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f0724a72640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0720072670 0x7f0720154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:03.634 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f071ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07200c57d0 0x7f0720149fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:33108/0 (socket says 172.21.15.190:33108) 2024-01-17T22:58:03.634 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.627+0000 7f071ffff640 1 -- 172.21.15.190:0/3971594160 learned_addr learned my addr 172.21.15.190:0/3971594160 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-01-17T22:58:03.637 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.631+0000 7f0725273640 1 -- 172.21.15.190:0/3971594160 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07200c57d0 msgr2=0x7f0720149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:03.637 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.631+0000 7f0725273640 1 --2- 172.21.15.190:0/3971594160 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07200c57d0 0x7f0720149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.637 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.631+0000 7f0725273640 1 -- 172.21.15.190:0/3971594160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0720072670 msgr2=0x7f0720154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:03.637 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.631+0000 7f0725273640 1 --2- 172.21.15.190:0/3971594160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0720072670 0x7f0720154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.637 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.631+0000 7f0725273640 1 -- 172.21.15.190:0/3971594160 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0714009420 con 0x7f072014fed0 2024-01-17T22:58:03.639 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.635+0000 7f0725273640 1 --2- 172.21.15.190:0/3971594160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f072014fed0 0x7f072014bc60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f071800efc0 tx=0x7f071800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:03.643 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.639+0000 7f071d7fa640 1 -- 172.21.15.190:0/3971594160 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0718009c00 con 0x7f072014fed0 2024-01-17T22:58:03.643 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.639+0000 7f071d7fa640 1 -- 172.21.15.190:0/3971594160 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071800f040 con 0x7f072014fed0 2024-01-17T22:58:03.643 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.639+0000 7f0726cd6640 1 -- 172.21.15.190:0/3971594160 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0720149760 con 0x7f072014fed0 2024-01-17T22:58:03.643 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.639+0000 7f071d7fa640 1 -- 172.21.15.190:0/3971594160 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07180146c0 con 0x7f072014fed0 2024-01-17T22:58:03.643 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.639+0000 7f0726cd6640 1 -- 172.21.15.190:0/3971594160 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072014d4a0 con 0x7f072014fed0 2024-01-17T22:58:03.644 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.639+0000 7f0726cd6640 1 -- 172.21.15.190:0/3971594160 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072014dca0 con 0x7f072014fed0 2024-01-17T22:58:03.646 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.643+0000 7f071d7fa640 1 -- 172.21.15.190:0/3971594160 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f0718014ba0 con 0x7f072014fed0 2024-01-17T22:58:03.646 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.643+0000 7f071d7fa640 1 -- 172.21.15.190:0/3971594160 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f0718013870 con 0x7f072014fed0 2024-01-17T22:58:03.745 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.739+0000 7f071d7fa640 1 -- 172.21.15.190:0/3971594160 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f071803bcf0 con 0x7f072014fed0 2024-01-17T22:58:03.816 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.811+0000 7f0726cd6640 1 -- 172.21.15.190:0/3971594160 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "61318d5c-4ff3-4e73-92aa-a7bb2e5ab996", "id": 3} v 0) v1 -- 0x7f07200746a0 con 0x7f072014fed0 2024-01-17T22:58:03.883 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.879+0000 7f071d7fa640 1 -- 172.21.15.190:0/3971594160 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "61318d5c-4ff3-4e73-92aa-a7bb2e5ab996", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f071802a030 con 0x7f072014fed0 2024-01-17T22:58:03.884 INFO:teuthology.orchestra.run.smithi190.stdout:3 2024-01-17T22:58:03.906 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.899+0000 7f0726cd6640 1 -- 172.21.15.190:0/3971594160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f072014fed0 msgr2=0x7f072014bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:03.906 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.899+0000 7f0726cd6640 1 --2- 172.21.15.190:0/3971594160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f072014fed0 0x7f072014bc60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f071800efc0 tx=0x7f071800c490 comp rx=0 tx=0).stop 2024-01-17T22:58:03.907 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.903+0000 7f0726cd6640 1 -- 172.21.15.190:0/3971594160 shutdown_connections 2024-01-17T22:58:03.907 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.903+0000 7f0726cd6640 1 --2- 172.21.15.190:0/3971594160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f072014fed0 0x7f072014bc60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.907 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.903+0000 7f0726cd6640 1 --2- 172.21.15.190:0/3971594160 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07200c57d0 0x7f0720149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.907 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.903+0000 7f0726cd6640 1 --2- 172.21.15.190:0/3971594160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0720072670 0x7f0720154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:03.907 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.903+0000 7f0726cd6640 1 -- 172.21.15.190:0/3971594160 >> 172.21.15.190:0/3971594160 conn(0x7f0720071b50 msgr2=0x7f07200c5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:03.907 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.903+0000 7f0726cd6640 1 -- 172.21.15.190:0/3971594160 shutdown_connections 2024-01-17T22:58:03.907 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:03.903+0000 7f0726cd6640 1 -- 172.21.15.190:0/3971594160 wait complete. 2024-01-17T22:58:03.933 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 00613158-a6c9-412f-b658-e348d7b6a1fb 4 2024-01-17T22:58:04.064 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.059+0000 7f11d8516640 1 Processor -- start 2024-01-17T22:58:04.064 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.059+0000 7f11d8516640 1 -- start start 2024-01-17T22:58:04.065 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.059+0000 7f11d8516640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f11d0158200 0x7f11d00c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:04.065 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.059+0000 7f11d8516640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d00c8130 con 0x7f11d0151780 2024-01-17T22:58:04.065 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.059+0000 7f11d8516640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d00c62d0 con 0x7f11d0151b60 2024-01-17T22:58:04.065 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.059+0000 7f11d8516640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d00c6800 con 0x7f11d0158200 2024-01-17T22:58:04.066 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.059+0000 7f11d62b2640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f11d0151780 0x7f11d0157af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.190:41394/0 (socket says 172.21.15.190:41394) 2024-01-17T22:58:04.066 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.059+0000 7f11d62b2640 1 -- 172.21.15.190:0/3684375567 learned_addr learned my addr 172.21.15.190:0/3684375567 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-01-17T22:58:04.066 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.059+0000 7f11d6ab3640 1 --2- 172.21.15.190:0/3684375567 >> v2:172.21.15.190:3300/0 conn(0x7f11d0158200 0x7f11d00c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:04.069 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.063+0000 7f11d52b0640 1 -- 172.21.15.190:0/3684375567 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995317635 0 0) 0x7f11d00c8130 con 0x7f11d0151780 2024-01-17T22:58:04.069 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.063+0000 7f11d52b0640 1 -- 172.21.15.190:0/3684375567 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11bc003530 con 0x7f11d0151780 2024-01-17T22:58:04.069 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.063+0000 7f11d6ab3640 1 -- 172.21.15.190:0/3684375567 >> v1:172.21.15.190:6789/0 conn(0x7f11d0151b60 legacy=0x7f11d00c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:04.069 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.063+0000 7f11d6ab3640 1 -- 172.21.15.190:0/3684375567 >> v1:172.21.15.161:6789/0 conn(0x7f11d0151780 legacy=0x7f11d0157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:04.069 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.063+0000 7f11d6ab3640 1 -- 172.21.15.190:0/3684375567 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d0072670 con 0x7f11d0158200 2024-01-17T22:58:04.073 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.067+0000 7f11d6ab3640 1 --2- 172.21.15.190:0/3684375567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11d0158200 0x7f11d00c70a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f11c80097c0 tx=0x7f11c801ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47b31536dda05565 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:04.078 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.071+0000 7f11d52b0640 1 -- 172.21.15.190:0/3684375567 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c80a8930 con 0x7f11d0158200 2024-01-17T22:58:04.078 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.071+0000 7f11d52b0640 1 -- 172.21.15.190:0/3684375567 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c80a8a90 con 0x7f11d0158200 2024-01-17T22:58:04.078 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.071+0000 7f11d52b0640 1 -- 172.21.15.190:0/3684375567 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c80a8e20 con 0x7f11d0158200 2024-01-17T22:58:04.078 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d8516640 1 -- 172.21.15.190:0/3684375567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11d0158200 msgr2=0x7f11d00c70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:04.079 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d8516640 1 --2- 172.21.15.190:0/3684375567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11d0158200 0x7f11d00c70a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f11c80097c0 tx=0x7f11c801ec30 comp rx=0 tx=0).stop 2024-01-17T22:58:04.079 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d8516640 1 -- 172.21.15.190:0/3684375567 shutdown_connections 2024-01-17T22:58:04.079 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d8516640 1 --2- 172.21.15.190:0/3684375567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11d0158200 0x7f11d00c70a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:04.079 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d8516640 1 -- 172.21.15.190:0/3684375567 >> 172.21.15.190:0/3684375567 conn(0x7f11d0071b50 msgr2=0x7f11d0071f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:04.079 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d8516640 1 -- 172.21.15.190:0/3684375567 shutdown_connections 2024-01-17T22:58:04.079 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d8516640 1 -- 172.21.15.190:0/3684375567 wait complete. 2024-01-17T22:58:04.080 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d8516640 1 Processor -- start 2024-01-17T22:58:04.080 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d8516640 1 -- start start 2024-01-17T22:58:04.080 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d8516640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11d0151780 0x7f11d0150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:04.081 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d8516640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11d0151b60 0x7f11d01ed640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:04.081 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d8516640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11d0158200 0x7f11d0151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:04.081 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d8516640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d0153320 con 0x7f11d0151780 2024-01-17T22:58:04.081 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d8516640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d01ece80 con 0x7f11d0158200 2024-01-17T22:58:04.081 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d8516640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d01f08b0 con 0x7f11d0151b60 2024-01-17T22:58:04.081 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d6ab3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11d0158200 0x7f11d0151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:04.082 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d5ab1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11d0151b60 0x7f11d01ed640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:04.082 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d62b2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11d0151780 0x7f11d0150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:04.082 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d5ab1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11d0151b60 0x7f11d01ed640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:33124/0 (socket says 172.21.15.190:33124) 2024-01-17T22:58:04.082 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.075+0000 7f11d5ab1640 1 -- 172.21.15.190:0/217552939 learned_addr learned my addr 172.21.15.190:0/217552939 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-01-17T22:58:04.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.079+0000 7f11d5ab1640 1 -- 172.21.15.190:0/217552939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11d0158200 msgr2=0x7f11d0151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:04.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.079+0000 7f11d5ab1640 1 --2- 172.21.15.190:0/217552939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11d0158200 0x7f11d0151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:04.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.079+0000 7f11d5ab1640 1 -- 172.21.15.190:0/217552939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11d0151780 msgr2=0x7f11d0150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:04.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.079+0000 7f11d5ab1640 1 --2- 172.21.15.190:0/217552939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11d0151780 0x7f11d0150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:04.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.079+0000 7f11d5ab1640 1 -- 172.21.15.190:0/217552939 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c8009420 con 0x7f11d0151b60 2024-01-17T22:58:04.087 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.083+0000 7f11d5ab1640 1 --2- 172.21.15.190:0/217552939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11d0151b60 0x7f11d01ed640 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f11c000c490 tx=0x7f11c0001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:04.089 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.083+0000 7f11c6ffd640 1 -- 172.21.15.190:0/217552939 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c0003600 con 0x7f11d0151b60 2024-01-17T22:58:04.089 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.083+0000 7f11d8516640 1 -- 172.21.15.190:0/217552939 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d01f0b90 con 0x7f11d0151b60 2024-01-17T22:58:04.090 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.083+0000 7f11d8516640 1 -- 172.21.15.190:0/217552939 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d01ed120 con 0x7f11d0151b60 2024-01-17T22:58:04.090 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.087+0000 7f11d8516640 1 -- 172.21.15.190:0/217552939 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d00c8200 con 0x7f11d0151b60 2024-01-17T22:58:04.091 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.087+0000 7f11c6ffd640 1 -- 172.21.15.190:0/217552939 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c0001130 con 0x7f11d0151b60 2024-01-17T22:58:04.091 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.087+0000 7f11c6ffd640 1 -- 172.21.15.190:0/217552939 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c0007230 con 0x7f11d0151b60 2024-01-17T22:58:04.133 INFO:tasks.ceph.mgr.y.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-17T22:58:04.133 INFO:tasks.ceph.mgr.y.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-17T22:58:04.133 INFO:tasks.ceph.mgr.y.smithi161.stderr: from numpy import show_config as show_numpy_config 2024-01-17T22:58:04.205 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:04.206+0000 7f5c9909b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-17T22:58:04.217 INFO:tasks.ceph.mgr.x.smithi190.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-17T22:58:04.217 INFO:tasks.ceph.mgr.x.smithi190.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-17T22:58:04.218 INFO:tasks.ceph.mgr.x.smithi190.stderr: from numpy import show_config as show_numpy_config 2024-01-17T22:58:04.257 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:04.251+0000 7f240b9be180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-17T22:58:04.329 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.323+0000 7f11c6ffd640 1 -- 172.21.15.190:0/217552939 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f11c00067a0 con 0x7f11d0151b60 2024-01-17T22:58:04.329 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.323+0000 7f11c6ffd640 1 -- 172.21.15.190:0/217552939 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f11c0012910 con 0x7f11d0151b60 2024-01-17T22:58:04.329 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.323+0000 7f11c6ffd640 1 -- 172.21.15.190:0/217552939 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f11c0021060 con 0x7f11d0151b60 2024-01-17T22:58:04.340 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:04.338+0000 7f5c9909b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-17T22:58:04.467 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:04.463+0000 7f240b9be180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-17T22:58:04.471 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.467+0000 7f11d8516640 1 -- 172.21.15.190:0/217552939 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00613158-a6c9-412f-b658-e348d7b6a1fb", "id": 4} v 0) v1 -- 0x7f11d01ed310 con 0x7f11d0151b60 2024-01-17T22:58:04.507 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:04.506+0000 7f5c9909b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-17T22:58:04.582 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:04.582+0000 7f5c9909b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-17T22:58:04.644 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.639+0000 7f11c6ffd640 1 -- 172.21.15.190:0/217552939 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00613158-a6c9-412f-b658-e348d7b6a1fb", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f11c0017070 con 0x7f11d0151b60 2024-01-17T22:58:04.644 INFO:teuthology.orchestra.run.smithi190.stdout:4 2024-01-17T22:58:04.646 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.639+0000 7f11d8516640 1 -- 172.21.15.190:0/217552939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11d0151b60 msgr2=0x7f11d01ed640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:04.646 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.639+0000 7f11d8516640 1 --2- 172.21.15.190:0/217552939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11d0151b60 0x7f11d01ed640 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f11c000c490 tx=0x7f11c0001e80 comp rx=0 tx=0).stop 2024-01-17T22:58:04.646 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.639+0000 7f11d8516640 1 -- 172.21.15.190:0/217552939 shutdown_connections 2024-01-17T22:58:04.646 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.639+0000 7f11d8516640 1 --2- 172.21.15.190:0/217552939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11d0158200 0x7f11d0151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:04.646 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.639+0000 7f11d8516640 1 --2- 172.21.15.190:0/217552939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11d0151b60 0x7f11d01ed640 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:04.646 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.639+0000 7f11d8516640 1 --2- 172.21.15.190:0/217552939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11d0151780 0x7f11d0150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:04.646 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.639+0000 7f11d8516640 1 -- 172.21.15.190:0/217552939 >> 172.21.15.190:0/217552939 conn(0x7f11d0071b50 msgr2=0x7f11d006a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:04.646 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.639+0000 7f11d8516640 1 -- 172.21.15.190:0/217552939 shutdown_connections 2024-01-17T22:58:04.646 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.639+0000 7f11d8516640 1 -- 172.21.15.190:0/217552939 wait complete. 2024-01-17T22:58:04.668 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new d2db9779-83a1-4339-9f78-3a46875ce3fa 5 2024-01-17T22:58:04.679 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:04.675+0000 7f240b9be180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-17T22:58:04.720 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:04.722+0000 7f5c9909b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-17T22:58:04.749 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:04.743+0000 7f240b9be180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-17T22:58:04.791 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.787+0000 7efec6592640 1 Processor -- start 2024-01-17T22:58:04.791 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.787+0000 7efec6592640 1 -- start start 2024-01-17T22:58:04.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.787+0000 7efec6592640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec00c84c0 0x7efec006a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:04.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.787+0000 7efec6592640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efec0157c20 0x7efec0158090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:04.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.787+0000 7efec6592640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec0157770 con 0x7efec0151810 2024-01-17T22:58:04.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.787+0000 7efec6592640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec00c3ae0 con 0x7efec0157c20 2024-01-17T22:58:04.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.787+0000 7efec6592640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec00c89b0 con 0x7efec00c84c0 2024-01-17T22:58:04.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.787+0000 7efebf7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec00c84c0 0x7efec006a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:04.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.787+0000 7efebf7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec00c84c0 0x7efec006a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:33138/0 (socket says 172.21.15.190:33138) 2024-01-17T22:58:04.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.787+0000 7efebf7fe640 1 -- 172.21.15.190:0/1544036636 learned_addr learned my addr 172.21.15.190:0/1544036636 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-01-17T22:58:04.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.787+0000 7efec4b2f640 1 --2- 172.21.15.190:0/1544036636 >> v2:172.21.15.161:3300/0 conn(0x7efec0157c20 0x7efec0158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:04.796 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.791+0000 7efebf7fe640 1 -- 172.21.15.190:0/1544036636 >> v2:172.21.15.161:3300/0 conn(0x7efec0157c20 msgr2=0x7efec0158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:04.796 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.791+0000 7efebf7fe640 1 --2- 172.21.15.190:0/1544036636 >> v2:172.21.15.161:3300/0 conn(0x7efec0157c20 0x7efec0158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:04.796 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.791+0000 7efebf7fe640 1 -- 172.21.15.190:0/1544036636 >> v1:172.21.15.161:6789/0 conn(0x7efec0151810 legacy=0x7efec00c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:04.796 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.791+0000 7efebf7fe640 1 -- 172.21.15.190:0/1544036636 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec01585d0 con 0x7efec00c84c0 2024-01-17T22:58:04.799 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.795+0000 7efebf7fe640 1 --2- 172.21.15.190:0/1544036636 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec00c84c0 0x7efec006a6e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009870 tx=0x7efeb401ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4922d7abf870ad56 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:04.805 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.799+0000 7efebeffd640 1 -- 172.21.15.190:0/1544036636 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb40a8a30 con 0x7efec00c84c0 2024-01-17T22:58:04.805 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.799+0000 7efebeffd640 1 -- 172.21.15.190:0/1544036636 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb40a8b90 con 0x7efec00c84c0 2024-01-17T22:58:04.805 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.799+0000 7efebeffd640 1 -- 172.21.15.190:0/1544036636 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb40b0440 con 0x7efec00c84c0 2024-01-17T22:58:04.806 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.799+0000 7efec6592640 1 -- 172.21.15.190:0/1544036636 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec00c84c0 msgr2=0x7efec006a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:04.806 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.799+0000 7efec6592640 1 --2- 172.21.15.190:0/1544036636 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec00c84c0 0x7efec006a6e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009870 tx=0x7efeb401ed30 comp rx=0 tx=0).stop 2024-01-17T22:58:04.806 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.799+0000 7efec6592640 1 -- 172.21.15.190:0/1544036636 shutdown_connections 2024-01-17T22:58:04.806 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.799+0000 7efec6592640 1 --2- 172.21.15.190:0/1544036636 >> v2:172.21.15.161:3300/0 conn(0x7efec0157c20 0x7efec0158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:04.806 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.799+0000 7efec6592640 1 --2- 172.21.15.190:0/1544036636 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec00c84c0 0x7efec006a6e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:04.806 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.799+0000 7efec6592640 1 -- 172.21.15.190:0/1544036636 >> 172.21.15.190:0/1544036636 conn(0x7efec00617e0 msgr2=0x7efec0072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:04.806 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.799+0000 7efec6592640 1 -- 172.21.15.190:0/1544036636 shutdown_connections 2024-01-17T22:58:04.807 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.799+0000 7efec6592640 1 -- 172.21.15.190:0/1544036636 wait complete. 2024-01-17T22:58:04.807 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.803+0000 7efec6592640 1 Processor -- start 2024-01-17T22:58:04.807 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.803+0000 7efec6592640 1 -- start start 2024-01-17T22:58:04.808 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.803+0000 7efec6592640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec00c84c0 0x7efec00c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:04.808 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.803+0000 7efec6592640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efec0151810 0x7efec00cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:04.808 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.803+0000 7efec6592640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec0157c20 0x7efec00cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:04.808 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.803+0000 7efec6592640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec00c2e90 con 0x7efec0151810 2024-01-17T22:58:04.808 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.803+0000 7efec6592640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec01ef9f0 con 0x7efec0157c20 2024-01-17T22:58:04.808 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.803+0000 7efec6592640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec00c1450 con 0x7efec00c84c0 2024-01-17T22:58:04.809 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.803+0000 7efebffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec00c84c0 0x7efec00c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:04.809 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.803+0000 7efebf7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efec0151810 0x7efec00cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:04.809 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.803+0000 7efebffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec00c84c0 0x7efec00c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:33140/0 (socket says 172.21.15.190:33140) 2024-01-17T22:58:04.809 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.803+0000 7efebffff640 1 -- 172.21.15.190:0/1056845155 learned_addr learned my addr 172.21.15.190:0/1056845155 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-01-17T22:58:04.809 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.803+0000 7efec4b2f640 1 --2- 172.21.15.190:0/1056845155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec0157c20 0x7efec00cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:04.812 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.807+0000 7efebf7fe640 1 -- 172.21.15.190:0/1056845155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec00c84c0 msgr2=0x7efec00c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:04.813 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.807+0000 7efebf7fe640 1 --2- 172.21.15.190:0/1056845155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec00c84c0 0x7efec00c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:04.813 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.807+0000 7efebf7fe640 1 -- 172.21.15.190:0/1056845155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec0157c20 msgr2=0x7efec00cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:04.813 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.807+0000 7efebf7fe640 1 --2- 172.21.15.190:0/1056845155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec0157c20 0x7efec00cca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:04.813 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.807+0000 7efebf7fe640 1 -- 172.21.15.190:0/1056845155 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb40094d0 con 0x7efec0151810 2024-01-17T22:58:04.814 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.811+0000 7efebf7fe640 1 --2- 172.21.15.190:0/1056845155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efec0151810 0x7efec00cc540 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efeb40af000 tx=0x7efeb401bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:04.819 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.815+0000 7efebcff9640 1 -- 172.21.15.190:0/1056845155 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb40be070 con 0x7efec0151810 2024-01-17T22:58:04.819 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.815+0000 7efebcff9640 1 -- 172.21.15.190:0/1056845155 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb40ba400 con 0x7efec0151810 2024-01-17T22:58:04.819 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.815+0000 7efec6592640 1 -- 172.21.15.190:0/1056845155 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec00c11b0 con 0x7efec0151810 2024-01-17T22:58:04.819 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.815+0000 7efebcff9640 1 -- 172.21.15.190:0/1056845155 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb40ba7d0 con 0x7efec0151810 2024-01-17T22:58:04.819 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.815+0000 7efec6592640 1 -- 172.21.15.190:0/1056845155 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec01ef680 con 0x7efec0151810 2024-01-17T22:58:04.820 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.815+0000 7efec6592640 1 -- 172.21.15.190:0/1056845155 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec01ef1f0 con 0x7efec0151810 2024-01-17T22:58:04.822 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.815+0000 7efebcff9640 1 -- 172.21.15.190:0/1056845155 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7efeb40bacb0 con 0x7efec0151810 2024-01-17T22:58:04.822 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.815+0000 7efebcff9640 1 -- 172.21.15.190:0/1056845155 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7efeb40c2940 con 0x7efec0151810 2024-01-17T22:58:04.890 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:04.883+0000 7f240b9be180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-17T22:58:04.921 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:04.915+0000 7efebcff9640 1 -- 172.21.15.190:0/1056845155 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7efeb40b5070 con 0x7efec0151810 2024-01-17T22:58:05.056 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.051+0000 7efec6592640 1 -- 172.21.15.190:0/1056845155 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d2db9779-83a1-4339-9f78-3a46875ce3fa", "id": 5} v 0) v1 -- 0x7efec00746a0 con 0x7efec0151810 2024-01-17T22:58:05.123 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.119+0000 7efebcff9640 1 -- 172.21.15.190:0/1056845155 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2db9779-83a1-4339-9f78-3a46875ce3fa", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7efeb40c2b00 con 0x7efec0151810 2024-01-17T22:58:05.123 INFO:teuthology.orchestra.run.smithi190.stdout:5 2024-01-17T22:58:05.125 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.119+0000 7efec6592640 1 -- 172.21.15.190:0/1056845155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efec0151810 msgr2=0x7efec00cc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:05.125 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.119+0000 7efec6592640 1 --2- 172.21.15.190:0/1056845155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efec0151810 0x7efec00cc540 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efeb40af000 tx=0x7efeb401bad0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.125 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.119+0000 7efec6592640 1 -- 172.21.15.190:0/1056845155 shutdown_connections 2024-01-17T22:58:05.125 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.119+0000 7efec6592640 1 --2- 172.21.15.190:0/1056845155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec0157c20 0x7efec00cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.125 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.119+0000 7efec6592640 1 --2- 172.21.15.190:0/1056845155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efec0151810 0x7efec00cc540 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.125 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.119+0000 7efec6592640 1 --2- 172.21.15.190:0/1056845155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec00c84c0 0x7efec00c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.125 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.119+0000 7efec6592640 1 -- 172.21.15.190:0/1056845155 >> 172.21.15.190:0/1056845155 conn(0x7efec00617e0 msgr2=0x7efec014fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:05.125 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.119+0000 7efec6592640 1 -- 172.21.15.190:0/1056845155 shutdown_connections 2024-01-17T22:58:05.125 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.119+0000 7efec6592640 1 -- 172.21.15.190:0/1056845155 wait complete. 2024-01-17T22:58:05.147 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 2f8ca4e1-cda9-4517-98f9-86aa5e8697f3 6 2024-01-17T22:58:05.309 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.303+0000 7fd520607640 1 Processor -- start 2024-01-17T22:58:05.309 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.303+0000 7fd520607640 1 -- start start 2024-01-17T22:58:05.309 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.303+0000 7fd520607640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5181506e0 0x7fd51806b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:05.309 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.303+0000 7fd520607640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd518150ac0 0x7fd5180c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:05.309 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.303+0000 7fd520607640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd5180c3900 0x7fd518159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:05.310 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.303+0000 7fd520607640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd518157280 con 0x7fd518150ac0 2024-01-17T22:58:05.310 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.303+0000 7fd520607640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5180c26f0 con 0x7fd5180c3900 2024-01-17T22:58:05.310 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.303+0000 7fd520607640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd518061380 con 0x7fd5181506e0 2024-01-17T22:58:05.310 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.303+0000 7fd51e3a3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5181506e0 0x7fd51806b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:05.311 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.303+0000 7fd51dba2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd518150ac0 0x7fd5180c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:05.311 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.307+0000 7fd51eba4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd5180c3900 0x7fd518159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:05.311 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.307+0000 7fd51e3a3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5181506e0 0x7fd51806b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:33154/0 (socket says 172.21.15.190:33154) 2024-01-17T22:58:05.311 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.307+0000 7fd51e3a3640 1 -- 172.21.15.190:0/891663143 learned_addr learned my addr 172.21.15.190:0/891663143 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-01-17T22:58:05.311 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.307+0000 7fd51dba2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd518150ac0 0x7fd5180c33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.190:47988/0 (socket says 172.21.15.190:47988) 2024-01-17T22:58:05.313 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.307+0000 7fd51e3a3640 1 -- 172.21.15.190:0/891663143 >> v2:172.21.15.190:3300/0 conn(0x7fd5180c3900 msgr2=0x7fd518159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:05.313 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.307+0000 7fd51e3a3640 1 --2- 172.21.15.190:0/891663143 >> v2:172.21.15.190:3300/0 conn(0x7fd5180c3900 0x7fd518159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.313 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.307+0000 7fd51e3a3640 1 -- 172.21.15.190:0/891663143 >> v2:172.21.15.161:3300/0 conn(0x7fd518150ac0 msgr2=0x7fd5180c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:05.313 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.307+0000 7fd51e3a3640 1 --2- 172.21.15.190:0/891663143 >> v2:172.21.15.161:3300/0 conn(0x7fd518150ac0 0x7fd5180c33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.313 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.307+0000 7fd51e3a3640 1 -- 172.21.15.190:0/891663143 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5180c8190 con 0x7fd5181506e0 2024-01-17T22:58:05.313 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.307+0000 7fd51dba2640 1 --2- 172.21.15.190:0/891663143 >> v2:172.21.15.161:3300/0 conn(0x7fd518150ac0 0x7fd5180c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-17T22:58:05.316 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.311+0000 7fd51e3a3640 1 --2- 172.21.15.190:0/891663143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5181506e0 0x7fd51806b7f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd51806ce10 tx=0x7fd50801ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab12cc5c920524e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:05.320 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.315+0000 7fd51d3a1640 1 -- 172.21.15.190:0/891663143 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5080a7950 con 0x7fd5181506e0 2024-01-17T22:58:05.320 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.315+0000 7fd51d3a1640 1 -- 172.21.15.190:0/891663143 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5080a7ab0 con 0x7fd5181506e0 2024-01-17T22:58:05.320 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.315+0000 7fd51d3a1640 1 -- 172.21.15.190:0/891663143 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5080a7e40 con 0x7fd5181506e0 2024-01-17T22:58:05.321 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.315+0000 7fd520607640 1 -- 172.21.15.190:0/891663143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5181506e0 msgr2=0x7fd51806b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:05.321 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.315+0000 7fd520607640 1 --2- 172.21.15.190:0/891663143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5181506e0 0x7fd51806b7f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd51806ce10 tx=0x7fd50801ebb0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.321 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.315+0000 7fd520607640 1 -- 172.21.15.190:0/891663143 shutdown_connections 2024-01-17T22:58:05.322 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.315+0000 7fd520607640 1 --2- 172.21.15.190:0/891663143 >> v2:172.21.15.190:3300/0 conn(0x7fd5180c3900 0x7fd518159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.322 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.315+0000 7fd520607640 1 --2- 172.21.15.190:0/891663143 >> v2:172.21.15.161:3300/0 conn(0x7fd518150ac0 0x7fd5180c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.322 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.315+0000 7fd520607640 1 --2- 172.21.15.190:0/891663143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5181506e0 0x7fd51806b7f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.322 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.315+0000 7fd520607640 1 -- 172.21.15.190:0/891663143 >> 172.21.15.190:0/891663143 conn(0x7fd518071b50 msgr2=0x7fd518071f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:05.322 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.315+0000 7fd520607640 1 -- 172.21.15.190:0/891663143 shutdown_connections 2024-01-17T22:58:05.322 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.315+0000 7fd520607640 1 -- 172.21.15.190:0/891663143 wait complete. 2024-01-17T22:58:05.322 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.319+0000 7fd520607640 1 Processor -- start 2024-01-17T22:58:05.322 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.319+0000 7fd520607640 1 -- start start 2024-01-17T22:58:05.323 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.319+0000 7fd520607640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5180c3900 0x7fd5181452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:05.323 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.319+0000 7fd520607640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5181506e0 0x7fd518145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:05.323 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.319+0000 7fd520607640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd518150ac0 0x7fd518146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:05.323 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.319+0000 7fd520607640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd518138a00 con 0x7fd518150ac0 2024-01-17T22:58:05.323 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.319+0000 7fd520607640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5181443c0 con 0x7fd5181506e0 2024-01-17T22:58:05.323 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.319+0000 7fd520607640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd518146380 con 0x7fd5180c3900 2024-01-17T22:58:05.324 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.319+0000 7fd51e3a3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5180c3900 0x7fd5181452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:05.324 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.319+0000 7fd51dba2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5181506e0 0x7fd518145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:05.325 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.319+0000 7fd51e3a3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5180c3900 0x7fd5181452f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:33156/0 (socket says 172.21.15.190:33156) 2024-01-17T22:58:05.325 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.319+0000 7fd51e3a3640 1 -- 172.21.15.190:0/873711107 learned_addr learned my addr 172.21.15.190:0/873711107 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-01-17T22:58:05.325 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.319+0000 7fd51eba4640 1 --2- 172.21.15.190:0/873711107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd518150ac0 0x7fd518146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:05.327 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.323+0000 7fd51e3a3640 1 -- 172.21.15.190:0/873711107 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5181506e0 msgr2=0x7fd518145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:05.327 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.323+0000 7fd51e3a3640 1 --2- 172.21.15.190:0/873711107 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5181506e0 0x7fd518145e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.328 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.323+0000 7fd51e3a3640 1 -- 172.21.15.190:0/873711107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd518150ac0 msgr2=0x7fd518146840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:05.328 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.323+0000 7fd51e3a3640 1 --2- 172.21.15.190:0/873711107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd518150ac0 0x7fd518146840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.328 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.323+0000 7fd51e3a3640 1 -- 172.21.15.190:0/873711107 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c009420 con 0x7fd5180c3900 2024-01-17T22:58:05.330 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.323+0000 7fd51e3a3640 1 --2- 172.21.15.190:0/873711107 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5180c3900 0x7fd5181452f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd5080b1040 tx=0x7fd50801b950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:05.334 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.327+0000 7fd516ffd640 1 -- 172.21.15.190:0/873711107 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5080a7950 con 0x7fd5180c3900 2024-01-17T22:58:05.334 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.327+0000 7fd516ffd640 1 -- 172.21.15.190:0/873711107 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd508007d60 con 0x7fd5180c3900 2024-01-17T22:58:05.334 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.327+0000 7fd520607640 1 -- 172.21.15.190:0/873711107 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd508009b30 con 0x7fd5180c3900 2024-01-17T22:58:05.334 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.327+0000 7fd516ffd640 1 -- 172.21.15.190:0/873711107 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5080ba6b0 con 0x7fd5180c3900 2024-01-17T22:58:05.334 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.327+0000 7fd520607640 1 -- 172.21.15.190:0/873711107 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd518147120 con 0x7fd5180c3900 2024-01-17T22:58:05.335 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.331+0000 7fd520607640 1 -- 172.21.15.190:0/873711107 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51806c0d0 con 0x7fd5180c3900 2024-01-17T22:58:05.338 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.331+0000 7fd516ffd640 1 -- 172.21.15.190:0/873711107 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fd5080ba810 con 0x7fd5180c3900 2024-01-17T22:58:05.338 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.331+0000 7fd516ffd640 1 -- 172.21.15.190:0/873711107 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fd5080cf430 con 0x7fd5180c3900 2024-01-17T22:58:05.434 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:05.434+0000 7f5c9909b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-17T22:58:05.447 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.443+0000 7fd516ffd640 1 -- 172.21.15.190:0/873711107 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7fd5080c5460 con 0x7fd5180c3900 2024-01-17T22:58:05.520 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:05.518+0000 7f5c9909b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-17T22:58:05.520 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.515+0000 7fd520607640 1 -- 172.21.15.190:0/873711107 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2f8ca4e1-cda9-4517-98f9-86aa5e8697f3", "id": 6} v 0) v1 -- 0x7fd518143f70 con 0x7fd5180c3900 2024-01-17T22:58:05.585 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:05.579+0000 7f240b9be180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-17T22:58:05.636 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.631+0000 7fd516ffd640 1 -- 172.21.15.190:0/873711107 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2f8ca4e1-cda9-4517-98f9-86aa5e8697f3", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd5080baac0 con 0x7fd5180c3900 2024-01-17T22:58:05.636 INFO:teuthology.orchestra.run.smithi190.stdout:6 2024-01-17T22:58:05.638 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.631+0000 7fd520607640 1 -- 172.21.15.190:0/873711107 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5180c3900 msgr2=0x7fd5181452f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:05.638 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.631+0000 7fd520607640 1 --2- 172.21.15.190:0/873711107 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5180c3900 0x7fd5181452f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd5080b1040 tx=0x7fd50801b950 comp rx=0 tx=0).stop 2024-01-17T22:58:05.638 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.631+0000 7fd520607640 1 -- 172.21.15.190:0/873711107 shutdown_connections 2024-01-17T22:58:05.638 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.631+0000 7fd520607640 1 --2- 172.21.15.190:0/873711107 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5181506e0 0x7fd518145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.639 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.631+0000 7fd520607640 1 --2- 172.21.15.190:0/873711107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd518150ac0 0x7fd518146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.639 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.631+0000 7fd520607640 1 --2- 172.21.15.190:0/873711107 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5180c3900 0x7fd5181452f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.639 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.631+0000 7fd520607640 1 -- 172.21.15.190:0/873711107 >> 172.21.15.190:0/873711107 conn(0x7fd518071b50 msgr2=0x7fd518155470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:05.639 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.631+0000 7fd520607640 1 -- 172.21.15.190:0/873711107 shutdown_connections 2024-01-17T22:58:05.639 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.631+0000 7fd520607640 1 -- 172.21.15.190:0/873711107 wait complete. 2024-01-17T22:58:05.656 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 2280c95e-a481-470f-9e41-7e25840e46d2 7 2024-01-17T22:58:05.664 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:05.659+0000 7f240b9be180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-17T22:58:05.713 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:05.714+0000 7f5c9909b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-17T22:58:05.774 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.771+0000 7fc2feaa2640 1 Processor -- start 2024-01-17T22:58:05.775 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.771+0000 7fc2feaa2640 1 -- start start 2024-01-17T22:58:05.776 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.771+0000 7fc2feaa2640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc2f80c1180 0x7fc2f815a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:05.776 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.771+0000 7fc2feaa2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc2f80c7a60 0x7fc2f8157040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:05.776 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.771+0000 7fc2feaa2640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f80c3320 con 0x7fc2f81507f0 2024-01-17T22:58:05.776 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.771+0000 7fc2feaa2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f80c1d90 con 0x7fc2f80c7a60 2024-01-17T22:58:05.776 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.771+0000 7fc2feaa2640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f815a2f0 con 0x7fc2f80c1180 2024-01-17T22:58:05.777 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.771+0000 7fc2f7fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc2f80c1180 0x7fc2f815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:05.777 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.771+0000 7fc2fd03f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc2f80c7a60 0x7fc2f8157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:05.777 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.771+0000 7fc2fd03f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc2f80c7a60 0x7fc2f8157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.190:48004/0 (socket says 172.21.15.190:48004) 2024-01-17T22:58:05.777 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.771+0000 7fc2fd03f640 1 -- 172.21.15.190:0/1170740117 learned_addr learned my addr 172.21.15.190:0/1170740117 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-01-17T22:58:05.779 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.775+0000 7fc2fd03f640 1 -- 172.21.15.190:0/1170740117 >> v2:172.21.15.190:3300/0 conn(0x7fc2f80c1180 msgr2=0x7fc2f815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:05.779 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.775+0000 7fc2fd03f640 1 --2- 172.21.15.190:0/1170740117 >> v2:172.21.15.190:3300/0 conn(0x7fc2f80c1180 0x7fc2f815a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.779 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.775+0000 7fc2fd03f640 1 -- 172.21.15.190:0/1170740117 >> v1:172.21.15.190:6789/0 conn(0x7fc2f81507f0 legacy=0x7fc2f806e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:05.779 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.775+0000 7fc2fd03f640 1 -- 172.21.15.190:0/1170740117 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f8157580 con 0x7fc2f80c7a60 2024-01-17T22:58:05.782 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.779+0000 7fc2fd03f640 1 --2- 172.21.15.190:0/1170740117 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f80c7a60 0x7fc2f8157040 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc2f806e2f0 tx=0x7fc2f001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bddb116ffb66112 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:05.787 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.779+0000 7fc2f77fe640 1 -- 172.21.15.190:0/1170740117 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f00a56f0 con 0x7fc2f80c7a60 2024-01-17T22:58:05.787 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.783+0000 7fc2f77fe640 1 -- 172.21.15.190:0/1170740117 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f00a5850 con 0x7fc2f80c7a60 2024-01-17T22:58:05.787 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.783+0000 7fc2f77fe640 1 -- 172.21.15.190:0/1170740117 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f00a5be0 con 0x7fc2f80c7a60 2024-01-17T22:58:05.788 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.783+0000 7fc2feaa2640 1 -- 172.21.15.190:0/1170740117 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f80c7a60 msgr2=0x7fc2f8157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:05.788 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.783+0000 7fc2feaa2640 1 --2- 172.21.15.190:0/1170740117 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f80c7a60 0x7fc2f8157040 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc2f806e2f0 tx=0x7fc2f001c940 comp rx=0 tx=0).stop 2024-01-17T22:58:05.788 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.783+0000 7fc2feaa2640 1 -- 172.21.15.190:0/1170740117 shutdown_connections 2024-01-17T22:58:05.788 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.783+0000 7fc2feaa2640 1 --2- 172.21.15.190:0/1170740117 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f80c7a60 0x7fc2f8157040 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.788 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.783+0000 7fc2feaa2640 1 --2- 172.21.15.190:0/1170740117 >> v2:172.21.15.190:3300/0 conn(0x7fc2f80c1180 0x7fc2f815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.788 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.783+0000 7fc2feaa2640 1 -- 172.21.15.190:0/1170740117 >> 172.21.15.190:0/1170740117 conn(0x7fc2f8061840 msgr2=0x7fc2f8072420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:05.788 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.783+0000 7fc2feaa2640 1 -- 172.21.15.190:0/1170740117 shutdown_connections 2024-01-17T22:58:05.788 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.783+0000 7fc2feaa2640 1 -- 172.21.15.190:0/1170740117 wait complete. 2024-01-17T22:58:05.789 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.783+0000 7fc2feaa2640 1 Processor -- start 2024-01-17T22:58:05.789 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.783+0000 7fc2feaa2640 1 -- start start 2024-01-17T22:58:05.791 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.787+0000 7fc2feaa2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2f80c1180 0x7fc2f80c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:05.791 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.787+0000 7fc2feaa2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2f80c7a60 0x7fc2f815f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:05.791 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.787+0000 7fc2feaa2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f81507f0 0x7fc2f8139d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:05.791 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.787+0000 7fc2feaa2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f8160090 con 0x7fc2f81507f0 2024-01-17T22:58:05.791 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.787+0000 7fc2feaa2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f813a2d0 con 0x7fc2f80c7a60 2024-01-17T22:58:05.791 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.787+0000 7fc2feaa2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80c58f0 con 0x7fc2f80c1180 2024-01-17T22:58:05.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.787+0000 7fc2f7fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2f80c7a60 0x7fc2f815f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:05.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.787+0000 7fc2fd03f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f81507f0 0x7fc2f8139d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:05.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.787+0000 7fc2fc83e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2f80c1180 0x7fc2f80c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:05.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.787+0000 7fc2f7fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2f80c7a60 0x7fc2f815f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:45330/0 (socket says 172.21.15.190:45330) 2024-01-17T22:58:05.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.787+0000 7fc2f7fff640 1 -- 172.21.15.190:0/3868101790 learned_addr learned my addr 172.21.15.190:0/3868101790 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-01-17T22:58:05.795 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.791+0000 7fc2fd03f640 1 -- 172.21.15.190:0/3868101790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2f80c1180 msgr2=0x7fc2f80c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:05.795 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.791+0000 7fc2fd03f640 1 --2- 172.21.15.190:0/3868101790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2f80c1180 0x7fc2f80c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.795 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.791+0000 7fc2fd03f640 1 -- 172.21.15.190:0/3868101790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2f80c7a60 msgr2=0x7fc2f815f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:05.795 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.791+0000 7fc2fd03f640 1 --2- 172.21.15.190:0/3868101790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2f80c7a60 0x7fc2f815f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:05.795 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.791+0000 7fc2fd03f640 1 -- 172.21.15.190:0/3868101790 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f0009b30 con 0x7fc2f81507f0 2024-01-17T22:58:05.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.791+0000 7fc2fd03f640 1 --2- 172.21.15.190:0/3868101790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f81507f0 0x7fc2f8139d90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc2f00ab000 tx=0x7fc2f00196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:05.798 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:05.798+0000 7f5c9909b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-17T22:58:05.801 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.795+0000 7fc2f57fa640 1 -- 172.21.15.190:0/3868101790 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0009510 con 0x7fc2f81507f0 2024-01-17T22:58:05.801 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.795+0000 7fc2f57fa640 1 -- 172.21.15.190:0/3868101790 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f00b8470 con 0x7fc2f81507f0 2024-01-17T22:58:05.801 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.795+0000 7fc2feaa2640 1 -- 172.21.15.190:0/3868101790 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f81f4fc0 con 0x7fc2f81507f0 2024-01-17T22:58:05.801 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.795+0000 7fc2f57fa640 1 -- 172.21.15.190:0/3868101790 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f00b8820 con 0x7fc2f81507f0 2024-01-17T22:58:05.801 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.795+0000 7fc2feaa2640 1 -- 172.21.15.190:0/3868101790 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f81f5580 con 0x7fc2f81507f0 2024-01-17T22:58:05.802 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.795+0000 7fc2feaa2640 1 -- 172.21.15.190:0/3868101790 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f80746a0 con 0x7fc2f81507f0 2024-01-17T22:58:05.846 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:05.843+0000 7f240b9be180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-17T22:58:05.899 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.895+0000 7fc2f57fa640 1 -- 172.21.15.190:0/3868101790 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fc2f00b8980 con 0x7fc2f81507f0 2024-01-17T22:58:05.903 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.899+0000 7fc2f57fa640 1 -- 172.21.15.190:0/3868101790 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fc2f00c1c60 con 0x7fc2f81507f0 2024-01-17T22:58:05.903 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.899+0000 7fc2f57fa640 1 -- 172.21.15.190:0/3868101790 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7fc2f00bc030 con 0x7fc2f81507f0 2024-01-17T22:58:05.919 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:05.915+0000 7f240b9be180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-17T22:58:05.978 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:05.971+0000 7fc2feaa2640 1 -- 172.21.15.190:0/3868101790 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2280c95e-a481-470f-9e41-7e25840e46d2", "id": 7} v 0) v1 -- 0x7fc2f813d790 con 0x7fc2f81507f0 2024-01-17T22:58:06.049 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:06.043+0000 7fc2f57fa640 1 -- 172.21.15.190:0/3868101790 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2280c95e-a481-470f-9e41-7e25840e46d2", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc2f00c1e20 con 0x7fc2f81507f0 2024-01-17T22:58:06.049 INFO:teuthology.orchestra.run.smithi190.stdout:7 2024-01-17T22:58:06.051 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:06.043+0000 7fc2feaa2640 1 -- 172.21.15.190:0/3868101790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f81507f0 msgr2=0x7fc2f8139d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:06.051 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:06.043+0000 7fc2feaa2640 1 --2- 172.21.15.190:0/3868101790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f81507f0 0x7fc2f8139d90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc2f00ab000 tx=0x7fc2f00196e0 comp rx=0 tx=0).stop 2024-01-17T22:58:06.051 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:06.047+0000 7fc2feaa2640 1 -- 172.21.15.190:0/3868101790 shutdown_connections 2024-01-17T22:58:06.051 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:06.047+0000 7fc2feaa2640 1 --2- 172.21.15.190:0/3868101790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2f80c7a60 0x7fc2f815f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:06.051 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:06.047+0000 7fc2feaa2640 1 --2- 172.21.15.190:0/3868101790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f81507f0 0x7fc2f8139d90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:06.051 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:06.047+0000 7fc2feaa2640 1 --2- 172.21.15.190:0/3868101790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2f80c1180 0x7fc2f80c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:06.051 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:06.047+0000 7fc2feaa2640 1 -- 172.21.15.190:0/3868101790 >> 172.21.15.190:0/3868101790 conn(0x7fc2f8061840 msgr2=0x7fc2f80c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:06.051 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:06.047+0000 7fc2feaa2640 1 -- 172.21.15.190:0/3868101790 shutdown_connections 2024-01-17T22:58:06.051 INFO:teuthology.orchestra.run.smithi190.stderr:2024-01-17T22:58:06.047+0000 7fc2feaa2640 1 -- 172.21.15.190:0/3868101790 wait complete. 2024-01-17T22:58:06.073 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-17T22:58:06.073 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-01-17T22:58:06.077 INFO:tasks.ceph.osd.0:Started 2024-01-17T22:58:06.077 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-17T22:58:06.077 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-01-17T22:58:06.080 INFO:tasks.ceph.osd.1:Started 2024-01-17T22:58:06.080 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-17T22:58:06.080 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-01-17T22:58:06.084 INFO:tasks.ceph.osd.2:Started 2024-01-17T22:58:06.084 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-17T22:58:06.084 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-01-17T22:58:06.088 INFO:tasks.ceph.osd.3:Started 2024-01-17T22:58:06.088 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-17T22:58:06.088 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-01-17T22:58:06.116 INFO:tasks.ceph.osd.4:Started 2024-01-17T22:58:06.116 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-17T22:58:06.116 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-01-17T22:58:06.118 INFO:tasks.ceph.osd.5:Started 2024-01-17T22:58:06.118 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-17T22:58:06.118 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-01-17T22:58:06.120 INFO:tasks.ceph.osd.6:Started 2024-01-17T22:58:06.120 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-17T22:58:06.120 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-01-17T22:58:06.122 INFO:tasks.ceph.osd.7:Started 2024-01-17T22:58:06.123 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T22:58:06.157 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:06.158+0000 7f5c9909b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-17T22:58:06.261 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:06.255+0000 7f240b9be180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-17T22:58:06.277 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:06.278+0000 7f5c9909b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-17T22:58:06.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.318+0000 7f54c8e00640 1 Processor -- start 2024-01-17T22:58:06.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.318+0000 7f54c8e00640 1 -- start start 2024-01-17T22:58:06.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.318+0000 7f54c8e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f54c41517f0 0x7f54c415b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:06.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.318+0000 7f54c8e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c40ca3a0 0x7f54c4061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:06.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.318+0000 7f54c8e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40c7d10 con 0x7f54c40ca780 2024-01-17T22:58:06.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.318+0000 7f54c8e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c41576d0 con 0x7f54c41517f0 2024-01-17T22:58:06.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.318+0000 7f54c8e00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c4157970 con 0x7f54c40ca3a0 2024-01-17T22:58:06.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.322+0000 7f54c1400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c40ca3a0 0x7f54c4061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:06.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.322+0000 7f54c1400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c40ca3a0 0x7f54c4061100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:37714/0 (socket says 172.21.15.161:37714) 2024-01-17T22:58:06.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.322+0000 7f54c1400640 1 -- 172.21.15.161:0/139030135 learned_addr learned my addr 172.21.15.161:0/139030135 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:06.322 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-17T22:58:06.319+0000 7f240b9be180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-17T22:58:06.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.326+0000 7f54c1400640 1 -- 172.21.15.161:0/139030135 >> v2:172.21.15.161:3300/0 conn(0x7f54c41517f0 msgr2=0x7f54c415b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:06.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.326+0000 7f54c1400640 1 --2- 172.21.15.161:0/139030135 >> v2:172.21.15.161:3300/0 conn(0x7f54c41517f0 0x7f54c415b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:06.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.326+0000 7f54c1400640 1 -- 172.21.15.161:0/139030135 >> v1:172.21.15.161:6789/0 conn(0x7f54c40ca780 legacy=0x7f54c40c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:06.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.326+0000 7f54c1400640 1 -- 172.21.15.161:0/139030135 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c4157c50 con 0x7f54c40ca3a0 2024-01-17T22:58:06.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.330+0000 7f54c1400640 1 --2- 172.21.15.161:0/139030135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c40ca3a0 0x7f54c4061100 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009870 tx=0x7f54ac01c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd23612306f27070 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:06.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.338+0000 7f54c0a00640 1 -- 172.21.15.161:0/139030135 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac0aa620 con 0x7f54c40ca3a0 2024-01-17T22:58:06.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.338+0000 7f54c0a00640 1 -- 172.21.15.161:0/139030135 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac0aa780 con 0x7f54c40ca3a0 2024-01-17T22:58:06.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.338+0000 7f54c0a00640 1 -- 172.21.15.161:0/139030135 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac0aab10 con 0x7f54c40ca3a0 2024-01-17T22:58:06.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.342+0000 7f54c8e00640 1 -- 172.21.15.161:0/139030135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c40ca3a0 msgr2=0x7f54c4061100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:06.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.342+0000 7f54c8e00640 1 --2- 172.21.15.161:0/139030135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c40ca3a0 0x7f54c4061100 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009870 tx=0x7f54ac01c500 comp rx=0 tx=0).stop 2024-01-17T22:58:06.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.342+0000 7f54c8e00640 1 -- 172.21.15.161:0/139030135 shutdown_connections 2024-01-17T22:58:06.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.342+0000 7f54c8e00640 1 --2- 172.21.15.161:0/139030135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c40ca3a0 0x7f54c4061100 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:06.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.342+0000 7f54c8e00640 1 --2- 172.21.15.161:0/139030135 >> v2:172.21.15.161:3300/0 conn(0x7f54c41517f0 0x7f54c415b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:06.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.342+0000 7f54c8e00640 1 -- 172.21.15.161:0/139030135 >> 172.21.15.161:0/139030135 conn(0x7f54c406ad40 msgr2=0x7f54c406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:06.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.342+0000 7f54c8e00640 1 -- 172.21.15.161:0/139030135 shutdown_connections 2024-01-17T22:58:06.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.342+0000 7f54c8e00640 1 -- 172.21.15.161:0/139030135 wait complete. 2024-01-17T22:58:06.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.342+0000 7f54c8e00640 1 Processor -- start 2024-01-17T22:58:06.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.342+0000 7f54c8e00640 1 -- start start 2024-01-17T22:58:06.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.342+0000 7f54c8e00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54c40ca3a0 0x7f54c4159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:06.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.342+0000 7f54c8e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c40ca780 0x7f54c4153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:06.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.342+0000 7f54c8e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54c41517f0 0x7f54c413fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:06.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.342+0000 7f54c8e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c4153e90 con 0x7f54c41517f0 2024-01-17T22:58:06.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.342+0000 7f54c8e00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b23f0 con 0x7f54c40ca3a0 2024-01-17T22:58:06.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.342+0000 7f54c8e00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c4158bb0 con 0x7f54c40ca780 2024-01-17T22:58:06.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.346+0000 7f54c1400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c40ca780 0x7f54c4153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:06.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.346+0000 7f54c1e00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54c40ca3a0 0x7f54c4159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:06.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.346+0000 7f54c1400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c40ca780 0x7f54c4153950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:37730/0 (socket says 172.21.15.161:37730) 2024-01-17T22:58:06.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.346+0000 7f54c1400640 1 -- 172.21.15.161:0/2996686193 learned_addr learned my addr 172.21.15.161:0/2996686193 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:06.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.350+0000 7f54c1400640 1 -- 172.21.15.161:0/2996686193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54c40ca3a0 msgr2=0x7f54c4159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:06.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.350+0000 7f54c1400640 1 --2- 172.21.15.161:0/2996686193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54c40ca3a0 0x7f54c4159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:06.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.350+0000 7f54c1400640 1 -- 172.21.15.161:0/2996686193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54c41517f0 msgr2=0x7f54c413fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:06.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.350+0000 7f54c1400640 1 --2- 172.21.15.161:0/2996686193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54c41517f0 0x7f54c413fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:06.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.350+0000 7f54c1400640 1 -- 172.21.15.161:0/2996686193 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac0094d0 con 0x7f54c40ca780 2024-01-17T22:58:06.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.354+0000 7f54c1400640 1 --2- 172.21.15.161:0/2996686193 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c40ca780 0x7f54c4153950 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0ac040 tx=0x7f54ac01ad40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:06.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.362+0000 7f54ba000640 1 -- 172.21.15.161:0/2996686193 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac0bd3f0 con 0x7f54c40ca780 2024-01-17T22:58:06.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.362+0000 7f54ba000640 1 -- 172.21.15.161:0/2996686193 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac0bd570 con 0x7f54c40ca780 2024-01-17T22:58:06.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.362+0000 7f54ba000640 1 -- 172.21.15.161:0/2996686193 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac0bd920 con 0x7f54c40ca780 2024-01-17T22:58:06.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.362+0000 7f54c8e00640 1 -- 172.21.15.161:0/2996686193 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c40b1e30 con 0x7f54c40ca780 2024-01-17T22:58:06.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.362+0000 7f54c8e00640 1 -- 172.21.15.161:0/2996686193 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c4158840 con 0x7f54c40ca780 2024-01-17T22:58:06.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.362+0000 7f54c8e00640 1 -- 172.21.15.161:0/2996686193 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c406b620 con 0x7f54c40ca780 2024-01-17T22:58:06.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.494+0000 7f54ba000640 1 -- 172.21.15.161:0/2996686193 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f54ac0059a0 con 0x7f54c40ca780 2024-01-17T22:58:06.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.498+0000 7f54ba000640 1 -- 172.21.15.161:0/2996686193 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f54ac0066c0 con 0x7f54c40ca780 2024-01-17T22:58:06.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.498+0000 7f54ba000640 1 -- 172.21.15.161:0/2996686193 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f54ac006880 con 0x7f54c40ca780 2024-01-17T22:58:06.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.554+0000 7f54c8e00640 1 -- 172.21.15.161:0/2996686193 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54c40746a0 con 0x7f54c40ca780 2024-01-17T22:58:06.764 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-01-17T22:58:06.759+0000 7f2d4b949640 -1 Falling back to public interface 2024-01-17T22:58:06.773 INFO:tasks.ceph.osd.0.smithi161.stderr:2024-01-17T22:58:06.774+0000 7f84db961640 -1 Falling back to public interface 2024-01-17T22:58:06.775 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-01-17T22:58:06.771+0000 7fb4e9717640 -1 Falling back to public interface 2024-01-17T22:58:06.785 INFO:tasks.ceph.osd.2.smithi161.stderr:2024-01-17T22:58:06.786+0000 7fcb6c667640 -1 Falling back to public interface 2024-01-17T22:58:06.785 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-01-17T22:58:06.786+0000 7f658e4ae640 -1 Falling back to public interface 2024-01-17T22:58:06.799 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-01-17T22:58:06.795+0000 7f096407f640 -1 Falling back to public interface 2024-01-17T22:58:06.799 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-01-17T22:58:06.795+0000 7f1461e3b640 -1 Falling back to public interface 2024-01-17T22:58:06.801 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-01-17T22:58:06.802+0000 7f902fb01640 -1 Falling back to public interface 2024-01-17T22:58:06.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.846+0000 7f54ba000640 1 -- 172.21.15.161:0/2996686193 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mgrmap(e 2) v1 ==== 43034+0+0 (secure 0 0 0) 0x7f54ac005d40 con 0x7f54c40ca780 2024-01-17T22:58:06.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.850+0000 7f54ba000640 1 -- 172.21.15.161:0/2996686193 <== mon.2 v2:172.21.15.190:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f54ac0c5d10 con 0x7f54c40ca780 2024-01-17T22:58:06.850 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:58:06.850 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":10,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:58:05.988359+0000","last_up_change":"0.000000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:58:06.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.850+0000 7f54c8e00640 1 -- 172.21.15.161:0/2996686193 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c40ca780 msgr2=0x7f54c4153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:06.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.850+0000 7f54c8e00640 1 --2- 172.21.15.161:0/2996686193 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c40ca780 0x7f54c4153950 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0ac040 tx=0x7f54ac01ad40 comp rx=0 tx=0).stop 2024-01-17T22:58:06.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.850+0000 7f54c8e00640 1 -- 172.21.15.161:0/2996686193 shutdown_connections 2024-01-17T22:58:06.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.850+0000 7f54c8e00640 1 --2- 172.21.15.161:0/2996686193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54c41517f0 0x7f54c413fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:06.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.850+0000 7f54c8e00640 1 --2- 172.21.15.161:0/2996686193 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c40ca780 0x7f54c4153950 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:06.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.850+0000 7f54c8e00640 1 --2- 172.21.15.161:0/2996686193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54c40ca3a0 0x7f54c4159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:06.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.850+0000 7f54c8e00640 1 -- 172.21.15.161:0/2996686193 >> 172.21.15.161:0/2996686193 conn(0x7f54c406ad40 msgr2=0x7f54c4070df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:06.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.850+0000 7f54c8e00640 1 -- 172.21.15.161:0/2996686193 shutdown_connections 2024-01-17T22:58:06.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:06.850+0000 7f54c8e00640 1 -- 172.21.15.161:0/2996686193 wait complete. 2024-01-17T22:58:06.871 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-17T22:58:06.871 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-17T22:58:07.676 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-17T22:58:07.806 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.806+0000 7f26c9400640 1 Processor -- start 2024-01-17T22:58:07.806 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.806+0000 7f26c9400640 1 -- start start 2024-01-17T22:58:07.808 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.806+0000 7f26c9400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26c41517a0 0x7f26c4157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:07.808 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.806+0000 7f26c9400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f26c40c1d30 0x7f26c40ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:07.808 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.806+0000 7f26c9400640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c4158510 con 0x7f26c40c9050 2024-01-17T22:58:07.808 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.806+0000 7f26c9400640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c40c8210 con 0x7f26c40c1d30 2024-01-17T22:58:07.808 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.806+0000 7f26c9400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c415af60 con 0x7f26c41517a0 2024-01-17T22:58:07.809 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.810+0000 7f26c2800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26c41517a0 0x7f26c4157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:07.810 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.810+0000 7f26c1e00640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f26c40c9050 0x7f26c415b3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.161:34300/0 (socket says 172.21.15.161:34300) 2024-01-17T22:58:07.810 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.810+0000 7f26c1e00640 1 -- 172.21.15.161:0/1096670242 learned_addr learned my addr 172.21.15.161:0/1096670242 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:58:07.810 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.810+0000 7f26c3200640 1 --2- 172.21.15.161:0/1096670242 >> v2:172.21.15.190:3300/0 conn(0x7f26c40c1d30 0x7f26c40ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:07.816 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.818+0000 7f26c2800640 1 -- 172.21.15.161:0/1096670242 >> v2:172.21.15.190:3300/0 conn(0x7f26c40c1d30 msgr2=0x7f26c40ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:07.816 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.818+0000 7f26c2800640 1 --2- 172.21.15.161:0/1096670242 >> v2:172.21.15.190:3300/0 conn(0x7f26c40c1d30 0x7f26c40ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:07.816 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.818+0000 7f26c2800640 1 -- 172.21.15.161:0/1096670242 >> v1:172.21.15.190:6789/0 conn(0x7f26c40c9050 legacy=0x7f26c415b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:07.816 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.818+0000 7f26c2800640 1 -- 172.21.15.161:0/1096670242 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c40c7c70 con 0x7f26c41517a0 2024-01-17T22:58:07.823 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.822+0000 7f26c2800640 1 --2- 172.21.15.161:0/1096670242 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26c41517a0 0x7f26c4157fd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f26b40097c0 tx=0x7f26b401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22ae06419381fa4e server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:07.833 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.834+0000 7f26c1400640 1 -- 172.21.15.161:0/1096670242 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b40ab600 con 0x7f26c41517a0 2024-01-17T22:58:07.833 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.834+0000 7f26c1400640 1 -- 172.21.15.161:0/1096670242 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b40a7050 con 0x7f26c41517a0 2024-01-17T22:58:07.833 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.834+0000 7f26c1400640 1 -- 172.21.15.161:0/1096670242 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b40ab980 con 0x7f26c41517a0 2024-01-17T22:58:07.834 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.834+0000 7f26c9400640 1 -- 172.21.15.161:0/1096670242 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26c41517a0 msgr2=0x7f26c4157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:07.834 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.834+0000 7f26c9400640 1 --2- 172.21.15.161:0/1096670242 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26c41517a0 0x7f26c4157fd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f26b40097c0 tx=0x7f26b401c480 comp rx=0 tx=0).stop 2024-01-17T22:58:07.834 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.834+0000 7f26c9400640 1 -- 172.21.15.161:0/1096670242 shutdown_connections 2024-01-17T22:58:07.834 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.834+0000 7f26c9400640 1 --2- 172.21.15.161:0/1096670242 >> v2:172.21.15.190:3300/0 conn(0x7f26c40c1d30 0x7f26c40ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:07.835 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.834+0000 7f26c9400640 1 --2- 172.21.15.161:0/1096670242 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26c41517a0 0x7f26c4157fd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:07.835 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.834+0000 7f26c9400640 1 -- 172.21.15.161:0/1096670242 >> 172.21.15.161:0/1096670242 conn(0x7f26c406a6b0 msgr2=0x7f26c406aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:07.835 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.834+0000 7f26c9400640 1 -- 172.21.15.161:0/1096670242 shutdown_connections 2024-01-17T22:58:07.835 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.834+0000 7f26c9400640 1 -- 172.21.15.161:0/1096670242 wait complete. 2024-01-17T22:58:07.836 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.834+0000 7f26c9400640 1 Processor -- start 2024-01-17T22:58:07.836 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.838+0000 7f26c9400640 1 -- start start 2024-01-17T22:58:07.837 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.838+0000 7f26c9400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26c40c1d30 0x7f26c4141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:07.837 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.838+0000 7f26c9400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26c40c9050 0x7f26c40c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:07.837 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.838+0000 7f26c9400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26c41517a0 0x7f26c41f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:07.838 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.838+0000 7f26c9400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c40c4c90 con 0x7f26c40c9050 2024-01-17T22:58:07.838 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.838+0000 7f26c9400640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c406bd50 con 0x7f26c41517a0 2024-01-17T22:58:07.838 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.838+0000 7f26c9400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c41f5910 con 0x7f26c40c1d30 2024-01-17T22:58:07.838 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.838+0000 7f26c3200640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26c41517a0 0x7f26c41f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:07.839 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.838+0000 7f26c3200640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26c41517a0 0x7f26c41f6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:34594/0 (socket says 172.21.15.161:34594) 2024-01-17T22:58:07.839 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.838+0000 7f26c3200640 1 -- 172.21.15.161:0/3704937300 learned_addr learned my addr 172.21.15.161:0/3704937300 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:07.844 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.842+0000 7f26c2800640 1 --2- 172.21.15.161:0/3704937300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26c40c1d30 0x7f26c4141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:07.850 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.850+0000 7f26c3200640 1 -- 172.21.15.161:0/3704937300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26c40c1d30 msgr2=0x7f26c4141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:07.850 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.850+0000 7f26c3200640 1 --2- 172.21.15.161:0/3704937300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26c40c1d30 0x7f26c4141b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:07.850 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.850+0000 7f26c3200640 1 -- 172.21.15.161:0/3704937300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26c40c9050 msgr2=0x7f26c40c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:07.850 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.850+0000 7f26c3200640 1 --2- 172.21.15.161:0/3704937300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26c40c9050 0x7f26c40c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:07.850 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.850+0000 7f26c3200640 1 -- 172.21.15.161:0/3704937300 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b4009420 con 0x7f26c41517a0 2024-01-17T22:58:07.856 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.854+0000 7f26c3200640 1 --2- 172.21.15.161:0/3704937300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26c41517a0 0x7f26c41f6080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00efc0 tx=0x7f26bc00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:07.869 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.870+0000 7f26baa00640 1 -- 172.21.15.161:0/3704937300 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc009ba0 con 0x7f26c41517a0 2024-01-17T22:58:07.870 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.870+0000 7f26baa00640 1 -- 172.21.15.161:0/3704937300 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc00f040 con 0x7f26c41517a0 2024-01-17T22:58:07.870 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.870+0000 7f26baa00640 1 -- 172.21.15.161:0/3704937300 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc0146c0 con 0x7f26c41517a0 2024-01-17T22:58:07.870 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.870+0000 7f26c9400640 1 -- 172.21.15.161:0/3704937300 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c41f5bf0 con 0x7f26c41517a0 2024-01-17T22:58:07.870 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.870+0000 7f26c9400640 1 -- 172.21.15.161:0/3704937300 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c40b1a00 con 0x7f26c41517a0 2024-01-17T22:58:07.870 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:07.870+0000 7f26c9400640 1 -- 172.21.15.161:0/3704937300 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c40673f0 con 0x7f26c41517a0 2024-01-17T22:58:08.171 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.170+0000 7f26baa00640 1 -- 172.21.15.161:0/3704937300 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 2) v1 ==== 43034+0+0 (secure 0 0 0) 0x7f26bc014820 con 0x7f26c41517a0 2024-01-17T22:58:08.216 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.218+0000 7f26baa00640 1 -- 172.21.15.161:0/3704937300 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f26bc014ad0 con 0x7f26c41517a0 2024-01-17T22:58:08.224 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.222+0000 7f26baa00640 1 -- 172.21.15.161:0/3704937300 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f26bc01d400 con 0x7f26c41517a0 2024-01-17T22:58:08.280 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.282+0000 7f26c9400640 1 -- 172.21.15.161:0/3704937300 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26c41f5d80 con 0x7f26c41517a0 2024-01-17T22:58:08.296 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:08.294+0000 7f5c3f600640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-17T22:58:08.502 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.502+0000 7f26baa00640 1 -- 172.21.15.161:0/3704937300 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mgrmap(e 3) v1 ==== 85831+0+0 (secure 0 0 0) 0x7f26bc014d10 con 0x7f26c41517a0 2024-01-17T22:58:08.503 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.502+0000 7f26baa00640 1 --2- 172.21.15.161:0/3704937300 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f269c066e10 0x7f269c069200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:08.503 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.502+0000 7f26c2800640 1 --2- 172.21.15.161:0/3704937300 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f269c066e10 0x7f269c069200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:08.504 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.506+0000 7f26c2800640 1 --2- 172.21.15.161:0/3704937300 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f269c066e10 0x7f269c069200 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f26b40ad000 tx=0x7f26b40a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:08.702 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-17T22:58:08.702+0000 7f5c3f600640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-17T22:58:08.848 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.850+0000 7f26baa00640 1 -- 172.21.15.161:0/3704937300 <== mon.1 v2:172.21.15.190:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f26bc054b90 con 0x7f26c41517a0 2024-01-17T22:58:08.848 INFO:teuthology.misc.health.smithi161.stdout: 2024-01-17T22:58:08.849 INFO:teuthology.misc.health.smithi161.stdout:{"epoch":10,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:58:05.988359+0000","last_up_change":"0.000000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:58:08.850 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.850+0000 7f26c9400640 1 -- 172.21.15.161:0/3704937300 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f269c066e10 msgr2=0x7f269c069200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:08.850 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.850+0000 7f26c9400640 1 --2- 172.21.15.161:0/3704937300 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f269c066e10 0x7f269c069200 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f26b40ad000 tx=0x7f26b40a6000 comp rx=0 tx=0).stop 2024-01-17T22:58:08.850 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.850+0000 7f26c9400640 1 -- 172.21.15.161:0/3704937300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26c41517a0 msgr2=0x7f26c41f6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:08.850 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.850+0000 7f26c9400640 1 --2- 172.21.15.161:0/3704937300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26c41517a0 0x7f26c41f6080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00efc0 tx=0x7f26bc00c490 comp rx=0 tx=0).stop 2024-01-17T22:58:08.850 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.850+0000 7f26c9400640 1 -- 172.21.15.161:0/3704937300 shutdown_connections 2024-01-17T22:58:08.850 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.850+0000 7f26c9400640 1 --2- 172.21.15.161:0/3704937300 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f269c066e10 0x7f269c069200 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:08.850 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.850+0000 7f26c9400640 1 --2- 172.21.15.161:0/3704937300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26c41517a0 0x7f26c41f6080 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:08.850 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.850+0000 7f26c9400640 1 --2- 172.21.15.161:0/3704937300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26c40c9050 0x7f26c40c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:08.850 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.850+0000 7f26c9400640 1 --2- 172.21.15.161:0/3704937300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26c40c1d30 0x7f26c4141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:08.850 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.850+0000 7f26c9400640 1 -- 172.21.15.161:0/3704937300 >> 172.21.15.161:0/3704937300 conn(0x7f26c406a6b0 msgr2=0x7f26c40cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:08.850 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.850+0000 7f26c9400640 1 -- 172.21.15.161:0/3704937300 shutdown_connections 2024-01-17T22:58:08.850 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:08.850+0000 7f26c9400640 1 -- 172.21.15.161:0/3704937300 wait complete. 2024-01-17T22:58:08.867 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-17T22:58:10.194 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-01-17T22:58:10.187+0000 7f096407f640 -1 osd.5 0 log_to_monitors true 2024-01-17T22:58:10.565 INFO:tasks.ceph.osd.0.smithi161.stderr:2024-01-17T22:58:10.566+0000 7f84db961640 -1 osd.0 0 log_to_monitors true 2024-01-17T22:58:10.584 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-01-17T22:58:10.579+0000 7f1461e3b640 -1 osd.7 0 log_to_monitors true 2024-01-17T22:58:10.671 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-01-17T22:58:10.667+0000 7f2d4b949640 -1 osd.4 0 log_to_monitors true 2024-01-17T22:58:10.675 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-01-17T22:58:10.674+0000 7f658e4ae640 -1 osd.3 0 log_to_monitors true 2024-01-17T22:58:10.678 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-01-17T22:58:10.671+0000 7fb4e9717640 -1 osd.6 0 log_to_monitors true 2024-01-17T22:58:10.722 INFO:tasks.ceph.osd.2.smithi161.stderr:2024-01-17T22:58:10.722+0000 7fcb6c667640 -1 osd.2 0 log_to_monitors true 2024-01-17T22:58:10.782 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-01-17T22:58:10.782+0000 7f902fb01640 -1 osd.1 0 log_to_monitors true 2024-01-17T22:58:12.556 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-01-17T22:58:12.551+0000 7f0960028640 -1 osd.5 0 waiting for initial osdmap 2024-01-17T22:58:12.616 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-01-17T22:58:12.611+0000 7f0957e63640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-17T22:58:12.785 INFO:tasks.ceph.osd.0.smithi161.stderr:2024-01-17T22:58:12.785+0000 7f84d6800640 -1 osd.0 0 waiting for initial osdmap 2024-01-17T22:58:12.830 INFO:tasks.ceph.osd.0.smithi161.stderr:2024-01-17T22:58:12.829+0000 7f84cc800640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-17T22:58:14.143 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-01-17T22:58:14.139+0000 7fb4e56c0640 -1 osd.6 0 waiting for initial osdmap 2024-01-17T22:58:14.199 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-01-17T22:58:14.195+0000 7fb4dd4fb640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-17T22:58:14.309 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-01-17T22:58:14.303+0000 7f145dde4640 -1 osd.7 0 waiting for initial osdmap 2024-01-17T22:58:14.368 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-01-17T22:58:14.363+0000 7f2d478f2640 -1 osd.4 0 waiting for initial osdmap 2024-01-17T22:58:14.395 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-01-17T22:58:14.391+0000 7f1455c1f640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-17T22:58:14.443 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-01-17T22:58:14.439+0000 7f2d3f72d640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-17T22:58:14.497 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-01-17T22:58:14.497+0000 7f6589400640 -1 osd.3 0 waiting for initial osdmap 2024-01-17T22:58:14.500 INFO:tasks.ceph.osd.2.smithi161.stderr:2024-01-17T22:58:14.497+0000 7fcb68000640 -1 osd.2 0 waiting for initial osdmap 2024-01-17T22:58:14.584 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-01-17T22:58:14.585+0000 7f902aa00640 -1 osd.1 0 waiting for initial osdmap 2024-01-17T22:58:14.617 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-01-17T22:58:14.617+0000 7f9020a00640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-17T22:58:14.619 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-01-17T22:58:14.617+0000 7f657f400640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-17T22:58:14.637 INFO:tasks.ceph.osd.2.smithi161.stderr:2024-01-17T22:58:14.637+0000 7fcb5d600640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-17T22:58:15.674 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-17T22:58:15.804 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.805+0000 7f3a63a00640 1 Processor -- start 2024-01-17T22:58:15.804 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.805+0000 7f3a63a00640 1 -- start start 2024-01-17T22:58:15.805 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.805+0000 7f3a63a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3a5c1517a0 0x7f3a5c157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:15.805 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.805+0000 7f3a63a00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3a5c0c9050 0x7f3a5c15b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:15.806 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.805+0000 7f3a63a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a5c0c1d30 0x7f3a5c0ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:15.806 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.805+0000 7f3a63a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5c158510 con 0x7f3a5c1517a0 2024-01-17T22:58:15.806 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.805+0000 7f3a63a00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5c0c8210 con 0x7f3a5c0c9050 2024-01-17T22:58:15.806 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.805+0000 7f3a63a00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c15af60 con 0x7f3a5c0c1d30 2024-01-17T22:58:15.868 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.865+0000 7f3a61000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3a5c1517a0 0x7f3a5c157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:15.872 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.873+0000 7f3a61000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3a5c1517a0 0x7f3a5c157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33434/0 (socket says 172.21.15.161:33434) 2024-01-17T22:58:15.872 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.873+0000 7f3a61000640 1 -- 172.21.15.161:0/3112503835 learned_addr learned my addr 172.21.15.161:0/3112503835 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:15.889 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.889+0000 7f3a61a00640 1 --2- 172.21.15.161:0/3112503835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a5c0c1d30 0x7f3a5c0ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:15.901 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.901+0000 7f3a61000640 1 -- 172.21.15.161:0/3112503835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a5c0c1d30 msgr2=0x7f3a5c0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:15.901 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.901+0000 7f3a61000640 1 --2- 172.21.15.161:0/3112503835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a5c0c1d30 0x7f3a5c0ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:15.901 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.901+0000 7f3a61000640 1 -- 172.21.15.161:0/3112503835 >> v2:172.21.15.190:3300/0 conn(0x7f3a5c0c9050 msgr2=0x7f3a5c15b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:15.902 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.901+0000 7f3a61000640 1 --2- 172.21.15.161:0/3112503835 >> v2:172.21.15.190:3300/0 conn(0x7f3a5c0c9050 0x7f3a5c15b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:15.902 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.901+0000 7f3a61000640 1 -- 172.21.15.161:0/3112503835 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c0c7c70 con 0x7f3a5c1517a0 2024-01-17T22:58:15.914 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.913+0000 7f3a61000640 1 --2- 172.21.15.161:0/3112503835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a5c1517a0 0x7f3a5c157fd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0c7e60 tx=0x7f3a4c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d87e574d3bb651 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:15.922 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.921+0000 7f3a5b400640 1 -- 172.21.15.161:0/3112503835 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c0ac600 con 0x7f3a5c1517a0 2024-01-17T22:58:15.922 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.921+0000 7f3a5b400640 1 -- 172.21.15.161:0/3112503835 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4c0a8050 con 0x7f3a5c1517a0 2024-01-17T22:58:15.922 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.921+0000 7f3a5b400640 1 -- 172.21.15.161:0/3112503835 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c0ac980 con 0x7f3a5c1517a0 2024-01-17T22:58:15.923 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.921+0000 7f3a63a00640 1 -- 172.21.15.161:0/3112503835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a5c1517a0 msgr2=0x7f3a5c157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:15.923 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.921+0000 7f3a63a00640 1 --2- 172.21.15.161:0/3112503835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a5c1517a0 0x7f3a5c157fd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0c7e60 tx=0x7f3a4c01c4d0 comp rx=0 tx=0).stop 2024-01-17T22:58:15.923 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.921+0000 7f3a63a00640 1 -- 172.21.15.161:0/3112503835 shutdown_connections 2024-01-17T22:58:15.923 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.921+0000 7f3a63a00640 1 --2- 172.21.15.161:0/3112503835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a5c0c1d30 0x7f3a5c0ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:15.923 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.921+0000 7f3a63a00640 1 --2- 172.21.15.161:0/3112503835 >> v2:172.21.15.190:3300/0 conn(0x7f3a5c0c9050 0x7f3a5c15b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:15.923 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.921+0000 7f3a63a00640 1 --2- 172.21.15.161:0/3112503835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a5c1517a0 0x7f3a5c157fd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:15.924 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.921+0000 7f3a63a00640 1 -- 172.21.15.161:0/3112503835 >> 172.21.15.161:0/3112503835 conn(0x7f3a5c06a6b0 msgr2=0x7f3a5c06aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:15.924 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.921+0000 7f3a63a00640 1 -- 172.21.15.161:0/3112503835 shutdown_connections 2024-01-17T22:58:15.924 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.921+0000 7f3a63a00640 1 -- 172.21.15.161:0/3112503835 wait complete. 2024-01-17T22:58:15.925 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.925+0000 7f3a63a00640 1 Processor -- start 2024-01-17T22:58:15.925 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.925+0000 7f3a63a00640 1 -- start start 2024-01-17T22:58:15.926 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.925+0000 7f3a63a00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a5c0c1d30 0x7f3a5c150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:15.926 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.925+0000 7f3a63a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a5c0c9050 0x7f3a5c1f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:15.926 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.925+0000 7f3a63a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a5c1517a0 0x7f3a5c152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:15.926 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.925+0000 7f3a63a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c1f26a0 con 0x7f3a5c0c9050 2024-01-17T22:58:15.926 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.925+0000 7f3a63a00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c1529b0 con 0x7f3a5c0c1d30 2024-01-17T22:58:15.926 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.925+0000 7f3a63a00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c1f2350 con 0x7f3a5c1517a0 2024-01-17T22:58:15.945 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.945+0000 7f3a5be00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a5c0c9050 0x7f3a5c1f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:15.945 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.945+0000 7f3a5be00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a5c0c9050 0x7f3a5c1f2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33440/0 (socket says 172.21.15.161:33440) 2024-01-17T22:58:15.945 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.945+0000 7f3a5be00640 1 -- 172.21.15.161:0/3794159065 learned_addr learned my addr 172.21.15.161:0/3794159065 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:15.949 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.949+0000 7f3a5be00640 1 -- 172.21.15.161:0/3794159065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a5c1517a0 msgr2=0x7f3a5c152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:15.949 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.949+0000 7f3a5be00640 1 --2- 172.21.15.161:0/3794159065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a5c1517a0 0x7f3a5c152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:15.949 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.949+0000 7f3a5be00640 1 -- 172.21.15.161:0/3794159065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a5c0c1d30 msgr2=0x7f3a5c150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:15.949 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.949+0000 7f3a5be00640 1 --2- 172.21.15.161:0/3794159065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a5c0c1d30 0x7f3a5c150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:15.950 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.949+0000 7f3a5be00640 1 -- 172.21.15.161:0/3794159065 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c0094d0 con 0x7f3a5c0c9050 2024-01-17T22:58:15.951 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.949+0000 7f3a5be00640 1 --2- 172.21.15.161:0/3794159065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a5c0c9050 0x7f3a5c1f2b30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400b550 tx=0x7f3a4400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:15.957 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.957+0000 7f3a58c00640 1 -- 172.21.15.161:0/3794159065 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44010870 con 0x7f3a5c0c9050 2024-01-17T22:58:15.957 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.957+0000 7f3a58c00640 1 -- 172.21.15.161:0/3794159065 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a440109f0 con 0x7f3a5c0c9050 2024-01-17T22:58:15.957 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.957+0000 7f3a58c00640 1 -- 172.21.15.161:0/3794159065 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44010da0 con 0x7f3a5c0c9050 2024-01-17T22:58:15.957 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.957+0000 7f3a63a00640 1 -- 172.21.15.161:0/3794159065 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5c1f5db0 con 0x7f3a5c0c9050 2024-01-17T22:58:15.957 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.957+0000 7f3a63a00640 1 -- 172.21.15.161:0/3794159065 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5c1f6370 con 0x7f3a5c0c9050 2024-01-17T22:58:15.958 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.957+0000 7f3a63a00640 1 -- 172.21.15.161:0/3794159065 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5c0673f0 con 0x7f3a5c0c9050 2024-01-17T22:58:15.976 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.973+0000 7f3a58c00640 1 -- 172.21.15.161:0/3794159065 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 4) v1 ==== 85937+0+0 (secure 0 0 0) 0x7f3a44023480 con 0x7f3a5c0c9050 2024-01-17T22:58:15.976 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.977+0000 7f3a58c00640 1 --2- 172.21.15.161:0/3794159065 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3a34066800 0x7f3a34068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:15.977 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.977+0000 7f3a61000640 1 --2- 172.21.15.161:0/3794159065 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3a34066800 0x7f3a34068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:15.977 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.977+0000 7f3a61000640 1 --2- 172.21.15.161:0/3794159065 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3a34066800 0x7f3a34068cc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0ae000 tx=0x7f3a4c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:15.978 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:15.977+0000 7f3a58c00640 1 -- 172.21.15.161:0/3794159065 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4846+0+0 (secure 0 0 0) 0x7f3a44055b30 con 0x7f3a5c0c9050 2024-01-17T22:58:16.211 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:16.209+0000 7f3a58c00640 1 -- 172.21.15.161:0/3794159065 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f3a44051770 con 0x7f3a5c0c9050 2024-01-17T22:58:16.377 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:16.377+0000 7f3a63a00640 1 -- 172.21.15.161:0/3794159065 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a5c04e980 con 0x7f3a5c0c9050 2024-01-17T22:58:16.497 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:16.497+0000 7f3a58c00640 1 -- 172.21.15.161:0/3794159065 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12742 (secure 0 0 0) 0x7f3a4401e020 con 0x7f3a5c0c9050 2024-01-17T22:58:16.497 INFO:teuthology.misc.health.smithi161.stdout: 2024-01-17T22:58:16.497 INFO:teuthology.misc.health.smithi161.stdout:{"epoch":15,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:58:15.452106+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:58:16.500 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:16.497+0000 7f3a63a00640 1 -- 172.21.15.161:0/3794159065 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3a34066800 msgr2=0x7f3a34068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:16.500 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:16.497+0000 7f3a63a00640 1 --2- 172.21.15.161:0/3794159065 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3a34066800 0x7f3a34068cc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0ae000 tx=0x7f3a4c008040 comp rx=0 tx=0).stop 2024-01-17T22:58:16.500 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:16.497+0000 7f3a63a00640 1 -- 172.21.15.161:0/3794159065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a5c0c9050 msgr2=0x7f3a5c1f2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:16.500 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:16.497+0000 7f3a63a00640 1 --2- 172.21.15.161:0/3794159065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a5c0c9050 0x7f3a5c1f2b30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400b550 tx=0x7f3a4400ba10 comp rx=0 tx=0).stop 2024-01-17T22:58:16.500 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:16.497+0000 7f3a63a00640 1 -- 172.21.15.161:0/3794159065 shutdown_connections 2024-01-17T22:58:16.500 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:16.497+0000 7f3a63a00640 1 --2- 172.21.15.161:0/3794159065 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3a34066800 0x7f3a34068cc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:16.500 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:16.497+0000 7f3a63a00640 1 --2- 172.21.15.161:0/3794159065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a5c1517a0 0x7f3a5c152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:16.500 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:16.497+0000 7f3a63a00640 1 --2- 172.21.15.161:0/3794159065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a5c0c9050 0x7f3a5c1f2b30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:16.500 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:16.497+0000 7f3a63a00640 1 --2- 172.21.15.161:0/3794159065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a5c0c1d30 0x7f3a5c150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:16.500 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:16.497+0000 7f3a63a00640 1 -- 172.21.15.161:0/3794159065 >> 172.21.15.161:0/3794159065 conn(0x7f3a5c06a6b0 msgr2=0x7f3a5c14ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:16.501 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:16.497+0000 7f3a63a00640 1 -- 172.21.15.161:0/3794159065 shutdown_connections 2024-01-17T22:58:16.501 INFO:teuthology.misc.health.smithi161.stderr:2024-01-17T22:58:16.497+0000 7f3a63a00640 1 -- 172.21.15.161:0/3794159065 wait complete. 2024-01-17T22:58:16.522 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-17T22:58:16.522 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-17T22:58:16.522 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-17T22:58:16.523 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-17T22:58:16.523 DEBUG:teuthology.orchestra.run.smithi161:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-01-17T22:58:16.526 INFO:tasks.ceph.mds.a:Started 2024-01-17T22:58:16.526 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-17T22:58:16.526 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-17T22:58:16.527 DEBUG:teuthology.orchestra.run.smithi161:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-01-17T22:58:16.530 INFO:tasks.ceph.mds.c:Started 2024-01-17T22:58:16.530 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-17T22:58:16.530 INFO:tasks.ceph.mds.e:Restarting daemon 2024-01-17T22:58:16.530 DEBUG:teuthology.orchestra.run.smithi161:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-01-17T22:58:16.533 INFO:tasks.ceph.mds.e:Started 2024-01-17T22:58:16.533 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-17T22:58:16.533 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-17T22:58:16.533 DEBUG:teuthology.orchestra.run.smithi190:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-01-17T22:58:16.536 INFO:tasks.ceph.mds.b:Started 2024-01-17T22:58:16.536 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-17T22:58:16.536 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-17T22:58:16.537 DEBUG:teuthology.orchestra.run.smithi190:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-01-17T22:58:16.539 INFO:tasks.ceph.mds.d:Started 2024-01-17T22:58:16.539 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-17T22:58:16.540 INFO:tasks.ceph.mds.f:Restarting daemon 2024-01-17T22:58:16.540 DEBUG:teuthology.orchestra.run.smithi190:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-01-17T22:58:16.542 INFO:tasks.ceph.mds.f:Started 2024-01-17T22:58:16.543 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-17T22:58:16.543 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T22:58:16.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.705+0000 7f5df0800640 1 Processor -- start 2024-01-17T22:58:16.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.705+0000 7f5df0800640 1 -- start start 2024-01-17T22:58:16.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.709+0000 7f5df0800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de81508d0 0x7f5de806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:16.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.709+0000 7f5df0800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de80c1450 con 0x7f5de8156fe0 2024-01-17T22:58:16.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.709+0000 7f5df0800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de80c1730 con 0x7f5de8156b80 2024-01-17T22:58:16.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.709+0000 7f5df0800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de8159820 con 0x7f5de81508d0 2024-01-17T22:58:16.710 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.709+0000 7f5dee800640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f5de8156b80 0x7f5de8157ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.161:53274/0 (socket says 172.21.15.161:53274) 2024-01-17T22:58:16.710 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.709+0000 7f5dee800640 1 -- 172.21.15.161:0/1655705753 learned_addr learned my addr 172.21.15.161:0/1655705753 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:58:16.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.709+0000 7f5dede00640 1 --2- 172.21.15.161:0/1655705753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de81508d0 0x7f5de806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:16.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.717+0000 7f5dede00640 1 -- 172.21.15.161:0/1655705753 >> v1:172.21.15.190:6789/0 conn(0x7f5de8156b80 legacy=0x7f5de8157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:16.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.717+0000 7f5dede00640 1 -- 172.21.15.161:0/1655705753 >> v1:172.21.15.161:6789/0 conn(0x7f5de8156fe0 legacy=0x7f5de8156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:16.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.717+0000 7f5dede00640 1 -- 172.21.15.161:0/1655705753 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de80c1a10 con 0x7f5de81508d0 2024-01-17T22:58:16.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.729+0000 7f5dede00640 1 --2- 172.21.15.161:0/1655705753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de81508d0 0x7f5de806e980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5dd80097f0 tx=0x7f5dd801ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a3b2d11bd63f5 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:16.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.733+0000 7f5deca00640 1 -- 172.21.15.161:0/1655705753 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd80a8970 con 0x7f5de81508d0 2024-01-17T22:58:16.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.733+0000 7f5deca00640 1 -- 172.21.15.161:0/1655705753 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd80a8ad0 con 0x7f5de81508d0 2024-01-17T22:58:16.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.733+0000 7f5deca00640 1 -- 172.21.15.161:0/1655705753 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd80a8e60 con 0x7f5de81508d0 2024-01-17T22:58:16.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.733+0000 7f5df0800640 1 -- 172.21.15.161:0/1655705753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de81508d0 msgr2=0x7f5de806e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:16.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.733+0000 7f5df0800640 1 --2- 172.21.15.161:0/1655705753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de81508d0 0x7f5de806e980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5dd80097f0 tx=0x7f5dd801ec70 comp rx=0 tx=0).stop 2024-01-17T22:58:16.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.737+0000 7f5df0800640 1 -- 172.21.15.161:0/1655705753 shutdown_connections 2024-01-17T22:58:16.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.737+0000 7f5df0800640 1 --2- 172.21.15.161:0/1655705753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de81508d0 0x7f5de806e980 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:16.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.737+0000 7f5df0800640 1 -- 172.21.15.161:0/1655705753 >> 172.21.15.161:0/1655705753 conn(0x7f5de806fc50 msgr2=0x7f5de8070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:16.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.737+0000 7f5df0800640 1 -- 172.21.15.161:0/1655705753 shutdown_connections 2024-01-17T22:58:16.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.737+0000 7f5df0800640 1 -- 172.21.15.161:0/1655705753 wait complete. 2024-01-17T22:58:16.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.737+0000 7f5df0800640 1 Processor -- start 2024-01-17T22:58:16.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.737+0000 7f5df0800640 1 -- start start 2024-01-17T22:58:16.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.741+0000 7f5df0800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5de81508d0 0x7f5de814f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:16.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.741+0000 7f5df0800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5de8156fe0 0x7f5de80c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:16.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.741+0000 7f5df0800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de81564b0 0x7f5de81e3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:16.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.741+0000 7f5df0800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de80c6980 con 0x7f5de81508d0 2024-01-17T22:58:16.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.741+0000 7f5df0800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de80c9650 con 0x7f5de8156fe0 2024-01-17T22:58:16.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.741+0000 7f5df0800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de80c6bd0 con 0x7f5de81564b0 2024-01-17T22:58:16.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.741+0000 7f5dee800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de81564b0 0x7f5de81e3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:16.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.741+0000 7f5dee800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de81564b0 0x7f5de81e3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:50978/0 (socket says 172.21.15.161:50978) 2024-01-17T22:58:16.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.741+0000 7f5dee800640 1 -- 172.21.15.161:0/810160961 learned_addr learned my addr 172.21.15.161:0/810160961 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:16.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.745+0000 7f5dee800640 1 -- 172.21.15.161:0/810160961 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5de8156fe0 msgr2=0x7f5de80c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:16.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.745+0000 7f5dee800640 1 --2- 172.21.15.161:0/810160961 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5de8156fe0 0x7f5de80c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:16.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.745+0000 7f5dee800640 1 -- 172.21.15.161:0/810160961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5de81508d0 msgr2=0x7f5de814f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:16.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.745+0000 7f5dee800640 1 --2- 172.21.15.161:0/810160961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5de81508d0 0x7f5de814f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:16.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.749+0000 7f5dee800640 1 -- 172.21.15.161:0/810160961 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd8009420 con 0x7f5de81564b0 2024-01-17T22:58:16.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.753+0000 7f5dee800640 1 --2- 172.21.15.161:0/810160961 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de81564b0 0x7f5de81e3c90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5de000ca30 tx=0x7f5de000cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:16.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.845+0000 7f5de6000640 1 -- 172.21.15.161:0/810160961 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de000abd0 con 0x7f5de81564b0 2024-01-17T22:58:16.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.845+0000 7f5de6000640 1 -- 172.21.15.161:0/810160961 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de000ad30 con 0x7f5de81564b0 2024-01-17T22:58:16.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.845+0000 7f5de6000640 1 -- 172.21.15.161:0/810160961 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0012620 con 0x7f5de81564b0 2024-01-17T22:58:16.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.849+0000 7f5df0800640 1 -- 172.21.15.161:0/810160961 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de80c6eb0 con 0x7f5de81564b0 2024-01-17T22:58:16.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.849+0000 7f5df0800640 1 -- 172.21.15.161:0/810160961 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de80c92e0 con 0x7f5de81564b0 2024-01-17T22:58:16.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:16.849+0000 7f5df0800640 1 -- 172.21.15.161:0/810160961 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de8067c90 con 0x7f5de81564b0 2024-01-17T22:58:17.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.209+0000 7f5de6000640 1 -- 172.21.15.161:0/810160961 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 4) v1 ==== 85937+0+0 (secure 0 0 0) 0x7f5de0007070 con 0x7f5de81564b0 2024-01-17T22:58:17.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.213+0000 7f5de6000640 1 --2- 172.21.15.161:0/810160961 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5dc0066800 0x7f5dc0068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:17.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.213+0000 7f5dede00640 1 --2- 172.21.15.161:0/810160961 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5dc0066800 0x7f5dc0068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:17.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.213+0000 7f5dede00640 1 --2- 172.21.15.161:0/810160961 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5dc0066800 0x7f5dc0068cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5dd80b2000 tx=0x7f5dd8004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:17.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.217+0000 7f5de6000640 1 -- 172.21.15.161:0/810160961 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4846+0+0 (secure 0 0 0) 0x7f5de0055a80 con 0x7f5de81564b0 2024-01-17T22:58:17.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.241+0000 7f5de6000640 1 -- 172.21.15.161:0/810160961 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f5de00516c0 con 0x7f5de81564b0 2024-01-17T22:58:17.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.429+0000 7f5df0800640 1 -- 172.21.15.161:0/810160961 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5de80c9470 con 0x7f5de81564b0 2024-01-17T22:58:17.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.569+0000 7f5de6000640 1 -- 172.21.15.161:0/810160961 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12866 (secure 0 0 0) 0x7f5de0017090 con 0x7f5de81564b0 2024-01-17T22:58:17.573 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:58:17.573 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":16,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:58:16.816607+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.614036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.689096+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.706485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.680048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.571249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:58:17.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.577+0000 7f5df0800640 1 -- 172.21.15.161:0/810160961 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5dc0066800 msgr2=0x7f5dc0068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:17.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.577+0000 7f5df0800640 1 --2- 172.21.15.161:0/810160961 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5dc0066800 0x7f5dc0068cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5dd80b2000 tx=0x7f5dd8004740 comp rx=0 tx=0).stop 2024-01-17T22:58:17.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.577+0000 7f5df0800640 1 -- 172.21.15.161:0/810160961 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de81564b0 msgr2=0x7f5de81e3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:17.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.577+0000 7f5df0800640 1 --2- 172.21.15.161:0/810160961 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de81564b0 0x7f5de81e3c90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5de000ca30 tx=0x7f5de000cef0 comp rx=0 tx=0).stop 2024-01-17T22:58:17.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.577+0000 7f5df0800640 1 -- 172.21.15.161:0/810160961 shutdown_connections 2024-01-17T22:58:17.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.577+0000 7f5df0800640 1 --2- 172.21.15.161:0/810160961 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5dc0066800 0x7f5dc0068cc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:17.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.577+0000 7f5df0800640 1 --2- 172.21.15.161:0/810160961 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5de8156fe0 0x7f5de80c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:17.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.577+0000 7f5df0800640 1 --2- 172.21.15.161:0/810160961 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de81564b0 0x7f5de81e3c90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:17.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.577+0000 7f5df0800640 1 --2- 172.21.15.161:0/810160961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5de81508d0 0x7f5de814f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:17.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.577+0000 7f5df0800640 1 -- 172.21.15.161:0/810160961 >> 172.21.15.161:0/810160961 conn(0x7f5de806fc50 msgr2=0x7f5de815ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:17.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.577+0000 7f5df0800640 1 -- 172.21.15.161:0/810160961 shutdown_connections 2024-01-17T22:58:17.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.577+0000 7f5df0800640 1 -- 172.21.15.161:0/810160961 wait complete. 2024-01-17T22:58:17.619 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-17T22:58:14.876386+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-17T22:58:17.620 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-17T22:58:17.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.773+0000 7fc77e000640 1 Processor -- start 2024-01-17T22:58:17.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.773+0000 7fc77e000640 1 -- start start 2024-01-17T22:58:17.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.773+0000 7fc77e000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc7781506d0 0x7fc778156af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:17.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.777+0000 7fc77e000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7780b1d40 0x7fc7780c8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:17.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.777+0000 7fc77e000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc778156660 con 0x7fc778157030 2024-01-17T22:58:17.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.777+0000 7fc77e000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7780c2b00 con 0x7fc7781506d0 2024-01-17T22:58:17.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.777+0000 7fc77e000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77806d5a0 con 0x7fc7780b1d40 2024-01-17T22:58:17.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.777+0000 7fc776a00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc778157030 0x7fc7780c7a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:46830/0 (socket says 172.21.15.161:46830) 2024-01-17T22:58:17.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.777+0000 7fc776a00640 1 -- 172.21.15.161:0/3924462892 learned_addr learned my addr 172.21.15.161:0/3924462892 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:58:17.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.781+0000 7fc777400640 1 --2- 172.21.15.161:0/3924462892 >> v2:172.21.15.161:3300/0 conn(0x7fc7781506d0 0x7fc778156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:17.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.781+0000 7fc776000640 1 -- 172.21.15.161:0/3924462892 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152336561 0 0) 0x7fc778156660 con 0x7fc778157030 2024-01-17T22:58:17.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.781+0000 7fc776000640 1 -- 172.21.15.161:0/3924462892 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc758003530 con 0x7fc778157030 2024-01-17T22:58:17.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.785+0000 7fc776000640 1 -- 172.21.15.161:0/3924462892 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1433906685 0 0) 0x7fc758003530 con 0x7fc778157030 2024-01-17T22:58:17.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.785+0000 7fc776000640 1 -- 172.21.15.161:0/3924462892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7780b1d40 msgr2=0x7fc7780c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:17.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.785+0000 7fc776000640 1 --2- 172.21.15.161:0/3924462892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7780b1d40 0x7fc7780c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:17.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.785+0000 7fc776000640 1 -- 172.21.15.161:0/3924462892 >> v2:172.21.15.161:3300/0 conn(0x7fc7781506d0 msgr2=0x7fc778156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:17.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.785+0000 7fc776000640 1 --2- 172.21.15.161:0/3924462892 >> v2:172.21.15.161:3300/0 conn(0x7fc7781506d0 0x7fc778156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:17.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.785+0000 7fc776000640 1 -- 172.21.15.161:0/3924462892 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7780c6ef0 con 0x7fc778157030 2024-01-17T22:58:17.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.785+0000 7fc776000640 1 -- 172.21.15.161:0/3924462892 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7fc760001680 con 0x7fc778157030 2024-01-17T22:58:17.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.785+0000 7fc776000640 1 -- 172.21.15.161:0/3924462892 >> v1:172.21.15.161:6789/0 conn(0x7fc778157030 legacy=0x7fc7780c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:17.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.785+0000 7fc776000640 1 --2- 172.21.15.161:0/3924462892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7780b1d40 0x7fc758003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:17.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.785+0000 7fc776000640 1 --2- 172.21.15.161:0/3924462892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc758003ec0 0x7fc7580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:17.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.785+0000 7fc776000640 1 --2- 172.21.15.161:0/3924462892 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc758004d10 0x7fc758005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:17.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.785+0000 7fc776000640 1 -- 172.21.15.161:0/3924462892 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7780c2b00 con 0x7fc758004d10 2024-01-17T22:58:17.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.785+0000 7fc776000640 1 -- 172.21.15.161:0/3924462892 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75800ffa0 con 0x7fc758003ec0 2024-01-17T22:58:17.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.785+0000 7fc776000640 1 -- 172.21.15.161:0/3924462892 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580100e0 con 0x7fc7780b1d40 2024-01-17T22:58:17.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.793+0000 7fc777e00640 1 --2- 172.21.15.161:0/3924462892 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc758004d10 0x7fc758005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:17.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.797+0000 7fc777e00640 1 -- 172.21.15.161:0/3924462892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7780b1d40 msgr2=0x7fc758003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:17.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.797+0000 7fc777e00640 1 --2- 172.21.15.161:0/3924462892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc7780b1d40 0x7fc758003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:17.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.797+0000 7fc777e00640 1 -- 172.21.15.161:0/3924462892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc758003ec0 msgr2=0x7fc7580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:17.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.797+0000 7fc777e00640 1 --2- 172.21.15.161:0/3924462892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc758003ec0 0x7fc7580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:17.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.797+0000 7fc777e00640 1 -- 172.21.15.161:0/3924462892 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc758003530 con 0x7fc758004d10 2024-01-17T22:58:17.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.805+0000 7fc777e00640 1 --2- 172.21.15.161:0/3924462892 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc758004d10 0x7fc758005190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc770009ca0 tx=0x7fc77001cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8c0c8e5ee9e3dc server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:17.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.809+0000 7fc776000640 1 -- 172.21.15.161:0/3924462892 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7700a5c60 con 0x7fc758004d10 2024-01-17T22:58:17.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.809+0000 7fc776000640 1 -- 172.21.15.161:0/3924462892 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7700a5de0 con 0x7fc758004d10 2024-01-17T22:58:17.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.813+0000 7fc77e000640 1 -- 172.21.15.161:0/3924462892 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc758004d10 msgr2=0x7fc758005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:17.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.813+0000 7fc77e000640 1 --2- 172.21.15.161:0/3924462892 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc758004d10 0x7fc758005190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc770009ca0 tx=0x7fc77001cc50 comp rx=0 tx=0).stop 2024-01-17T22:58:17.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.813+0000 7fc777e00640 1 -- 172.21.15.161:0/3924462892 reap_dead start 2024-01-17T22:58:17.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.813+0000 7fc77e000640 1 -- 172.21.15.161:0/3924462892 shutdown_connections 2024-01-17T22:58:17.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.813+0000 7fc77e000640 1 -- 172.21.15.161:0/3924462892 >> 172.21.15.161:0/3924462892 conn(0x7fc7780c89c0 msgr2=0x7fc7780c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:17.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.813+0000 7fc77e000640 1 -- 172.21.15.161:0/3924462892 shutdown_connections 2024-01-17T22:58:17.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.813+0000 7fc77e000640 1 -- 172.21.15.161:0/3924462892 wait complete. 2024-01-17T22:58:17.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.813+0000 7fc77e000640 1 Processor -- start 2024-01-17T22:58:17.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.817+0000 7fc77e000640 1 -- start start 2024-01-17T22:58:17.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.817+0000 7fc77e000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7780c1140 0x7fc7780c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:17.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.817+0000 7fc77e000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7780c1520 0x7fc7781eace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:17.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.817+0000 7fc77e000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc778151830 0x7fc7781eb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:17.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.817+0000 7fc77e000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7781edfe0 con 0x7fc7780c1520 2024-01-17T22:58:17.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.817+0000 7fc77e000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7781eee40 con 0x7fc7780c1140 2024-01-17T22:58:17.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.817+0000 7fc77e000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7780c1c60 con 0x7fc778151830 2024-01-17T22:58:17.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.817+0000 7fc776a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7780c1520 0x7fc7781eace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:17.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.817+0000 7fc776a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7780c1520 0x7fc7781eace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33496/0 (socket says 172.21.15.161:33496) 2024-01-17T22:58:17.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.817+0000 7fc776a00640 1 -- 172.21.15.161:0/3570996089 learned_addr learned my addr 172.21.15.161:0/3570996089 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:17.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.821+0000 7fc777e00640 1 --2- 172.21.15.161:0/3570996089 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc778151830 0x7fc7781eb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:17.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.821+0000 7fc776a00640 1 -- 172.21.15.161:0/3570996089 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc778151830 msgr2=0x7fc7781eb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:17.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.821+0000 7fc776a00640 1 --2- 172.21.15.161:0/3570996089 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc778151830 0x7fc7781eb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:17.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.821+0000 7fc776a00640 1 -- 172.21.15.161:0/3570996089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7780c1140 msgr2=0x7fc7780c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:17.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.821+0000 7fc776a00640 1 --2- 172.21.15.161:0/3570996089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7780c1140 0x7fc7780c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:17.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.821+0000 7fc776a00640 1 -- 172.21.15.161:0/3570996089 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7781ee230 con 0x7fc7780c1520 2024-01-17T22:58:17.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.825+0000 7fc776a00640 1 --2- 172.21.15.161:0/3570996089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7780c1520 0x7fc7781eace0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc76000caa0 tx=0x7fc76000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:17.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.837+0000 7fc76f400640 1 -- 172.21.15.161:0/3570996089 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760004cc0 con 0x7fc7780c1520 2024-01-17T22:58:17.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.837+0000 7fc77e000640 1 -- 172.21.15.161:0/3570996089 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7781ee510 con 0x7fc7780c1520 2024-01-17T22:58:17.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.837+0000 7fc77e000640 1 -- 172.21.15.161:0/3570996089 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7781eead0 con 0x7fc7780c1520 2024-01-17T22:58:17.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.837+0000 7fc76f400640 1 -- 172.21.15.161:0/3570996089 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc760004e20 con 0x7fc7780c1520 2024-01-17T22:58:17.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.837+0000 7fc76f400640 1 -- 172.21.15.161:0/3570996089 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760007310 con 0x7fc7780c1520 2024-01-17T22:58:17.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:17.837+0000 7fc77e000640 1 -- 172.21.15.161:0/3570996089 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7480052a0 con 0x7fc7780c1520 2024-01-17T22:58:18.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.233+0000 7fc76f400640 1 -- 172.21.15.161:0/3570996089 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 4) v1 ==== 85937+0+0 (secure 0 0 0) 0x7fc760007470 con 0x7fc7780c1520 2024-01-17T22:58:18.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.233+0000 7fc76f400640 1 --2- 172.21.15.161:0/3570996089 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc750066830 0x7fc750068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:18.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.237+0000 7fc777400640 1 --2- 172.21.15.161:0/3570996089 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc750066830 0x7fc750068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:18.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.237+0000 7fc777400640 1 --2- 172.21.15.161:0/3570996089 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc750066830 0x7fc750068cf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc768006aa0 tx=0x7fc768004780 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:18.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.261+0000 7fc76f400640 1 -- 172.21.15.161:0/3570996089 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc760007720 con 0x7fc7780c1520 2024-01-17T22:58:18.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.261+0000 7fc76f400640 1 -- 172.21.15.161:0/3570996089 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fc7600510e0 con 0x7fc7780c1520 2024-01-17T22:58:18.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.433+0000 7fc77e000640 1 -- 172.21.15.161:0/3570996089 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc748005ad0 con 0x7fc7780c1520 2024-01-17T22:58:18.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.461+0000 7fc76f400640 1 -- 172.21.15.161:0/3570996089 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc760018070 con 0x7fc7780c1520 2024-01-17T22:58:18.460 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-01-17T22:58:18.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.461+0000 7fc77e000640 1 -- 172.21.15.161:0/3570996089 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc750066830 msgr2=0x7fc750068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:18.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.461+0000 7fc77e000640 1 --2- 172.21.15.161:0/3570996089 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc750066830 0x7fc750068cf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc768006aa0 tx=0x7fc768004780 comp rx=0 tx=0).stop 2024-01-17T22:58:18.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.461+0000 7fc77e000640 1 -- 172.21.15.161:0/3570996089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7780c1520 msgr2=0x7fc7781eace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:18.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.461+0000 7fc77e000640 1 --2- 172.21.15.161:0/3570996089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7780c1520 0x7fc7781eace0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc76000caa0 tx=0x7fc76000cf60 comp rx=0 tx=0).stop 2024-01-17T22:58:18.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.461+0000 7fc77e000640 1 -- 172.21.15.161:0/3570996089 shutdown_connections 2024-01-17T22:58:18.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.461+0000 7fc77e000640 1 --2- 172.21.15.161:0/3570996089 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc750066830 0x7fc750068cf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:18.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.461+0000 7fc77e000640 1 --2- 172.21.15.161:0/3570996089 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc778151830 0x7fc7781eb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:18.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.461+0000 7fc77e000640 1 --2- 172.21.15.161:0/3570996089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7780c1520 0x7fc7781eace0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:18.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.461+0000 7fc77e000640 1 --2- 172.21.15.161:0/3570996089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7780c1140 0x7fc7780c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:18.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.461+0000 7fc77e000640 1 -- 172.21.15.161:0/3570996089 >> 172.21.15.161:0/3570996089 conn(0x7fc7780c89c0 msgr2=0x7fc778070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:18.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.461+0000 7fc77e000640 1 -- 172.21.15.161:0/3570996089 shutdown_connections 2024-01-17T22:58:18.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.461+0000 7fc77e000640 1 -- 172.21.15.161:0/3570996089 wait complete. 2024-01-17T22:58:18.493 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T22:58:18.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.661+0000 7fa3b7400640 1 Processor -- start 2024-01-17T22:58:18.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.661+0000 7fa3b7400640 1 -- start start 2024-01-17T22:58:18.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.665+0000 7fa3b7400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa3b0156fe0 0x7fa3b0156470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:18.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.665+0000 7fa3b7400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa3b01569b0 0x7fa3b0157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:18.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.665+0000 7fa3b7400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b00c1450 con 0x7fa3b01508d0 2024-01-17T22:58:18.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.665+0000 7fa3b7400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b0159820 con 0x7fa3b0156fe0 2024-01-17T22:58:18.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.665+0000 7fa3b7400640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b0156e00 con 0x7fa3b01569b0 2024-01-17T22:58:18.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.665+0000 7fa3b5400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa3b01569b0 0x7fa3b0157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:18.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.665+0000 7fa3afe00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa3b0156fe0 0x7fa3b0156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:18.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.665+0000 7fa3b5400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa3b01569b0 0x7fa3b0157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:39842/0 (socket says 172.21.15.161:39842) 2024-01-17T22:58:18.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.665+0000 7fa3b5400640 1 -- 172.21.15.161:0/4246393855 learned_addr learned my addr 172.21.15.161:0/4246393855 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:18.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.669+0000 7fa3b5400640 1 -- 172.21.15.161:0/4246393855 >> v2:172.21.15.161:3300/0 conn(0x7fa3b0156fe0 msgr2=0x7fa3b0156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:18.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.669+0000 7fa3b5400640 1 --2- 172.21.15.161:0/4246393855 >> v2:172.21.15.161:3300/0 conn(0x7fa3b0156fe0 0x7fa3b0156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:18.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.669+0000 7fa3b5400640 1 -- 172.21.15.161:0/4246393855 >> v1:172.21.15.161:6789/0 conn(0x7fa3b01508d0 legacy=0x7fa3b006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:18.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.669+0000 7fa3b5400640 1 -- 172.21.15.161:0/4246393855 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b00c1730 con 0x7fa3b01569b0 2024-01-17T22:58:18.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.677+0000 7fa3b5400640 1 --2- 172.21.15.161:0/4246393855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b01569b0 0x7fa3b0157ec0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0071f00 tx=0x7fa3a801f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6a0caf53259660d server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:18.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.681+0000 7fa3af400640 1 -- 172.21.15.161:0/4246393855 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a80af400 con 0x7fa3b01569b0 2024-01-17T22:58:18.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.681+0000 7fa3af400640 1 -- 172.21.15.161:0/4246393855 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a80ab050 con 0x7fa3b01569b0 2024-01-17T22:58:18.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.681+0000 7fa3af400640 1 -- 172.21.15.161:0/4246393855 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a80af780 con 0x7fa3b01569b0 2024-01-17T22:58:18.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.681+0000 7fa3b7400640 1 -- 172.21.15.161:0/4246393855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b01569b0 msgr2=0x7fa3b0157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:18.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.681+0000 7fa3b7400640 1 --2- 172.21.15.161:0/4246393855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b01569b0 0x7fa3b0157ec0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0071f00 tx=0x7fa3a801f1c0 comp rx=0 tx=0).stop 2024-01-17T22:58:18.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.685+0000 7fa3b7400640 1 -- 172.21.15.161:0/4246393855 shutdown_connections 2024-01-17T22:58:18.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.685+0000 7fa3b7400640 1 --2- 172.21.15.161:0/4246393855 >> v2:172.21.15.161:3300/0 conn(0x7fa3b0156fe0 0x7fa3b0156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:18.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.685+0000 7fa3b7400640 1 --2- 172.21.15.161:0/4246393855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b01569b0 0x7fa3b0157ec0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:18.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.685+0000 7fa3b7400640 1 -- 172.21.15.161:0/4246393855 >> 172.21.15.161:0/4246393855 conn(0x7fa3b006fc50 msgr2=0x7fa3b0070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:18.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.685+0000 7fa3b7400640 1 -- 172.21.15.161:0/4246393855 shutdown_connections 2024-01-17T22:58:18.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.685+0000 7fa3b7400640 1 -- 172.21.15.161:0/4246393855 wait complete. 2024-01-17T22:58:18.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.685+0000 7fa3b7400640 1 Processor -- start 2024-01-17T22:58:18.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.685+0000 7fa3b7400640 1 -- start start 2024-01-17T22:58:18.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.689+0000 7fa3b7400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b01508d0 0x7fa3b0150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:18.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.689+0000 7fa3b7400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b01569b0 0x7fa3b0152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:18.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.689+0000 7fa3b7400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3b0156fe0 0x7fa3b01f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:18.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.689+0000 7fa3b7400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b0151ba0 con 0x7fa3b0156fe0 2024-01-17T22:58:18.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.689+0000 7fa3b7400640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b01f6d80 con 0x7fa3b01508d0 2024-01-17T22:58:18.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.689+0000 7fa3b7400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b01f7be0 con 0x7fa3b01569b0 2024-01-17T22:58:18.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.689+0000 7fa3afe00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b01569b0 0x7fa3b0152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:18.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.689+0000 7fa3b5400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3b0156fe0 0x7fa3b01f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:18.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.689+0000 7fa3b4a00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b01508d0 0x7fa3b0150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:18.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.689+0000 7fa3b5400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3b0156fe0 0x7fa3b01f3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33512/0 (socket says 172.21.15.161:33512) 2024-01-17T22:58:18.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.689+0000 7fa3b5400640 1 -- 172.21.15.161:0/1995960711 learned_addr learned my addr 172.21.15.161:0/1995960711 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:18.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.693+0000 7fa3afe00640 1 -- 172.21.15.161:0/1995960711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b01508d0 msgr2=0x7fa3b0150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:18.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.693+0000 7fa3afe00640 1 --2- 172.21.15.161:0/1995960711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b01508d0 0x7fa3b0150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:18.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.693+0000 7fa3afe00640 1 -- 172.21.15.161:0/1995960711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3b0156fe0 msgr2=0x7fa3b01f3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:18.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.693+0000 7fa3afe00640 1 --2- 172.21.15.161:0/1995960711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3b0156fe0 0x7fa3b01f3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:18.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.697+0000 7fa3afe00640 1 -- 172.21.15.161:0/1995960711 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a8009b30 con 0x7fa3b01569b0 2024-01-17T22:58:18.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.701+0000 7fa3afe00640 1 --2- 172.21.15.161:0/1995960711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b01569b0 0x7fa3b0152ca0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa39800e8a0 tx=0x7fa39800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:18.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.705+0000 7fa3acc00640 1 -- 172.21.15.161:0/1995960711 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398009e80 con 0x7fa3b01569b0 2024-01-17T22:58:18.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.705+0000 7fa3acc00640 1 -- 172.21.15.161:0/1995960711 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39800c940 con 0x7fa3b01569b0 2024-01-17T22:58:18.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.705+0000 7fa3acc00640 1 -- 172.21.15.161:0/1995960711 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39800ccb0 con 0x7fa3b01569b0 2024-01-17T22:58:18.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.705+0000 7fa3b7400640 1 -- 172.21.15.161:0/1995960711 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b0151320 con 0x7fa3b01569b0 2024-01-17T22:58:18.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.705+0000 7fa3b7400640 1 -- 172.21.15.161:0/1995960711 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b01f72b0 con 0x7fa3b01569b0 2024-01-17T22:58:18.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.709+0000 7fa3b7400640 1 -- 172.21.15.161:0/1995960711 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b01f3860 con 0x7fa3b01569b0 2024-01-17T22:58:18.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.741+0000 7fa3acc00640 1 -- 172.21.15.161:0/1995960711 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 4) v1 ==== 85937+0+0 (secure 0 0 0) 0x7fa398013470 con 0x7fa3b01569b0 2024-01-17T22:58:18.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.745+0000 7fa3acc00640 1 --2- 172.21.15.161:0/1995960711 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa388066830 0x7fa388068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:18.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.745+0000 7fa3b4a00640 1 --2- 172.21.15.161:0/1995960711 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa388066830 0x7fa388068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:18.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.745+0000 7fa3b4a00640 1 --2- 172.21.15.161:0/1995960711 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa388066830 0x7fa388068cf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0001810 tx=0x7fa3a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:18.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:18.749+0000 7fa3acc00640 1 -- 172.21.15.161:0/1995960711 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa398055780 con 0x7fa3b01569b0 2024-01-17T22:58:19.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:19.045+0000 7fa3acc00640 1 -- 172.21.15.161:0/1995960711 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fa398051ac0 con 0x7fa3b01569b0 2024-01-17T22:58:19.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:19.317+0000 7fa3b7400640 1 -- 172.21.15.161:0/1995960711 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3b0067c90 con 0x7fa3b01569b0 2024-01-17T22:58:19.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:19.661+0000 7fa3acc00640 1 -- 172.21.15.161:0/1995960711 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fa398051e90 con 0x7fa3b01569b0 2024-01-17T22:58:19.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:19.749+0000 7fa3acc00640 1 -- 172.21.15.161:0/1995960711 <== mon.2 v2:172.21.15.190:3301/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7fa39807f4c0 con 0x7fa3b01569b0 2024-01-17T22:58:19.750 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:58:19.750 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-17T22:58:19.750 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 1 2024-01-17T22:58:19.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:19.753+0000 7fa3b7400640 1 -- 172.21.15.161:0/1995960711 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa388066830 msgr2=0x7fa388068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:19.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:19.753+0000 7fa3b7400640 1 --2- 172.21.15.161:0/1995960711 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa388066830 0x7fa388068cf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0001810 tx=0x7fa3a0009040 comp rx=0 tx=0).stop 2024-01-17T22:58:19.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:19.753+0000 7fa3b7400640 1 -- 172.21.15.161:0/1995960711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b01569b0 msgr2=0x7fa3b0152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:19.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:19.753+0000 7fa3b7400640 1 --2- 172.21.15.161:0/1995960711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b01569b0 0x7fa3b0152ca0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa39800e8a0 tx=0x7fa39800ed60 comp rx=0 tx=0).stop 2024-01-17T22:58:19.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:19.753+0000 7fa3b7400640 1 -- 172.21.15.161:0/1995960711 shutdown_connections 2024-01-17T22:58:19.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:19.753+0000 7fa3b7400640 1 --2- 172.21.15.161:0/1995960711 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa388066830 0x7fa388068cf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:19.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:19.753+0000 7fa3b7400640 1 --2- 172.21.15.161:0/1995960711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3b0156fe0 0x7fa3b01f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:19.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:19.753+0000 7fa3b7400640 1 --2- 172.21.15.161:0/1995960711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b01569b0 0x7fa3b0152ca0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:19.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:19.753+0000 7fa3b7400640 1 --2- 172.21.15.161:0/1995960711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b01508d0 0x7fa3b0150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:19.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:19.753+0000 7fa3b7400640 1 -- 172.21.15.161:0/1995960711 >> 172.21.15.161:0/1995960711 conn(0x7fa3b006fc50 msgr2=0x7fa3b0157dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:19.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:19.753+0000 7fa3b7400640 1 -- 172.21.15.161:0/1995960711 shutdown_connections 2024-01-17T22:58:19.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:19.753+0000 7fa3b7400640 1 -- 172.21.15.161:0/1995960711 wait complete. 2024-01-17T22:58:21.789 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T22:58:22.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.025+0000 7f8aebe00640 1 Processor -- start 2024-01-17T22:58:22.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.025+0000 7f8aebe00640 1 -- start start 2024-01-17T22:58:22.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.025+0000 7f8aebe00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8ae40c9450 0x7f8ae406a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:22.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.025+0000 7f8aebe00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8ae406ac20 0x7f8ae40ae970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:22.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.025+0000 7f8aebe00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ae40c9830 0x7f8ae40aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:22.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.025+0000 7f8aebe00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae415e010 con 0x7f8ae406ac20 2024-01-17T22:58:22.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.025+0000 7f8aebe00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae40c8620 con 0x7f8ae40c9450 2024-01-17T22:58:22.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.025+0000 7f8aebe00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40c8ab0 con 0x7f8ae40c9830 2024-01-17T22:58:22.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.029+0000 7f8aea800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ae40c9830 0x7f8ae40aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:22.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.029+0000 7f8ae8a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8ae406ac20 0x7f8ae40ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:22.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.029+0000 7f8aea800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ae40c9830 0x7f8ae40aeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:60008/0 (socket says 172.21.15.161:60008) 2024-01-17T22:58:22.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.029+0000 7f8aea800640 1 -- 172.21.15.161:0/724178616 learned_addr learned my addr 172.21.15.161:0/724178616 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:22.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.029+0000 7f8ae9400640 1 --2- 172.21.15.161:0/724178616 >> v2:172.21.15.190:3300/0 conn(0x7f8ae40c9450 0x7f8ae406a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:22.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.033+0000 7f8aea800640 1 -- 172.21.15.161:0/724178616 >> v2:172.21.15.190:3300/0 conn(0x7f8ae40c9450 msgr2=0x7f8ae406a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:22.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.033+0000 7f8aea800640 1 --2- 172.21.15.161:0/724178616 >> v2:172.21.15.190:3300/0 conn(0x7f8ae40c9450 0x7f8ae406a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:22.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.033+0000 7f8aea800640 1 -- 172.21.15.161:0/724178616 >> v2:172.21.15.161:3300/0 conn(0x7f8ae406ac20 msgr2=0x7f8ae40ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:22.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.033+0000 7f8aea800640 1 --2- 172.21.15.161:0/724178616 >> v2:172.21.15.161:3300/0 conn(0x7f8ae406ac20 0x7f8ae40ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:22.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.033+0000 7f8aea800640 1 -- 172.21.15.161:0/724178616 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae40c36d0 con 0x7f8ae40c9830 2024-01-17T22:58:22.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.037+0000 7f8aea800640 1 --2- 172.21.15.161:0/724178616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ae40c9830 0x7f8ae40aeeb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4071240 tx=0x7f8adc01f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dc6eafe65c08943 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:22.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.045+0000 7f8ae3e00640 1 -- 172.21.15.161:0/724178616 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0af400 con 0x7f8ae40c9830 2024-01-17T22:58:22.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.045+0000 7f8ae3e00640 1 -- 172.21.15.161:0/724178616 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc0ab050 con 0x7f8ae40c9830 2024-01-17T22:58:22.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.045+0000 7f8ae3e00640 1 -- 172.21.15.161:0/724178616 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0af780 con 0x7f8ae40c9830 2024-01-17T22:58:22.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.045+0000 7f8aebe00640 1 -- 172.21.15.161:0/724178616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ae40c9830 msgr2=0x7f8ae40aeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:22.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.045+0000 7f8aebe00640 1 --2- 172.21.15.161:0/724178616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ae40c9830 0x7f8ae40aeeb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4071240 tx=0x7f8adc01f1c0 comp rx=0 tx=0).stop 2024-01-17T22:58:22.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.045+0000 7f8aebe00640 1 -- 172.21.15.161:0/724178616 shutdown_connections 2024-01-17T22:58:22.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.045+0000 7f8aebe00640 1 --2- 172.21.15.161:0/724178616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ae40c9830 0x7f8ae40aeeb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:22.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.045+0000 7f8aebe00640 1 --2- 172.21.15.161:0/724178616 >> v2:172.21.15.161:3300/0 conn(0x7f8ae406ac20 0x7f8ae40ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:22.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.045+0000 7f8aebe00640 1 --2- 172.21.15.161:0/724178616 >> v2:172.21.15.190:3300/0 conn(0x7f8ae40c9450 0x7f8ae406a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:22.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.045+0000 7f8aebe00640 1 -- 172.21.15.161:0/724178616 >> 172.21.15.161:0/724178616 conn(0x7f8ae40705c0 msgr2=0x7f8ae40709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:22.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.045+0000 7f8aebe00640 1 -- 172.21.15.161:0/724178616 shutdown_connections 2024-01-17T22:58:22.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.045+0000 7f8aebe00640 1 -- 172.21.15.161:0/724178616 wait complete. 2024-01-17T22:58:22.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.049+0000 7f8aebe00640 1 Processor -- start 2024-01-17T22:58:22.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.049+0000 7f8aebe00640 1 -- start start 2024-01-17T22:58:22.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.049+0000 7f8aebe00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ae406ac20 0x7f8ae41f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:22.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.049+0000 7f8aebe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ae40c9450 0x7f8ae415a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:22.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.049+0000 7f8aebe00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ae40c9830 0x7f8ae40c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:22.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.049+0000 7f8aebe00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae41f7240 con 0x7f8ae40c9450 2024-01-17T22:58:22.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.049+0000 7f8aebe00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae41f63e0 con 0x7f8ae406ac20 2024-01-17T22:58:22.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.049+0000 7f8aebe00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae41f6630 con 0x7f8ae40c9830 2024-01-17T22:58:22.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.049+0000 7f8aea800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ae40c9830 0x7f8ae40c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:22.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.053+0000 7f8aea800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ae40c9830 0x7f8ae40c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:60016/0 (socket says 172.21.15.161:60016) 2024-01-17T22:58:22.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.053+0000 7f8aea800640 1 -- 172.21.15.161:0/3538579680 learned_addr learned my addr 172.21.15.161:0/3538579680 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:22.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.053+0000 7f8ae8a00640 1 --2- 172.21.15.161:0/3538579680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ae40c9450 0x7f8ae415a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:22.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.053+0000 7f8ae9400640 1 --2- 172.21.15.161:0/3538579680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ae406ac20 0x7f8ae41f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:22.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.057+0000 7f8aea800640 1 -- 172.21.15.161:0/3538579680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ae406ac20 msgr2=0x7f8ae41f3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:22.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.057+0000 7f8aea800640 1 --2- 172.21.15.161:0/3538579680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ae406ac20 0x7f8ae41f3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:22.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.057+0000 7f8aea800640 1 -- 172.21.15.161:0/3538579680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ae40c9450 msgr2=0x7f8ae415a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:22.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.057+0000 7f8aea800640 1 --2- 172.21.15.161:0/3538579680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ae40c9450 0x7f8ae415a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:22.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.057+0000 7f8aea800640 1 -- 172.21.15.161:0/3538579680 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc009b30 con 0x7f8ae40c9830 2024-01-17T22:58:22.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.061+0000 7f8aea800640 1 --2- 172.21.15.161:0/3538579680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ae40c9830 0x7f8ae40c5c90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8adc01cdf0 tx=0x7f8adc01bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:22.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.069+0000 7f8ae1600640 1 -- 172.21.15.161:0/3538579680 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0afc00 con 0x7f8ae40c9830 2024-01-17T22:58:22.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.069+0000 7f8ae1600640 1 -- 172.21.15.161:0/3538579680 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc0afd80 con 0x7f8ae40c9830 2024-01-17T22:58:22.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.069+0000 7f8ae1600640 1 -- 172.21.15.161:0/3538579680 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0b9650 con 0x7f8ae40c9830 2024-01-17T22:58:22.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.069+0000 7f8aebe00640 1 -- 172.21.15.161:0/3538579680 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae41f6910 con 0x7f8ae40c9830 2024-01-17T22:58:22.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.069+0000 7f8aebe00640 1 -- 172.21.15.161:0/3538579680 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae41f6ed0 con 0x7f8ae40c9830 2024-01-17T22:58:22.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.069+0000 7f8aebe00640 1 -- 172.21.15.161:0/3538579680 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae40746a0 con 0x7f8ae40c9830 2024-01-17T22:58:22.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.097+0000 7f8ae1600640 1 -- 172.21.15.161:0/3538579680 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f8adc0b6070 con 0x7f8ae40c9830 2024-01-17T22:58:22.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.097+0000 7f8ae1600640 1 --2- 172.21.15.161:0/3538579680 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8abc066890 0x7f8abc068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:22.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.101+0000 7f8ae9400640 1 --2- 172.21.15.161:0/3538579680 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8abc066890 0x7f8abc068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:22.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.101+0000 7f8ae9400640 1 --2- 172.21.15.161:0/3538579680 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8abc066890 0x7f8abc068d50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40079e0 tx=0x7f8ad4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:22.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.361+0000 7f8ae1600640 1 -- 172.21.15.161:0/3538579680 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8adc0f37f0 con 0x7f8ae40c9830 2024-01-17T22:58:22.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.381+0000 7f8ae1600640 1 -- 172.21.15.161:0/3538579680 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f8adc0efb30 con 0x7f8ae40c9830 2024-01-17T22:58:22.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:22.789+0000 7f8aebe00640 1 -- 172.21.15.161:0/3538579680 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ae40b2980 con 0x7f8ae40c9830 2024-01-17T22:58:24.333 INFO:tasks.ceph.mds.f.smithi190.stdout:starting mds.f at 2024-01-17T22:58:24.446 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2024-01-17T22:58:24.497 INFO:tasks.ceph.mds.c.smithi161.stdout:starting mds.c at 2024-01-17T22:58:24.547 INFO:tasks.ceph.mds.e.smithi161.stdout:starting mds.e at 2024-01-17T22:58:25.509 INFO:tasks.ceph.mds.a.smithi161.stdout:starting mds.a at 2024-01-17T22:58:25.611 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2024-01-17T22:58:30.147 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T22:58:30.151 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T22:58:31.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:31.073+0000 7f8ae1600640 1 -- 172.21.15.161:0/3538579680 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f8adc0b4020 con 0x7f8ae40c9830 2024-01-17T22:58:31.077 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:58:31.077 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-17T22:58:31.078 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 1 2024-01-17T22:58:31.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:31.077+0000 7f8aebe00640 1 -- 172.21.15.161:0/3538579680 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8abc066890 msgr2=0x7f8abc068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:31.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:31.077+0000 7f8aebe00640 1 --2- 172.21.15.161:0/3538579680 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8abc066890 0x7f8abc068d50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40079e0 tx=0x7f8ad4008040 comp rx=0 tx=0).stop 2024-01-17T22:58:31.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:31.077+0000 7f8aebe00640 1 -- 172.21.15.161:0/3538579680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ae40c9830 msgr2=0x7f8ae40c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:31.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:31.077+0000 7f8aebe00640 1 --2- 172.21.15.161:0/3538579680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ae40c9830 0x7f8ae40c5c90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8adc01cdf0 tx=0x7f8adc01bf60 comp rx=0 tx=0).stop 2024-01-17T22:58:31.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:31.077+0000 7f8aebe00640 1 -- 172.21.15.161:0/3538579680 shutdown_connections 2024-01-17T22:58:31.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:31.077+0000 7f8aebe00640 1 --2- 172.21.15.161:0/3538579680 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8abc066890 0x7f8abc068d50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:31.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:31.077+0000 7f8aebe00640 1 --2- 172.21.15.161:0/3538579680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ae40c9830 0x7f8ae40c5c90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:31.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:31.077+0000 7f8aebe00640 1 --2- 172.21.15.161:0/3538579680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ae40c9450 0x7f8ae415a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:31.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:31.077+0000 7f8aebe00640 1 --2- 172.21.15.161:0/3538579680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ae406ac20 0x7f8ae41f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:31.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:31.077+0000 7f8aebe00640 1 -- 172.21.15.161:0/3538579680 >> 172.21.15.161:0/3538579680 conn(0x7f8ae40705c0 msgr2=0x7f8ae40cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:31.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:31.077+0000 7f8aebe00640 1 -- 172.21.15.161:0/3538579680 shutdown_connections 2024-01-17T22:58:31.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:31.077+0000 7f8aebe00640 1 -- 172.21.15.161:0/3538579680 wait complete. 2024-01-17T22:58:33.109 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T22:58:33.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.257+0000 7f1c51800640 1 Processor -- start 2024-01-17T22:58:33.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.257+0000 7f1c51800640 1 -- start start 2024-01-17T22:58:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.257+0000 7f1c51800640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1c4c14ff10 0x7f1c4c156590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.257+0000 7f1c51800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c4c0c6480 0x7f1c4c06d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.257+0000 7f1c51800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1c4c0c68c0 0x7f1c4c06dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.257+0000 7f1c51800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c159ad0 con 0x7f1c4c0c68c0 2024-01-17T22:58:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.257+0000 7f1c51800640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c156ad0 con 0x7f1c4c14ff10 2024-01-17T22:58:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.257+0000 7f1c51800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c06cc20 con 0x7f1c4c0c6480 2024-01-17T22:58:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.257+0000 7f1c4b400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1c4c0c68c0 0x7f1c4c06dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.257+0000 7f1c4b400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1c4c0c68c0 0x7f1c4c06dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:51522/0 (socket says 172.21.15.161:51522) 2024-01-17T22:58:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.257+0000 7f1c4b400640 1 -- 172.21.15.161:0/96933797 learned_addr learned my addr 172.21.15.161:0/96933797 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.261+0000 7f1c4a000640 1 --2- 172.21.15.161:0/96933797 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c4c0c6480 0x7f1c4c06d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.261+0000 7f1c4aa00640 1 --2- 172.21.15.161:0/96933797 >> v2:172.21.15.190:3300/0 conn(0x7f1c4c14ff10 0x7f1c4c156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:33.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.261+0000 7f1c4b400640 1 -- 172.21.15.161:0/96933797 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c4c0c6480 msgr2=0x7f1c4c06d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:33.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.261+0000 7f1c4b400640 1 --2- 172.21.15.161:0/96933797 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c4c0c6480 0x7f1c4c06d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:33.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.261+0000 7f1c4b400640 1 -- 172.21.15.161:0/96933797 >> v2:172.21.15.190:3300/0 conn(0x7f1c4c14ff10 msgr2=0x7f1c4c156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:33.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.261+0000 7f1c4b400640 1 --2- 172.21.15.161:0/96933797 >> v2:172.21.15.190:3300/0 conn(0x7f1c4c14ff10 0x7f1c4c156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:33.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.261+0000 7f1c4b400640 1 -- 172.21.15.161:0/96933797 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c06cf00 con 0x7f1c4c0c68c0 2024-01-17T22:58:33.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.265+0000 7f1c4b400640 1 --2- 172.21.15.161:0/96933797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c4c0c68c0 0x7f1c4c06dc70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c074b30 tx=0x7f1c4401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65f7d10749d56b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:33.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.269+0000 7f1c49600640 1 -- 172.21.15.161:0/96933797 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c440af400 con 0x7f1c4c0c68c0 2024-01-17T22:58:33.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.269+0000 7f1c49600640 1 -- 172.21.15.161:0/96933797 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c440ab050 con 0x7f1c4c0c68c0 2024-01-17T22:58:33.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.269+0000 7f1c49600640 1 -- 172.21.15.161:0/96933797 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c440af780 con 0x7f1c4c0c68c0 2024-01-17T22:58:33.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.269+0000 7f1c51800640 1 -- 172.21.15.161:0/96933797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c4c0c68c0 msgr2=0x7f1c4c06dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:33.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.269+0000 7f1c51800640 1 --2- 172.21.15.161:0/96933797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c4c0c68c0 0x7f1c4c06dc70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c074b30 tx=0x7f1c4401f1c0 comp rx=0 tx=0).stop 2024-01-17T22:58:33.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.269+0000 7f1c51800640 1 -- 172.21.15.161:0/96933797 shutdown_connections 2024-01-17T22:58:33.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.269+0000 7f1c51800640 1 --2- 172.21.15.161:0/96933797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c4c0c68c0 0x7f1c4c06dc70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:33.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.269+0000 7f1c51800640 1 --2- 172.21.15.161:0/96933797 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c4c0c6480 0x7f1c4c06d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:33.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.269+0000 7f1c51800640 1 --2- 172.21.15.161:0/96933797 >> v2:172.21.15.190:3300/0 conn(0x7f1c4c14ff10 0x7f1c4c156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:33.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.269+0000 7f1c51800640 1 -- 172.21.15.161:0/96933797 >> 172.21.15.161:0/96933797 conn(0x7f1c4c0cb070 msgr2=0x7f1c4c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:33.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.269+0000 7f1c51800640 1 -- 172.21.15.161:0/96933797 shutdown_connections 2024-01-17T22:58:33.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.273+0000 7f1c51800640 1 -- 172.21.15.161:0/96933797 wait complete. 2024-01-17T22:58:33.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.273+0000 7f1c51800640 1 Processor -- start 2024-01-17T22:58:33.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.273+0000 7f1c51800640 1 -- start start 2024-01-17T22:58:33.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.273+0000 7f1c51800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c4c0c6480 0x7f1c4c143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:33.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.273+0000 7f1c51800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c4c0c68c0 0x7f1c4c14e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:33.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.273+0000 7f1c51800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c4c14ff10 0x7f1c4c149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:33.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.273+0000 7f1c51800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c1490e0 con 0x7f1c4c14ff10 2024-01-17T22:58:33.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.273+0000 7f1c51800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c147b00 con 0x7f1c4c0c68c0 2024-01-17T22:58:33.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.273+0000 7f1c51800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c147de0 con 0x7f1c4c0c6480 2024-01-17T22:58:33.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.273+0000 7f1c4b400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c4c14ff10 0x7f1c4c149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:33.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.273+0000 7f1c4b400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c4c14ff10 0x7f1c4c149570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:51534/0 (socket says 172.21.15.161:51534) 2024-01-17T22:58:33.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.273+0000 7f1c4b400640 1 -- 172.21.15.161:0/2342697981 learned_addr learned my addr 172.21.15.161:0/2342697981 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:33.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.277+0000 7f1c4aa00640 1 --2- 172.21.15.161:0/2342697981 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c4c0c6480 0x7f1c4c143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:33.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.277+0000 7f1c4a000640 1 --2- 172.21.15.161:0/2342697981 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c4c0c68c0 0x7f1c4c14e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:33.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.277+0000 7f1c4b400640 1 -- 172.21.15.161:0/2342697981 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c4c0c6480 msgr2=0x7f1c4c143300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:33.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.277+0000 7f1c4b400640 1 --2- 172.21.15.161:0/2342697981 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c4c0c6480 0x7f1c4c143300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:33.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.277+0000 7f1c4b400640 1 -- 172.21.15.161:0/2342697981 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c4c0c68c0 msgr2=0x7f1c4c14e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:33.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.277+0000 7f1c4b400640 1 --2- 172.21.15.161:0/2342697981 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c4c0c68c0 0x7f1c4c14e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:33.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.281+0000 7f1c4b400640 1 -- 172.21.15.161:0/2342697981 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c44009b30 con 0x7f1c4c14ff10 2024-01-17T22:58:33.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.281+0000 7f1c4b400640 1 --2- 172.21.15.161:0/2342697981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c4c14ff10 0x7f1c4c149570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1c4401fa60 tx=0x7f1c4401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:33.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.285+0000 7f1c42a00640 1 -- 172.21.15.161:0/2342697981 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c440c1070 con 0x7f1c4c14ff10 2024-01-17T22:58:33.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.285+0000 7f1c42a00640 1 -- 172.21.15.161:0/2342697981 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c440afb40 con 0x7f1c4c14ff10 2024-01-17T22:58:33.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.285+0000 7f1c42a00640 1 -- 172.21.15.161:0/2342697981 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c440b9410 con 0x7f1c4c14ff10 2024-01-17T22:58:33.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.285+0000 7f1c51800640 1 -- 172.21.15.161:0/2342697981 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4c148a90 con 0x7f1c4c14ff10 2024-01-17T22:58:33.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.285+0000 7f1c51800640 1 -- 172.21.15.161:0/2342697981 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4c14eb90 con 0x7f1c4c14ff10 2024-01-17T22:58:33.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.285+0000 7f1c51800640 1 -- 172.21.15.161:0/2342697981 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c4c1488f0 con 0x7f1c4c14ff10 2024-01-17T22:58:33.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.305+0000 7f1c42a00640 1 -- 172.21.15.161:0/2342697981 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f1c440b6050 con 0x7f1c4c14ff10 2024-01-17T22:58:33.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.305+0000 7f1c42a00640 1 --2- 172.21.15.161:0/2342697981 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f1c24066890 0x7f1c24068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:33.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.305+0000 7f1c4aa00640 1 --2- 172.21.15.161:0/2342697981 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f1c24066890 0x7f1c24068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:33.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.305+0000 7f1c4aa00640 1 --2- 172.21.15.161:0/2342697981 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f1c24066890 0x7f1c24068d50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0079c0 tx=0x7f1c3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:33.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.309+0000 7f1c42a00640 1 -- 172.21.15.161:0/2342697981 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1c440f30b0 con 0x7f1c4c14ff10 2024-01-17T22:58:33.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.537+0000 7f1c42a00640 1 -- 172.21.15.161:0/2342697981 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f1c440ef3f0 con 0x7f1c4c14ff10 2024-01-17T22:58:33.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.721+0000 7f1c51800640 1 -- 172.21.15.161:0/2342697981 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c4c1488f0 con 0x7f1c4c14ff10 2024-01-17T22:58:33.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.729+0000 7f1c42a00640 1 -- 172.21.15.161:0/2342697981 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f1c4c1488f0 con 0x7f1c4c14ff10 2024-01-17T22:58:33.731 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:58:33.731 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-17T22:58:33.732 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 1 2024-01-17T22:58:33.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.733+0000 7f1c51800640 1 -- 172.21.15.161:0/2342697981 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f1c24066890 msgr2=0x7f1c24068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:33.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.733+0000 7f1c51800640 1 --2- 172.21.15.161:0/2342697981 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f1c24066890 0x7f1c24068d50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0079c0 tx=0x7f1c3c008040 comp rx=0 tx=0).stop 2024-01-17T22:58:33.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.733+0000 7f1c51800640 1 -- 172.21.15.161:0/2342697981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c4c14ff10 msgr2=0x7f1c4c149570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:33.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.733+0000 7f1c51800640 1 --2- 172.21.15.161:0/2342697981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c4c14ff10 0x7f1c4c149570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1c4401fa60 tx=0x7f1c4401bf60 comp rx=0 tx=0).stop 2024-01-17T22:58:33.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.733+0000 7f1c51800640 1 -- 172.21.15.161:0/2342697981 shutdown_connections 2024-01-17T22:58:33.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.733+0000 7f1c51800640 1 --2- 172.21.15.161:0/2342697981 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f1c24066890 0x7f1c24068d50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:33.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.733+0000 7f1c51800640 1 --2- 172.21.15.161:0/2342697981 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c4c0c68c0 0x7f1c4c14e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:33.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.733+0000 7f1c51800640 1 --2- 172.21.15.161:0/2342697981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c4c14ff10 0x7f1c4c149570 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:33.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.733+0000 7f1c51800640 1 --2- 172.21.15.161:0/2342697981 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c4c0c6480 0x7f1c4c143300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:33.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.733+0000 7f1c51800640 1 -- 172.21.15.161:0/2342697981 >> 172.21.15.161:0/2342697981 conn(0x7f1c4c0cb070 msgr2=0x7f1c4c0c7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:33.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.733+0000 7f1c51800640 1 -- 172.21.15.161:0/2342697981 shutdown_connections 2024-01-17T22:58:33.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:33.733+0000 7f1c51800640 1 -- 172.21.15.161:0/2342697981 wait complete. 2024-01-17T22:58:35.754 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T22:58:35.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.889+0000 7f8411000640 1 Processor -- start 2024-01-17T22:58:35.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.889+0000 7f8411000640 1 -- start start 2024-01-17T22:58:35.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.889+0000 7f8411000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f840c1539a0 0x7f840c0ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:35.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.889+0000 7f8411000640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f840c0c79c0 0x7f840c061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:35.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.889+0000 7f8411000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f840c061640 0x7f840c15d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:35.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.889+0000 7f8411000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840c06d570 con 0x7f840c1539a0 2024-01-17T22:58:35.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.889+0000 7f8411000640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840c0c9890 con 0x7f840c0c79c0 2024-01-17T22:58:35.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.889+0000 7f8411000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c159bf0 con 0x7f840c061640 2024-01-17T22:58:35.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.889+0000 7f8409e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f840c1539a0 0x7f840c0ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:35.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.889+0000 7f8409e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f840c1539a0 0x7f840c0ca410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:51542/0 (socket says 172.21.15.161:51542) 2024-01-17T22:58:35.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.889+0000 7f8409e00640 1 -- 172.21.15.161:0/1086147052 learned_addr learned my addr 172.21.15.161:0/1086147052 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:35.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.889+0000 7f840a800640 1 --2- 172.21.15.161:0/1086147052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f840c061640 0x7f840c15d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:35.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.889+0000 7f8409400640 1 --2- 172.21.15.161:0/1086147052 >> v2:172.21.15.190:3300/0 conn(0x7f840c0c79c0 0x7f840c061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:35.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.893+0000 7f8409e00640 1 -- 172.21.15.161:0/1086147052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f840c061640 msgr2=0x7f840c15d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:35.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.893+0000 7f8409e00640 1 --2- 172.21.15.161:0/1086147052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f840c061640 0x7f840c15d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:35.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.893+0000 7f8409e00640 1 -- 172.21.15.161:0/1086147052 >> v2:172.21.15.190:3300/0 conn(0x7f840c0c79c0 msgr2=0x7f840c061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:35.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.893+0000 7f8409e00640 1 --2- 172.21.15.161:0/1086147052 >> v2:172.21.15.190:3300/0 conn(0x7f840c0c79c0 0x7f840c061100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:35.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.893+0000 7f8409e00640 1 -- 172.21.15.161:0/1086147052 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c159eb0 con 0x7f840c1539a0 2024-01-17T22:58:35.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.897+0000 7f8409e00640 1 --2- 172.21.15.161:0/1086147052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f840c1539a0 0x7f840c0ca410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f840c0c8150 tx=0x7f83fc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fd2e099dbed790 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:35.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.901+0000 7f8408a00640 1 -- 172.21.15.161:0/1086147052 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc0aa620 con 0x7f840c1539a0 2024-01-17T22:58:35.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.901+0000 7f8408a00640 1 -- 172.21.15.161:0/1086147052 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc0aa780 con 0x7f840c1539a0 2024-01-17T22:58:35.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.901+0000 7f8408a00640 1 -- 172.21.15.161:0/1086147052 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc0aab10 con 0x7f840c1539a0 2024-01-17T22:58:35.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.901+0000 7f8411000640 1 -- 172.21.15.161:0/1086147052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f840c1539a0 msgr2=0x7f840c0ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:35.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.901+0000 7f8411000640 1 --2- 172.21.15.161:0/1086147052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f840c1539a0 0x7f840c0ca410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f840c0c8150 tx=0x7f83fc01c500 comp rx=0 tx=0).stop 2024-01-17T22:58:35.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.901+0000 7f8411000640 1 -- 172.21.15.161:0/1086147052 shutdown_connections 2024-01-17T22:58:35.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.901+0000 7f8411000640 1 --2- 172.21.15.161:0/1086147052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f840c061640 0x7f840c15d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:35.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.901+0000 7f8411000640 1 --2- 172.21.15.161:0/1086147052 >> v2:172.21.15.190:3300/0 conn(0x7f840c0c79c0 0x7f840c061100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:35.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.901+0000 7f8411000640 1 --2- 172.21.15.161:0/1086147052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f840c1539a0 0x7f840c0ca410 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:35.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.901+0000 7f8411000640 1 -- 172.21.15.161:0/1086147052 >> 172.21.15.161:0/1086147052 conn(0x7f840c06ad40 msgr2=0x7f840c06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:35.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.901+0000 7f8411000640 1 -- 172.21.15.161:0/1086147052 shutdown_connections 2024-01-17T22:58:35.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.901+0000 7f8411000640 1 -- 172.21.15.161:0/1086147052 wait complete. 2024-01-17T22:58:35.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.905+0000 7f8411000640 1 Processor -- start 2024-01-17T22:58:35.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.905+0000 7f8411000640 1 -- start start 2024-01-17T22:58:35.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.905+0000 7f8411000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f840c061640 0x7f840c0cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:35.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.905+0000 7f8411000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f840c0c79c0 0x7f840c1412f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:35.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.905+0000 7f8411000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f840c1539a0 0x7f840c070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:35.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.905+0000 7f8411000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c1f64c0 con 0x7f840c1539a0 2024-01-17T22:58:35.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.905+0000 7f8411000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c147890 con 0x7f840c061640 2024-01-17T22:58:35.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.905+0000 7f8411000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c14ae20 con 0x7f840c0c79c0 2024-01-17T22:58:35.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.905+0000 7f840a800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f840c1539a0 0x7f840c070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:35.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.905+0000 7f8409400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f840c0c79c0 0x7f840c1412f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:35.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.905+0000 7f840a800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f840c1539a0 0x7f840c070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:51552/0 (socket says 172.21.15.161:51552) 2024-01-17T22:58:35.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.905+0000 7f840a800640 1 -- 172.21.15.161:0/3578641631 learned_addr learned my addr 172.21.15.161:0/3578641631 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:35.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.905+0000 7f8409e00640 1 --2- 172.21.15.161:0/3578641631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f840c061640 0x7f840c0cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.909+0000 7f840a800640 1 -- 172.21.15.161:0/3578641631 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f840c0c79c0 msgr2=0x7f840c1412f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.909+0000 7f840a800640 1 --2- 172.21.15.161:0/3578641631 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f840c0c79c0 0x7f840c1412f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.909+0000 7f840a800640 1 -- 172.21.15.161:0/3578641631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f840c061640 msgr2=0x7f840c0cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.909+0000 7f840a800640 1 --2- 172.21.15.161:0/3578641631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f840c061640 0x7f840c0cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.909+0000 7f840a800640 1 -- 172.21.15.161:0/3578641631 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc0094d0 con 0x7f840c1539a0 2024-01-17T22:58:35.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.913+0000 7f840a800640 1 --2- 172.21.15.161:0/3578641631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f840c1539a0 0x7f840c070df0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f840400eed0 tx=0x7f840400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:35.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.917+0000 7f8402000640 1 -- 172.21.15.161:0/3578641631 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8404010040 con 0x7f840c1539a0 2024-01-17T22:58:35.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.917+0000 7f8402000640 1 -- 172.21.15.161:0/3578641631 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8404014400 con 0x7f840c1539a0 2024-01-17T22:58:35.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.917+0000 7f8402000640 1 -- 172.21.15.161:0/3578641631 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8404009ea0 con 0x7f840c1539a0 2024-01-17T22:58:35.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.917+0000 7f8411000640 1 -- 172.21.15.161:0/3578641631 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840c1475d0 con 0x7f840c1539a0 2024-01-17T22:58:35.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.917+0000 7f8411000640 1 -- 172.21.15.161:0/3578641631 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840c145d90 con 0x7f840c1539a0 2024-01-17T22:58:35.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.917+0000 7f8411000640 1 -- 172.21.15.161:0/3578641631 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840c06b620 con 0x7f840c1539a0 2024-01-17T22:58:35.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.937+0000 7f8402000640 1 -- 172.21.15.161:0/3578641631 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f84040147b0 con 0x7f840c1539a0 2024-01-17T22:58:35.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.937+0000 7f8402000640 1 --2- 172.21.15.161:0/3578641631 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f83e40668c0 0x7f83e4068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:35.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.937+0000 7f8409e00640 1 --2- 172.21.15.161:0/3578641631 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f83e40668c0 0x7f83e4068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:35.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:35.937+0000 7f8409e00640 1 --2- 172.21.15.161:0/3578641631 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f83e40668c0 0x7f83e4068d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0ae000 tx=0x7f83fc0b5040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:36.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:36.169+0000 7f8402000640 1 -- 172.21.15.161:0/3578641631 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8404055e50 con 0x7f840c1539a0 2024-01-17T22:58:36.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:36.169+0000 7f8402000640 1 -- 172.21.15.161:0/3578641631 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f8404052190 con 0x7f840c1539a0 2024-01-17T22:58:36.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:36.353+0000 7f8411000640 1 -- 172.21.15.161:0/3578641631 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f840c0746a0 con 0x7f840c1539a0 2024-01-17T22:58:36.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:36.361+0000 7f8402000640 1 -- 172.21.15.161:0/3578641631 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f8404018020 con 0x7f840c1539a0 2024-01-17T22:58:36.364 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:58:36.364 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1671527613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1671527613},{"type":"v1","addr":"172.21.15.161:6835","nonce":1671527613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-17T22:58:36.365 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 2 2024-01-17T22:58:36.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:36.365+0000 7f8411000640 1 -- 172.21.15.161:0/3578641631 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f83e40668c0 msgr2=0x7f83e4068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:36.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:36.365+0000 7f8411000640 1 --2- 172.21.15.161:0/3578641631 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f83e40668c0 0x7f83e4068d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0ae000 tx=0x7f83fc0b5040 comp rx=0 tx=0).stop 2024-01-17T22:58:36.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:36.365+0000 7f8411000640 1 -- 172.21.15.161:0/3578641631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f840c1539a0 msgr2=0x7f840c070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:36.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:36.365+0000 7f8411000640 1 --2- 172.21.15.161:0/3578641631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f840c1539a0 0x7f840c070df0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f840400eed0 tx=0x7f840400b480 comp rx=0 tx=0).stop 2024-01-17T22:58:36.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:36.365+0000 7f8411000640 1 -- 172.21.15.161:0/3578641631 shutdown_connections 2024-01-17T22:58:36.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:36.365+0000 7f8411000640 1 --2- 172.21.15.161:0/3578641631 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f83e40668c0 0x7f83e4068d80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:36.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:36.365+0000 7f8411000640 1 --2- 172.21.15.161:0/3578641631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f840c1539a0 0x7f840c070df0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:36.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:36.365+0000 7f8411000640 1 --2- 172.21.15.161:0/3578641631 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f840c0c79c0 0x7f840c1412f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:36.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:36.365+0000 7f8411000640 1 --2- 172.21.15.161:0/3578641631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f840c061640 0x7f840c0cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:36.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:36.365+0000 7f8411000640 1 -- 172.21.15.161:0/3578641631 >> 172.21.15.161:0/3578641631 conn(0x7f840c06ad40 msgr2=0x7f840c06c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:36.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:36.365+0000 7f8411000640 1 -- 172.21.15.161:0/3578641631 shutdown_connections 2024-01-17T22:58:36.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:36.365+0000 7f8411000640 1 -- 172.21.15.161:0/3578641631 wait complete. 2024-01-17T22:58:38.387 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T22:58:38.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.533+0000 7f5fe4a00640 1 Processor -- start 2024-01-17T22:58:38.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.537+0000 7f5fe4a00640 1 -- start start 2024-01-17T22:58:38.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.537+0000 7f5fe4a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5fdc153af0 0x7f5fdc15a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:38.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.537+0000 7f5fe4a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fdc06b7f0 0x7f5fdc15cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:38.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.537+0000 7f5fe4a00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc06bc70 con 0x7f5fdc153ed0 2024-01-17T22:58:38.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.537+0000 7f5fe4a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fdc15d7e0 con 0x7f5fdc153af0 2024-01-17T22:58:38.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.537+0000 7f5fe4a00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc15dd80 con 0x7f5fdc06b7f0 2024-01-17T22:58:38.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.537+0000 7f5fe2000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5fdc153af0 0x7f5fdc15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:38.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.537+0000 7f5fe2000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5fdc153af0 0x7f5fdc15a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:51558/0 (socket says 172.21.15.161:51558) 2024-01-17T22:58:38.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.537+0000 7f5fe2000640 1 -- 172.21.15.161:0/3630845848 learned_addr learned my addr 172.21.15.161:0/3630845848 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:38.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.537+0000 7f5fe2a00640 1 --2- 172.21.15.161:0/3630845848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fdc06b7f0 0x7f5fdc15cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:38.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.541+0000 7f5fe2000640 1 -- 172.21.15.161:0/3630845848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fdc06b7f0 msgr2=0x7f5fdc15cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:38.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.541+0000 7f5fe2000640 1 --2- 172.21.15.161:0/3630845848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fdc06b7f0 0x7f5fdc15cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:38.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.541+0000 7f5fe2000640 1 -- 172.21.15.161:0/3630845848 >> v1:172.21.15.190:6789/0 conn(0x7f5fdc153ed0 legacy=0x7f5fdc0ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:38.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.541+0000 7f5fe2000640 1 -- 172.21.15.161:0/3630845848 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc15daa0 con 0x7f5fdc153af0 2024-01-17T22:58:38.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.545+0000 7f5fe2000640 1 --2- 172.21.15.161:0/3630845848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fdc153af0 0x7f5fdc15a560 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009870 tx=0x7f5fd401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc01cdc064d25ce5 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:38.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.549+0000 7f5fe0c00640 1 -- 172.21.15.161:0/3630845848 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd40ab680 con 0x7f5fdc153af0 2024-01-17T22:58:38.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.549+0000 7f5fe0c00640 1 -- 172.21.15.161:0/3630845848 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd40ab7e0 con 0x7f5fdc153af0 2024-01-17T22:58:38.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.549+0000 7f5fe0c00640 1 -- 172.21.15.161:0/3630845848 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd40abb70 con 0x7f5fdc153af0 2024-01-17T22:58:38.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.549+0000 7f5fe4a00640 1 -- 172.21.15.161:0/3630845848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fdc153af0 msgr2=0x7f5fdc15a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:38.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.549+0000 7f5fe4a00640 1 --2- 172.21.15.161:0/3630845848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fdc153af0 0x7f5fdc15a560 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009870 tx=0x7f5fd401c480 comp rx=0 tx=0).stop 2024-01-17T22:58:38.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.549+0000 7f5fe4a00640 1 -- 172.21.15.161:0/3630845848 shutdown_connections 2024-01-17T22:58:38.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.549+0000 7f5fe4a00640 1 --2- 172.21.15.161:0/3630845848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fdc06b7f0 0x7f5fdc15cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:38.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.549+0000 7f5fe4a00640 1 --2- 172.21.15.161:0/3630845848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fdc153af0 0x7f5fdc15a560 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:38.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.549+0000 7f5fe4a00640 1 -- 172.21.15.161:0/3630845848 >> 172.21.15.161:0/3630845848 conn(0x7f5fdc0704f0 msgr2=0x7f5fdc06f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:38.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.549+0000 7f5fe4a00640 1 -- 172.21.15.161:0/3630845848 shutdown_connections 2024-01-17T22:58:38.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.549+0000 7f5fe4a00640 1 -- 172.21.15.161:0/3630845848 wait complete. 2024-01-17T22:58:38.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.553+0000 7f5fe4a00640 1 Processor -- start 2024-01-17T22:58:38.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.553+0000 7f5fe4a00640 1 -- start start 2024-01-17T22:58:38.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.553+0000 7f5fe4a00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fdc06b7f0 0x7f5fdc141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:38.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.553+0000 7f5fe4a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fdc153af0 0x7f5fdc154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:38.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.553+0000 7f5fe4a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fdc153ed0 0x7f5fdc1388c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:38.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.553+0000 7f5fe4a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc156ac0 con 0x7f5fdc153ed0 2024-01-17T22:58:38.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.553+0000 7f5fe4a00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc1f31c0 con 0x7f5fdc06b7f0 2024-01-17T22:58:38.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.553+0000 7f5fe4a00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0cb400 con 0x7f5fdc153af0 2024-01-17T22:58:38.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.553+0000 7f5fe2a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fdc153ed0 0x7f5fdc1388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:38.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.553+0000 7f5fe2a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fdc153ed0 0x7f5fdc1388c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:51564/0 (socket says 172.21.15.161:51564) 2024-01-17T22:58:38.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.553+0000 7f5fe2a00640 1 -- 172.21.15.161:0/2663017439 learned_addr learned my addr 172.21.15.161:0/2663017439 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:38.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.553+0000 7f5fe2000640 1 --2- 172.21.15.161:0/2663017439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fdc06b7f0 0x7f5fdc141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:38.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.553+0000 7f5fe1600640 1 --2- 172.21.15.161:0/2663017439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fdc153af0 0x7f5fdc154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:38.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.557+0000 7f5fe2a00640 1 -- 172.21.15.161:0/2663017439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fdc153af0 msgr2=0x7f5fdc154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:38.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.557+0000 7f5fe2a00640 1 --2- 172.21.15.161:0/2663017439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fdc153af0 0x7f5fdc154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:38.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.557+0000 7f5fe2a00640 1 -- 172.21.15.161:0/2663017439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fdc06b7f0 msgr2=0x7f5fdc141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:38.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.557+0000 7f5fe2a00640 1 --2- 172.21.15.161:0/2663017439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fdc06b7f0 0x7f5fdc141220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:38.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.557+0000 7f5fe2a00640 1 -- 172.21.15.161:0/2663017439 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd40094d0 con 0x7f5fdc153ed0 2024-01-17T22:58:38.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.561+0000 7f5fe2a00640 1 --2- 172.21.15.161:0/2663017439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fdc153ed0 0x7f5fdc1388c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc007e60 tx=0x7f5fcc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:38.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.565+0000 7f5fda000640 1 -- 172.21.15.161:0/2663017439 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc014420 con 0x7f5fdc153ed0 2024-01-17T22:58:38.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.565+0000 7f5fda000640 1 -- 172.21.15.161:0/2663017439 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc0145a0 con 0x7f5fdc153ed0 2024-01-17T22:58:38.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.565+0000 7f5fda000640 1 -- 172.21.15.161:0/2663017439 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc014950 con 0x7f5fdc153ed0 2024-01-17T22:58:38.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.565+0000 7f5fe4a00640 1 -- 172.21.15.161:0/2663017439 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fdc1f25b0 con 0x7f5fdc153ed0 2024-01-17T22:58:38.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.565+0000 7f5fe4a00640 1 -- 172.21.15.161:0/2663017439 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fdc1f2b70 con 0x7f5fdc153ed0 2024-01-17T22:58:38.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.565+0000 7f5fe4a00640 1 -- 172.21.15.161:0/2663017439 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fdc1f3370 con 0x7f5fdc153ed0 2024-01-17T22:58:38.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.585+0000 7f5fda000640 1 -- 172.21.15.161:0/2663017439 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f5fcc014ab0 con 0x7f5fdc153ed0 2024-01-17T22:58:38.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.585+0000 7f5fda000640 1 --2- 172.21.15.161:0/2663017439 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5fb4066890 0x7f5fb4068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:38.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.585+0000 7f5fe2000640 1 --2- 172.21.15.161:0/2663017439 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5fb4066890 0x7f5fb4068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:38.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.585+0000 7f5fe2000640 1 --2- 172.21.15.161:0/2663017439 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5fb4066890 0x7f5fb4068d50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40af000 tx=0x7f5fd40b6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:38.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.589+0000 7f5fda000640 1 -- 172.21.15.161:0/2663017439 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5fcc0565c0 con 0x7f5fdc153ed0 2024-01-17T22:58:38.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:38.817+0000 7f5fda000640 1 -- 172.21.15.161:0/2663017439 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f5fcc052900 con 0x7f5fdc153ed0 2024-01-17T22:58:39.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:39.001+0000 7f5fe4a00640 1 -- 172.21.15.161:0/2663017439 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fdc1f3330 con 0x7f5fdc153ed0 2024-01-17T22:58:39.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:39.009+0000 7f5fda000640 1 -- 172.21.15.161:0/2663017439 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f5fcc055f20 con 0x7f5fdc153ed0 2024-01-17T22:58:39.011 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:58:39.011 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1671527613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1671527613},{"type":"v1","addr":"172.21.15.161:6835","nonce":1671527613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-17T22:58:39.011 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 2 2024-01-17T22:58:39.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:39.013+0000 7f5fe4a00640 1 -- 172.21.15.161:0/2663017439 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5fb4066890 msgr2=0x7f5fb4068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:39.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:39.013+0000 7f5fe4a00640 1 --2- 172.21.15.161:0/2663017439 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5fb4066890 0x7f5fb4068d50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40af000 tx=0x7f5fd40b6040 comp rx=0 tx=0).stop 2024-01-17T22:58:39.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:39.013+0000 7f5fe4a00640 1 -- 172.21.15.161:0/2663017439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fdc153ed0 msgr2=0x7f5fdc1388c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:39.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:39.013+0000 7f5fe4a00640 1 --2- 172.21.15.161:0/2663017439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fdc153ed0 0x7f5fdc1388c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc007e60 tx=0x7f5fcc00e4b0 comp rx=0 tx=0).stop 2024-01-17T22:58:39.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:39.013+0000 7f5fe4a00640 1 -- 172.21.15.161:0/2663017439 shutdown_connections 2024-01-17T22:58:39.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:39.013+0000 7f5fe4a00640 1 --2- 172.21.15.161:0/2663017439 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5fb4066890 0x7f5fb4068d50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:39.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:39.013+0000 7f5fe4a00640 1 --2- 172.21.15.161:0/2663017439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fdc153ed0 0x7f5fdc1388c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:39.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:39.013+0000 7f5fe4a00640 1 --2- 172.21.15.161:0/2663017439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fdc153af0 0x7f5fdc154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:39.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:39.013+0000 7f5fe4a00640 1 --2- 172.21.15.161:0/2663017439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fdc06b7f0 0x7f5fdc141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:39.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:39.013+0000 7f5fe4a00640 1 -- 172.21.15.161:0/2663017439 >> 172.21.15.161:0/2663017439 conn(0x7f5fdc0704f0 msgr2=0x7f5fdc142610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:39.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:39.013+0000 7f5fe4a00640 1 -- 172.21.15.161:0/2663017439 shutdown_connections 2024-01-17T22:58:39.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:39.013+0000 7f5fe4a00640 1 -- 172.21.15.161:0/2663017439 wait complete. 2024-01-17T22:58:41.034 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T22:58:41.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.181+0000 7f88acc00640 1 Processor -- start 2024-01-17T22:58:41.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.181+0000 7f88acc00640 1 -- start start 2024-01-17T22:58:41.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.181+0000 7f88acc00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88a81582d0 0x7f88a8072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:41.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.181+0000 7f88acc00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a815b9c0 con 0x7f88a81517a0 2024-01-17T22:58:41.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.181+0000 7f88acc00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a815ae40 con 0x7f88a8072300 2024-01-17T22:58:41.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.181+0000 7f88acc00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a815b120 con 0x7f88a81582d0 2024-01-17T22:58:41.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.181+0000 7f88a5e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f88a81517a0 0x7f88a806ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59216/0 (socket says 172.21.15.161:59216) 2024-01-17T22:58:41.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.181+0000 7f88a5e00640 1 -- 172.21.15.161:0/1097404734 learned_addr learned my addr 172.21.15.161:0/1097404734 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:58:41.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.185+0000 7f88a6800640 1 --2- 172.21.15.161:0/1097404734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88a81582d0 0x7f88a8072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:41.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.185+0000 7f88a4a00640 1 -- 172.21.15.161:0/1097404734 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817973255 0 0) 0x7f88a815b9c0 con 0x7f88a81517a0 2024-01-17T22:58:41.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.185+0000 7f88a4a00640 1 -- 172.21.15.161:0/1097404734 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8888003530 con 0x7f88a81517a0 2024-01-17T22:58:41.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.189+0000 7f88a4a00640 1 -- 172.21.15.161:0/1097404734 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4060131910 0 0) 0x7f8888003530 con 0x7f88a81517a0 2024-01-17T22:58:41.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.189+0000 7f88a4a00640 1 -- 172.21.15.161:0/1097404734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88a81582d0 msgr2=0x7f88a8072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:41.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.189+0000 7f88a4a00640 1 --2- 172.21.15.161:0/1097404734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88a81582d0 0x7f88a8072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:41.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.189+0000 7f88a4a00640 1 -- 172.21.15.161:0/1097404734 >> v1:172.21.15.190:6789/0 conn(0x7f88a8072300 legacy=0x7f88a8157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:41.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.189+0000 7f88a4a00640 1 -- 172.21.15.161:0/1097404734 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a815b400 con 0x7f88a81517a0 2024-01-17T22:58:41.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.189+0000 7f88a4a00640 1 -- 172.21.15.161:0/1097404734 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f8898001680 con 0x7f88a81517a0 2024-01-17T22:58:41.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.189+0000 7f88a4a00640 1 -- 172.21.15.161:0/1097404734 >> v1:172.21.15.161:6789/0 conn(0x7f88a81517a0 legacy=0x7f88a806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:41.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.189+0000 7f88a4a00640 1 --2- 172.21.15.161:0/1097404734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88a81582d0 0x7f88880039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:41.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.189+0000 7f88a4a00640 1 --2- 172.21.15.161:0/1097404734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8888003f80 0x7f88880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:41.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.189+0000 7f88a4a00640 1 --2- 172.21.15.161:0/1097404734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8888004d10 0x7f8888005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:41.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.189+0000 7f88a4a00640 1 -- 172.21.15.161:0/1097404734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a815b120 con 0x7f8888003f80 2024-01-17T22:58:41.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.189+0000 7f88a4a00640 1 -- 172.21.15.161:0/1097404734 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888800bad0 con 0x7f8888004d10 2024-01-17T22:58:41.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.189+0000 7f88a4a00640 1 -- 172.21.15.161:0/1097404734 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888800bc90 con 0x7f88a81582d0 2024-01-17T22:58:41.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.193+0000 7f88a5400640 1 --2- 172.21.15.161:0/1097404734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8888003f80 0x7f88880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:41.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.193+0000 7f88a6800640 1 --2- 172.21.15.161:0/1097404734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8888004d10 0x7f8888005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:41.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.197+0000 7f88a5400640 1 -- 172.21.15.161:0/1097404734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88a81582d0 msgr2=0x7f88880039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:41.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.197+0000 7f88a5400640 1 --2- 172.21.15.161:0/1097404734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88a81582d0 0x7f88880039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:41.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.197+0000 7f88a5400640 1 -- 172.21.15.161:0/1097404734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8888004d10 msgr2=0x7f8888005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:41.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.197+0000 7f88a5400640 1 --2- 172.21.15.161:0/1097404734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8888004d10 0x7f8888005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:41.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.197+0000 7f88a5400640 1 -- 172.21.15.161:0/1097404734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8888003530 con 0x7f8888003f80 2024-01-17T22:58:41.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.201+0000 7f88a5400640 1 --2- 172.21.15.161:0/1097404734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8888003f80 0x7f88880047d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8890001780 tx=0x7f889001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b78b433b51c1775 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:41.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.201+0000 7f88a4a00640 1 -- 172.21.15.161:0/1097404734 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88900052d0 con 0x7f8888003f80 2024-01-17T22:58:41.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.201+0000 7f88a4a00640 1 -- 172.21.15.161:0/1097404734 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88900a7050 con 0x7f8888003f80 2024-01-17T22:58:41.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.201+0000 7f88a4a00640 1 -- 172.21.15.161:0/1097404734 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890003840 con 0x7f8888003f80 2024-01-17T22:58:41.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.205+0000 7f88acc00640 1 -- 172.21.15.161:0/1097404734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8888003f80 msgr2=0x7f88880047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:41.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.205+0000 7f88acc00640 1 --2- 172.21.15.161:0/1097404734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8888003f80 0x7f88880047d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8890001780 tx=0x7f889001c340 comp rx=0 tx=0).stop 2024-01-17T22:58:41.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.205+0000 7f88a6800640 1 -- 172.21.15.161:0/1097404734 reap_dead start 2024-01-17T22:58:41.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.205+0000 7f88acc00640 1 -- 172.21.15.161:0/1097404734 shutdown_connections 2024-01-17T22:58:41.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.205+0000 7f88acc00640 1 -- 172.21.15.161:0/1097404734 >> 172.21.15.161:0/1097404734 conn(0x7f88a80cb070 msgr2=0x7f88a80cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:41.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.205+0000 7f88acc00640 1 -- 172.21.15.161:0/1097404734 shutdown_connections 2024-01-17T22:58:41.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.205+0000 7f88acc00640 1 -- 172.21.15.161:0/1097404734 wait complete. 2024-01-17T22:58:41.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.205+0000 7f88acc00640 1 Processor -- start 2024-01-17T22:58:41.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.205+0000 7f88acc00640 1 -- start start 2024-01-17T22:58:41.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.205+0000 7f88acc00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8888003f80 0x7f88a81efd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:41.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.205+0000 7f88acc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88a8148ab0 0x7f88a80c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:41.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.205+0000 7f88acc00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88a81f30b0 0x7f88a81562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:41.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.205+0000 7f88acc00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a814a5a0 con 0x7f88a8148ab0 2024-01-17T22:58:41.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.205+0000 7f88acc00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a806e090 con 0x7f88a81f30b0 2024-01-17T22:58:41.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.205+0000 7f88acc00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a814a840 con 0x7f8888003f80 2024-01-17T22:58:41.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.209+0000 7f88a5400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88a8148ab0 0x7f88a80c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:41.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.209+0000 7f88a5400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88a8148ab0 0x7f88a80c0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:51584/0 (socket says 172.21.15.161:51584) 2024-01-17T22:58:41.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.209+0000 7f88a5400640 1 -- 172.21.15.161:0/276046233 learned_addr learned my addr 172.21.15.161:0/276046233 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:41.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.209+0000 7f88a6800640 1 --2- 172.21.15.161:0/276046233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88a81f30b0 0x7f88a81562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:41.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.209+0000 7f88a5e00640 1 --2- 172.21.15.161:0/276046233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8888003f80 0x7f88a81efd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:41.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.213+0000 7f88a5400640 1 -- 172.21.15.161:0/276046233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8888003f80 msgr2=0x7f88a81efd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:41.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.213+0000 7f88a5400640 1 --2- 172.21.15.161:0/276046233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8888003f80 0x7f88a81efd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:41.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.213+0000 7f88a5400640 1 -- 172.21.15.161:0/276046233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88a81f30b0 msgr2=0x7f88a81562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:41.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.213+0000 7f88a5400640 1 --2- 172.21.15.161:0/276046233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88a81f30b0 0x7f88a81562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:41.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.213+0000 7f88a5400640 1 -- 172.21.15.161:0/276046233 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a81ef240 con 0x7f88a8148ab0 2024-01-17T22:58:41.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.213+0000 7f88a5400640 1 --2- 172.21.15.161:0/276046233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88a8148ab0 0x7f88a80c0090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8890005040 tx=0x7f8888005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:41.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.217+0000 7f889e000640 1 -- 172.21.15.161:0/276046233 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890007490 con 0x7f88a8148ab0 2024-01-17T22:58:41.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.217+0000 7f889e000640 1 -- 172.21.15.161:0/276046233 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88900075f0 con 0x7f88a8148ab0 2024-01-17T22:58:41.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.217+0000 7f889e000640 1 -- 172.21.15.161:0/276046233 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890006a20 con 0x7f88a8148ab0 2024-01-17T22:58:41.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.217+0000 7f88acc00640 1 -- 172.21.15.161:0/276046233 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a81ef520 con 0x7f88a8148ab0 2024-01-17T22:58:41.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.217+0000 7f88acc00640 1 -- 172.21.15.161:0/276046233 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a81f3530 con 0x7f88a8148ab0 2024-01-17T22:58:41.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.221+0000 7f88acc00640 1 -- 172.21.15.161:0/276046233 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a8067c90 con 0x7f88a8148ab0 2024-01-17T22:58:41.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.237+0000 7f889e000640 1 -- 172.21.15.161:0/276046233 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f8890006b80 con 0x7f88a8148ab0 2024-01-17T22:58:41.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.241+0000 7f889e000640 1 --2- 172.21.15.161:0/276046233 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8880066890 0x7f8880068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:41.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.241+0000 7f88a5e00640 1 --2- 172.21.15.161:0/276046233 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8880066890 0x7f8880068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:41.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.241+0000 7f88a5e00640 1 --2- 172.21.15.161:0/276046233 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8880066890 0x7f8880068d50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8898000c10 tx=0x7f889800a920 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:41.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.241+0000 7f889e000640 1 -- 172.21.15.161:0/276046233 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8890006e30 con 0x7f88a8148ab0 2024-01-17T22:58:41.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.473+0000 7f889e000640 1 -- 172.21.15.161:0/276046233 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f88900ec510 con 0x7f88a8148ab0 2024-01-17T22:58:41.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.657+0000 7f88acc00640 1 -- 172.21.15.161:0/276046233 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88a80746a0 con 0x7f88a8148ab0 2024-01-17T22:58:41.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.661+0000 7f889e000640 1 -- 172.21.15.161:0/276046233 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f88900efb30 con 0x7f88a8148ab0 2024-01-17T22:58:41.663 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:58:41.663 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1671527613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1671527613},{"type":"v1","addr":"172.21.15.161:6835","nonce":1671527613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-17T22:58:41.663 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 2 2024-01-17T22:58:41.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.665+0000 7f88acc00640 1 -- 172.21.15.161:0/276046233 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8880066890 msgr2=0x7f8880068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:41.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.665+0000 7f88acc00640 1 --2- 172.21.15.161:0/276046233 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8880066890 0x7f8880068d50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8898000c10 tx=0x7f889800a920 comp rx=0 tx=0).stop 2024-01-17T22:58:41.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.665+0000 7f88acc00640 1 -- 172.21.15.161:0/276046233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88a8148ab0 msgr2=0x7f88a80c0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:41.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.665+0000 7f88acc00640 1 --2- 172.21.15.161:0/276046233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88a8148ab0 0x7f88a80c0090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8890005040 tx=0x7f8888005800 comp rx=0 tx=0).stop 2024-01-17T22:58:41.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.665+0000 7f88acc00640 1 -- 172.21.15.161:0/276046233 shutdown_connections 2024-01-17T22:58:41.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.665+0000 7f88acc00640 1 --2- 172.21.15.161:0/276046233 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8880066890 0x7f8880068d50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:41.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.665+0000 7f88acc00640 1 --2- 172.21.15.161:0/276046233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88a81f30b0 0x7f88a81562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:41.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.665+0000 7f88acc00640 1 --2- 172.21.15.161:0/276046233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88a8148ab0 0x7f88a80c0090 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:41.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.665+0000 7f88acc00640 1 --2- 172.21.15.161:0/276046233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8888003f80 0x7f88a81efd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:41.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.665+0000 7f88acc00640 1 -- 172.21.15.161:0/276046233 >> 172.21.15.161:0/276046233 conn(0x7f88a80cb070 msgr2=0x7f88a8073e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:41.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.665+0000 7f88acc00640 1 -- 172.21.15.161:0/276046233 shutdown_connections 2024-01-17T22:58:41.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:41.665+0000 7f88acc00640 1 -- 172.21.15.161:0/276046233 wait complete. 2024-01-17T22:58:43.687 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T22:58:43.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.829+0000 7f6bd8800640 1 Processor -- start 2024-01-17T22:58:43.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.829+0000 7f6bd8800640 1 -- start start 2024-01-17T22:58:43.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.829+0000 7f6bd8800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6bd0071110 0x7f6bd015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:43.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.829+0000 7f6bd8800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd015d770 con 0x7f6bd006b7f0 2024-01-17T22:58:43.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.829+0000 7f6bd8800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd015da30 con 0x7f6bd00714f0 2024-01-17T22:58:43.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.829+0000 7f6bd8800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd006bc80 con 0x7f6bd0071110 2024-01-17T22:58:43.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.829+0000 7f6bd5e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6bd0071110 0x7f6bd015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:43.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.833+0000 7f6bd6800640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6bd006b7f0 0x7f6bd00ca520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:41492/0 (socket says 172.21.15.161:41492) 2024-01-17T22:58:43.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.833+0000 7f6bd6800640 1 -- 172.21.15.161:0/1725617490 learned_addr learned my addr 172.21.15.161:0/1725617490 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:58:43.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.837+0000 7f6bd5e00640 1 -- 172.21.15.161:0/1725617490 >> v1:172.21.15.190:6789/0 conn(0x7f6bd00714f0 legacy=0x7f6bd015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:43.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.837+0000 7f6bd5e00640 1 -- 172.21.15.161:0/1725617490 >> v1:172.21.15.161:6789/0 conn(0x7f6bd006b7f0 legacy=0x7f6bd00ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:43.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.837+0000 7f6bd5e00640 1 -- 172.21.15.161:0/1725617490 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd0159a80 con 0x7f6bd0071110 2024-01-17T22:58:43.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.841+0000 7f6bd5e00640 1 --2- 172.21.15.161:0/1725617490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd0071110 0x7f6bd015a540 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00097f0 tx=0x7f6bc001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28747849cb390e8a server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:43.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.845+0000 7f6bd4a00640 1 -- 172.21.15.161:0/1725617490 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00a8970 con 0x7f6bd0071110 2024-01-17T22:58:43.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.845+0000 7f6bd4a00640 1 -- 172.21.15.161:0/1725617490 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc00a8ad0 con 0x7f6bd0071110 2024-01-17T22:58:43.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.845+0000 7f6bd4a00640 1 -- 172.21.15.161:0/1725617490 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00a8e60 con 0x7f6bd0071110 2024-01-17T22:58:43.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.845+0000 7f6bd8800640 1 -- 172.21.15.161:0/1725617490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd0071110 msgr2=0x7f6bd015a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:43.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.845+0000 7f6bd8800640 1 --2- 172.21.15.161:0/1725617490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd0071110 0x7f6bd015a540 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00097f0 tx=0x7f6bc001ec70 comp rx=0 tx=0).stop 2024-01-17T22:58:43.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.845+0000 7f6bd8800640 1 -- 172.21.15.161:0/1725617490 shutdown_connections 2024-01-17T22:58:43.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.845+0000 7f6bd8800640 1 --2- 172.21.15.161:0/1725617490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd0071110 0x7f6bd015a540 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:43.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.845+0000 7f6bd8800640 1 -- 172.21.15.161:0/1725617490 >> 172.21.15.161:0/1725617490 conn(0x7f6bd00704f0 msgr2=0x7f6bd006f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:43.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.845+0000 7f6bd8800640 1 -- 172.21.15.161:0/1725617490 shutdown_connections 2024-01-17T22:58:43.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.845+0000 7f6bd8800640 1 -- 172.21.15.161:0/1725617490 wait complete. 2024-01-17T22:58:43.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.845+0000 7f6bd8800640 1 Processor -- start 2024-01-17T22:58:43.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.845+0000 7f6bd8800640 1 -- start start 2024-01-17T22:58:43.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.849+0000 7f6bd8800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bd006b7f0 0x7f6bd00cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:43.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.849+0000 7f6bd8800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd0071110 0x7f6bd015c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:43.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.849+0000 7f6bd8800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bd00714f0 0x7f6bd01f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:43.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.849+0000 7f6bd8800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd013fd20 con 0x7f6bd0071110 2024-01-17T22:58:43.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.849+0000 7f6bd8800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd00cdf20 con 0x7f6bd006b7f0 2024-01-17T22:58:43.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.849+0000 7f6bd8800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd01ef590 con 0x7f6bd00714f0 2024-01-17T22:58:43.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.849+0000 7f6bd5400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd0071110 0x7f6bd015c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:43.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.849+0000 7f6bd5400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd0071110 0x7f6bd015c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46044/0 (socket says 172.21.15.161:46044) 2024-01-17T22:58:43.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.849+0000 7f6bd5400640 1 -- 172.21.15.161:0/1958262584 learned_addr learned my addr 172.21.15.161:0/1958262584 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:43.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.849+0000 7f6bd5e00640 1 --2- 172.21.15.161:0/1958262584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bd006b7f0 0x7f6bd00cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:43.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.849+0000 7f6bd6800640 1 --2- 172.21.15.161:0/1958262584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bd00714f0 0x7f6bd01f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:43.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.853+0000 7f6bd5400640 1 -- 172.21.15.161:0/1958262584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bd00714f0 msgr2=0x7f6bd01f2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:43.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.853+0000 7f6bd5400640 1 --2- 172.21.15.161:0/1958262584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bd00714f0 0x7f6bd01f2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:43.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.853+0000 7f6bd5400640 1 -- 172.21.15.161:0/1958262584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bd006b7f0 msgr2=0x7f6bd00cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:43.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.853+0000 7f6bd5400640 1 --2- 172.21.15.161:0/1958262584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bd006b7f0 0x7f6bd00cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:43.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.853+0000 7f6bd5400640 1 -- 172.21.15.161:0/1958262584 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc0009420 con 0x7f6bd0071110 2024-01-17T22:58:43.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.853+0000 7f6bd5400640 1 --2- 172.21.15.161:0/1958262584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd0071110 0x7f6bd015c110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800c3c0 tx=0x7f6bb800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:43.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.857+0000 7f6bce000640 1 -- 172.21.15.161:0/1958262584 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80052d0 con 0x7f6bd0071110 2024-01-17T22:58:43.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.857+0000 7f6bce000640 1 -- 172.21.15.161:0/1958262584 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb8005430 con 0x7f6bd0071110 2024-01-17T22:58:43.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.857+0000 7f6bce000640 1 -- 172.21.15.161:0/1958262584 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8003840 con 0x7f6bd0071110 2024-01-17T22:58:43.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.857+0000 7f6bd8800640 1 -- 172.21.15.161:0/1958262584 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd01f00d0 con 0x7f6bd0071110 2024-01-17T22:58:43.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.857+0000 7f6bd8800640 1 -- 172.21.15.161:0/1958262584 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd01f0560 con 0x7f6bd0071110 2024-01-17T22:58:43.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.861+0000 7f6bd8800640 1 -- 172.21.15.161:0/1958262584 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd01f0280 con 0x7f6bd0071110 2024-01-17T22:58:43.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.877+0000 7f6bce000640 1 -- 172.21.15.161:0/1958262584 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f6bb80039a0 con 0x7f6bd0071110 2024-01-17T22:58:43.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.881+0000 7f6bce000640 1 --2- 172.21.15.161:0/1958262584 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6ba8066870 0x7f6ba8068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:43.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.881+0000 7f6bd5e00640 1 --2- 172.21.15.161:0/1958262584 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6ba8066870 0x7f6ba8068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:43.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.881+0000 7f6bd5e00640 1 --2- 172.21.15.161:0/1958262584 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6ba8066870 0x7f6ba8068d30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00b2000 tx=0x7f6bc00aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:43.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:43.881+0000 7f6bce000640 1 -- 172.21.15.161:0/1958262584 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6bb8054600 con 0x7f6bd0071110 2024-01-17T22:58:44.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.113+0000 7f6bce000640 1 -- 172.21.15.161:0/1958262584 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f6bb8081e60 con 0x7f6bd0071110 2024-01-17T22:58:44.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.297+0000 7f6bd8800640 1 -- 172.21.15.161:0/1958262584 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bd01f0280 con 0x7f6bd0071110 2024-01-17T22:58:44.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.317+0000 7f6bce000640 1 -- 172.21.15.161:0/1958262584 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5286 (secure 0 0 0) 0x7f6bd01f0280 con 0x7f6bd0071110 2024-01-17T22:58:44.316 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:58:44.316 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6839/2820898287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":2820898287},{"type":"v1","addr":"172.21.15.161:6839","nonce":2820898287}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/2332272186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2332272186},{"type":"v1","addr":"172.21.15.190:6833","nonce":2332272186}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3170137737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3170137737},{"type":"v1","addr":"172.21.15.190:6835","nonce":3170137737}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1671527613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1671527613},{"type":"v1","addr":"172.21.15.161:6835","nonce":1671527613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/409686078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":409686078},{"type":"v1","addr":"172.21.15.161:6837","nonce":409686078}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/561131647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":561131647},{"type":"v1","addr":"172.21.15.190:6837","nonce":561131647}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-01-17T22:58:44.317 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 3 2024-01-17T22:58:44.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.317+0000 7f6bd8800640 1 -- 172.21.15.161:0/1958262584 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6ba8066870 msgr2=0x7f6ba8068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:44.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.317+0000 7f6bd8800640 1 --2- 172.21.15.161:0/1958262584 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6ba8066870 0x7f6ba8068d30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00b2000 tx=0x7f6bc00aa070 comp rx=0 tx=0).stop 2024-01-17T22:58:44.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.317+0000 7f6bd8800640 1 -- 172.21.15.161:0/1958262584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd0071110 msgr2=0x7f6bd015c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:44.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.317+0000 7f6bd8800640 1 --2- 172.21.15.161:0/1958262584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd0071110 0x7f6bd015c110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800c3c0 tx=0x7f6bb800c880 comp rx=0 tx=0).stop 2024-01-17T22:58:44.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.317+0000 7f6bd8800640 1 -- 172.21.15.161:0/1958262584 shutdown_connections 2024-01-17T22:58:44.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.317+0000 7f6bd8800640 1 --2- 172.21.15.161:0/1958262584 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6ba8066870 0x7f6ba8068d30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:44.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.317+0000 7f6bd8800640 1 --2- 172.21.15.161:0/1958262584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bd00714f0 0x7f6bd01f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:44.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.317+0000 7f6bd8800640 1 --2- 172.21.15.161:0/1958262584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd0071110 0x7f6bd015c110 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:44.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.317+0000 7f6bd8800640 1 --2- 172.21.15.161:0/1958262584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bd006b7f0 0x7f6bd00cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:44.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.317+0000 7f6bd8800640 1 -- 172.21.15.161:0/1958262584 >> 172.21.15.161:0/1958262584 conn(0x7f6bd00704f0 msgr2=0x7f6bd00c90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:44.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.317+0000 7f6bd8800640 1 -- 172.21.15.161:0/1958262584 shutdown_connections 2024-01-17T22:58:44.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.317+0000 7f6bd8800640 1 -- 172.21.15.161:0/1958262584 wait complete. 2024-01-17T22:58:44.338 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T22:58:44.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.473+0000 7f6278000640 1 Processor -- start 2024-01-17T22:58:44.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.473+0000 7f6278000640 1 -- start start 2024-01-17T22:58:44.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.473+0000 7f6278000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f62700c79c0 0x7f6270061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:44.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.473+0000 7f6278000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6270061640 0x7f627015d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:44.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.473+0000 7f6278000640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62700c9890 con 0x7f62701539a0 2024-01-17T22:58:44.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.473+0000 7f6278000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627006d570 con 0x7f62700c79c0 2024-01-17T22:58:44.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.473+0000 7f6278000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6270159bf0 con 0x7f6270061640 2024-01-17T22:58:44.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.473+0000 7f6274c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f62700c79c0 0x7f6270061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:44.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.473+0000 7f6274c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f62700c79c0 0x7f6270061100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46056/0 (socket says 172.21.15.161:46056) 2024-01-17T22:58:44.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.473+0000 7f6274c00640 1 -- 172.21.15.161:0/1280997290 learned_addr learned my addr 172.21.15.161:0/1280997290 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:44.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.473+0000 7f6276000640 1 --2- 172.21.15.161:0/1280997290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6270061640 0x7f627015d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:44.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.477+0000 7f6274c00640 1 -- 172.21.15.161:0/1280997290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6270061640 msgr2=0x7f627015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:44.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.477+0000 7f6274c00640 1 --2- 172.21.15.161:0/1280997290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6270061640 0x7f627015d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:44.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.477+0000 7f6274c00640 1 -- 172.21.15.161:0/1280997290 >> v1:172.21.15.190:6789/0 conn(0x7f62701539a0 legacy=0x7f62700ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:44.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.477+0000 7f6274c00640 1 -- 172.21.15.161:0/1280997290 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6270159eb0 con 0x7f62700c79c0 2024-01-17T22:58:44.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.481+0000 7f6274c00640 1 --2- 172.21.15.161:0/1280997290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62700c79c0 0x7f6270061100 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6258009870 tx=0x7f625801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1362bf6d22b91e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:44.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.485+0000 7f626fe00640 1 -- 172.21.15.161:0/1280997290 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62580aa610 con 0x7f62700c79c0 2024-01-17T22:58:44.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.485+0000 7f626fe00640 1 -- 172.21.15.161:0/1280997290 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62580a6040 con 0x7f62700c79c0 2024-01-17T22:58:44.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.485+0000 7f626fe00640 1 -- 172.21.15.161:0/1280997290 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62580aa990 con 0x7f62700c79c0 2024-01-17T22:58:44.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.485+0000 7f6278000640 1 -- 172.21.15.161:0/1280997290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62700c79c0 msgr2=0x7f6270061100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:44.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.485+0000 7f6278000640 1 --2- 172.21.15.161:0/1280997290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62700c79c0 0x7f6270061100 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6258009870 tx=0x7f625801c4b0 comp rx=0 tx=0).stop 2024-01-17T22:58:44.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.485+0000 7f6278000640 1 -- 172.21.15.161:0/1280997290 shutdown_connections 2024-01-17T22:58:44.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.485+0000 7f6278000640 1 --2- 172.21.15.161:0/1280997290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6270061640 0x7f627015d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:44.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.485+0000 7f6278000640 1 --2- 172.21.15.161:0/1280997290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62700c79c0 0x7f6270061100 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:44.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.485+0000 7f6278000640 1 -- 172.21.15.161:0/1280997290 >> 172.21.15.161:0/1280997290 conn(0x7f627006ad40 msgr2=0x7f627006f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:44.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.485+0000 7f6278000640 1 -- 172.21.15.161:0/1280997290 shutdown_connections 2024-01-17T22:58:44.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.485+0000 7f6278000640 1 -- 172.21.15.161:0/1280997290 wait complete. 2024-01-17T22:58:44.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.489+0000 7f6278000640 1 Processor -- start 2024-01-17T22:58:44.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.489+0000 7f6278000640 1 -- start start 2024-01-17T22:58:44.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.489+0000 7f6278000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6270061640 0x7f6270145d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:44.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.489+0000 7f6278000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62700c79c0 0x7f62701f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:44.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.489+0000 7f6278000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62701539a0 0x7f62701f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:44.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.489+0000 7f6278000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62701f62b0 con 0x7f6270061640 2024-01-17T22:58:44.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.489+0000 7f6278000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627014f080 con 0x7f62701539a0 2024-01-17T22:58:44.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.489+0000 7f6278000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6270146250 con 0x7f62700c79c0 2024-01-17T22:58:44.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.489+0000 7f6275600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6270061640 0x7f6270145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:44.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.489+0000 7f6275600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6270061640 0x7f6270145d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46060/0 (socket says 172.21.15.161:46060) 2024-01-17T22:58:44.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.489+0000 7f6275600640 1 -- 172.21.15.161:0/3189788880 learned_addr learned my addr 172.21.15.161:0/3189788880 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:44.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.489+0000 7f6274c00640 1 --2- 172.21.15.161:0/3189788880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62700c79c0 0x7f62701f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:44.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.489+0000 7f6276000640 1 --2- 172.21.15.161:0/3189788880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62701539a0 0x7f62701f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:44.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.493+0000 7f6275600640 1 -- 172.21.15.161:0/3189788880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62700c79c0 msgr2=0x7f62701f53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:44.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.493+0000 7f6275600640 1 --2- 172.21.15.161:0/3189788880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62700c79c0 0x7f62701f53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:44.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.493+0000 7f6275600640 1 -- 172.21.15.161:0/3189788880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62701539a0 msgr2=0x7f62701f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:44.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.493+0000 7f6275600640 1 --2- 172.21.15.161:0/3189788880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62701539a0 0x7f62701f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:44.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.493+0000 7f6275600640 1 -- 172.21.15.161:0/3189788880 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62580094d0 con 0x7f6270061640 2024-01-17T22:58:44.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.497+0000 7f6275600640 1 --2- 172.21.15.161:0/3189788880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6270061640 0x7f6270145d10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f626000c390 tx=0x7f626000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:44.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.501+0000 7f626d600640 1 -- 172.21.15.161:0/3189788880 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62600052d0 con 0x7f6270061640 2024-01-17T22:58:44.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.501+0000 7f626d600640 1 -- 172.21.15.161:0/3189788880 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6260005450 con 0x7f6270061640 2024-01-17T22:58:44.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.501+0000 7f6278000640 1 -- 172.21.15.161:0/3189788880 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627015aa00 con 0x7f6270061640 2024-01-17T22:58:44.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.501+0000 7f626d600640 1 -- 172.21.15.161:0/3189788880 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260003840 con 0x7f6270061640 2024-01-17T22:58:44.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.501+0000 7f6278000640 1 -- 172.21.15.161:0/3189788880 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627014e2e0 con 0x7f6270061640 2024-01-17T22:58:44.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.501+0000 7f6278000640 1 -- 172.21.15.161:0/3189788880 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627006b620 con 0x7f6270061640 2024-01-17T22:58:44.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.521+0000 7f626d600640 1 -- 172.21.15.161:0/3189788880 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f62600039a0 con 0x7f6270061640 2024-01-17T22:58:44.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.521+0000 7f626d600640 1 --2- 172.21.15.161:0/3189788880 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6248066840 0x7f6248068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:44.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.521+0000 7f6274c00640 1 --2- 172.21.15.161:0/3189788880 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6248066840 0x7f6248068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:44.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.525+0000 7f6274c00640 1 --2- 172.21.15.161:0/3189788880 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6248066840 0x7f6248068d00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f62580ae000 tx=0x7f62580b5040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:44.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.757+0000 7f626d600640 1 -- 172.21.15.161:0/3189788880 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6260001090 con 0x7f6270061640 2024-01-17T22:58:44.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.757+0000 7f626d600640 1 -- 172.21.15.161:0/3189788880 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f6260050b40 con 0x7f6270061640 2024-01-17T22:58:44.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.909+0000 7f6278000640 1 -- 172.21.15.161:0/3189788880 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62700746a0 con 0x7f6270061640 2024-01-17T22:58:44.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.933+0000 7f626d600640 1 -- 172.21.15.161:0/3189788880 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12899 (secure 0 0 0) 0x7f6260017020 con 0x7f6270061640 2024-01-17T22:58:44.935 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:58:44.935 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":17,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:58:18.198091+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.614036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.746767+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.689096+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.706485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.628004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.680048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.571249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:58:44.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.937+0000 7f6278000640 1 -- 172.21.15.161:0/3189788880 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6248066840 msgr2=0x7f6248068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:44.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.937+0000 7f6278000640 1 --2- 172.21.15.161:0/3189788880 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6248066840 0x7f6248068d00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f62580ae000 tx=0x7f62580b5040 comp rx=0 tx=0).stop 2024-01-17T22:58:44.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.937+0000 7f6278000640 1 -- 172.21.15.161:0/3189788880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6270061640 msgr2=0x7f6270145d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:44.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.937+0000 7f6278000640 1 --2- 172.21.15.161:0/3189788880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6270061640 0x7f6270145d10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f626000c390 tx=0x7f626000c850 comp rx=0 tx=0).stop 2024-01-17T22:58:44.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.937+0000 7f6278000640 1 -- 172.21.15.161:0/3189788880 shutdown_connections 2024-01-17T22:58:44.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.937+0000 7f6278000640 1 --2- 172.21.15.161:0/3189788880 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6248066840 0x7f6248068d00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:44.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.937+0000 7f6278000640 1 --2- 172.21.15.161:0/3189788880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62701539a0 0x7f62701f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:44.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.937+0000 7f6278000640 1 --2- 172.21.15.161:0/3189788880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62700c79c0 0x7f62701f53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:44.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.937+0000 7f6278000640 1 --2- 172.21.15.161:0/3189788880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6270061640 0x7f6270145d10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:44.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.937+0000 7f6278000640 1 -- 172.21.15.161:0/3189788880 >> 172.21.15.161:0/3189788880 conn(0x7f627006ad40 msgr2=0x7f6270152c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:44.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.937+0000 7f6278000640 1 -- 172.21.15.161:0/3189788880 shutdown_connections 2024-01-17T22:58:44.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:44.937+0000 7f6278000640 1 -- 172.21.15.161:0/3189788880 wait complete. 2024-01-17T22:58:44.957 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-17T22:58:14.876386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-17T22:58:44.957 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-17T22:58:45.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.101+0000 7f6b27800640 1 Processor -- start 2024-01-17T22:58:45.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.101+0000 7f6b27800640 1 -- start start 2024-01-17T22:58:45.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.101+0000 7f6b27800640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6b200c5dd0 0x7f6b200c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:45.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.101+0000 7f6b27800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b200bffb0 con 0x7f6b201506b0 2024-01-17T22:58:45.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.101+0000 7f6b27800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b200c6720 con 0x7f6b20156300 2024-01-17T22:58:45.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.101+0000 7f6b27800640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b20150a90 con 0x7f6b200c5dd0 2024-01-17T22:58:45.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.101+0000 7f6b24e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6b201506b0 0x7f6b200c0720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:41502/0 (socket says 172.21.15.161:41502) 2024-01-17T22:58:45.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.101+0000 7f6b24e00640 1 -- 172.21.15.161:0/423674743 learned_addr learned my addr 172.21.15.161:0/423674743 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:58:45.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.101+0000 7f6b25800640 1 --2- 172.21.15.161:0/423674743 >> v2:172.21.15.190:3300/0 conn(0x7f6b200c5dd0 0x7f6b200c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:45.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.101+0000 7f6b1f400640 1 -- 172.21.15.161:0/423674743 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776443744 0 0) 0x7f6b200bffb0 con 0x7f6b201506b0 2024-01-17T22:58:45.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.101+0000 7f6b1f400640 1 -- 172.21.15.161:0/423674743 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b00005740 con 0x7f6b201506b0 2024-01-17T22:58:45.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.105+0000 7f6b1f400640 1 -- 172.21.15.161:0/423674743 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3669147411 0 0) 0x7f6b00005740 con 0x7f6b201506b0 2024-01-17T22:58:45.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.105+0000 7f6b1f400640 1 -- 172.21.15.161:0/423674743 >> v2:172.21.15.190:3300/0 conn(0x7f6b200c5dd0 msgr2=0x7f6b200c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:45.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.105+0000 7f6b1f400640 1 --2- 172.21.15.161:0/423674743 >> v2:172.21.15.190:3300/0 conn(0x7f6b200c5dd0 0x7f6b200c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:45.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.105+0000 7f6b1f400640 1 -- 172.21.15.161:0/423674743 >> v1:172.21.15.190:6789/0 conn(0x7f6b20156300 legacy=0x7f6b2006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:45.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.105+0000 7f6b1f400640 1 -- 172.21.15.161:0/423674743 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b200b1130 con 0x7f6b201506b0 2024-01-17T22:58:45.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.105+0000 7f6b1f400640 1 -- 172.21.15.161:0/423674743 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f6b10001680 con 0x7f6b201506b0 2024-01-17T22:58:45.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.105+0000 7f6b1f400640 1 -- 172.21.15.161:0/423674743 >> v1:172.21.15.161:6789/0 conn(0x7f6b201506b0 legacy=0x7f6b200c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:45.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.105+0000 7f6b1f400640 1 --2- 172.21.15.161:0/423674743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b00005be0 0x7f6b00005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:45.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.105+0000 7f6b1f400640 1 --2- 172.21.15.161:0/423674743 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b000069e0 0x7f6b00006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:45.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.105+0000 7f6b1f400640 1 --2- 172.21.15.161:0/423674743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b000073a0 0x7f6b0000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:45.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.105+0000 7f6b1f400640 1 -- 172.21.15.161:0/423674743 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b20150a90 con 0x7f6b000073a0 2024-01-17T22:58:45.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.105+0000 7f6b1f400640 1 -- 172.21.15.161:0/423674743 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0000e270 con 0x7f6b00005be0 2024-01-17T22:58:45.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.105+0000 7f6b1f400640 1 -- 172.21.15.161:0/423674743 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0000e430 con 0x7f6b000069e0 2024-01-17T22:58:45.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.109+0000 7f6b1fe00640 1 --2- 172.21.15.161:0/423674743 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b000069e0 0x7f6b00006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:45.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.109+0000 7f6b25800640 1 --2- 172.21.15.161:0/423674743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b000073a0 0x7f6b0000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:45.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.113+0000 7f6b25800640 1 -- 172.21.15.161:0/423674743 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b000069e0 msgr2=0x7f6b00006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:45.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.113+0000 7f6b25800640 1 --2- 172.21.15.161:0/423674743 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b000069e0 0x7f6b00006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:45.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.113+0000 7f6b25800640 1 -- 172.21.15.161:0/423674743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b00005be0 msgr2=0x7f6b00005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:45.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.113+0000 7f6b25800640 1 --2- 172.21.15.161:0/423674743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b00005be0 0x7f6b00005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:45.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.113+0000 7f6b25800640 1 -- 172.21.15.161:0/423674743 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b00005740 con 0x7f6b000073a0 2024-01-17T22:58:45.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.113+0000 7f6b25800640 1 -- 172.21.15.161:0/423674743 reap_dead start 2024-01-17T22:58:45.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.117+0000 7f6b25800640 1 --2- 172.21.15.161:0/423674743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b000073a0 0x7f6b0000dba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6b18009fc0 tx=0x7f6b1801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f95e5f41623760 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:45.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.121+0000 7f6b1f400640 1 -- 172.21.15.161:0/423674743 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b180a5cb0 con 0x7f6b000073a0 2024-01-17T22:58:45.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.121+0000 7f6b1f400640 1 -- 172.21.15.161:0/423674743 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1800f040 con 0x7f6b000073a0 2024-01-17T22:58:45.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.121+0000 7f6b1f400640 1 -- 172.21.15.161:0/423674743 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b18003be0 con 0x7f6b000073a0 2024-01-17T22:58:45.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.121+0000 7f6b27800640 1 -- 172.21.15.161:0/423674743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b000073a0 msgr2=0x7f6b0000dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:45.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.121+0000 7f6b27800640 1 --2- 172.21.15.161:0/423674743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b000073a0 0x7f6b0000dba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6b18009fc0 tx=0x7f6b1801cca0 comp rx=0 tx=0).stop 2024-01-17T22:58:45.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.125+0000 7f6b27800640 1 -- 172.21.15.161:0/423674743 shutdown_connections 2024-01-17T22:58:45.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.125+0000 7f6b27800640 1 --2- 172.21.15.161:0/423674743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b000073a0 0x7f6b0000dba0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:45.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.125+0000 7f6b27800640 1 -- 172.21.15.161:0/423674743 >> 172.21.15.161:0/423674743 conn(0x7f6b200c7a90 msgr2=0x7f6b200c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:45.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.125+0000 7f6b27800640 1 -- 172.21.15.161:0/423674743 shutdown_connections 2024-01-17T22:58:45.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.125+0000 7f6b27800640 1 -- 172.21.15.161:0/423674743 wait complete. 2024-01-17T22:58:45.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.125+0000 7f6b27800640 1 Processor -- start 2024-01-17T22:58:45.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.125+0000 7f6b27800640 1 -- start start 2024-01-17T22:58:45.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.125+0000 7f6b27800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b000073a0 0x7f6b20140f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:45.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.125+0000 7f6b27800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b20146170 0x7f6b201edfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:45.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.125+0000 7f6b27800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b201475a0 0x7f6b201ee500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:45.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.125+0000 7f6b27800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b20142c50 con 0x7f6b201475a0 2024-01-17T22:58:45.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.125+0000 7f6b27800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b20141a90 con 0x7f6b20146170 2024-01-17T22:58:45.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.125+0000 7f6b27800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b201eeaf0 con 0x7f6b000073a0 2024-01-17T22:58:45.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.125+0000 7f6b25800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b201475a0 0x7f6b201ee500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:45.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.129+0000 7f6b25800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b201475a0 0x7f6b201ee500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46074/0 (socket says 172.21.15.161:46074) 2024-01-17T22:58:45.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.129+0000 7f6b25800640 1 -- 172.21.15.161:0/1959334634 learned_addr learned my addr 172.21.15.161:0/1959334634 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:45.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.129+0000 7f6b24e00640 1 --2- 172.21.15.161:0/1959334634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b000073a0 0x7f6b20140f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:45.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.129+0000 7f6b1fe00640 1 --2- 172.21.15.161:0/1959334634 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b20146170 0x7f6b201edfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:45.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.129+0000 7f6b25800640 1 -- 172.21.15.161:0/1959334634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b000073a0 msgr2=0x7f6b20140f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:45.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.129+0000 7f6b25800640 1 --2- 172.21.15.161:0/1959334634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b000073a0 0x7f6b20140f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:45.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.129+0000 7f6b25800640 1 -- 172.21.15.161:0/1959334634 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b20146170 msgr2=0x7f6b201edfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:45.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.129+0000 7f6b25800640 1 --2- 172.21.15.161:0/1959334634 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b20146170 0x7f6b201edfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:45.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.129+0000 7f6b25800640 1 -- 172.21.15.161:0/1959334634 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b20146a20 con 0x7f6b201475a0 2024-01-17T22:58:45.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.133+0000 7f6b25800640 1 --2- 172.21.15.161:0/1959334634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b201475a0 0x7f6b201ee500 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6b180987d0 tx=0x7f6b18009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:45.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.137+0000 7f6b1cc00640 1 -- 172.21.15.161:0/1959334634 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b180aed60 con 0x7f6b201475a0 2024-01-17T22:58:45.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.137+0000 7f6b1cc00640 1 -- 172.21.15.161:0/1959334634 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b180aeec0 con 0x7f6b201475a0 2024-01-17T22:58:45.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.137+0000 7f6b1cc00640 1 -- 172.21.15.161:0/1959334634 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b18003bc0 con 0x7f6b201475a0 2024-01-17T22:58:45.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.137+0000 7f6b27800640 1 -- 172.21.15.161:0/1959334634 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b201eedb0 con 0x7f6b201475a0 2024-01-17T22:58:45.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.137+0000 7f6b27800640 1 -- 172.21.15.161:0/1959334634 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b20146d00 con 0x7f6b201475a0 2024-01-17T22:58:45.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.137+0000 7f6b27800640 1 -- 172.21.15.161:0/1959334634 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b200c99a0 con 0x7f6b201475a0 2024-01-17T22:58:45.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.377+0000 7f6b1cc00640 1 -- 172.21.15.161:0/1959334634 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f6b18003d20 con 0x7f6b201475a0 2024-01-17T22:58:45.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.381+0000 7f6b1cc00640 1 --2- 172.21.15.161:0/1959334634 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6af8066890 0x7f6af8068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:45.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.381+0000 7f6b24e00640 1 --2- 172.21.15.161:0/1959334634 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6af8066890 0x7f6af8068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:45.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.381+0000 7f6b24e00640 1 --2- 172.21.15.161:0/1959334634 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6af8066890 0x7f6af8068d50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6b10001ec0 tx=0x7f6b10001a70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:45.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.389+0000 7f6b1cc00640 1 -- 172.21.15.161:0/1959334634 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6b180a6e40 con 0x7f6b201475a0 2024-01-17T22:58:45.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.389+0000 7f6b1cc00640 1 -- 172.21.15.161:0/1959334634 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f6b180edb00 con 0x7f6b201475a0 2024-01-17T22:58:45.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.541+0000 7f6b27800640 1 -- 172.21.15.161:0/1959334634 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b200c5850 con 0x7f6b201475a0 2024-01-17T22:58:45.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.545+0000 7f6b1cc00640 1 -- 172.21.15.161:0/1959334634 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b180f1120 con 0x7f6b201475a0 2024-01-17T22:58:45.544 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-01-17T22:58:45.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.549+0000 7f6b27800640 1 -- 172.21.15.161:0/1959334634 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6af8066890 msgr2=0x7f6af8068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:45.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.549+0000 7f6b27800640 1 --2- 172.21.15.161:0/1959334634 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6af8066890 0x7f6af8068d50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6b10001ec0 tx=0x7f6b10001a70 comp rx=0 tx=0).stop 2024-01-17T22:58:45.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.549+0000 7f6b27800640 1 -- 172.21.15.161:0/1959334634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b201475a0 msgr2=0x7f6b201ee500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:45.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.549+0000 7f6b27800640 1 --2- 172.21.15.161:0/1959334634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b201475a0 0x7f6b201ee500 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6b180987d0 tx=0x7f6b18009750 comp rx=0 tx=0).stop 2024-01-17T22:58:45.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.549+0000 7f6b27800640 1 -- 172.21.15.161:0/1959334634 shutdown_connections 2024-01-17T22:58:45.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.549+0000 7f6b27800640 1 --2- 172.21.15.161:0/1959334634 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6af8066890 0x7f6af8068d50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:45.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.549+0000 7f6b27800640 1 --2- 172.21.15.161:0/1959334634 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b20146170 0x7f6b201edfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:45.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.549+0000 7f6b27800640 1 --2- 172.21.15.161:0/1959334634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b201475a0 0x7f6b201ee500 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:45.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.549+0000 7f6b27800640 1 --2- 172.21.15.161:0/1959334634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b000073a0 0x7f6b20140f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:45.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.549+0000 7f6b27800640 1 -- 172.21.15.161:0/1959334634 >> 172.21.15.161:0/1959334634 conn(0x7f6b200c7a90 msgr2=0x7f6b20155b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:45.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.549+0000 7f6b27800640 1 -- 172.21.15.161:0/1959334634 shutdown_connections 2024-01-17T22:58:45.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.549+0000 7f6b27800640 1 -- 172.21.15.161:0/1959334634 wait complete. 2024-01-17T22:58:45.566 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-17T22:58:45.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.705+0000 7fb302000640 1 Processor -- start 2024-01-17T22:58:45.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.705+0000 7fb302000640 1 -- start start 2024-01-17T22:58:45.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.705+0000 7fb302000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb2fc153ab0 0x7fb2fc15d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:45.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.705+0000 7fb302000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2fc153e90 con 0x7fb2fc159700 2024-01-17T22:58:45.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.705+0000 7fb302000640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2fc15dc40 con 0x7fb2fc0c8100 2024-01-17T22:58:45.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.705+0000 7fb302000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2fc15a730 con 0x7fb2fc153ab0 2024-01-17T22:58:45.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.705+0000 7fb2fb400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb2fc153ab0 0x7fb2fc15d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:45.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.709+0000 7fb2fb400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb2fc153ab0 0x7fb2fc15d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46088/0 (socket says 172.21.15.161:46088) 2024-01-17T22:58:45.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.709+0000 7fb2fb400640 1 -- 172.21.15.161:0/1596780862 learned_addr learned my addr 172.21.15.161:0/1596780862 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:45.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.709+0000 7fb2fb400640 1 -- 172.21.15.161:0/1596780862 >> v1:172.21.15.190:6789/0 conn(0x7fb2fc0c8100 legacy=0x7fb2fc0c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:45.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.709+0000 7fb2fb400640 1 -- 172.21.15.161:0/1596780862 >> v1:172.21.15.161:6789/0 conn(0x7fb2fc159700 legacy=0x7fb2fc0cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:45.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.709+0000 7fb2fb400640 1 -- 172.21.15.161:0/1596780862 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc159bb0 con 0x7fb2fc153ab0 2024-01-17T22:58:45.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.717+0000 7fb2fb400640 1 --2- 172.21.15.161:0/1596780862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2fc153ab0 0x7fb2fc15d700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009870 tx=0x7fb2ec01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3dde94dec944b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:45.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.721+0000 7fb2fa000640 1 -- 172.21.15.161:0/1596780862 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec0aa430 con 0x7fb2fc153ab0 2024-01-17T22:58:45.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.721+0000 7fb2fa000640 1 -- 172.21.15.161:0/1596780862 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec0aa590 con 0x7fb2fc153ab0 2024-01-17T22:58:45.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.721+0000 7fb2fa000640 1 -- 172.21.15.161:0/1596780862 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec0aa920 con 0x7fb2fc153ab0 2024-01-17T22:58:45.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.721+0000 7fb302000640 1 -- 172.21.15.161:0/1596780862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2fc153ab0 msgr2=0x7fb2fc15d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:45.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.721+0000 7fb302000640 1 --2- 172.21.15.161:0/1596780862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2fc153ab0 0x7fb2fc15d700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009870 tx=0x7fb2ec01c4d0 comp rx=0 tx=0).stop 2024-01-17T22:58:45.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.721+0000 7fb302000640 1 -- 172.21.15.161:0/1596780862 shutdown_connections 2024-01-17T22:58:45.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.721+0000 7fb302000640 1 --2- 172.21.15.161:0/1596780862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2fc153ab0 0x7fb2fc15d700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:45.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.721+0000 7fb302000640 1 -- 172.21.15.161:0/1596780862 >> 172.21.15.161:0/1596780862 conn(0x7fb2fc061100 msgr2=0x7fb2fc061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:45.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.721+0000 7fb302000640 1 -- 172.21.15.161:0/1596780862 shutdown_connections 2024-01-17T22:58:45.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.721+0000 7fb302000640 1 -- 172.21.15.161:0/1596780862 wait complete. 2024-01-17T22:58:45.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.721+0000 7fb302000640 1 Processor -- start 2024-01-17T22:58:45.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.721+0000 7fb302000640 1 -- start start 2024-01-17T22:58:45.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.725+0000 7fb302000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2fc0c8100 0x7fb2fc1f2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:45.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.725+0000 7fb302000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2fc153ab0 0x7fb2fc14cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:45.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.725+0000 7fb302000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2fc159700 0x7fb2fc14d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:45.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.725+0000 7fb302000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc0cb440 con 0x7fb2fc0c8100 2024-01-17T22:58:45.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.725+0000 7fb302000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc1f3570 con 0x7fb2fc153ab0 2024-01-17T22:58:45.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.725+0000 7fb302000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc1f2cd0 con 0x7fb2fc159700 2024-01-17T22:58:45.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.725+0000 7fb2fb400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2fc0c8100 0x7fb2fc1f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:45.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.725+0000 7fb2fb400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2fc0c8100 0x7fb2fc1f2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46098/0 (socket says 172.21.15.161:46098) 2024-01-17T22:58:45.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.725+0000 7fb2fb400640 1 -- 172.21.15.161:0/3043275602 learned_addr learned my addr 172.21.15.161:0/3043275602 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:45.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.725+0000 7fb2fbe00640 1 --2- 172.21.15.161:0/3043275602 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2fc159700 0x7fb2fc14d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:45.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.725+0000 7fb2faa00640 1 --2- 172.21.15.161:0/3043275602 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2fc153ab0 0x7fb2fc14cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:45.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.729+0000 7fb2fb400640 1 -- 172.21.15.161:0/3043275602 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2fc159700 msgr2=0x7fb2fc14d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:45.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.729+0000 7fb2fb400640 1 --2- 172.21.15.161:0/3043275602 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2fc159700 0x7fb2fc14d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:45.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.729+0000 7fb2fb400640 1 -- 172.21.15.161:0/3043275602 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2fc153ab0 msgr2=0x7fb2fc14cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:45.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.729+0000 7fb2fb400640 1 --2- 172.21.15.161:0/3043275602 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2fc153ab0 0x7fb2fc14cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:45.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.729+0000 7fb2fb400640 1 -- 172.21.15.161:0/3043275602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec0094d0 con 0x7fb2fc0c8100 2024-01-17T22:58:45.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.733+0000 7fb2fb400640 1 --2- 172.21.15.161:0/3043275602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2fc0c8100 0x7fb2fc1f2620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0ac040 tx=0x7fb2ec01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:45.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.733+0000 7fb2f3400640 1 -- 172.21.15.161:0/3043275602 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec0b3800 con 0x7fb2fc0c8100 2024-01-17T22:58:45.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.733+0000 7fb2f3400640 1 -- 172.21.15.161:0/3043275602 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec0b3980 con 0x7fb2fc0c8100 2024-01-17T22:58:45.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.733+0000 7fb2f3400640 1 -- 172.21.15.161:0/3043275602 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec0b3d30 con 0x7fb2fc0c8100 2024-01-17T22:58:45.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.733+0000 7fb302000640 1 -- 172.21.15.161:0/3043275602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2fc1f2fb0 con 0x7fb2fc0c8100 2024-01-17T22:58:45.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.737+0000 7fb302000640 1 -- 172.21.15.161:0/3043275602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2fc0cb0d0 con 0x7fb2fc0c8100 2024-01-17T22:58:45.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.737+0000 7fb302000640 1 -- 172.21.15.161:0/3043275602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2fc0746a0 con 0x7fb2fc0c8100 2024-01-17T22:58:45.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.757+0000 7fb2f3400640 1 -- 172.21.15.161:0/3043275602 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fb2ec0c7420 con 0x7fb2fc0c8100 2024-01-17T22:58:45.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.757+0000 7fb2f3400640 1 --2- 172.21.15.161:0/3043275602 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb2d40668c0 0x7fb2d4068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:45.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.757+0000 7fb2faa00640 1 --2- 172.21.15.161:0/3043275602 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb2d40668c0 0x7fb2d4068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:45.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.757+0000 7fb2faa00640 1 --2- 172.21.15.161:0/3043275602 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb2d40668c0 0x7fb2d4068d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc15cc30 tx=0x7fb2e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:45.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.985+0000 7fb2f3400640 1 -- 172.21.15.161:0/3043275602 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb2ec0ef9f0 con 0x7fb2fc0c8100 2024-01-17T22:58:45.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:45.985+0000 7fb2f3400640 1 -- 172.21.15.161:0/3043275602 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fb2ec0ebd30 con 0x7fb2fc0c8100 2024-01-17T22:58:46.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.141+0000 7fb302000640 1 -- 172.21.15.161:0/3043275602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb2fc0746a0 con 0x7fb2fc0c8100 2024-01-17T22:58:46.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.149+0000 7fb2f3400640 1 -- 172.21.15.161:0/3043275602 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb2ec0ef350 con 0x7fb2fc0c8100 2024-01-17T22:58:46.146 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:58:46.147 INFO:teuthology.orchestra.run.smithi161.stdout:[ 2024-01-17T22:58:46.147 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-01-17T22:58:46.147 INFO:teuthology.orchestra.run.smithi161.stdout: "poolnum": 1, 2024-01-17T22:58:46.147 INFO:teuthology.orchestra.run.smithi161.stdout: "poolname": ".mgr" 2024-01-17T22:58:46.147 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-01-17T22:58:46.147 INFO:teuthology.orchestra.run.smithi161.stdout:] 2024-01-17T22:58:46.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.153+0000 7fb302000640 1 -- 172.21.15.161:0/3043275602 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb2d40668c0 msgr2=0x7fb2d4068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:46.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.153+0000 7fb302000640 1 --2- 172.21.15.161:0/3043275602 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb2d40668c0 0x7fb2d4068d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc15cc30 tx=0x7fb2e4009040 comp rx=0 tx=0).stop 2024-01-17T22:58:46.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.153+0000 7fb302000640 1 -- 172.21.15.161:0/3043275602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2fc0c8100 msgr2=0x7fb2fc1f2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:46.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.153+0000 7fb302000640 1 --2- 172.21.15.161:0/3043275602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2fc0c8100 0x7fb2fc1f2620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0ac040 tx=0x7fb2ec01ad10 comp rx=0 tx=0).stop 2024-01-17T22:58:46.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.153+0000 7fb302000640 1 -- 172.21.15.161:0/3043275602 shutdown_connections 2024-01-17T22:58:46.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.153+0000 7fb302000640 1 --2- 172.21.15.161:0/3043275602 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb2d40668c0 0x7fb2d4068d80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:46.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.153+0000 7fb302000640 1 --2- 172.21.15.161:0/3043275602 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2fc153ab0 0x7fb2fc14cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:46.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.153+0000 7fb302000640 1 --2- 172.21.15.161:0/3043275602 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2fc159700 0x7fb2fc14d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:46.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.153+0000 7fb302000640 1 --2- 172.21.15.161:0/3043275602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2fc0c8100 0x7fb2fc1f2620 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:46.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.153+0000 7fb302000640 1 -- 172.21.15.161:0/3043275602 >> 172.21.15.161:0/3043275602 conn(0x7fb2fc061100 msgr2=0x7fb2fc152060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:46.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.153+0000 7fb302000640 1 -- 172.21.15.161:0/3043275602 shutdown_connections 2024-01-17T22:58:46.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.153+0000 7fb302000640 1 -- 172.21.15.161:0/3043275602 wait complete. 2024-01-17T22:58:46.168 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-17T22:58:46.168 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-17T22:58:46.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.313+0000 7fede2000640 1 Processor -- start 2024-01-17T22:58:46.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.313+0000 7fede2000640 1 -- start start 2024-01-17T22:58:46.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.313+0000 7fede2000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feddc150480 0x7feddc0c5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:46.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.313+0000 7fede2000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feddc0726a0 0x7feddc0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:46.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.313+0000 7fede2000640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feddc071960 con 0x7feddc0bffb0 2024-01-17T22:58:46.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.313+0000 7fede2000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feddc1572c0 con 0x7feddc150480 2024-01-17T22:58:46.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.313+0000 7fede2000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc156720 con 0x7feddc0726a0 2024-01-17T22:58:46.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.313+0000 7feddb400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feddc150480 0x7feddc0c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:46.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.313+0000 7feddb400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feddc150480 0x7feddc0c5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46108/0 (socket says 172.21.15.161:46108) 2024-01-17T22:58:46.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.313+0000 7feddb400640 1 -- 172.21.15.161:0/591317622 learned_addr learned my addr 172.21.15.161:0/591317622 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:46.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.313+0000 7feddbe00640 1 --2- 172.21.15.161:0/591317622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feddc0726a0 0x7feddc0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:46.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.317+0000 7feddb400640 1 -- 172.21.15.161:0/591317622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feddc0726a0 msgr2=0x7feddc0cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:46.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.317+0000 7feddb400640 1 --2- 172.21.15.161:0/591317622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feddc0726a0 0x7feddc0cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:46.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.317+0000 7feddb400640 1 -- 172.21.15.161:0/591317622 >> v1:172.21.15.190:6789/0 conn(0x7feddc0bffb0 legacy=0x7feddc156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:46.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.317+0000 7feddb400640 1 -- 172.21.15.161:0/591317622 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc071bb0 con 0x7feddc150480 2024-01-17T22:58:46.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.321+0000 7feddb400640 1 --2- 172.21.15.161:0/591317622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feddc150480 0x7feddc0c5990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009870 tx=0x7fedcc01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a897205c91416a5c server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:46.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.325+0000 7fedda000640 1 -- 172.21.15.161:0/591317622 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0a8a30 con 0x7feddc150480 2024-01-17T22:58:46.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.325+0000 7fedda000640 1 -- 172.21.15.161:0/591317622 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc0a8b90 con 0x7feddc150480 2024-01-17T22:58:46.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.325+0000 7fedda000640 1 -- 172.21.15.161:0/591317622 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0b0440 con 0x7feddc150480 2024-01-17T22:58:46.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.325+0000 7fede2000640 1 -- 172.21.15.161:0/591317622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feddc150480 msgr2=0x7feddc0c5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:46.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.325+0000 7fede2000640 1 --2- 172.21.15.161:0/591317622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feddc150480 0x7feddc0c5990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009870 tx=0x7fedcc01ed30 comp rx=0 tx=0).stop 2024-01-17T22:58:46.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.325+0000 7fede2000640 1 -- 172.21.15.161:0/591317622 shutdown_connections 2024-01-17T22:58:46.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.325+0000 7fede2000640 1 --2- 172.21.15.161:0/591317622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feddc0726a0 0x7feddc0cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:46.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.325+0000 7fede2000640 1 --2- 172.21.15.161:0/591317622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feddc150480 0x7feddc0c5990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:46.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.325+0000 7fede2000640 1 -- 172.21.15.161:0/591317622 >> 172.21.15.161:0/591317622 conn(0x7feddc06aae0 msgr2=0x7feddc06aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:46.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.325+0000 7fede2000640 1 -- 172.21.15.161:0/591317622 shutdown_connections 2024-01-17T22:58:46.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.325+0000 7fede2000640 1 -- 172.21.15.161:0/591317622 wait complete. 2024-01-17T22:58:46.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.329+0000 7fede2000640 1 Processor -- start 2024-01-17T22:58:46.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.329+0000 7fede2000640 1 -- start start 2024-01-17T22:58:46.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.329+0000 7fede2000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feddc0726a0 0x7feddc1e8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:46.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.329+0000 7fede2000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feddc0bffb0 0x7feddc0ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:46.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.329+0000 7fede2000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feddc150480 0x7feddc1e9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:46.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.329+0000 7fede2000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0cac30 con 0x7feddc150480 2024-01-17T22:58:46.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.329+0000 7fede2000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0c9be0 con 0x7feddc0726a0 2024-01-17T22:58:46.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.329+0000 7fede2000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0ca690 con 0x7feddc0bffb0 2024-01-17T22:58:46.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.329+0000 7feddbe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feddc150480 0x7feddc1e9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:46.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.329+0000 7feddbe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feddc150480 0x7feddc1e9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46118/0 (socket says 172.21.15.161:46118) 2024-01-17T22:58:46.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.329+0000 7feddbe00640 1 -- 172.21.15.161:0/1149559913 learned_addr learned my addr 172.21.15.161:0/1149559913 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:46.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.329+0000 7feddb400640 1 --2- 172.21.15.161:0/1149559913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feddc0726a0 0x7feddc1e8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:46.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.329+0000 7feddaa00640 1 --2- 172.21.15.161:0/1149559913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feddc0bffb0 0x7feddc0ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:46.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.333+0000 7feddbe00640 1 -- 172.21.15.161:0/1149559913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feddc0bffb0 msgr2=0x7feddc0ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:46.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.333+0000 7feddbe00640 1 --2- 172.21.15.161:0/1149559913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feddc0bffb0 0x7feddc0ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:46.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.333+0000 7feddbe00640 1 -- 172.21.15.161:0/1149559913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feddc0726a0 msgr2=0x7feddc1e8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:46.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.333+0000 7feddbe00640 1 --2- 172.21.15.161:0/1149559913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feddc0726a0 0x7feddc1e8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:46.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.333+0000 7feddbe00640 1 -- 172.21.15.161:0/1149559913 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc0094d0 con 0x7feddc150480 2024-01-17T22:58:46.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.337+0000 7feddbe00640 1 --2- 172.21.15.161:0/1149559913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feddc150480 0x7feddc1e9820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009fd0 tx=0x7fedd400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:46.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.341+0000 7fedd3400640 1 -- 172.21.15.161:0/1149559913 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd4014420 con 0x7feddc150480 2024-01-17T22:58:46.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.341+0000 7fedd3400640 1 -- 172.21.15.161:0/1149559913 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd4014580 con 0x7feddc150480 2024-01-17T22:58:46.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.341+0000 7fedd3400640 1 -- 172.21.15.161:0/1149559913 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd4014930 con 0x7feddc150480 2024-01-17T22:58:46.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.341+0000 7fede2000640 1 -- 172.21.15.161:0/1149559913 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feddc0ca950 con 0x7feddc150480 2024-01-17T22:58:46.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.341+0000 7fede2000640 1 -- 172.21.15.161:0/1149559913 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feddc154170 con 0x7feddc150480 2024-01-17T22:58:46.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.341+0000 7fede2000640 1 -- 172.21.15.161:0/1149559913 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feddc0746a0 con 0x7feddc150480 2024-01-17T22:58:46.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.361+0000 7fedd3400640 1 -- 172.21.15.161:0/1149559913 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fedd4014a90 con 0x7feddc150480 2024-01-17T22:58:46.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.361+0000 7fedd3400640 1 --2- 172.21.15.161:0/1149559913 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fedb4066890 0x7fedb4068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:46.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.361+0000 7feddb400640 1 --2- 172.21.15.161:0/1149559913 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fedb4066890 0x7fedb4068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:46.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.361+0000 7feddb400640 1 --2- 172.21.15.161:0/1149559913 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fedb4066890 0x7fedb4068d50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0b2000 tx=0x7fedcc0aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:46.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.365+0000 7fedd3400640 1 -- 172.21.15.161:0/1149559913 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fedd4056360 con 0x7feddc150480 2024-01-17T22:58:46.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.593+0000 7fedd3400640 1 -- 172.21.15.161:0/1149559913 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fedd40526a0 con 0x7feddc150480 2024-01-17T22:58:46.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:46.749+0000 7fede2000640 1 -- 172.21.15.161:0/1149559913 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7feddc153b40 con 0x7feddc150480 2024-01-17T22:58:47.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.197+0000 7fedd3400640 1 -- 172.21.15.161:0/1149559913 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fedd4055cc0 con 0x7feddc150480 2024-01-17T22:58:47.196 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_metadata' created 2024-01-17T22:58:47.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.201+0000 7fede2000640 1 -- 172.21.15.161:0/1149559913 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fedb4066890 msgr2=0x7fedb4068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:47.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.201+0000 7fede2000640 1 --2- 172.21.15.161:0/1149559913 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fedb4066890 0x7fedb4068d50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0b2000 tx=0x7fedcc0aa070 comp rx=0 tx=0).stop 2024-01-17T22:58:47.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.201+0000 7fede2000640 1 -- 172.21.15.161:0/1149559913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feddc150480 msgr2=0x7feddc1e9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:47.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.201+0000 7fede2000640 1 --2- 172.21.15.161:0/1149559913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feddc150480 0x7feddc1e9820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009fd0 tx=0x7fedd400e4b0 comp rx=0 tx=0).stop 2024-01-17T22:58:47.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.201+0000 7fede2000640 1 -- 172.21.15.161:0/1149559913 shutdown_connections 2024-01-17T22:58:47.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.201+0000 7fede2000640 1 --2- 172.21.15.161:0/1149559913 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fedb4066890 0x7fedb4068d50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:47.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.201+0000 7fede2000640 1 --2- 172.21.15.161:0/1149559913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feddc150480 0x7feddc1e9820 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:47.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.201+0000 7fede2000640 1 --2- 172.21.15.161:0/1149559913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feddc0bffb0 0x7feddc0ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:47.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.201+0000 7fede2000640 1 --2- 172.21.15.161:0/1149559913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feddc0726a0 0x7feddc1e8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:47.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.201+0000 7fede2000640 1 -- 172.21.15.161:0/1149559913 >> 172.21.15.161:0/1149559913 conn(0x7feddc06aae0 msgr2=0x7feddc159c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:47.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.201+0000 7fede2000640 1 -- 172.21.15.161:0/1149559913 shutdown_connections 2024-01-17T22:58:47.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.201+0000 7fede2000640 1 -- 172.21.15.161:0/1149559913 wait complete. 2024-01-17T22:58:47.219 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-01-17T22:58:47.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.393+0000 7eff6be00640 1 Processor -- start 2024-01-17T22:58:47.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.393+0000 7eff6be00640 1 -- start start 2024-01-17T22:58:47.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.393+0000 7eff6be00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7eff64159620 0x7eff64070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:47.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.393+0000 7eff6be00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff64159c40 con 0x7eff640ca2f0 2024-01-17T22:58:47.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.393+0000 7eff6be00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff64159f20 con 0x7eff64153780 2024-01-17T22:58:47.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.393+0000 7eff6be00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff64159a50 con 0x7eff64159620 2024-01-17T22:58:47.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.393+0000 7eff69e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7eff64159620 0x7eff64070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:47.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.393+0000 7eff68a00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7eff640ca2f0 0x7eff6415d410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:41516/0 (socket says 172.21.15.161:41516) 2024-01-17T22:58:47.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.393+0000 7eff68a00640 1 -- 172.21.15.161:0/1568261902 learned_addr learned my addr 172.21.15.161:0/1568261902 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:58:47.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.397+0000 7eff69e00640 1 -- 172.21.15.161:0/1568261902 >> v1:172.21.15.190:6789/0 conn(0x7eff64153780 legacy=0x7eff6406c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:47.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.397+0000 7eff69e00640 1 -- 172.21.15.161:0/1568261902 >> v1:172.21.15.161:6789/0 conn(0x7eff640ca2f0 legacy=0x7eff6415d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:47.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.397+0000 7eff69e00640 1 -- 172.21.15.161:0/1568261902 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6415a200 con 0x7eff64159620 2024-01-17T22:58:47.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.401+0000 7eff69e00640 1 --2- 172.21.15.161:0/1568261902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff64159620 0x7eff64070d20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009d90 tx=0x7eff5c01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d602db6b53dc5e server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:47.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.405+0000 7eff63e00640 1 -- 172.21.15.161:0/1568261902 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0af600 con 0x7eff64159620 2024-01-17T22:58:47.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.405+0000 7eff63e00640 1 -- 172.21.15.161:0/1568261902 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c0ab050 con 0x7eff64159620 2024-01-17T22:58:47.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.405+0000 7eff63e00640 1 -- 172.21.15.161:0/1568261902 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0af980 con 0x7eff64159620 2024-01-17T22:58:47.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.409+0000 7eff6be00640 1 -- 172.21.15.161:0/1568261902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff64159620 msgr2=0x7eff64070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.409+0000 7eff6be00640 1 --2- 172.21.15.161:0/1568261902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff64159620 0x7eff64070d20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009d90 tx=0x7eff5c01f130 comp rx=0 tx=0).stop 2024-01-17T22:58:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.409+0000 7eff6be00640 1 -- 172.21.15.161:0/1568261902 shutdown_connections 2024-01-17T22:58:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.409+0000 7eff6be00640 1 --2- 172.21.15.161:0/1568261902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff64159620 0x7eff64070d20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.409+0000 7eff6be00640 1 -- 172.21.15.161:0/1568261902 >> 172.21.15.161:0/1568261902 conn(0x7eff64070390 msgr2=0x7eff6406f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.409+0000 7eff6be00640 1 -- 172.21.15.161:0/1568261902 shutdown_connections 2024-01-17T22:58:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.409+0000 7eff6be00640 1 -- 172.21.15.161:0/1568261902 wait complete. 2024-01-17T22:58:47.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.409+0000 7eff6be00640 1 Processor -- start 2024-01-17T22:58:47.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.409+0000 7eff6be00640 1 -- start start 2024-01-17T22:58:47.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.409+0000 7eff6be00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff640ca2f0 0x7eff640affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:47.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.409+0000 7eff6be00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff64153780 0x7eff641f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:47.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.409+0000 7eff6be00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff64159620 0x7eff640cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:47.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.409+0000 7eff6be00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff64154b50 con 0x7eff64159620 2024-01-17T22:58:47.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.409+0000 7eff6be00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff640b04e0 con 0x7eff64153780 2024-01-17T22:58:47.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.409+0000 7eff6be00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff641f3230 con 0x7eff640ca2f0 2024-01-17T22:58:47.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.413+0000 7eff68a00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff64153780 0x7eff641f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:47.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.413+0000 7eff68a00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff64153780 0x7eff641f2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:53344/0 (socket says 172.21.15.161:53344) 2024-01-17T22:58:47.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.413+0000 7eff68a00640 1 -- 172.21.15.161:0/2653634777 learned_addr learned my addr 172.21.15.161:0/2653634777 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:47.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.413+0000 7eff69e00640 1 --2- 172.21.15.161:0/2653634777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff64159620 0x7eff640cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:47.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.417+0000 7eff69e00640 1 -- 172.21.15.161:0/2653634777 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff640ca2f0 msgr2=0x7eff640affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:47.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.417+0000 7eff69e00640 1 --2- 172.21.15.161:0/2653634777 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff640ca2f0 0x7eff640affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:47.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.417+0000 7eff69e00640 1 -- 172.21.15.161:0/2653634777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff64153780 msgr2=0x7eff641f2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:47.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.417+0000 7eff69e00640 1 --2- 172.21.15.161:0/2653634777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff64153780 0x7eff641f2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:47.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.417+0000 7eff69e00640 1 -- 172.21.15.161:0/2653634777 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c009a70 con 0x7eff64159620 2024-01-17T22:58:47.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.421+0000 7eff69e00640 1 --2- 172.21.15.161:0/2653634777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff64159620 0x7eff640cd450 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0af000 tx=0x7eff5c01bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:47.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.425+0000 7eff61600640 1 -- 172.21.15.161:0/2653634777 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0ba420 con 0x7eff64159620 2024-01-17T22:58:47.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.425+0000 7eff61600640 1 -- 172.21.15.161:0/2653634777 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c0ba580 con 0x7eff64159620 2024-01-17T22:58:47.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.425+0000 7eff61600640 1 -- 172.21.15.161:0/2653634777 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0ba930 con 0x7eff64159620 2024-01-17T22:58:47.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.425+0000 7eff6be00640 1 -- 172.21.15.161:0/2653634777 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff64154390 con 0x7eff64159620 2024-01-17T22:58:47.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.425+0000 7eff6be00640 1 -- 172.21.15.161:0/2653634777 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff64154da0 con 0x7eff64159620 2024-01-17T22:58:47.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.425+0000 7eff6be00640 1 -- 172.21.15.161:0/2653634777 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff64154950 con 0x7eff64159620 2024-01-17T22:58:47.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.669+0000 7eff61600640 1 -- 172.21.15.161:0/2653634777 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7eff5c0baa90 con 0x7eff64159620 2024-01-17T22:58:47.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.669+0000 7eff61600640 1 --2- 172.21.15.161:0/2653634777 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7eff3c0668c0 0x7eff3c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:47.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.669+0000 7eff69400640 1 --2- 172.21.15.161:0/2653634777 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7eff3c0668c0 0x7eff3c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:47.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.669+0000 7eff69400640 1 --2- 172.21.15.161:0/2653634777 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7eff3c0668c0 0x7eff3c068d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff54000f70 tx=0x7eff540079e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:47.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.681+0000 7eff61600640 1 -- 172.21.15.161:0/2653634777 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7eff5c0f3d90 con 0x7eff64159620 2024-01-17T22:58:47.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.681+0000 7eff61600640 1 -- 172.21.15.161:0/2653634777 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7eff5c0f00d0 con 0x7eff64159620 2024-01-17T22:58:47.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:47.845+0000 7eff6be00640 1 -- 172.21.15.161:0/2653634777 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7eff640746a0 con 0x7eff64159620 2024-01-17T22:58:48.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.261+0000 7eff61600640 1 -- 172.21.15.161:0/2653634777 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7eff5c0b4020 con 0x7eff64159620 2024-01-17T22:58:48.258 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data' created 2024-01-17T22:58:48.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.265+0000 7eff6be00640 1 -- 172.21.15.161:0/2653634777 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7eff3c0668c0 msgr2=0x7eff3c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:48.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.265+0000 7eff6be00640 1 --2- 172.21.15.161:0/2653634777 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7eff3c0668c0 0x7eff3c068d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff54000f70 tx=0x7eff540079e0 comp rx=0 tx=0).stop 2024-01-17T22:58:48.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.265+0000 7eff6be00640 1 -- 172.21.15.161:0/2653634777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff64159620 msgr2=0x7eff640cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:48.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.265+0000 7eff6be00640 1 --2- 172.21.15.161:0/2653634777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff64159620 0x7eff640cd450 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0af000 tx=0x7eff5c01bed0 comp rx=0 tx=0).stop 2024-01-17T22:58:48.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.265+0000 7eff6be00640 1 -- 172.21.15.161:0/2653634777 shutdown_connections 2024-01-17T22:58:48.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.265+0000 7eff6be00640 1 --2- 172.21.15.161:0/2653634777 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7eff3c0668c0 0x7eff3c068d80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:48.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.265+0000 7eff6be00640 1 --2- 172.21.15.161:0/2653634777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff64153780 0x7eff641f2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:48.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.265+0000 7eff6be00640 1 --2- 172.21.15.161:0/2653634777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff64159620 0x7eff640cd450 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:48.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.265+0000 7eff6be00640 1 --2- 172.21.15.161:0/2653634777 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff640ca2f0 0x7eff640affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:48.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.265+0000 7eff6be00640 1 -- 172.21.15.161:0/2653634777 >> 172.21.15.161:0/2653634777 conn(0x7eff64070390 msgr2=0x7eff640c8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:48.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.265+0000 7eff6be00640 1 -- 172.21.15.161:0/2653634777 shutdown_connections 2024-01-17T22:58:48.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.265+0000 7eff6be00640 1 -- 172.21.15.161:0/2653634777 wait complete. 2024-01-17T22:58:48.290 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-17T22:58:48.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.461+0000 7f9ee2200640 1 Processor -- start 2024-01-17T22:58:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.461+0000 7f9ee2200640 1 -- start start 2024-01-17T22:58:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.461+0000 7f9ee2200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9edc1506b0 0x7f9edc0c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.461+0000 7f9ee2200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9edc156300 0x7f9edc06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.461+0000 7f9ee2200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc0bffb0 con 0x7f9edc0c0c60 2024-01-17T22:58:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.461+0000 7f9ee2200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9edc150a90 con 0x7f9edc156300 2024-01-17T22:58:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.461+0000 7f9ee2200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0b1130 con 0x7f9edc1506b0 2024-01-17T22:58:48.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.469+0000 7f9edb400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9edc1506b0 0x7f9edc0c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:48.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.469+0000 7f9edb400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9edc1506b0 0x7f9edc0c0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:33726/0 (socket says 172.21.15.161:33726) 2024-01-17T22:58:48.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.469+0000 7f9edb400640 1 -- 172.21.15.161:0/2318358562 learned_addr learned my addr 172.21.15.161:0/2318358562 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:48.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.473+0000 7f9edb400640 1 -- 172.21.15.161:0/2318358562 >> v2:172.21.15.161:3300/0 conn(0x7f9edc156300 msgr2=0x7f9edc06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:48.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.473+0000 7f9edb400640 1 --2- 172.21.15.161:0/2318358562 >> v2:172.21.15.161:3300/0 conn(0x7f9edc156300 0x7f9edc06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:48.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.473+0000 7f9edb400640 1 -- 172.21.15.161:0/2318358562 >> v1:172.21.15.161:6789/0 conn(0x7f9edc0c0c60 legacy=0x7f9edc0c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:48.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.473+0000 7f9edb400640 1 -- 172.21.15.161:0/2318358562 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc1567b0 con 0x7f9edc1506b0 2024-01-17T22:58:48.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.489+0000 7f9edb400640 1 --2- 172.21.15.161:0/2318358562 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9edc1506b0 0x7f9edc0c0720 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009870 tx=0x7f9ecc01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41d79c645d5cb1b server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:48.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.501+0000 7f9eda000640 1 -- 172.21.15.161:0/2318358562 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0aa5f0 con 0x7f9edc1506b0 2024-01-17T22:58:48.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.501+0000 7f9eda000640 1 -- 172.21.15.161:0/2318358562 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc0aa750 con 0x7f9edc1506b0 2024-01-17T22:58:48.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.501+0000 7f9eda000640 1 -- 172.21.15.161:0/2318358562 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0aaae0 con 0x7f9edc1506b0 2024-01-17T22:58:48.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.501+0000 7f9ee2200640 1 -- 172.21.15.161:0/2318358562 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9edc1506b0 msgr2=0x7f9edc0c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:48.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.501+0000 7f9ee2200640 1 --2- 172.21.15.161:0/2318358562 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9edc1506b0 0x7f9edc0c0720 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009870 tx=0x7f9ecc01c4d0 comp rx=0 tx=0).stop 2024-01-17T22:58:48.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.501+0000 7f9ee2200640 1 -- 172.21.15.161:0/2318358562 shutdown_connections 2024-01-17T22:58:48.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.501+0000 7f9ee2200640 1 --2- 172.21.15.161:0/2318358562 >> v2:172.21.15.161:3300/0 conn(0x7f9edc156300 0x7f9edc06d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:48.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.501+0000 7f9ee2200640 1 --2- 172.21.15.161:0/2318358562 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9edc1506b0 0x7f9edc0c0720 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:48.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.501+0000 7f9ee2200640 1 -- 172.21.15.161:0/2318358562 >> 172.21.15.161:0/2318358562 conn(0x7f9edc0c7a90 msgr2=0x7f9edc0c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:48.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.501+0000 7f9ee2200640 1 -- 172.21.15.161:0/2318358562 shutdown_connections 2024-01-17T22:58:48.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.501+0000 7f9ee2200640 1 -- 172.21.15.161:0/2318358562 wait complete. 2024-01-17T22:58:48.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.505+0000 7f9ee2200640 1 Processor -- start 2024-01-17T22:58:48.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.505+0000 7f9ee2200640 1 -- start start 2024-01-17T22:58:48.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.505+0000 7f9ee2200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0c0c60 0x7f9edc13f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:48.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.505+0000 7f9ee2200640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9edc1506b0 0x7f9edc13bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:48.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.505+0000 7f9ee2200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9edc156300 0x7f9edc0c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:48.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.505+0000 7f9ee2200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0c2bf0 con 0x7f9edc0c0c60 2024-01-17T22:58:48.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.505+0000 7f9ee2200640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0c37b0 con 0x7f9edc1506b0 2024-01-17T22:58:48.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.505+0000 7f9ee2200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc1f50f0 con 0x7f9edc156300 2024-01-17T22:58:48.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.505+0000 7f9edb400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0c0c60 0x7f9edc13f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.505+0000 7f9edaa00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9edc1506b0 0x7f9edc13bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.505+0000 7f9edb400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0c0c60 0x7f9edc13f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46142/0 (socket says 172.21.15.161:46142) 2024-01-17T22:58:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.505+0000 7f9edb400640 1 -- 172.21.15.161:0/1963630408 learned_addr learned my addr 172.21.15.161:0/1963630408 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.505+0000 7f9edbe00640 1 --2- 172.21.15.161:0/1963630408 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9edc156300 0x7f9edc0c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.509+0000 7f9edb400640 1 -- 172.21.15.161:0/1963630408 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9edc156300 msgr2=0x7f9edc0c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.509+0000 7f9edb400640 1 --2- 172.21.15.161:0/1963630408 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9edc156300 0x7f9edc0c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.509+0000 7f9edb400640 1 -- 172.21.15.161:0/1963630408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9edc1506b0 msgr2=0x7f9edc13bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.509+0000 7f9edb400640 1 --2- 172.21.15.161:0/1963630408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9edc1506b0 0x7f9edc13bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.509+0000 7f9edb400640 1 -- 172.21.15.161:0/1963630408 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0094d0 con 0x7f9edc0c0c60 2024-01-17T22:58:48.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.513+0000 7f9edb400640 1 --2- 172.21.15.161:0/1963630408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0c0c60 0x7f9edc13f650 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0ac040 tx=0x7f9ecc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:48.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.517+0000 7f9ed3400640 1 -- 172.21.15.161:0/1963630408 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0b3800 con 0x7f9edc0c0c60 2024-01-17T22:58:48.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.517+0000 7f9ed3400640 1 -- 172.21.15.161:0/1963630408 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc0b3980 con 0x7f9edc0c0c60 2024-01-17T22:58:48.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.517+0000 7f9ed3400640 1 -- 172.21.15.161:0/1963630408 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0b3d30 con 0x7f9edc0c0c60 2024-01-17T22:58:48.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.517+0000 7f9ee2200640 1 -- 172.21.15.161:0/1963630408 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc147a60 con 0x7f9edc0c0c60 2024-01-17T22:58:48.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.517+0000 7f9ee2200640 1 -- 172.21.15.161:0/1963630408 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc148020 con 0x7f9edc0c0c60 2024-01-17T22:58:48.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.517+0000 7f9ee2200640 1 -- 172.21.15.161:0/1963630408 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc0746a0 con 0x7f9edc0c0c60 2024-01-17T22:58:48.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.537+0000 7f9ed3400640 1 -- 172.21.15.161:0/1963630408 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f9ecc0c73e0 con 0x7f9edc0c0c60 2024-01-17T22:58:48.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.537+0000 7f9ed3400640 1 --2- 172.21.15.161:0/1963630408 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f9eb4066840 0x7f9eb4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:48.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.537+0000 7f9edaa00640 1 --2- 172.21.15.161:0/1963630408 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f9eb4066840 0x7f9eb4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:48.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.537+0000 7f9edaa00640 1 --2- 172.21.15.161:0/1963630408 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f9eb4066840 0x7f9eb4068d00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0c25b0 tx=0x7f9ec4006f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:48.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.769+0000 7f9ed3400640 1 -- 172.21.15.161:0/1963630408 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f9ecc0a7070 con 0x7f9edc0c0c60 2024-01-17T22:58:48.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.769+0000 7f9ed3400640 1 -- 172.21.15.161:0/1963630408 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f9ecc0ec210 con 0x7f9edc0c0c60 2024-01-17T22:58:48.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:48.973+0000 7f9ee2200640 1 -- 172.21.15.161:0/1963630408 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9edc06fb30 con 0x7f9edc0c0c60 2024-01-17T22:58:50.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.109+0000 7f9ed3400640 1 -- 172.21.15.161:0/1963630408 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9ecc0ef830 con 0x7f9edc0c0c60 2024-01-17T22:58:50.105 INFO:teuthology.orchestra.run.smithi161.stderr:new fs with metadata pool 2 and data pool 3 2024-01-17T22:58:50.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.109+0000 7f9ee2200640 1 -- 172.21.15.161:0/1963630408 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f9eb4066840 msgr2=0x7f9eb4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:50.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.109+0000 7f9ee2200640 1 --2- 172.21.15.161:0/1963630408 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f9eb4066840 0x7f9eb4068d00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0c25b0 tx=0x7f9ec4006f90 comp rx=0 tx=0).stop 2024-01-17T22:58:50.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.109+0000 7f9ee2200640 1 -- 172.21.15.161:0/1963630408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0c0c60 msgr2=0x7f9edc13f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:50.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.109+0000 7f9ee2200640 1 --2- 172.21.15.161:0/1963630408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0c0c60 0x7f9edc13f650 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0ac040 tx=0x7f9ecc01ad10 comp rx=0 tx=0).stop 2024-01-17T22:58:50.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.109+0000 7f9ee2200640 1 -- 172.21.15.161:0/1963630408 shutdown_connections 2024-01-17T22:58:50.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.109+0000 7f9ee2200640 1 --2- 172.21.15.161:0/1963630408 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f9eb4066840 0x7f9eb4068d00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:50.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.109+0000 7f9ee2200640 1 --2- 172.21.15.161:0/1963630408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9edc1506b0 0x7f9edc13bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:50.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.109+0000 7f9ee2200640 1 --2- 172.21.15.161:0/1963630408 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9edc156300 0x7f9edc0c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:50.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.109+0000 7f9ee2200640 1 --2- 172.21.15.161:0/1963630408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0c0c60 0x7f9edc13f650 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:50.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.109+0000 7f9ee2200640 1 -- 172.21.15.161:0/1963630408 >> 172.21.15.161:0/1963630408 conn(0x7f9edc0c7a90 msgr2=0x7f9edc142ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:50.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.109+0000 7f9ee2200640 1 -- 172.21.15.161:0/1963630408 shutdown_connections 2024-01-17T22:58:50.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.109+0000 7f9ee2200640 1 -- 172.21.15.161:0/1963630408 wait complete. 2024-01-17T22:58:50.127 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-01-17T22:58:50.128 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-01-17T22:58:50.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.273+0000 7f2b90000640 1 Processor -- start 2024-01-17T22:58:50.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.273+0000 7f2b90000640 1 -- start start 2024-01-17T22:58:50.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.273+0000 7f2b90000640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2b88153b30 0x7f2b880c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:50.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.273+0000 7f2b90000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b880c7e30 0x7f2b880ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:50.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.273+0000 7f2b90000640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8815a430 con 0x7f2b880c91a0 2024-01-17T22:58:50.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.273+0000 7f2b90000640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b880c8850 con 0x7f2b88153b30 2024-01-17T22:58:50.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.273+0000 7f2b90000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b88153f10 con 0x7f2b880c7e30 2024-01-17T22:58:50.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.277+0000 7f2b8e000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b880c7e30 0x7f2b880ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:50.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.277+0000 7f2b8d600640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2b88153b30 0x7f2b880c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:50.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.277+0000 7f2b8e000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b880c7e30 0x7f2b880ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:33738/0 (socket says 172.21.15.161:33738) 2024-01-17T22:58:50.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.277+0000 7f2b8e000640 1 -- 172.21.15.161:0/2196777697 learned_addr learned my addr 172.21.15.161:0/2196777697 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:50.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.285+0000 7f2b8e000640 1 -- 172.21.15.161:0/2196777697 >> v2:172.21.15.190:3300/0 conn(0x7f2b88153b30 msgr2=0x7f2b880c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:50.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.285+0000 7f2b8e000640 1 --2- 172.21.15.161:0/2196777697 >> v2:172.21.15.190:3300/0 conn(0x7f2b88153b30 0x7f2b880c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:50.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.285+0000 7f2b8e000640 1 -- 172.21.15.161:0/2196777697 >> v1:172.21.15.190:6789/0 conn(0x7f2b880c91a0 legacy=0x7f2b8815ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:50.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.285+0000 7f2b8e000640 1 -- 172.21.15.161:0/2196777697 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b880c96e0 con 0x7f2b880c7e30 2024-01-17T22:58:50.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.297+0000 7f2b8e000640 1 --2- 172.21.15.161:0/2196777697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b880c7e30 0x7f2b880ccfc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009e50 tx=0x7f2b8001ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9284537c90fb3952 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:50.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.309+0000 7f2b87e00640 1 -- 172.21.15.161:0/2196777697 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b800a57f0 con 0x7f2b880c7e30 2024-01-17T22:58:50.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.309+0000 7f2b87e00640 1 -- 172.21.15.161:0/2196777697 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b800a5950 con 0x7f2b880c7e30 2024-01-17T22:58:50.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.309+0000 7f2b87e00640 1 -- 172.21.15.161:0/2196777697 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b800a5ce0 con 0x7f2b880c7e30 2024-01-17T22:58:50.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.309+0000 7f2b90000640 1 -- 172.21.15.161:0/2196777697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b880c7e30 msgr2=0x7f2b880ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:50.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.309+0000 7f2b90000640 1 --2- 172.21.15.161:0/2196777697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b880c7e30 0x7f2b880ccfc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009e50 tx=0x7f2b8001ca10 comp rx=0 tx=0).stop 2024-01-17T22:58:50.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.309+0000 7f2b90000640 1 -- 172.21.15.161:0/2196777697 shutdown_connections 2024-01-17T22:58:50.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.309+0000 7f2b90000640 1 --2- 172.21.15.161:0/2196777697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b880c7e30 0x7f2b880ccfc0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:50.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.309+0000 7f2b90000640 1 --2- 172.21.15.161:0/2196777697 >> v2:172.21.15.190:3300/0 conn(0x7f2b88153b30 0x7f2b880c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:50.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.309+0000 7f2b90000640 1 -- 172.21.15.161:0/2196777697 >> 172.21.15.161:0/2196777697 conn(0x7f2b88061100 msgr2=0x7f2b88061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:50.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.309+0000 7f2b90000640 1 -- 172.21.15.161:0/2196777697 shutdown_connections 2024-01-17T22:58:50.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.309+0000 7f2b90000640 1 -- 172.21.15.161:0/2196777697 wait complete. 2024-01-17T22:58:50.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.309+0000 7f2b90000640 1 Processor -- start 2024-01-17T22:58:50.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.309+0000 7f2b90000640 1 -- start start 2024-01-17T22:58:50.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.313+0000 7f2b90000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b880c7e30 0x7f2b880c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:50.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.313+0000 7f2b90000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b880c91a0 0x7f2b881f32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:50.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.313+0000 7f2b90000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b88153b30 0x7f2b880acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:50.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.313+0000 7f2b90000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b880c4eb0 con 0x7f2b880c7e30 2024-01-17T22:58:50.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.313+0000 7f2b90000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b880c47b0 con 0x7f2b88153b30 2024-01-17T22:58:50.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.313+0000 7f2b90000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b881f3820 con 0x7f2b880c91a0 2024-01-17T22:58:50.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.313+0000 7f2b8e000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b88153b30 0x7f2b880acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:50.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.313+0000 7f2b8cc00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b880c91a0 0x7f2b881f32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:50.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.313+0000 7f2b8cc00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b880c91a0 0x7f2b881f32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:33752/0 (socket says 172.21.15.161:33752) 2024-01-17T22:58:50.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.313+0000 7f2b8cc00640 1 -- 172.21.15.161:0/1380303526 learned_addr learned my addr 172.21.15.161:0/1380303526 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:50.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.313+0000 7f2b8e000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b88153b30 0x7f2b880acc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:53368/0 (socket says 172.21.15.161:53368) 2024-01-17T22:58:50.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.313+0000 7f2b8d600640 1 --2- 172.21.15.161:0/1380303526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b880c7e30 0x7f2b880c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:50.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.325+0000 7f2b8cc00640 1 -- 172.21.15.161:0/1380303526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b88153b30 msgr2=0x7f2b880acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:50.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.325+0000 7f2b8cc00640 1 --2- 172.21.15.161:0/1380303526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b88153b30 0x7f2b880acc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:50.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.325+0000 7f2b8cc00640 1 -- 172.21.15.161:0/1380303526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b880c7e30 msgr2=0x7f2b880c4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:50.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.325+0000 7f2b8cc00640 1 --2- 172.21.15.161:0/1380303526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b880c7e30 0x7f2b880c4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:50.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.325+0000 7f2b8cc00640 1 -- 172.21.15.161:0/1380303526 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b80009b30 con 0x7f2b880c91a0 2024-01-17T22:58:50.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.325+0000 7f2b8e000640 1 --2- 172.21.15.161:0/1380303526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b88153b30 0x7f2b880acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-17T22:58:50.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.337+0000 7f2b8cc00640 1 --2- 172.21.15.161:0/1380303526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b880c91a0 0x7f2b881f32e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000c460 tx=0x7f2b7000c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:50.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.457+0000 7f2b85600640 1 -- 172.21.15.161:0/1380303526 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b700052d0 con 0x7f2b880c91a0 2024-01-17T22:58:50.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.457+0000 7f2b85600640 1 -- 172.21.15.161:0/1380303526 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b70005430 con 0x7f2b880c91a0 2024-01-17T22:58:50.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.457+0000 7f2b85600640 1 -- 172.21.15.161:0/1380303526 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b70007260 con 0x7f2b880c91a0 2024-01-17T22:58:50.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.457+0000 7f2b90000640 1 -- 172.21.15.161:0/1380303526 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b880c4990 con 0x7f2b880c91a0 2024-01-17T22:58:50.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.457+0000 7f2b90000640 1 -- 172.21.15.161:0/1380303526 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b880c5370 con 0x7f2b880c91a0 2024-01-17T22:58:50.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.457+0000 7f2b90000640 1 -- 172.21.15.161:0/1380303526 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8806d980 con 0x7f2b880c91a0 2024-01-17T22:58:50.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.481+0000 7f2b85600640 1 -- 172.21.15.161:0/1380303526 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f2b700073c0 con 0x7f2b880c91a0 2024-01-17T22:58:50.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.481+0000 7f2b85600640 1 --2- 172.21.15.161:0/1380303526 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2b600668c0 0x7f2b60068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:50.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.481+0000 7f2b8d600640 1 --2- 172.21.15.161:0/1380303526 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2b600668c0 0x7f2b60068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:50.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.481+0000 7f2b8d600640 1 --2- 172.21.15.161:0/1380303526 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2b600668c0 0x7f2b60068d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009b60 tx=0x7f2b78009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:50.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.737+0000 7f2b85600640 1 -- 172.21.15.161:0/1380303526 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b70007670 con 0x7f2b880c91a0 2024-01-17T22:58:50.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.749+0000 7f2b85600640 1 -- 172.21.15.161:0/1380303526 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f2b700519f0 con 0x7f2b880c91a0 2024-01-17T22:58:50.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:50.917+0000 7f2b90000640 1 -- 172.21.15.161:0/1380303526 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f2b880c3300 con 0x7f2b880c91a0 2024-01-17T22:58:51.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:51.977+0000 7f2b85600640 1 -- 172.21.15.161:0/1380303526 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7f2b70055010 con 0x7f2b880c91a0 2024-01-17T22:58:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:51.977+0000 7f2b90000640 1 -- 172.21.15.161:0/1380303526 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2b600668c0 msgr2=0x7f2b60068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:51.977+0000 7f2b90000640 1 --2- 172.21.15.161:0/1380303526 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2b600668c0 0x7f2b60068d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009b60 tx=0x7f2b78009190 comp rx=0 tx=0).stop 2024-01-17T22:58:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:51.977+0000 7f2b90000640 1 -- 172.21.15.161:0/1380303526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b880c91a0 msgr2=0x7f2b881f32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:51.977+0000 7f2b90000640 1 --2- 172.21.15.161:0/1380303526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b880c91a0 0x7f2b881f32e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000c460 tx=0x7f2b7000c920 comp rx=0 tx=0).stop 2024-01-17T22:58:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:51.977+0000 7f2b90000640 1 -- 172.21.15.161:0/1380303526 shutdown_connections 2024-01-17T22:58:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:51.977+0000 7f2b90000640 1 --2- 172.21.15.161:0/1380303526 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2b600668c0 0x7f2b60068d80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:51.977+0000 7f2b90000640 1 --2- 172.21.15.161:0/1380303526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b88153b30 0x7f2b880acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:51.977+0000 7f2b90000640 1 --2- 172.21.15.161:0/1380303526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b880c91a0 0x7f2b881f32e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:51.977+0000 7f2b90000640 1 --2- 172.21.15.161:0/1380303526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b880c7e30 0x7f2b880c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:51.977+0000 7f2b90000640 1 -- 172.21.15.161:0/1380303526 >> 172.21.15.161:0/1380303526 conn(0x7f2b88061100 msgr2=0x7f2b880614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:51.977+0000 7f2b90000640 1 -- 172.21.15.161:0/1380303526 shutdown_connections 2024-01-17T22:58:51.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:51.977+0000 7f2b90000640 1 -- 172.21.15.161:0/1380303526 wait complete. 2024-01-17T22:58:51.996 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-01-17T22:58:52.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.149+0000 7f6019e00640 1 Processor -- start 2024-01-17T22:58:52.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.149+0000 7f6019e00640 1 -- start start 2024-01-17T22:58:52.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.149+0000 7f6019e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6014153b10 0x7f601406bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:52.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.149+0000 7f6019e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601415a200 con 0x7f601406baa0 2024-01-17T22:58:52.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.149+0000 7f6019e00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601415da00 con 0x7f601415ce90 2024-01-17T22:58:52.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.149+0000 7f6019e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f601415dcc0 con 0x7f6014153b10 2024-01-17T22:58:52.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.149+0000 7f6012a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6014153b10 0x7f601406bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:52.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.149+0000 7f6012000640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f601406baa0 0x7f60140c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36794/0 (socket says 172.21.15.161:36794) 2024-01-17T22:58:52.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.149+0000 7f6012000640 1 -- 172.21.15.161:0/2285842697 learned_addr learned my addr 172.21.15.161:0/2285842697 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:58:52.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.153+0000 7f6012a00640 1 -- 172.21.15.161:0/2285842697 >> v1:172.21.15.190:6789/0 conn(0x7f601415ce90 legacy=0x7f6014164220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:52.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.153+0000 7f6012a00640 1 -- 172.21.15.161:0/2285842697 >> v1:172.21.15.161:6789/0 conn(0x7f601406baa0 legacy=0x7f60140c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:52.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.153+0000 7f6012a00640 1 -- 172.21.15.161:0/2285842697 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6014159bb0 con 0x7f6014153b10 2024-01-17T22:58:52.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.157+0000 7f6012a00640 1 --2- 172.21.15.161:0/2285842697 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6014153b10 0x7f601406bff0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f60040097c0 tx=0x7f600401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef0e997b92caf54 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:52.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.161+0000 7f6011600640 1 -- 172.21.15.161:0/2285842697 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60040a8930 con 0x7f6014153b10 2024-01-17T22:58:52.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.161+0000 7f6011600640 1 -- 172.21.15.161:0/2285842697 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60040a8a90 con 0x7f6014153b10 2024-01-17T22:58:52.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.161+0000 7f6011600640 1 -- 172.21.15.161:0/2285842697 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60040a8e20 con 0x7f6014153b10 2024-01-17T22:58:52.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.161+0000 7f6019e00640 1 -- 172.21.15.161:0/2285842697 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6014153b10 msgr2=0x7f601406bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:52.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.161+0000 7f6019e00640 1 --2- 172.21.15.161:0/2285842697 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6014153b10 0x7f601406bff0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f60040097c0 tx=0x7f600401ec30 comp rx=0 tx=0).stop 2024-01-17T22:58:52.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.165+0000 7f6019e00640 1 -- 172.21.15.161:0/2285842697 shutdown_connections 2024-01-17T22:58:52.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.165+0000 7f6019e00640 1 --2- 172.21.15.161:0/2285842697 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6014153b10 0x7f601406bff0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:52.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.165+0000 7f6019e00640 1 -- 172.21.15.161:0/2285842697 >> 172.21.15.161:0/2285842697 conn(0x7f6014061100 msgr2=0x7f6014061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:52.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.165+0000 7f6019e00640 1 -- 172.21.15.161:0/2285842697 shutdown_connections 2024-01-17T22:58:52.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.165+0000 7f6019e00640 1 -- 172.21.15.161:0/2285842697 wait complete. 2024-01-17T22:58:52.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.165+0000 7f6019e00640 1 Processor -- start 2024-01-17T22:58:52.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.165+0000 7f6019e00640 1 -- start start 2024-01-17T22:58:52.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.165+0000 7f6019e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f601406baa0 0x7f6014156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:52.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.165+0000 7f6019e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6014153b10 0x7f60140c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:52.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.165+0000 7f6019e00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f601415ce90 0x7f60140c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:52.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.165+0000 7f6019e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60140c4270 con 0x7f601406baa0 2024-01-17T22:58:52.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.165+0000 7f6019e00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60141e4f10 con 0x7f601415ce90 2024-01-17T22:58:52.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.165+0000 7f6019e00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60141e5370 con 0x7f6014153b10 2024-01-17T22:58:52.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.169+0000 7f6012a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f601406baa0 0x7f6014156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:52.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.169+0000 7f6012a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f601406baa0 0x7f6014156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55790/0 (socket says 172.21.15.161:55790) 2024-01-17T22:58:52.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.169+0000 7f6012a00640 1 -- 172.21.15.161:0/676879114 learned_addr learned my addr 172.21.15.161:0/676879114 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:52.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.169+0000 7f6012000640 1 --2- 172.21.15.161:0/676879114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6014153b10 0x7f60140c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:52.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.173+0000 7f6012a00640 1 -- 172.21.15.161:0/676879114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6014153b10 msgr2=0x7f60140c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:52.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.173+0000 7f6012a00640 1 --2- 172.21.15.161:0/676879114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6014153b10 0x7f60140c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:52.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.173+0000 7f6012a00640 1 -- 172.21.15.161:0/676879114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f601415ce90 msgr2=0x7f60140c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:52.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.173+0000 7f6012a00640 1 --2- 172.21.15.161:0/676879114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f601415ce90 0x7f60140c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:52.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.173+0000 7f6012a00640 1 -- 172.21.15.161:0/676879114 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6004009420 con 0x7f601406baa0 2024-01-17T22:58:52.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.173+0000 7f6012a00640 1 --2- 172.21.15.161:0/676879114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f601406baa0 0x7f6014156620 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f600401b840 tx=0x7f600401b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:52.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.177+0000 7f600b400640 1 -- 172.21.15.161:0/676879114 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60040b9600 con 0x7f601406baa0 2024-01-17T22:58:52.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.181+0000 7f600b400640 1 -- 172.21.15.161:0/676879114 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60040b97a0 con 0x7f601406baa0 2024-01-17T22:58:52.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.181+0000 7f600b400640 1 -- 172.21.15.161:0/676879114 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60040b9b50 con 0x7f601406baa0 2024-01-17T22:58:52.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.181+0000 7f6019e00640 1 -- 172.21.15.161:0/676879114 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60141e5650 con 0x7f601406baa0 2024-01-17T22:58:52.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.181+0000 7f6019e00640 1 -- 172.21.15.161:0/676879114 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60141e5c10 con 0x7f601406baa0 2024-01-17T22:58:52.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.181+0000 7f6019e00640 1 -- 172.21.15.161:0/676879114 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601406d950 con 0x7f601406baa0 2024-01-17T22:58:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.417+0000 7f600b400640 1 -- 172.21.15.161:0/676879114 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f60040b7040 con 0x7f601406baa0 2024-01-17T22:58:52.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.421+0000 7f600b400640 1 --2- 172.21.15.161:0/676879114 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5fec0668c0 0x7f5fec068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:52.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.421+0000 7f6012000640 1 --2- 172.21.15.161:0/676879114 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5fec0668c0 0x7f5fec068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.421+0000 7f6012000640 1 --2- 172.21.15.161:0/676879114 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5fec0668c0 0x7f5fec068d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f60140c7ba0 tx=0x7f5ffc007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:52.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.445+0000 7f600b400640 1 -- 172.21.15.161:0/676879114 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f60040a88d0 con 0x7f601406baa0 2024-01-17T22:58:52.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.445+0000 7f600b400640 1 -- 172.21.15.161:0/676879114 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f60040efe90 con 0x7f601406baa0 2024-01-17T22:58:52.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:52.605+0000 7f6019e00640 1 -- 172.21.15.161:0/676879114 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f60140746a0 con 0x7f601406baa0 2024-01-17T22:58:54.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.553+0000 7f600b400640 1 -- 172.21.15.161:0/676879114 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7f60040b5070 con 0x7f601406baa0 2024-01-17T22:58:54.552 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data_ec' created 2024-01-17T22:58:54.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.557+0000 7f6019e00640 1 -- 172.21.15.161:0/676879114 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5fec0668c0 msgr2=0x7f5fec068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:54.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.557+0000 7f6019e00640 1 --2- 172.21.15.161:0/676879114 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5fec0668c0 0x7f5fec068d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f60140c7ba0 tx=0x7f5ffc007e90 comp rx=0 tx=0).stop 2024-01-17T22:58:54.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.557+0000 7f6019e00640 1 -- 172.21.15.161:0/676879114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f601406baa0 msgr2=0x7f6014156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:54.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.557+0000 7f6019e00640 1 --2- 172.21.15.161:0/676879114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f601406baa0 0x7f6014156620 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f600401b840 tx=0x7f600401b9d0 comp rx=0 tx=0).stop 2024-01-17T22:58:54.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.557+0000 7f6019e00640 1 -- 172.21.15.161:0/676879114 shutdown_connections 2024-01-17T22:58:54.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.557+0000 7f6019e00640 1 --2- 172.21.15.161:0/676879114 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5fec0668c0 0x7f5fec068d80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:54.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.557+0000 7f6019e00640 1 --2- 172.21.15.161:0/676879114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f601415ce90 0x7f60140c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:54.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.557+0000 7f6019e00640 1 --2- 172.21.15.161:0/676879114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6014153b10 0x7f60140c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:54.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.557+0000 7f6019e00640 1 --2- 172.21.15.161:0/676879114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f601406baa0 0x7f6014156620 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:54.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.557+0000 7f6019e00640 1 -- 172.21.15.161:0/676879114 >> 172.21.15.161:0/676879114 conn(0x7f6014061100 msgr2=0x7f601415b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:54.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.557+0000 7f6019e00640 1 -- 172.21.15.161:0/676879114 shutdown_connections 2024-01-17T22:58:54.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.557+0000 7f6019e00640 1 -- 172.21.15.161:0/676879114 wait complete. 2024-01-17T22:58:54.577 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-01-17T22:58:54.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.737+0000 7fddde800640 1 Processor -- start 2024-01-17T22:58:54.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.737+0000 7fddde800640 1 -- start start 2024-01-17T22:58:54.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.737+0000 7fddde800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fddd8072240 0x7fddd8157f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:54.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.737+0000 7fddde800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd8072cd0 con 0x7fddd80c51f0 2024-01-17T22:58:54.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.737+0000 7fddde800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd8158440 con 0x7fddd80c4e10 2024-01-17T22:58:54.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.737+0000 7fddde800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd806ba40 con 0x7fddd8072240 2024-01-17T22:58:54.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.745+0000 7fddd7400640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fddd80c4e10 0x7fddd806a6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.161:42944/0 (socket says 172.21.15.161:42944) 2024-01-17T22:58:54.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.745+0000 7fddd7400640 1 -- 172.21.15.161:0/4091152028 learned_addr learned my addr 172.21.15.161:0/4091152028 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:58:54.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.781+0000 7fddd7e00640 1 --2- 172.21.15.161:0/4091152028 >> v2:172.21.15.161:3300/0 conn(0x7fddd8072240 0x7fddd8157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:54.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.785+0000 7fddd7e00640 1 -- 172.21.15.161:0/4091152028 >> v1:172.21.15.190:6789/0 conn(0x7fddd80c4e10 legacy=0x7fddd806a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:54.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.785+0000 7fddd7e00640 1 -- 172.21.15.161:0/4091152028 >> v1:172.21.15.161:6789/0 conn(0x7fddd80c51f0 legacy=0x7fddd8071b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:54.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.785+0000 7fddd7e00640 1 -- 172.21.15.161:0/4091152028 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd806bce0 con 0x7fddd8072240 2024-01-17T22:58:54.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.789+0000 7fddd7e00640 1 --2- 172.21.15.161:0/4091152028 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddd8072240 0x7fddd8157f00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009d90 tx=0x7fddd001f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bd696577b00ec6 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:54.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.793+0000 7fddd6000640 1 -- 172.21.15.161:0/4091152028 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd00af600 con 0x7fddd8072240 2024-01-17T22:58:54.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.793+0000 7fddd6000640 1 -- 172.21.15.161:0/4091152028 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd00ab050 con 0x7fddd8072240 2024-01-17T22:58:54.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.793+0000 7fddd6000640 1 -- 172.21.15.161:0/4091152028 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd00af980 con 0x7fddd8072240 2024-01-17T22:58:54.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.793+0000 7fddde800640 1 -- 172.21.15.161:0/4091152028 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddd8072240 msgr2=0x7fddd8157f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:54.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.793+0000 7fddde800640 1 --2- 172.21.15.161:0/4091152028 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddd8072240 0x7fddd8157f00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009d90 tx=0x7fddd001f100 comp rx=0 tx=0).stop 2024-01-17T22:58:54.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.793+0000 7fddde800640 1 -- 172.21.15.161:0/4091152028 shutdown_connections 2024-01-17T22:58:54.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.793+0000 7fddde800640 1 --2- 172.21.15.161:0/4091152028 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddd8072240 0x7fddd8157f00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:54.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.793+0000 7fddde800640 1 -- 172.21.15.161:0/4091152028 >> 172.21.15.161:0/4091152028 conn(0x7fddd80cb4a0 msgr2=0x7fddd80cb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:54.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.793+0000 7fddde800640 1 -- 172.21.15.161:0/4091152028 shutdown_connections 2024-01-17T22:58:54.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.793+0000 7fddde800640 1 -- 172.21.15.161:0/4091152028 wait complete. 2024-01-17T22:58:54.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.797+0000 7fddde800640 1 Processor -- start 2024-01-17T22:58:54.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.797+0000 7fddde800640 1 -- start start 2024-01-17T22:58:54.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.797+0000 7fddde800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddd8072240 0x7fddd8140b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:54.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.797+0000 7fddde800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddd80c4e10 0x7fddd8145190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:54.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.797+0000 7fddde800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddd80c51f0 0x7fddd81f2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:54.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.797+0000 7fddde800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80cb270 con 0x7fddd80c51f0 2024-01-17T22:58:54.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.797+0000 7fddde800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80cacf0 con 0x7fddd80c4e10 2024-01-17T22:58:54.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.797+0000 7fddde800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80caf90 con 0x7fddd8072240 2024-01-17T22:58:54.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.797+0000 7fddd7e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddd80c51f0 0x7fddd81f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:54.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.797+0000 7fddd7e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddd80c51f0 0x7fddd81f2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55804/0 (socket says 172.21.15.161:55804) 2024-01-17T22:58:54.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.797+0000 7fddd7e00640 1 -- 172.21.15.161:0/2621993829 learned_addr learned my addr 172.21.15.161:0/2621993829 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:54.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.801+0000 7fddd7e00640 1 -- 172.21.15.161:0/2621993829 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddd8072240 msgr2=0x7fddd8140b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:54.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.801+0000 7fddd7e00640 1 --2- 172.21.15.161:0/2621993829 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddd8072240 0x7fddd8140b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:54.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.801+0000 7fddd7e00640 1 -- 172.21.15.161:0/2621993829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddd80c4e10 msgr2=0x7fddd8145190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:54.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.801+0000 7fddd7e00640 1 --2- 172.21.15.161:0/2621993829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddd80c4e10 0x7fddd8145190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:54.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.801+0000 7fddd7e00640 1 -- 172.21.15.161:0/2621993829 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd0009a70 con 0x7fddd80c51f0 2024-01-17T22:58:54.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.805+0000 7fddd7e00640 1 --2- 172.21.15.161:0/2621993829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddd80c51f0 0x7fddd81f2550 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fddd001cd30 tx=0x7fddd001bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:54.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.809+0000 7fddcf400640 1 -- 172.21.15.161:0/2621993829 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd00b9610 con 0x7fddd80c51f0 2024-01-17T22:58:54.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.809+0000 7fddde800640 1 -- 172.21.15.161:0/2621993829 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd80c4370 con 0x7fddd80c51f0 2024-01-17T22:58:54.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.809+0000 7fddde800640 1 -- 172.21.15.161:0/2621993829 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd8145bf0 con 0x7fddd80c51f0 2024-01-17T22:58:54.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.809+0000 7fddcf400640 1 -- 172.21.15.161:0/2621993829 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd00afe10 con 0x7fddd80c51f0 2024-01-17T22:58:54.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.809+0000 7fddcf400640 1 -- 172.21.15.161:0/2621993829 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd00b9970 con 0x7fddd80c51f0 2024-01-17T22:58:54.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.809+0000 7fddde800640 1 -- 172.21.15.161:0/2621993829 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda80052a0 con 0x7fddd80c51f0 2024-01-17T22:58:54.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.829+0000 7fddcf400640 1 -- 172.21.15.161:0/2621993829 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fddd00b6050 con 0x7fddd80c51f0 2024-01-17T22:58:54.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.829+0000 7fddcf400640 1 --2- 172.21.15.161:0/2621993829 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fddb0066840 0x7fddb0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:54.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.829+0000 7fddd7400640 1 --2- 172.21.15.161:0/2621993829 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fddb0066840 0x7fddb0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:54.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.829+0000 7fddd7400640 1 --2- 172.21.15.161:0/2621993829 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fddb0066840 0x7fddb0068d00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fddc8004fa0 tx=0x7fddc8007ab0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:54.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:54.833+0000 7fddcf400640 1 -- 172.21.15.161:0/2621993829 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fddd00f48d0 con 0x7fddd80c51f0 2024-01-17T22:58:55.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.085+0000 7fddcf400640 1 -- 172.21.15.161:0/2621993829 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fddd00f3fa0 con 0x7fddd80c51f0 2024-01-17T22:58:55.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.237+0000 7fddde800640 1 -- 172.21.15.161:0/2621993829 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fdda8005550 con 0x7fddd80c51f0 2024-01-17T22:58:55.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.745+0000 7fddcf400640 1 -- 172.21.15.161:0/2621993829 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fddd00b4070 con 0x7fddd80c51f0 2024-01-17T22:58:55.743 INFO:teuthology.orchestra.run.smithi161.stderr:set pool 4 allow_ec_overwrites to true 2024-01-17T22:58:55.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.749+0000 7fddde800640 1 -- 172.21.15.161:0/2621993829 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fddb0066840 msgr2=0x7fddb0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:55.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.749+0000 7fddde800640 1 --2- 172.21.15.161:0/2621993829 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fddb0066840 0x7fddb0068d00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fddc8004fa0 tx=0x7fddc8007ab0 comp rx=0 tx=0).stop 2024-01-17T22:58:55.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.749+0000 7fddde800640 1 -- 172.21.15.161:0/2621993829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddd80c51f0 msgr2=0x7fddd81f2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:55.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.749+0000 7fddde800640 1 --2- 172.21.15.161:0/2621993829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddd80c51f0 0x7fddd81f2550 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fddd001cd30 tx=0x7fddd001bea0 comp rx=0 tx=0).stop 2024-01-17T22:58:55.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.749+0000 7fddde800640 1 -- 172.21.15.161:0/2621993829 shutdown_connections 2024-01-17T22:58:55.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.749+0000 7fddde800640 1 --2- 172.21.15.161:0/2621993829 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fddb0066840 0x7fddb0068d00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:55.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.749+0000 7fddde800640 1 --2- 172.21.15.161:0/2621993829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddd80c4e10 0x7fddd8145190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:55.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.749+0000 7fddde800640 1 --2- 172.21.15.161:0/2621993829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddd80c51f0 0x7fddd81f2550 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:55.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.749+0000 7fddde800640 1 --2- 172.21.15.161:0/2621993829 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddd8072240 0x7fddd8140b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:55.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.749+0000 7fddde800640 1 -- 172.21.15.161:0/2621993829 >> 172.21.15.161:0/2621993829 conn(0x7fddd80cb4a0 msgr2=0x7fddd8155210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:55.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.749+0000 7fddde800640 1 -- 172.21.15.161:0/2621993829 shutdown_connections 2024-01-17T22:58:55.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.749+0000 7fddde800640 1 -- 172.21.15.161:0/2621993829 wait complete. 2024-01-17T22:58:55.766 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-01-17T22:58:55.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.937+0000 7f9abaa00640 1 Processor -- start 2024-01-17T22:58:55.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.937+0000 7f9abaa00640 1 -- start start 2024-01-17T22:58:55.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.937+0000 7f9abaa00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ab4151760 0x7f9ab40c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:55.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.937+0000 7f9abaa00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9ab40ca410 0x7f9ab4070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:55.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.937+0000 7f9abaa00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab4157540 con 0x7f9ab4071260 2024-01-17T22:58:55.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.937+0000 7f9abaa00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab4151b40 con 0x7f9ab40ca410 2024-01-17T22:58:55.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.937+0000 7f9abaa00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab415aa30 con 0x7f9ab4151760 2024-01-17T22:58:55.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.941+0000 7f9ab3e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ab4151760 0x7f9ab40c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:55.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.941+0000 7f9ab3e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ab4151760 0x7f9ab40c2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:38320/0 (socket says 172.21.15.161:38320) 2024-01-17T22:58:55.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.941+0000 7f9ab3e00640 1 -- 172.21.15.161:0/2125605726 learned_addr learned my addr 172.21.15.161:0/2125605726 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:55.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.945+0000 7f9ab3400640 1 --2- 172.21.15.161:0/2125605726 >> v2:172.21.15.161:3300/0 conn(0x7f9ab40ca410 0x7f9ab4070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:55.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.945+0000 7f9ab3e00640 1 -- 172.21.15.161:0/2125605726 >> v2:172.21.15.161:3300/0 conn(0x7f9ab40ca410 msgr2=0x7f9ab4070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:55.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.945+0000 7f9ab3e00640 1 --2- 172.21.15.161:0/2125605726 >> v2:172.21.15.161:3300/0 conn(0x7f9ab40ca410 0x7f9ab4070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:55.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.945+0000 7f9ab3e00640 1 -- 172.21.15.161:0/2125605726 >> v1:172.21.15.161:6789/0 conn(0x7f9ab4071260 legacy=0x7f9ab41579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:55.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.945+0000 7f9ab3e00640 1 -- 172.21.15.161:0/2125605726 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab415acf0 con 0x7f9ab4151760 2024-01-17T22:58:55.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:55.957+0000 7f9ab3e00640 1 --2- 172.21.15.161:0/2125605726 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ab4151760 0x7f9ab40c2a60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4009870 tx=0x7f9aa401ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c708696ad66396a server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:56.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.013+0000 7f9ab2a00640 1 -- 172.21.15.161:0/2125605726 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40a89b0 con 0x7f9ab4151760 2024-01-17T22:58:56.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.017+0000 7f9ab2a00640 1 -- 172.21.15.161:0/2125605726 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa40a8b10 con 0x7f9ab4151760 2024-01-17T22:58:56.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.017+0000 7f9ab2a00640 1 -- 172.21.15.161:0/2125605726 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40a8ea0 con 0x7f9ab4151760 2024-01-17T22:58:56.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.017+0000 7f9abaa00640 1 -- 172.21.15.161:0/2125605726 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ab4151760 msgr2=0x7f9ab40c2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:56.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.017+0000 7f9abaa00640 1 --2- 172.21.15.161:0/2125605726 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ab4151760 0x7f9ab40c2a60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4009870 tx=0x7f9aa401ecf0 comp rx=0 tx=0).stop 2024-01-17T22:58:56.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.017+0000 7f9abaa00640 1 -- 172.21.15.161:0/2125605726 shutdown_connections 2024-01-17T22:58:56.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.017+0000 7f9abaa00640 1 --2- 172.21.15.161:0/2125605726 >> v2:172.21.15.161:3300/0 conn(0x7f9ab40ca410 0x7f9ab4070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:56.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.017+0000 7f9abaa00640 1 --2- 172.21.15.161:0/2125605726 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ab4151760 0x7f9ab40c2a60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:56.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.017+0000 7f9abaa00640 1 -- 172.21.15.161:0/2125605726 >> 172.21.15.161:0/2125605726 conn(0x7f9ab4070390 msgr2=0x7f9ab406f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:56.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.017+0000 7f9abaa00640 1 -- 172.21.15.161:0/2125605726 shutdown_connections 2024-01-17T22:58:56.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.017+0000 7f9abaa00640 1 -- 172.21.15.161:0/2125605726 wait complete. 2024-01-17T22:58:56.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.017+0000 7f9abaa00640 1 Processor -- start 2024-01-17T22:58:56.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.017+0000 7f9abaa00640 1 -- start start 2024-01-17T22:58:56.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.021+0000 7f9abaa00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ab4071260 0x7f9ab41e28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:56.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.021+0000 7f9abaa00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ab40ca410 0x7f9ab406bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:56.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.021+0000 7f9abaa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ab4151760 0x7f9ab4154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:56.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.021+0000 7f9abaa00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab406d090 con 0x7f9ab4151760 2024-01-17T22:58:56.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.021+0000 7f9abaa00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab4154a80 con 0x7f9ab4071260 2024-01-17T22:58:56.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.021+0000 7f9abaa00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab406d7c0 con 0x7f9ab40ca410 2024-01-17T22:58:56.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.021+0000 7f9ab3400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ab40ca410 0x7f9ab406bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:56.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.025+0000 7f9ab3400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ab40ca410 0x7f9ab406bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:38324/0 (socket says 172.21.15.161:38324) 2024-01-17T22:58:56.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.025+0000 7f9ab3400640 1 -- 172.21.15.161:0/1879827742 learned_addr learned my addr 172.21.15.161:0/1879827742 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:56.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.033+0000 7f9ab8a00640 1 --2- 172.21.15.161:0/1879827742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ab4151760 0x7f9ab4154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:56.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.033+0000 7f9ab3400640 1 -- 172.21.15.161:0/1879827742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ab4071260 msgr2=0x7f9ab41e28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:56.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.033+0000 7f9ab3400640 1 --2- 172.21.15.161:0/1879827742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ab4071260 0x7f9ab41e28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:56.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.033+0000 7f9ab3400640 1 -- 172.21.15.161:0/1879827742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ab4151760 msgr2=0x7f9ab4154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:56.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.033+0000 7f9ab3400640 1 --2- 172.21.15.161:0/1879827742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ab4151760 0x7f9ab4154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:56.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.033+0000 7f9ab3400640 1 -- 172.21.15.161:0/1879827742 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa40094d0 con 0x7f9ab40ca410 2024-01-17T22:58:56.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.045+0000 7f9ab3400640 1 --2- 172.21.15.161:0/1879827742 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ab40ca410 0x7f9ab406bc20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00e9b0 tx=0x7f9a9c00ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:56.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.057+0000 7f9aabe00640 1 -- 172.21.15.161:0/1879827742 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c0096b0 con 0x7f9ab40ca410 2024-01-17T22:58:56.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.057+0000 7f9aabe00640 1 -- 172.21.15.161:0/1879827742 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9c00c9a0 con 0x7f9ab40ca410 2024-01-17T22:58:56.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.057+0000 7f9aabe00640 1 -- 172.21.15.161:0/1879827742 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c00cd30 con 0x7f9ab40ca410 2024-01-17T22:58:56.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.057+0000 7f9abaa00640 1 -- 172.21.15.161:0/1879827742 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab41f32e0 con 0x7f9ab40ca410 2024-01-17T22:58:56.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.057+0000 7f9abaa00640 1 -- 172.21.15.161:0/1879827742 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab41e3500 con 0x7f9ab40ca410 2024-01-17T22:58:56.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.057+0000 7f9abaa00640 1 -- 172.21.15.161:0/1879827742 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab40746a0 con 0x7f9ab40ca410 2024-01-17T22:58:56.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.392+0000 7f9aabe00640 1 -- 172.21.15.161:0/1879827742 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f9a9c013470 con 0x7f9ab40ca410 2024-01-17T22:58:56.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.392+0000 7f9aabe00640 1 --2- 172.21.15.161:0/1879827742 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f9a8c066890 0x7f9a8c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:56.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.392+0000 7f9ab3e00640 1 --2- 172.21.15.161:0/1879827742 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f9a8c066890 0x7f9a8c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:56.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.396+0000 7f9ab3e00640 1 --2- 172.21.15.161:0/1879827742 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f9a8c066890 0x7f9a8c068d50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40b2000 tx=0x7f9aa4004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:56.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.400+0000 7f9aabe00640 1 -- 172.21.15.161:0/1879827742 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f9a9c0561c0 con 0x7f9ab40ca410 2024-01-17T22:58:56.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.428+0000 7f9aabe00640 1 -- 172.21.15.161:0/1879827742 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f9a9c051e00 con 0x7f9ab40ca410 2024-01-17T22:58:56.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:56.612+0000 7f9abaa00640 1 -- 172.21.15.161:0/1879827742 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f9ab40c35e0 con 0x7f9ab40ca410 2024-01-17T22:58:57.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.312+0000 7f9aabe00640 1 -- 172.21.15.161:0/1879827742 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f9a9c0210b0 con 0x7f9ab40ca410 2024-01-17T22:58:57.310 INFO:teuthology.orchestra.run.smithi161.stderr:added data pool 4 to fsmap 2024-01-17T22:58:57.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.312+0000 7f9abaa00640 1 -- 172.21.15.161:0/1879827742 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f9a8c066890 msgr2=0x7f9a8c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:57.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.312+0000 7f9abaa00640 1 --2- 172.21.15.161:0/1879827742 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f9a8c066890 0x7f9a8c068d50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40b2000 tx=0x7f9aa4004740 comp rx=0 tx=0).stop 2024-01-17T22:58:57.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.312+0000 7f9abaa00640 1 -- 172.21.15.161:0/1879827742 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ab40ca410 msgr2=0x7f9ab406bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:57.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.312+0000 7f9abaa00640 1 --2- 172.21.15.161:0/1879827742 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ab40ca410 0x7f9ab406bc20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00e9b0 tx=0x7f9a9c00ee70 comp rx=0 tx=0).stop 2024-01-17T22:58:57.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.312+0000 7f9abaa00640 1 -- 172.21.15.161:0/1879827742 shutdown_connections 2024-01-17T22:58:57.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.312+0000 7f9abaa00640 1 --2- 172.21.15.161:0/1879827742 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f9a8c066890 0x7f9a8c068d50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:57.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.312+0000 7f9abaa00640 1 --2- 172.21.15.161:0/1879827742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ab4151760 0x7f9ab4154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:57.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.312+0000 7f9abaa00640 1 --2- 172.21.15.161:0/1879827742 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ab40ca410 0x7f9ab406bc20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:57.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.312+0000 7f9abaa00640 1 --2- 172.21.15.161:0/1879827742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ab4071260 0x7f9ab41e28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:57.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.312+0000 7f9abaa00640 1 -- 172.21.15.161:0/1879827742 >> 172.21.15.161:0/1879827742 conn(0x7f9ab4070390 msgr2=0x7f9ab40c93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:57.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.312+0000 7f9abaa00640 1 -- 172.21.15.161:0/1879827742 shutdown_connections 2024-01-17T22:58:57.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.316+0000 7f9abaa00640 1 -- 172.21.15.161:0/1879827742 wait complete. 2024-01-17T22:58:57.332 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T22:58:57.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.468+0000 7fe6aa000640 1 Processor -- start 2024-01-17T22:58:57.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.468+0000 7fe6aa000640 1 -- start start 2024-01-17T22:58:57.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.472+0000 7fe6aa000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6a40caee0 0x7fe6a406bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:57.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.472+0000 7fe6aa000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe6a406c460 0x7fe6a4153420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:57.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.472+0000 7fe6aa000640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a40c9910 con 0x7fe6a40cb690 2024-01-17T22:58:57.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.472+0000 7fe6aa000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a40b44d0 con 0x7fe6a406c460 2024-01-17T22:58:57.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.472+0000 7fe6aa000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40c9ed0 con 0x7fe6a40caee0 2024-01-17T22:58:57.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.472+0000 7fe6a3e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe6a406c460 0x7fe6a4153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:57.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.472+0000 7fe6a3e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe6a406c460 0x7fe6a4153420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55838/0 (socket says 172.21.15.161:55838) 2024-01-17T22:58:57.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.472+0000 7fe6a3e00640 1 -- 172.21.15.161:0/3204038906 learned_addr learned my addr 172.21.15.161:0/3204038906 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:57.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.472+0000 7fe6a2a00640 1 --2- 172.21.15.161:0/3204038906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6a40caee0 0x7fe6a406bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:57.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.476+0000 7fe6a3e00640 1 -- 172.21.15.161:0/3204038906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6a40caee0 msgr2=0x7fe6a406bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:57.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.476+0000 7fe6a3e00640 1 --2- 172.21.15.161:0/3204038906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6a40caee0 0x7fe6a406bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:57.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.476+0000 7fe6a3e00640 1 -- 172.21.15.161:0/3204038906 >> v1:172.21.15.190:6789/0 conn(0x7fe6a40cb690 legacy=0x7fe6a40cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:57.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.476+0000 7fe6a3e00640 1 -- 172.21.15.161:0/3204038906 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a406c8f0 con 0x7fe6a406c460 2024-01-17T22:58:57.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.480+0000 7fe6a3e00640 1 --2- 172.21.15.161:0/3204038906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6a406c460 0x7fe6a4153420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009e50 tx=0x7fe69c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a9a6967d4ce9be server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:57.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.484+0000 7fe6a2000640 1 -- 172.21.15.161:0/3204038906 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0a5640 con 0x7fe6a406c460 2024-01-17T22:58:57.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.484+0000 7fe6a2000640 1 -- 172.21.15.161:0/3204038906 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69c0a57a0 con 0x7fe6a406c460 2024-01-17T22:58:57.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.484+0000 7fe6a2000640 1 -- 172.21.15.161:0/3204038906 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0a5b30 con 0x7fe6a406c460 2024-01-17T22:58:57.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.484+0000 7fe6aa000640 1 -- 172.21.15.161:0/3204038906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6a406c460 msgr2=0x7fe6a4153420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:57.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.484+0000 7fe6aa000640 1 --2- 172.21.15.161:0/3204038906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6a406c460 0x7fe6a4153420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009e50 tx=0x7fe69c01c980 comp rx=0 tx=0).stop 2024-01-17T22:58:57.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.484+0000 7fe6aa000640 1 -- 172.21.15.161:0/3204038906 shutdown_connections 2024-01-17T22:58:57.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.484+0000 7fe6aa000640 1 --2- 172.21.15.161:0/3204038906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6a406c460 0x7fe6a4153420 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:57.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.484+0000 7fe6aa000640 1 --2- 172.21.15.161:0/3204038906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6a40caee0 0x7fe6a406bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:57.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.484+0000 7fe6aa000640 1 -- 172.21.15.161:0/3204038906 >> 172.21.15.161:0/3204038906 conn(0x7fe6a408b6f0 msgr2=0x7fe6a4061100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:57.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.484+0000 7fe6aa000640 1 -- 172.21.15.161:0/3204038906 shutdown_connections 2024-01-17T22:58:57.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.484+0000 7fe6aa000640 1 -- 172.21.15.161:0/3204038906 wait complete. 2024-01-17T22:58:57.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.484+0000 7fe6aa000640 1 Processor -- start 2024-01-17T22:58:57.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.484+0000 7fe6aa000640 1 -- start start 2024-01-17T22:58:57.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.488+0000 7fe6aa000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6a406c460 0x7fe6a40c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:57.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.488+0000 7fe6aa000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6a40caee0 0x7fe6a414ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:57.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.488+0000 7fe6aa000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6a40cb690 0x7fe6a41498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:57.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.488+0000 7fe6aa000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40c6fc0 con 0x7fe6a40cb690 2024-01-17T22:58:57.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.488+0000 7fe6aa000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a41f1a70 con 0x7fe6a40caee0 2024-01-17T22:58:57.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.488+0000 7fe6aa000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a41f1c80 con 0x7fe6a406c460 2024-01-17T22:58:57.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.488+0000 7fe6a3e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6a40cb690 0x7fe6a41498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:57.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.488+0000 7fe6a3e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6a40cb690 0x7fe6a41498d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55842/0 (socket says 172.21.15.161:55842) 2024-01-17T22:58:57.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.488+0000 7fe6a3e00640 1 -- 172.21.15.161:0/4018222139 learned_addr learned my addr 172.21.15.161:0/4018222139 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:57.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.488+0000 7fe6a3400640 1 --2- 172.21.15.161:0/4018222139 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6a406c460 0x7fe6a40c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:57.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.488+0000 7fe6a2a00640 1 --2- 172.21.15.161:0/4018222139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6a40caee0 0x7fe6a414ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:57.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.492+0000 7fe6a3e00640 1 -- 172.21.15.161:0/4018222139 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6a406c460 msgr2=0x7fe6a40c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:57.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.492+0000 7fe6a3e00640 1 --2- 172.21.15.161:0/4018222139 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6a406c460 0x7fe6a40c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:57.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.492+0000 7fe6a3e00640 1 -- 172.21.15.161:0/4018222139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6a40caee0 msgr2=0x7fe6a414ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:57.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.492+0000 7fe6a3e00640 1 --2- 172.21.15.161:0/4018222139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6a40caee0 0x7fe6a414ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:57.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.492+0000 7fe6a3e00640 1 -- 172.21.15.161:0/4018222139 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c009b30 con 0x7fe6a40cb690 2024-01-17T22:58:57.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.496+0000 7fe6a3e00640 1 --2- 172.21.15.161:0/4018222139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6a40cb690 0x7fe6a41498d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe69c01a5b0 tx=0x7fe69c019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:57.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.496+0000 7fe69b400640 1 -- 172.21.15.161:0/4018222139 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0a5640 con 0x7fe6a40cb690 2024-01-17T22:58:57.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.500+0000 7fe69b400640 1 -- 172.21.15.161:0/4018222139 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69c0b8470 con 0x7fe6a40cb690 2024-01-17T22:58:57.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.500+0000 7fe69b400640 1 -- 172.21.15.161:0/4018222139 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0b8860 con 0x7fe6a40cb690 2024-01-17T22:58:57.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.500+0000 7fe6aa000640 1 -- 172.21.15.161:0/4018222139 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a41f1f60 con 0x7fe6a40cb690 2024-01-17T22:58:57.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.500+0000 7fe6aa000640 1 -- 172.21.15.161:0/4018222139 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a41f2520 con 0x7fe6a40cb690 2024-01-17T22:58:57.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.500+0000 7fe6aa000640 1 -- 172.21.15.161:0/4018222139 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a4067c90 con 0x7fe6a40cb690 2024-01-17T22:58:57.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.520+0000 7fe69b400640 1 -- 172.21.15.161:0/4018222139 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fe69c0b89c0 con 0x7fe6a40cb690 2024-01-17T22:58:57.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.520+0000 7fe69b400640 1 --2- 172.21.15.161:0/4018222139 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe67c0668c0 0x7fe67c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:57.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.520+0000 7fe6a3400640 1 --2- 172.21.15.161:0/4018222139 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe67c0668c0 0x7fe67c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:57.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.520+0000 7fe6a3400640 1 --2- 172.21.15.161:0/4018222139 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe67c0668c0 0x7fe67c068d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe694001770 tx=0x7fe694009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:57.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.752+0000 7fe69b400640 1 -- 172.21.15.161:0/4018222139 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe69c0f09a0 con 0x7fe6a40cb690 2024-01-17T22:58:57.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.752+0000 7fe69b400640 1 -- 172.21.15.161:0/4018222139 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fe69c0ecce0 con 0x7fe6a40cb690 2024-01-17T22:58:57.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.936+0000 7fe6aa000640 1 -- 172.21.15.161:0/4018222139 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6a40746a0 con 0x7fe6a40cb690 2024-01-17T22:58:57.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.960+0000 7fe69b400640 1 -- 172.21.15.161:0/4018222139 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6526 (secure 0 0 0) 0x7fe69c0f0300 con 0x7fe6a40cb690 2024-01-17T22:58:57.957 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:58:57.957 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6839/2820898287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":2820898287},{"type":"v1","addr":"172.21.15.161:6839","nonce":2820898287}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/2332272186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2332272186},{"type":"v1","addr":"172.21.15.190:6833","nonce":2332272186}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3170137737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3170137737},{"type":"v1","addr":"172.21.15.190:6835","nonce":3170137737}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1671527613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1671527613},{"type":"v1","addr":"172.21.15.161:6835","nonce":1671527613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/409686078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":409686078},{"type":"v1","addr":"172.21.15.161:6837","nonce":409686078}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-17T22:58:49.015246+0000","modified":"2024-01-17T22:58:56.644431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":7,"addr":"172.21.15.190:6837/561131647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":561131647},{"type":"v1","addr":"172.21.15.190:6837","nonce":561131647}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-17T22:58:57.958 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 7 2024-01-17T22:58:57.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.960+0000 7fe6aa000640 1 -- 172.21.15.161:0/4018222139 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe67c0668c0 msgr2=0x7fe67c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:57.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.960+0000 7fe6aa000640 1 --2- 172.21.15.161:0/4018222139 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe67c0668c0 0x7fe67c068d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe694001770 tx=0x7fe694009040 comp rx=0 tx=0).stop 2024-01-17T22:58:57.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.960+0000 7fe6aa000640 1 -- 172.21.15.161:0/4018222139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6a40cb690 msgr2=0x7fe6a41498d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:57.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.960+0000 7fe6aa000640 1 --2- 172.21.15.161:0/4018222139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6a40cb690 0x7fe6a41498d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe69c01a5b0 tx=0x7fe69c019720 comp rx=0 tx=0).stop 2024-01-17T22:58:57.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.960+0000 7fe6aa000640 1 -- 172.21.15.161:0/4018222139 shutdown_connections 2024-01-17T22:58:57.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.960+0000 7fe6aa000640 1 --2- 172.21.15.161:0/4018222139 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe67c0668c0 0x7fe67c068d80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:57.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.960+0000 7fe6aa000640 1 --2- 172.21.15.161:0/4018222139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6a40caee0 0x7fe6a414ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:57.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.960+0000 7fe6aa000640 1 --2- 172.21.15.161:0/4018222139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6a40cb690 0x7fe6a41498d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:57.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.960+0000 7fe6aa000640 1 --2- 172.21.15.161:0/4018222139 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6a406c460 0x7fe6a40c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:57.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.960+0000 7fe6aa000640 1 -- 172.21.15.161:0/4018222139 >> 172.21.15.161:0/4018222139 conn(0x7fe6a408b6f0 msgr2=0x7fe6a4150600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:57.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.960+0000 7fe6aa000640 1 -- 172.21.15.161:0/4018222139 shutdown_connections 2024-01-17T22:58:57.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:57.960+0000 7fe6aa000640 1 -- 172.21.15.161:0/4018222139 wait complete. 2024-01-17T22:58:57.981 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T22:58:58.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.124+0000 7f4b7f200640 1 Processor -- start 2024-01-17T22:58:58.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.124+0000 7f4b7f200640 1 -- start start 2024-01-17T22:58:58.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.124+0000 7f4b7f200640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4b78153970 0x7f4b7815a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:58.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.124+0000 7f4b7f200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b780cc010 0x7f4b780cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:58.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.124+0000 7f4b7f200640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7815a6b0 con 0x7f4b7806e970 2024-01-17T22:58:58.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.124+0000 7f4b7f200640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7806af30 con 0x7f4b78153970 2024-01-17T22:58:58.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.124+0000 7f4b7f200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7806e720 con 0x7f4b780cc010 2024-01-17T22:58:58.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.128+0000 7f4b77e00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4b78153970 0x7f4b7815a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:58.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.128+0000 7f4b7d200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b780cc010 0x7f4b780cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:58.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.128+0000 7f4b77e00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4b78153970 0x7f4b7815a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:42346/0 (socket says 172.21.15.161:42346) 2024-01-17T22:58:58.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.128+0000 7f4b77e00640 1 -- 172.21.15.161:0/3054564720 learned_addr learned my addr 172.21.15.161:0/3054564720 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:58.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.136+0000 7f4b7d200640 1 -- 172.21.15.161:0/3054564720 >> v2:172.21.15.190:3300/0 conn(0x7f4b78153970 msgr2=0x7f4b7815a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:58.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.136+0000 7f4b7d200640 1 --2- 172.21.15.161:0/3054564720 >> v2:172.21.15.190:3300/0 conn(0x7f4b78153970 0x7f4b7815a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:58.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.136+0000 7f4b7d200640 1 -- 172.21.15.161:0/3054564720 >> v1:172.21.15.190:6789/0 conn(0x7f4b7806e970 legacy=0x7f4b7815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:58.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.136+0000 7f4b7d200640 1 -- 172.21.15.161:0/3054564720 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7806ac50 con 0x7f4b780cc010 2024-01-17T22:58:58.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.140+0000 7f4b7d200640 1 --2- 172.21.15.161:0/3054564720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b780cc010 0x7f4b780cc4a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009d90 tx=0x7f4b7001f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebcabd4067767a25 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:58.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.148+0000 7f4b76a00640 1 -- 172.21.15.161:0/3054564720 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b700af600 con 0x7f4b780cc010 2024-01-17T22:58:58.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.148+0000 7f4b76a00640 1 -- 172.21.15.161:0/3054564720 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b700ab050 con 0x7f4b780cc010 2024-01-17T22:58:58.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.148+0000 7f4b76a00640 1 -- 172.21.15.161:0/3054564720 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b700af980 con 0x7f4b780cc010 2024-01-17T22:58:58.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.148+0000 7f4b7f200640 1 -- 172.21.15.161:0/3054564720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b780cc010 msgr2=0x7f4b780cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:58.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.148+0000 7f4b7f200640 1 --2- 172.21.15.161:0/3054564720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b780cc010 0x7f4b780cc4a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009d90 tx=0x7f4b7001f130 comp rx=0 tx=0).stop 2024-01-17T22:58:58.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.148+0000 7f4b7f200640 1 -- 172.21.15.161:0/3054564720 shutdown_connections 2024-01-17T22:58:58.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.148+0000 7f4b7f200640 1 --2- 172.21.15.161:0/3054564720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b780cc010 0x7f4b780cc4a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:58.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.148+0000 7f4b7f200640 1 --2- 172.21.15.161:0/3054564720 >> v2:172.21.15.190:3300/0 conn(0x7f4b78153970 0x7f4b7815a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:58.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.148+0000 7f4b7f200640 1 -- 172.21.15.161:0/3054564720 >> 172.21.15.161:0/3054564720 conn(0x7f4b78072670 msgr2=0x7f4b7806fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:58.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.152+0000 7f4b7f200640 1 -- 172.21.15.161:0/3054564720 shutdown_connections 2024-01-17T22:58:58.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.152+0000 7f4b7f200640 1 -- 172.21.15.161:0/3054564720 wait complete. 2024-01-17T22:58:58.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.152+0000 7f4b7f200640 1 Processor -- start 2024-01-17T22:58:58.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.152+0000 7f4b7f200640 1 -- start start 2024-01-17T22:58:58.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.152+0000 7f4b7f200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b7806e970 0x7f4b7815bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:58.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.152+0000 7f4b7f200640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b780cc010 0x7f4b7814c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:58.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.152+0000 7f4b7f200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b78153970 0x7f4b781f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:58.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.152+0000 7f4b7f200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780c4700 con 0x7f4b7806e970 2024-01-17T22:58:58.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.152+0000 7f4b7f200640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7814c1f0 con 0x7f4b780cc010 2024-01-17T22:58:58.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.152+0000 7f4b7f200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780c3480 con 0x7f4b78153970 2024-01-17T22:58:58.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.152+0000 7f4b77e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b7806e970 0x7f4b7815bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:58.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.152+0000 7f4b77e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b7806e970 0x7f4b7815bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55854/0 (socket says 172.21.15.161:55854) 2024-01-17T22:58:58.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.152+0000 7f4b77e00640 1 -- 172.21.15.161:0/2334532958 learned_addr learned my addr 172.21.15.161:0/2334532958 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:58.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.156+0000 7f4b77400640 1 --2- 172.21.15.161:0/2334532958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b780cc010 0x7f4b7814c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:58.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.156+0000 7f4b7d200640 1 --2- 172.21.15.161:0/2334532958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b78153970 0x7f4b781f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:58.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.156+0000 7f4b77e00640 1 -- 172.21.15.161:0/2334532958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b78153970 msgr2=0x7f4b781f24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:58.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.156+0000 7f4b77e00640 1 --2- 172.21.15.161:0/2334532958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b78153970 0x7f4b781f24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:58.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.156+0000 7f4b77e00640 1 -- 172.21.15.161:0/2334532958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b780cc010 msgr2=0x7f4b7814c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:58.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.156+0000 7f4b77e00640 1 --2- 172.21.15.161:0/2334532958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b780cc010 0x7f4b7814c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:58.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.156+0000 7f4b77e00640 1 -- 172.21.15.161:0/2334532958 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b70009a70 con 0x7f4b7806e970 2024-01-17T22:58:58.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.160+0000 7f4b77e00640 1 --2- 172.21.15.161:0/2334532958 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b7806e970 0x7f4b7815bea0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800e890 tx=0x7f4b6800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:58.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.164+0000 7f4b6fe00640 1 -- 172.21.15.161:0/2334532958 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68009620 con 0x7f4b7806e970 2024-01-17T22:58:58.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.164+0000 7f4b7f200640 1 -- 172.21.15.161:0/2334532958 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b780c3720 con 0x7f4b7806e970 2024-01-17T22:58:58.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.164+0000 7f4b7f200640 1 -- 172.21.15.161:0/2334532958 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7814b8c0 con 0x7f4b7806e970 2024-01-17T22:58:58.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.164+0000 7f4b6fe00640 1 -- 172.21.15.161:0/2334532958 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6800c940 con 0x7f4b7806e970 2024-01-17T22:58:58.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.164+0000 7f4b6fe00640 1 -- 172.21.15.161:0/2334532958 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6800ccb0 con 0x7f4b7806e970 2024-01-17T22:58:58.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.164+0000 7f4b7f200640 1 -- 172.21.15.161:0/2334532958 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7815ce40 con 0x7f4b7806e970 2024-01-17T22:58:58.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.184+0000 7f4b6fe00640 1 -- 172.21.15.161:0/2334532958 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f4b68013470 con 0x7f4b7806e970 2024-01-17T22:58:58.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.184+0000 7f4b6fe00640 1 --2- 172.21.15.161:0/2334532958 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4b50066840 0x7f4b50068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:58.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.184+0000 7f4b77400640 1 --2- 172.21.15.161:0/2334532958 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4b50066840 0x7f4b50068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:58.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.184+0000 7f4b77400640 1 --2- 172.21.15.161:0/2334532958 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4b50066840 0x7f4b50068d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4b7814ab10 tx=0x7f4b60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:58.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.416+0000 7f4b6fe00640 1 -- 172.21.15.161:0/2334532958 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b68055ad0 con 0x7f4b7806e970 2024-01-17T22:58:58.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.416+0000 7f4b6fe00640 1 -- 172.21.15.161:0/2334532958 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f4b68051e10 con 0x7f4b7806e970 2024-01-17T22:58:58.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.580+0000 7f4b7f200640 1 -- 172.21.15.161:0/2334532958 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b780c8770 con 0x7f4b7806e970 2024-01-17T22:58:58.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.628+0000 7f4b6fe00640 1 -- 172.21.15.161:0/2334532958 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18399 (secure 0 0 0) 0x7f4b68017090 con 0x7f4b7806e970 2024-01-17T22:58:58.628 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:58:58.629 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":26,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:58:56.639614+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T22:58:46.757110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T22:58:47.930512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T22:58:53.561624+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.614036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.746767+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.689096+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.706485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.628004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.680048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.571249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:58:58.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.632+0000 7f4b7f200640 1 -- 172.21.15.161:0/2334532958 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4b50066840 msgr2=0x7f4b50068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:58.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.632+0000 7f4b7f200640 1 --2- 172.21.15.161:0/2334532958 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4b50066840 0x7f4b50068d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4b7814ab10 tx=0x7f4b60009040 comp rx=0 tx=0).stop 2024-01-17T22:58:58.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.632+0000 7f4b7f200640 1 -- 172.21.15.161:0/2334532958 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b7806e970 msgr2=0x7f4b7815bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:58.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.632+0000 7f4b7f200640 1 --2- 172.21.15.161:0/2334532958 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b7806e970 0x7f4b7815bea0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800e890 tx=0x7f4b6800ed50 comp rx=0 tx=0).stop 2024-01-17T22:58:58.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.632+0000 7f4b7f200640 1 -- 172.21.15.161:0/2334532958 shutdown_connections 2024-01-17T22:58:58.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.632+0000 7f4b7f200640 1 --2- 172.21.15.161:0/2334532958 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4b50066840 0x7f4b50068d00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:58.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.632+0000 7f4b7f200640 1 --2- 172.21.15.161:0/2334532958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b780cc010 0x7f4b7814c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:58.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.632+0000 7f4b7f200640 1 --2- 172.21.15.161:0/2334532958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b78153970 0x7f4b781f24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:58.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.632+0000 7f4b7f200640 1 --2- 172.21.15.161:0/2334532958 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b7806e970 0x7f4b7815bea0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:58.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.632+0000 7f4b7f200640 1 -- 172.21.15.161:0/2334532958 >> 172.21.15.161:0/2334532958 conn(0x7f4b78072670 msgr2=0x7f4b780c24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:58.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.632+0000 7f4b7f200640 1 -- 172.21.15.161:0/2334532958 shutdown_connections 2024-01-17T22:58:58.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.632+0000 7f4b7f200640 1 -- 172.21.15.161:0/2334532958 wait complete. 2024-01-17T22:58:58.652 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T22:58:58.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.788+0000 7fe09b400640 1 Processor -- start 2024-01-17T22:58:58.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.788+0000 7fe09b400640 1 -- start start 2024-01-17T22:58:58.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.792+0000 7fe09b400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe094153570 0x7fe09406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:58.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.792+0000 7fe09b400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe094159f30 con 0x7fe094153950 2024-01-17T22:58:58.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.792+0000 7fe09b400640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe094159660 con 0x7fe09415a3c0 2024-01-17T22:58:58.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.792+0000 7fe09b400640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09406b520 con 0x7fe094153570 2024-01-17T22:58:58.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.792+0000 7fe099400640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fe094153950 0x7fe09406a6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36818/0 (socket says 172.21.15.161:36818) 2024-01-17T22:58:58.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.792+0000 7fe099400640 1 -- 172.21.15.161:0/3287190878 learned_addr learned my addr 172.21.15.161:0/3287190878 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:58:58.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.792+0000 7fe098a00640 1 --2- 172.21.15.161:0/3287190878 >> v2:172.21.15.190:3300/0 conn(0x7fe094153570 0x7fe09406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:58.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.796+0000 7fe093400640 1 -- 172.21.15.161:0/3287190878 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308042617 0 0) 0x7fe094159f30 con 0x7fe094153950 2024-01-17T22:58:58.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.796+0000 7fe093400640 1 -- 172.21.15.161:0/3287190878 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe074003530 con 0x7fe094153950 2024-01-17T22:58:58.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.796+0000 7fe093400640 1 -- 172.21.15.161:0/3287190878 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 410785896 0 0) 0x7fe074003530 con 0x7fe094153950 2024-01-17T22:58:58.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.796+0000 7fe093400640 1 -- 172.21.15.161:0/3287190878 >> v2:172.21.15.190:3300/0 conn(0x7fe094153570 msgr2=0x7fe09406dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:58.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.796+0000 7fe093400640 1 --2- 172.21.15.161:0/3287190878 >> v2:172.21.15.190:3300/0 conn(0x7fe094153570 0x7fe09406dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:58.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.796+0000 7fe093400640 1 -- 172.21.15.161:0/3287190878 >> v1:172.21.15.190:6789/0 conn(0x7fe09415a3c0 legacy=0x7fe0940c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:58.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.796+0000 7fe093400640 1 -- 172.21.15.161:0/3287190878 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09406e520 con 0x7fe094153950 2024-01-17T22:58:58.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.796+0000 7fe093400640 1 -- 172.21.15.161:0/3287190878 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7fe08c001a00 con 0x7fe094153950 2024-01-17T22:58:58.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.796+0000 7fe093400640 1 -- 172.21.15.161:0/3287190878 >> v1:172.21.15.161:6789/0 conn(0x7fe094153950 legacy=0x7fe09406a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:58.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.800+0000 7fe093400640 1 --2- 172.21.15.161:0/3287190878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0740039d0 0x7fe074003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:58.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.800+0000 7fe093400640 1 --2- 172.21.15.161:0/3287190878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0740047d0 0x7fe074004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:58.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.800+0000 7fe093400640 1 --2- 172.21.15.161:0/3287190878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe074005190 0x7fe07400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:58.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.800+0000 7fe093400640 1 -- 172.21.15.161:0/3287190878 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09406b520 con 0x7fe074005190 2024-01-17T22:58:58.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.800+0000 7fe093400640 1 -- 172.21.15.161:0/3287190878 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07400c090 con 0x7fe0740039d0 2024-01-17T22:58:58.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.800+0000 7fe093400640 1 -- 172.21.15.161:0/3287190878 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07400c250 con 0x7fe0740047d0 2024-01-17T22:58:58.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.800+0000 7fe093e00640 1 --2- 172.21.15.161:0/3287190878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0740047d0 0x7fe074004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:58.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.800+0000 7fe099400640 1 --2- 172.21.15.161:0/3287190878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe074005190 0x7fe07400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:58.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.804+0000 7fe099400640 1 -- 172.21.15.161:0/3287190878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0740047d0 msgr2=0x7fe074004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:58.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.804+0000 7fe099400640 1 --2- 172.21.15.161:0/3287190878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0740047d0 0x7fe074004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:58.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.804+0000 7fe099400640 1 -- 172.21.15.161:0/3287190878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0740039d0 msgr2=0x7fe074003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:58.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.804+0000 7fe099400640 1 --2- 172.21.15.161:0/3287190878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0740039d0 0x7fe074003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:58.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.804+0000 7fe099400640 1 -- 172.21.15.161:0/3287190878 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe074003530 con 0x7fe074005190 2024-01-17T22:58:58.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.808+0000 7fe099400640 1 -- 172.21.15.161:0/3287190878 reap_dead start 2024-01-17T22:58:58.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.808+0000 7fe099400640 1 --2- 172.21.15.161:0/3287190878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe074005190 0x7fe07400b990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00a750 tx=0x7fe08c01d260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d733723189e295 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:58.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.812+0000 7fe093400640 1 -- 172.21.15.161:0/3287190878 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0ac620 con 0x7fe074005190 2024-01-17T22:58:58.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.812+0000 7fe093400640 1 -- 172.21.15.161:0/3287190878 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c0a8070 con 0x7fe074005190 2024-01-17T22:58:58.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.812+0000 7fe093400640 1 -- 172.21.15.161:0/3287190878 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0ac9e0 con 0x7fe074005190 2024-01-17T22:58:58.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.812+0000 7fe09b400640 1 -- 172.21.15.161:0/3287190878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe074005190 msgr2=0x7fe07400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:58.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.812+0000 7fe09b400640 1 --2- 172.21.15.161:0/3287190878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe074005190 0x7fe07400b990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00a750 tx=0x7fe08c01d260 comp rx=0 tx=0).stop 2024-01-17T22:58:58.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.812+0000 7fe09b400640 1 -- 172.21.15.161:0/3287190878 shutdown_connections 2024-01-17T22:58:58.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.812+0000 7fe09b400640 1 --2- 172.21.15.161:0/3287190878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe074005190 0x7fe07400b990 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:58.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.812+0000 7fe09b400640 1 -- 172.21.15.161:0/3287190878 >> 172.21.15.161:0/3287190878 conn(0x7fe09406fd30 msgr2=0x7fe094070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:58.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.812+0000 7fe09b400640 1 -- 172.21.15.161:0/3287190878 shutdown_connections 2024-01-17T22:58:58.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.812+0000 7fe09b400640 1 -- 172.21.15.161:0/3287190878 wait complete. 2024-01-17T22:58:58.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.816+0000 7fe09b400640 1 Processor -- start 2024-01-17T22:58:58.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.816+0000 7fe09b400640 1 -- start start 2024-01-17T22:58:58.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.816+0000 7fe09b400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe074005190 0x7fe0941eed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:58.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.816+0000 7fe09b400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0941e19e0 0x7fe0941e3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:58.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.816+0000 7fe09b400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0940b0840 0x7fe0940c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:58.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.816+0000 7fe09b400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0940b15d0 con 0x7fe0940b0840 2024-01-17T22:58:58.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.816+0000 7fe09b400640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0940b0d30 con 0x7fe0941e19e0 2024-01-17T22:58:58.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.816+0000 7fe09b400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0940b1010 con 0x7fe074005190 2024-01-17T22:58:58.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.816+0000 7fe099400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0940b0840 0x7fe0940c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:58.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.816+0000 7fe099400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0940b0840 0x7fe0940c68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55868/0 (socket says 172.21.15.161:55868) 2024-01-17T22:58:58.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.816+0000 7fe099400640 1 -- 172.21.15.161:0/4148317665 learned_addr learned my addr 172.21.15.161:0/4148317665 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:58.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.816+0000 7fe098a00640 1 --2- 172.21.15.161:0/4148317665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe074005190 0x7fe0941eed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:58.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.816+0000 7fe093e00640 1 --2- 172.21.15.161:0/4148317665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0941e19e0 0x7fe0941e3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:58.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.820+0000 7fe099400640 1 -- 172.21.15.161:0/4148317665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe074005190 msgr2=0x7fe0941eed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:58.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.820+0000 7fe099400640 1 --2- 172.21.15.161:0/4148317665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe074005190 0x7fe0941eed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:58.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.820+0000 7fe099400640 1 -- 172.21.15.161:0/4148317665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0941e19e0 msgr2=0x7fe0941e3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:58.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.820+0000 7fe099400640 1 --2- 172.21.15.161:0/4148317665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0941e19e0 0x7fe0941e3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:58.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.820+0000 7fe099400640 1 -- 172.21.15.161:0/4148317665 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0940b12f0 con 0x7fe0940b0840 2024-01-17T22:58:58.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.824+0000 7fe099400640 1 --2- 172.21.15.161:0/4148317665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0940b0840 0x7fe0940c68f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe08c01db00 tx=0x7fe074005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:58.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.824+0000 7fe090c00640 1 -- 172.21.15.161:0/4148317665 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0b7620 con 0x7fe0940b0840 2024-01-17T22:58:58.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.824+0000 7fe09b400640 1 -- 172.21.15.161:0/4148317665 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0941e3350 con 0x7fe0940b0840 2024-01-17T22:58:58.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.824+0000 7fe09b400640 1 -- 172.21.15.161:0/4148317665 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0940ae7d0 con 0x7fe0940b0840 2024-01-17T22:58:58.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.824+0000 7fe090c00640 1 -- 172.21.15.161:0/4148317665 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c0b7780 con 0x7fe0940b0840 2024-01-17T22:58:58.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.824+0000 7fe090c00640 1 -- 172.21.15.161:0/4148317665 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0b7af0 con 0x7fe0940b0840 2024-01-17T22:58:58.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.828+0000 7fe09b400640 1 -- 172.21.15.161:0/4148317665 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0640052a0 con 0x7fe0940b0840 2024-01-17T22:58:58.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.848+0000 7fe090c00640 1 -- 172.21.15.161:0/4148317665 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fe08c0aa070 con 0x7fe0940b0840 2024-01-17T22:58:58.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.848+0000 7fe090c00640 1 --2- 172.21.15.161:0/4148317665 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe06c066870 0x7fe06c068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:58.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.848+0000 7fe098a00640 1 --2- 172.21.15.161:0/4148317665 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe06c066870 0x7fe06c068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:58.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.848+0000 7fe098a00640 1 --2- 172.21.15.161:0/4148317665 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe06c066870 0x7fe06c068d30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe0840093f0 tx=0x7fe084009320 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:58.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:58.848+0000 7fe090c00640 1 -- 172.21.15.161:0/4148317665 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe08c0b3070 con 0x7fe0940b0840 2024-01-17T22:58:59.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.080+0000 7fe090c00640 1 -- 172.21.15.161:0/4148317665 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fe08c0eb440 con 0x7fe0940b0840 2024-01-17T22:58:59.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.244+0000 7fe09b400640 1 -- 172.21.15.161:0/4148317665 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe064005820 con 0x7fe0940b0840 2024-01-17T22:58:59.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.292+0000 7fe090c00640 1 -- 172.21.15.161:0/4148317665 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18399 (secure 0 0 0) 0x7fe08c0eea60 con 0x7fe0940b0840 2024-01-17T22:58:59.289 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:58:59.289 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":26,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:58:56.639614+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T22:58:46.757110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T22:58:47.930512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T22:58:53.561624+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.614036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.746767+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.689096+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.706485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.628004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.680048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.571249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:58:59.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.292+0000 7fe09b400640 1 -- 172.21.15.161:0/4148317665 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe06c066870 msgr2=0x7fe06c068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:59.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.292+0000 7fe09b400640 1 --2- 172.21.15.161:0/4148317665 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe06c066870 0x7fe06c068d30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe0840093f0 tx=0x7fe084009320 comp rx=0 tx=0).stop 2024-01-17T22:58:59.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.292+0000 7fe09b400640 1 -- 172.21.15.161:0/4148317665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0940b0840 msgr2=0x7fe0940c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:59.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.292+0000 7fe09b400640 1 --2- 172.21.15.161:0/4148317665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0940b0840 0x7fe0940c68f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe08c01db00 tx=0x7fe074005800 comp rx=0 tx=0).stop 2024-01-17T22:58:59.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.292+0000 7fe09b400640 1 -- 172.21.15.161:0/4148317665 shutdown_connections 2024-01-17T22:58:59.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.292+0000 7fe09b400640 1 --2- 172.21.15.161:0/4148317665 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe06c066870 0x7fe06c068d30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:59.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.292+0000 7fe09b400640 1 --2- 172.21.15.161:0/4148317665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0941e19e0 0x7fe0941e3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:59.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.292+0000 7fe09b400640 1 --2- 172.21.15.161:0/4148317665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0940b0840 0x7fe0940c68f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:59.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.292+0000 7fe09b400640 1 --2- 172.21.15.161:0/4148317665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe074005190 0x7fe0941eed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:59.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.292+0000 7fe09b400640 1 -- 172.21.15.161:0/4148317665 >> 172.21.15.161:0/4148317665 conn(0x7fe09406fd30 msgr2=0x7fe0940c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:59.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.292+0000 7fe09b400640 1 -- 172.21.15.161:0/4148317665 shutdown_connections 2024-01-17T22:58:59.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.292+0000 7fe09b400640 1 -- 172.21.15.161:0/4148317665 wait complete. 2024-01-17T22:58:59.325 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T22:58:59.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.464+0000 7fdc73a00640 1 Processor -- start 2024-01-17T22:58:59.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.464+0000 7fdc73a00640 1 -- start start 2024-01-17T22:58:59.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.464+0000 7fdc73a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdc6c1517a0 0x7fdc6c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:59.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.464+0000 7fdc73a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc6c157bc0 0x7fdc6c158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:59.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.464+0000 7fdc73a00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6c15b9c0 con 0x7fdc6c06d210 2024-01-17T22:58:59.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.464+0000 7fdc73a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6c158570 con 0x7fdc6c1517a0 2024-01-17T22:58:59.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.464+0000 7fdc73a00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c15ae40 con 0x7fdc6c157bc0 2024-01-17T22:58:59.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.468+0000 7fdc71000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdc6c1517a0 0x7fdc6c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:59.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.468+0000 7fdc71000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdc6c1517a0 0x7fdc6c06ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55878/0 (socket says 172.21.15.161:55878) 2024-01-17T22:58:59.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.468+0000 7fdc71000640 1 -- 172.21.15.161:0/567412912 learned_addr learned my addr 172.21.15.161:0/567412912 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:59.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.468+0000 7fdc71a00640 1 --2- 172.21.15.161:0/567412912 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc6c157bc0 0x7fdc6c158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:59.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.468+0000 7fdc71000640 1 -- 172.21.15.161:0/567412912 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc6c157bc0 msgr2=0x7fdc6c158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:58:59.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.468+0000 7fdc71000640 1 --2- 172.21.15.161:0/567412912 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc6c157bc0 0x7fdc6c158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:59.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.468+0000 7fdc71000640 1 -- 172.21.15.161:0/567412912 >> v1:172.21.15.190:6789/0 conn(0x7fdc6c06d210 legacy=0x7fdc6c072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:59.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.468+0000 7fdc71000640 1 -- 172.21.15.161:0/567412912 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c15b120 con 0x7fdc6c1517a0 2024-01-17T22:58:59.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.472+0000 7fdc71000640 1 --2- 172.21.15.161:0/567412912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc6c1517a0 0x7fdc6c06ccd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c009870 tx=0x7fdc5c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc4ce1c3c5d8e78 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:59.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.476+0000 7fdc6b400640 1 -- 172.21.15.161:0/567412912 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c0aa670 con 0x7fdc6c1517a0 2024-01-17T22:58:59.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.476+0000 7fdc6b400640 1 -- 172.21.15.161:0/567412912 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c0aa7d0 con 0x7fdc6c1517a0 2024-01-17T22:58:59.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.476+0000 7fdc6b400640 1 -- 172.21.15.161:0/567412912 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c0aab60 con 0x7fdc6c1517a0 2024-01-17T22:58:59.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.476+0000 7fdc73a00640 1 -- 172.21.15.161:0/567412912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc6c1517a0 msgr2=0x7fdc6c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:59.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.476+0000 7fdc73a00640 1 --2- 172.21.15.161:0/567412912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc6c1517a0 0x7fdc6c06ccd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c009870 tx=0x7fdc5c01c510 comp rx=0 tx=0).stop 2024-01-17T22:58:59.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.480+0000 7fdc73a00640 1 -- 172.21.15.161:0/567412912 shutdown_connections 2024-01-17T22:58:59.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.480+0000 7fdc73a00640 1 --2- 172.21.15.161:0/567412912 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc6c157bc0 0x7fdc6c158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:59.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.480+0000 7fdc73a00640 1 --2- 172.21.15.161:0/567412912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc6c1517a0 0x7fdc6c06ccd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:59.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.480+0000 7fdc73a00640 1 -- 172.21.15.161:0/567412912 >> 172.21.15.161:0/567412912 conn(0x7fdc6c0cb070 msgr2=0x7fdc6c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:59.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.480+0000 7fdc73a00640 1 -- 172.21.15.161:0/567412912 shutdown_connections 2024-01-17T22:58:59.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.480+0000 7fdc73a00640 1 -- 172.21.15.161:0/567412912 wait complete. 2024-01-17T22:58:59.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.480+0000 7fdc73a00640 1 Processor -- start 2024-01-17T22:58:59.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.480+0000 7fdc73a00640 1 -- start start 2024-01-17T22:58:59.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.480+0000 7fdc73a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc6c06d210 0x7fdc6c1f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:59.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.480+0000 7fdc73a00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc6c1517a0 0x7fdc6c1f2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:59.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.480+0000 7fdc73a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc6c157bc0 0x7fdc6c0c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:59.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.480+0000 7fdc73a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c0c05a0 con 0x7fdc6c06d210 2024-01-17T22:58:59.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.480+0000 7fdc73a00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c0c1e40 con 0x7fdc6c1517a0 2024-01-17T22:58:59.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.480+0000 7fdc73a00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c1f2c60 con 0x7fdc6c157bc0 2024-01-17T22:58:59.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.480+0000 7fdc71000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc6c06d210 0x7fdc6c1f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:59.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.484+0000 7fdc71000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc6c06d210 0x7fdc6c1f5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55894/0 (socket says 172.21.15.161:55894) 2024-01-17T22:58:59.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.484+0000 7fdc71000640 1 -- 172.21.15.161:0/3731885651 learned_addr learned my addr 172.21.15.161:0/3731885651 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:58:59.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.484+0000 7fdc6be00640 1 --2- 172.21.15.161:0/3731885651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc6c1517a0 0x7fdc6c1f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:59.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.484+0000 7fdc71a00640 1 --2- 172.21.15.161:0/3731885651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc6c157bc0 0x7fdc6c0c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:59.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.484+0000 7fdc71000640 1 -- 172.21.15.161:0/3731885651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc6c157bc0 msgr2=0x7fdc6c0c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:59.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.484+0000 7fdc71000640 1 --2- 172.21.15.161:0/3731885651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc6c157bc0 0x7fdc6c0c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:59.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.484+0000 7fdc71000640 1 -- 172.21.15.161:0/3731885651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc6c1517a0 msgr2=0x7fdc6c1f2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:59.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.484+0000 7fdc71000640 1 --2- 172.21.15.161:0/3731885651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc6c1517a0 0x7fdc6c1f2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:59.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.484+0000 7fdc71000640 1 -- 172.21.15.161:0/3731885651 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c0094d0 con 0x7fdc6c06d210 2024-01-17T22:58:59.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.488+0000 7fdc71000640 1 --2- 172.21.15.161:0/3731885651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc6c06d210 0x7fdc6c1f5210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0ac040 tx=0x7fdc5c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:59.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.492+0000 7fdc68c00640 1 -- 172.21.15.161:0/3731885651 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c0b3800 con 0x7fdc6c06d210 2024-01-17T22:58:59.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.492+0000 7fdc68c00640 1 -- 172.21.15.161:0/3731885651 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c0b3980 con 0x7fdc6c06d210 2024-01-17T22:58:59.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.492+0000 7fdc68c00640 1 -- 172.21.15.161:0/3731885651 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c0b3d30 con 0x7fdc6c06d210 2024-01-17T22:58:59.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.492+0000 7fdc73a00640 1 -- 172.21.15.161:0/3731885651 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6c1f6160 con 0x7fdc6c06d210 2024-01-17T22:58:59.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.492+0000 7fdc73a00640 1 -- 172.21.15.161:0/3731885651 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6c1f5ba0 con 0x7fdc6c06d210 2024-01-17T22:58:59.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.492+0000 7fdc73a00640 1 -- 172.21.15.161:0/3731885651 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6c0746a0 con 0x7fdc6c06d210 2024-01-17T22:58:59.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.512+0000 7fdc68c00640 1 -- 172.21.15.161:0/3731885651 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fdc5c0c7410 con 0x7fdc6c06d210 2024-01-17T22:58:59.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.516+0000 7fdc68c00640 1 --2- 172.21.15.161:0/3731885651 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fdc44066890 0x7fdc44068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:58:59.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.516+0000 7fdc6be00640 1 --2- 172.21.15.161:0/3731885651 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fdc44066890 0x7fdc44068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:58:59.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.516+0000 7fdc6be00640 1 --2- 172.21.15.161:0/3731885651 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fdc44066890 0x7fdc44068d50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c1573c0 tx=0x7fdc54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:58:59.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.744+0000 7fdc68c00640 1 -- 172.21.15.161:0/3731885651 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdc5c0efed0 con 0x7fdc6c06d210 2024-01-17T22:58:59.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.744+0000 7fdc68c00640 1 -- 172.21.15.161:0/3731885651 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fdc5c0ec210 con 0x7fdc6c06d210 2024-01-17T22:58:59.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.932+0000 7fdc73a00640 1 -- 172.21.15.161:0/3731885651 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc6c06cab0 con 0x7fdc6c06d210 2024-01-17T22:58:59.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.944+0000 7fdc68c00640 1 -- 172.21.15.161:0/3731885651 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6526 (secure 0 0 0) 0x7fdc5c0ef830 con 0x7fdc6c06d210 2024-01-17T22:58:59.944 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:58:59.944 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6839/2820898287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":2820898287},{"type":"v1","addr":"172.21.15.161:6839","nonce":2820898287}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/2332272186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2332272186},{"type":"v1","addr":"172.21.15.190:6833","nonce":2332272186}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3170137737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3170137737},{"type":"v1","addr":"172.21.15.190:6835","nonce":3170137737}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1671527613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1671527613},{"type":"v1","addr":"172.21.15.161:6835","nonce":1671527613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/409686078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":409686078},{"type":"v1","addr":"172.21.15.161:6837","nonce":409686078}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-17T22:58:49.015246+0000","modified":"2024-01-17T22:58:56.644431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":7,"addr":"172.21.15.190:6837/561131647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":561131647},{"type":"v1","addr":"172.21.15.190:6837","nonce":561131647}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-17T22:58:59.945 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 7 2024-01-17T22:58:59.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.948+0000 7fdc73a00640 1 -- 172.21.15.161:0/3731885651 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fdc44066890 msgr2=0x7fdc44068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:59.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.948+0000 7fdc73a00640 1 --2- 172.21.15.161:0/3731885651 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fdc44066890 0x7fdc44068d50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c1573c0 tx=0x7fdc54009040 comp rx=0 tx=0).stop 2024-01-17T22:58:59.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.948+0000 7fdc73a00640 1 -- 172.21.15.161:0/3731885651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc6c06d210 msgr2=0x7fdc6c1f5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:58:59.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.948+0000 7fdc73a00640 1 --2- 172.21.15.161:0/3731885651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc6c06d210 0x7fdc6c1f5210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0ac040 tx=0x7fdc5c01ad50 comp rx=0 tx=0).stop 2024-01-17T22:58:59.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.948+0000 7fdc73a00640 1 -- 172.21.15.161:0/3731885651 shutdown_connections 2024-01-17T22:58:59.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.948+0000 7fdc73a00640 1 --2- 172.21.15.161:0/3731885651 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fdc44066890 0x7fdc44068d50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:59.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.948+0000 7fdc73a00640 1 --2- 172.21.15.161:0/3731885651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc6c1517a0 0x7fdc6c1f2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:59.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.948+0000 7fdc73a00640 1 --2- 172.21.15.161:0/3731885651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc6c157bc0 0x7fdc6c0c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:59.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.948+0000 7fdc73a00640 1 --2- 172.21.15.161:0/3731885651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc6c06d210 0x7fdc6c1f5210 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:58:59.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.948+0000 7fdc73a00640 1 -- 172.21.15.161:0/3731885651 >> 172.21.15.161:0/3731885651 conn(0x7fdc6c0cb070 msgr2=0x7fdc6c0c8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:58:59.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.948+0000 7fdc73a00640 1 -- 172.21.15.161:0/3731885651 shutdown_connections 2024-01-17T22:58:59.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:58:59.948+0000 7fdc73a00640 1 -- 172.21.15.161:0/3731885651 wait complete. 2024-01-17T22:58:59.967 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T22:59:00.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.172+0000 7f2213c00640 1 Processor -- start 2024-01-17T22:59:00.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.172+0000 7f2213c00640 1 -- start start 2024-01-17T22:59:00.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.176+0000 7f2213c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f220c1539a0 0x7f220c0ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:00.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.176+0000 7f2213c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220c0c9890 con 0x7f220c15d3f0 2024-01-17T22:59:00.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.176+0000 7f2213c00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220c159bf0 con 0x7f220c0c79c0 2024-01-17T22:59:00.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.176+0000 7f2213c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220c06d570 con 0x7f220c1539a0 2024-01-17T22:59:00.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.192+0000 7f220be00640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f220c0c79c0 0x7f220c061100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.161:42978/0 (socket says 172.21.15.161:42978) 2024-01-17T22:59:00.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.192+0000 7f220be00640 1 -- 172.21.15.161:0/764422400 learned_addr learned my addr 172.21.15.161:0/764422400 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:00.204 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T22:59:00.207 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T22:59:00.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.216+0000 7f2211200640 1 --2- 172.21.15.161:0/764422400 >> v2:172.21.15.161:3300/0 conn(0x7f220c1539a0 0x7f220c0ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:00.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.220+0000 7f2211200640 1 -- 172.21.15.161:0/764422400 >> v1:172.21.15.190:6789/0 conn(0x7f220c0c79c0 legacy=0x7f220c061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:00.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.220+0000 7f2211200640 1 -- 172.21.15.161:0/764422400 >> v1:172.21.15.161:6789/0 conn(0x7f220c15d3f0 legacy=0x7f220c15d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:00.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.220+0000 7f2211200640 1 -- 172.21.15.161:0/764422400 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c159eb0 con 0x7f220c1539a0 2024-01-17T22:59:00.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.228+0000 7f2211200640 1 --2- 172.21.15.161:0/764422400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220c1539a0 0x7f220c0ca410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0097c0 tx=0x7f21fc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ab585b3fc11f5c server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:00.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.232+0000 7f220b400640 1 -- 172.21.15.161:0/764422400 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc0ab610 con 0x7f220c1539a0 2024-01-17T22:59:00.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.232+0000 7f220b400640 1 -- 172.21.15.161:0/764422400 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc0ab770 con 0x7f220c1539a0 2024-01-17T22:59:00.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.232+0000 7f220b400640 1 -- 172.21.15.161:0/764422400 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc0abb00 con 0x7f220c1539a0 2024-01-17T22:59:00.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.232+0000 7f2213c00640 1 -- 172.21.15.161:0/764422400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220c1539a0 msgr2=0x7f220c0ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:00.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.232+0000 7f2213c00640 1 --2- 172.21.15.161:0/764422400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220c1539a0 0x7f220c0ca410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0097c0 tx=0x7f21fc01c410 comp rx=0 tx=0).stop 2024-01-17T22:59:00.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.232+0000 7f2213c00640 1 -- 172.21.15.161:0/764422400 shutdown_connections 2024-01-17T22:59:00.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.232+0000 7f2213c00640 1 --2- 172.21.15.161:0/764422400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220c1539a0 0x7f220c0ca410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:00.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.232+0000 7f2213c00640 1 -- 172.21.15.161:0/764422400 >> 172.21.15.161:0/764422400 conn(0x7f220c06ad40 msgr2=0x7f220c06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:00.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.232+0000 7f2213c00640 1 -- 172.21.15.161:0/764422400 shutdown_connections 2024-01-17T22:59:00.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.232+0000 7f2213c00640 1 -- 172.21.15.161:0/764422400 wait complete. 2024-01-17T22:59:00.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.236+0000 7f2213c00640 1 Processor -- start 2024-01-17T22:59:00.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.236+0000 7f2213c00640 1 -- start start 2024-01-17T22:59:00.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.236+0000 7f2213c00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f220c0c79c0 0x7f220c071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:00.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.236+0000 7f2213c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220c1539a0 0x7f220c0cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:00.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.236+0000 7f2213c00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f220c15d3f0 0x7f220c0cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:00.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.236+0000 7f2213c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c14ccb0 con 0x7f220c1539a0 2024-01-17T22:59:00.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.236+0000 7f2213c00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c0cb870 con 0x7f220c15d3f0 2024-01-17T22:59:00.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.236+0000 7f2213c00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c14e520 con 0x7f220c0c79c0 2024-01-17T22:59:00.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.236+0000 7f220be00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220c1539a0 0x7f220c0cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:00.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.236+0000 7f220be00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220c1539a0 0x7f220c0cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55908/0 (socket says 172.21.15.161:55908) 2024-01-17T22:59:00.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.236+0000 7f220be00640 1 -- 172.21.15.161:0/585128362 learned_addr learned my addr 172.21.15.161:0/585128362 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:00.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.240+0000 7f220be00640 1 -- 172.21.15.161:0/585128362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f220c0c79c0 msgr2=0x7f220c071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:00.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.240+0000 7f220be00640 1 --2- 172.21.15.161:0/585128362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f220c0c79c0 0x7f220c071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:00.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.240+0000 7f220be00640 1 -- 172.21.15.161:0/585128362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f220c15d3f0 msgr2=0x7f220c0cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:00.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.240+0000 7f220be00640 1 --2- 172.21.15.161:0/585128362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f220c15d3f0 0x7f220c0cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:00.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.240+0000 7f220be00640 1 -- 172.21.15.161:0/585128362 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc009420 con 0x7f220c1539a0 2024-01-17T22:59:00.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.240+0000 7f220be00640 1 --2- 172.21.15.161:0/585128362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220c1539a0 0x7f220c0cbd00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f21f400c3a0 tx=0x7f21f400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:00.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.244+0000 7f2208c00640 1 -- 172.21.15.161:0/585128362 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f4005cf0 con 0x7f220c1539a0 2024-01-17T22:59:00.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.244+0000 7f2208c00640 1 -- 172.21.15.161:0/585128362 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f4005e50 con 0x7f220c1539a0 2024-01-17T22:59:00.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.244+0000 7f2208c00640 1 -- 172.21.15.161:0/585128362 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f40072f0 con 0x7f220c1539a0 2024-01-17T22:59:00.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.244+0000 7f2213c00640 1 -- 172.21.15.161:0/585128362 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220c14e260 con 0x7f220c1539a0 2024-01-17T22:59:00.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.244+0000 7f2213c00640 1 -- 172.21.15.161:0/585128362 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220c0cb220 con 0x7f220c1539a0 2024-01-17T22:59:00.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.248+0000 7f2213c00640 1 -- 172.21.15.161:0/585128362 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220c06b620 con 0x7f220c1539a0 2024-01-17T22:59:00.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.268+0000 7f2208c00640 1 -- 172.21.15.161:0/585128362 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f21f4007450 con 0x7f220c1539a0 2024-01-17T22:59:00.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.268+0000 7f2208c00640 1 --2- 172.21.15.161:0/585128362 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f21e4066890 0x7f21e4068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:00.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.268+0000 7f2211200640 1 --2- 172.21.15.161:0/585128362 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f21e4066890 0x7f21e4068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:00.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.268+0000 7f2211200640 1 --2- 172.21.15.161:0/585128362 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f21e4066890 0x7f21e4068d50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0af000 tx=0x7f21fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:00.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.508+0000 7f2208c00640 1 -- 172.21.15.161:0/585128362 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f21f4055160 con 0x7f220c1539a0 2024-01-17T22:59:00.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.508+0000 7f2208c00640 1 -- 172.21.15.161:0/585128362 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f21f4050da0 con 0x7f220c1539a0 2024-01-17T22:59:00.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.668+0000 7f2213c00640 1 -- 172.21.15.161:0/585128362 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f220c0746a0 con 0x7f220c1539a0 2024-01-17T22:59:00.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.752+0000 7f2208c00640 1 -- 172.21.15.161:0/585128362 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18399 (secure 0 0 0) 0x7f21f4017020 con 0x7f220c1539a0 2024-01-17T22:59:00.750 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:00.751 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":26,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:58:56.639614+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T22:58:46.757110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T22:58:47.930512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T22:58:53.561624+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.614036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.746767+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.689096+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.706485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.628004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.680048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.571249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:59:00.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.756+0000 7f2213c00640 1 -- 172.21.15.161:0/585128362 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f21e4066890 msgr2=0x7f21e4068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:00.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.756+0000 7f2213c00640 1 --2- 172.21.15.161:0/585128362 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f21e4066890 0x7f21e4068d50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0af000 tx=0x7f21fc008040 comp rx=0 tx=0).stop 2024-01-17T22:59:00.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.756+0000 7f2213c00640 1 -- 172.21.15.161:0/585128362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220c1539a0 msgr2=0x7f220c0cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:00.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.756+0000 7f2213c00640 1 --2- 172.21.15.161:0/585128362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220c1539a0 0x7f220c0cbd00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f21f400c3a0 tx=0x7f21f400c860 comp rx=0 tx=0).stop 2024-01-17T22:59:00.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.756+0000 7f2213c00640 1 -- 172.21.15.161:0/585128362 shutdown_connections 2024-01-17T22:59:00.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.756+0000 7f2213c00640 1 --2- 172.21.15.161:0/585128362 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f21e4066890 0x7f21e4068d50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:00.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.756+0000 7f2213c00640 1 --2- 172.21.15.161:0/585128362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f220c15d3f0 0x7f220c0cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:00.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.756+0000 7f2213c00640 1 --2- 172.21.15.161:0/585128362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220c1539a0 0x7f220c0cbd00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:00.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.756+0000 7f2213c00640 1 --2- 172.21.15.161:0/585128362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f220c0c79c0 0x7f220c071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:00.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.756+0000 7f2213c00640 1 -- 172.21.15.161:0/585128362 >> 172.21.15.161:0/585128362 conn(0x7f220c06ad40 msgr2=0x7f220c15d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:00.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.756+0000 7f2213c00640 1 -- 172.21.15.161:0/585128362 shutdown_connections 2024-01-17T22:59:00.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:00.756+0000 7f2213c00640 1 -- 172.21.15.161:0/585128362 wait complete. 2024-01-17T22:59:01.375 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-17T22:58:49.015246+0000', 'modified': '2024-01-17T22:58:56.644431+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4269': {'gid': 4269, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.190:6837/561131647', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6836', 'nonce': 561131647}, {'type': 'v1', 'addr': '172.21.15.190:6837', 'nonce': 561131647}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-01-17T22:59:01.375 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-17T22:59:01.375 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-01-17T22:59:01.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.512+0000 7f9917200640 1 Processor -- start 2024-01-17T22:59:01.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.512+0000 7f9917200640 1 -- start start 2024-01-17T22:59:01.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.516+0000 7f9917200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9910153730 0x7f99100ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.516+0000 7f9917200640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f99100cda40 0x7f9910070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.516+0000 7f9917200640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99101598e0 con 0x7f9910071360 2024-01-17T22:59:01.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.516+0000 7f9917200640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99101596f0 con 0x7f99100cda40 2024-01-17T22:59:01.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.516+0000 7f9917200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99100cde80 con 0x7f9910153730 2024-01-17T22:59:01.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.516+0000 7f990fe00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9910153730 0x7f99100ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:01.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.516+0000 7f990f400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f99100cda40 0x7f9910070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:01.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.516+0000 7f990fe00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9910153730 0x7f99100ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:38404/0 (socket says 172.21.15.161:38404) 2024-01-17T22:59:01.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.516+0000 7f990fe00640 1 -- 172.21.15.161:0/633422502 learned_addr learned my addr 172.21.15.161:0/633422502 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:01.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.528+0000 7f990fe00640 1 -- 172.21.15.161:0/633422502 >> v2:172.21.15.190:3300/0 conn(0x7f99100cda40 msgr2=0x7f9910070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:01.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.528+0000 7f990fe00640 1 --2- 172.21.15.161:0/633422502 >> v2:172.21.15.190:3300/0 conn(0x7f99100cda40 0x7f9910070e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.528+0000 7f990fe00640 1 -- 172.21.15.161:0/633422502 >> v1:172.21.15.190:6789/0 conn(0x7f9910071360 legacy=0x7f991015d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:01.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.528+0000 7f990fe00640 1 -- 172.21.15.161:0/633422502 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9910159b80 con 0x7f9910153730 2024-01-17T22:59:01.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.536+0000 7f990fe00640 1 --2- 172.21.15.161:0/633422502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9910153730 0x7f99100ca330 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9900009870 tx=0x7f990001ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d08e2e430ae4c0d server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:01.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.544+0000 7f990ea00640 1 -- 172.21.15.161:0/633422502 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99000a8a30 con 0x7f9910153730 2024-01-17T22:59:01.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.544+0000 7f990ea00640 1 -- 172.21.15.161:0/633422502 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99000a8b90 con 0x7f9910153730 2024-01-17T22:59:01.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.544+0000 7f990ea00640 1 -- 172.21.15.161:0/633422502 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99000b0440 con 0x7f9910153730 2024-01-17T22:59:01.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.544+0000 7f9917200640 1 -- 172.21.15.161:0/633422502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9910153730 msgr2=0x7f99100ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:01.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.544+0000 7f9917200640 1 --2- 172.21.15.161:0/633422502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9910153730 0x7f99100ca330 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9900009870 tx=0x7f990001ed30 comp rx=0 tx=0).stop 2024-01-17T22:59:01.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.544+0000 7f9917200640 1 -- 172.21.15.161:0/633422502 shutdown_connections 2024-01-17T22:59:01.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.544+0000 7f9917200640 1 --2- 172.21.15.161:0/633422502 >> v2:172.21.15.190:3300/0 conn(0x7f99100cda40 0x7f9910070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.544+0000 7f9917200640 1 --2- 172.21.15.161:0/633422502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9910153730 0x7f99100ca330 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.544+0000 7f9917200640 1 -- 172.21.15.161:0/633422502 >> 172.21.15.161:0/633422502 conn(0x7f9910070460 msgr2=0x7f991006f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:01.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.544+0000 7f9917200640 1 -- 172.21.15.161:0/633422502 shutdown_connections 2024-01-17T22:59:01.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.544+0000 7f9917200640 1 -- 172.21.15.161:0/633422502 wait complete. 2024-01-17T22:59:01.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.548+0000 7f9917200640 1 Processor -- start 2024-01-17T22:59:01.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.548+0000 7f9917200640 1 -- start start 2024-01-17T22:59:01.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.548+0000 7f9917200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9910071360 0x7f991014d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.548+0000 7f9917200640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99100cda40 0x7f99101562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.548+0000 7f9917200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9910153730 0x7f991015bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.548+0000 7f9917200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99101505c0 con 0x7f9910153730 2024-01-17T22:59:01.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.548+0000 7f9917200640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9910155290 con 0x7f99100cda40 2024-01-17T22:59:01.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.548+0000 7f9917200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9910155e10 con 0x7f9910071360 2024-01-17T22:59:01.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.548+0000 7f9915200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9910153730 0x7f991015bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:01.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.548+0000 7f9915200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9910153730 0x7f991015bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55924/0 (socket says 172.21.15.161:55924) 2024-01-17T22:59:01.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.548+0000 7f9915200640 1 -- 172.21.15.161:0/425380938 learned_addr learned my addr 172.21.15.161:0/425380938 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:01.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.548+0000 7f990fe00640 1 --2- 172.21.15.161:0/425380938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9910071360 0x7f991014d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:01.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.548+0000 7f990f400640 1 --2- 172.21.15.161:0/425380938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99100cda40 0x7f99101562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:01.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.552+0000 7f9915200640 1 -- 172.21.15.161:0/425380938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9910071360 msgr2=0x7f991014d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:01.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.552+0000 7f9915200640 1 --2- 172.21.15.161:0/425380938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9910071360 0x7f991014d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.552+0000 7f9915200640 1 -- 172.21.15.161:0/425380938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99100cda40 msgr2=0x7f99101562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:01.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.552+0000 7f9915200640 1 --2- 172.21.15.161:0/425380938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99100cda40 0x7f99101562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.552+0000 7f9915200640 1 -- 172.21.15.161:0/425380938 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99000094d0 con 0x7f9910153730 2024-01-17T22:59:01.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.556+0000 7f9915200640 1 --2- 172.21.15.161:0/425380938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9910153730 0x7f991015bd70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f990800c760 tx=0x7f990800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:01.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.556+0000 7f9907e00640 1 -- 172.21.15.161:0/425380938 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9908003b80 con 0x7f9910153730 2024-01-17T22:59:01.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.560+0000 7f9907e00640 1 -- 172.21.15.161:0/425380938 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9908003ce0 con 0x7f9910153730 2024-01-17T22:59:01.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.560+0000 7f9907e00640 1 -- 172.21.15.161:0/425380938 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990800aa30 con 0x7f9910153730 2024-01-17T22:59:01.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.560+0000 7f9917200640 1 -- 172.21.15.161:0/425380938 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99101f2f50 con 0x7f9910153730 2024-01-17T22:59:01.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.560+0000 7f9917200640 1 -- 172.21.15.161:0/425380938 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99101557c0 con 0x7f9910153730 2024-01-17T22:59:01.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.560+0000 7f991a6fa000 1 Processor -- start 2024-01-17T22:59:01.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.560+0000 7f991a6fa000 1 -- start start 2024-01-17T22:59:01.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.564+0000 7f991a6fa000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565179fcf730 0x565179fcfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.564+0000 7f991a6fa000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00a7d0 0x56517a00abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.564+0000 7f991a6fa000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56517a00b0f0 0x56517a015a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.564+0000 7f991a6fa000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x565179e25d70 con 0x56517a00a7d0 2024-01-17T22:59:01.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.564+0000 7f991a6fa000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x565179e21ba0 con 0x565179fcf730 2024-01-17T22:59:01.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.564+0000 7f991a6fa000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x565179e1f0d0 con 0x56517a00b0f0 2024-01-17T22:59:01.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.568+0000 7f990f400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565179fcf730 0x565179fcfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:01.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.568+0000 7f990f400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56517a00b0f0 0x56517a015a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:01.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.568+0000 7f990f400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565179fcf730 0x565179fcfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:42426/0 (socket says 172.21.15.161:42426) 2024-01-17T22:59:01.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.568+0000 7f990f400640 1 -- 172.21.15.161:0/3766078411 learned_addr learned my addr 172.21.15.161:0/3766078411 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:01.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.576+0000 7f990f400640 1 -- 172.21.15.161:0/3766078411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56517a00b0f0 msgr2=0x56517a015a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:01.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.576+0000 7f990f400640 1 --2- 172.21.15.161:0/3766078411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56517a00b0f0 0x56517a015a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.576+0000 7f990f400640 1 -- 172.21.15.161:0/3766078411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00a7d0 msgr2=0x56517a00abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:01.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.576+0000 7f990f400640 1 --2- 172.21.15.161:0/3766078411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00a7d0 0x56517a00abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.576+0000 7f990f400640 1 -- 172.21.15.161:0/3766078411 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565179b11890 con 0x565179fcf730 2024-01-17T22:59:01.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.580+0000 7f9907e00640 1 -- 172.21.15.161:0/425380938 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f990800ab90 con 0x7f9910153730 2024-01-17T22:59:01.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.580+0000 7f9907e00640 1 --2- 172.21.15.161:0/425380938 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f98e8066890 0x7f98e8068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.580+0000 7f990fe00640 1 --2- 172.21.15.161:0/425380938 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f98e8066890 0x7f98e8068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:01.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.580+0000 7f990f400640 1 --2- 172.21.15.161:0/3766078411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565179fcf730 0x565179fcfb10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f98f8018930 tx=0x7f98f8009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ab1be288bb20b04 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:01.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.584+0000 7f990fe00640 1 --2- 172.21.15.161:0/425380938 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f98e8066890 0x7f98e8068d50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f99000b2000 tx=0x7f9900004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:01.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.584+0000 7f9907e00640 1 -- 172.21.15.161:0/425380938 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f990800ae40 con 0x7f9910153730 2024-01-17T22:59:01.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.592+0000 7f9904c00640 1 -- 172.21.15.161:0/3766078411 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f8004250 con 0x565179fcf730 2024-01-17T22:59:01.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.592+0000 7f9904c00640 1 -- 172.21.15.161:0/3766078411 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f80043b0 con 0x565179fcf730 2024-01-17T22:59:01.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.592+0000 7f9904c00640 1 -- 172.21.15.161:0/3766078411 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f8013980 con 0x565179fcf730 2024-01-17T22:59:01.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.592+0000 7f991a6fa000 1 -- 172.21.15.161:0/3766078411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565179fcf730 msgr2=0x565179fcfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:01.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.592+0000 7f991a6fa000 1 --2- 172.21.15.161:0/3766078411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565179fcf730 0x565179fcfb10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f98f8018930 tx=0x7f98f8009650 comp rx=0 tx=0).stop 2024-01-17T22:59:01.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.592+0000 7f991a6fa000 1 -- 172.21.15.161:0/3766078411 shutdown_connections 2024-01-17T22:59:01.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.592+0000 7f991a6fa000 1 --2- 172.21.15.161:0/3766078411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56517a00b0f0 0x56517a015a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.592+0000 7f991a6fa000 1 --2- 172.21.15.161:0/3766078411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00a7d0 0x56517a00abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.592+0000 7f991a6fa000 1 --2- 172.21.15.161:0/3766078411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565179fcf730 0x565179fcfb10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.592+0000 7f991a6fa000 1 -- 172.21.15.161:0/3766078411 >> 172.21.15.161:0/3766078411 conn(0x56517a006580 msgr2=0x56517a008970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:01.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.592+0000 7f991a6fa000 1 -- 172.21.15.161:0/3766078411 shutdown_connections 2024-01-17T22:59:01.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.592+0000 7f991a6fa000 1 -- 172.21.15.161:0/3766078411 wait complete. 2024-01-17T22:59:01.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.596+0000 7f991a6fa000 1 -- start start 2024-01-17T22:59:01.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.596+0000 7f991a6fa000 1 Processor -- start 2024-01-17T22:59:01.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.596+0000 7f991a6fa000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565179fcf730 0x56517a004d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.596+0000 7f991a6fa000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56517a00a7d0 0x56517a005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.596+0000 7f991a6fa000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00b0f0 0x56517a011950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.596+0000 7f991a6fa000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x565179e1a9c0 con 0x56517a00b0f0 2024-01-17T22:59:01.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.596+0000 7f991a6fa000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x565179dd2040 con 0x56517a00a7d0 2024-01-17T22:59:01.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.596+0000 7f991a6fa000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x565179dd7ee0 con 0x565179fcf730 2024-01-17T22:59:01.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.596+0000 7f991a6fa000 10 client.0 _ll_register_callbacks cb 0x565179dd51b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-17T22:59:01.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.596+0000 7f9915200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00b0f0 0x56517a011950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:01.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.596+0000 7f9915200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00b0f0 0x56517a011950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55938/0 (socket says 172.21.15.161:55938) 2024-01-17T22:59:01.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.596+0000 7f9915200640 1 -- 172.21.15.161:0/237449830 learned_addr learned my addr 172.21.15.161:0/237449830 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:01.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.596+0000 7f990f400640 1 --2- 172.21.15.161:0/237449830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56517a00a7d0 0x56517a005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:01.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.596+0000 7f990fe00640 1 --2- 172.21.15.161:0/237449830 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565179fcf730 0x56517a004d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:01.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.600+0000 7f9915200640 1 -- 172.21.15.161:0/237449830 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565179fcf730 msgr2=0x56517a004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:01.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.600+0000 7f9915200640 1 --2- 172.21.15.161:0/237449830 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565179fcf730 0x56517a004d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.600+0000 7f9915200640 1 -- 172.21.15.161:0/237449830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56517a00a7d0 msgr2=0x56517a005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:01.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.600+0000 7f9915200640 1 --2- 172.21.15.161:0/237449830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56517a00a7d0 0x56517a005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.600+0000 7f9915200640 1 -- 172.21.15.161:0/237449830 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f80185e0 con 0x56517a00b0f0 2024-01-17T22:59:01.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.604+0000 7f9915200640 1 --2- 172.21.15.161:0/237449830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00b0f0 0x56517a011950 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9908051220 tx=0x7f9908058f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6bd4fbc928a40ce server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:01.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.604+0000 7f98fd600640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2024-01-17T22:59:01.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.604+0000 7f98fd600640 1 -- 172.21.15.161:0/237449830 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990805ccf0 con 0x56517a00b0f0 2024-01-17T22:59:01.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.604+0000 7f98fd600640 1 -- 172.21.15.161:0/237449830 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9908059b00 con 0x56517a00b0f0 2024-01-17T22:59:01.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.604+0000 7f991a6fa000 1 -- 172.21.15.161:0/237449830 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565179da0e30 con 0x56517a00b0f0 2024-01-17T22:59:01.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.608+0000 7f98fd600640 1 -- 172.21.15.161:0/237449830 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9908059cc0 con 0x56517a00b0f0 2024-01-17T22:59:01.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.608+0000 7f991a6fa000 10 client.4395 fetch_fsmap learned FSMap version 7 2024-01-17T22:59:01.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.608+0000 7f991a6fa000 1 -- 172.21.15.161:0/237449830 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x565179dda5e0 con 0x56517a00b0f0 2024-01-17T22:59:01.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.612+0000 7f98fd600640 1 -- 172.21.15.161:0/237449830 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565179da0e30 con 0x56517a00b0f0 2024-01-17T22:59:01.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.612+0000 7f98fd600640 1 -- 172.21.15.161:0/237449830 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f9908019020 con 0x56517a00b0f0 2024-01-17T22:59:01.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.612+0000 7f991a6fa000 10 client.4395 fetch_fsmap finished waiting for FSMap version 7 2024-01-17T22:59:01.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.612+0000 7f991a6fa000 10 client.4395 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-17T22:59:01.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.612+0000 7f991a6fa000 20 client.4395 populate_metadata read hostname 'smithi161' 2024-01-17T22:59:01.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.612+0000 7f991a6fa000 1 --2- 172.21.15.161:0/237449830 >> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] conn(0x56517a012600 0x56517a0129e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.612+0000 7f991a6fa000 4 client.4395 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-17T22:59:01.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.612+0000 7f991a6fa000 1 -- 172.21.15.161:0/237449830 --> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565179dd7870 con 0x56517a012600 2024-01-17T22:59:01.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.636+0000 7f990fe00640 1 --2- 172.21.15.161:0/237449830 >> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] conn(0x56517a012600 0x56517a0129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:01.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.780+0000 7f990fe00640 1 --2- 172.21.15.161:0/237449830 >> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] conn(0x56517a012600 0x56517a0129e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b3050f135636843 server_cookie=82c26667469aa071 in_seq=0 out_seq=0 2024-01-17T22:59:01.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.780+0000 7f98fd600640 10 client.4395 ms_handle_connect on v2:172.21.15.190:6836/561131647 2024-01-17T22:59:01.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.968+0000 7f98fd600640 1 -- 172.21.15.161:0/237449830 <== mds.0 v2:172.21.15.190:6836/561131647 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x565179dd7870 con 0x56517a012600 2024-01-17T22:59:01.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.968+0000 7f98fd600640 10 client.4395 handle_command_reply: tid=0 2024-01-17T22:59:01.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.968+0000 7f991a6fa000 1 client.4395 shutdown 2024-01-17T22:59:01.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.968+0000 7f991a6fa000 1 -- 172.21.15.161:0/237449830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00b0f0 msgr2=0x56517a011950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:01.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.968+0000 7f991a6fa000 1 --2- 172.21.15.161:0/237449830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00b0f0 0x56517a011950 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9908051220 tx=0x7f9908058f00 comp rx=0 tx=0).stop 2024-01-17T22:59:01.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.968+0000 7f991a6fa000 1 -- 172.21.15.161:0/237449830 shutdown_connections 2024-01-17T22:59:01.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.968+0000 7f991a6fa000 1 --2- 172.21.15.161:0/237449830 >> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] conn(0x56517a012600 0x56517a0129e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.968+0000 7f991a6fa000 1 --2- 172.21.15.161:0/237449830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56517a00a7d0 0x56517a005240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.968+0000 7f991a6fa000 1 --2- 172.21.15.161:0/237449830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00b0f0 0x56517a011950 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.968+0000 7f991a6fa000 1 --2- 172.21.15.161:0/237449830 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565179fcf730 0x56517a004d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.968+0000 7f98fd600640 0 client.4395 ms_handle_reset on v2:172.21.15.190:6836/561131647 2024-01-17T22:59:01.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.968+0000 7f991a6fa000 1 -- 172.21.15.161:0/237449830 >> 172.21.15.161:0/237449830 conn(0x56517a006580 msgr2=0x56517a005d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:01.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.968+0000 7f991a6fa000 1 -- 172.21.15.161:0/237449830 shutdown_connections 2024-01-17T22:59:01.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.968+0000 7f991a6fa000 1 -- 172.21.15.161:0/237449830 wait complete. 2024-01-17T22:59:01.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.968+0000 7f991a6fa000 20 client.4395 trim_cache size 0 max 16384 2024-01-17T22:59:01.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.984+0000 7f991a6fa000 1 Processor -- start 2024-01-17T22:59:01.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.984+0000 7f991a6fa000 1 -- start start 2024-01-17T22:59:01.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.984+0000 7f991a6fa000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565179fcf730 0x56517a01c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.984+0000 7f991a6fa000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00a7d0 0x56517a01cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.984+0000 7f991a6fa000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56517a00b0f0 0x56517a0129e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.984+0000 7f991a6fa000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x565179ad2940 con 0x56517a00a7d0 2024-01-17T22:59:01.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.984+0000 7f991a6fa000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x565179e14cc0 con 0x56517a00b0f0 2024-01-17T22:59:01.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.984+0000 7f991a6fa000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x565179e16930 con 0x565179fcf730 2024-01-17T22:59:01.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.988+0000 7f990f400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00a7d0 0x56517a01cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:01.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.988+0000 7f990f400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00a7d0 0x56517a01cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39698/0 (socket says 172.21.15.161:39698) 2024-01-17T22:59:01.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.988+0000 7f990f400640 1 -- 172.21.15.161:0/1650714716 learned_addr learned my addr 172.21.15.161:0/1650714716 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:01.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.988+0000 7f990fe00640 1 --2- 172.21.15.161:0/1650714716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565179fcf730 0x56517a01c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:01.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.988+0000 7f9915200640 1 --2- 172.21.15.161:0/1650714716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56517a00b0f0 0x56517a0129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:01.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.988+0000 7f990f400640 1 -- 172.21.15.161:0/1650714716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565179fcf730 msgr2=0x56517a01c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:01.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.988+0000 7f990f400640 1 --2- 172.21.15.161:0/1650714716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565179fcf730 0x56517a01c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.988+0000 7f990f400640 1 -- 172.21.15.161:0/1650714716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56517a00b0f0 msgr2=0x56517a0129e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:01.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.988+0000 7f990f400640 1 --2- 172.21.15.161:0/1650714716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56517a00b0f0 0x56517a0129e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.988+0000 7f990f400640 1 -- 172.21.15.161:0/1650714716 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565179dc08e0 con 0x56517a00a7d0 2024-01-17T22:59:01.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.992+0000 7f990f400640 1 --2- 172.21.15.161:0/1650714716 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00a7d0 0x56517a01cf00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f98f8016000 tx=0x7f98f8008050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3459595cdd0a17 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:01.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f98ffe00640 1 -- 172.21.15.161:0/1650714716 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f8028070 con 0x56517a00a7d0 2024-01-17T22:59:01.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f98ffe00640 1 -- 172.21.15.161:0/1650714716 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f80098c0 con 0x56517a00a7d0 2024-01-17T22:59:01.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f98ffe00640 1 -- 172.21.15.161:0/1650714716 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f8004250 con 0x56517a00a7d0 2024-01-17T22:59:01.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f991a6fa000 1 -- 172.21.15.161:0/1650714716 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00a7d0 msgr2=0x56517a01cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:01.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f991a6fa000 1 --2- 172.21.15.161:0/1650714716 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00a7d0 0x56517a01cf00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f98f8016000 tx=0x7f98f8008050 comp rx=0 tx=0).stop 2024-01-17T22:59:01.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f991a6fa000 1 -- 172.21.15.161:0/1650714716 shutdown_connections 2024-01-17T22:59:01.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f991a6fa000 1 --2- 172.21.15.161:0/1650714716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56517a00b0f0 0x56517a0129e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f991a6fa000 1 --2- 172.21.15.161:0/1650714716 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00a7d0 0x56517a01cf00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f991a6fa000 1 --2- 172.21.15.161:0/1650714716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565179fcf730 0x56517a01c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:01.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f991a6fa000 1 -- 172.21.15.161:0/1650714716 >> 172.21.15.161:0/1650714716 conn(0x56517a006580 msgr2=0x56517a009b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:01.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f991a6fa000 1 -- 172.21.15.161:0/1650714716 shutdown_connections 2024-01-17T22:59:01.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f991a6fa000 1 -- 172.21.15.161:0/1650714716 wait complete. 2024-01-17T22:59:01.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f991a6fa000 1 -- start start 2024-01-17T22:59:01.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f991a6fa000 1 Processor -- start 2024-01-17T22:59:01.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f991a6fa000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565179fcf730 0x56517a06fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f991a6fa000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56517a00a7d0 0x56517a0701b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f991a6fa000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00b0f0 0x56517a0706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:01.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f991a6fa000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x565179db4cf0 con 0x56517a00b0f0 2024-01-17T22:59:01.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f991a6fa000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x565179e5b440 con 0x56517a00a7d0 2024-01-17T22:59:01.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f991a6fa000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x565179de1eb0 con 0x565179fcf730 2024-01-17T22:59:01.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:01.996+0000 7f991a6fa000 10 client.0 _ll_register_callbacks cb 0x565179e47a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-17T22:59:01.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.000+0000 7f9915200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00b0f0 0x56517a0706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:01.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.000+0000 7f9915200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00b0f0 0x56517a0706f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39710/0 (socket says 172.21.15.161:39710) 2024-01-17T22:59:01.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.000+0000 7f9915200640 1 -- 172.21.15.161:0/551448589 learned_addr learned my addr 172.21.15.161:0/551448589 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:01.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.000+0000 7f990f400640 1 --2- 172.21.15.161:0/551448589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56517a00a7d0 0x56517a0701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:01.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.000+0000 7f990fe00640 1 --2- 172.21.15.161:0/551448589 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565179fcf730 0x56517a06fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:02.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.004+0000 7f9915200640 1 -- 172.21.15.161:0/551448589 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565179fcf730 msgr2=0x56517a06fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:02.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.004+0000 7f9915200640 1 --2- 172.21.15.161:0/551448589 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565179fcf730 0x56517a06fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.004+0000 7f9915200640 1 -- 172.21.15.161:0/551448589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56517a00a7d0 msgr2=0x56517a0701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:02.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.004+0000 7f9915200640 1 --2- 172.21.15.161:0/551448589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56517a00a7d0 0x56517a0701b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.004+0000 7f9915200640 1 -- 172.21.15.161:0/551448589 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565179b11890 con 0x56517a00b0f0 2024-01-17T22:59:02.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.004+0000 7f9915200640 1 --2- 172.21.15.161:0/551448589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00b0f0 0x56517a0706f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9908082280 tx=0x7f9908005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3484523ae778f server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:02.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.004+0000 7f98fd600640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2024-01-17T22:59:02.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.008+0000 7f98fd600640 1 -- 172.21.15.161:0/551448589 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990805ccf0 con 0x56517a00b0f0 2024-01-17T22:59:02.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.008+0000 7f98fd600640 1 -- 172.21.15.161:0/551448589 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9908072e40 con 0x56517a00b0f0 2024-01-17T22:59:02.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.008+0000 7f991a6fa000 1 -- 172.21.15.161:0/551448589 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565179dcc4f0 con 0x56517a00b0f0 2024-01-17T22:59:02.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.012+0000 7f98fd600640 1 -- 172.21.15.161:0/551448589 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9908054d20 con 0x56517a00b0f0 2024-01-17T22:59:02.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.012+0000 7f991a6fa000 10 client.4401 fetch_fsmap learned FSMap version 7 2024-01-17T22:59:02.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.012+0000 7f991a6fa000 1 -- 172.21.15.161:0/551448589 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x565179b11cc0 con 0x56517a00b0f0 2024-01-17T22:59:02.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.016+0000 7f98fd600640 1 -- 172.21.15.161:0/551448589 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565179dcc4f0 con 0x56517a00b0f0 2024-01-17T22:59:02.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.016+0000 7f98fd600640 1 -- 172.21.15.161:0/551448589 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f990807a070 con 0x56517a00b0f0 2024-01-17T22:59:02.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.016+0000 7f991a6fa000 10 client.4401 fetch_fsmap finished waiting for FSMap version 7 2024-01-17T22:59:02.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.016+0000 7f991a6fa000 10 client.4401 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-17T22:59:02.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.016+0000 7f991a6fa000 20 client.4401 populate_metadata read hostname 'smithi161' 2024-01-17T22:59:02.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.016+0000 7f991a6fa000 1 --2- 172.21.15.161:0/551448589 >> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] conn(0x565179fcd650 0x565179fcda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:02.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.016+0000 7f991a6fa000 4 client.4401 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-17T22:59:02.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.016+0000 7f991a6fa000 1 -- 172.21.15.161:0/551448589 --> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] -- command(tid 0: {"prefix": "status"}) v1 -- 0x565179e19310 con 0x565179fcd650 2024-01-17T22:59:02.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.016+0000 7f990fe00640 1 --2- 172.21.15.161:0/551448589 >> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] conn(0x565179fcd650 0x565179fcda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:02.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.024+0000 7f990fe00640 1 --2- 172.21.15.161:0/551448589 >> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] conn(0x565179fcd650 0x565179fcda30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49ce32d7d9a08cbe server_cookie=47fab3dd9883a6f5 in_seq=0 out_seq=0 2024-01-17T22:59:02.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.024+0000 7f98fd600640 10 client.4401 ms_handle_connect on v2:172.21.15.190:6836/561131647 2024-01-17T22:59:02.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.048+0000 7f98fd600640 1 -- 172.21.15.161:0/551448589 <== mds.0 v2:172.21.15.190:6836/561131647 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x565179e19310 con 0x565179fcd650 2024-01-17T22:59:02.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.048+0000 7f98fd600640 10 client.4401 handle_command_reply: tid=0 2024-01-17T22:59:02.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.048+0000 7f991a6fa000 1 client.4401 shutdown 2024-01-17T22:59:02.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.048+0000 7f991a6fa000 1 -- 172.21.15.161:0/551448589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00b0f0 msgr2=0x56517a0706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:02.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.048+0000 7f991a6fa000 1 --2- 172.21.15.161:0/551448589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00b0f0 0x56517a0706f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9908082280 tx=0x7f9908005040 comp rx=0 tx=0).stop 2024-01-17T22:59:02.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.048+0000 7f991a6fa000 1 -- 172.21.15.161:0/551448589 shutdown_connections 2024-01-17T22:59:02.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.048+0000 7f991a6fa000 1 --2- 172.21.15.161:0/551448589 >> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] conn(0x565179fcd650 0x565179fcda30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.048+0000 7f991a6fa000 1 --2- 172.21.15.161:0/551448589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56517a00a7d0 0x56517a0701b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.048+0000 7f991a6fa000 1 --2- 172.21.15.161:0/551448589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56517a00b0f0 0x56517a0706f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.048+0000 7f991a6fa000 1 --2- 172.21.15.161:0/551448589 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565179fcf730 0x56517a06fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.048+0000 7f98fd600640 0 client.4401 ms_handle_reset on v2:172.21.15.190:6836/561131647 2024-01-17T22:59:02.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.048+0000 7f991a6fa000 1 -- 172.21.15.161:0/551448589 >> 172.21.15.161:0/551448589 conn(0x56517a006580 msgr2=0x56517a01d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:02.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.048+0000 7f991a6fa000 1 -- 172.21.15.161:0/551448589 shutdown_connections 2024-01-17T22:59:02.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.048+0000 7f991a6fa000 1 -- 172.21.15.161:0/551448589 wait complete. 2024-01-17T22:59:02.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.048+0000 7f991a6fa000 20 client.4401 trim_cache size 0 max 16384 2024-01-17T22:59:02.049 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-01-17T22:59:02.049 INFO:teuthology.orchestra.run.smithi161.stdout: "cluster_fsid": "58c3361f-c527-4d53-a987-e30062ef8beb", 2024-01-17T22:59:02.049 INFO:teuthology.orchestra.run.smithi161.stdout: "whoami": 0, 2024-01-17T22:59:02.049 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 4269, 2024-01-17T22:59:02.049 INFO:teuthology.orchestra.run.smithi161.stdout: "want_state": "up:active", 2024-01-17T22:59:02.049 INFO:teuthology.orchestra.run.smithi161.stdout: "state": "up:active", 2024-01-17T22:59:02.049 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs", 2024-01-17T22:59:02.049 INFO:teuthology.orchestra.run.smithi161.stdout: "rank_uptime": 11.796645097000001, 2024-01-17T22:59:02.049 INFO:teuthology.orchestra.run.smithi161.stdout: "mdsmap_epoch": 7, 2024-01-17T22:59:02.049 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch": 26, 2024-01-17T22:59:02.049 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch_barrier": 26, 2024-01-17T22:59:02.049 INFO:teuthology.orchestra.run.smithi161.stdout: "uptime": 36.331246290000003 2024-01-17T22:59:02.050 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-01-17T22:59:02.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.052+0000 7f9917200640 1 -- 172.21.15.161:0/425380938 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f98e8066890 msgr2=0x7f98e8068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:02.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.052+0000 7f9917200640 1 --2- 172.21.15.161:0/425380938 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f98e8066890 0x7f98e8068d50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f99000b2000 tx=0x7f9900004740 comp rx=0 tx=0).stop 2024-01-17T22:59:02.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.052+0000 7f9917200640 1 -- 172.21.15.161:0/425380938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9910153730 msgr2=0x7f991015bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:02.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.052+0000 7f9917200640 1 --2- 172.21.15.161:0/425380938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9910153730 0x7f991015bd70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f990800c760 tx=0x7f990800cc20 comp rx=0 tx=0).stop 2024-01-17T22:59:02.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.052+0000 7f9917200640 1 -- 172.21.15.161:0/425380938 shutdown_connections 2024-01-17T22:59:02.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.052+0000 7f9917200640 1 --2- 172.21.15.161:0/425380938 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f98e8066890 0x7f98e8068d50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.052+0000 7f9917200640 1 --2- 172.21.15.161:0/425380938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99100cda40 0x7f99101562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.052+0000 7f9917200640 1 --2- 172.21.15.161:0/425380938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9910153730 0x7f991015bd70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.052+0000 7f9917200640 1 --2- 172.21.15.161:0/425380938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9910071360 0x7f991014d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.052+0000 7f9917200640 1 -- 172.21.15.161:0/425380938 >> 172.21.15.161:0/425380938 conn(0x7f9910070460 msgr2=0x7f99100c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:02.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.052+0000 7f9917200640 1 -- 172.21.15.161:0/425380938 shutdown_connections 2024-01-17T22:59:02.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.052+0000 7f9917200640 1 -- 172.21.15.161:0/425380938 wait complete. 2024-01-17T22:59:02.069 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-17T22:59:02.069 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-17T22:59:02.069 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-17T22:59:02.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.208+0000 7fdfa4000640 1 Processor -- start 2024-01-17T22:59:02.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.208+0000 7fdfa4000640 1 -- start start 2024-01-17T22:59:02.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.208+0000 7fdfa4000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf9c071110 0x7fdf9c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:02.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.208+0000 7fdfa4000640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdf9c06b7f0 0x7fdf9c0ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:02.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.208+0000 7fdfa4000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf9c15d770 con 0x7fdf9c0714f0 2024-01-17T22:59:02.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.208+0000 7fdfa4000640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf9c06bc80 con 0x7fdf9c06b7f0 2024-01-17T22:59:02.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.208+0000 7fdfa4000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c15da30 con 0x7fdf9c071110 2024-01-17T22:59:02.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.212+0000 7fdfa0c00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fdf9c0714f0 0x7fdf9c15cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:48392/0 (socket says 172.21.15.161:48392) 2024-01-17T22:59:02.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.212+0000 7fdfa0c00640 1 -- 172.21.15.161:0/1987048171 learned_addr learned my addr 172.21.15.161:0/1987048171 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:02.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.212+0000 7fdfa1600640 1 --2- 172.21.15.161:0/1987048171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf9c071110 0x7fdf9c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:02.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.212+0000 7fdfa2000640 1 --2- 172.21.15.161:0/1987048171 >> v2:172.21.15.190:3300/0 conn(0x7fdf9c06b7f0 0x7fdf9c0ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:02.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.212+0000 7fdf9be00640 1 -- 172.21.15.161:0/1987048171 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025772581 0 0) 0x7fdf9c15d770 con 0x7fdf9c0714f0 2024-01-17T22:59:02.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.212+0000 7fdf9be00640 1 -- 172.21.15.161:0/1987048171 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf7c003530 con 0x7fdf9c0714f0 2024-01-17T22:59:02.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.216+0000 7fdf9be00640 1 -- 172.21.15.161:0/1987048171 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1028639483 0 0) 0x7fdf7c003530 con 0x7fdf9c0714f0 2024-01-17T22:59:02.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.216+0000 7fdf9be00640 1 -- 172.21.15.161:0/1987048171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf9c071110 msgr2=0x7fdf9c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:02.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.216+0000 7fdf9be00640 1 --2- 172.21.15.161:0/1987048171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf9c071110 0x7fdf9c15a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.216+0000 7fdf9be00640 1 -- 172.21.15.161:0/1987048171 >> v2:172.21.15.190:3300/0 conn(0x7fdf9c06b7f0 msgr2=0x7fdf9c0ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:02.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.216+0000 7fdf9be00640 1 --2- 172.21.15.161:0/1987048171 >> v2:172.21.15.190:3300/0 conn(0x7fdf9c06b7f0 0x7fdf9c0ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.216+0000 7fdf9be00640 1 -- 172.21.15.161:0/1987048171 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c159a80 con 0x7fdf9c0714f0 2024-01-17T22:59:02.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.216+0000 7fdf9be00640 1 -- 172.21.15.161:0/1987048171 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7fdf84001680 con 0x7fdf9c0714f0 2024-01-17T22:59:02.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.216+0000 7fdf9be00640 1 -- 172.21.15.161:0/1987048171 >> v1:172.21.15.161:6789/0 conn(0x7fdf9c0714f0 legacy=0x7fdf9c15cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:02.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.216+0000 7fdf9be00640 1 --2- 172.21.15.161:0/1987048171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf9c071110 0x7fdf7c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:02.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.216+0000 7fdf9be00640 1 --2- 172.21.15.161:0/1987048171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf7c003f50 0x7fdf7c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:02.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.216+0000 7fdf9be00640 1 --2- 172.21.15.161:0/1987048171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf7c004d10 0x7fdf7c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:02.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.216+0000 7fdf9be00640 1 -- 172.21.15.161:0/1987048171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c06bc80 con 0x7fdf7c003f50 2024-01-17T22:59:02.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.216+0000 7fdf9be00640 1 -- 172.21.15.161:0/1987048171 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c15da30 con 0x7fdf7c004d10 2024-01-17T22:59:02.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.216+0000 7fdf9be00640 1 -- 172.21.15.161:0/1987048171 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c00ba10 con 0x7fdf9c071110 2024-01-17T22:59:02.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.220+0000 7fdfa0c00640 1 --2- 172.21.15.161:0/1987048171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf7c003f50 0x7fdf7c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:02.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.224+0000 7fdfa0c00640 1 -- 172.21.15.161:0/1987048171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf9c071110 msgr2=0x7fdf7c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:02.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.224+0000 7fdfa0c00640 1 --2- 172.21.15.161:0/1987048171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf9c071110 0x7fdf7c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.224+0000 7fdfa0c00640 1 -- 172.21.15.161:0/1987048171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf7c004d10 msgr2=0x7fdf7c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:02.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.224+0000 7fdfa0c00640 1 --2- 172.21.15.161:0/1987048171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf7c004d10 0x7fdf7c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.224+0000 7fdfa0c00640 1 -- 172.21.15.161:0/1987048171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c003530 con 0x7fdf7c003f50 2024-01-17T22:59:02.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.228+0000 7fdfa0c00640 1 --2- 172.21.15.161:0/1987048171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf7c003f50 0x7fdf7c0047d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400c110 tx=0x7fdf8401cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33532cffe612b9f2 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:02.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.232+0000 7fdf9be00640 1 -- 172.21.15.161:0/1987048171 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf840058e0 con 0x7fdf7c003f50 2024-01-17T22:59:02.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.232+0000 7fdf9be00640 1 -- 172.21.15.161:0/1987048171 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf84005a60 con 0x7fdf7c003f50 2024-01-17T22:59:02.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.232+0000 7fdf9be00640 1 -- 172.21.15.161:0/1987048171 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84005e90 con 0x7fdf7c003f50 2024-01-17T22:59:02.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.232+0000 7fdfa4000640 1 -- 172.21.15.161:0/1987048171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf7c003f50 msgr2=0x7fdf7c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:02.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.232+0000 7fdfa4000640 1 --2- 172.21.15.161:0/1987048171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf7c003f50 0x7fdf7c0047d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400c110 tx=0x7fdf8401cba0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.232+0000 7fdfa2000640 1 -- 172.21.15.161:0/1987048171 reap_dead start 2024-01-17T22:59:02.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.232+0000 7fdfa4000640 1 -- 172.21.15.161:0/1987048171 shutdown_connections 2024-01-17T22:59:02.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.232+0000 7fdfa4000640 1 -- 172.21.15.161:0/1987048171 >> 172.21.15.161:0/1987048171 conn(0x7fdf9c0704f0 msgr2=0x7fdf9c06f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:02.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.232+0000 7fdfa4000640 1 -- 172.21.15.161:0/1987048171 shutdown_connections 2024-01-17T22:59:02.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.232+0000 7fdfa4000640 1 -- 172.21.15.161:0/1987048171 wait complete. 2024-01-17T22:59:02.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.232+0000 7fdfa4000640 1 Processor -- start 2024-01-17T22:59:02.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.232+0000 7fdfa4000640 1 -- start start 2024-01-17T22:59:02.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.236+0000 7fdfa4000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf7c003f50 0x7fdf9c1e3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:02.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.236+0000 7fdfa4000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf9c0cc4c0 0x7fdf9c0c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:02.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.236+0000 7fdfa4000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf9c0cd690 0x7fdf9c0cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:02.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.236+0000 7fdfa4000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c1572f0 con 0x7fdf9c0cd690 2024-01-17T22:59:02.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.236+0000 7fdfa4000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c1e6aa0 con 0x7fdf7c003f50 2024-01-17T22:59:02.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.236+0000 7fdfa4000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c155330 con 0x7fdf9c0cc4c0 2024-01-17T22:59:02.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.236+0000 7fdfa2000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf9c0cd690 0x7fdf9c0cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:02.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.236+0000 7fdfa2000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf9c0cd690 0x7fdf9c0cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39724/0 (socket says 172.21.15.161:39724) 2024-01-17T22:59:02.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.236+0000 7fdfa2000640 1 -- 172.21.15.161:0/4164406658 learned_addr learned my addr 172.21.15.161:0/4164406658 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:02.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.236+0000 7fdfa0c00640 1 --2- 172.21.15.161:0/4164406658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf9c0cc4c0 0x7fdf9c0c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:02.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.236+0000 7fdfa1600640 1 --2- 172.21.15.161:0/4164406658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf7c003f50 0x7fdf9c1e3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:02.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.240+0000 7fdfa2000640 1 -- 172.21.15.161:0/4164406658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf9c0cc4c0 msgr2=0x7fdf9c0c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:02.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.240+0000 7fdfa2000640 1 --2- 172.21.15.161:0/4164406658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf9c0cc4c0 0x7fdf9c0c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.240+0000 7fdfa2000640 1 -- 172.21.15.161:0/4164406658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf7c003f50 msgr2=0x7fdf9c1e3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:02.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.240+0000 7fdfa2000640 1 --2- 172.21.15.161:0/4164406658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf7c003f50 0x7fdf9c1e3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.240+0000 7fdfa2000640 1 -- 172.21.15.161:0/4164406658 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c1e3db0 con 0x7fdf9c0cd690 2024-01-17T22:59:02.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.240+0000 7fdfa2000640 1 --2- 172.21.15.161:0/4164406658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf9c0cd690 0x7fdf9c0cdb20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c0c23d0 tx=0x7fdf9400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:02.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.244+0000 7fdf99600640 1 -- 172.21.15.161:0/4164406658 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf94010040 con 0x7fdf9c0cd690 2024-01-17T22:59:02.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.244+0000 7fdf99600640 1 -- 172.21.15.161:0/4164406658 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9400bae0 con 0x7fdf9c0cd690 2024-01-17T22:59:02.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.244+0000 7fdf99600640 1 -- 172.21.15.161:0/4164406658 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9400be90 con 0x7fdf9c0cd690 2024-01-17T22:59:02.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.244+0000 7fdfa4000640 1 -- 172.21.15.161:0/4164406658 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9c1e2ba0 con 0x7fdf9c0cd690 2024-01-17T22:59:02.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.244+0000 7fdfa4000640 1 -- 172.21.15.161:0/4164406658 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9c1e63e0 con 0x7fdf9c0cd690 2024-01-17T22:59:02.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.248+0000 7fdfa4000640 1 -- 172.21.15.161:0/4164406658 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9c1e6240 con 0x7fdf9c0cd690 2024-01-17T22:59:02.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.268+0000 7fdf99600640 1 -- 172.21.15.161:0/4164406658 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fdf9401d400 con 0x7fdf9c0cd690 2024-01-17T22:59:02.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.268+0000 7fdf99600640 1 --2- 172.21.15.161:0/4164406658 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fdf74066890 0x7fdf74068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:02.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.268+0000 7fdfa1600640 1 --2- 172.21.15.161:0/4164406658 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fdf74066890 0x7fdf74068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:02.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.268+0000 7fdfa1600640 1 --2- 172.21.15.161:0/4164406658 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fdf74066890 0x7fdf74068d50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009a20 tx=0x7fdf8c0094c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:02.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.268+0000 7fdf99600640 1 -- 172.21.15.161:0/4164406658 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdf94056020 con 0x7fdf9c0cd690 2024-01-17T22:59:02.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.496+0000 7fdf99600640 1 -- 172.21.15.161:0/4164406658 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fdf94051c60 con 0x7fdf9c0cd690 2024-01-17T22:59:02.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.684+0000 7fdfa4000640 1 -- 172.21.15.161:0/4164406658 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdf9c0cd3b0 con 0x7fdf9c0cd690 2024-01-17T22:59:02.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.692+0000 7fdf99600640 1 -- 172.21.15.161:0/4164406658 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fdf9c0cd3b0 con 0x7fdf9c0cd690 2024-01-17T22:59:02.692 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-17T22:59:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.696+0000 7fdfa4000640 1 -- 172.21.15.161:0/4164406658 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fdf74066890 msgr2=0x7fdf74068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.696+0000 7fdfa4000640 1 --2- 172.21.15.161:0/4164406658 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fdf74066890 0x7fdf74068d50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009a20 tx=0x7fdf8c0094c0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.696+0000 7fdfa4000640 1 -- 172.21.15.161:0/4164406658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf9c0cd690 msgr2=0x7fdf9c0cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.696+0000 7fdfa4000640 1 --2- 172.21.15.161:0/4164406658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf9c0cd690 0x7fdf9c0cdb20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c0c23d0 tx=0x7fdf9400b480 comp rx=0 tx=0).stop 2024-01-17T22:59:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.696+0000 7fdfa4000640 1 -- 172.21.15.161:0/4164406658 shutdown_connections 2024-01-17T22:59:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.696+0000 7fdfa4000640 1 --2- 172.21.15.161:0/4164406658 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fdf74066890 0x7fdf74068d50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.696+0000 7fdfa4000640 1 --2- 172.21.15.161:0/4164406658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf9c0cd690 0x7fdf9c0cdb20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.696+0000 7fdfa4000640 1 --2- 172.21.15.161:0/4164406658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf9c0cc4c0 0x7fdf9c0c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.696+0000 7fdfa4000640 1 --2- 172.21.15.161:0/4164406658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf7c003f50 0x7fdf9c1e3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.696+0000 7fdfa4000640 1 -- 172.21.15.161:0/4164406658 >> 172.21.15.161:0/4164406658 conn(0x7fdf9c0704f0 msgr2=0x7fdf9c15ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.696+0000 7fdfa4000640 1 -- 172.21.15.161:0/4164406658 shutdown_connections 2024-01-17T22:59:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:02.696+0000 7fdfa4000640 1 -- 172.21.15.161:0/4164406658 wait complete. 2024-01-17T22:59:02.716 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-17T22:59:02.716 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-17T22:59:02.716 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2024-01-17T22:59:02.716 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-01-17T22:59:02.716 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-17T22:59:02.716 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-17T22:59:02.716 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-17T22:59:02.716 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-17T22:59:02.716 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-01-17T22:59:02.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:02.717 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2024-01-17T22:59:02.725 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-17T22:59:02.725 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-17T22:59:02.725 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2024-01-17T22:59:02.725 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-01-17T22:59:02.725 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2024-01-17T22:59:02.725 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-01-17T22:59:02.725 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-17T22:59:02.725 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2024-01-17T22:59:02.726 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2024-01-17T22:59:02.726 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-17T22:59:02.726 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2024-01-17T22:59:02.726 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2024-01-17T22:59:02.726 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-17T22:59:02.726 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2024-01-17T22:59:02.726 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-17T22:59:02.726 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2024-01-17T22:59:02.726 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-17T22:59:02.726 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 35085sec preferred_lft 35085sec 2024-01-17T22:59:02.726 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2024-01-17T22:59:02.726 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-01-17T22:59:02.726 INFO:teuthology.orchestra.run.smithi161.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-17T22:59:02.726 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 02:42:29:ee:21:87 brd ff:ff:ff:ff:ff:ff 2024-01-17T22:59:02.726 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-17T22:59:02.727 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-01-17T22:59:02.728 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-17T22:59:02.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:02.728 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-01-17T22:59:02.728 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-01-17T22:59:02.728 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add name ceph-brx type bridge 2024-01-17T22:59:02.728 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr flush dev ceph-brx 2024-01-17T22:59:02.728 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set ceph-brx up 2024-01-17T22:59:02.728 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-17T22:59:02.728 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-01-17T22:59:02.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:02.836 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-17T22:59:02.854 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-01-17T22:59:02.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:02.856 DEBUG:teuthology.orchestra.run.smithi161:> route 2024-01-17T22:59:02.958 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2024-01-17T22:59:02.958 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-17T22:59:02.958 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-17T22:59:02.958 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-17T22:59:02.958 INFO:teuthology.orchestra.run.smithi161.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-17T22:59:02.958 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-17T22:59:02.959 INFO:teuthology.orchestra.run.smithi161.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-17T22:59:02.959 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-17T22:59:02.959 INFO:teuthology.orchestra.run.smithi161.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-17T22:59:02.959 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-17T22:59:02.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:02.959 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-01-17T22:59:02.959 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-01-17T22:59:02.959 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-17T22:59:02.959 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-17T22:59:02.959 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-17T22:59:02.959 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-01-17T22:59:03.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:03.008 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-01-17T22:59:03.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:03.017 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2024-01-17T22:59:03.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:03.072 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-01-17T22:59:03.072 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-01-17T22:59:03.072 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-17T22:59:03.072 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-01-17T22:59:03.072 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-01-17T22:59:03.157 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-01-17T22:59:03.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:03.158 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-01-17T22:59:03.158 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-01-17T22:59:03.158 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-01-17T22:59:03.158 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-17T22:59:03.158 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-01-17T22:59:03.158 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-01-17T22:59:03.158 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-01-17T22:59:03.158 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-01-17T22:59:03.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:03.328 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-01-17T22:59:03.328 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-01-17T22:59:03.328 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2024-01-17T22:59:03.328 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.0 master ceph-brx 2024-01-17T22:59:03.328 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-01-17T22:59:03.367 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-01-17T22:59:03.367 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-17T22:59:03.368 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-01-17T22:59:03.416 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-01-17T22:59:03.416 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-17T22:59:03.416 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-01-17T22:59:03.467 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2024-01-17T22:59:03.527 DEBUG:teuthology.orchestra.run.smithi161:> cat /proc/self/mounts | awk '{print $2}' 2024-01-17T22:59:03.577 INFO:teuthology.orchestra.run.smithi161.stdout:/sys 2024-01-17T22:59:03.577 INFO:teuthology.orchestra.run.smithi161.stdout:/proc 2024-01-17T22:59:03.577 INFO:teuthology.orchestra.run.smithi161.stdout:/dev 2024-01-17T22:59:03.577 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/pts 2024-01-17T22:59:03.577 INFO:teuthology.orchestra.run.smithi161.stdout:/run 2024-01-17T22:59:03.578 INFO:teuthology.orchestra.run.smithi161.stdout:/ 2024-01-17T22:59:03.578 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/security 2024-01-17T22:59:03.578 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/shm 2024-01-17T22:59:03.578 INFO:teuthology.orchestra.run.smithi161.stdout:/run/lock 2024-01-17T22:59:03.578 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/cgroup 2024-01-17T22:59:03.578 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/pstore 2024-01-17T22:59:03.578 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/bpf 2024-01-17T22:59:03.578 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/sys/fs/binfmt_misc 2024-01-17T22:59:03.578 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/hugepages 2024-01-17T22:59:03.578 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/mqueue 2024-01-17T22:59:03.578 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/debug 2024-01-17T22:59:03.578 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/tracing 2024-01-17T22:59:03.578 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/fs/nfsd 2024-01-17T22:59:03.578 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/fuse/connections 2024-01-17T22:59:03.578 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/config 2024-01-17T22:59:03.579 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-sysusers.service 2024-01-17T22:59:03.579 INFO:teuthology.orchestra.run.smithi161.stdout:/run/rpc_pipefs 2024-01-17T22:59:03.579 INFO:teuthology.orchestra.run.smithi161.stdout:/run/user/1000 2024-01-17T22:59:03.579 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph 2024-01-17T22:59:03.579 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-0 2024-01-17T22:59:03.579 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-1 2024-01-17T22:59:03.579 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-2 2024-01-17T22:59:03.579 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-3 2024-01-17T22:59:03.579 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns 2024-01-17T22:59:03.579 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-17T22:59:03.579 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-17T22:59:03.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:03.580 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2024-01-17T22:59:03.632 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-17T22:59:03.632 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-01-17T22:59:03.674 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2024-01-17T22:59:03.694 DEBUG:teuthology.orchestra.run.smithi161:> cat /proc/self/mounts | awk '{print $2}' 2024-01-17T22:59:03.749 INFO:teuthology.orchestra.run.smithi161.stdout:/sys 2024-01-17T22:59:03.749 INFO:teuthology.orchestra.run.smithi161.stdout:/proc 2024-01-17T22:59:03.749 INFO:teuthology.orchestra.run.smithi161.stdout:/dev 2024-01-17T22:59:03.749 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/pts 2024-01-17T22:59:03.749 INFO:teuthology.orchestra.run.smithi161.stdout:/run 2024-01-17T22:59:03.750 INFO:teuthology.orchestra.run.smithi161.stdout:/ 2024-01-17T22:59:03.750 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/security 2024-01-17T22:59:03.750 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/shm 2024-01-17T22:59:03.750 INFO:teuthology.orchestra.run.smithi161.stdout:/run/lock 2024-01-17T22:59:03.750 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/cgroup 2024-01-17T22:59:03.750 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/pstore 2024-01-17T22:59:03.750 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/bpf 2024-01-17T22:59:03.750 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/sys/fs/binfmt_misc 2024-01-17T22:59:03.750 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/hugepages 2024-01-17T22:59:03.750 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/mqueue 2024-01-17T22:59:03.750 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/debug 2024-01-17T22:59:03.750 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/tracing 2024-01-17T22:59:03.750 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/fs/nfsd 2024-01-17T22:59:03.750 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/fuse/connections 2024-01-17T22:59:03.750 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/config 2024-01-17T22:59:03.750 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-sysusers.service 2024-01-17T22:59:03.750 INFO:teuthology.orchestra.run.smithi161.stdout:/run/rpc_pipefs 2024-01-17T22:59:03.751 INFO:teuthology.orchestra.run.smithi161.stdout:/run/user/1000 2024-01-17T22:59:03.751 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph 2024-01-17T22:59:03.751 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-0 2024-01-17T22:59:03.751 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-1 2024-01-17T22:59:03.751 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-2 2024-01-17T22:59:03.751 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-3 2024-01-17T22:59:03.751 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns 2024-01-17T22:59:03.751 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-17T22:59:03.751 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-17T22:59:03.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:03.752 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2024-01-17T22:59:03.805 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi161.stderr:2024-01-17T22:59:03.808+0000 7f080c3c9580 -1 init, newargv = 0x55dec504bdd0 newargc=15 2024-01-17T22:59:03.805 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi161.stderr:ceph-fuse[32110]: starting ceph client 2024-01-17T22:59:04.243 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi161.stderr:ceph-fuse[32110]: starting fuse 2024-01-17T22:59:04.911 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2024-01-17T22:59:04.933 DEBUG:teuthology.orchestra.run.smithi161:> cat /proc/self/mounts | awk '{print $2}' 2024-01-17T22:59:04.989 INFO:teuthology.orchestra.run.smithi161.stdout:/sys 2024-01-17T22:59:04.989 INFO:teuthology.orchestra.run.smithi161.stdout:/proc 2024-01-17T22:59:04.989 INFO:teuthology.orchestra.run.smithi161.stdout:/dev 2024-01-17T22:59:04.989 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/pts 2024-01-17T22:59:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:/run 2024-01-17T22:59:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:/ 2024-01-17T22:59:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/security 2024-01-17T22:59:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/shm 2024-01-17T22:59:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:/run/lock 2024-01-17T22:59:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/cgroup 2024-01-17T22:59:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/pstore 2024-01-17T22:59:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/bpf 2024-01-17T22:59:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/sys/fs/binfmt_misc 2024-01-17T22:59:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/hugepages 2024-01-17T22:59:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/mqueue 2024-01-17T22:59:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/debug 2024-01-17T22:59:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/tracing 2024-01-17T22:59:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/fs/nfsd 2024-01-17T22:59:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/fuse/connections 2024-01-17T22:59:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/config 2024-01-17T22:59:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-sysusers.service 2024-01-17T22:59:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:/run/rpc_pipefs 2024-01-17T22:59:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:/run/user/1000 2024-01-17T22:59:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph 2024-01-17T22:59:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-0 2024-01-17T22:59:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-1 2024-01-17T22:59:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-2 2024-01-17T22:59:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-3 2024-01-17T22:59:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns 2024-01-17T22:59:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-17T22:59:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-17T22:59:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:/home/ubuntu/cephtest/mnt.admin 2024-01-17T22:59:04.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:04.992 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2024-01-17T22:59:05.043 INFO:teuthology.orchestra.run.smithi161.stdout:43 2024-01-17T22:59:05.044 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-17T22:59:05.044 DEBUG:teuthology.orchestra.run.smithi161:> sudo stdin-killer -- python3 -c ' 2024-01-17T22:59:05.044 DEBUG:teuthology.orchestra.run.smithi161:> import glob 2024-01-17T22:59:05.044 DEBUG:teuthology.orchestra.run.smithi161:> import re 2024-01-17T22:59:05.044 DEBUG:teuthology.orchestra.run.smithi161:> import os 2024-01-17T22:59:05.044 DEBUG:teuthology.orchestra.run.smithi161:> import subprocess 2024-01-17T22:59:05.044 DEBUG:teuthology.orchestra.run.smithi161:> 2024-01-17T22:59:05.044 DEBUG:teuthology.orchestra.run.smithi161:> def _find_admin_socket(client_name): 2024-01-17T22:59:05.044 DEBUG:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-01-17T22:59:05.044 DEBUG:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2024-01-17T22:59:05.044 DEBUG:teuthology.orchestra.run.smithi161:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-01-17T22:59:05.044 DEBUG:teuthology.orchestra.run.smithi161:> 2024-01-17T22:59:05.045 DEBUG:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2024-01-17T22:59:05.045 DEBUG:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2024-01-17T22:59:05.045 DEBUG:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2024-01-17T22:59:05.045 DEBUG:teuthology.orchestra.run.smithi161:> return files[0] 2024-01-17T22:59:05.045 DEBUG:teuthology.orchestra.run.smithi161:> 2024-01-17T22:59:05.045 DEBUG:teuthology.orchestra.run.smithi161:> for f in files: 2024-01-17T22:59:05.045 DEBUG:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-17T22:59:05.045 DEBUG:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-17T22:59:05.045 DEBUG:teuthology.orchestra.run.smithi161:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-17T22:59:05.045 DEBUG:teuthology.orchestra.run.smithi161:> contents = proc_f.read() 2024-01-17T22:59:05.045 DEBUG:teuthology.orchestra.run.smithi161:> if mountpoint in contents: 2024-01-17T22:59:05.045 DEBUG:teuthology.orchestra.run.smithi161:> return f 2024-01-17T22:59:05.045 DEBUG:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-17T22:59:05.045 DEBUG:teuthology.orchestra.run.smithi161:> 2024-01-17T22:59:05.045 DEBUG:teuthology.orchestra.run.smithi161:> print(_find_admin_socket("client.admin")) 2024-01-17T22:59:05.045 DEBUG:teuthology.orchestra.run.smithi161:> ' 2024-01-17T22:59:05.165 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.admin.32110.asok 2024-01-17T22:59:05.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-17T22:59:05.176 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.32110.asok 2024-01-17T22:59:05.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:05.176 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.32110.asok status 2024-01-17T22:59:05.346 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-01-17T22:59:05.346 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2024-01-17T22:59:05.346 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "1ec1182e55b4a38b17dd0d004d9fa6814d0269d4", 2024-01-17T22:59:05.346 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 19.0.0-653-g1ec1182e (1ec1182e55b4a38b17dd0d004d9fa6814d0269d4) squid (dev)", 2024-01-17T22:59:05.346 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "admin", 2024-01-17T22:59:05.346 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2024-01-17T22:59:05.346 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-01-17T22:59:05.346 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "32110", 2024-01-17T22:59:05.346 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2024-01-17T22:59:05.346 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-01-17T22:59:05.346 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2024-01-17T22:59:05.346 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2024-01-17T22:59:05.346 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 4413, 2024-01-17T22:59:05.346 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2024-01-17T22:59:05.347 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2024-01-17T22:59:05.347 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2024-01-17T22:59:05.347 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 4413 2024-01-17T22:59:05.347 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-01-17T22:59:05.347 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2024-01-17T22:59:05.347 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2024-01-17T22:59:05.347 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "192.168.0.1:0", 2024-01-17T22:59:05.347 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 250946664 2024-01-17T22:59:05.347 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-01-17T22:59:05.347 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-01-17T22:59:05.347 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2024-01-17T22:59:05.347 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2024-01-17T22:59:05.347 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "192.168.0.1:0", 2024-01-17T22:59:05.347 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 250946664 2024-01-17T22:59:05.347 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-01-17T22:59:05.347 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.4413 192.168.0.1:0/250946664", 2024-01-17T22:59:05.347 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "192.168.0.1:0/250946664", 2024-01-17T22:59:05.348 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2024-01-17T22:59:05.348 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 7, 2024-01-17T22:59:05.348 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 26, 2024-01-17T22:59:05.348 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2024-01-17T22:59:05.348 INFO:teuthology.orchestra.run.smithi161.stdout: "blocklisted": false, 2024-01-17T22:59:05.348 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2024-01-17T22:59:05.348 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-01-17T22:59:05.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:05.360 DEBUG:teuthology.orchestra.run.smithi161:> stat --file-system '--printf=%T 2024-01-17T22:59:05.360 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-01-17T22:59:05.380 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2024-01-17T22:59:05.380 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-01-17T22:59:05.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:05.380 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-01-17T22:59:05.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:05.571 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-01-17T22:59:05.924 INFO:teuthology.orchestra.run.smithi161.stdout:# file: . 2024-01-17T22:59:05.924 INFO:teuthology.orchestra.run.smithi161.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-01-17T22:59:05.924 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:05.925 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:59:05.925 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-17T22:59:05.934 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T22:59:06.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.116+0000 7f4165000640 1 Processor -- start 2024-01-17T22:59:06.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.116+0000 7f4165000640 1 -- start start 2024-01-17T22:59:06.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.116+0000 7f4165000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41601539a0 0x7f41600ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:06.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.116+0000 7f4165000640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f416015d3f0 0x7f416015d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:06.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.116+0000 7f4165000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41600c9890 con 0x7f41600c79c0 2024-01-17T22:59:06.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.116+0000 7f4165000640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416006d570 con 0x7f416015d3f0 2024-01-17T22:59:06.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.116+0000 7f4165000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4160159bf0 con 0x7f41601539a0 2024-01-17T22:59:06.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.120+0000 7f415d400640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f41600c79c0 0x7f4160061100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:48402/0 (socket says 172.21.15.161:48402) 2024-01-17T22:59:06.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.120+0000 7f415d400640 1 -- 172.21.15.161:0/3981896618 learned_addr learned my addr 172.21.15.161:0/3981896618 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:06.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.120+0000 7f415e800640 1 --2- 172.21.15.161:0/3981896618 >> v2:172.21.15.190:3300/0 conn(0x7f416015d3f0 0x7f416015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:06.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.120+0000 7f415de00640 1 --2- 172.21.15.161:0/3981896618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41601539a0 0x7f41600ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:06.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.120+0000 7f415ca00640 1 -- 172.21.15.161:0/3981896618 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262570790 0 0) 0x7f41600c9890 con 0x7f41600c79c0 2024-01-17T22:59:06.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.120+0000 7f415ca00640 1 -- 172.21.15.161:0/3981896618 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4140003530 con 0x7f41600c79c0 2024-01-17T22:59:06.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.124+0000 7f415ca00640 1 -- 172.21.15.161:0/3981896618 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 718255459 0 0) 0x7f4140003530 con 0x7f41600c79c0 2024-01-17T22:59:06.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.124+0000 7f415ca00640 1 -- 172.21.15.161:0/3981896618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41601539a0 msgr2=0x7f41600ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:06.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.124+0000 7f415ca00640 1 --2- 172.21.15.161:0/3981896618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41601539a0 0x7f41600ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:06.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.124+0000 7f415ca00640 1 -- 172.21.15.161:0/3981896618 >> v2:172.21.15.190:3300/0 conn(0x7f416015d3f0 msgr2=0x7f416015d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:06.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.124+0000 7f415ca00640 1 --2- 172.21.15.161:0/3981896618 >> v2:172.21.15.190:3300/0 conn(0x7f416015d3f0 0x7f416015d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:06.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.124+0000 7f415ca00640 1 -- 172.21.15.161:0/3981896618 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416015dd60 con 0x7f41600c79c0 2024-01-17T22:59:06.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.124+0000 7f415ca00640 1 -- 172.21.15.161:0/3981896618 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f4148001680 con 0x7f41600c79c0 2024-01-17T22:59:06.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.124+0000 7f415ca00640 1 -- 172.21.15.161:0/3981896618 >> v1:172.21.15.161:6789/0 conn(0x7f41600c79c0 legacy=0x7f4160061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:06.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.124+0000 7f415ca00640 1 --2- 172.21.15.161:0/3981896618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41601539a0 0x7f4140003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:06.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.124+0000 7f415ca00640 1 --2- 172.21.15.161:0/3981896618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4140003f50 0x7f41400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:06.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.124+0000 7f415ca00640 1 --2- 172.21.15.161:0/3981896618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4140004d10 0x7f4140005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:06.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.124+0000 7f415ca00640 1 -- 172.21.15.161:0/3981896618 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4160159bf0 con 0x7f4140004d10 2024-01-17T22:59:06.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.124+0000 7f415ca00640 1 -- 172.21.15.161:0/3981896618 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414000b990 con 0x7f4140003f50 2024-01-17T22:59:06.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.124+0000 7f415ca00640 1 -- 172.21.15.161:0/3981896618 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414000bad0 con 0x7f41601539a0 2024-01-17T22:59:06.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.128+0000 7f415e800640 1 --2- 172.21.15.161:0/3981896618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4140004d10 0x7f4140005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:06.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.132+0000 7f415e800640 1 -- 172.21.15.161:0/3981896618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41601539a0 msgr2=0x7f4140003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:06.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.132+0000 7f415e800640 1 --2- 172.21.15.161:0/3981896618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41601539a0 0x7f4140003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:06.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.132+0000 7f415e800640 1 -- 172.21.15.161:0/3981896618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4140003f50 msgr2=0x7f41400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:06.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.132+0000 7f415e800640 1 --2- 172.21.15.161:0/3981896618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4140003f50 0x7f41400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:06.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.132+0000 7f415e800640 1 -- 172.21.15.161:0/3981896618 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4140003530 con 0x7f4140004d10 2024-01-17T22:59:06.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.136+0000 7f415e800640 1 --2- 172.21.15.161:0/3981896618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4140004d10 0x7f4140005190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f415800e170 tx=0x7f415801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b746eda84633f11 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:06.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.140+0000 7f415ca00640 1 -- 172.21.15.161:0/3981896618 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41580a5c90 con 0x7f4140004d10 2024-01-17T22:59:06.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.140+0000 7f415ca00640 1 -- 172.21.15.161:0/3981896618 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415800f040 con 0x7f4140004d10 2024-01-17T22:59:06.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.140+0000 7f415ca00640 1 -- 172.21.15.161:0/3981896618 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41580ad680 con 0x7f4140004d10 2024-01-17T22:59:06.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.140+0000 7f4165000640 1 -- 172.21.15.161:0/3981896618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4140004d10 msgr2=0x7f4140005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:06.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.140+0000 7f4165000640 1 --2- 172.21.15.161:0/3981896618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4140004d10 0x7f4140005190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f415800e170 tx=0x7f415801cc80 comp rx=0 tx=0).stop 2024-01-17T22:59:06.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.140+0000 7f415e800640 1 -- 172.21.15.161:0/3981896618 reap_dead start 2024-01-17T22:59:06.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.140+0000 7f4165000640 1 -- 172.21.15.161:0/3981896618 shutdown_connections 2024-01-17T22:59:06.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.140+0000 7f4165000640 1 -- 172.21.15.161:0/3981896618 >> 172.21.15.161:0/3981896618 conn(0x7f416006ad40 msgr2=0x7f416006f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:06.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.140+0000 7f4165000640 1 -- 172.21.15.161:0/3981896618 shutdown_connections 2024-01-17T22:59:06.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.140+0000 7f4165000640 1 -- 172.21.15.161:0/3981896618 wait complete. 2024-01-17T22:59:06.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.144+0000 7f4165000640 1 Processor -- start 2024-01-17T22:59:06.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.144+0000 7f4165000640 1 -- start start 2024-01-17T22:59:06.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.144+0000 7f4165000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4140004d10 0x7f4160061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:06.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.144+0000 7f4165000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41600b21c0 0x7f41601f2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:06.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.144+0000 7f4165000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41601f27c0 0x7f41601568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:06.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.144+0000 7f4165000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41601f1e60 con 0x7f4140004d10 2024-01-17T22:59:06.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.144+0000 7f4165000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41601ee670 con 0x7f41600b21c0 2024-01-17T22:59:06.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.144+0000 7f4165000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41600ccf50 con 0x7f41601f27c0 2024-01-17T22:59:06.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.144+0000 7f415de00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4140004d10 0x7f4160061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:06.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.144+0000 7f415de00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4140004d10 0x7f4160061360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39740/0 (socket says 172.21.15.161:39740) 2024-01-17T22:59:06.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.144+0000 7f415de00640 1 -- 172.21.15.161:0/1459310925 learned_addr learned my addr 172.21.15.161:0/1459310925 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:06.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.144+0000 7f415e800640 1 --2- 172.21.15.161:0/1459310925 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41601f27c0 0x7f41601568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:06.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.148+0000 7f415de00640 1 -- 172.21.15.161:0/1459310925 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41601f27c0 msgr2=0x7f41601568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:06.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.148+0000 7f415de00640 1 --2- 172.21.15.161:0/1459310925 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41601f27c0 0x7f41601568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:06.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.148+0000 7f415de00640 1 -- 172.21.15.161:0/1459310925 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41600b21c0 msgr2=0x7f41601f2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:06.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.148+0000 7f415de00640 1 --2- 172.21.15.161:0/1459310925 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41600b21c0 0x7f41601f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:06.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.148+0000 7f415de00640 1 -- 172.21.15.161:0/1459310925 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41600cd230 con 0x7f4140004d10 2024-01-17T22:59:06.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.152+0000 7f415de00640 1 --2- 172.21.15.161:0/1459310925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4140004d10 0x7f4160061360 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f415000e7c0 tx=0x7f415000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:06.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.156+0000 7f4156000640 1 -- 172.21.15.161:0/1459310925 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415000eed0 con 0x7f4140004d10 2024-01-17T22:59:06.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.156+0000 7f4156000640 1 -- 172.21.15.161:0/1459310925 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415000c8c0 con 0x7f4140004d10 2024-01-17T22:59:06.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.156+0000 7f4156000640 1 -- 172.21.15.161:0/1459310925 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415000cc50 con 0x7f4140004d10 2024-01-17T22:59:06.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.156+0000 7f4165000640 1 -- 172.21.15.161:0/1459310925 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41600cd510 con 0x7f4140004d10 2024-01-17T22:59:06.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.156+0000 7f4165000640 1 -- 172.21.15.161:0/1459310925 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41600618a0 con 0x7f4140004d10 2024-01-17T22:59:06.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.156+0000 7f4165000640 1 -- 172.21.15.161:0/1459310925 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f416006b620 con 0x7f4140004d10 2024-01-17T22:59:06.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.176+0000 7f4156000640 1 -- 172.21.15.161:0/1459310925 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f4150013470 con 0x7f4140004d10 2024-01-17T22:59:06.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.176+0000 7f4156000640 1 --2- 172.21.15.161:0/1459310925 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f41380668c0 0x7f4138068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:06.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.176+0000 7f415d400640 1 --2- 172.21.15.161:0/1459310925 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f41380668c0 0x7f4138068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:06.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.176+0000 7f415d400640 1 --2- 172.21.15.161:0/1459310925 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f41380668c0 0x7f4138068d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4148001ec0 tx=0x7f41480015d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:06.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.180+0000 7f4156000640 1 -- 172.21.15.161:0/1459310925 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4150055820 con 0x7f4140004d10 2024-01-17T22:59:06.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.408+0000 7f4156000640 1 -- 172.21.15.161:0/1459310925 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f4150051b60 con 0x7f4140004d10 2024-01-17T22:59:06.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.560+0000 7f4165000640 1 -- 172.21.15.161:0/1459310925 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41601f1be0 con 0x7f4140004d10 2024-01-17T22:59:06.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.600+0000 7f4156000640 1 -- 172.21.15.161:0/1459310925 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18399 (secure 0 0 0) 0x7f4150021020 con 0x7f4140004d10 2024-01-17T22:59:06.598 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:06.599 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":26,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:58:56.639614+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T22:58:46.757110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T22:58:47.930512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T22:58:53.561624+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.614036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.746767+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.689096+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.706485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.628004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.680048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.571249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:59:06.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.604+0000 7f4165000640 1 -- 172.21.15.161:0/1459310925 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f41380668c0 msgr2=0x7f4138068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:06.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.604+0000 7f4165000640 1 --2- 172.21.15.161:0/1459310925 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f41380668c0 0x7f4138068d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4148001ec0 tx=0x7f41480015d0 comp rx=0 tx=0).stop 2024-01-17T22:59:06.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.604+0000 7f4165000640 1 -- 172.21.15.161:0/1459310925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4140004d10 msgr2=0x7f4160061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:06.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.604+0000 7f4165000640 1 --2- 172.21.15.161:0/1459310925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4140004d10 0x7f4160061360 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f415000e7c0 tx=0x7f415000ec80 comp rx=0 tx=0).stop 2024-01-17T22:59:06.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.604+0000 7f4165000640 1 -- 172.21.15.161:0/1459310925 shutdown_connections 2024-01-17T22:59:06.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.604+0000 7f4165000640 1 --2- 172.21.15.161:0/1459310925 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f41380668c0 0x7f4138068d80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:06.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.604+0000 7f4165000640 1 --2- 172.21.15.161:0/1459310925 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41600b21c0 0x7f41601f2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:06.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.604+0000 7f4165000640 1 --2- 172.21.15.161:0/1459310925 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41601f27c0 0x7f41601568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:06.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.604+0000 7f4165000640 1 --2- 172.21.15.161:0/1459310925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4140004d10 0x7f4160061360 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:06.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.604+0000 7f4165000640 1 -- 172.21.15.161:0/1459310925 >> 172.21.15.161:0/1459310925 conn(0x7f416006ad40 msgr2=0x7f416015b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:06.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.604+0000 7f4165000640 1 -- 172.21.15.161:0/1459310925 shutdown_connections 2024-01-17T22:59:06.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.604+0000 7f4165000640 1 -- 172.21.15.161:0/1459310925 wait complete. 2024-01-17T22:59:06.621 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-17T22:58:14.876386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-17T22:58:46.757110+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-17T22:58:47.930512+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-17T22:58:53.561624+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-17T22:59:06.621 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-17T22:59:06.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.764+0000 7fcfbfa00640 1 Processor -- start 2024-01-17T22:59:06.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.764+0000 7fcfbfa00640 1 -- start start 2024-01-17T22:59:06.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.764+0000 7fcfbfa00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcfb8151760 0x7fcfb80c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:06.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.764+0000 7fcfbfa00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb81579d0 0x7fcfb8157e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:06.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.764+0000 7fcfbfa00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb8157540 con 0x7fcfb80ca410 2024-01-17T22:59:06.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.764+0000 7fcfbfa00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb81583a0 con 0x7fcfb8151760 2024-01-17T22:59:06.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.764+0000 7fcfbfa00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8151b40 con 0x7fcfb81579d0 2024-01-17T22:59:06.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.764+0000 7fcfb7e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fcfb80ca410 0x7fcfb8070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:48404/0 (socket says 172.21.15.161:48404) 2024-01-17T22:59:06.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.764+0000 7fcfb7e00640 1 -- 172.21.15.161:0/734382568 learned_addr learned my addr 172.21.15.161:0/734382568 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:06.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.764+0000 7fcfbd000640 1 --2- 172.21.15.161:0/734382568 >> v2:172.21.15.161:3300/0 conn(0x7fcfb8151760 0x7fcfb80c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:06.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.768+0000 7fcfbda00640 1 --2- 172.21.15.161:0/734382568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb81579d0 0x7fcfb8157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:06.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.768+0000 7fcfbd000640 1 -- 172.21.15.161:0/734382568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb81579d0 msgr2=0x7fcfb8157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:06.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.768+0000 7fcfbd000640 1 --2- 172.21.15.161:0/734382568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb81579d0 0x7fcfb8157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:06.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.768+0000 7fcfbd000640 1 -- 172.21.15.161:0/734382568 >> v1:172.21.15.161:6789/0 conn(0x7fcfb80ca410 legacy=0x7fcfb8070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:06.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.768+0000 7fcfbd000640 1 -- 172.21.15.161:0/734382568 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb815aa30 con 0x7fcfb8151760 2024-01-17T22:59:06.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.776+0000 7fcfbd000640 1 --2- 172.21.15.161:0/734382568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb8151760 0x7fcfb80c2a60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcfb815ac20 tx=0x7fcfa801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e207ebb963ed8876 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:06.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.780+0000 7fcfb7400640 1 -- 172.21.15.161:0/734382568 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80a8970 con 0x7fcfb8151760 2024-01-17T22:59:06.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.780+0000 7fcfb7400640 1 -- 172.21.15.161:0/734382568 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa80a8ad0 con 0x7fcfb8151760 2024-01-17T22:59:06.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.780+0000 7fcfb7400640 1 -- 172.21.15.161:0/734382568 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80a8e60 con 0x7fcfb8151760 2024-01-17T22:59:06.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.780+0000 7fcfbfa00640 1 -- 172.21.15.161:0/734382568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb8151760 msgr2=0x7fcfb80c2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:06.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.780+0000 7fcfbfa00640 1 --2- 172.21.15.161:0/734382568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb8151760 0x7fcfb80c2a60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcfb815ac20 tx=0x7fcfa801ec70 comp rx=0 tx=0).stop 2024-01-17T22:59:06.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.780+0000 7fcfbfa00640 1 -- 172.21.15.161:0/734382568 shutdown_connections 2024-01-17T22:59:06.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.780+0000 7fcfbfa00640 1 --2- 172.21.15.161:0/734382568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb81579d0 0x7fcfb8157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:06.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.780+0000 7fcfbfa00640 1 --2- 172.21.15.161:0/734382568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb8151760 0x7fcfb80c2a60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:06.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.780+0000 7fcfbfa00640 1 -- 172.21.15.161:0/734382568 >> 172.21.15.161:0/734382568 conn(0x7fcfb8070390 msgr2=0x7fcfb806f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:06.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.780+0000 7fcfbfa00640 1 -- 172.21.15.161:0/734382568 shutdown_connections 2024-01-17T22:59:06.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.780+0000 7fcfbfa00640 1 -- 172.21.15.161:0/734382568 wait complete. 2024-01-17T22:59:06.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.780+0000 7fcfbfa00640 1 Processor -- start 2024-01-17T22:59:06.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.780+0000 7fcfbfa00640 1 -- start start 2024-01-17T22:59:06.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.784+0000 7fcfbfa00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb80ca410 0x7fcfb81ebc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:06.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.784+0000 7fcfbfa00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfb8151760 0x7fcfb8158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:06.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.784+0000 7fcfbfa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb81579d0 0x7fcfb8070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:06.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.784+0000 7fcfbfa00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8159a50 con 0x7fcfb81579d0 2024-01-17T22:59:06.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.784+0000 7fcfbfa00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80b2150 con 0x7fcfb8151760 2024-01-17T22:59:06.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.784+0000 7fcfbfa00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8159c40 con 0x7fcfb80ca410 2024-01-17T22:59:06.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.784+0000 7fcfbda00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb81579d0 0x7fcfb8070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:06.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.784+0000 7fcfbda00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb81579d0 0x7fcfb8070f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39758/0 (socket says 172.21.15.161:39758) 2024-01-17T22:59:06.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.784+0000 7fcfbda00640 1 -- 172.21.15.161:0/2951553004 learned_addr learned my addr 172.21.15.161:0/2951553004 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:06.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.784+0000 7fcfbd000640 1 --2- 172.21.15.161:0/2951553004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb80ca410 0x7fcfb81ebc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:06.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.784+0000 7fcfb7e00640 1 --2- 172.21.15.161:0/2951553004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfb8151760 0x7fcfb8158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:06.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.788+0000 7fcfbda00640 1 -- 172.21.15.161:0/2951553004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb80ca410 msgr2=0x7fcfb81ebc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:06.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.788+0000 7fcfbda00640 1 --2- 172.21.15.161:0/2951553004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb80ca410 0x7fcfb81ebc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:06.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.788+0000 7fcfbda00640 1 -- 172.21.15.161:0/2951553004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfb8151760 msgr2=0x7fcfb8158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:06.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.788+0000 7fcfbda00640 1 --2- 172.21.15.161:0/2951553004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfb8151760 0x7fcfb8158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:06.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.788+0000 7fcfbda00640 1 -- 172.21.15.161:0/2951553004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa8009420 con 0x7fcfb81579d0 2024-01-17T22:59:06.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.788+0000 7fcfbda00640 1 --2- 172.21.15.161:0/2951553004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb81579d0 0x7fcfb8070f80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000efc0 tx=0x7fcfb000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:06.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.792+0000 7fcfb4c00640 1 -- 172.21.15.161:0/2951553004 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0009ba0 con 0x7fcfb81579d0 2024-01-17T22:59:06.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.792+0000 7fcfb4c00640 1 -- 172.21.15.161:0/2951553004 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb000f040 con 0x7fcfb81579d0 2024-01-17T22:59:06.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.792+0000 7fcfb4c00640 1 -- 172.21.15.161:0/2951553004 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb00146c0 con 0x7fcfb81579d0 2024-01-17T22:59:06.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.792+0000 7fcfbfa00640 1 -- 172.21.15.161:0/2951553004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb8159f20 con 0x7fcfb81579d0 2024-01-17T22:59:06.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.792+0000 7fcfbfa00640 1 -- 172.21.15.161:0/2951553004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb81eb440 con 0x7fcfb81579d0 2024-01-17T22:59:06.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.792+0000 7fcfbfa00640 1 -- 172.21.15.161:0/2951553004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb80746a0 con 0x7fcfb81579d0 2024-01-17T22:59:06.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.812+0000 7fcfb4c00640 1 -- 172.21.15.161:0/2951553004 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fcfb0014820 con 0x7fcfb81579d0 2024-01-17T22:59:06.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.816+0000 7fcfb4c00640 1 --2- 172.21.15.161:0/2951553004 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fcf90066890 0x7fcf90068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:06.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.816+0000 7fcfbd000640 1 --2- 172.21.15.161:0/2951553004 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fcf90066890 0x7fcf90068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:06.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.816+0000 7fcfbd000640 1 --2- 172.21.15.161:0/2951553004 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fcf90066890 0x7fcf90068d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80b2000 tx=0x7fcfa80aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:06.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:06.816+0000 7fcfb4c00640 1 -- 172.21.15.161:0/2951553004 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcfb0056360 con 0x7fcfb81579d0 2024-01-17T22:59:07.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.048+0000 7fcfb4c00640 1 -- 172.21.15.161:0/2951553004 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fcfb00526a0 con 0x7fcfb81579d0 2024-01-17T22:59:07.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.252+0000 7fcfbfa00640 1 -- 172.21.15.161:0/2951553004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcfb81572d0 con 0x7fcfb81579d0 2024-01-17T22:59:07.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.312+0000 7fcfb4c00640 1 -- 172.21.15.161:0/2951553004 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcfb0018020 con 0x7fcfb81579d0 2024-01-17T22:59:07.309 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-01-17T22:59:07.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.312+0000 7fcfbfa00640 1 -- 172.21.15.161:0/2951553004 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fcf90066890 msgr2=0x7fcf90068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:07.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.312+0000 7fcfbfa00640 1 --2- 172.21.15.161:0/2951553004 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fcf90066890 0x7fcf90068d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80b2000 tx=0x7fcfa80aa070 comp rx=0 tx=0).stop 2024-01-17T22:59:07.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.312+0000 7fcfbfa00640 1 -- 172.21.15.161:0/2951553004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb81579d0 msgr2=0x7fcfb8070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:07.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.312+0000 7fcfbfa00640 1 --2- 172.21.15.161:0/2951553004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb81579d0 0x7fcfb8070f80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000efc0 tx=0x7fcfb000c490 comp rx=0 tx=0).stop 2024-01-17T22:59:07.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.312+0000 7fcfbfa00640 1 -- 172.21.15.161:0/2951553004 shutdown_connections 2024-01-17T22:59:07.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.312+0000 7fcfbfa00640 1 --2- 172.21.15.161:0/2951553004 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fcf90066890 0x7fcf90068d50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:07.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.312+0000 7fcfbfa00640 1 --2- 172.21.15.161:0/2951553004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfb8151760 0x7fcfb8158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:07.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.312+0000 7fcfbfa00640 1 --2- 172.21.15.161:0/2951553004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb81579d0 0x7fcfb8070f80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:07.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.312+0000 7fcfbfa00640 1 --2- 172.21.15.161:0/2951553004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb80ca410 0x7fcfb81ebc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:07.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.312+0000 7fcfbfa00640 1 -- 172.21.15.161:0/2951553004 >> 172.21.15.161:0/2951553004 conn(0x7fcfb8070390 msgr2=0x7fcfb8150a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:07.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.312+0000 7fcfbfa00640 1 -- 172.21.15.161:0/2951553004 shutdown_connections 2024-01-17T22:59:07.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.312+0000 7fcfbfa00640 1 -- 172.21.15.161:0/2951553004 wait complete. 2024-01-17T22:59:07.331 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-17T22:59:07.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.484+0000 7f3e66800640 1 Processor -- start 2024-01-17T22:59:07.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.484+0000 7f3e66800640 1 -- start start 2024-01-17T22:59:07.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.484+0000 7f3e66800640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3e600c2a60 0x7f3e600ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:07.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.484+0000 7f3e66800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e601579d0 0x7f3e60157e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:07.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.484+0000 7f3e66800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e600ca950 con 0x7f3e60151760 2024-01-17T22:59:07.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.484+0000 7f3e66800640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e60157540 con 0x7f3e600c2a60 2024-01-17T22:59:07.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.484+0000 7f3e66800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e601583a0 con 0x7f3e601579d0 2024-01-17T22:59:07.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.536+0000 7f3e5ea00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3e600c2a60 0x7f3e600ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:07.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.536+0000 7f3e5ea00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3e600c2a60 0x7f3e600ca410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:39336/0 (socket says 172.21.15.161:39336) 2024-01-17T22:59:07.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.536+0000 7f3e5ea00640 1 -- 172.21.15.161:0/3841045793 learned_addr learned my addr 172.21.15.161:0/3841045793 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:07.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.540+0000 7f3e5ea00640 1 -- 172.21.15.161:0/3841045793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e601579d0 msgr2=0x7f3e60157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:07.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.540+0000 7f3e5ea00640 1 --2- 172.21.15.161:0/3841045793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e601579d0 0x7f3e60157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:07.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.540+0000 7f3e5ea00640 1 -- 172.21.15.161:0/3841045793 >> v1:172.21.15.190:6789/0 conn(0x7f3e60151760 legacy=0x7f3e60070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:07.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.540+0000 7f3e5ea00640 1 -- 172.21.15.161:0/3841045793 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e600c2eb0 con 0x7f3e600c2a60 2024-01-17T22:59:07.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.552+0000 7f3e5ea00640 1 --2- 172.21.15.161:0/3841045793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e600c2a60 0x7f3e600ca410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3e60070b90 tx=0x7f3e4801ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74737b6f418d7c6d server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:07.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.564+0000 7f3e5e000640 1 -- 172.21.15.161:0/3841045793 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e480a8990 con 0x7f3e600c2a60 2024-01-17T22:59:07.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.564+0000 7f3e5e000640 1 -- 172.21.15.161:0/3841045793 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e480a8af0 con 0x7f3e600c2a60 2024-01-17T22:59:07.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.564+0000 7f3e5e000640 1 -- 172.21.15.161:0/3841045793 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e480a8e80 con 0x7f3e600c2a60 2024-01-17T22:59:07.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.564+0000 7f3e66800640 1 -- 172.21.15.161:0/3841045793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e600c2a60 msgr2=0x7f3e600ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:07.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.564+0000 7f3e66800640 1 --2- 172.21.15.161:0/3841045793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e600c2a60 0x7f3e600ca410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3e60070b90 tx=0x7f3e4801ecd0 comp rx=0 tx=0).stop 2024-01-17T22:59:07.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.564+0000 7f3e66800640 1 -- 172.21.15.161:0/3841045793 shutdown_connections 2024-01-17T22:59:07.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.564+0000 7f3e66800640 1 --2- 172.21.15.161:0/3841045793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e601579d0 0x7f3e60157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:07.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.564+0000 7f3e66800640 1 --2- 172.21.15.161:0/3841045793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e600c2a60 0x7f3e600ca410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:07.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.564+0000 7f3e66800640 1 -- 172.21.15.161:0/3841045793 >> 172.21.15.161:0/3841045793 conn(0x7f3e60070390 msgr2=0x7f3e6006f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:07.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.564+0000 7f3e66800640 1 -- 172.21.15.161:0/3841045793 shutdown_connections 2024-01-17T22:59:07.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.564+0000 7f3e66800640 1 -- 172.21.15.161:0/3841045793 wait complete. 2024-01-17T22:59:07.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.568+0000 7f3e66800640 1 Processor -- start 2024-01-17T22:59:07.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.568+0000 7f3e66800640 1 -- start start 2024-01-17T22:59:07.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.568+0000 7f3e66800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e600c2a60 0x7f3e601f1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:07.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.568+0000 7f3e66800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e60151760 0x7f3e601e1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:07.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.568+0000 7f3e66800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e601579d0 0x7f3e600cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:07.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.568+0000 7f3e66800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e601eda30 con 0x7f3e601579d0 2024-01-17T22:59:07.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.568+0000 7f3e66800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e600b0a30 con 0x7f3e600c2a60 2024-01-17T22:59:07.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.568+0000 7f3e66800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e601ed420 con 0x7f3e60151760 2024-01-17T22:59:07.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.568+0000 7f3e5fe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e601579d0 0x7f3e600cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:07.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.568+0000 7f3e5fe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e601579d0 0x7f3e600cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39770/0 (socket says 172.21.15.161:39770) 2024-01-17T22:59:07.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.568+0000 7f3e5fe00640 1 -- 172.21.15.161:0/106955812 learned_addr learned my addr 172.21.15.161:0/106955812 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:07.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.568+0000 7f3e5ea00640 1 --2- 172.21.15.161:0/106955812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e60151760 0x7f3e601e1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:07.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.568+0000 7f3e5f400640 1 --2- 172.21.15.161:0/106955812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e600c2a60 0x7f3e601f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:07.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.572+0000 7f3e5fe00640 1 -- 172.21.15.161:0/106955812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e60151760 msgr2=0x7f3e601e1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:07.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.572+0000 7f3e5fe00640 1 --2- 172.21.15.161:0/106955812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e60151760 0x7f3e601e1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:07.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.572+0000 7f3e5fe00640 1 -- 172.21.15.161:0/106955812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e600c2a60 msgr2=0x7f3e601f1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:07.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.572+0000 7f3e5fe00640 1 --2- 172.21.15.161:0/106955812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e600c2a60 0x7f3e601f1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:07.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.572+0000 7f3e5fe00640 1 -- 172.21.15.161:0/106955812 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e480094d0 con 0x7f3e601579d0 2024-01-17T22:59:07.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.576+0000 7f3e5fe00640 1 --2- 172.21.15.161:0/106955812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e601579d0 0x7f3e600cd500 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800b970 tx=0x7f3e5800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:07.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.580+0000 7f3e57400640 1 -- 172.21.15.161:0/106955812 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5800cb40 con 0x7f3e601579d0 2024-01-17T22:59:07.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.580+0000 7f3e57400640 1 -- 172.21.15.161:0/106955812 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5800ccc0 con 0x7f3e601579d0 2024-01-17T22:59:07.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.580+0000 7f3e57400640 1 -- 172.21.15.161:0/106955812 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e58014680 con 0x7f3e601579d0 2024-01-17T22:59:07.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.580+0000 7f3e66800640 1 -- 172.21.15.161:0/106955812 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e600b0470 con 0x7f3e601579d0 2024-01-17T22:59:07.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.580+0000 7f3e66800640 1 -- 172.21.15.161:0/106955812 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e601ed6c0 con 0x7f3e601579d0 2024-01-17T22:59:07.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.580+0000 7f3e66800640 1 -- 172.21.15.161:0/106955812 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e601ed280 con 0x7f3e601579d0 2024-01-17T22:59:07.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.600+0000 7f3e57400640 1 -- 172.21.15.161:0/106955812 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f3e5801d3b0 con 0x7f3e601579d0 2024-01-17T22:59:07.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.600+0000 7f3e57400640 1 --2- 172.21.15.161:0/106955812 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3e380668c0 0x7f3e38068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:07.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.600+0000 7f3e5f400640 1 --2- 172.21.15.161:0/106955812 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3e380668c0 0x7f3e38068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:07.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.600+0000 7f3e5f400640 1 --2- 172.21.15.161:0/106955812 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3e380668c0 0x7f3e38068d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3e50007fd0 tx=0x7f3e50009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:07.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.836+0000 7f3e57400640 1 -- 172.21.15.161:0/106955812 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f3e5800ce30 con 0x7f3e601579d0 2024-01-17T22:59:07.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.836+0000 7f3e57400640 1 -- 172.21.15.161:0/106955812 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f3e580515c0 con 0x7f3e601579d0 2024-01-17T22:59:07.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.988+0000 7f3e66800640 1 -- 172.21.15.161:0/106955812 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e601ed280 con 0x7f3e601579d0 2024-01-17T22:59:07.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.996+0000 7f3e57400640 1 -- 172.21.15.161:0/106955812 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3e601ed280 con 0x7f3e601579d0 2024-01-17T22:59:07.993 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-01-17T22:59:07.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.996+0000 7f3e66800640 1 -- 172.21.15.161:0/106955812 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3e380668c0 msgr2=0x7f3e38068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:07.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.996+0000 7f3e66800640 1 --2- 172.21.15.161:0/106955812 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3e380668c0 0x7f3e38068d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3e50007fd0 tx=0x7f3e50009040 comp rx=0 tx=0).stop 2024-01-17T22:59:07.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.996+0000 7f3e66800640 1 -- 172.21.15.161:0/106955812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e601579d0 msgr2=0x7f3e600cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:07.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.996+0000 7f3e66800640 1 --2- 172.21.15.161:0/106955812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e601579d0 0x7f3e600cd500 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800b970 tx=0x7f3e5800be30 comp rx=0 tx=0).stop 2024-01-17T22:59:07.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.996+0000 7f3e66800640 1 -- 172.21.15.161:0/106955812 shutdown_connections 2024-01-17T22:59:07.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.996+0000 7f3e66800640 1 --2- 172.21.15.161:0/106955812 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3e380668c0 0x7f3e38068d80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:07.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.996+0000 7f3e66800640 1 --2- 172.21.15.161:0/106955812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e601579d0 0x7f3e600cd500 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:07.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.996+0000 7f3e66800640 1 --2- 172.21.15.161:0/106955812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e60151760 0x7f3e601e1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:07.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.996+0000 7f3e66800640 1 --2- 172.21.15.161:0/106955812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e600c2a60 0x7f3e601f1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:07.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.996+0000 7f3e66800640 1 -- 172.21.15.161:0/106955812 >> 172.21.15.161:0/106955812 conn(0x7f3e60070390 msgr2=0x7f3e6014a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:07.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.996+0000 7f3e66800640 1 -- 172.21.15.161:0/106955812 shutdown_connections 2024-01-17T22:59:07.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:07.996+0000 7f3e66800640 1 -- 172.21.15.161:0/106955812 wait complete. 2024-01-17T22:59:08.017 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-17T22:59:08.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.164+0000 7f1fa1800640 1 Processor -- start 2024-01-17T22:59:08.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.164+0000 7f1fa1800640 1 -- start start 2024-01-17T22:59:08.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.164+0000 7f1fa1800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f9c0c2ee0 0x7f1f9c165000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:08.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.164+0000 7f1fa1800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9c0c22f0 con 0x7f1f9c0af460 2024-01-17T22:59:08.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.164+0000 7f1fa1800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9c159750 con 0x7f1f9c06c8b0 2024-01-17T22:59:08.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.164+0000 7f1fa1800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c159a10 con 0x7f1f9c0c2ee0 2024-01-17T22:59:08.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.184+0000 7f1f9be00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f9c0c2ee0 0x7f1f9c165000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:08.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.184+0000 7f1f9be00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f9c0c2ee0 0x7f1f9c165000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:51654/0 (socket says 172.21.15.161:51654) 2024-01-17T22:59:08.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.184+0000 7f1f9be00640 1 -- 172.21.15.161:0/4233278861 learned_addr learned my addr 172.21.15.161:0/4233278861 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:08.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.184+0000 7f1f9a000640 1 --1- 172.21.15.161:0/4233278861 >> v1:172.21.15.190:6789/0 conn(0x7f1f9c06c8b0 0x7f1f9c0c27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.161:57448/0 (socket says 172.21.15.161:57448) 2024-01-17T22:59:08.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.192+0000 7f1f9be00640 1 -- 172.21.15.161:0/4233278861 >> v1:172.21.15.190:6789/0 conn(0x7f1f9c06c8b0 legacy=0x7f1f9c0c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:08.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.192+0000 7f1f9be00640 1 -- 172.21.15.161:0/4233278861 >> v1:172.21.15.161:6789/0 conn(0x7f1f9c0af460 legacy=0x7f1f9c0c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:08.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.192+0000 7f1f9be00640 1 -- 172.21.15.161:0/4233278861 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9c159cf0 con 0x7f1f9c0c2ee0 2024-01-17T22:59:08.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.200+0000 7f1f9be00640 1 --2- 172.21.15.161:0/4233278861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f9c0c2ee0 0x7f1f9c165000 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009e80 tx=0x7f1f9401f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7097f8ea50889d0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:08.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.304+0000 7f1f99600640 1 -- 172.21.15.161:0/4233278861 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940af400 con 0x7f1f9c0c2ee0 2024-01-17T22:59:08.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.304+0000 7f1f99600640 1 -- 172.21.15.161:0/4233278861 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f940ab050 con 0x7f1f9c0c2ee0 2024-01-17T22:59:08.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.304+0000 7f1f99600640 1 -- 172.21.15.161:0/4233278861 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940af780 con 0x7f1f9c0c2ee0 2024-01-17T22:59:08.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.304+0000 7f1fa1800640 1 -- 172.21.15.161:0/4233278861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f9c0c2ee0 msgr2=0x7f1f9c165000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:08.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.304+0000 7f1fa1800640 1 --2- 172.21.15.161:0/4233278861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f9c0c2ee0 0x7f1f9c165000 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009e80 tx=0x7f1f9401f1e0 comp rx=0 tx=0).stop 2024-01-17T22:59:08.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.304+0000 7f1fa1800640 1 -- 172.21.15.161:0/4233278861 shutdown_connections 2024-01-17T22:59:08.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.304+0000 7f1fa1800640 1 --2- 172.21.15.161:0/4233278861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f9c0c2ee0 0x7f1f9c165000 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:08.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.304+0000 7f1fa1800640 1 -- 172.21.15.161:0/4233278861 >> 172.21.15.161:0/4233278861 conn(0x7f1f9c070580 msgr2=0x7f1f9c070990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:08.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.304+0000 7f1fa1800640 1 -- 172.21.15.161:0/4233278861 shutdown_connections 2024-01-17T22:59:08.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.304+0000 7f1fa1800640 1 -- 172.21.15.161:0/4233278861 wait complete. 2024-01-17T22:59:08.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.304+0000 7f1fa1800640 1 Processor -- start 2024-01-17T22:59:08.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.308+0000 7f1fa1800640 1 -- start start 2024-01-17T22:59:08.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.308+0000 7f1fa1800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f9c06c8b0 0x7f1f9c151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:08.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.308+0000 7f1fa1800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f9c0af460 0x7f1f9c151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:08.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.308+0000 7f1fa1800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f9c0c2ee0 0x7f1f9c155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:08.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.308+0000 7f1fa1800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c152430 con 0x7f1f9c0c2ee0 2024-01-17T22:59:08.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.308+0000 7f1fa1800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c0c82c0 con 0x7f1f9c06c8b0 2024-01-17T22:59:08.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.308+0000 7f1fa1800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c1ef040 con 0x7f1f9c0af460 2024-01-17T22:59:08.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.308+0000 7f1f9aa00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f9c06c8b0 0x7f1f9c151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:08.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.308+0000 7f1f9aa00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f9c06c8b0 0x7f1f9c151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:39340/0 (socket says 172.21.15.161:39340) 2024-01-17T22:59:08.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.308+0000 7f1f9aa00640 1 -- 172.21.15.161:0/3473862161 learned_addr learned my addr 172.21.15.161:0/3473862161 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:08.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.312+0000 7f1f9a000640 1 --2- 172.21.15.161:0/3473862161 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f9c0af460 0x7f1f9c151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:08.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.316+0000 7f1f9be00640 1 --2- 172.21.15.161:0/3473862161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f9c0c2ee0 0x7f1f9c155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:08.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.320+0000 7f1f9be00640 1 -- 172.21.15.161:0/3473862161 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f9c0af460 msgr2=0x7f1f9c151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:08.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.320+0000 7f1f9be00640 1 --2- 172.21.15.161:0/3473862161 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f9c0af460 0x7f1f9c151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:08.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.320+0000 7f1f9be00640 1 -- 172.21.15.161:0/3473862161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f9c06c8b0 msgr2=0x7f1f9c151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:08.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.320+0000 7f1f9be00640 1 --2- 172.21.15.161:0/3473862161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f9c06c8b0 0x7f1f9c151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:08.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.320+0000 7f1f9be00640 1 -- 172.21.15.161:0/3473862161 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f94009b30 con 0x7f1f9c0c2ee0 2024-01-17T22:59:08.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.320+0000 7f1f9be00640 1 --2- 172.21.15.161:0/3473862161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f9c0c2ee0 0x7f1f9c155f50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1f940ae000 tx=0x7f1f9401bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:08.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.324+0000 7f1f92a00640 1 -- 172.21.15.161:0/3473862161 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940c1070 con 0x7f1f9c0c2ee0 2024-01-17T22:59:08.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.324+0000 7f1f92a00640 1 -- 172.21.15.161:0/3473862161 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f940afb00 con 0x7f1f9c0c2ee0 2024-01-17T22:59:08.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.324+0000 7f1f92a00640 1 -- 172.21.15.161:0/3473862161 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940b9410 con 0x7f1f9c0c2ee0 2024-01-17T22:59:08.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.324+0000 7f1fa1800640 1 -- 172.21.15.161:0/3473862161 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f9c0c8560 con 0x7f1f9c0c2ee0 2024-01-17T22:59:08.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.324+0000 7f1fa1800640 1 -- 172.21.15.161:0/3473862161 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9c1ef5e0 con 0x7f1f9c0c2ee0 2024-01-17T22:59:08.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.324+0000 7f1fa1800640 1 -- 172.21.15.161:0/3473862161 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9c0746a0 con 0x7f1f9c0c2ee0 2024-01-17T22:59:08.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.348+0000 7f1f92a00640 1 -- 172.21.15.161:0/3473862161 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f1f940b6050 con 0x7f1f9c0c2ee0 2024-01-17T22:59:08.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.348+0000 7f1f92a00640 1 --2- 172.21.15.161:0/3473862161 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f1f74066890 0x7f1f74068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:08.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.348+0000 7f1f9aa00640 1 --2- 172.21.15.161:0/3473862161 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f1f74066890 0x7f1f74068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:08.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.348+0000 7f1f9aa00640 1 --2- 172.21.15.161:0/3473862161 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f1f74066890 0x7f1f74068d50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c001960 tx=0x7f1f8c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:08.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.352+0000 7f1f92a00640 1 -- 172.21.15.161:0/3473862161 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f1f940f3990 con 0x7f1f9c0c2ee0 2024-01-17T22:59:08.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.584+0000 7f1f92a00640 1 -- 172.21.15.161:0/3473862161 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f1f940efcd0 con 0x7f1f9c0c2ee0 2024-01-17T22:59:08.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.764+0000 7f1fa1800640 1 -- 172.21.15.161:0/3473862161 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1f9c0cc150 con 0x7f1f9c0c2ee0 2024-01-17T22:59:08.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.772+0000 7f1f92a00640 1 -- 172.21.15.161:0/3473862161 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1f940b4020 con 0x7f1f9c0c2ee0 2024-01-17T22:59:08.769 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2024-01-17T22:59:08.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.772+0000 7f1fa1800640 1 -- 172.21.15.161:0/3473862161 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f1f74066890 msgr2=0x7f1f74068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:08.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.772+0000 7f1fa1800640 1 --2- 172.21.15.161:0/3473862161 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f1f74066890 0x7f1f74068d50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c001960 tx=0x7f1f8c009040 comp rx=0 tx=0).stop 2024-01-17T22:59:08.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.772+0000 7f1fa1800640 1 -- 172.21.15.161:0/3473862161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f9c0c2ee0 msgr2=0x7f1f9c155f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:08.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.772+0000 7f1fa1800640 1 --2- 172.21.15.161:0/3473862161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f9c0c2ee0 0x7f1f9c155f50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1f940ae000 tx=0x7f1f9401bf80 comp rx=0 tx=0).stop 2024-01-17T22:59:08.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.772+0000 7f1fa1800640 1 -- 172.21.15.161:0/3473862161 shutdown_connections 2024-01-17T22:59:08.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.772+0000 7f1fa1800640 1 --2- 172.21.15.161:0/3473862161 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f1f74066890 0x7f1f74068d50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:08.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.772+0000 7f1fa1800640 1 --2- 172.21.15.161:0/3473862161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f9c0c2ee0 0x7f1f9c155f50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:08.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.772+0000 7f1fa1800640 1 --2- 172.21.15.161:0/3473862161 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1f9c0af460 0x7f1f9c151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:08.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.772+0000 7f1fa1800640 1 --2- 172.21.15.161:0/3473862161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f9c06c8b0 0x7f1f9c151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:08.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.772+0000 7f1fa1800640 1 -- 172.21.15.161:0/3473862161 >> 172.21.15.161:0/3473862161 conn(0x7f1f9c070580 msgr2=0x7f1f9c157800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:08.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.772+0000 7f1fa1800640 1 -- 172.21.15.161:0/3473862161 shutdown_connections 2024-01-17T22:59:08.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.772+0000 7f1fa1800640 1 -- 172.21.15.161:0/3473862161 wait complete. 2024-01-17T22:59:08.791 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-17T22:59:08.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.932+0000 7f2267800640 1 Processor -- start 2024-01-17T22:59:08.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.932+0000 7f2267800640 1 -- start start 2024-01-17T22:59:08.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.932+0000 7f2267800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22601506b0 0x7f22600c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:08.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.932+0000 7f2267800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22600bffb0 con 0x7f22600c0c60 2024-01-17T22:59:08.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.932+0000 7f2267800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22600b1130 con 0x7f2260156300 2024-01-17T22:59:08.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.932+0000 7f2267800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2260150a90 con 0x7f22601506b0 2024-01-17T22:59:08.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.936+0000 7f2265800640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f22600c0c60 0x7f22600c5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:48422/0 (socket says 172.21.15.161:48422) 2024-01-17T22:59:08.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.936+0000 7f2265800640 1 -- 172.21.15.161:0/3145128546 learned_addr learned my addr 172.21.15.161:0/3145128546 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:08.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.936+0000 7f2264e00640 1 --2- 172.21.15.161:0/3145128546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22601506b0 0x7f22600c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:08.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.936+0000 7f225f400640 1 -- 172.21.15.161:0/3145128546 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761622406 0 0) 0x7f22600bffb0 con 0x7f22600c0c60 2024-01-17T22:59:08.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.936+0000 7f225f400640 1 -- 172.21.15.161:0/3145128546 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2240005740 con 0x7f22600c0c60 2024-01-17T22:59:08.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.940+0000 7f225f400640 1 -- 172.21.15.161:0/3145128546 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2734696769 0 0) 0x7f2240005740 con 0x7f22600c0c60 2024-01-17T22:59:08.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.940+0000 7f225f400640 1 -- 172.21.15.161:0/3145128546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22601506b0 msgr2=0x7f22600c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:08.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.940+0000 7f225f400640 1 --2- 172.21.15.161:0/3145128546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22601506b0 0x7f22600c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:08.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.940+0000 7f225f400640 1 -- 172.21.15.161:0/3145128546 >> v1:172.21.15.190:6789/0 conn(0x7f2260156300 legacy=0x7f226006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:08.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.940+0000 7f225f400640 1 -- 172.21.15.161:0/3145128546 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22601567b0 con 0x7f22600c0c60 2024-01-17T22:59:08.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.940+0000 7f225f400640 1 -- 172.21.15.161:0/3145128546 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f2258001a00 con 0x7f22600c0c60 2024-01-17T22:59:08.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.940+0000 7f225f400640 1 -- 172.21.15.161:0/3145128546 >> v1:172.21.15.161:6789/0 conn(0x7f22600c0c60 legacy=0x7f22600c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:08.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.940+0000 7f225f400640 1 --2- 172.21.15.161:0/3145128546 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2240005bc0 0x7f2240005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:08.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.940+0000 7f225f400640 1 --2- 172.21.15.161:0/3145128546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22601506b0 0x7f22400069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:08.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.940+0000 7f225f400640 1 --2- 172.21.15.161:0/3145128546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2240006f20 0x7f22400073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:08.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.940+0000 7f225f400640 1 -- 172.21.15.161:0/3145128546 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2260150a90 con 0x7f2240006f20 2024-01-17T22:59:08.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.940+0000 7f225f400640 1 -- 172.21.15.161:0/3145128546 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224000dc80 con 0x7f2240005bc0 2024-01-17T22:59:08.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.940+0000 7f225f400640 1 -- 172.21.15.161:0/3145128546 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224000de40 con 0x7f22601506b0 2024-01-17T22:59:08.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.944+0000 7f2265800640 1 --2- 172.21.15.161:0/3145128546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2240006f20 0x7f22400073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:08.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.944+0000 7f2264e00640 1 --2- 172.21.15.161:0/3145128546 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2240005bc0 0x7f2240005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:08.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.948+0000 7f2265800640 1 -- 172.21.15.161:0/3145128546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22601506b0 msgr2=0x7f22400069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:08.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.948+0000 7f2265800640 1 --2- 172.21.15.161:0/3145128546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22601506b0 0x7f22400069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:08.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.948+0000 7f2265800640 1 -- 172.21.15.161:0/3145128546 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2240005bc0 msgr2=0x7f2240005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:08.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.948+0000 7f2265800640 1 --2- 172.21.15.161:0/3145128546 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2240005bc0 0x7f2240005fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:08.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.948+0000 7f2265800640 1 -- 172.21.15.161:0/3145128546 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2240005740 con 0x7f2240006f20 2024-01-17T22:59:08.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.952+0000 7f2265800640 1 --2- 172.21.15.161:0/3145128546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2240006f20 0x7f22400073a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2258002240 tx=0x7f225801d240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aaef8637faf76c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:08.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.956+0000 7f225f400640 1 -- 172.21.15.161:0/3145128546 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22580ad630 con 0x7f2240006f20 2024-01-17T22:59:08.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.956+0000 7f225f400640 1 -- 172.21.15.161:0/3145128546 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22580a8070 con 0x7f2240006f20 2024-01-17T22:59:08.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.956+0000 7f225f400640 1 -- 172.21.15.161:0/3145128546 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22580ada90 con 0x7f2240006f20 2024-01-17T22:59:08.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.956+0000 7f2267800640 1 -- 172.21.15.161:0/3145128546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2240006f20 msgr2=0x7f22400073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:08.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.956+0000 7f2267800640 1 --2- 172.21.15.161:0/3145128546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2240006f20 0x7f22400073a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2258002240 tx=0x7f225801d240 comp rx=0 tx=0).stop 2024-01-17T22:59:08.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.956+0000 7f2265800640 1 -- 172.21.15.161:0/3145128546 reap_dead start 2024-01-17T22:59:08.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.956+0000 7f2267800640 1 -- 172.21.15.161:0/3145128546 shutdown_connections 2024-01-17T22:59:08.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.956+0000 7f2267800640 1 -- 172.21.15.161:0/3145128546 >> 172.21.15.161:0/3145128546 conn(0x7f22600c7a90 msgr2=0x7f22600c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:08.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.956+0000 7f2267800640 1 -- 172.21.15.161:0/3145128546 shutdown_connections 2024-01-17T22:59:08.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.956+0000 7f2267800640 1 -- 172.21.15.161:0/3145128546 wait complete. 2024-01-17T22:59:08.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.956+0000 7f2267800640 1 Processor -- start 2024-01-17T22:59:08.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.956+0000 7f2267800640 1 -- start start 2024-01-17T22:59:08.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.956+0000 7f2267800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2240006f20 0x7f22601473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:08.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.956+0000 7f2267800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22601428d0 0x7f22601ee8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:08.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.956+0000 7f2267800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22601eee00 0x7f226014de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:08.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.956+0000 7f2267800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22601ef280 con 0x7f22601eee00 2024-01-17T22:59:08.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.956+0000 7f2267800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22601ee430 con 0x7f22601428d0 2024-01-17T22:59:08.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.956+0000 7f2267800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226014f390 con 0x7f2240006f20 2024-01-17T22:59:08.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.960+0000 7f2265800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22601eee00 0x7f226014de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:08.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.960+0000 7f2265800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22601eee00 0x7f226014de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39784/0 (socket says 172.21.15.161:39784) 2024-01-17T22:59:08.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.960+0000 7f2265800640 1 -- 172.21.15.161:0/2696039520 learned_addr learned my addr 172.21.15.161:0/2696039520 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:08.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.960+0000 7f225fe00640 1 --2- 172.21.15.161:0/2696039520 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22601428d0 0x7f22601ee8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:08.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.960+0000 7f2264e00640 1 --2- 172.21.15.161:0/2696039520 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2240006f20 0x7f22601473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:08.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.964+0000 7f2265800640 1 -- 172.21.15.161:0/2696039520 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2240006f20 msgr2=0x7f22601473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:08.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.964+0000 7f2265800640 1 --2- 172.21.15.161:0/2696039520 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2240006f20 0x7f22601473f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:08.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.964+0000 7f2265800640 1 -- 172.21.15.161:0/2696039520 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22601428d0 msgr2=0x7f22601ee8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:08.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.964+0000 7f2265800640 1 --2- 172.21.15.161:0/2696039520 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22601428d0 0x7f22601ee8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:08.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.964+0000 7f2265800640 1 -- 172.21.15.161:0/2696039520 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226014fed0 con 0x7f22601eee00 2024-01-17T22:59:08.963 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.964+0000 7f2265800640 1 --2- 172.21.15.161:0/2696039520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22601eee00 0x7f226014de70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2258002240 tx=0x7f2240007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:08.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.968+0000 7f225cc00640 1 -- 172.21.15.161:0/2696039520 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22580019d0 con 0x7f22601eee00 2024-01-17T22:59:08.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.968+0000 7f225cc00640 1 -- 172.21.15.161:0/2696039520 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22580b9480 con 0x7f22601eee00 2024-01-17T22:59:08.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.968+0000 7f225cc00640 1 -- 172.21.15.161:0/2696039520 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22580b9810 con 0x7f22601eee00 2024-01-17T22:59:08.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.968+0000 7f2267800640 1 -- 172.21.15.161:0/2696039520 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226014f630 con 0x7f22601eee00 2024-01-17T22:59:08.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.968+0000 7f2267800640 1 -- 172.21.15.161:0/2696039520 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226014fbf0 con 0x7f22601eee00 2024-01-17T22:59:08.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:08.968+0000 7f2267800640 1 -- 172.21.15.161:0/2696039520 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22600746a0 con 0x7f22601eee00 2024-01-17T22:59:09.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.220+0000 7f225cc00640 1 -- 172.21.15.161:0/2696039520 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f22580aa030 con 0x7f22601eee00 2024-01-17T22:59:09.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.220+0000 7f225cc00640 1 --2- 172.21.15.161:0/2696039520 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2238066890 0x7f2238068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:09.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.220+0000 7f2264e00640 1 --2- 172.21.15.161:0/2696039520 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2238066890 0x7f2238068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:09.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.220+0000 7f2264e00640 1 --2- 172.21.15.161:0/2696039520 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2238066890 0x7f2238068d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2250009b00 tx=0x7f2250008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:09.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.236+0000 7f225cc00640 1 -- 172.21.15.161:0/2696039520 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f22580eff40 con 0x7f22601eee00 2024-01-17T22:59:09.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.236+0000 7f225cc00640 1 -- 172.21.15.161:0/2696039520 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f22580ec1f0 con 0x7f22601eee00 2024-01-17T22:59:09.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.396+0000 7f2267800640 1 -- 172.21.15.161:0/2696039520 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f226014da90 con 0x7f22601eee00 2024-01-17T22:59:09.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.400+0000 7f225cc00640 1 -- 172.21.15.161:0/2696039520 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f22580be070 con 0x7f22601eee00 2024-01-17T22:59:09.399 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-01-17T22:59:09.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.404+0000 7f2267800640 1 -- 172.21.15.161:0/2696039520 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2238066890 msgr2=0x7f2238068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:09.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.404+0000 7f2267800640 1 --2- 172.21.15.161:0/2696039520 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2238066890 0x7f2238068d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2250009b00 tx=0x7f2250008040 comp rx=0 tx=0).stop 2024-01-17T22:59:09.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.404+0000 7f2267800640 1 -- 172.21.15.161:0/2696039520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22601eee00 msgr2=0x7f226014de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:09.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.404+0000 7f2267800640 1 --2- 172.21.15.161:0/2696039520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22601eee00 0x7f226014de70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2258002240 tx=0x7f2240007a10 comp rx=0 tx=0).stop 2024-01-17T22:59:09.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.404+0000 7f2267800640 1 -- 172.21.15.161:0/2696039520 shutdown_connections 2024-01-17T22:59:09.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.404+0000 7f2267800640 1 --2- 172.21.15.161:0/2696039520 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2238066890 0x7f2238068d50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:09.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.404+0000 7f2267800640 1 --2- 172.21.15.161:0/2696039520 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22601428d0 0x7f22601ee8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:09.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.404+0000 7f2267800640 1 --2- 172.21.15.161:0/2696039520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22601eee00 0x7f226014de70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:09.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.404+0000 7f2267800640 1 --2- 172.21.15.161:0/2696039520 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2240006f20 0x7f22601473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:09.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.404+0000 7f2267800640 1 -- 172.21.15.161:0/2696039520 >> 172.21.15.161:0/2696039520 conn(0x7f22600c7a90 msgr2=0x7f2260148380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:09.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.404+0000 7f2267800640 1 -- 172.21.15.161:0/2696039520 shutdown_connections 2024-01-17T22:59:09.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.404+0000 7f2267800640 1 -- 172.21.15.161:0/2696039520 wait complete. 2024-01-17T22:59:09.422 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-17T22:59:09.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.560+0000 7f86eca00640 1 Processor -- start 2024-01-17T22:59:09.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.560+0000 7f86eca00640 1 -- start start 2024-01-17T22:59:09.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.560+0000 7f86eca00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86e40c0090 0x7f86e4156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:09.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.560+0000 7f86eca00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e406dc10 con 0x7f86e40c5a70 2024-01-17T22:59:09.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.560+0000 7f86eca00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e406d7e0 con 0x7f86e4150560 2024-01-17T22:59:09.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.560+0000 7f86eca00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e41564c0 con 0x7f86e40c0090 2024-01-17T22:59:09.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.564+0000 7f86e9600640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f86e40c5a70 0x7f86e415ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:48424/0 (socket says 172.21.15.161:48424) 2024-01-17T22:59:09.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.564+0000 7f86e9600640 1 -- 172.21.15.161:0/3130268113 learned_addr learned my addr 172.21.15.161:0/3130268113 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:09.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.564+0000 7f86eaa00640 1 --2- 172.21.15.161:0/3130268113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86e40c0090 0x7f86e4156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:09.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.564+0000 7f86e8c00640 1 -- 172.21.15.161:0/3130268113 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668904474 0 0) 0x7f86e406dc10 con 0x7f86e40c5a70 2024-01-17T22:59:09.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.564+0000 7f86e8c00640 1 -- 172.21.15.161:0/3130268113 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86c4003530 con 0x7f86e40c5a70 2024-01-17T22:59:09.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.568+0000 7f86e8c00640 1 -- 172.21.15.161:0/3130268113 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 634538712 0 0) 0x7f86c4003530 con 0x7f86e40c5a70 2024-01-17T22:59:09.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.568+0000 7f86e8c00640 1 -- 172.21.15.161:0/3130268113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86e40c0090 msgr2=0x7f86e4156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:09.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.568+0000 7f86e8c00640 1 --2- 172.21.15.161:0/3130268113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86e40c0090 0x7f86e4156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:09.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.568+0000 7f86e8c00640 1 -- 172.21.15.161:0/3130268113 >> v1:172.21.15.190:6789/0 conn(0x7f86e4150560 legacy=0x7f86e40722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:09.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.568+0000 7f86e8c00640 1 -- 172.21.15.161:0/3130268113 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e406d220 con 0x7f86e40c5a70 2024-01-17T22:59:09.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.568+0000 7f86e8c00640 1 -- 172.21.15.161:0/3130268113 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f86cc0016a0 con 0x7f86e40c5a70 2024-01-17T22:59:09.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.568+0000 7f86e8c00640 1 -- 172.21.15.161:0/3130268113 >> v1:172.21.15.161:6789/0 conn(0x7f86e40c5a70 legacy=0x7f86e415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:09.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.568+0000 7f86e8c00640 1 --2- 172.21.15.161:0/3130268113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86c40039b0 0x7f86c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:09.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.568+0000 7f86e8c00640 1 --2- 172.21.15.161:0/3130268113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86e40c0090 0x7f86c40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:09.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.568+0000 7f86e8c00640 1 --2- 172.21.15.161:0/3130268113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86c4004d10 0x7f86c4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:09.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.568+0000 7f86e8c00640 1 -- 172.21.15.161:0/3130268113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e41564c0 con 0x7f86c4004d10 2024-01-17T22:59:09.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.568+0000 7f86e8c00640 1 -- 172.21.15.161:0/3130268113 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c400ba70 con 0x7f86c40039b0 2024-01-17T22:59:09.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.568+0000 7f86e8c00640 1 -- 172.21.15.161:0/3130268113 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c400de40 con 0x7f86e40c0090 2024-01-17T22:59:09.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.572+0000 7f86eaa00640 1 --2- 172.21.15.161:0/3130268113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86c4004d10 0x7f86c4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:09.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.572+0000 7f86ea000640 1 --2- 172.21.15.161:0/3130268113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86c40039b0 0x7f86c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:09.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.576+0000 7f86eaa00640 1 -- 172.21.15.161:0/3130268113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86e40c0090 msgr2=0x7f86c40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:09.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.576+0000 7f86eaa00640 1 --2- 172.21.15.161:0/3130268113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86e40c0090 0x7f86c40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:09.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.576+0000 7f86eaa00640 1 -- 172.21.15.161:0/3130268113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86c40039b0 msgr2=0x7f86c4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:09.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.576+0000 7f86eaa00640 1 --2- 172.21.15.161:0/3130268113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86c40039b0 0x7f86c4003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:09.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.576+0000 7f86eaa00640 1 -- 172.21.15.161:0/3130268113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c4003530 con 0x7f86c4004d10 2024-01-17T22:59:09.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.580+0000 7f86eaa00640 1 --2- 172.21.15.161:0/3130268113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86c4004d10 0x7f86c4005190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009f90 tx=0x7f86d401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33816ac51d0c6413 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:09.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.584+0000 7f86e8c00640 1 -- 172.21.15.161:0/3130268113 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d40a5c70 con 0x7f86c4004d10 2024-01-17T22:59:09.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.584+0000 7f86e8c00640 1 -- 172.21.15.161:0/3130268113 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d400f040 con 0x7f86c4004d10 2024-01-17T22:59:09.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.584+0000 7f86e8c00640 1 -- 172.21.15.161:0/3130268113 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d40ad440 con 0x7f86c4004d10 2024-01-17T22:59:09.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.584+0000 7f86eca00640 1 -- 172.21.15.161:0/3130268113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86c4004d10 msgr2=0x7f86c4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:09.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.584+0000 7f86eca00640 1 --2- 172.21.15.161:0/3130268113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86c4004d10 0x7f86c4005190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009f90 tx=0x7f86d401cc60 comp rx=0 tx=0).stop 2024-01-17T22:59:09.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.584+0000 7f86eaa00640 1 -- 172.21.15.161:0/3130268113 reap_dead start 2024-01-17T22:59:09.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.584+0000 7f86eca00640 1 -- 172.21.15.161:0/3130268113 shutdown_connections 2024-01-17T22:59:09.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.584+0000 7f86eca00640 1 -- 172.21.15.161:0/3130268113 >> 172.21.15.161:0/3130268113 conn(0x7f86e40cb070 msgr2=0x7f86e40cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:09.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.584+0000 7f86eca00640 1 -- 172.21.15.161:0/3130268113 shutdown_connections 2024-01-17T22:59:09.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.584+0000 7f86eca00640 1 -- 172.21.15.161:0/3130268113 wait complete. 2024-01-17T22:59:09.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.584+0000 7f86eca00640 1 Processor -- start 2024-01-17T22:59:09.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.584+0000 7f86eca00640 1 -- start start 2024-01-17T22:59:09.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.588+0000 7f86eca00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86c4004d10 0x7f86e40ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:09.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.588+0000 7f86eca00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86e40c19d0 0x7f86e41f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:09.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.588+0000 7f86eca00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86e40c1e50 0x7f86e41f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:09.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.588+0000 7f86eca00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40c2650 con 0x7f86e40c1e50 2024-01-17T22:59:09.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.588+0000 7f86eca00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e41f25d0 con 0x7f86c4004d10 2024-01-17T22:59:09.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.588+0000 7f86eca00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40c3970 con 0x7f86e40c19d0 2024-01-17T22:59:09.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.588+0000 7f86eaa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86e40c1e50 0x7f86e41f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:09.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.588+0000 7f86eaa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86e40c1e50 0x7f86e41f2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39794/0 (socket says 172.21.15.161:39794) 2024-01-17T22:59:09.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.588+0000 7f86eaa00640 1 -- 172.21.15.161:0/3224938832 learned_addr learned my addr 172.21.15.161:0/3224938832 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:09.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.588+0000 7f86e9600640 1 --2- 172.21.15.161:0/3224938832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86e40c19d0 0x7f86e41f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:09.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.592+0000 7f86eaa00640 1 -- 172.21.15.161:0/3224938832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86e40c19d0 msgr2=0x7f86e41f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:09.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.592+0000 7f86eaa00640 1 --2- 172.21.15.161:0/3224938832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86e40c19d0 0x7f86e41f2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:09.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.592+0000 7f86eaa00640 1 -- 172.21.15.161:0/3224938832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86c4004d10 msgr2=0x7f86e40ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:09.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.592+0000 7f86eaa00640 1 --2- 172.21.15.161:0/3224938832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86c4004d10 0x7f86e40ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:09.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.592+0000 7f86eaa00640 1 -- 172.21.15.161:0/3224938832 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e40c3c50 con 0x7f86e40c1e50 2024-01-17T22:59:09.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.592+0000 7f86eaa00640 1 --2- 172.21.15.161:0/3224938832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86e40c1e50 0x7f86e41f2fa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f86d4002240 tx=0x7f86d4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:09.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.596+0000 7f86e2000640 1 -- 172.21.15.161:0/3224938832 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d40039a0 con 0x7f86e40c1e50 2024-01-17T22:59:09.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.596+0000 7f86e2000640 1 -- 172.21.15.161:0/3224938832 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d4003b00 con 0x7f86e40c1e50 2024-01-17T22:59:09.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.596+0000 7f86e2000640 1 -- 172.21.15.161:0/3224938832 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d40ae950 con 0x7f86e40c1e50 2024-01-17T22:59:09.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.596+0000 7f86eca00640 1 -- 172.21.15.161:0/3224938832 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e40c3f30 con 0x7f86e40c1e50 2024-01-17T22:59:09.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.596+0000 7f86eca00640 1 -- 172.21.15.161:0/3224938832 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e40c44f0 con 0x7f86e40c1e50 2024-01-17T22:59:09.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.596+0000 7f86eca00640 1 -- 172.21.15.161:0/3224938832 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e40746a0 con 0x7f86e40c1e50 2024-01-17T22:59:09.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.616+0000 7f86e2000640 1 -- 172.21.15.161:0/3224938832 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f86d40b4040 con 0x7f86e40c1e50 2024-01-17T22:59:09.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.620+0000 7f86e2000640 1 --2- 172.21.15.161:0/3224938832 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f86bc066890 0x7f86bc068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:09.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.620+0000 7f86ea000640 1 --2- 172.21.15.161:0/3224938832 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f86bc066890 0x7f86bc068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:09.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.620+0000 7f86ea000640 1 --2- 172.21.15.161:0/3224938832 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f86bc066890 0x7f86bc068d50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f86dc007fd0 tx=0x7f86dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:09.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.848+0000 7f86e2000640 1 -- 172.21.15.161:0/3224938832 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f86d40ef360 con 0x7f86e40c1e50 2024-01-17T22:59:09.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:09.848+0000 7f86e2000640 1 -- 172.21.15.161:0/3224938832 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f86d40eb6a0 con 0x7f86e40c1e50 2024-01-17T22:59:10.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.016+0000 7f86eca00640 1 -- 172.21.15.161:0/3224938832 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f86e41f2710 con 0x7f86e40c1e50 2024-01-17T22:59:10.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.020+0000 7f86e2000640 1 -- 172.21.15.161:0/3224938832 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f86d40b2020 con 0x7f86e40c1e50 2024-01-17T22:59:10.020 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2024-01-17T22:59:10.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.024+0000 7f86eca00640 1 -- 172.21.15.161:0/3224938832 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f86bc066890 msgr2=0x7f86bc068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:10.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.024+0000 7f86eca00640 1 --2- 172.21.15.161:0/3224938832 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f86bc066890 0x7f86bc068d50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f86dc007fd0 tx=0x7f86dc009040 comp rx=0 tx=0).stop 2024-01-17T22:59:10.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.024+0000 7f86eca00640 1 -- 172.21.15.161:0/3224938832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86e40c1e50 msgr2=0x7f86e41f2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:10.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.024+0000 7f86eca00640 1 --2- 172.21.15.161:0/3224938832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86e40c1e50 0x7f86e41f2fa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f86d4002240 tx=0x7f86d4009750 comp rx=0 tx=0).stop 2024-01-17T22:59:10.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.024+0000 7f86eca00640 1 -- 172.21.15.161:0/3224938832 shutdown_connections 2024-01-17T22:59:10.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.024+0000 7f86eca00640 1 --2- 172.21.15.161:0/3224938832 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f86bc066890 0x7f86bc068d50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.024+0000 7f86eca00640 1 --2- 172.21.15.161:0/3224938832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86e40c1e50 0x7f86e41f2fa0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.024+0000 7f86eca00640 1 --2- 172.21.15.161:0/3224938832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86e40c19d0 0x7f86e41f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.024+0000 7f86eca00640 1 --2- 172.21.15.161:0/3224938832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86c4004d10 0x7f86e40ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.024+0000 7f86eca00640 1 -- 172.21.15.161:0/3224938832 >> 172.21.15.161:0/3224938832 conn(0x7f86e40cb070 msgr2=0x7f86e4072210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:10.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.024+0000 7f86eca00640 1 -- 172.21.15.161:0/3224938832 shutdown_connections 2024-01-17T22:59:10.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.024+0000 7f86eca00640 1 -- 172.21.15.161:0/3224938832 wait complete. 2024-01-17T22:59:10.042 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:59:10.043 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-17T22:59:10.052 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T22:59:10.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.236+0000 7f80bf400640 1 Processor -- start 2024-01-17T22:59:10.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.236+0000 7f80bf400640 1 -- start start 2024-01-17T22:59:10.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.236+0000 7f80bf400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f80b80c8a30 0x7f80b80c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:10.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.236+0000 7f80bf400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b80c7d10 con 0x7f80b815b620 2024-01-17T22:59:10.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.236+0000 7f80bf400640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b81576d0 con 0x7f80b81517f0 2024-01-17T22:59:10.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.236+0000 7f80bf400640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b8157970 con 0x7f80b80c8a30 2024-01-17T22:59:10.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.236+0000 7f80b7e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f80b815b620 0x7f80b8061100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:48440/0 (socket says 172.21.15.161:48440) 2024-01-17T22:59:10.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.236+0000 7f80b7e00640 1 -- 172.21.15.161:0/3691156638 learned_addr learned my addr 172.21.15.161:0/3691156638 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:10.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.240+0000 7f80bd400640 1 --2- 172.21.15.161:0/3691156638 >> v2:172.21.15.190:3300/0 conn(0x7f80b80c8a30 0x7f80b80c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:10.243 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.240+0000 7f80b7400640 1 -- 172.21.15.161:0/3691156638 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331638601 0 0) 0x7f80b80c7d10 con 0x7f80b815b620 2024-01-17T22:59:10.243 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.240+0000 7f80b7400640 1 -- 172.21.15.161:0/3691156638 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8098003530 con 0x7f80b815b620 2024-01-17T22:59:10.243 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.244+0000 7f80b7400640 1 -- 172.21.15.161:0/3691156638 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1825184967 0 0) 0x7f8098003530 con 0x7f80b815b620 2024-01-17T22:59:10.243 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.244+0000 7f80b7400640 1 -- 172.21.15.161:0/3691156638 >> v2:172.21.15.190:3300/0 conn(0x7f80b80c8a30 msgr2=0x7f80b80c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:10.243 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.244+0000 7f80b7400640 1 --2- 172.21.15.161:0/3691156638 >> v2:172.21.15.190:3300/0 conn(0x7f80b80c8a30 0x7f80b80c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.243 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.244+0000 7f80b7400640 1 -- 172.21.15.161:0/3691156638 >> v1:172.21.15.190:6789/0 conn(0x7f80b81517f0 legacy=0x7f80b80ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:10.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.244+0000 7f80b7400640 1 -- 172.21.15.161:0/3691156638 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b8157c50 con 0x7f80b815b620 2024-01-17T22:59:10.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.244+0000 7f80b7400640 1 -- 172.21.15.161:0/3691156638 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f80a0001680 con 0x7f80b815b620 2024-01-17T22:59:10.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.244+0000 7f80b7400640 1 -- 172.21.15.161:0/3691156638 >> v1:172.21.15.161:6789/0 conn(0x7f80b815b620 legacy=0x7f80b8061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:10.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.244+0000 7f80b7400640 1 --2- 172.21.15.161:0/3691156638 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80980039d0 0x7f8098003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:10.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.244+0000 7f80b7400640 1 --2- 172.21.15.161:0/3691156638 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80980047d0 0x7f8098004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:10.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.244+0000 7f80b7400640 1 --2- 172.21.15.161:0/3691156638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8098005190 0x7f809800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:10.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.244+0000 7f80b7400640 1 -- 172.21.15.161:0/3691156638 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b8157970 con 0x7f8098005190 2024-01-17T22:59:10.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.244+0000 7f80b7400640 1 -- 172.21.15.161:0/3691156638 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809800c060 con 0x7f80980039d0 2024-01-17T22:59:10.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.244+0000 7f80b7400640 1 -- 172.21.15.161:0/3691156638 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809800c220 con 0x7f80980047d0 2024-01-17T22:59:10.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.244+0000 7f80b7e00640 1 --2- 172.21.15.161:0/3691156638 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80980047d0 0x7f8098004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:10.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.248+0000 7f80bd400640 1 --2- 172.21.15.161:0/3691156638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8098005190 0x7f809800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:10.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.252+0000 7f80bd400640 1 -- 172.21.15.161:0/3691156638 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80980047d0 msgr2=0x7f8098004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:10.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.252+0000 7f80bd400640 1 --2- 172.21.15.161:0/3691156638 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80980047d0 0x7f8098004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.252+0000 7f80bd400640 1 -- 172.21.15.161:0/3691156638 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80980039d0 msgr2=0x7f8098003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:10.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.252+0000 7f80bd400640 1 --2- 172.21.15.161:0/3691156638 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80980039d0 0x7f8098003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.252+0000 7f80bd400640 1 -- 172.21.15.161:0/3691156638 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8098003530 con 0x7f8098005190 2024-01-17T22:59:10.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.252+0000 7f80bd400640 1 -- 172.21.15.161:0/3691156638 reap_dead start 2024-01-17T22:59:10.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.256+0000 7f80bd400640 1 --2- 172.21.15.161:0/3691156638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8098005190 0x7f809800b990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009fc0 tx=0x7f80b001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97144e390fe82dfd server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.260+0000 7f80b7400640 1 -- 172.21.15.161:0/3691156638 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b00a5cb0 con 0x7f8098005190 2024-01-17T22:59:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.260+0000 7f80b7400640 1 -- 172.21.15.161:0/3691156638 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b000f040 con 0x7f8098005190 2024-01-17T22:59:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.260+0000 7f80b7400640 1 -- 172.21.15.161:0/3691156638 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0003be0 con 0x7f8098005190 2024-01-17T22:59:10.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.260+0000 7f80bf400640 1 -- 172.21.15.161:0/3691156638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8098005190 msgr2=0x7f809800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:10.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.260+0000 7f80bf400640 1 --2- 172.21.15.161:0/3691156638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8098005190 0x7f809800b990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009fc0 tx=0x7f80b001cca0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.260+0000 7f80bf400640 1 -- 172.21.15.161:0/3691156638 shutdown_connections 2024-01-17T22:59:10.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.260+0000 7f80bf400640 1 --2- 172.21.15.161:0/3691156638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8098005190 0x7f809800b990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.260+0000 7f80bf400640 1 -- 172.21.15.161:0/3691156638 >> 172.21.15.161:0/3691156638 conn(0x7f80b806ad40 msgr2=0x7f80b806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:10.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.260+0000 7f80bf400640 1 -- 172.21.15.161:0/3691156638 shutdown_connections 2024-01-17T22:59:10.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.260+0000 7f80bf400640 1 -- 172.21.15.161:0/3691156638 wait complete. 2024-01-17T22:59:10.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.260+0000 7f80bf400640 1 Processor -- start 2024-01-17T22:59:10.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.260+0000 7f80bf400640 1 -- start start 2024-01-17T22:59:10.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.264+0000 7f80bf400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8098005190 0x7f80b80c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:10.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.264+0000 7f80bf400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80b80c4220 0x7f80b81ef340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:10.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.264+0000 7f80bf400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80b80cb6c0 0x7f80b81ef880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:10.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.264+0000 7f80bf400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80c5890 con 0x7f8098005190 2024-01-17T22:59:10.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.264+0000 7f80bf400640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80c49f0 con 0x7f80b80cb6c0 2024-01-17T22:59:10.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.264+0000 7f80bf400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80c4710 con 0x7f80b80c4220 2024-01-17T22:59:10.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.264+0000 7f80bca00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8098005190 0x7f80b80c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:10.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.264+0000 7f80bca00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8098005190 0x7f80b80c6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39812/0 (socket says 172.21.15.161:39812) 2024-01-17T22:59:10.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.264+0000 7f80bca00640 1 -- 172.21.15.161:0/2994120057 learned_addr learned my addr 172.21.15.161:0/2994120057 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:10.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.264+0000 7f80b7e00640 1 --2- 172.21.15.161:0/2994120057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80b80c4220 0x7f80b81ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:10.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.268+0000 7f80bca00640 1 -- 172.21.15.161:0/2994120057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80b80c4220 msgr2=0x7f80b81ef340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:10.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.268+0000 7f80bca00640 1 --2- 172.21.15.161:0/2994120057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80b80c4220 0x7f80b81ef340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.268+0000 7f80bca00640 1 -- 172.21.15.161:0/2994120057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80b80cb6c0 msgr2=0x7f80b81ef880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:10.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.268+0000 7f80bca00640 1 --2- 172.21.15.161:0/2994120057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80b80cb6c0 0x7f80b81ef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.268+0000 7f80bca00640 1 -- 172.21.15.161:0/2994120057 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b80c6e70 con 0x7f8098005190 2024-01-17T22:59:10.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.272+0000 7f80bca00640 1 --2- 172.21.15.161:0/2994120057 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8098005190 0x7f80b80c6180 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f80a800c3c0 tx=0x7f80a800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:10.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.276+0000 7f80b4c00640 1 -- 172.21.15.161:0/2994120057 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8011790 con 0x7f8098005190 2024-01-17T22:59:10.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.276+0000 7f80b4c00640 1 -- 172.21.15.161:0/2994120057 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a80118f0 con 0x7f8098005190 2024-01-17T22:59:10.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.276+0000 7f80b4c00640 1 -- 172.21.15.161:0/2994120057 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8011ca0 con 0x7f8098005190 2024-01-17T22:59:10.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.276+0000 7f80bf400640 1 -- 172.21.15.161:0/2994120057 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b80c7150 con 0x7f8098005190 2024-01-17T22:59:10.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.276+0000 7f80bf400640 1 -- 172.21.15.161:0/2994120057 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b815adb0 con 0x7f8098005190 2024-01-17T22:59:10.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.276+0000 7f80bf400640 1 -- 172.21.15.161:0/2994120057 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b81ef190 con 0x7f8098005190 2024-01-17T22:59:10.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.296+0000 7f80b4c00640 1 -- 172.21.15.161:0/2994120057 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f80a801c460 con 0x7f8098005190 2024-01-17T22:59:10.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.296+0000 7f80b4c00640 1 --2- 172.21.15.161:0/2994120057 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8090066890 0x7f8090068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:10.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.296+0000 7f80b7e00640 1 --2- 172.21.15.161:0/2994120057 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8090066890 0x7f8090068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:10.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.300+0000 7f80b7e00640 1 --2- 172.21.15.161:0/2994120057 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8090066890 0x7f8090068d50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f80b80cd340 tx=0x7f80a0000f60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:10.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.524+0000 7f80b4c00640 1 -- 172.21.15.161:0/2994120057 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f80a8055fa0 con 0x7f8098005190 2024-01-17T22:59:10.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.524+0000 7f80b4c00640 1 -- 172.21.15.161:0/2994120057 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f80a8051be0 con 0x7f8098005190 2024-01-17T22:59:10.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.688+0000 7f80bf400640 1 -- 172.21.15.161:0/2994120057 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80b806b620 con 0x7f8098005190 2024-01-17T22:59:10.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.776+0000 7f80b4c00640 1 -- 172.21.15.161:0/2994120057 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18587 (secure 0 0 0) 0x7f80a8003810 con 0x7f8098005190 2024-01-17T22:59:10.775 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:10.775 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":28,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:59:08.571619+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T22:58:46.757110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T22:58:47.930512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T22:58:53.561624+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.614036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.746767+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.689096+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.706485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.628004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.680048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.571249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]},{"pgid":"4.14","mappings":[{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:59:10.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.780+0000 7f80bf400640 1 -- 172.21.15.161:0/2994120057 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8090066890 msgr2=0x7f8090068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:10.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.780+0000 7f80bf400640 1 --2- 172.21.15.161:0/2994120057 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8090066890 0x7f8090068d50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f80b80cd340 tx=0x7f80a0000f60 comp rx=0 tx=0).stop 2024-01-17T22:59:10.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.780+0000 7f80bf400640 1 -- 172.21.15.161:0/2994120057 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8098005190 msgr2=0x7f80b80c6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:10.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.780+0000 7f80bf400640 1 --2- 172.21.15.161:0/2994120057 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8098005190 0x7f80b80c6180 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f80a800c3c0 tx=0x7f80a800c7c0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.780+0000 7f80bf400640 1 -- 172.21.15.161:0/2994120057 shutdown_connections 2024-01-17T22:59:10.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.780+0000 7f80bf400640 1 --2- 172.21.15.161:0/2994120057 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8090066890 0x7f8090068d50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.780+0000 7f80bf400640 1 --2- 172.21.15.161:0/2994120057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80b80cb6c0 0x7f80b81ef880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.780+0000 7f80bf400640 1 --2- 172.21.15.161:0/2994120057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80b80c4220 0x7f80b81ef340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.780+0000 7f80bf400640 1 --2- 172.21.15.161:0/2994120057 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8098005190 0x7f80b80c6180 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.780+0000 7f80bf400640 1 -- 172.21.15.161:0/2994120057 >> 172.21.15.161:0/2994120057 conn(0x7f80b806ad40 msgr2=0x7f80b80c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:10.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.780+0000 7f80bf400640 1 -- 172.21.15.161:0/2994120057 shutdown_connections 2024-01-17T22:59:10.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.780+0000 7f80bf400640 1 -- 172.21.15.161:0/2994120057 wait complete. 2024-01-17T22:59:10.797 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-17T22:58:14.876386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-17T22:58:46.757110+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-17T22:58:47.930512+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-17T22:58:53.561624+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-17T22:59:10.797 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-17T22:59:10.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.940+0000 7f5393600640 1 Processor -- start 2024-01-17T22:59:10.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.940+0000 7f5393600640 1 -- start start 2024-01-17T22:59:10.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.940+0000 7f5393600640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f538c1506b0 0x7f538c0c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:10.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.940+0000 7f5393600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f538c0c0c60 0x7f538c0c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:10.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.940+0000 7f5393600640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538c0bffb0 con 0x7f538c156300 2024-01-17T22:59:10.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.940+0000 7f5393600640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538c150a90 con 0x7f538c1506b0 2024-01-17T22:59:10.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.940+0000 7f5393600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538c0b1130 con 0x7f538c0c0c60 2024-01-17T22:59:10.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.940+0000 7f5390c00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f538c1506b0 0x7f538c0c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:10.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.944+0000 7f5391600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f538c0c0c60 0x7f538c0c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:10.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.944+0000 7f5390c00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f538c1506b0 0x7f538c0c0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:39416/0 (socket says 172.21.15.161:39416) 2024-01-17T22:59:10.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.944+0000 7f5390c00640 1 -- 172.21.15.161:0/413693180 learned_addr learned my addr 172.21.15.161:0/413693180 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:10.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.952+0000 7f5390c00640 1 -- 172.21.15.161:0/413693180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f538c0c0c60 msgr2=0x7f538c0c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:10.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.952+0000 7f5390c00640 1 --2- 172.21.15.161:0/413693180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f538c0c0c60 0x7f538c0c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.952+0000 7f5390c00640 1 -- 172.21.15.161:0/413693180 >> v1:172.21.15.190:6789/0 conn(0x7f538c156300 legacy=0x7f538c06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:10.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.952+0000 7f5390c00640 1 -- 172.21.15.161:0/413693180 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c1567b0 con 0x7f538c1506b0 2024-01-17T22:59:10.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.952+0000 7f5391600640 1 --2- 172.21.15.161:0/413693180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f538c0c0c60 0x7f538c0c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-17T22:59:10.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.960+0000 7f5390c00640 1 --2- 172.21.15.161:0/413693180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f538c1506b0 0x7f538c0c0720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f537c009870 tx=0x7f537c01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=129844e14b43a269 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:10.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.964+0000 7f538b400640 1 -- 172.21.15.161:0/413693180 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c0ac600 con 0x7f538c1506b0 2024-01-17T22:59:10.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.964+0000 7f538b400640 1 -- 172.21.15.161:0/413693180 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c0a8050 con 0x7f538c1506b0 2024-01-17T22:59:10.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.964+0000 7f538b400640 1 -- 172.21.15.161:0/413693180 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c0ac980 con 0x7f538c1506b0 2024-01-17T22:59:10.963 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.964+0000 7f5393600640 1 -- 172.21.15.161:0/413693180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f538c1506b0 msgr2=0x7f538c0c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:10.963 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.964+0000 7f5393600640 1 --2- 172.21.15.161:0/413693180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f538c1506b0 0x7f538c0c0720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f537c009870 tx=0x7f537c01c4d0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.963 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.964+0000 7f5393600640 1 -- 172.21.15.161:0/413693180 shutdown_connections 2024-01-17T22:59:10.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.964+0000 7f5393600640 1 --2- 172.21.15.161:0/413693180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f538c0c0c60 0x7f538c0c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.964+0000 7f5393600640 1 --2- 172.21.15.161:0/413693180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f538c1506b0 0x7f538c0c0720 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.964+0000 7f5393600640 1 -- 172.21.15.161:0/413693180 >> 172.21.15.161:0/413693180 conn(0x7f538c0c7a90 msgr2=0x7f538c0c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:10.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.964+0000 7f5393600640 1 -- 172.21.15.161:0/413693180 shutdown_connections 2024-01-17T22:59:10.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.964+0000 7f5393600640 1 -- 172.21.15.161:0/413693180 wait complete. 2024-01-17T22:59:10.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.968+0000 7f5393600640 1 Processor -- start 2024-01-17T22:59:10.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.968+0000 7f5393600640 1 -- start start 2024-01-17T22:59:10.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.968+0000 7f5393600640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f538c0c0c60 0x7f538c0c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:10.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.968+0000 7f5393600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f538c1506b0 0x7f538c0c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:10.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.968+0000 7f5393600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f538c156300 0x7f538c0c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:10.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.968+0000 7f5393600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c14e1c0 con 0x7f538c156300 2024-01-17T22:59:10.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.968+0000 7f5393600640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c14f440 con 0x7f538c0c0c60 2024-01-17T22:59:10.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.968+0000 7f5393600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538c14f700 con 0x7f538c1506b0 2024-01-17T22:59:10.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.968+0000 7f5391600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f538c156300 0x7f538c0c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:10.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.968+0000 7f5391600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f538c156300 0x7f538c0c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39820/0 (socket says 172.21.15.161:39820) 2024-01-17T22:59:10.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.968+0000 7f5391600640 1 -- 172.21.15.161:0/3738594415 learned_addr learned my addr 172.21.15.161:0/3738594415 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:10.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.968+0000 7f538be00640 1 --2- 172.21.15.161:0/3738594415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f538c1506b0 0x7f538c0c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:10.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.972+0000 7f5390c00640 1 --2- 172.21.15.161:0/3738594415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f538c0c0c60 0x7f538c0c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:10.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.972+0000 7f5391600640 1 -- 172.21.15.161:0/3738594415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f538c1506b0 msgr2=0x7f538c0c2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:10.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.972+0000 7f5391600640 1 --2- 172.21.15.161:0/3738594415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f538c1506b0 0x7f538c0c2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.972+0000 7f5391600640 1 -- 172.21.15.161:0/3738594415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f538c0c0c60 msgr2=0x7f538c0c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:10.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.972+0000 7f5391600640 1 --2- 172.21.15.161:0/3738594415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f538c0c0c60 0x7f538c0c3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:10.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.972+0000 7f5391600640 1 -- 172.21.15.161:0/3738594415 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5384009a70 con 0x7f538c156300 2024-01-17T22:59:10.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.976+0000 7f5391600640 1 --2- 172.21.15.161:0/3738594415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f538c156300 0x7f538c0c8d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f538400efc0 tx=0x7f538400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:10.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.980+0000 7f5388c00640 1 -- 172.21.15.161:0/3738594415 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384009cd0 con 0x7f538c156300 2024-01-17T22:59:10.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.980+0000 7f5388c00640 1 -- 172.21.15.161:0/3738594415 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538400f040 con 0x7f538c156300 2024-01-17T22:59:10.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.980+0000 7f5388c00640 1 -- 172.21.15.161:0/3738594415 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53840039a0 con 0x7f538c156300 2024-01-17T22:59:10.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.980+0000 7f5393600640 1 -- 172.21.15.161:0/3738594415 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537c0094d0 con 0x7f538c156300 2024-01-17T22:59:10.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.980+0000 7f5393600640 1 -- 172.21.15.161:0/3738594415 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538c14fcc0 con 0x7f538c156300 2024-01-17T22:59:10.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:10.980+0000 7f5393600640 1 -- 172.21.15.161:0/3738594415 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538c14e370 con 0x7f538c156300 2024-01-17T22:59:10.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.000+0000 7f5388c00640 1 -- 172.21.15.161:0/3738594415 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f5384014480 con 0x7f538c156300 2024-01-17T22:59:10.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.000+0000 7f5388c00640 1 --2- 172.21.15.161:0/3738594415 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f53640668c0 0x7f5364068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:10.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.000+0000 7f5390c00640 1 --2- 172.21.15.161:0/3738594415 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f53640668c0 0x7f5364068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:10.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.000+0000 7f5390c00640 1 --2- 172.21.15.161:0/3738594415 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f53640668c0 0x7f5364068d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f537c0ae000 tx=0x7f537c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:11.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.004+0000 7f5388c00640 1 -- 172.21.15.161:0/3738594415 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f53840567f0 con 0x7f538c156300 2024-01-17T22:59:11.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.252+0000 7f5388c00640 1 -- 172.21.15.161:0/3738594415 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f5384052430 con 0x7f538c156300 2024-01-17T22:59:11.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.416+0000 7f5393600640 1 -- 172.21.15.161:0/3738594415 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f538c14fee0 con 0x7f538c156300 2024-01-17T22:59:11.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.420+0000 7f5388c00640 1 -- 172.21.15.161:0/3738594415 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53840180a0 con 0x7f538c156300 2024-01-17T22:59:11.418 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-01-17T22:59:11.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.424+0000 7f5393600640 1 -- 172.21.15.161:0/3738594415 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f53640668c0 msgr2=0x7f5364068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:11.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.424+0000 7f5393600640 1 --2- 172.21.15.161:0/3738594415 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f53640668c0 0x7f5364068d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f537c0ae000 tx=0x7f537c008040 comp rx=0 tx=0).stop 2024-01-17T22:59:11.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.424+0000 7f5393600640 1 -- 172.21.15.161:0/3738594415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f538c156300 msgr2=0x7f538c0c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:11.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.424+0000 7f5393600640 1 --2- 172.21.15.161:0/3738594415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f538c156300 0x7f538c0c8d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f538400efc0 tx=0x7f538400c490 comp rx=0 tx=0).stop 2024-01-17T22:59:11.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.424+0000 7f5393600640 1 -- 172.21.15.161:0/3738594415 shutdown_connections 2024-01-17T22:59:11.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.424+0000 7f5393600640 1 --2- 172.21.15.161:0/3738594415 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f53640668c0 0x7f5364068d80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:11.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.424+0000 7f5393600640 1 --2- 172.21.15.161:0/3738594415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f538c156300 0x7f538c0c8d90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:11.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.424+0000 7f5393600640 1 --2- 172.21.15.161:0/3738594415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f538c1506b0 0x7f538c0c2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:11.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.424+0000 7f5393600640 1 --2- 172.21.15.161:0/3738594415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f538c0c0c60 0x7f538c0c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:11.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.424+0000 7f5393600640 1 -- 172.21.15.161:0/3738594415 >> 172.21.15.161:0/3738594415 conn(0x7f538c0c7a90 msgr2=0x7f538c06f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:11.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.424+0000 7f5393600640 1 -- 172.21.15.161:0/3738594415 shutdown_connections 2024-01-17T22:59:11.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.424+0000 7f5393600640 1 -- 172.21.15.161:0/3738594415 wait complete. 2024-01-17T22:59:11.441 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-17T22:59:11.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.588+0000 7fe70bc00640 1 Processor -- start 2024-01-17T22:59:11.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.588+0000 7fe70bc00640 1 -- start start 2024-01-17T22:59:11.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.588+0000 7fe70bc00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe7041515a0 0x7fe704157510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:11.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.588+0000 7fe70bc00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe7040c9eb0 0x7fe7040c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:11.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.588+0000 7fe70bc00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7040c8190 con 0x7fe7040c9660 2024-01-17T22:59:11.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.588+0000 7fe70bc00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7040c9ad0 con 0x7fe7041515a0 2024-01-17T22:59:11.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.588+0000 7fe70bc00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7040c72a0 con 0x7fe7040c9eb0 2024-01-17T22:59:11.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.592+0000 7fe709200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe7041515a0 0x7fe704157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:11.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.592+0000 7fe709200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe7041515a0 0x7fe704157510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39824/0 (socket says 172.21.15.161:39824) 2024-01-17T22:59:11.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.592+0000 7fe709200640 1 -- 172.21.15.161:0/58446599 learned_addr learned my addr 172.21.15.161:0/58446599 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:11.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.592+0000 7fe6fbe00640 1 --2- 172.21.15.161:0/58446599 >> v2:172.21.15.190:3300/0 conn(0x7fe7040c9eb0 0x7fe7040c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:11.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.592+0000 7fe709200640 1 -- 172.21.15.161:0/58446599 >> v2:172.21.15.190:3300/0 conn(0x7fe7040c9eb0 msgr2=0x7fe7040c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:11.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.592+0000 7fe709200640 1 --2- 172.21.15.161:0/58446599 >> v2:172.21.15.190:3300/0 conn(0x7fe7040c9eb0 0x7fe7040c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:11.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.592+0000 7fe709200640 1 -- 172.21.15.161:0/58446599 >> v1:172.21.15.190:6789/0 conn(0x7fe7040c9660 legacy=0x7fe70406b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:11.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.592+0000 7fe709200640 1 -- 172.21.15.161:0/58446599 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7040c7580 con 0x7fe7041515a0 2024-01-17T22:59:11.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.596+0000 7fe709200640 1 --2- 172.21.15.161:0/58446599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7041515a0 0x7fe704157510 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe704151dd0 tx=0x7fe6f401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1dcdd1aaf05439 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:11.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.600+0000 7fe703e00640 1 -- 172.21.15.161:0/58446599 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f40ac410 con 0x7fe7041515a0 2024-01-17T22:59:11.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.600+0000 7fe703e00640 1 -- 172.21.15.161:0/58446599 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f40ac570 con 0x7fe7041515a0 2024-01-17T22:59:11.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.600+0000 7fe703e00640 1 -- 172.21.15.161:0/58446599 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f40ac900 con 0x7fe7041515a0 2024-01-17T22:59:11.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.600+0000 7fe70bc00640 1 -- 172.21.15.161:0/58446599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7041515a0 msgr2=0x7fe704157510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:11.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.600+0000 7fe70bc00640 1 --2- 172.21.15.161:0/58446599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7041515a0 0x7fe704157510 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe704151dd0 tx=0x7fe6f401c4c0 comp rx=0 tx=0).stop 2024-01-17T22:59:11.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.600+0000 7fe70bc00640 1 -- 172.21.15.161:0/58446599 shutdown_connections 2024-01-17T22:59:11.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.600+0000 7fe70bc00640 1 --2- 172.21.15.161:0/58446599 >> v2:172.21.15.190:3300/0 conn(0x7fe7040c9eb0 0x7fe7040c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:11.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.600+0000 7fe70bc00640 1 --2- 172.21.15.161:0/58446599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7041515a0 0x7fe704157510 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:11.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.600+0000 7fe70bc00640 1 -- 172.21.15.161:0/58446599 >> 172.21.15.161:0/58446599 conn(0x7fe704070580 msgr2=0x7fe704070990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:11.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.600+0000 7fe70bc00640 1 -- 172.21.15.161:0/58446599 shutdown_connections 2024-01-17T22:59:11.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.604+0000 7fe70bc00640 1 -- 172.21.15.161:0/58446599 wait complete. 2024-01-17T22:59:11.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.604+0000 7fe70bc00640 1 Processor -- start 2024-01-17T22:59:11.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.604+0000 7fe70bc00640 1 -- start start 2024-01-17T22:59:11.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.604+0000 7fe70bc00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7040c9660 0x7fe7041480c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:11.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.604+0000 7fe70bc00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7040c9eb0 0x7fe7040c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:11.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.604+0000 7fe70bc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7041515a0 0x7fe704159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:11.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.604+0000 7fe70bc00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70414d1a0 con 0x7fe7041515a0 2024-01-17T22:59:11.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.604+0000 7fe70bc00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040c6330 con 0x7fe7040c9660 2024-01-17T22:59:11.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.604+0000 7fe70bc00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040c3f30 con 0x7fe7040c9eb0 2024-01-17T22:59:11.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.604+0000 7fe70a600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7041515a0 0x7fe704159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:11.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.604+0000 7fe70a600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7041515a0 0x7fe704159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39836/0 (socket says 172.21.15.161:39836) 2024-01-17T22:59:11.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.604+0000 7fe70a600640 1 -- 172.21.15.161:0/905230212 learned_addr learned my addr 172.21.15.161:0/905230212 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:11.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.608+0000 7fe6fbe00640 1 --2- 172.21.15.161:0/905230212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7040c9eb0 0x7fe7040c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:11.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.608+0000 7fe709200640 1 --2- 172.21.15.161:0/905230212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7040c9660 0x7fe7041480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:11.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.608+0000 7fe70a600640 1 -- 172.21.15.161:0/905230212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7040c9eb0 msgr2=0x7fe7040c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:11.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.608+0000 7fe70a600640 1 --2- 172.21.15.161:0/905230212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7040c9eb0 0x7fe7040c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:11.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.608+0000 7fe70a600640 1 -- 172.21.15.161:0/905230212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7040c9660 msgr2=0x7fe7041480c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:11.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.608+0000 7fe70a600640 1 --2- 172.21.15.161:0/905230212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7040c9660 0x7fe7041480c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:11.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.608+0000 7fe70a600640 1 -- 172.21.15.161:0/905230212 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f40094d0 con 0x7fe7041515a0 2024-01-17T22:59:11.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.612+0000 7fe70a600640 1 --2- 172.21.15.161:0/905230212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7041515a0 0x7fe704159930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00b9c0 tx=0x7fe6fc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:11.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.616+0000 7fe701600640 1 -- 172.21.15.161:0/905230212 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc00cba0 con 0x7fe7041515a0 2024-01-17T22:59:11.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.616+0000 7fe70bc00640 1 -- 172.21.15.161:0/905230212 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7040c6580 con 0x7fe7041515a0 2024-01-17T22:59:11.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.616+0000 7fe70bc00640 1 -- 172.21.15.161:0/905230212 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70414c450 con 0x7fe7041515a0 2024-01-17T22:59:11.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.616+0000 7fe701600640 1 -- 172.21.15.161:0/905230212 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc0098d0 con 0x7fe7041515a0 2024-01-17T22:59:11.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.616+0000 7fe701600640 1 -- 172.21.15.161:0/905230212 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc01e440 con 0x7fe7041515a0 2024-01-17T22:59:11.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.616+0000 7fe70bc00640 1 -- 172.21.15.161:0/905230212 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d40052a0 con 0x7fe7041515a0 2024-01-17T22:59:11.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.636+0000 7fe701600640 1 -- 172.21.15.161:0/905230212 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fe6fc01e5a0 con 0x7fe7041515a0 2024-01-17T22:59:11.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.636+0000 7fe701600640 1 --2- 172.21.15.161:0/905230212 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe6dc066870 0x7fe6dc068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:11.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.636+0000 7fe709200640 1 --2- 172.21.15.161:0/905230212 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe6dc066870 0x7fe6dc068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:11.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.636+0000 7fe709200640 1 --2- 172.21.15.161:0/905230212 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe6dc066870 0x7fe6dc068d30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40ae000 tx=0x7fe6f40a6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:11.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.636+0000 7fe701600640 1 -- 172.21.15.161:0/905230212 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fe6fc055430 con 0x7fe7041515a0 2024-01-17T22:59:11.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:11.864+0000 7fe701600640 1 -- 172.21.15.161:0/905230212 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fe6fc051770 con 0x7fe7041515a0 2024-01-17T22:59:12.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.012+0000 7fe70bc00640 1 -- 172.21.15.161:0/905230212 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe6d4005ad0 con 0x7fe7041515a0 2024-01-17T22:59:12.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.020+0000 7fe701600640 1 -- 172.21.15.161:0/905230212 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe6fc0190a0 con 0x7fe7041515a0 2024-01-17T22:59:12.018 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-01-17T22:59:12.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.020+0000 7fe70bc00640 1 -- 172.21.15.161:0/905230212 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe6dc066870 msgr2=0x7fe6dc068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:12.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.020+0000 7fe70bc00640 1 --2- 172.21.15.161:0/905230212 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe6dc066870 0x7fe6dc068d30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40ae000 tx=0x7fe6f40a6040 comp rx=0 tx=0).stop 2024-01-17T22:59:12.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.020+0000 7fe70bc00640 1 -- 172.21.15.161:0/905230212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7041515a0 msgr2=0x7fe704159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:12.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.020+0000 7fe70bc00640 1 --2- 172.21.15.161:0/905230212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7041515a0 0x7fe704159930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00b9c0 tx=0x7fe6fc00be80 comp rx=0 tx=0).stop 2024-01-17T22:59:12.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.020+0000 7fe70bc00640 1 -- 172.21.15.161:0/905230212 shutdown_connections 2024-01-17T22:59:12.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.020+0000 7fe70bc00640 1 --2- 172.21.15.161:0/905230212 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe6dc066870 0x7fe6dc068d30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.020+0000 7fe70bc00640 1 --2- 172.21.15.161:0/905230212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7041515a0 0x7fe704159930 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.020+0000 7fe70bc00640 1 --2- 172.21.15.161:0/905230212 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7040c9eb0 0x7fe7040c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.020+0000 7fe70bc00640 1 --2- 172.21.15.161:0/905230212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7040c9660 0x7fe7041480c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.020+0000 7fe70bc00640 1 -- 172.21.15.161:0/905230212 >> 172.21.15.161:0/905230212 conn(0x7fe704070580 msgr2=0x7fe7040b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:12.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.024+0000 7fe70bc00640 1 -- 172.21.15.161:0/905230212 shutdown_connections 2024-01-17T22:59:12.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.024+0000 7fe70bc00640 1 -- 172.21.15.161:0/905230212 wait complete. 2024-01-17T22:59:12.039 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-17T22:59:12.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.180+0000 7f034ba00640 1 Processor -- start 2024-01-17T22:59:12.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.180+0000 7f034ba00640 1 -- start start 2024-01-17T22:59:12.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.180+0000 7f034ba00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f03440b0640 0x7f03440b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:12.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.180+0000 7f034ba00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03440c5cc0 con 0x7f03440c6780 2024-01-17T22:59:12.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.180+0000 7f034ba00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03441575b0 con 0x7f03441516c0 2024-01-17T22:59:12.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.180+0000 7f034ba00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0344158410 con 0x7f03440b0640 2024-01-17T22:59:12.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.180+0000 7f0349a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f03440b0640 0x7f03440b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:12.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.180+0000 7f0343e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f03440c6780 0x7f03440c6ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50744/0 (socket says 172.21.15.161:50744) 2024-01-17T22:59:12.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.180+0000 7f0343e00640 1 -- 172.21.15.161:0/3551932611 learned_addr learned my addr 172.21.15.161:0/3551932611 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:12.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.184+0000 7f0349a00640 1 -- 172.21.15.161:0/3551932611 >> v1:172.21.15.190:6789/0 conn(0x7f03441516c0 legacy=0x7f034406db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:12.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.184+0000 7f0349a00640 1 -- 172.21.15.161:0/3551932611 >> v1:172.21.15.161:6789/0 conn(0x7f03440c6780 legacy=0x7f03440c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:12.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.184+0000 7f0349a00640 1 -- 172.21.15.161:0/3551932611 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0344157890 con 0x7f03440b0640 2024-01-17T22:59:12.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.188+0000 7f0349a00640 1 --2- 172.21.15.161:0/3551932611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03440b0640 0x7f03440b0a90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f033c009d90 tx=0x7f033c01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15149eeda5875c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:12.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.192+0000 7f0343400640 1 -- 172.21.15.161:0/3551932611 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c0af600 con 0x7f03440b0640 2024-01-17T22:59:12.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.192+0000 7f0343400640 1 -- 172.21.15.161:0/3551932611 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c0ab050 con 0x7f03440b0640 2024-01-17T22:59:12.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.192+0000 7f0343400640 1 -- 172.21.15.161:0/3551932611 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c0af980 con 0x7f03440b0640 2024-01-17T22:59:12.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.192+0000 7f034ba00640 1 -- 172.21.15.161:0/3551932611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03440b0640 msgr2=0x7f03440b0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:12.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.192+0000 7f034ba00640 1 --2- 172.21.15.161:0/3551932611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03440b0640 0x7f03440b0a90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f033c009d90 tx=0x7f033c01f130 comp rx=0 tx=0).stop 2024-01-17T22:59:12.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.196+0000 7f034ba00640 1 -- 172.21.15.161:0/3551932611 shutdown_connections 2024-01-17T22:59:12.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.196+0000 7f034ba00640 1 --2- 172.21.15.161:0/3551932611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03440b0640 0x7f03440b0a90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.196+0000 7f034ba00640 1 -- 172.21.15.161:0/3551932611 >> 172.21.15.161:0/3551932611 conn(0x7f03440c7a90 msgr2=0x7f03440c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:12.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.196+0000 7f034ba00640 1 -- 172.21.15.161:0/3551932611 shutdown_connections 2024-01-17T22:59:12.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.196+0000 7f034ba00640 1 -- 172.21.15.161:0/3551932611 wait complete. 2024-01-17T22:59:12.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.196+0000 7f034ba00640 1 Processor -- start 2024-01-17T22:59:12.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.196+0000 7f034ba00640 1 -- start start 2024-01-17T22:59:12.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.196+0000 7f034ba00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03440b0640 0x7f03440c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:12.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.196+0000 7f034ba00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03440c6780 0x7f0344151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:12.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.196+0000 7f034ba00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03441516c0 0x7f03440ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:12.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.196+0000 7f034ba00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03440c5810 con 0x7f03441516c0 2024-01-17T22:59:12.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.196+0000 7f034ba00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03441ed890 con 0x7f03440b0640 2024-01-17T22:59:12.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.196+0000 7f034ba00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03441ed560 con 0x7f03440c6780 2024-01-17T22:59:12.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.196+0000 7f0349a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03441516c0 0x7f03440ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:12.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.200+0000 7f0349a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03441516c0 0x7f03440ca220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52350/0 (socket says 172.21.15.161:52350) 2024-01-17T22:59:12.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.200+0000 7f0349a00640 1 -- 172.21.15.161:0/3613967280 learned_addr learned my addr 172.21.15.161:0/3613967280 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:12.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.200+0000 7f0343e00640 1 --2- 172.21.15.161:0/3613967280 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03440c6780 0x7f0344151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:12.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.200+0000 7f0349000640 1 --2- 172.21.15.161:0/3613967280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03440b0640 0x7f03440c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:12.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.200+0000 7f0349a00640 1 -- 172.21.15.161:0/3613967280 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03440c6780 msgr2=0x7f0344151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:12.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.200+0000 7f0349a00640 1 --2- 172.21.15.161:0/3613967280 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03440c6780 0x7f0344151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.200+0000 7f0349a00640 1 -- 172.21.15.161:0/3613967280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03440b0640 msgr2=0x7f03440c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:12.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.200+0000 7f0349a00640 1 --2- 172.21.15.161:0/3613967280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03440b0640 0x7f03440c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.200+0000 7f0349a00640 1 -- 172.21.15.161:0/3613967280 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c009a70 con 0x7f03441516c0 2024-01-17T22:59:12.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.204+0000 7f0349a00640 1 --2- 172.21.15.161:0/3613967280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03441516c0 0x7f03440ca220 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f033c01cd60 tx=0x7f033c01bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:12.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.208+0000 7f0340c00640 1 -- 172.21.15.161:0/3613967280 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c0afdb0 con 0x7f03441516c0 2024-01-17T22:59:12.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.208+0000 7f034ba00640 1 -- 172.21.15.161:0/3613967280 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0344152250 con 0x7f03441516c0 2024-01-17T22:59:12.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.208+0000 7f034ba00640 1 -- 172.21.15.161:0/3613967280 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0344154a10 con 0x7f03441516c0 2024-01-17T22:59:12.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.208+0000 7f0340c00640 1 -- 172.21.15.161:0/3613967280 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c0ba420 con 0x7f03441516c0 2024-01-17T22:59:12.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.208+0000 7f0340c00640 1 -- 172.21.15.161:0/3613967280 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c0ba790 con 0x7f03441516c0 2024-01-17T22:59:12.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.208+0000 7f034ba00640 1 -- 172.21.15.161:0/3613967280 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03441eda00 con 0x7f03441516c0 2024-01-17T22:59:12.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.228+0000 7f0340c00640 1 -- 172.21.15.161:0/3613967280 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f033c0ba8f0 con 0x7f03441516c0 2024-01-17T22:59:12.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.228+0000 7f0340c00640 1 --2- 172.21.15.161:0/3613967280 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f031c066840 0x7f031c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:12.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.228+0000 7f0349000640 1 --2- 172.21.15.161:0/3613967280 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f031c066840 0x7f031c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:12.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.228+0000 7f0349000640 1 --2- 172.21.15.161:0/3613967280 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f031c066840 0x7f031c068d00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0334001770 tx=0x7f0334009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:12.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.228+0000 7f0340c00640 1 -- 172.21.15.161:0/3613967280 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f033c0f4120 con 0x7f03441516c0 2024-01-17T22:59:12.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.476+0000 7f0340c00640 1 -- 172.21.15.161:0/3613967280 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f033c0f0460 con 0x7f03441516c0 2024-01-17T22:59:12.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.636+0000 7f034ba00640 1 -- 172.21.15.161:0/3613967280 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f03440746a0 con 0x7f03441516c0 2024-01-17T22:59:12.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.640+0000 7f0340c00640 1 -- 172.21.15.161:0/3613967280 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f033c0b40a0 con 0x7f03441516c0 2024-01-17T22:59:12.640 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2024-01-17T22:59:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.644+0000 7f034ba00640 1 -- 172.21.15.161:0/3613967280 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f031c066840 msgr2=0x7f031c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.644+0000 7f034ba00640 1 --2- 172.21.15.161:0/3613967280 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f031c066840 0x7f031c068d00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0334001770 tx=0x7f0334009040 comp rx=0 tx=0).stop 2024-01-17T22:59:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.644+0000 7f034ba00640 1 -- 172.21.15.161:0/3613967280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03441516c0 msgr2=0x7f03440ca220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.644+0000 7f034ba00640 1 --2- 172.21.15.161:0/3613967280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03441516c0 0x7f03440ca220 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f033c01cd60 tx=0x7f033c01bed0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.644+0000 7f034ba00640 1 -- 172.21.15.161:0/3613967280 shutdown_connections 2024-01-17T22:59:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.644+0000 7f034ba00640 1 --2- 172.21.15.161:0/3613967280 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f031c066840 0x7f031c068d00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.644+0000 7f034ba00640 1 --2- 172.21.15.161:0/3613967280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03441516c0 0x7f03440ca220 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.644+0000 7f034ba00640 1 --2- 172.21.15.161:0/3613967280 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03440c6780 0x7f0344151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.644+0000 7f034ba00640 1 --2- 172.21.15.161:0/3613967280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03440b0640 0x7f03440c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.644+0000 7f034ba00640 1 -- 172.21.15.161:0/3613967280 >> 172.21.15.161:0/3613967280 conn(0x7f03440c7a90 msgr2=0x7f034414fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:12.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.644+0000 7f034ba00640 1 -- 172.21.15.161:0/3613967280 shutdown_connections 2024-01-17T22:59:12.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.644+0000 7f034ba00640 1 -- 172.21.15.161:0/3613967280 wait complete. 2024-01-17T22:59:12.670 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-17T22:59:12.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.812+0000 7f87b1c00640 1 Processor -- start 2024-01-17T22:59:12.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.812+0000 7f87b1c00640 1 -- start start 2024-01-17T22:59:12.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.812+0000 7f87b1c00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f87ac151aa0 0x7f87ac0c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:12.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.812+0000 7f87b1c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ac0c9180 con 0x7f87ac0ca4d0 2024-01-17T22:59:12.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.812+0000 7f87b1c00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ac0ca940 con 0x7f87ac1516c0 2024-01-17T22:59:12.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.812+0000 7f87b1c00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac0c9b70 con 0x7f87ac151aa0 2024-01-17T22:59:12.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.812+0000 7f87ab400640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f87ac0ca4d0 0x7f87ac0c7ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50754/0 (socket says 172.21.15.161:50754) 2024-01-17T22:59:12.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.812+0000 7f87ab400640 1 -- 172.21.15.161:0/215527971 learned_addr learned my addr 172.21.15.161:0/215527971 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:12.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.812+0000 7f87aa000640 1 --2- 172.21.15.161:0/215527971 >> v2:172.21.15.190:3300/0 conn(0x7f87ac151aa0 0x7f87ac0c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:12.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.816+0000 7f87a9600640 1 -- 172.21.15.161:0/215527971 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828578237 0 0) 0x7f87ac0c9180 con 0x7f87ac0ca4d0 2024-01-17T22:59:12.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.816+0000 7f87a9600640 1 -- 172.21.15.161:0/215527971 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f878c003530 con 0x7f87ac0ca4d0 2024-01-17T22:59:12.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.820+0000 7f87a9600640 1 -- 172.21.15.161:0/215527971 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 899441951 0 0) 0x7f878c003530 con 0x7f87ac0ca4d0 2024-01-17T22:59:12.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.820+0000 7f87a9600640 1 -- 172.21.15.161:0/215527971 >> v2:172.21.15.190:3300/0 conn(0x7f87ac151aa0 msgr2=0x7f87ac0c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:12.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.820+0000 7f87a9600640 1 --2- 172.21.15.161:0/215527971 >> v2:172.21.15.190:3300/0 conn(0x7f87ac151aa0 0x7f87ac0c9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.820+0000 7f87a9600640 1 -- 172.21.15.161:0/215527971 >> v1:172.21.15.190:6789/0 conn(0x7f87ac1516c0 legacy=0x7f87ac0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:12.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.820+0000 7f87a9600640 1 -- 172.21.15.161:0/215527971 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac15ada0 con 0x7f87ac0ca4d0 2024-01-17T22:59:12.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.820+0000 7f87a9600640 1 -- 172.21.15.161:0/215527971 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f87a4001a00 con 0x7f87ac0ca4d0 2024-01-17T22:59:12.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.820+0000 7f87a9600640 1 -- 172.21.15.161:0/215527971 >> v1:172.21.15.161:6789/0 conn(0x7f87ac0ca4d0 legacy=0x7f87ac0c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:12.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.820+0000 7f87a9600640 1 --2- 172.21.15.161:0/215527971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f878c0039d0 0x7f878c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:12.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.820+0000 7f87a9600640 1 --2- 172.21.15.161:0/215527971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f878c0047d0 0x7f878c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:12.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.820+0000 7f87a9600640 1 --2- 172.21.15.161:0/215527971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f878c005190 0x7f878c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:12.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.820+0000 7f87a9600640 1 -- 172.21.15.161:0/215527971 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0c9b70 con 0x7f878c0039d0 2024-01-17T22:59:12.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.820+0000 7f87a9600640 1 -- 172.21.15.161:0/215527971 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c00c040 con 0x7f878c005190 2024-01-17T22:59:12.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.820+0000 7f87a9600640 1 -- 172.21.15.161:0/215527971 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c00c200 con 0x7f878c0047d0 2024-01-17T22:59:12.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.820+0000 7f87aa000640 1 --2- 172.21.15.161:0/215527971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f878c0047d0 0x7f878c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:12.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.820+0000 7f87ab400640 1 --2- 172.21.15.161:0/215527971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f878c005190 0x7f878c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:12.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.824+0000 7f87aaa00640 1 --2- 172.21.15.161:0/215527971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f878c0039d0 0x7f878c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:12.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.824+0000 7f87aaa00640 1 -- 172.21.15.161:0/215527971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f878c0047d0 msgr2=0x7f878c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:12.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.824+0000 7f87aaa00640 1 --2- 172.21.15.161:0/215527971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f878c0047d0 0x7f878c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.824+0000 7f87aaa00640 1 -- 172.21.15.161:0/215527971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f878c005190 msgr2=0x7f878c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:12.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.824+0000 7f87aaa00640 1 --2- 172.21.15.161:0/215527971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f878c005190 0x7f878c00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.824+0000 7f87aaa00640 1 -- 172.21.15.161:0/215527971 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c003530 con 0x7f878c0039d0 2024-01-17T22:59:12.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.824+0000 7f87ab400640 1 -- 172.21.15.161:0/215527971 reap_dead start 2024-01-17T22:59:12.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.828+0000 7f87aaa00640 1 --2- 172.21.15.161:0/215527971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f878c0039d0 0x7f878c003dd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f879c003db0 tx=0x7f879c01c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b8d7ecfbee7595 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:12.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.832+0000 7f87a9600640 1 -- 172.21.15.161:0/215527971 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0ab600 con 0x7f878c0039d0 2024-01-17T22:59:12.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.832+0000 7f87a9600640 1 -- 172.21.15.161:0/215527971 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c0a7050 con 0x7f878c0039d0 2024-01-17T22:59:12.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.832+0000 7f87a9600640 1 -- 172.21.15.161:0/215527971 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0ab9c0 con 0x7f878c0039d0 2024-01-17T22:59:12.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.832+0000 7f87b1c00640 1 -- 172.21.15.161:0/215527971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f878c0039d0 msgr2=0x7f878c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:12.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.832+0000 7f87b1c00640 1 --2- 172.21.15.161:0/215527971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f878c0039d0 0x7f878c003dd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f879c003db0 tx=0x7f879c01c2e0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.832+0000 7f87b1c00640 1 -- 172.21.15.161:0/215527971 shutdown_connections 2024-01-17T22:59:12.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.832+0000 7f87b1c00640 1 --2- 172.21.15.161:0/215527971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f878c0039d0 0x7f878c003dd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.832+0000 7f87b1c00640 1 -- 172.21.15.161:0/215527971 >> 172.21.15.161:0/215527971 conn(0x7f87ac061100 msgr2=0x7f87ac061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:12.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.832+0000 7f87b1c00640 1 -- 172.21.15.161:0/215527971 shutdown_connections 2024-01-17T22:59:12.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.832+0000 7f87b1c00640 1 -- 172.21.15.161:0/215527971 wait complete. 2024-01-17T22:59:12.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.836+0000 7f87b1c00640 1 Processor -- start 2024-01-17T22:59:12.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.836+0000 7f87b1c00640 1 -- start start 2024-01-17T22:59:12.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.836+0000 7f87b1c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f878c0039d0 0x7f87ac159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:12.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.836+0000 7f87b1c00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87ac14fa20 0x7f87ac154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:12.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.836+0000 7f87b1c00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87ac149a60 0x7f87ac149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:12.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.836+0000 7f87b1c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac14a420 con 0x7f878c0039d0 2024-01-17T22:59:12.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.836+0000 7f87b1c00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac1edd80 con 0x7f87ac14fa20 2024-01-17T22:59:12.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.836+0000 7f87b1c00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac154cf0 con 0x7f87ac149a60 2024-01-17T22:59:12.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.836+0000 7f87aaa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f878c0039d0 0x7f87ac159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:12.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.836+0000 7f87aaa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f878c0039d0 0x7f87ac159d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52376/0 (socket says 172.21.15.161:52376) 2024-01-17T22:59:12.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.836+0000 7f87aaa00640 1 -- 172.21.15.161:0/887863284 learned_addr learned my addr 172.21.15.161:0/887863284 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:12.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.836+0000 7f87aa000640 1 --2- 172.21.15.161:0/887863284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87ac14fa20 0x7f87ac154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:12.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.840+0000 7f87ab400640 1 --2- 172.21.15.161:0/887863284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87ac149a60 0x7f87ac149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:12.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.840+0000 7f87aaa00640 1 -- 172.21.15.161:0/887863284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87ac149a60 msgr2=0x7f87ac149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:12.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.840+0000 7f87aaa00640 1 --2- 172.21.15.161:0/887863284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87ac149a60 0x7f87ac149ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.840+0000 7f87aaa00640 1 -- 172.21.15.161:0/887863284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87ac14fa20 msgr2=0x7f87ac154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:12.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.840+0000 7f87aaa00640 1 --2- 172.21.15.161:0/887863284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87ac14fa20 0x7f87ac154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:12.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.840+0000 7f87aaa00640 1 -- 172.21.15.161:0/887863284 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac1ed450 con 0x7f878c0039d0 2024-01-17T22:59:12.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.844+0000 7f87aaa00640 1 --2- 172.21.15.161:0/887863284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f878c0039d0 0x7f87ac159d60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f879c01c110 tx=0x7f878c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:12.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.848+0000 7f87a2a00640 1 -- 172.21.15.161:0/887863284 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c007450 con 0x7f878c0039d0 2024-01-17T22:59:12.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.848+0000 7f87a2a00640 1 -- 172.21.15.161:0/887863284 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c0075b0 con 0x7f878c0039d0 2024-01-17T22:59:12.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.848+0000 7f87a2a00640 1 -- 172.21.15.161:0/887863284 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0b4620 con 0x7f878c0039d0 2024-01-17T22:59:12.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.848+0000 7f87b1c00640 1 -- 172.21.15.161:0/887863284 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac1ed730 con 0x7f878c0039d0 2024-01-17T22:59:12.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.848+0000 7f87b1c00640 1 -- 172.21.15.161:0/887863284 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ac1ed100 con 0x7f878c0039d0 2024-01-17T22:59:12.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.848+0000 7f87b1c00640 1 -- 172.21.15.161:0/887863284 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ac150680 con 0x7f878c0039d0 2024-01-17T22:59:12.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.868+0000 7f87a2a00640 1 -- 172.21.15.161:0/887863284 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f879c0b2040 con 0x7f878c0039d0 2024-01-17T22:59:12.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.868+0000 7f87a2a00640 1 --2- 172.21.15.161:0/887863284 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f87840668c0 0x7f8784068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:12.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.868+0000 7f87aa000640 1 --2- 172.21.15.161:0/887863284 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f87840668c0 0x7f8784068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:12.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:12.872+0000 7f87aa000640 1 --2- 172.21.15.161:0/887863284 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f87840668c0 0x7f8784068d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0c3b40 tx=0x7f8794009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:13.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.096+0000 7f87a2a00640 1 -- 172.21.15.161:0/887863284 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f879c0ef660 con 0x7f878c0039d0 2024-01-17T22:59:13.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.096+0000 7f87a2a00640 1 -- 172.21.15.161:0/887863284 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f879c0eb9a0 con 0x7f878c0039d0 2024-01-17T22:59:13.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.248+0000 7f87b1c00640 1 -- 172.21.15.161:0/887863284 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f87ac06b170 con 0x7f878c0039d0 2024-01-17T22:59:13.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.256+0000 7f87a2a00640 1 -- 172.21.15.161:0/887863284 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f879c0b0020 con 0x7f878c0039d0 2024-01-17T22:59:13.254 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-01-17T22:59:13.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.256+0000 7f87b1c00640 1 -- 172.21.15.161:0/887863284 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f87840668c0 msgr2=0x7f8784068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:13.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.256+0000 7f87b1c00640 1 --2- 172.21.15.161:0/887863284 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f87840668c0 0x7f8784068d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0c3b40 tx=0x7f8794009190 comp rx=0 tx=0).stop 2024-01-17T22:59:13.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.256+0000 7f87b1c00640 1 -- 172.21.15.161:0/887863284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f878c0039d0 msgr2=0x7f87ac159d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:13.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.256+0000 7f87b1c00640 1 --2- 172.21.15.161:0/887863284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f878c0039d0 0x7f87ac159d60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f879c01c110 tx=0x7f878c005800 comp rx=0 tx=0).stop 2024-01-17T22:59:13.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.256+0000 7f87b1c00640 1 -- 172.21.15.161:0/887863284 shutdown_connections 2024-01-17T22:59:13.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.256+0000 7f87b1c00640 1 --2- 172.21.15.161:0/887863284 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f87840668c0 0x7f8784068d80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:13.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.256+0000 7f87b1c00640 1 --2- 172.21.15.161:0/887863284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87ac14fa20 0x7f87ac154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:13.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.256+0000 7f87b1c00640 1 --2- 172.21.15.161:0/887863284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87ac149a60 0x7f87ac149ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:13.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.256+0000 7f87b1c00640 1 --2- 172.21.15.161:0/887863284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f878c0039d0 0x7f87ac159d60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:13.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.256+0000 7f87b1c00640 1 -- 172.21.15.161:0/887863284 >> 172.21.15.161:0/887863284 conn(0x7f87ac061100 msgr2=0x7f87ac0b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:13.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.260+0000 7f87b1c00640 1 -- 172.21.15.161:0/887863284 shutdown_connections 2024-01-17T22:59:13.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.260+0000 7f87b1c00640 1 -- 172.21.15.161:0/887863284 wait complete. 2024-01-17T22:59:13.277 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-17T22:59:13.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.420+0000 7efdbf600640 1 Processor -- start 2024-01-17T22:59:13.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.420+0000 7efdbf600640 1 -- start start 2024-01-17T22:59:13.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.420+0000 7efdbf600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8150020 0x7efdb8155b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:13.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.420+0000 7efdbf600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efdb8156090 0x7efdb80c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:13.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.420+0000 7efdbf600640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efdb806c650 0x7efdb80c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:13.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.420+0000 7efdbf600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb8159a50 con 0x7efdb8156090 2024-01-17T22:59:13.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.420+0000 7efdbf600640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb8159160 con 0x7efdb806c650 2024-01-17T22:59:13.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.420+0000 7efdbf600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80cd340 con 0x7efdb8150020 2024-01-17T22:59:13.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.420+0000 7efdb7e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efdb8156090 0x7efdb80c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:13.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.424+0000 7efdb7e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efdb8156090 0x7efdb80c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52386/0 (socket says 172.21.15.161:52386) 2024-01-17T22:59:13.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.424+0000 7efdb7e00640 1 -- 172.21.15.161:0/650153491 learned_addr learned my addr 172.21.15.161:0/650153491 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:13.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.424+0000 7efdbe000640 1 --2- 172.21.15.161:0/650153491 >> v2:172.21.15.190:3300/0 conn(0x7efdb806c650 0x7efdb80c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:13.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.424+0000 7efdbcc00640 1 --2- 172.21.15.161:0/650153491 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8150020 0x7efdb8155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:13.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.424+0000 7efdb7e00640 1 -- 172.21.15.161:0/650153491 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8150020 msgr2=0x7efdb8155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:13.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.424+0000 7efdb7e00640 1 --2- 172.21.15.161:0/650153491 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8150020 0x7efdb8155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:13.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.424+0000 7efdb7e00640 1 -- 172.21.15.161:0/650153491 >> v2:172.21.15.190:3300/0 conn(0x7efdb806c650 msgr2=0x7efdb80c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:13.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.424+0000 7efdb7e00640 1 --2- 172.21.15.161:0/650153491 >> v2:172.21.15.190:3300/0 conn(0x7efdb806c650 0x7efdb80c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:13.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.424+0000 7efdb7e00640 1 -- 172.21.15.161:0/650153491 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb8159400 con 0x7efdb8156090 2024-01-17T22:59:13.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.428+0000 7efdb7e00640 1 --2- 172.21.15.161:0/650153491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb8156090 0x7efdb80c8fb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efdb806f410 tx=0x7efda001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f807d286b301c094 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:13.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.432+0000 7efdb7400640 1 -- 172.21.15.161:0/650153491 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda00a89b0 con 0x7efdb8156090 2024-01-17T22:59:13.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.432+0000 7efdb7400640 1 -- 172.21.15.161:0/650153491 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda00a8b10 con 0x7efdb8156090 2024-01-17T22:59:13.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.432+0000 7efdb7400640 1 -- 172.21.15.161:0/650153491 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda00a8ea0 con 0x7efdb8156090 2024-01-17T22:59:13.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.432+0000 7efdbf600640 1 -- 172.21.15.161:0/650153491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb8156090 msgr2=0x7efdb80c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:13.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.432+0000 7efdbf600640 1 --2- 172.21.15.161:0/650153491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb8156090 0x7efdb80c8fb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efdb806f410 tx=0x7efda001ecf0 comp rx=0 tx=0).stop 2024-01-17T22:59:13.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.432+0000 7efdbf600640 1 -- 172.21.15.161:0/650153491 shutdown_connections 2024-01-17T22:59:13.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.432+0000 7efdbf600640 1 --2- 172.21.15.161:0/650153491 >> v2:172.21.15.190:3300/0 conn(0x7efdb806c650 0x7efdb80c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:13.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.432+0000 7efdbf600640 1 --2- 172.21.15.161:0/650153491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb8156090 0x7efdb80c8fb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:13.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.432+0000 7efdbf600640 1 --2- 172.21.15.161:0/650153491 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8150020 0x7efdb8155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:13.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.432+0000 7efdbf600640 1 -- 172.21.15.161:0/650153491 >> 172.21.15.161:0/650153491 conn(0x7efdb8061100 msgr2=0x7efdb806e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:13.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.436+0000 7efdbf600640 1 -- 172.21.15.161:0/650153491 shutdown_connections 2024-01-17T22:59:13.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.436+0000 7efdbf600640 1 -- 172.21.15.161:0/650153491 wait complete. 2024-01-17T22:59:13.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.436+0000 7efdbf600640 1 Processor -- start 2024-01-17T22:59:13.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.436+0000 7efdbf600640 1 -- start start 2024-01-17T22:59:13.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.436+0000 7efdbf600640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb806c650 0x7efdb81485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:13.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.436+0000 7efdbf600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8150020 0x7efdb81539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:13.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.436+0000 7efdbf600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb8156090 0x7efdb81467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:13.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.436+0000 7efdbf600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb8146d00 con 0x7efdb8156090 2024-01-17T22:59:13.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.436+0000 7efdbf600640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb8148160 con 0x7efdb806c650 2024-01-17T22:59:13.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.436+0000 7efdbf600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb8147550 con 0x7efdb8150020 2024-01-17T22:59:13.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.436+0000 7efdbe000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb8156090 0x7efdb81467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:13.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.436+0000 7efdbe000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb8156090 0x7efdb81467c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52398/0 (socket says 172.21.15.161:52398) 2024-01-17T22:59:13.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.436+0000 7efdbe000640 1 -- 172.21.15.161:0/2717112333 learned_addr learned my addr 172.21.15.161:0/2717112333 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:13.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.440+0000 7efdb7e00640 1 --2- 172.21.15.161:0/2717112333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8150020 0x7efdb81539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:13.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.440+0000 7efdbcc00640 1 --2- 172.21.15.161:0/2717112333 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb806c650 0x7efdb81485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:13.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.440+0000 7efdbe000640 1 -- 172.21.15.161:0/2717112333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8150020 msgr2=0x7efdb81539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:13.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.440+0000 7efdbe000640 1 --2- 172.21.15.161:0/2717112333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8150020 0x7efdb81539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:13.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.440+0000 7efdbe000640 1 -- 172.21.15.161:0/2717112333 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb806c650 msgr2=0x7efdb81485f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:13.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.440+0000 7efdbe000640 1 --2- 172.21.15.161:0/2717112333 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb806c650 0x7efdb81485f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:13.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.440+0000 7efdbe000640 1 -- 172.21.15.161:0/2717112333 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda00094d0 con 0x7efdb8156090 2024-01-17T22:59:13.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.444+0000 7efdbe000640 1 --2- 172.21.15.161:0/2717112333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb8156090 0x7efdb81467c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efdb0007e30 tx=0x7efdb000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:13.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.448+0000 7efdb4c00640 1 -- 172.21.15.161:0/2717112333 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb0014420 con 0x7efdb8156090 2024-01-17T22:59:13.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.448+0000 7efdb4c00640 1 -- 172.21.15.161:0/2717112333 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb0014580 con 0x7efdb8156090 2024-01-17T22:59:13.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.448+0000 7efdb4c00640 1 -- 172.21.15.161:0/2717112333 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb0014930 con 0x7efdb8156090 2024-01-17T22:59:13.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.448+0000 7efdbf600640 1 -- 172.21.15.161:0/2717112333 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb8147830 con 0x7efdb8156090 2024-01-17T22:59:13.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.448+0000 7efdbf600640 1 -- 172.21.15.161:0/2717112333 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb8147df0 con 0x7efdb8156090 2024-01-17T22:59:13.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.448+0000 7efdbf600640 1 -- 172.21.15.161:0/2717112333 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb81482d0 con 0x7efdb8156090 2024-01-17T22:59:13.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.688+0000 7efdb4c00640 1 -- 172.21.15.161:0/2717112333 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7efdb0014a90 con 0x7efdb8156090 2024-01-17T22:59:13.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.692+0000 7efdb4c00640 1 --2- 172.21.15.161:0/2717112333 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efd90066890 0x7efd90068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:13.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.692+0000 7efdbcc00640 1 --2- 172.21.15.161:0/2717112333 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efd90066890 0x7efd90068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:13.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.692+0000 7efdbcc00640 1 --2- 172.21.15.161:0/2717112333 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efd90066890 0x7efd90068d50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efda8007a60 tx=0x7efda8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:13.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.708+0000 7efdb4c00640 1 -- 172.21.15.161:0/2717112333 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7efdb0056370 con 0x7efdb8156090 2024-01-17T22:59:13.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.708+0000 7efdb4c00640 1 -- 172.21.15.161:0/2717112333 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7efdb00526b0 con 0x7efdb8156090 2024-01-17T22:59:13.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.880+0000 7efdbf600640 1 -- 172.21.15.161:0/2717112333 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efdb80746a0 con 0x7efdb8156090 2024-01-17T22:59:13.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.884+0000 7efdb4c00640 1 -- 172.21.15.161:0/2717112333 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7efdb0055cd0 con 0x7efdb8156090 2024-01-17T22:59:13.884 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2024-01-17T22:59:13.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.888+0000 7efdbf600640 1 -- 172.21.15.161:0/2717112333 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efd90066890 msgr2=0x7efd90068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.888+0000 7efdbf600640 1 --2- 172.21.15.161:0/2717112333 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efd90066890 0x7efd90068d50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efda8007a60 tx=0x7efda8008040 comp rx=0 tx=0).stop 2024-01-17T22:59:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.888+0000 7efdbf600640 1 -- 172.21.15.161:0/2717112333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb8156090 msgr2=0x7efdb81467c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.888+0000 7efdbf600640 1 --2- 172.21.15.161:0/2717112333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb8156090 0x7efdb81467c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efdb0007e30 tx=0x7efdb000e4b0 comp rx=0 tx=0).stop 2024-01-17T22:59:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.888+0000 7efdbf600640 1 -- 172.21.15.161:0/2717112333 shutdown_connections 2024-01-17T22:59:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.888+0000 7efdbf600640 1 --2- 172.21.15.161:0/2717112333 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efd90066890 0x7efd90068d50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.888+0000 7efdbf600640 1 --2- 172.21.15.161:0/2717112333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb8156090 0x7efdb81467c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.888+0000 7efdbf600640 1 --2- 172.21.15.161:0/2717112333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdb8150020 0x7efdb81539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.888+0000 7efdbf600640 1 --2- 172.21.15.161:0/2717112333 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdb806c650 0x7efdb81485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.888+0000 7efdbf600640 1 -- 172.21.15.161:0/2717112333 >> 172.21.15.161:0/2717112333 conn(0x7efdb8061100 msgr2=0x7efdb80cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.888+0000 7efdbf600640 1 -- 172.21.15.161:0/2717112333 shutdown_connections 2024-01-17T22:59:13.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:13.888+0000 7efdbf600640 1 -- 172.21.15.161:0/2717112333 wait complete. 2024-01-17T22:59:13.911 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi161.front.sepia.ceph.com... 2024-01-17T22:59:13.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:13.912 DEBUG:teuthology.orchestra.run.smithi161:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-01-17T22:59:13.946 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi161.stderr:ceph-fuse[32110]: fuse finished with error 0 and tester_r 0 2024-01-17T22:59:13.949 INFO:teuthology.orchestra.run:waiting for 300 2024-01-17T22:59:20.050 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2024-01-17T22:59:20.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:20.051 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-01-17T22:59:20.334 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T22:59:20.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.480+0000 7fdd8a800640 1 Processor -- start 2024-01-17T22:59:20.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.480+0000 7fdd8a800640 1 -- start start 2024-01-17T22:59:20.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.484+0000 7fdd8a800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdd841517a0 0x7fdd8406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:20.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.484+0000 7fdd8a800640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdd8406d210 0x7fdd84072300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:20.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.484+0000 7fdd8a800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8415b9c0 con 0x7fdd84072840 2024-01-17T22:59:20.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.484+0000 7fdd8a800640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8415ae40 con 0x7fdd8406d210 2024-01-17T22:59:20.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.484+0000 7fdd8a800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8415b120 con 0x7fdd841517a0 2024-01-17T22:59:20.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.484+0000 7fdd83400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdd841517a0 0x7fdd8406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:20.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.484+0000 7fdd83400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdd841517a0 0x7fdd8406ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:52772/0 (socket says 172.21.15.161:52772) 2024-01-17T22:59:20.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.484+0000 7fdd82a00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdd8406d210 0x7fdd84072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:20.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.484+0000 7fdd83400640 1 -- 172.21.15.161:0/944360356 learned_addr learned my addr 172.21.15.161:0/944360356 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:20.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.492+0000 7fdd83400640 1 -- 172.21.15.161:0/944360356 >> v2:172.21.15.190:3300/0 conn(0x7fdd8406d210 msgr2=0x7fdd84072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:20.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.492+0000 7fdd83400640 1 --2- 172.21.15.161:0/944360356 >> v2:172.21.15.190:3300/0 conn(0x7fdd8406d210 0x7fdd84072300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:20.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.492+0000 7fdd83400640 1 -- 172.21.15.161:0/944360356 >> v1:172.21.15.190:6789/0 conn(0x7fdd84072840 legacy=0x7fdd84157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:20.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.492+0000 7fdd83400640 1 -- 172.21.15.161:0/944360356 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8415b400 con 0x7fdd841517a0 2024-01-17T22:59:20.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.500+0000 7fdd83400640 1 --2- 172.21.15.161:0/944360356 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdd841517a0 0x7fdd8406ccd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009870 tx=0x7fdd7401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0af8d0067e9ccaa server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:20.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.512+0000 7fdd82000640 1 -- 172.21.15.161:0/944360356 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd740aa5f0 con 0x7fdd841517a0 2024-01-17T22:59:20.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.512+0000 7fdd82000640 1 -- 172.21.15.161:0/944360356 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd740aa750 con 0x7fdd841517a0 2024-01-17T22:59:20.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.512+0000 7fdd82000640 1 -- 172.21.15.161:0/944360356 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd740aaae0 con 0x7fdd841517a0 2024-01-17T22:59:20.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.512+0000 7fdd8a800640 1 -- 172.21.15.161:0/944360356 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdd841517a0 msgr2=0x7fdd8406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:20.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.512+0000 7fdd8a800640 1 --2- 172.21.15.161:0/944360356 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdd841517a0 0x7fdd8406ccd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009870 tx=0x7fdd7401c4d0 comp rx=0 tx=0).stop 2024-01-17T22:59:20.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.512+0000 7fdd8a800640 1 -- 172.21.15.161:0/944360356 shutdown_connections 2024-01-17T22:59:20.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.512+0000 7fdd8a800640 1 --2- 172.21.15.161:0/944360356 >> v2:172.21.15.190:3300/0 conn(0x7fdd8406d210 0x7fdd84072300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:20.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.512+0000 7fdd8a800640 1 --2- 172.21.15.161:0/944360356 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdd841517a0 0x7fdd8406ccd0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:20.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.512+0000 7fdd8a800640 1 -- 172.21.15.161:0/944360356 >> 172.21.15.161:0/944360356 conn(0x7fdd840cb070 msgr2=0x7fdd840cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:20.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.512+0000 7fdd8a800640 1 -- 172.21.15.161:0/944360356 shutdown_connections 2024-01-17T22:59:20.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.512+0000 7fdd8a800640 1 -- 172.21.15.161:0/944360356 wait complete. 2024-01-17T22:59:20.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.516+0000 7fdd8a800640 1 Processor -- start 2024-01-17T22:59:20.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.516+0000 7fdd8a800640 1 -- start start 2024-01-17T22:59:20.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.516+0000 7fdd8a800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd8406d210 0x7fdd841f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:20.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.516+0000 7fdd8a800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdd84072840 0x7fdd840c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:20.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.516+0000 7fdd8a800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd841517a0 0x7fdd84155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:20.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.516+0000 7fdd8a800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd841559b0 con 0x7fdd841517a0 2024-01-17T22:59:20.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.516+0000 7fdd8a800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd84155380 con 0x7fdd8406d210 2024-01-17T22:59:20.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.516+0000 7fdd8a800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8414f0f0 con 0x7fdd84072840 2024-01-17T22:59:20.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.516+0000 7fdd83e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd841517a0 0x7fdd84155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:20.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.516+0000 7fdd82a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdd84072840 0x7fdd840c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:20.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.516+0000 7fdd83e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd841517a0 0x7fdd84155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52414/0 (socket says 172.21.15.161:52414) 2024-01-17T22:59:20.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.516+0000 7fdd83e00640 1 -- 172.21.15.161:0/2808889195 learned_addr learned my addr 172.21.15.161:0/2808889195 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:20.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.516+0000 7fdd83400640 1 --2- 172.21.15.161:0/2808889195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd8406d210 0x7fdd841f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:20.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.520+0000 7fdd83e00640 1 -- 172.21.15.161:0/2808889195 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdd84072840 msgr2=0x7fdd840c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:20.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.520+0000 7fdd83e00640 1 --2- 172.21.15.161:0/2808889195 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdd84072840 0x7fdd840c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:20.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.520+0000 7fdd83e00640 1 -- 172.21.15.161:0/2808889195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd8406d210 msgr2=0x7fdd841f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:20.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.520+0000 7fdd83e00640 1 --2- 172.21.15.161:0/2808889195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd8406d210 0x7fdd841f2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:20.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.520+0000 7fdd83e00640 1 -- 172.21.15.161:0/2808889195 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd740094d0 con 0x7fdd841517a0 2024-01-17T22:59:20.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.524+0000 7fdd83e00640 1 --2- 172.21.15.161:0/2808889195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd841517a0 0x7fdd84155dd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00b970 tx=0x7fdd7c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:20.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.528+0000 7fdd7b400640 1 -- 172.21.15.161:0/2808889195 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c00cb40 con 0x7fdd841517a0 2024-01-17T22:59:20.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.528+0000 7fdd7b400640 1 -- 172.21.15.161:0/2808889195 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c00cca0 con 0x7fdd841517a0 2024-01-17T22:59:20.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.528+0000 7fdd7b400640 1 -- 172.21.15.161:0/2808889195 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c014680 con 0x7fdd841517a0 2024-01-17T22:59:20.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.528+0000 7fdd8a800640 1 -- 172.21.15.161:0/2808889195 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd841f2e90 con 0x7fdd841517a0 2024-01-17T22:59:20.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.528+0000 7fdd8a800640 1 -- 172.21.15.161:0/2808889195 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd841f3430 con 0x7fdd841517a0 2024-01-17T22:59:20.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.528+0000 7fdd8a800640 1 -- 172.21.15.161:0/2808889195 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd84155af0 con 0x7fdd841517a0 2024-01-17T22:59:20.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.548+0000 7fdd7b400640 1 -- 172.21.15.161:0/2808889195 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fdd7c003980 con 0x7fdd841517a0 2024-01-17T22:59:20.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.548+0000 7fdd7b400640 1 --2- 172.21.15.161:0/2808889195 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fdd5c0668c0 0x7fdd5c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:20.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.548+0000 7fdd83400640 1 --2- 172.21.15.161:0/2808889195 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fdd5c0668c0 0x7fdd5c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:20.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.548+0000 7fdd7b400640 1 -- 172.21.15.161:0/2808889195 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fdd7c01fe50 con 0x7fdd841517a0 2024-01-17T22:59:20.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.548+0000 7fdd83400640 1 --2- 172.21.15.161:0/2808889195 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fdd5c0668c0 0x7fdd5c068d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdd740ae000 tx=0x7fdd740a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:20.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.776+0000 7fdd7b400640 1 -- 172.21.15.161:0/2808889195 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fdd7c0511c0 con 0x7fdd841517a0 2024-01-17T22:59:20.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.936+0000 7fdd8a800640 1 -- 172.21.15.161:0/2808889195 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd84155af0 con 0x7fdd841517a0 2024-01-17T22:59:20.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.980+0000 7fdd7b400640 1 -- 172.21.15.161:0/2808889195 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18587 (secure 0 0 0) 0x7fdd84155af0 con 0x7fdd841517a0 2024-01-17T22:59:20.978 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:20.978 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":28,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:59:08.571619+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T22:58:46.757110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T22:58:47.930512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T22:58:53.561624+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.614036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.746767+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.689096+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.706485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.628004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.680048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.571249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]},{"pgid":"4.14","mappings":[{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:59:20.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.980+0000 7fdd8a800640 1 -- 172.21.15.161:0/2808889195 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fdd5c0668c0 msgr2=0x7fdd5c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:20.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.980+0000 7fdd8a800640 1 --2- 172.21.15.161:0/2808889195 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fdd5c0668c0 0x7fdd5c068d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdd740ae000 tx=0x7fdd740a7000 comp rx=0 tx=0).stop 2024-01-17T22:59:20.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.984+0000 7fdd8a800640 1 -- 172.21.15.161:0/2808889195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd841517a0 msgr2=0x7fdd84155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:20.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.984+0000 7fdd8a800640 1 --2- 172.21.15.161:0/2808889195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd841517a0 0x7fdd84155dd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00b970 tx=0x7fdd7c00be30 comp rx=0 tx=0).stop 2024-01-17T22:59:20.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.984+0000 7fdd8a800640 1 -- 172.21.15.161:0/2808889195 shutdown_connections 2024-01-17T22:59:20.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.984+0000 7fdd8a800640 1 --2- 172.21.15.161:0/2808889195 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fdd5c0668c0 0x7fdd5c068d80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:20.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.984+0000 7fdd8a800640 1 --2- 172.21.15.161:0/2808889195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd841517a0 0x7fdd84155dd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:20.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.984+0000 7fdd8a800640 1 --2- 172.21.15.161:0/2808889195 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdd84072840 0x7fdd840c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:20.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.984+0000 7fdd8a800640 1 --2- 172.21.15.161:0/2808889195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd8406d210 0x7fdd841f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:20.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.984+0000 7fdd8a800640 1 -- 172.21.15.161:0/2808889195 >> 172.21.15.161:0/2808889195 conn(0x7fdd840cb070 msgr2=0x7fdd84157a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:20.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.984+0000 7fdd8a800640 1 -- 172.21.15.161:0/2808889195 shutdown_connections 2024-01-17T22:59:20.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:20.984+0000 7fdd8a800640 1 -- 172.21.15.161:0/2808889195 wait complete. 2024-01-17T22:59:21.004 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T22:59:21.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.144+0000 7f98a8800640 1 Processor -- start 2024-01-17T22:59:21.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.144+0000 7f98a8800640 1 -- start start 2024-01-17T22:59:21.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.148+0000 7f98a8800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98a01517a0 0x7f98a006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:21.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.148+0000 7f98a8800640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f98a006d210 0x7f98a0072300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:21.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.148+0000 7f98a8800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a015b9c0 con 0x7f98a0072840 2024-01-17T22:59:21.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.148+0000 7f98a8800640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a015ae40 con 0x7f98a006d210 2024-01-17T22:59:21.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.148+0000 7f98a8800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a015b120 con 0x7f98a01517a0 2024-01-17T22:59:21.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.148+0000 7f98a5400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f98a006d210 0x7f98a0072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:21.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.148+0000 7f98a5e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98a01517a0 0x7f98a006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:21.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.148+0000 7f98a5400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f98a006d210 0x7f98a0072300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:48470/0 (socket says 172.21.15.161:48470) 2024-01-17T22:59:21.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.148+0000 7f98a5400640 1 -- 172.21.15.161:0/1695006710 learned_addr learned my addr 172.21.15.161:0/1695006710 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:21.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.156+0000 7f98a5e00640 1 -- 172.21.15.161:0/1695006710 >> v2:172.21.15.190:3300/0 conn(0x7f98a006d210 msgr2=0x7f98a0072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:21.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.156+0000 7f98a5e00640 1 --2- 172.21.15.161:0/1695006710 >> v2:172.21.15.190:3300/0 conn(0x7f98a006d210 0x7f98a0072300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:21.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.156+0000 7f98a5e00640 1 -- 172.21.15.161:0/1695006710 >> v1:172.21.15.190:6789/0 conn(0x7f98a0072840 legacy=0x7f98a0157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:21.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.156+0000 7f98a5e00640 1 -- 172.21.15.161:0/1695006710 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a015b400 con 0x7f98a01517a0 2024-01-17T22:59:21.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.164+0000 7f98a5e00640 1 --2- 172.21.15.161:0/1695006710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98a01517a0 0x7f98a006ccd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f98900097c0 tx=0x7f989001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a923bd962e7f30e server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:21.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a4a00640 1 -- 172.21.15.161:0/1695006710 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98900ad660 con 0x7f98a01517a0 2024-01-17T22:59:21.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a4a00640 1 -- 172.21.15.161:0/1695006710 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98900ad7c0 con 0x7f98a01517a0 2024-01-17T22:59:21.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a4a00640 1 -- 172.21.15.161:0/1695006710 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98900adb50 con 0x7f98a01517a0 2024-01-17T22:59:21.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a8800640 1 -- 172.21.15.161:0/1695006710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98a01517a0 msgr2=0x7f98a006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:21.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a8800640 1 --2- 172.21.15.161:0/1695006710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98a01517a0 0x7f98a006ccd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f98900097c0 tx=0x7f989001c450 comp rx=0 tx=0).stop 2024-01-17T22:59:21.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a8800640 1 -- 172.21.15.161:0/1695006710 shutdown_connections 2024-01-17T22:59:21.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a8800640 1 --2- 172.21.15.161:0/1695006710 >> v2:172.21.15.190:3300/0 conn(0x7f98a006d210 0x7f98a0072300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:21.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a8800640 1 --2- 172.21.15.161:0/1695006710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98a01517a0 0x7f98a006ccd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:21.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a8800640 1 -- 172.21.15.161:0/1695006710 >> 172.21.15.161:0/1695006710 conn(0x7f98a00cb070 msgr2=0x7f98a00cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:21.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a8800640 1 -- 172.21.15.161:0/1695006710 shutdown_connections 2024-01-17T22:59:21.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a8800640 1 -- 172.21.15.161:0/1695006710 wait complete. 2024-01-17T22:59:21.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a8800640 1 Processor -- start 2024-01-17T22:59:21.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a8800640 1 -- start start 2024-01-17T22:59:21.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a8800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98a006d210 0x7f98a0071430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:21.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a8800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a0072840 0x7f98a01504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:21.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a8800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98a01517a0 0x7f98a0150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:21.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a8800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a0147a80 con 0x7f98a0072840 2024-01-17T22:59:21.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a8800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a0150060 con 0x7f98a01517a0 2024-01-17T22:59:21.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.172+0000 7f98a8800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a00c1290 con 0x7f98a006d210 2024-01-17T22:59:21.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.176+0000 7f98a6800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98a01517a0 0x7f98a0150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:21.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.176+0000 7f98a5400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a0072840 0x7f98a01504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:21.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.176+0000 7f98a5400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a0072840 0x7f98a01504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52418/0 (socket says 172.21.15.161:52418) 2024-01-17T22:59:21.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.176+0000 7f98a5400640 1 -- 172.21.15.161:0/904842787 learned_addr learned my addr 172.21.15.161:0/904842787 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:21.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.176+0000 7f98a5e00640 1 --2- 172.21.15.161:0/904842787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98a006d210 0x7f98a0071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:21.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.180+0000 7f98a5400640 1 -- 172.21.15.161:0/904842787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98a006d210 msgr2=0x7f98a0071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:21.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.180+0000 7f98a5400640 1 --2- 172.21.15.161:0/904842787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98a006d210 0x7f98a0071430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:21.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.180+0000 7f98a5400640 1 -- 172.21.15.161:0/904842787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98a01517a0 msgr2=0x7f98a0150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:21.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.180+0000 7f98a5400640 1 --2- 172.21.15.161:0/904842787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98a01517a0 0x7f98a0150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:21.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.180+0000 7f98a5400640 1 -- 172.21.15.161:0/904842787 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9890009420 con 0x7f98a0072840 2024-01-17T22:59:21.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.180+0000 7f98a5400640 1 --2- 172.21.15.161:0/904842787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a0072840 0x7f98a01504f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f988800e7f0 tx=0x7f988800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:21.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.184+0000 7f989e000640 1 -- 172.21.15.161:0/904842787 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9888009580 con 0x7f98a0072840 2024-01-17T22:59:21.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.184+0000 7f989e000640 1 -- 172.21.15.161:0/904842787 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988800c940 con 0x7f98a0072840 2024-01-17T22:59:21.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.184+0000 7f98a8800640 1 -- 172.21.15.161:0/904842787 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a014e990 con 0x7f98a0072840 2024-01-17T22:59:21.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.184+0000 7f989e000640 1 -- 172.21.15.161:0/904842787 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988800ccf0 con 0x7f98a0072840 2024-01-17T22:59:21.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.184+0000 7f98a8800640 1 -- 172.21.15.161:0/904842787 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a014e3d0 con 0x7f98a0072840 2024-01-17T22:59:21.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.184+0000 7f98a8800640 1 -- 172.21.15.161:0/904842787 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a0150210 con 0x7f98a0072840 2024-01-17T22:59:21.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.204+0000 7f989e000640 1 -- 172.21.15.161:0/904842787 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f9888013470 con 0x7f98a0072840 2024-01-17T22:59:21.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.204+0000 7f989e000640 1 --2- 172.21.15.161:0/904842787 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f9878066890 0x7f9878068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:21.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.204+0000 7f98a5e00640 1 --2- 172.21.15.161:0/904842787 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f9878066890 0x7f9878068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:21.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.204+0000 7f98a5e00640 1 --2- 172.21.15.161:0/904842787 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f9878066890 0x7f9878068d50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f98900af000 tx=0x7f98900a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:21.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.208+0000 7f989e000640 1 -- 172.21.15.161:0/904842787 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f98880557e0 con 0x7f98a0072840 2024-01-17T22:59:21.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.436+0000 7f989e000640 1 -- 172.21.15.161:0/904842787 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f9888051b20 con 0x7f98a0072840 2024-01-17T22:59:21.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.596+0000 7f98a8800640 1 -- 172.21.15.161:0/904842787 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98a0150210 con 0x7f98a0072840 2024-01-17T22:59:21.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.636+0000 7f989e000640 1 -- 172.21.15.161:0/904842787 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18587 (secure 0 0 0) 0x7f98a0150210 con 0x7f98a0072840 2024-01-17T22:59:21.634 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:21.634 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":28,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:59:08.571619+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T22:58:46.757110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T22:58:47.930512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T22:58:53.561624+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.614036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.746767+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.689096+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.706485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.628004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.680048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.571249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]},{"pgid":"4.14","mappings":[{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:59:21.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.640+0000 7f98a8800640 1 -- 172.21.15.161:0/904842787 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f9878066890 msgr2=0x7f9878068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:21.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.640+0000 7f98a8800640 1 --2- 172.21.15.161:0/904842787 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f9878066890 0x7f9878068d50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f98900af000 tx=0x7f98900a7000 comp rx=0 tx=0).stop 2024-01-17T22:59:21.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.640+0000 7f98a8800640 1 -- 172.21.15.161:0/904842787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a0072840 msgr2=0x7f98a01504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:21.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.640+0000 7f98a8800640 1 --2- 172.21.15.161:0/904842787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a0072840 0x7f98a01504f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f988800e7f0 tx=0x7f988800ecb0 comp rx=0 tx=0).stop 2024-01-17T22:59:21.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.640+0000 7f98a8800640 1 -- 172.21.15.161:0/904842787 shutdown_connections 2024-01-17T22:59:21.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.640+0000 7f98a8800640 1 --2- 172.21.15.161:0/904842787 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f9878066890 0x7f9878068d50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:21.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.640+0000 7f98a8800640 1 --2- 172.21.15.161:0/904842787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98a01517a0 0x7f98a0150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:21.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.640+0000 7f98a8800640 1 --2- 172.21.15.161:0/904842787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a0072840 0x7f98a01504f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:21.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.640+0000 7f98a8800640 1 --2- 172.21.15.161:0/904842787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98a006d210 0x7f98a0071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:21.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.640+0000 7f98a8800640 1 -- 172.21.15.161:0/904842787 >> 172.21.15.161:0/904842787 conn(0x7f98a00cb070 msgr2=0x7f98a00c9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:21.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.640+0000 7f98a8800640 1 -- 172.21.15.161:0/904842787 shutdown_connections 2024-01-17T22:59:21.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.640+0000 7f98a8800640 1 -- 172.21.15.161:0/904842787 wait complete. 2024-01-17T22:59:21.658 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-17T22:59:21.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.800+0000 7f91f9000640 1 Processor -- start 2024-01-17T22:59:21.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.800+0000 7f91f9000640 1 -- start start 2024-01-17T22:59:21.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.800+0000 7f91f9000640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f91f4156300 0x7f91f406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:21.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.800+0000 7f91f9000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f40bffb0 con 0x7f91f406df20 2024-01-17T22:59:21.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.800+0000 7f91f9000640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f40b1130 con 0x7f91f41506b0 2024-01-17T22:59:21.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.800+0000 7f91f9000640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f406e330 con 0x7f91f4156300 2024-01-17T22:59:21.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.800+0000 7f91f1400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f91f4156300 0x7f91f406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:21.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.800+0000 7f91f2800640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f91f406df20 0x7f91f40c5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47690/0 (socket says 172.21.15.161:47690) 2024-01-17T22:59:21.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.800+0000 7f91f2800640 1 -- 172.21.15.161:0/1143428094 learned_addr learned my addr 172.21.15.161:0/1143428094 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:21.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.804+0000 7f91f0a00640 1 -- 172.21.15.161:0/1143428094 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1908435648 0 0) 0x7f91f40bffb0 con 0x7f91f406df20 2024-01-17T22:59:21.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.804+0000 7f91f0a00640 1 -- 172.21.15.161:0/1143428094 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91d4003530 con 0x7f91f406df20 2024-01-17T22:59:21.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.808+0000 7f91f0a00640 1 -- 172.21.15.161:0/1143428094 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4203501282 0 0) 0x7f91d4003530 con 0x7f91f406df20 2024-01-17T22:59:21.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.808+0000 7f91f0a00640 1 -- 172.21.15.161:0/1143428094 >> v2:172.21.15.190:3300/0 conn(0x7f91f4156300 msgr2=0x7f91f406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:21.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.808+0000 7f91f0a00640 1 --2- 172.21.15.161:0/1143428094 >> v2:172.21.15.190:3300/0 conn(0x7f91f4156300 0x7f91f406d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:21.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.808+0000 7f91f0a00640 1 -- 172.21.15.161:0/1143428094 >> v1:172.21.15.190:6789/0 conn(0x7f91f41506b0 legacy=0x7f91f40c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:21.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.808+0000 7f91f0a00640 1 -- 172.21.15.161:0/1143428094 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f41567b0 con 0x7f91f406df20 2024-01-17T22:59:21.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.808+0000 7f91f0a00640 1 -- 172.21.15.161:0/1143428094 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f91ec001a00 con 0x7f91f406df20 2024-01-17T22:59:21.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.808+0000 7f91f0a00640 1 -- 172.21.15.161:0/1143428094 >> v1:172.21.15.161:6789/0 conn(0x7f91f406df20 legacy=0x7f91f40c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:21.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.808+0000 7f91f0a00640 1 --2- 172.21.15.161:0/1143428094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91d40039d0 0x7f91d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:21.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.808+0000 7f91f0a00640 1 --2- 172.21.15.161:0/1143428094 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91d40047d0 0x7f91d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:21.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.808+0000 7f91f0a00640 1 --2- 172.21.15.161:0/1143428094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d4005190 0x7f91d400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:21.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.808+0000 7f91f0a00640 1 -- 172.21.15.161:0/1143428094 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f406e330 con 0x7f91d4005190 2024-01-17T22:59:21.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.808+0000 7f91f0a00640 1 -- 172.21.15.161:0/1143428094 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d400c060 con 0x7f91d40039d0 2024-01-17T22:59:21.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.808+0000 7f91f0a00640 1 -- 172.21.15.161:0/1143428094 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d400c220 con 0x7f91d40047d0 2024-01-17T22:59:21.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.812+0000 7f91f1400640 1 --2- 172.21.15.161:0/1143428094 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91d40047d0 0x7f91d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:21.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.812+0000 7f91f2800640 1 --2- 172.21.15.161:0/1143428094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d4005190 0x7f91d400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:21.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.816+0000 7f91f2800640 1 -- 172.21.15.161:0/1143428094 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91d40047d0 msgr2=0x7f91d4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:21.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.816+0000 7f91f2800640 1 --2- 172.21.15.161:0/1143428094 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91d40047d0 0x7f91d4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:21.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.816+0000 7f91f2800640 1 -- 172.21.15.161:0/1143428094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91d40039d0 msgr2=0x7f91d4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:21.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.816+0000 7f91f2800640 1 --2- 172.21.15.161:0/1143428094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91d40039d0 0x7f91d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:21.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.816+0000 7f91f2800640 1 -- 172.21.15.161:0/1143428094 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d4003530 con 0x7f91d4005190 2024-01-17T22:59:21.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.816+0000 7f91f2800640 1 -- 172.21.15.161:0/1143428094 reap_dead start 2024-01-17T22:59:21.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.820+0000 7f91f2800640 1 --2- 172.21.15.161:0/1143428094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d4005190 0x7f91d400b990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00a770 tx=0x7f91ec01d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3938f6fcb18b02 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:21.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.820+0000 7f91f0a00640 1 -- 172.21.15.161:0/1143428094 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec0ac620 con 0x7f91d4005190 2024-01-17T22:59:21.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.820+0000 7f91f0a00640 1 -- 172.21.15.161:0/1143428094 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec0a8070 con 0x7f91d4005190 2024-01-17T22:59:21.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.820+0000 7f91f0a00640 1 -- 172.21.15.161:0/1143428094 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec0aca00 con 0x7f91d4005190 2024-01-17T22:59:21.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.824+0000 7f91f9000640 1 -- 172.21.15.161:0/1143428094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d4005190 msgr2=0x7f91d400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:21.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.824+0000 7f91f9000640 1 --2- 172.21.15.161:0/1143428094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d4005190 0x7f91d400b990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00a770 tx=0x7f91ec01d280 comp rx=0 tx=0).stop 2024-01-17T22:59:21.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.824+0000 7f91f9000640 1 -- 172.21.15.161:0/1143428094 shutdown_connections 2024-01-17T22:59:21.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.824+0000 7f91f9000640 1 --2- 172.21.15.161:0/1143428094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d4005190 0x7f91d400b990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:21.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.824+0000 7f91f9000640 1 -- 172.21.15.161:0/1143428094 >> 172.21.15.161:0/1143428094 conn(0x7f91f40c7a90 msgr2=0x7f91f40c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:21.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.824+0000 7f91f9000640 1 -- 172.21.15.161:0/1143428094 shutdown_connections 2024-01-17T22:59:21.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.824+0000 7f91f9000640 1 -- 172.21.15.161:0/1143428094 wait complete. 2024-01-17T22:59:21.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.824+0000 7f91f9000640 1 Processor -- start 2024-01-17T22:59:21.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.824+0000 7f91f9000640 1 -- start start 2024-01-17T22:59:21.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.824+0000 7f91f9000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d4005190 0x7f91f41f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:21.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.824+0000 7f91f9000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91f41eece0 0x7f91f40ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:21.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.824+0000 7f91f9000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91f414c6b0 0x7f91f4155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:21.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.824+0000 7f91f9000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f41f27d0 con 0x7f91d4005190 2024-01-17T22:59:21.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.824+0000 7f91f9000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f414a960 con 0x7f91f41eece0 2024-01-17T22:59:21.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.824+0000 7f91f9000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f41f3130 con 0x7f91f414c6b0 2024-01-17T22:59:21.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.828+0000 7f91f1e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d4005190 0x7f91f41f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:21.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.828+0000 7f91f1e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d4005190 0x7f91f41f2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57900/0 (socket says 172.21.15.161:57900) 2024-01-17T22:59:21.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.828+0000 7f91f1e00640 1 -- 172.21.15.161:0/1804081274 learned_addr learned my addr 172.21.15.161:0/1804081274 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:21.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.828+0000 7f91f2800640 1 --2- 172.21.15.161:0/1804081274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91f414c6b0 0x7f91f4155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:21.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.828+0000 7f91f1400640 1 --2- 172.21.15.161:0/1804081274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91f41eece0 0x7f91f40ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:21.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.832+0000 7f91f1e00640 1 -- 172.21.15.161:0/1804081274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91f414c6b0 msgr2=0x7f91f4155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:21.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.832+0000 7f91f1e00640 1 --2- 172.21.15.161:0/1804081274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91f414c6b0 0x7f91f4155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:21.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.832+0000 7f91f1e00640 1 -- 172.21.15.161:0/1804081274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91f41eece0 msgr2=0x7f91f40ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:21.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.832+0000 7f91f1e00640 1 --2- 172.21.15.161:0/1804081274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91f41eece0 0x7f91f40ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:21.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.832+0000 7f91f1e00640 1 -- 172.21.15.161:0/1804081274 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f414ac00 con 0x7f91d4005190 2024-01-17T22:59:21.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.836+0000 7f91f1e00640 1 --2- 172.21.15.161:0/1804081274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d4005190 0x7f91f41f2bf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f91e400c3c0 tx=0x7f91e400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:21.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.840+0000 7f91ea000640 1 -- 172.21.15.161:0/1804081274 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4011790 con 0x7f91d4005190 2024-01-17T22:59:21.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.840+0000 7f91ea000640 1 -- 172.21.15.161:0/1804081274 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e40118f0 con 0x7f91d4005190 2024-01-17T22:59:21.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.840+0000 7f91ea000640 1 -- 172.21.15.161:0/1804081274 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4011c80 con 0x7f91d4005190 2024-01-17T22:59:21.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.840+0000 7f91f9000640 1 -- 172.21.15.161:0/1804081274 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f414aee0 con 0x7f91d4005190 2024-01-17T22:59:21.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.840+0000 7f91f9000640 1 -- 172.21.15.161:0/1804081274 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f40caba0 con 0x7f91d4005190 2024-01-17T22:59:21.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:21.840+0000 7f91f9000640 1 -- 172.21.15.161:0/1804081274 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f41f2250 con 0x7f91d4005190 2024-01-17T22:59:22.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:22.084+0000 7f91ea000640 1 -- 172.21.15.161:0/1804081274 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f91e401c460 con 0x7f91d4005190 2024-01-17T22:59:22.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:22.084+0000 7f91ea000640 1 --2- 172.21.15.161:0/1804081274 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f91cc0668c0 0x7f91cc068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:22.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:22.084+0000 7f91f1400640 1 --2- 172.21.15.161:0/1804081274 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f91cc0668c0 0x7f91cc068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:22.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:22.088+0000 7f91f1400640 1 --2- 172.21.15.161:0/1804081274 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f91cc0668c0 0x7f91cc068d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f91f40c5850 tx=0x7f91dc009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:22.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:22.100+0000 7f91ea000640 1 -- 172.21.15.161:0/1804081274 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f91e4055e70 con 0x7f91d4005190 2024-01-17T22:59:22.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:22.100+0000 7f91ea000640 1 -- 172.21.15.161:0/1804081274 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f91e4051ab0 con 0x7f91d4005190 2024-01-17T22:59:22.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:22.288+0000 7f91f9000640 1 -- 172.21.15.161:0/1804081274 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f91f41f2250 con 0x7f91d4005190 2024-01-17T22:59:23.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.308+0000 7f91ea000640 1 -- 172.21.15.161:0/1804081274 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f91f41f2250 con 0x7f91d4005190 2024-01-17T22:59:23.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.312+0000 7f91f9000640 1 -- 172.21.15.161:0/1804081274 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f91cc0668c0 msgr2=0x7f91cc068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:23.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.312+0000 7f91f9000640 1 --2- 172.21.15.161:0/1804081274 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f91cc0668c0 0x7f91cc068d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f91f40c5850 tx=0x7f91dc009190 comp rx=0 tx=0).stop 2024-01-17T22:59:23.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.312+0000 7f91f9000640 1 -- 172.21.15.161:0/1804081274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d4005190 msgr2=0x7f91f41f2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:23.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.312+0000 7f91f9000640 1 --2- 172.21.15.161:0/1804081274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d4005190 0x7f91f41f2bf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f91e400c3c0 tx=0x7f91e400c7c0 comp rx=0 tx=0).stop 2024-01-17T22:59:23.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.312+0000 7f91f9000640 1 -- 172.21.15.161:0/1804081274 shutdown_connections 2024-01-17T22:59:23.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.312+0000 7f91f9000640 1 --2- 172.21.15.161:0/1804081274 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f91cc0668c0 0x7f91cc068d80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:23.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.312+0000 7f91f9000640 1 --2- 172.21.15.161:0/1804081274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91f41eece0 0x7f91f40ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:23.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.312+0000 7f91f9000640 1 --2- 172.21.15.161:0/1804081274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91f414c6b0 0x7f91f4155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:23.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.312+0000 7f91f9000640 1 --2- 172.21.15.161:0/1804081274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d4005190 0x7f91f41f2bf0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:23.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.312+0000 7f91f9000640 1 -- 172.21.15.161:0/1804081274 >> 172.21.15.161:0/1804081274 conn(0x7f91f40c7a90 msgr2=0x7f91f40c0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:23.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.312+0000 7f91f9000640 1 -- 172.21.15.161:0/1804081274 shutdown_connections 2024-01-17T22:59:23.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.312+0000 7f91f9000640 1 -- 172.21.15.161:0/1804081274 wait complete. 2024-01-17T22:59:23.333 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300} 2024-01-17T22:59:23.333 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-01-17T22:59:23.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.476+0000 7fc36aa00640 1 Processor -- start 2024-01-17T22:59:23.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.476+0000 7fc36aa00640 1 -- start start 2024-01-17T22:59:23.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.476+0000 7fc36aa00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc36415ce20 0x7fc36415d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:23.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.476+0000 7fc36aa00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3640c9900 con 0x7fc36406d830 2024-01-17T22:59:23.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.480+0000 7fc36aa00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36406b5d0 con 0x7fc364153970 2024-01-17T22:59:23.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.480+0000 7fc36aa00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36406dce0 con 0x7fc36415ce20 2024-01-17T22:59:23.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.480+0000 7fc368a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc36415ce20 0x7fc36415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:23.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.480+0000 7fc363400640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc36406d830 0x7fc3640cbfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47694/0 (socket says 172.21.15.161:47694) 2024-01-17T22:59:23.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.480+0000 7fc363400640 1 -- 172.21.15.161:0/2795088664 learned_addr learned my addr 172.21.15.161:0/2795088664 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:23.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.484+0000 7fc368a00640 1 -- 172.21.15.161:0/2795088664 >> v1:172.21.15.190:6789/0 conn(0x7fc364153970 legacy=0x7fc36406e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:23.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.484+0000 7fc368a00640 1 -- 172.21.15.161:0/2795088664 >> v1:172.21.15.161:6789/0 conn(0x7fc36406d830 legacy=0x7fc3640cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:23.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.484+0000 7fc368a00640 1 -- 172.21.15.161:0/2795088664 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36415d7b0 con 0x7fc36415ce20 2024-01-17T22:59:23.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.488+0000 7fc368a00640 1 --2- 172.21.15.161:0/2795088664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc36415ce20 0x7fc36415d270 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc35c009d90 tx=0x7fc35c01c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c953c931922fdbcf server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:23.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.492+0000 7fc362a00640 1 -- 172.21.15.161:0/2795088664 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c0a6700 con 0x7fc36415ce20 2024-01-17T22:59:23.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.492+0000 7fc362a00640 1 -- 172.21.15.161:0/2795088664 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35c0a6860 con 0x7fc36415ce20 2024-01-17T22:59:23.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.492+0000 7fc362a00640 1 -- 172.21.15.161:0/2795088664 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c0a6bf0 con 0x7fc36415ce20 2024-01-17T22:59:23.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.492+0000 7fc36aa00640 1 -- 172.21.15.161:0/2795088664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc36415ce20 msgr2=0x7fc36415d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:23.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.492+0000 7fc36aa00640 1 --2- 172.21.15.161:0/2795088664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc36415ce20 0x7fc36415d270 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc35c009d90 tx=0x7fc35c01c830 comp rx=0 tx=0).stop 2024-01-17T22:59:23.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.492+0000 7fc36aa00640 1 -- 172.21.15.161:0/2795088664 shutdown_connections 2024-01-17T22:59:23.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.492+0000 7fc36aa00640 1 --2- 172.21.15.161:0/2795088664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc36415ce20 0x7fc36415d270 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:23.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.492+0000 7fc36aa00640 1 -- 172.21.15.161:0/2795088664 >> 172.21.15.161:0/2795088664 conn(0x7fc36406b7f0 msgr2=0x7fc36406bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:23.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.492+0000 7fc36aa00640 1 -- 172.21.15.161:0/2795088664 shutdown_connections 2024-01-17T22:59:23.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.492+0000 7fc36aa00640 1 -- 172.21.15.161:0/2795088664 wait complete. 2024-01-17T22:59:23.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.496+0000 7fc36aa00640 1 Processor -- start 2024-01-17T22:59:23.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.496+0000 7fc36aa00640 1 -- start start 2024-01-17T22:59:23.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.496+0000 7fc36aa00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc36406d830 0x7fc36415b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:23.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.496+0000 7fc36aa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc364153970 0x7fc36415b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:23.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.496+0000 7fc36aa00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc36415ce20 0x7fc3640cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:23.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.496+0000 7fc36aa00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640c2bc0 con 0x7fc364153970 2024-01-17T22:59:23.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.496+0000 7fc36aa00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36415ca10 con 0x7fc36415ce20 2024-01-17T22:59:23.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.496+0000 7fc36aa00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640ca8e0 con 0x7fc36406d830 2024-01-17T22:59:23.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.496+0000 7fc363400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc364153970 0x7fc36415b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:23.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.496+0000 7fc363400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc364153970 0x7fc36415b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57914/0 (socket says 172.21.15.161:57914) 2024-01-17T22:59:23.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.496+0000 7fc363400640 1 -- 172.21.15.161:0/2033517688 learned_addr learned my addr 172.21.15.161:0/2033517688 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:23.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.496+0000 7fc363e00640 1 --2- 172.21.15.161:0/2033517688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc36406d830 0x7fc36415b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:23.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.496+0000 7fc368a00640 1 --2- 172.21.15.161:0/2033517688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc36415ce20 0x7fc3640cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:23.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.500+0000 7fc363400640 1 -- 172.21.15.161:0/2033517688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc36406d830 msgr2=0x7fc36415b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:23.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.500+0000 7fc363400640 1 --2- 172.21.15.161:0/2033517688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc36406d830 0x7fc36415b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:23.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.500+0000 7fc363400640 1 -- 172.21.15.161:0/2033517688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc36415ce20 msgr2=0x7fc3640cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:23.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.500+0000 7fc363400640 1 --2- 172.21.15.161:0/2033517688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc36415ce20 0x7fc3640cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:23.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.500+0000 7fc363400640 1 -- 172.21.15.161:0/2033517688 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c009a70 con 0x7fc364153970 2024-01-17T22:59:23.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.504+0000 7fc363400640 1 --2- 172.21.15.161:0/2033517688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc364153970 0x7fc36415b730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00c420 tx=0x7fc34c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:23.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.508+0000 7fc35be00640 1 -- 172.21.15.161:0/2033517688 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c005cf0 con 0x7fc364153970 2024-01-17T22:59:23.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.508+0000 7fc35be00640 1 -- 172.21.15.161:0/2033517688 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c005e50 con 0x7fc364153970 2024-01-17T22:59:23.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.508+0000 7fc35be00640 1 -- 172.21.15.161:0/2033517688 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c0072f0 con 0x7fc364153970 2024-01-17T22:59:23.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.508+0000 7fc36aa00640 1 -- 172.21.15.161:0/2033517688 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36415c730 con 0x7fc364153970 2024-01-17T22:59:23.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.508+0000 7fc36aa00640 1 -- 172.21.15.161:0/2033517688 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3640ca290 con 0x7fc364153970 2024-01-17T22:59:23.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.508+0000 7fc36aa00640 1 -- 172.21.15.161:0/2033517688 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3640746a0 con 0x7fc364153970 2024-01-17T22:59:23.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.744+0000 7fc35be00640 1 -- 172.21.15.161:0/2033517688 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fc34c007450 con 0x7fc364153970 2024-01-17T22:59:23.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.744+0000 7fc35be00640 1 --2- 172.21.15.161:0/2033517688 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc33c066890 0x7fc33c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:23.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.744+0000 7fc363e00640 1 --2- 172.21.15.161:0/2033517688 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc33c066890 0x7fc33c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:23.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.744+0000 7fc363e00640 1 --2- 172.21.15.161:0/2033517688 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc33c066890 0x7fc33c068d50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc354001810 tx=0x7fc354009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:23.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.756+0000 7fc35be00640 1 -- 172.21.15.161:0/2033517688 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fc34c054ac0 con 0x7fc364153970 2024-01-17T22:59:23.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.760+0000 7fc35be00640 1 -- 172.21.15.161:0/2033517688 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fc34c050e00 con 0x7fc364153970 2024-01-17T22:59:23.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:23.948+0000 7fc36aa00640 1 -- 172.21.15.161:0/2033517688 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7fc3640c71b0 con 0x7fc364153970 2024-01-17T22:59:24.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.388+0000 7fc35be00640 1 -- 172.21.15.161:0/2033517688 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v9) v1 ==== 105+0+0 (secure 0 0 0) 0x7fc34c017070 con 0x7fc364153970 2024-01-17T22:59:24.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.392+0000 7fc36aa00640 1 -- 172.21.15.161:0/2033517688 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc33c066890 msgr2=0x7fc33c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:24.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.392+0000 7fc36aa00640 1 --2- 172.21.15.161:0/2033517688 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc33c066890 0x7fc33c068d50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc354001810 tx=0x7fc354009040 comp rx=0 tx=0).stop 2024-01-17T22:59:24.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.392+0000 7fc36aa00640 1 -- 172.21.15.161:0/2033517688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc364153970 msgr2=0x7fc36415b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:24.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.392+0000 7fc36aa00640 1 --2- 172.21.15.161:0/2033517688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc364153970 0x7fc36415b730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00c420 tx=0x7fc34c00c8e0 comp rx=0 tx=0).stop 2024-01-17T22:59:24.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.392+0000 7fc36aa00640 1 -- 172.21.15.161:0/2033517688 shutdown_connections 2024-01-17T22:59:24.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.392+0000 7fc36aa00640 1 --2- 172.21.15.161:0/2033517688 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc33c066890 0x7fc33c068d50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:24.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.392+0000 7fc36aa00640 1 --2- 172.21.15.161:0/2033517688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc36415ce20 0x7fc3640cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:24.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.392+0000 7fc36aa00640 1 --2- 172.21.15.161:0/2033517688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc364153970 0x7fc36415b730 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:24.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.392+0000 7fc36aa00640 1 --2- 172.21.15.161:0/2033517688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc36406d830 0x7fc36415b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:24.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.392+0000 7fc36aa00640 1 -- 172.21.15.161:0/2033517688 >> 172.21.15.161:0/2033517688 conn(0x7fc36406b7f0 msgr2=0x7fc3640c6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:24.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.392+0000 7fc36aa00640 1 -- 172.21.15.161:0/2033517688 shutdown_connections 2024-01-17T22:59:24.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.392+0000 7fc36aa00640 1 -- 172.21.15.161:0/2033517688 wait complete. 2024-01-17T22:59:24.412 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-17T22:59:24.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.568+0000 7f5233a00640 1 Processor -- start 2024-01-17T22:59:24.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.568+0000 7f5233a00640 1 -- start start 2024-01-17T22:59:24.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.568+0000 7f5233a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f522c1580e0 0x7f522c0ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:24.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.568+0000 7f5233a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f522c0ca950 con 0x7f522c0c2a60 2024-01-17T22:59:24.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.568+0000 7f5233a00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f522c157540 con 0x7f522c151760 2024-01-17T22:59:24.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.568+0000 7f5233a00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522c0c2eb0 con 0x7f522c1580e0 2024-01-17T22:59:24.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.588+0000 7f5231000640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f522c151760 0x7f522c070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.161:39022/0 (socket says 172.21.15.161:39022) 2024-01-17T22:59:24.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.588+0000 7f5231000640 1 -- 172.21.15.161:0/211094156 learned_addr learned my addr 172.21.15.161:0/211094156 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:24.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.592+0000 7f5231a00640 1 --2- 172.21.15.161:0/211094156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f522c1580e0 0x7f522c0ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:24.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.604+0000 7f5231a00640 1 -- 172.21.15.161:0/211094156 >> v1:172.21.15.190:6789/0 conn(0x7f522c151760 legacy=0x7f522c070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:24.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.604+0000 7f5231a00640 1 -- 172.21.15.161:0/211094156 >> v1:172.21.15.161:6789/0 conn(0x7f522c0c2a60 legacy=0x7f522c1579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:24.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.604+0000 7f5231a00640 1 -- 172.21.15.161:0/211094156 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c151b40 con 0x7f522c1580e0 2024-01-17T22:59:24.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.608+0000 7f5231a00640 1 --2- 172.21.15.161:0/211094156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f522c1580e0 0x7f522c0ca410 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f522c06fc10 tx=0x7f522401f0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e42479379c962cb2 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:24.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.696+0000 7f522b400640 1 -- 172.21.15.161:0/211094156 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52240b0440 con 0x7f522c1580e0 2024-01-17T22:59:24.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.696+0000 7f522b400640 1 -- 172.21.15.161:0/211094156 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52240b05a0 con 0x7f522c1580e0 2024-01-17T22:59:24.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.696+0000 7f522b400640 1 -- 172.21.15.161:0/211094156 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52240b0930 con 0x7f522c1580e0 2024-01-17T22:59:24.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.700+0000 7f5233a00640 1 -- 172.21.15.161:0/211094156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f522c1580e0 msgr2=0x7f522c0ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:24.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.700+0000 7f5233a00640 1 --2- 172.21.15.161:0/211094156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f522c1580e0 0x7f522c0ca410 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f522c06fc10 tx=0x7f522401f0e0 comp rx=0 tx=0).stop 2024-01-17T22:59:24.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.700+0000 7f5233a00640 1 -- 172.21.15.161:0/211094156 shutdown_connections 2024-01-17T22:59:24.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.700+0000 7f5233a00640 1 --2- 172.21.15.161:0/211094156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f522c1580e0 0x7f522c0ca410 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:24.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.700+0000 7f5233a00640 1 -- 172.21.15.161:0/211094156 >> 172.21.15.161:0/211094156 conn(0x7f522c070390 msgr2=0x7f522c06f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:24.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.700+0000 7f5233a00640 1 -- 172.21.15.161:0/211094156 shutdown_connections 2024-01-17T22:59:24.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.700+0000 7f5233a00640 1 -- 172.21.15.161:0/211094156 wait complete. 2024-01-17T22:59:24.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.700+0000 7f5233a00640 1 Processor -- start 2024-01-17T22:59:24.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.700+0000 7f5233a00640 1 -- start start 2024-01-17T22:59:24.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.700+0000 7f5233a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f522c0c2a60 0x7f522c070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:24.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.700+0000 7f5233a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f522c151760 0x7f522c1481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:24.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.700+0000 7f5233a00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f522c1580e0 0x7f522c1486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:24.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.700+0000 7f5233a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c1557e0 con 0x7f522c151760 2024-01-17T22:59:24.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.700+0000 7f5233a00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c1f3060 con 0x7f522c1580e0 2024-01-17T22:59:24.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.700+0000 7f5233a00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522c157010 con 0x7f522c0c2a60 2024-01-17T22:59:24.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.704+0000 7f522be00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f522c151760 0x7f522c1481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:24.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.704+0000 7f522be00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f522c151760 0x7f522c1481b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57928/0 (socket says 172.21.15.161:57928) 2024-01-17T22:59:24.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.704+0000 7f522be00640 1 -- 172.21.15.161:0/529693946 learned_addr learned my addr 172.21.15.161:0/529693946 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:24.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.704+0000 7f5231a00640 1 --2- 172.21.15.161:0/529693946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f522c1580e0 0x7f522c1486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:24.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.704+0000 7f5231000640 1 --2- 172.21.15.161:0/529693946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f522c0c2a60 0x7f522c070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:24.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.708+0000 7f522be00640 1 -- 172.21.15.161:0/529693946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f522c0c2a60 msgr2=0x7f522c070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:24.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.708+0000 7f522be00640 1 --2- 172.21.15.161:0/529693946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f522c0c2a60 0x7f522c070f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:24.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.708+0000 7f522be00640 1 -- 172.21.15.161:0/529693946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f522c1580e0 msgr2=0x7f522c1486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:24.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.708+0000 7f522be00640 1 --2- 172.21.15.161:0/529693946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f522c1580e0 0x7f522c1486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:24.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.708+0000 7f522be00640 1 -- 172.21.15.161:0/529693946 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5224009a70 con 0x7f522c151760 2024-01-17T22:59:24.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.708+0000 7f522be00640 1 --2- 172.21.15.161:0/529693946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f522c151760 0x7f522c1481b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f521400c490 tx=0x7f5214001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:24.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.712+0000 7f5228c00640 1 -- 172.21.15.161:0/529693946 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5214003600 con 0x7f522c151760 2024-01-17T22:59:24.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.712+0000 7f5228c00640 1 -- 172.21.15.161:0/529693946 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5214003780 con 0x7f522c151760 2024-01-17T22:59:24.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.712+0000 7f5233a00640 1 -- 172.21.15.161:0/529693946 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522c156720 con 0x7f522c151760 2024-01-17T22:59:24.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.716+0000 7f5228c00640 1 -- 172.21.15.161:0/529693946 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5214003b70 con 0x7f522c151760 2024-01-17T22:59:24.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.716+0000 7f5233a00640 1 -- 172.21.15.161:0/529693946 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522c1569c0 con 0x7f522c151760 2024-01-17T22:59:24.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.716+0000 7f5233a00640 1 -- 172.21.15.161:0/529693946 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522c14f8c0 con 0x7f522c151760 2024-01-17T22:59:24.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.736+0000 7f5228c00640 1 -- 172.21.15.161:0/529693946 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f5214003cd0 con 0x7f522c151760 2024-01-17T22:59:24.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.736+0000 7f5228c00640 1 --2- 172.21.15.161:0/529693946 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5204066890 0x7f5204068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:24.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.736+0000 7f5231000640 1 --2- 172.21.15.161:0/529693946 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5204066890 0x7f5204068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:24.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.736+0000 7f5231000640 1 --2- 172.21.15.161:0/529693946 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5204066890 0x7f5204068d50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f521c005060 tx=0x7f521c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:24.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.736+0000 7f5228c00640 1 -- 172.21.15.161:0/529693946 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f5214054b40 con 0x7f522c151760 2024-01-17T22:59:24.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:24.968+0000 7f5228c00640 1 -- 172.21.15.161:0/529693946 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f5214050e80 con 0x7f522c151760 2024-01-17T22:59:25.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.168+0000 7f5233a00640 1 -- 172.21.15.161:0/529693946 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f522c157180 con 0x7f522c151760 2024-01-17T22:59:25.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.732+0000 7f5228c00640 1 -- 172.21.15.161:0/529693946 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5214017070 con 0x7f522c151760 2024-01-17T22:59:25.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.732+0000 7f5233a00640 1 -- 172.21.15.161:0/529693946 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5204066890 msgr2=0x7f5204068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:25.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.732+0000 7f5233a00640 1 --2- 172.21.15.161:0/529693946 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5204066890 0x7f5204068d50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f521c005060 tx=0x7f521c009040 comp rx=0 tx=0).stop 2024-01-17T22:59:25.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.732+0000 7f5233a00640 1 -- 172.21.15.161:0/529693946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f522c151760 msgr2=0x7f522c1481b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:25.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.732+0000 7f5233a00640 1 --2- 172.21.15.161:0/529693946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f522c151760 0x7f522c1481b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f521400c490 tx=0x7f5214001e80 comp rx=0 tx=0).stop 2024-01-17T22:59:25.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.732+0000 7f5233a00640 1 -- 172.21.15.161:0/529693946 shutdown_connections 2024-01-17T22:59:25.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.732+0000 7f5233a00640 1 --2- 172.21.15.161:0/529693946 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5204066890 0x7f5204068d50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:25.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.732+0000 7f5233a00640 1 --2- 172.21.15.161:0/529693946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f522c1580e0 0x7f522c1486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:25.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.732+0000 7f5233a00640 1 --2- 172.21.15.161:0/529693946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f522c151760 0x7f522c1481b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:25.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.732+0000 7f5233a00640 1 --2- 172.21.15.161:0/529693946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f522c0c2a60 0x7f522c070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:25.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.732+0000 7f5233a00640 1 -- 172.21.15.161:0/529693946 >> 172.21.15.161:0/529693946 conn(0x7f522c070390 msgr2=0x7f522c14fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:25.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.732+0000 7f5233a00640 1 -- 172.21.15.161:0/529693946 shutdown_connections 2024-01-17T22:59:25.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.732+0000 7f5233a00640 1 -- 172.21.15.161:0/529693946 wait complete. 2024-01-17T22:59:25.754 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-01-17T22:59:25.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.900+0000 7fbb87800640 1 Processor -- start 2024-01-17T22:59:25.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.900+0000 7fbb87800640 1 -- start start 2024-01-17T22:59:25.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.900+0000 7fbb87800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbb80151760 0x7fbb800c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:25.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.900+0000 7fbb87800640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbb800ca410 0x7fbb80070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:25.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.900+0000 7fbb87800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80071260 0x7fbb801579d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:25.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.900+0000 7fbb87800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb80157540 con 0x7fbb80151760 2024-01-17T22:59:25.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.900+0000 7fbb87800640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb80151b40 con 0x7fbb800ca410 2024-01-17T22:59:25.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.900+0000 7fbb87800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8015aa30 con 0x7fbb80071260 2024-01-17T22:59:25.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.900+0000 7fbb84e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbb80151760 0x7fbb800c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:25.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.900+0000 7fbb84e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbb80151760 0x7fbb800c2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57934/0 (socket says 172.21.15.161:57934) 2024-01-17T22:59:25.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.900+0000 7fbb84e00640 1 -- 172.21.15.161:0/1887761721 learned_addr learned my addr 172.21.15.161:0/1887761721 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.904+0000 7fbb84e00640 1 -- 172.21.15.161:0/1887761721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80071260 msgr2=0x7fbb801579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.904+0000 7fbb84e00640 1 --2- 172.21.15.161:0/1887761721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80071260 0x7fbb801579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.904+0000 7fbb84e00640 1 -- 172.21.15.161:0/1887761721 >> v2:172.21.15.190:3300/0 conn(0x7fbb800ca410 msgr2=0x7fbb80070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.904+0000 7fbb84e00640 1 --2- 172.21.15.161:0/1887761721 >> v2:172.21.15.190:3300/0 conn(0x7fbb800ca410 0x7fbb80070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.904+0000 7fbb84e00640 1 -- 172.21.15.161:0/1887761721 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8015acf0 con 0x7fbb80151760 2024-01-17T22:59:25.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.908+0000 7fbb84e00640 1 --2- 172.21.15.161:0/1887761721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb80151760 0x7fbb800c2a60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbb80070b90 tx=0x7fbb7001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22007629909a0aac server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:25.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.912+0000 7fbb7f400640 1 -- 172.21.15.161:0/1887761721 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700a89b0 con 0x7fbb80151760 2024-01-17T22:59:25.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.912+0000 7fbb7f400640 1 -- 172.21.15.161:0/1887761721 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb700a8b10 con 0x7fbb80151760 2024-01-17T22:59:25.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.912+0000 7fbb7f400640 1 -- 172.21.15.161:0/1887761721 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700a8ea0 con 0x7fbb80151760 2024-01-17T22:59:25.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.912+0000 7fbb87800640 1 -- 172.21.15.161:0/1887761721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb80151760 msgr2=0x7fbb800c2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:25.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.912+0000 7fbb87800640 1 --2- 172.21.15.161:0/1887761721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb80151760 0x7fbb800c2a60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbb80070b90 tx=0x7fbb7001ecf0 comp rx=0 tx=0).stop 2024-01-17T22:59:25.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.912+0000 7fbb87800640 1 -- 172.21.15.161:0/1887761721 shutdown_connections 2024-01-17T22:59:25.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.912+0000 7fbb87800640 1 --2- 172.21.15.161:0/1887761721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80071260 0x7fbb801579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:25.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.912+0000 7fbb87800640 1 --2- 172.21.15.161:0/1887761721 >> v2:172.21.15.190:3300/0 conn(0x7fbb800ca410 0x7fbb80070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:25.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.912+0000 7fbb87800640 1 --2- 172.21.15.161:0/1887761721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb80151760 0x7fbb800c2a60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:25.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.912+0000 7fbb87800640 1 -- 172.21.15.161:0/1887761721 >> 172.21.15.161:0/1887761721 conn(0x7fbb80070390 msgr2=0x7fbb8006f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:25.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.912+0000 7fbb87800640 1 -- 172.21.15.161:0/1887761721 shutdown_connections 2024-01-17T22:59:25.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.912+0000 7fbb87800640 1 -- 172.21.15.161:0/1887761721 wait complete. 2024-01-17T22:59:25.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.916+0000 7fbb87800640 1 Processor -- start 2024-01-17T22:59:25.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.916+0000 7fbb87800640 1 -- start start 2024-01-17T22:59:25.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.916+0000 7fbb87800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb80071260 0x7fbb801f0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:25.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.916+0000 7fbb87800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb800ca410 0x7fbb800cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:25.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.916+0000 7fbb87800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80151760 0x7fbb800cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:25.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.916+0000 7fbb87800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800b02e0 con 0x7fbb80071260 2024-01-17T22:59:25.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.916+0000 7fbb87800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800cda30 con 0x7fbb800ca410 2024-01-17T22:59:25.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.916+0000 7fbb87800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb80159cc0 con 0x7fbb80151760 2024-01-17T22:59:25.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.916+0000 7fbb84e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb80071260 0x7fbb801f0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:25.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.916+0000 7fbb84e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb80071260 0x7fbb801f0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57944/0 (socket says 172.21.15.161:57944) 2024-01-17T22:59:25.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.916+0000 7fbb84e00640 1 -- 172.21.15.161:0/2436144478 learned_addr learned my addr 172.21.15.161:0/2436144478 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:25.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.920+0000 7fbb84e00640 1 -- 172.21.15.161:0/2436144478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80151760 msgr2=0x7fbb800cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:25.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.920+0000 7fbb84e00640 1 --2- 172.21.15.161:0/2436144478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80151760 0x7fbb800cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:25.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.920+0000 7fbb84e00640 1 -- 172.21.15.161:0/2436144478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb800ca410 msgr2=0x7fbb800cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:25.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.920+0000 7fbb84e00640 1 --2- 172.21.15.161:0/2436144478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb800ca410 0x7fbb800cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:25.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.920+0000 7fbb84e00640 1 -- 172.21.15.161:0/2436144478 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb700094d0 con 0x7fbb80071260 2024-01-17T22:59:25.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.924+0000 7fbb84e00640 1 --2- 172.21.15.161:0/2436144478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb80071260 0x7fbb801f0400 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbb7001c920 tx=0x7fbb7001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:25.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.928+0000 7fbb7cc00640 1 -- 172.21.15.161:0/2436144478 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700b0e20 con 0x7fbb80071260 2024-01-17T22:59:25.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.928+0000 7fbb7cc00640 1 -- 172.21.15.161:0/2436144478 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb700ba440 con 0x7fbb80071260 2024-01-17T22:59:25.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.928+0000 7fbb7cc00640 1 -- 172.21.15.161:0/2436144478 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700ba7f0 con 0x7fbb80071260 2024-01-17T22:59:25.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.928+0000 7fbb87800640 1 -- 172.21.15.161:0/2436144478 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb800cdcb0 con 0x7fbb80071260 2024-01-17T22:59:25.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.928+0000 7fbb87800640 1 -- 172.21.15.161:0/2436144478 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb801f0940 con 0x7fbb80071260 2024-01-17T22:59:25.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.928+0000 7fbb87800640 1 -- 172.21.15.161:0/2436144478 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb800cde40 con 0x7fbb80071260 2024-01-17T22:59:25.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.948+0000 7fbb7cc00640 1 -- 172.21.15.161:0/2436144478 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fbb700ba950 con 0x7fbb80071260 2024-01-17T22:59:25.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.948+0000 7fbb7cc00640 1 --2- 172.21.15.161:0/2436144478 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fbb580668c0 0x7fbb58068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:25.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.948+0000 7fbb7fe00640 1 --2- 172.21.15.161:0/2436144478 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fbb580668c0 0x7fbb58068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:25.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:25.948+0000 7fbb7fe00640 1 --2- 172.21.15.161:0/2436144478 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fbb580668c0 0x7fbb58068d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbb800b2310 tx=0x7fbb68006ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:26.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:26.180+0000 7fbb7cc00640 1 -- 172.21.15.161:0/2436144478 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fbb700f41a0 con 0x7fbb80071260 2024-01-17T22:59:26.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:26.180+0000 7fbb7cc00640 1 -- 172.21.15.161:0/2436144478 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fbb700efde0 con 0x7fbb80071260 2024-01-17T22:59:26.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:26.376+0000 7fbb87800640 1 -- 172.21.15.161:0/2436144478 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fbb800746a0 con 0x7fbb80071260 2024-01-17T22:59:27.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.080+0000 7fbb7cc00640 1 -- 172.21.15.161:0/2436144478 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) v1 ==== 115+0+0 (secure 0 0 0) 0x7fbb700b50b0 con 0x7fbb80071260 2024-01-17T22:59:27.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.080+0000 7fbb87800640 1 -- 172.21.15.161:0/2436144478 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fbb580668c0 msgr2=0x7fbb58068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:27.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.080+0000 7fbb87800640 1 --2- 172.21.15.161:0/2436144478 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fbb580668c0 0x7fbb58068d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbb800b2310 tx=0x7fbb68006ca0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.080+0000 7fbb87800640 1 -- 172.21.15.161:0/2436144478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb80071260 msgr2=0x7fbb801f0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:27.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.080+0000 7fbb87800640 1 --2- 172.21.15.161:0/2436144478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb80071260 0x7fbb801f0400 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbb7001c920 tx=0x7fbb7001ba90 comp rx=0 tx=0).stop 2024-01-17T22:59:27.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.080+0000 7fbb87800640 1 -- 172.21.15.161:0/2436144478 shutdown_connections 2024-01-17T22:59:27.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.080+0000 7fbb87800640 1 --2- 172.21.15.161:0/2436144478 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fbb580668c0 0x7fbb58068d80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.080+0000 7fbb87800640 1 --2- 172.21.15.161:0/2436144478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb800ca410 0x7fbb800cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.080+0000 7fbb87800640 1 --2- 172.21.15.161:0/2436144478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80151760 0x7fbb800cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.080+0000 7fbb87800640 1 --2- 172.21.15.161:0/2436144478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb80071260 0x7fbb801f0400 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.080+0000 7fbb87800640 1 -- 172.21.15.161:0/2436144478 >> 172.21.15.161:0/2436144478 conn(0x7fbb80070390 msgr2=0x7fbb8014e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:27.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.080+0000 7fbb87800640 1 -- 172.21.15.161:0/2436144478 shutdown_connections 2024-01-17T22:59:27.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.080+0000 7fbb87800640 1 -- 172.21.15.161:0/2436144478 wait complete. 2024-01-17T22:59:27.099 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-17T22:59:27.100 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T22:59:27.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.248+0000 7f1adc400640 1 Processor -- start 2024-01-17T22:59:27.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.248+0000 7f1adc400640 1 -- start start 2024-01-17T22:59:27.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.248+0000 7f1adc400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1ad41517f0 0x7f1ad415b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:27.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.248+0000 7f1adc400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1ad40ca780 0x7f1ad40c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:27.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.248+0000 7f1adc400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad40c7d10 con 0x7f1ad40ca3a0 2024-01-17T22:59:27.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.248+0000 7f1adc400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad41576d0 con 0x7f1ad40ca780 2024-01-17T22:59:27.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.248+0000 7f1adc400640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad4157970 con 0x7f1ad41517f0 2024-01-17T22:59:27.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.248+0000 7f1ada400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1ad40ca780 0x7f1ad40c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:27.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.252+0000 7f1ad9000640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f1ad40ca3a0 0x7f1ad4061100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47708/0 (socket says 172.21.15.161:47708) 2024-01-17T22:59:27.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.252+0000 7f1ad9000640 1 -- 172.21.15.161:0/209730728 learned_addr learned my addr 172.21.15.161:0/209730728 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:27.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.252+0000 7f1ad9a00640 1 --2- 172.21.15.161:0/209730728 >> v2:172.21.15.190:3300/0 conn(0x7f1ad41517f0 0x7f1ad415b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:27.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.256+0000 7f1ada400640 1 -- 172.21.15.161:0/209730728 >> v2:172.21.15.190:3300/0 conn(0x7f1ad41517f0 msgr2=0x7f1ad415b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:27.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.256+0000 7f1ada400640 1 --2- 172.21.15.161:0/209730728 >> v2:172.21.15.190:3300/0 conn(0x7f1ad41517f0 0x7f1ad415b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.256+0000 7f1ada400640 1 -- 172.21.15.161:0/209730728 >> v1:172.21.15.161:6789/0 conn(0x7f1ad40ca3a0 legacy=0x7f1ad4061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:27.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.256+0000 7f1ada400640 1 -- 172.21.15.161:0/209730728 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4157c50 con 0x7f1ad40ca780 2024-01-17T22:59:27.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.260+0000 7f1ada400640 1 --2- 172.21.15.161:0/209730728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad40ca780 0x7f1ad40c8a30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1ad406fd20 tx=0x7f1acc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0ce4d8a0d694b2 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:27.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.264+0000 7f1ad3e00640 1 -- 172.21.15.161:0/209730728 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc0a59d0 con 0x7f1ad40ca780 2024-01-17T22:59:27.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.264+0000 7f1ad3e00640 1 -- 172.21.15.161:0/209730728 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc0a5b30 con 0x7f1ad40ca780 2024-01-17T22:59:27.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.264+0000 7f1ad3e00640 1 -- 172.21.15.161:0/209730728 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc0ad440 con 0x7f1ad40ca780 2024-01-17T22:59:27.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.264+0000 7f1adc400640 1 -- 172.21.15.161:0/209730728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad40ca780 msgr2=0x7f1ad40c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:27.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.264+0000 7f1adc400640 1 --2- 172.21.15.161:0/209730728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad40ca780 0x7f1ad40c8a30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1ad406fd20 tx=0x7f1acc01c910 comp rx=0 tx=0).stop 2024-01-17T22:59:27.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.264+0000 7f1adc400640 1 -- 172.21.15.161:0/209730728 shutdown_connections 2024-01-17T22:59:27.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.264+0000 7f1adc400640 1 --2- 172.21.15.161:0/209730728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad40ca780 0x7f1ad40c8a30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.264+0000 7f1adc400640 1 --2- 172.21.15.161:0/209730728 >> v2:172.21.15.190:3300/0 conn(0x7f1ad41517f0 0x7f1ad415b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.264+0000 7f1adc400640 1 -- 172.21.15.161:0/209730728 >> 172.21.15.161:0/209730728 conn(0x7f1ad406ad40 msgr2=0x7f1ad406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:27.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.264+0000 7f1adc400640 1 -- 172.21.15.161:0/209730728 shutdown_connections 2024-01-17T22:59:27.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.264+0000 7f1adc400640 1 -- 172.21.15.161:0/209730728 wait complete. 2024-01-17T22:59:27.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.268+0000 7f1adc400640 1 Processor -- start 2024-01-17T22:59:27.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.268+0000 7f1adc400640 1 -- start start 2024-01-17T22:59:27.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.268+0000 7f1adc400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ad40ca3a0 0x7f1ad40cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:27.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.268+0000 7f1adc400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ad40ca780 0x7f1ad40cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:27.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.268+0000 7f1adc400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad41517f0 0x7f1ad406be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:27.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.268+0000 7f1adc400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad406b980 con 0x7f1ad41517f0 2024-01-17T22:59:27.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.268+0000 7f1adc400640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad41f5ac0 con 0x7f1ad40ca780 2024-01-17T22:59:27.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.268+0000 7f1adc400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad41f5da0 con 0x7f1ad40ca3a0 2024-01-17T22:59:27.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.268+0000 7f1ada400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad41517f0 0x7f1ad406be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:27.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.268+0000 7f1ada400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad41517f0 0x7f1ad406be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57964/0 (socket says 172.21.15.161:57964) 2024-01-17T22:59:27.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.268+0000 7f1ada400640 1 -- 172.21.15.161:0/4065544974 learned_addr learned my addr 172.21.15.161:0/4065544974 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:27.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.272+0000 7f1ad9a00640 1 --2- 172.21.15.161:0/4065544974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ad40ca3a0 0x7f1ad40cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:27.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.272+0000 7f1ada400640 1 -- 172.21.15.161:0/4065544974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ad40ca3a0 msgr2=0x7f1ad40cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:27.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.272+0000 7f1ada400640 1 --2- 172.21.15.161:0/4065544974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ad40ca3a0 0x7f1ad40cc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.272+0000 7f1ada400640 1 -- 172.21.15.161:0/4065544974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ad40ca780 msgr2=0x7f1ad40cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:27.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.272+0000 7f1ada400640 1 --2- 172.21.15.161:0/4065544974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ad40ca780 0x7f1ad40cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.272+0000 7f1ada400640 1 -- 172.21.15.161:0/4065544974 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc009a70 con 0x7f1ad41517f0 2024-01-17T22:59:27.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.276+0000 7f1ada400640 1 --2- 172.21.15.161:0/4065544974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad41517f0 0x7f1ad406be10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1acc019520 tx=0x7f1acc0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:27.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.280+0000 7f1ad1600640 1 -- 172.21.15.161:0/4065544974 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc0aec60 con 0x7f1ad41517f0 2024-01-17T22:59:27.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.280+0000 7f1adc400640 1 -- 172.21.15.161:0/4065544974 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad41f6080 con 0x7f1ad41517f0 2024-01-17T22:59:27.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.280+0000 7f1adc400640 1 -- 172.21.15.161:0/4065544974 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad41f6640 con 0x7f1ad41517f0 2024-01-17T22:59:27.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.280+0000 7f1adc400640 1 -- 172.21.15.161:0/4065544974 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad406b620 con 0x7f1ad41517f0 2024-01-17T22:59:27.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.280+0000 7f1ad1600640 1 -- 172.21.15.161:0/4065544974 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc0aedc0 con 0x7f1ad41517f0 2024-01-17T22:59:27.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.280+0000 7f1ad1600640 1 -- 172.21.15.161:0/4065544974 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc0ce430 con 0x7f1ad41517f0 2024-01-17T22:59:27.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.520+0000 7f1ad1600640 1 -- 172.21.15.161:0/4065544974 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f1acc0b4050 con 0x7f1ad41517f0 2024-01-17T22:59:27.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.520+0000 7f1ad1600640 1 --2- 172.21.15.161:0/4065544974 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f1aac066840 0x7f1aac068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:27.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.520+0000 7f1ad9a00640 1 --2- 172.21.15.161:0/4065544974 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f1aac066840 0x7f1aac068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:27.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.520+0000 7f1ad9a00640 1 --2- 172.21.15.161:0/4065544974 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f1aac066840 0x7f1aac068d00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009990 tx=0x7f1ac4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:27.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.532+0000 7f1ad1600640 1 -- 172.21.15.161:0/4065544974 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f1acc0ac3a0 con 0x7f1ad41517f0 2024-01-17T22:59:27.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.532+0000 7f1ad1600640 1 -- 172.21.15.161:0/4065544974 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f1acc0ecae0 con 0x7f1ad41517f0 2024-01-17T22:59:27.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.720+0000 7f1adc400640 1 -- 172.21.15.161:0/4065544974 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ad40746a0 con 0x7f1ad41517f0 2024-01-17T22:59:27.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.732+0000 7f1ad1600640 1 -- 172.21.15.161:0/4065544974 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6546 (secure 0 0 0) 0x7f1acc0b2070 con 0x7f1ad41517f0 2024-01-17T22:59:27.731 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:27.731 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6839/2820898287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":2820898287},{"type":"v1","addr":"172.21.15.161:6839","nonce":2820898287}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/2332272186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2332272186},{"type":"v1","addr":"172.21.15.190:6833","nonce":2332272186}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3170137737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3170137737},{"type":"v1","addr":"172.21.15.190:6835","nonce":3170137737}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1671527613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1671527613},{"type":"v1","addr":"172.21.15.161:6835","nonce":1671527613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-17T22:58:49.015246+0000","modified":"2024-01-17T22:59:26.386739+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4269,"mds_1":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"e","rank":1,"incarnation":10,"state":"up:creating","state_seq":1,"addr":"172.21.15.161:6837/409686078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":409686078},{"type":"v1","addr":"172.21.15.161:6837","nonce":409686078}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4269":{"gid":4269,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":7,"addr":"172.21.15.190:6837/561131647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":561131647},{"type":"v1","addr":"172.21.15.190:6837","nonce":561131647}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-17T22:59:27.731 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 12 2024-01-17T22:59:27.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.736+0000 7f1adc400640 1 -- 172.21.15.161:0/4065544974 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f1aac066840 msgr2=0x7f1aac068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:27.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.736+0000 7f1adc400640 1 --2- 172.21.15.161:0/4065544974 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f1aac066840 0x7f1aac068d00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009990 tx=0x7f1ac4008040 comp rx=0 tx=0).stop 2024-01-17T22:59:27.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.736+0000 7f1adc400640 1 -- 172.21.15.161:0/4065544974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad41517f0 msgr2=0x7f1ad406be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:27.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.736+0000 7f1adc400640 1 --2- 172.21.15.161:0/4065544974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad41517f0 0x7f1ad406be10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1acc019520 tx=0x7f1acc0196b0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.736+0000 7f1adc400640 1 -- 172.21.15.161:0/4065544974 shutdown_connections 2024-01-17T22:59:27.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.736+0000 7f1adc400640 1 --2- 172.21.15.161:0/4065544974 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f1aac066840 0x7f1aac068d00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.736+0000 7f1adc400640 1 --2- 172.21.15.161:0/4065544974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ad40ca780 0x7f1ad40cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.736+0000 7f1adc400640 1 --2- 172.21.15.161:0/4065544974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad41517f0 0x7f1ad406be10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.736+0000 7f1adc400640 1 --2- 172.21.15.161:0/4065544974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ad40ca3a0 0x7f1ad40cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.736+0000 7f1adc400640 1 -- 172.21.15.161:0/4065544974 >> 172.21.15.161:0/4065544974 conn(0x7f1ad406ad40 msgr2=0x7f1ad414ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:27.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.736+0000 7f1adc400640 1 -- 172.21.15.161:0/4065544974 shutdown_connections 2024-01-17T22:59:27.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.736+0000 7f1adc400640 1 -- 172.21.15.161:0/4065544974 wait complete. 2024-01-17T22:59:27.753 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T22:59:27.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.896+0000 7f077a800640 1 Processor -- start 2024-01-17T22:59:27.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.896+0000 7f077a800640 1 -- start start 2024-01-17T22:59:27.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.896+0000 7f077a800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0774150660 0x7f077415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:27.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.896+0000 7f077a800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07740c6ee0 0x7f07740c9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:27.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.896+0000 7f077a800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0774159890 con 0x7f07740aebf0 2024-01-17T22:59:27.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.896+0000 7f077a800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0774150a40 con 0x7f0774150660 2024-01-17T22:59:27.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.896+0000 7f077a800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077415a820 con 0x7f07740c6ee0 2024-01-17T22:59:27.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.896+0000 7f0773400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0774150660 0x7f077415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:27.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.896+0000 7f0772a00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f07740aebf0 0x7f07740cc110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47714/0 (socket says 172.21.15.161:47714) 2024-01-17T22:59:27.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.896+0000 7f0772a00640 1 -- 172.21.15.161:0/640233532 learned_addr learned my addr 172.21.15.161:0/640233532 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:27.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.896+0000 7f0773e00640 1 --2- 172.21.15.161:0/640233532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07740c6ee0 0x7f07740c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:27.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.900+0000 7f0773400640 1 -- 172.21.15.161:0/640233532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07740c6ee0 msgr2=0x7f07740c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:27.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.900+0000 7f0773400640 1 --2- 172.21.15.161:0/640233532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07740c6ee0 0x7f07740c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.900+0000 7f0773400640 1 -- 172.21.15.161:0/640233532 >> v1:172.21.15.161:6789/0 conn(0x7f07740aebf0 legacy=0x7f07740cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:27.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.900+0000 7f0773400640 1 -- 172.21.15.161:0/640233532 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07740cc8c0 con 0x7f0774150660 2024-01-17T22:59:27.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.908+0000 7f0773400640 1 --2- 172.21.15.161:0/640233532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0774150660 0x7f077415a2e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f07640097c0 tx=0x7f076401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25871e9c7db99888 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:27.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.912+0000 7f0772000640 1 -- 172.21.15.161:0/640233532 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640ab650 con 0x7f0774150660 2024-01-17T22:59:27.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.912+0000 7f0772000640 1 -- 172.21.15.161:0/640233532 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07640ab7b0 con 0x7f0774150660 2024-01-17T22:59:27.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.912+0000 7f0772000640 1 -- 172.21.15.161:0/640233532 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640abb40 con 0x7f0774150660 2024-01-17T22:59:27.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.912+0000 7f077a800640 1 -- 172.21.15.161:0/640233532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0774150660 msgr2=0x7f077415a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:27.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.912+0000 7f077a800640 1 --2- 172.21.15.161:0/640233532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0774150660 0x7f077415a2e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f07640097c0 tx=0x7f076401c450 comp rx=0 tx=0).stop 2024-01-17T22:59:27.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.912+0000 7f077a800640 1 -- 172.21.15.161:0/640233532 shutdown_connections 2024-01-17T22:59:27.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.912+0000 7f077a800640 1 --2- 172.21.15.161:0/640233532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07740c6ee0 0x7f07740c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.912+0000 7f077a800640 1 --2- 172.21.15.161:0/640233532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0774150660 0x7f077415a2e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.912+0000 7f077a800640 1 -- 172.21.15.161:0/640233532 >> 172.21.15.161:0/640233532 conn(0x7f077406e0e0 msgr2=0x7f077406e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:27.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.912+0000 7f077a800640 1 -- 172.21.15.161:0/640233532 shutdown_connections 2024-01-17T22:59:27.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.912+0000 7f077a800640 1 -- 172.21.15.161:0/640233532 wait complete. 2024-01-17T22:59:27.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.912+0000 7f077a800640 1 Processor -- start 2024-01-17T22:59:27.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.912+0000 7f077a800640 1 -- start start 2024-01-17T22:59:27.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.916+0000 7f077a800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07740aebf0 0x7f077413ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:27.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.916+0000 7f077a800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07740c6ee0 0x7f07741601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:27.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.916+0000 7f077a800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0774150660 0x7f07740701b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:27.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.916+0000 7f077a800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077415fc80 con 0x7f07740c6ee0 2024-01-17T22:59:27.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.916+0000 7f077a800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07741f2830 con 0x7f07740aebf0 2024-01-17T22:59:27.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.916+0000 7f077a800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077413e310 con 0x7f0774150660 2024-01-17T22:59:27.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.916+0000 7f0772a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07740c6ee0 0x7f07741601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:27.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.916+0000 7f0772a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07740c6ee0 0x7f07741601c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57984/0 (socket says 172.21.15.161:57984) 2024-01-17T22:59:27.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.916+0000 7f0772a00640 1 -- 172.21.15.161:0/1749347202 learned_addr learned my addr 172.21.15.161:0/1749347202 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:27.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.916+0000 7f0773e00640 1 --2- 172.21.15.161:0/1749347202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0774150660 0x7f07740701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:27.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.916+0000 7f0773400640 1 --2- 172.21.15.161:0/1749347202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07740aebf0 0x7f077413ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:27.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.920+0000 7f0772a00640 1 -- 172.21.15.161:0/1749347202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0774150660 msgr2=0x7f07740701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:27.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.920+0000 7f0772a00640 1 --2- 172.21.15.161:0/1749347202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0774150660 0x7f07740701b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.920+0000 7f0772a00640 1 -- 172.21.15.161:0/1749347202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07740aebf0 msgr2=0x7f077413ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:27.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.920+0000 7f0772a00640 1 --2- 172.21.15.161:0/1749347202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07740aebf0 0x7f077413ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.920+0000 7f0772a00640 1 -- 172.21.15.161:0/1749347202 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0764009420 con 0x7f07740c6ee0 2024-01-17T22:59:27.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.920+0000 7f0772a00640 1 --2- 172.21.15.161:0/1749347202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07740c6ee0 0x7f07741601c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f075c00c450 tx=0x7f075c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:27.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.924+0000 7f076b400640 1 -- 172.21.15.161:0/1749347202 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c005cf0 con 0x7f07740c6ee0 2024-01-17T22:59:27.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.924+0000 7f076b400640 1 -- 172.21.15.161:0/1749347202 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075c005e50 con 0x7f07740c6ee0 2024-01-17T22:59:27.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.924+0000 7f076b400640 1 -- 172.21.15.161:0/1749347202 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c007290 con 0x7f07740c6ee0 2024-01-17T22:59:27.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.924+0000 7f077a800640 1 -- 172.21.15.161:0/1749347202 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07740cb3e0 con 0x7f07740c6ee0 2024-01-17T22:59:27.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.924+0000 7f077a800640 1 -- 172.21.15.161:0/1749347202 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0774160700 con 0x7f07740c6ee0 2024-01-17T22:59:27.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.928+0000 7f077a800640 1 -- 172.21.15.161:0/1749347202 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07741f29a0 con 0x7f07740c6ee0 2024-01-17T22:59:27.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.944+0000 7f076b400640 1 -- 172.21.15.161:0/1749347202 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f075c0073f0 con 0x7f07740c6ee0 2024-01-17T22:59:27.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.948+0000 7f076b400640 1 --2- 172.21.15.161:0/1749347202 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f074c066890 0x7f074c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:27.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.948+0000 7f0773400640 1 --2- 172.21.15.161:0/1749347202 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f074c066890 0x7f074c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:27.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:27.948+0000 7f0773400640 1 --2- 172.21.15.161:0/1749347202 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f074c066890 0x7f074c068d50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f07640af000 tx=0x7f07640a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:28.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.184+0000 7f076b400640 1 -- 172.21.15.161:0/1749347202 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f075c0546a0 con 0x7f07740c6ee0 2024-01-17T22:59:28.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.184+0000 7f076b400640 1 -- 172.21.15.161:0/1749347202 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f075c0509e0 con 0x7f07740c6ee0 2024-01-17T22:59:28.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.344+0000 7f077a800640 1 -- 172.21.15.161:0/1749347202 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07741f29a0 con 0x7f07740c6ee0 2024-01-17T22:59:28.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.388+0000 7f076b400640 1 -- 172.21.15.161:0/1749347202 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18587 (secure 0 0 0) 0x7f07741f29a0 con 0x7f07740c6ee0 2024-01-17T22:59:28.385 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:28.385 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":28,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:59:08.571619+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T22:58:46.757110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T22:58:47.930512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T22:58:53.561624+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.614036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.746767+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.689096+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.706485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.628004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.680048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.571249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]},{"pgid":"4.14","mappings":[{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:59:28.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.388+0000 7f077a800640 1 -- 172.21.15.161:0/1749347202 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f074c066890 msgr2=0x7f074c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:28.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.388+0000 7f077a800640 1 --2- 172.21.15.161:0/1749347202 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f074c066890 0x7f074c068d50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f07640af000 tx=0x7f07640a7000 comp rx=0 tx=0).stop 2024-01-17T22:59:28.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.388+0000 7f077a800640 1 -- 172.21.15.161:0/1749347202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07740c6ee0 msgr2=0x7f07741601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:28.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.388+0000 7f077a800640 1 --2- 172.21.15.161:0/1749347202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07740c6ee0 0x7f07741601c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f075c00c450 tx=0x7f075c00c910 comp rx=0 tx=0).stop 2024-01-17T22:59:28.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.388+0000 7f077a800640 1 -- 172.21.15.161:0/1749347202 shutdown_connections 2024-01-17T22:59:28.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.388+0000 7f077a800640 1 --2- 172.21.15.161:0/1749347202 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f074c066890 0x7f074c068d50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.388+0000 7f077a800640 1 --2- 172.21.15.161:0/1749347202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0774150660 0x7f07740701b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.388+0000 7f077a800640 1 --2- 172.21.15.161:0/1749347202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07740c6ee0 0x7f07741601c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.388+0000 7f077a800640 1 --2- 172.21.15.161:0/1749347202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07740aebf0 0x7f077413ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.388+0000 7f077a800640 1 -- 172.21.15.161:0/1749347202 >> 172.21.15.161:0/1749347202 conn(0x7f077406e0e0 msgr2=0x7f077406b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:28.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.388+0000 7f077a800640 1 -- 172.21.15.161:0/1749347202 shutdown_connections 2024-01-17T22:59:28.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.388+0000 7f077a800640 1 -- 172.21.15.161:0/1749347202 wait complete. 2024-01-17T22:59:28.407 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-17T22:59:28.407 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-17T22:59:28.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.544+0000 7f13bc200640 1 Processor -- start 2024-01-17T22:59:28.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.544+0000 7f13bc200640 1 -- start start 2024-01-17T22:59:28.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.544+0000 7f13bc200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f13b41517f0 0x7f13b415b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:28.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.544+0000 7f13bc200640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f13b40ca3a0 0x7f13b4061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:28.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.544+0000 7f13bc200640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b40c7d10 con 0x7f13b40ca780 2024-01-17T22:59:28.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.544+0000 7f13bc200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b41576d0 con 0x7f13b41517f0 2024-01-17T22:59:28.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.544+0000 7f13bc200640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b4157970 con 0x7f13b40ca3a0 2024-01-17T22:59:28.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.544+0000 7f13b9800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f13b41517f0 0x7f13b415b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:28.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.544+0000 7f13b9800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f13b41517f0 0x7f13b415b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58000/0 (socket says 172.21.15.161:58000) 2024-01-17T22:59:28.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.544+0000 7f13b9800640 1 -- 172.21.15.161:0/2533946361 learned_addr learned my addr 172.21.15.161:0/2533946361 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:28.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.548+0000 7f13b8e00640 1 --2- 172.21.15.161:0/2533946361 >> v2:172.21.15.190:3300/0 conn(0x7f13b40ca3a0 0x7f13b4061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:28.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.548+0000 7f13b9800640 1 -- 172.21.15.161:0/2533946361 >> v2:172.21.15.190:3300/0 conn(0x7f13b40ca3a0 msgr2=0x7f13b4061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:28.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.548+0000 7f13b9800640 1 --2- 172.21.15.161:0/2533946361 >> v2:172.21.15.190:3300/0 conn(0x7f13b40ca3a0 0x7f13b4061100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.548+0000 7f13b9800640 1 -- 172.21.15.161:0/2533946361 >> v1:172.21.15.190:6789/0 conn(0x7f13b40ca780 legacy=0x7f13b40c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:28.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.548+0000 7f13b9800640 1 -- 172.21.15.161:0/2533946361 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b4157c50 con 0x7f13b41517f0 2024-01-17T22:59:28.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.552+0000 7f13b9800640 1 --2- 172.21.15.161:0/2533946361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13b41517f0 0x7f13b415b620 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f13b4061ca0 tx=0x7f13a401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb7215bc102cf50 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:28.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.556+0000 7f13b3e00640 1 -- 172.21.15.161:0/2533946361 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a40aa620 con 0x7f13b41517f0 2024-01-17T22:59:28.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.556+0000 7f13b3e00640 1 -- 172.21.15.161:0/2533946361 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a40aa780 con 0x7f13b41517f0 2024-01-17T22:59:28.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.556+0000 7f13b3e00640 1 -- 172.21.15.161:0/2533946361 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a40aab10 con 0x7f13b41517f0 2024-01-17T22:59:28.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.556+0000 7f13bc200640 1 -- 172.21.15.161:0/2533946361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13b41517f0 msgr2=0x7f13b415b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:28.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.556+0000 7f13bc200640 1 --2- 172.21.15.161:0/2533946361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13b41517f0 0x7f13b415b620 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f13b4061ca0 tx=0x7f13a401c4c0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.556+0000 7f13bc200640 1 -- 172.21.15.161:0/2533946361 shutdown_connections 2024-01-17T22:59:28.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.556+0000 7f13bc200640 1 --2- 172.21.15.161:0/2533946361 >> v2:172.21.15.190:3300/0 conn(0x7f13b40ca3a0 0x7f13b4061100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.556+0000 7f13bc200640 1 --2- 172.21.15.161:0/2533946361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13b41517f0 0x7f13b415b620 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.556+0000 7f13bc200640 1 -- 172.21.15.161:0/2533946361 >> 172.21.15.161:0/2533946361 conn(0x7f13b406ad40 msgr2=0x7f13b406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:28.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.556+0000 7f13bc200640 1 -- 172.21.15.161:0/2533946361 shutdown_connections 2024-01-17T22:59:28.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.556+0000 7f13bc200640 1 -- 172.21.15.161:0/2533946361 wait complete. 2024-01-17T22:59:28.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.560+0000 7f13bc200640 1 Processor -- start 2024-01-17T22:59:28.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.560+0000 7f13bc200640 1 -- start start 2024-01-17T22:59:28.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.560+0000 7f13bc200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13b40ca3a0 0x7f13b40b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:28.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.560+0000 7f13bc200640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13b40ca780 0x7f13b415a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:28.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.560+0000 7f13bc200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13b41517f0 0x7f13b41446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:28.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.560+0000 7f13bc200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b4148ef0 con 0x7f13b41517f0 2024-01-17T22:59:28.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.560+0000 7f13bc200640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b4159e20 con 0x7f13b40ca780 2024-01-17T22:59:28.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.560+0000 7f13bc200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b41f69b0 con 0x7f13b40ca3a0 2024-01-17T22:59:28.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.560+0000 7f13ba200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13b41517f0 0x7f13b41446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:28.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.560+0000 7f13ba200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13b41517f0 0x7f13b41446e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58014/0 (socket says 172.21.15.161:58014) 2024-01-17T22:59:28.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.560+0000 7f13ba200640 1 -- 172.21.15.161:0/2136112824 learned_addr learned my addr 172.21.15.161:0/2136112824 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:28.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.564+0000 7f13b9800640 1 --2- 172.21.15.161:0/2136112824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13b40ca3a0 0x7f13b40b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:28.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.564+0000 7f13b8e00640 1 --2- 172.21.15.161:0/2136112824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13b40ca780 0x7f13b415a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:28.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.564+0000 7f13ba200640 1 -- 172.21.15.161:0/2136112824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13b40ca3a0 msgr2=0x7f13b40b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:28.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.564+0000 7f13ba200640 1 --2- 172.21.15.161:0/2136112824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13b40ca3a0 0x7f13b40b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.564+0000 7f13ba200640 1 -- 172.21.15.161:0/2136112824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13b40ca780 msgr2=0x7f13b415a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:28.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.564+0000 7f13ba200640 1 --2- 172.21.15.161:0/2136112824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13b40ca780 0x7f13b415a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.564+0000 7f13ba200640 1 -- 172.21.15.161:0/2136112824 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a40094d0 con 0x7f13b41517f0 2024-01-17T22:59:28.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.568+0000 7f13ba200640 1 --2- 172.21.15.161:0/2136112824 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13b41517f0 0x7f13b41446e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00c780 tx=0x7f13ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:28.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.572+0000 7f13b1600640 1 -- 172.21.15.161:0/2136112824 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac003d90 con 0x7f13b41517f0 2024-01-17T22:59:28.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.572+0000 7f13b1600640 1 -- 172.21.15.161:0/2136112824 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ac00ce90 con 0x7f13b41517f0 2024-01-17T22:59:28.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.572+0000 7f13b1600640 1 -- 172.21.15.161:0/2136112824 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac0052b0 con 0x7f13b41517f0 2024-01-17T22:59:28.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.572+0000 7f13bc200640 1 -- 172.21.15.161:0/2136112824 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b4159250 con 0x7f13b41517f0 2024-01-17T22:59:28.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.572+0000 7f13bc200640 1 -- 172.21.15.161:0/2136112824 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b41597d0 con 0x7f13b41517f0 2024-01-17T22:59:28.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.572+0000 7f13bc200640 1 -- 172.21.15.161:0/2136112824 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b40746a0 con 0x7f13b41517f0 2024-01-17T22:59:28.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.592+0000 7f13b1600640 1 -- 172.21.15.161:0/2136112824 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f13ac005410 con 0x7f13b41517f0 2024-01-17T22:59:28.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.592+0000 7f13b1600640 1 --2- 172.21.15.161:0/2136112824 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f138c066890 0x7f138c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:28.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.592+0000 7f13b9800640 1 --2- 172.21.15.161:0/2136112824 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f138c066890 0x7f138c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:28.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.592+0000 7f13b9800640 1 --2- 172.21.15.161:0/2136112824 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f138c066890 0x7f138c068d50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f13a40ae000 tx=0x7f13a40b5040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:28.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.824+0000 7f13b1600640 1 -- 172.21.15.161:0/2136112824 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f13ac054d50 con 0x7f13b41517f0 2024-01-17T22:59:28.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.824+0000 7f13b1600640 1 -- 172.21.15.161:0/2136112824 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f13ac051090 con 0x7f13b41517f0 2024-01-17T22:59:28.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.972+0000 7f13bc200640 1 -- 172.21.15.161:0/2136112824 --> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13b414b7c0 con 0x7f138c066890 2024-01-17T22:59:28.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.984+0000 7f13b1600640 1 -- 172.21.15.161:0/2136112824 <== mgr.4110 v2:172.21.15.161:6800/272458188 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369030 (secure 0 0 0) 0x7f13b414b7c0 con 0x7f138c066890 2024-01-17T22:59:28.988 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:28.990 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-01-17T22:59:28.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.988+0000 7f13bc200640 1 -- 172.21.15.161:0/2136112824 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f138c066890 msgr2=0x7f138c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:28.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.988+0000 7f13bc200640 1 --2- 172.21.15.161:0/2136112824 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f138c066890 0x7f138c068d50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f13a40ae000 tx=0x7f13a40b5040 comp rx=0 tx=0).stop 2024-01-17T22:59:28.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.988+0000 7f13bc200640 1 -- 172.21.15.161:0/2136112824 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13b41517f0 msgr2=0x7f13b41446e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:28.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.988+0000 7f13bc200640 1 --2- 172.21.15.161:0/2136112824 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13b41517f0 0x7f13b41446e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00c780 tx=0x7f13ac00cc40 comp rx=0 tx=0).stop 2024-01-17T22:59:28.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.992+0000 7f13bc200640 1 -- 172.21.15.161:0/2136112824 shutdown_connections 2024-01-17T22:59:28.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.992+0000 7f13bc200640 1 --2- 172.21.15.161:0/2136112824 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f138c066890 0x7f138c068d50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.992+0000 7f13bc200640 1 --2- 172.21.15.161:0/2136112824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13b40ca780 0x7f13b415a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.992+0000 7f13bc200640 1 --2- 172.21.15.161:0/2136112824 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13b41517f0 0x7f13b41446e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.992+0000 7f13bc200640 1 --2- 172.21.15.161:0/2136112824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13b40ca3a0 0x7f13b40b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.992+0000 7f13bc200640 1 -- 172.21.15.161:0/2136112824 >> 172.21.15.161:0/2136112824 conn(0x7f13b406ad40 msgr2=0x7f13b4147a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:28.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.992+0000 7f13bc200640 1 -- 172.21.15.161:0/2136112824 shutdown_connections 2024-01-17T22:59:28.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:28.992+0000 7f13bc200640 1 -- 172.21.15.161:0/2136112824 wait complete. 2024-01-17T22:59:29.009 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-01-17T22:59:28.655487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595791,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":239,"num_write_kb":2445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":186,"ondisk_log_size":186,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218676,"kb_used_data":2532,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756044,"statfs":{"total":773094113280,"available":772870189056,"internally_reserved":0,"allocated":2592768,"data_stored":2159586,"data_compressed":66578,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":784,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003312"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.470133+0000","last_change":"2024-01-17T22:58:48.328193+0000","last_active":"2024-01-17T22:59:07.470133+0000","last_peered":"2024-01-17T22:59:07.470133+0000","last_clean":"2024-01-17T22:59:07.470133+0000","last_became_active":"2024-01-17T22:58:48.327340+0000","last_became_peered":"2024-01-17T22:58:48.327340+0000","last_unstale":"2024-01-17T22:59:07.470133+0000","last_undegraded":"2024-01-17T22:59:07.470133+0000","last_fullsized":"2024-01-17T22:59:07.470133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:56.524325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477190+0000","last_change":"2024-01-17T22:58:49.351609+0000","last_active":"2024-01-17T22:59:07.477190+0000","last_peered":"2024-01-17T22:59:07.477190+0000","last_clean":"2024-01-17T22:59:07.477190+0000","last_became_active":"2024-01-17T22:58:49.350812+0000","last_became_peered":"2024-01-17T22:58:49.350812+0000","last_unstale":"2024-01-17T22:59:07.477190+0000","last_undegraded":"2024-01-17T22:59:07.477190+0000","last_fullsized":"2024-01-17T22:59:07.477190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:02:07.535209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.461792+0000","last_change":"2024-01-17T22:58:55.903757+0000","last_active":"2024-01-17T22:59:07.461792+0000","last_peered":"2024-01-17T22:59:07.461792+0000","last_clean":"2024-01-17T22:59:07.461792+0000","last_became_active":"2024-01-17T22:58:55.903167+0000","last_became_peered":"2024-01-17T22:58:55.903167+0000","last_unstale":"2024-01-17T22:59:07.461792+0000","last_undegraded":"2024-01-17T22:59:07.461792+0000","last_fullsized":"2024-01-17T22:59:07.461792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:22.127961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477292+0000","last_change":"2024-01-17T22:58:48.373068+0000","last_active":"2024-01-17T22:59:07.477292+0000","last_peered":"2024-01-17T22:59:07.477292+0000","last_clean":"2024-01-17T22:59:07.477292+0000","last_became_active":"2024-01-17T22:58:48.372582+0000","last_became_peered":"2024-01-17T22:58:48.372582+0000","last_unstale":"2024-01-17T22:59:07.477292+0000","last_undegraded":"2024-01-17T22:59:07.477292+0000","last_fullsized":"2024-01-17T22:59:07.477292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:10:59.139723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.478032+0000","last_change":"2024-01-17T22:58:49.511918+0000","last_active":"2024-01-17T22:59:07.478032+0000","last_peered":"2024-01-17T22:59:07.478032+0000","last_clean":"2024-01-17T22:59:07.478032+0000","last_became_active":"2024-01-17T22:58:49.511303+0000","last_became_peered":"2024-01-17T22:58:49.511303+0000","last_unstale":"2024-01-17T22:59:07.478032+0000","last_undegraded":"2024-01-17T22:59:07.478032+0000","last_fullsized":"2024-01-17T22:59:07.478032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:13:09.466879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474413+0000","last_change":"2024-01-17T22:58:55.878752+0000","last_active":"2024-01-17T22:59:07.474413+0000","last_peered":"2024-01-17T22:59:07.474413+0000","last_clean":"2024-01-17T22:59:07.474413+0000","last_became_active":"2024-01-17T22:58:55.878263+0000","last_became_peered":"2024-01-17T22:58:55.878263+0000","last_unstale":"2024-01-17T22:59:07.474413+0000","last_undegraded":"2024-01-17T22:59:07.474413+0000","last_fullsized":"2024-01-17T22:59:07.474413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:19:49.420559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472270+0000","last_change":"2024-01-17T22:58:48.346724+0000","last_active":"2024-01-17T22:59:07.472270+0000","last_peered":"2024-01-17T22:59:07.472270+0000","last_clean":"2024-01-17T22:59:07.472270+0000","last_became_active":"2024-01-17T22:58:48.346411+0000","last_became_peered":"2024-01-17T22:58:48.346411+0000","last_unstale":"2024-01-17T22:59:07.472270+0000","last_undegraded":"2024-01-17T22:59:07.472270+0000","last_fullsized":"2024-01-17T22:59:07.472270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:03:04.691978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479505+0000","last_change":"2024-01-17T22:58:49.517981+0000","last_active":"2024-01-17T22:59:07.479505+0000","last_peered":"2024-01-17T22:59:07.479505+0000","last_clean":"2024-01-17T22:59:07.479505+0000","last_became_active":"2024-01-17T22:58:49.517710+0000","last_became_peered":"2024-01-17T22:58:49.517710+0000","last_unstale":"2024-01-17T22:59:07.479505+0000","last_undegraded":"2024-01-17T22:59:07.479505+0000","last_fullsized":"2024-01-17T22:59:07.479505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475930+0000","last_change":"2024-01-17T22:58:55.847347+0000","last_active":"2024-01-17T22:59:07.475930+0000","last_peered":"2024-01-17T22:59:07.475930+0000","last_clean":"2024-01-17T22:59:07.475930+0000","last_became_active":"2024-01-17T22:58:55.846773+0000","last_became_peered":"2024-01-17T22:58:55.846773+0000","last_unstale":"2024-01-17T22:59:07.475930+0000","last_undegraded":"2024-01-17T22:59:07.475930+0000","last_fullsized":"2024-01-17T22:59:07.475930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:31:43.629750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.473014+0000","last_change":"2024-01-17T22:58:48.346483+0000","last_active":"2024-01-17T22:59:07.473014+0000","last_peered":"2024-01-17T22:59:07.473014+0000","last_clean":"2024-01-17T22:59:07.473014+0000","last_became_active":"2024-01-17T22:58:48.345749+0000","last_became_peered":"2024-01-17T22:58:48.345749+0000","last_unstale":"2024-01-17T22:59:07.473014+0000","last_undegraded":"2024-01-17T22:59:07.473014+0000","last_fullsized":"2024-01-17T22:59:07.473014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:22:41.169668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476010+0000","last_change":"2024-01-17T22:58:49.371509+0000","last_active":"2024-01-17T22:59:07.476010+0000","last_peered":"2024-01-17T22:59:07.476010+0000","last_clean":"2024-01-17T22:59:07.476010+0000","last_became_active":"2024-01-17T22:58:49.370010+0000","last_became_peered":"2024-01-17T22:58:49.370010+0000","last_unstale":"2024-01-17T22:59:07.476010+0000","last_undegraded":"2024-01-17T22:59:07.476010+0000","last_fullsized":"2024-01-17T22:59:07.476010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:36:24.817716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474645+0000","last_change":"2024-01-17T22:58:55.886223+0000","last_active":"2024-01-17T22:59:07.474645+0000","last_peered":"2024-01-17T22:59:07.474645+0000","last_clean":"2024-01-17T22:59:07.474645+0000","last_became_active":"2024-01-17T22:58:55.885739+0000","last_became_peered":"2024-01-17T22:58:55.885739+0000","last_unstale":"2024-01-17T22:59:07.474645+0000","last_undegraded":"2024-01-17T22:59:07.474645+0000","last_fullsized":"2024-01-17T22:59:07.474645+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:49:18.835647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474772+0000","last_change":"2024-01-17T22:58:49.514565+0000","last_active":"2024-01-17T22:59:07.474772+0000","last_peered":"2024-01-17T22:59:07.474772+0000","last_clean":"2024-01-17T22:59:07.474772+0000","last_became_active":"2024-01-17T22:58:49.514310+0000","last_became_peered":"2024-01-17T22:58:49.514310+0000","last_unstale":"2024-01-17T22:59:07.474772+0000","last_undegraded":"2024-01-17T22:59:07.474772+0000","last_fullsized":"2024-01-17T22:59:07.474772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:01:32.364167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.577114+0000","last_change":"2024-01-17T22:58:48.341961+0000","last_active":"2024-01-17T22:59:25.577114+0000","last_peered":"2024-01-17T22:59:25.577114+0000","last_clean":"2024-01-17T22:59:25.577114+0000","last_became_active":"2024-01-17T22:58:48.341498+0000","last_became_peered":"2024-01-17T22:58:48.341498+0000","last_unstale":"2024-01-17T22:59:25.577114+0000","last_undegraded":"2024-01-17T22:59:25.577114+0000","last_fullsized":"2024-01-17T22:59:25.577114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:56.524325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475855+0000","last_change":"2024-01-17T22:58:55.915918+0000","last_active":"2024-01-17T22:59:07.475855+0000","last_peered":"2024-01-17T22:59:07.475855+0000","last_clean":"2024-01-17T22:59:07.475855+0000","last_became_active":"2024-01-17T22:58:55.915556+0000","last_became_peered":"2024-01-17T22:58:55.915556+0000","last_unstale":"2024-01-17T22:59:07.475855+0000","last_undegraded":"2024-01-17T22:59:07.475855+0000","last_fullsized":"2024-01-17T22:59:07.475855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:22:21.478703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.462199+0000","last_change":"2024-01-17T22:58:49.388237+0000","last_active":"2024-01-17T22:59:07.462199+0000","last_peered":"2024-01-17T22:59:07.462199+0000","last_clean":"2024-01-17T22:59:07.462199+0000","last_became_active":"2024-01-17T22:58:49.387500+0000","last_became_peered":"2024-01-17T22:58:49.387500+0000","last_unstale":"2024-01-17T22:59:07.462199+0000","last_undegraded":"2024-01-17T22:59:07.462199+0000","last_fullsized":"2024-01-17T22:59:07.462199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468246+0000","last_change":"2024-01-17T22:58:48.346215+0000","last_active":"2024-01-17T22:59:07.468246+0000","last_peered":"2024-01-17T22:59:07.468246+0000","last_clean":"2024-01-17T22:59:07.468246+0000","last_became_active":"2024-01-17T22:58:48.345584+0000","last_became_peered":"2024-01-17T22:58:48.345584+0000","last_unstale":"2024-01-17T22:59:07.468246+0000","last_undegraded":"2024-01-17T22:59:07.468246+0000","last_fullsized":"2024-01-17T22:59:07.468246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471736+0000","last_change":"2024-01-17T22:58:55.904518+0000","last_active":"2024-01-17T22:59:07.471736+0000","last_peered":"2024-01-17T22:59:07.471736+0000","last_clean":"2024-01-17T22:59:07.471736+0000","last_became_active":"2024-01-17T22:58:55.904182+0000","last_became_peered":"2024-01-17T22:58:55.904182+0000","last_unstale":"2024-01-17T22:59:07.471736+0000","last_undegraded":"2024-01-17T22:59:07.471736+0000","last_fullsized":"2024-01-17T22:59:07.471736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:24:43.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468071+0000","last_change":"2024-01-17T22:58:49.417907+0000","last_active":"2024-01-17T22:59:07.468071+0000","last_peered":"2024-01-17T22:59:07.468071+0000","last_clean":"2024-01-17T22:59:07.468071+0000","last_became_active":"2024-01-17T22:58:49.417440+0000","last_became_peered":"2024-01-17T22:58:49.417440+0000","last_unstale":"2024-01-17T22:59:07.468071+0000","last_undegraded":"2024-01-17T22:59:07.468071+0000","last_fullsized":"2024-01-17T22:59:07.468071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:59.773063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.575301+0000","last_change":"2024-01-17T22:58:48.332092+0000","last_active":"2024-01-17T22:59:25.575301+0000","last_peered":"2024-01-17T22:59:25.575301+0000","last_clean":"2024-01-17T22:59:25.575301+0000","last_became_active":"2024-01-17T22:58:48.331435+0000","last_became_peered":"2024-01-17T22:58:48.331435+0000","last_unstale":"2024-01-17T22:59:25.575301+0000","last_undegraded":"2024-01-17T22:59:25.575301+0000","last_fullsized":"2024-01-17T22:59:25.575301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:41:24.117738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:09.255716+0000","last_change":"2024-01-17T22:59:09.254564+0000","last_active":"2024-01-17T22:59:09.255716+0000","last_peered":"2024-01-17T22:59:09.255716+0000","last_clean":"2024-01-17T22:59:09.255716+0000","last_became_active":"2024-01-17T22:59:09.254084+0000","last_became_peered":"2024-01-17T22:59:09.254084+0000","last_unstale":"2024-01-17T22:59:09.255716+0000","last_undegraded":"2024-01-17T22:59:09.255716+0000","last_fullsized":"2024-01-17T22:59:09.255716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:04:05.785891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2,3],"acting":[0,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474946+0000","last_change":"2024-01-17T22:58:49.416963+0000","last_active":"2024-01-17T22:59:07.474946+0000","last_peered":"2024-01-17T22:59:07.474946+0000","last_clean":"2024-01-17T22:59:07.474946+0000","last_became_active":"2024-01-17T22:58:49.416757+0000","last_became_peered":"2024-01-17T22:58:49.416757+0000","last_unstale":"2024-01-17T22:59:07.474946+0000","last_undegraded":"2024-01-17T22:59:07.474946+0000","last_fullsized":"2024-01-17T22:59:07.474946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:08.763719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.470918+0000","last_change":"2024-01-17T22:58:48.341728+0000","last_active":"2024-01-17T22:59:07.470918+0000","last_peered":"2024-01-17T22:59:07.470918+0000","last_clean":"2024-01-17T22:59:07.470918+0000","last_became_active":"2024-01-17T22:58:48.341359+0000","last_became_peered":"2024-01-17T22:58:48.341359+0000","last_unstale":"2024-01-17T22:59:07.470918+0000","last_undegraded":"2024-01-17T22:59:07.470918+0000","last_fullsized":"2024-01-17T22:59:07.470918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:20:07.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476805+0000","last_change":"2024-01-17T22:58:55.913996+0000","last_active":"2024-01-17T22:59:07.476805+0000","last_peered":"2024-01-17T22:59:07.476805+0000","last_clean":"2024-01-17T22:59:07.476805+0000","last_became_active":"2024-01-17T22:58:55.913645+0000","last_became_peered":"2024-01-17T22:58:55.913645+0000","last_unstale":"2024-01-17T22:59:07.476805+0000","last_undegraded":"2024-01-17T22:59:07.476805+0000","last_fullsized":"2024-01-17T22:59:07.476805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468870+0000","last_change":"2024-01-17T22:58:49.417874+0000","last_active":"2024-01-17T22:59:07.468870+0000","last_peered":"2024-01-17T22:59:07.468870+0000","last_clean":"2024-01-17T22:59:07.468870+0000","last_became_active":"2024-01-17T22:58:49.417385+0000","last_became_peered":"2024-01-17T22:58:49.417385+0000","last_unstale":"2024-01-17T22:59:07.468870+0000","last_undegraded":"2024-01-17T22:59:07.468870+0000","last_fullsized":"2024-01-17T22:59:07.468870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:41.515981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.575922+0000","last_change":"2024-01-17T22:58:48.340052+0000","last_active":"2024-01-17T22:59:25.575922+0000","last_peered":"2024-01-17T22:59:25.575922+0000","last_clean":"2024-01-17T22:59:25.575922+0000","last_became_active":"2024-01-17T22:58:48.339738+0000","last_became_peered":"2024-01-17T22:58:48.339738+0000","last_unstale":"2024-01-17T22:59:25.575922+0000","last_undegraded":"2024-01-17T22:59:25.575922+0000","last_fullsized":"2024-01-17T22:59:25.575922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:58.517904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475163+0000","last_change":"2024-01-17T22:58:55.904749+0000","last_active":"2024-01-17T22:59:07.475163+0000","last_peered":"2024-01-17T22:59:07.475163+0000","last_clean":"2024-01-17T22:59:07.475163+0000","last_became_active":"2024-01-17T22:58:55.904417+0000","last_became_peered":"2024-01-17T22:58:55.904417+0000","last_unstale":"2024-01-17T22:59:07.475163+0000","last_undegraded":"2024-01-17T22:59:07.475163+0000","last_fullsized":"2024-01-17T22:59:07.475163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:22:32.504064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469801+0000","last_change":"2024-01-17T22:58:49.411284+0000","last_active":"2024-01-17T22:59:07.469801+0000","last_peered":"2024-01-17T22:59:07.469801+0000","last_clean":"2024-01-17T22:59:07.469801+0000","last_became_active":"2024-01-17T22:58:49.410830+0000","last_became_peered":"2024-01-17T22:58:49.410830+0000","last_unstale":"2024-01-17T22:59:07.469801+0000","last_undegraded":"2024-01-17T22:59:07.469801+0000","last_fullsized":"2024-01-17T22:59:07.469801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:17:04.832847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469132+0000","last_change":"2024-01-17T22:58:48.339919+0000","last_active":"2024-01-17T22:59:07.469132+0000","last_peered":"2024-01-17T22:59:07.469132+0000","last_clean":"2024-01-17T22:59:07.469132+0000","last_became_active":"2024-01-17T22:58:48.338928+0000","last_became_peered":"2024-01-17T22:58:48.338928+0000","last_unstale":"2024-01-17T22:59:07.469132+0000","last_undegraded":"2024-01-17T22:59:07.469132+0000","last_fullsized":"2024-01-17T22:59:07.469132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:21.699809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467936+0000","last_change":"2024-01-17T22:58:55.909140+0000","last_active":"2024-01-17T22:59:07.467936+0000","last_peered":"2024-01-17T22:59:07.467936+0000","last_clean":"2024-01-17T22:59:07.467936+0000","last_became_active":"2024-01-17T22:58:55.908232+0000","last_became_peered":"2024-01-17T22:58:55.908232+0000","last_unstale":"2024-01-17T22:59:07.467936+0000","last_undegraded":"2024-01-17T22:59:07.467936+0000","last_fullsized":"2024-01-17T22:59:07.467936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.470820+0000","last_change":"2024-01-17T22:58:49.370201+0000","last_active":"2024-01-17T22:59:07.470820+0000","last_peered":"2024-01-17T22:59:07.470820+0000","last_clean":"2024-01-17T22:59:07.470820+0000","last_became_active":"2024-01-17T22:58:49.369598+0000","last_became_peered":"2024-01-17T22:58:49.369598+0000","last_unstale":"2024-01-17T22:59:07.470820+0000","last_undegraded":"2024-01-17T22:59:07.470820+0000","last_fullsized":"2024-01-17T22:59:07.470820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:15.814647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.670757+0000","last_change":"2024-01-17T22:58:48.338556+0000","last_active":"2024-01-17T22:59:08.670757+0000","last_peered":"2024-01-17T22:59:08.670757+0000","last_clean":"2024-01-17T22:59:08.670757+0000","last_became_active":"2024-01-17T22:58:48.338225+0000","last_became_peered":"2024-01-17T22:58:48.338225+0000","last_unstale":"2024-01-17T22:59:08.670757+0000","last_undegraded":"2024-01-17T22:59:08.670757+0000","last_fullsized":"2024-01-17T22:59:08.670757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:47.210049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469567+0000","last_change":"2024-01-17T22:58:55.872734+0000","last_active":"2024-01-17T22:59:07.469567+0000","last_peered":"2024-01-17T22:59:07.469567+0000","last_clean":"2024-01-17T22:59:07.469567+0000","last_became_active":"2024-01-17T22:58:55.872356+0000","last_became_peered":"2024-01-17T22:58:55.872356+0000","last_unstale":"2024-01-17T22:59:07.469567+0000","last_undegraded":"2024-01-17T22:59:07.469567+0000","last_fullsized":"2024-01-17T22:59:07.469567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:22:32.504064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476568+0000","last_change":"2024-01-17T22:58:49.369806+0000","last_active":"2024-01-17T22:59:07.476568+0000","last_peered":"2024-01-17T22:59:07.476568+0000","last_clean":"2024-01-17T22:59:07.476568+0000","last_became_active":"2024-01-17T22:58:49.369487+0000","last_became_peered":"2024-01-17T22:58:49.369487+0000","last_unstale":"2024-01-17T22:59:07.476568+0000","last_undegraded":"2024-01-17T22:59:07.476568+0000","last_fullsized":"2024-01-17T22:59:07.476568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:25.515983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477453+0000","last_change":"2024-01-17T22:58:48.341854+0000","last_active":"2024-01-17T22:59:07.477453+0000","last_peered":"2024-01-17T22:59:07.477453+0000","last_clean":"2024-01-17T22:59:07.477453+0000","last_became_active":"2024-01-17T22:58:48.339996+0000","last_became_peered":"2024-01-17T22:58:48.339996+0000","last_unstale":"2024-01-17T22:59:07.477453+0000","last_undegraded":"2024-01-17T22:59:07.477453+0000","last_fullsized":"2024-01-17T22:59:07.477453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:55:52.894278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467661+0000","last_change":"2024-01-17T22:58:55.877637+0000","last_active":"2024-01-17T22:59:07.467661+0000","last_peered":"2024-01-17T22:59:07.467661+0000","last_clean":"2024-01-17T22:59:07.467661+0000","last_became_active":"2024-01-17T22:58:55.877118+0000","last_became_peered":"2024-01-17T22:58:55.877118+0000","last_unstale":"2024-01-17T22:59:07.467661+0000","last_undegraded":"2024-01-17T22:59:07.467661+0000","last_fullsized":"2024-01-17T22:59:07.467661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:08.327495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471403+0000","last_change":"2024-01-17T22:58:49.352845+0000","last_active":"2024-01-17T22:59:07.471403+0000","last_peered":"2024-01-17T22:59:07.471403+0000","last_clean":"2024-01-17T22:59:07.471403+0000","last_became_active":"2024-01-17T22:58:49.352563+0000","last_became_peered":"2024-01-17T22:58:49.352563+0000","last_unstale":"2024-01-17T22:59:07.471403+0000","last_undegraded":"2024-01-17T22:59:07.471403+0000","last_fullsized":"2024-01-17T22:59:07.471403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:43.516572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475062+0000","last_change":"2024-01-17T22:58:48.343658+0000","last_active":"2024-01-17T22:59:07.475062+0000","last_peered":"2024-01-17T22:59:07.475062+0000","last_clean":"2024-01-17T22:59:07.475062+0000","last_became_active":"2024-01-17T22:58:48.343060+0000","last_became_peered":"2024-01-17T22:58:48.343060+0000","last_unstale":"2024-01-17T22:59:07.475062+0000","last_undegraded":"2024-01-17T22:59:07.475062+0000","last_fullsized":"2024-01-17T22:59:07.475062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:42.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.470375+0000","last_change":"2024-01-17T22:58:55.881076+0000","last_active":"2024-01-17T22:59:07.470375+0000","last_peered":"2024-01-17T22:59:07.470375+0000","last_clean":"2024-01-17T22:59:07.470375+0000","last_became_active":"2024-01-17T22:58:55.880665+0000","last_became_peered":"2024-01-17T22:58:55.880665+0000","last_unstale":"2024-01-17T22:59:07.470375+0000","last_undegraded":"2024-01-17T22:59:07.470375+0000","last_fullsized":"2024-01-17T22:59:07.470375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:37:20.317014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475438+0000","last_change":"2024-01-17T22:58:49.385682+0000","last_active":"2024-01-17T22:59:07.475438+0000","last_peered":"2024-01-17T22:59:07.475438+0000","last_clean":"2024-01-17T22:59:07.475438+0000","last_became_active":"2024-01-17T22:58:49.384655+0000","last_became_peered":"2024-01-17T22:58:49.384655+0000","last_unstale":"2024-01-17T22:59:07.475438+0000","last_undegraded":"2024-01-17T22:59:07.475438+0000","last_fullsized":"2024-01-17T22:59:07.475438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:22:51.592384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.638398+0000","last_change":"2024-01-17T22:58:48.375527+0000","last_active":"2024-01-17T22:59:08.638398+0000","last_peered":"2024-01-17T22:59:08.638398+0000","last_clean":"2024-01-17T22:59:08.638398+0000","last_became_active":"2024-01-17T22:58:48.375210+0000","last_became_peered":"2024-01-17T22:58:48.375210+0000","last_unstale":"2024-01-17T22:59:08.638398+0000","last_undegraded":"2024-01-17T22:59:08.638398+0000","last_fullsized":"2024-01-17T22:59:08.638398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:51:00.037407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468786+0000","last_change":"2024-01-17T22:58:55.903437+0000","last_active":"2024-01-17T22:59:07.468786+0000","last_peered":"2024-01-17T22:59:07.468786+0000","last_clean":"2024-01-17T22:59:07.468786+0000","last_became_active":"2024-01-17T22:58:55.902881+0000","last_became_peered":"2024-01-17T22:58:55.902881+0000","last_unstale":"2024-01-17T22:59:07.468786+0000","last_undegraded":"2024-01-17T22:59:07.468786+0000","last_fullsized":"2024-01-17T22:59:07.468786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467415+0000","last_change":"2024-01-17T22:58:49.367932+0000","last_active":"2024-01-17T22:59:07.467415+0000","last_peered":"2024-01-17T22:59:07.467415+0000","last_clean":"2024-01-17T22:59:07.467415+0000","last_became_active":"2024-01-17T22:58:49.367236+0000","last_became_peered":"2024-01-17T22:58:49.367236+0000","last_unstale":"2024-01-17T22:59:07.467415+0000","last_undegraded":"2024-01-17T22:59:07.467415+0000","last_fullsized":"2024-01-17T22:59:07.467415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:06.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.669794+0000","last_change":"2024-01-17T22:58:48.338730+0000","last_active":"2024-01-17T22:59:08.669794+0000","last_peered":"2024-01-17T22:59:08.669794+0000","last_clean":"2024-01-17T22:59:08.669794+0000","last_became_active":"2024-01-17T22:58:48.337500+0000","last_became_peered":"2024-01-17T22:58:48.337500+0000","last_unstale":"2024-01-17T22:59:08.669794+0000","last_undegraded":"2024-01-17T22:59:08.669794+0000","last_fullsized":"2024-01-17T22:59:08.669794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:54.141445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477014+0000","last_change":"2024-01-17T22:58:55.900298+0000","last_active":"2024-01-17T22:59:07.477014+0000","last_peered":"2024-01-17T22:59:07.477014+0000","last_clean":"2024-01-17T22:59:07.477014+0000","last_became_active":"2024-01-17T22:58:55.899657+0000","last_became_peered":"2024-01-17T22:58:55.899657+0000","last_unstale":"2024-01-17T22:59:07.477014+0000","last_undegraded":"2024-01-17T22:59:07.477014+0000","last_fullsized":"2024-01-17T22:59:07.477014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:30:03.955178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468595+0000","last_change":"2024-01-17T22:58:49.412701+0000","last_active":"2024-01-17T22:59:07.468595+0000","last_peered":"2024-01-17T22:59:07.468595+0000","last_clean":"2024-01-17T22:59:07.468595+0000","last_became_active":"2024-01-17T22:58:49.411848+0000","last_became_peered":"2024-01-17T22:58:49.411848+0000","last_unstale":"2024-01-17T22:59:07.468595+0000","last_undegraded":"2024-01-17T22:59:07.468595+0000","last_fullsized":"2024-01-17T22:59:07.468595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:55:47.020055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.577178+0000","last_change":"2024-01-17T22:58:48.341769+0000","last_active":"2024-01-17T22:59:25.577178+0000","last_peered":"2024-01-17T22:59:25.577178+0000","last_clean":"2024-01-17T22:59:25.577178+0000","last_became_active":"2024-01-17T22:58:48.340963+0000","last_became_peered":"2024-01-17T22:58:48.340963+0000","last_unstale":"2024-01-17T22:59:25.577178+0000","last_undegraded":"2024-01-17T22:59:25.577178+0000","last_fullsized":"2024-01-17T22:59:25.577178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:15:16.672836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479207+0000","last_change":"2024-01-17T22:58:17.322374+0000","last_active":"2024-01-17T22:59:07.479207+0000","last_peered":"2024-01-17T22:59:07.479207+0000","last_clean":"2024-01-17T22:59:07.479207+0000","last_became_active":"2024-01-17T22:58:17.321097+0000","last_became_peered":"2024-01-17T22:58:17.321097+0000","last_unstale":"2024-01-17T22:59:07.479207+0000","last_undegraded":"2024-01-17T22:59:07.479207+0000","last_fullsized":"2024-01-17T22:59:07.479207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:15.452106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:15.452106+0000","last_clean_scrub_stamp":"2024-01-17T22:58:15.452106+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:55:58.924319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476194+0000","last_change":"2024-01-17T22:58:55.909509+0000","last_active":"2024-01-17T22:59:07.476194+0000","last_peered":"2024-01-17T22:59:07.476194+0000","last_clean":"2024-01-17T22:59:07.476194+0000","last_became_active":"2024-01-17T22:58:55.909055+0000","last_became_peered":"2024-01-17T22:58:55.909055+0000","last_unstale":"2024-01-17T22:59:07.476194+0000","last_undegraded":"2024-01-17T22:59:07.476194+0000","last_fullsized":"2024-01-17T22:59:07.476194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:11:12.388395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476079+0000","last_change":"2024-01-17T22:58:49.516198+0000","last_active":"2024-01-17T22:59:07.476079+0000","last_peered":"2024-01-17T22:59:07.476079+0000","last_clean":"2024-01-17T22:59:07.476079+0000","last_became_active":"2024-01-17T22:58:49.515941+0000","last_became_peered":"2024-01-17T22:58:49.515941+0000","last_unstale":"2024-01-17T22:59:07.476079+0000","last_undegraded":"2024-01-17T22:59:07.476079+0000","last_fullsized":"2024-01-17T22:59:07.476079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:54:07.128744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.470970+0000","last_change":"2024-01-17T22:58:48.344998+0000","last_active":"2024-01-17T22:59:07.470970+0000","last_peered":"2024-01-17T22:59:07.470970+0000","last_clean":"2024-01-17T22:59:07.470970+0000","last_became_active":"2024-01-17T22:58:48.344402+0000","last_became_peered":"2024-01-17T22:58:48.344402+0000","last_unstale":"2024-01-17T22:59:07.470970+0000","last_undegraded":"2024-01-17T22:59:07.470970+0000","last_fullsized":"2024-01-17T22:59:07.470970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:01:21.629083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475784+0000","last_change":"2024-01-17T22:58:55.886258+0000","last_active":"2024-01-17T22:59:07.475784+0000","last_peered":"2024-01-17T22:59:07.475784+0000","last_clean":"2024-01-17T22:59:07.475784+0000","last_became_active":"2024-01-17T22:58:55.885809+0000","last_became_peered":"2024-01-17T22:58:55.885809+0000","last_unstale":"2024-01-17T22:59:07.475784+0000","last_undegraded":"2024-01-17T22:59:07.475784+0000","last_fullsized":"2024-01-17T22:59:07.475784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:08.327495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.656010+0000","last_change":"2024-01-17T22:59:08.654953+0000","last_active":"2024-01-17T22:59:08.656010+0000","last_peered":"2024-01-17T22:59:08.656010+0000","last_clean":"2024-01-17T22:59:08.656010+0000","last_became_active":"2024-01-17T22:59:08.654136+0000","last_became_peered":"2024-01-17T22:59:08.654136+0000","last_unstale":"2024-01-17T22:59:08.656010+0000","last_undegraded":"2024-01-17T22:59:08.656010+0000","last_fullsized":"2024-01-17T22:59:08.656010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:19:02.000223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476805+0000","last_change":"2024-01-17T22:58:48.338206+0000","last_active":"2024-01-17T22:59:07.476805+0000","last_peered":"2024-01-17T22:59:07.476805+0000","last_clean":"2024-01-17T22:59:07.476805+0000","last_became_active":"2024-01-17T22:58:48.337489+0000","last_became_peered":"2024-01-17T22:58:48.337489+0000","last_unstale":"2024-01-17T22:59:07.476805+0000","last_undegraded":"2024-01-17T22:59:07.476805+0000","last_fullsized":"2024-01-17T22:59:07.476805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:09:04.579374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476461+0000","last_change":"2024-01-17T22:58:55.903435+0000","last_active":"2024-01-17T22:59:07.476461+0000","last_peered":"2024-01-17T22:59:07.476461+0000","last_clean":"2024-01-17T22:59:07.476461+0000","last_became_active":"2024-01-17T22:58:55.902857+0000","last_became_peered":"2024-01-17T22:58:55.902857+0000","last_unstale":"2024-01-17T22:59:07.476461+0000","last_undegraded":"2024-01-17T22:59:07.476461+0000","last_fullsized":"2024-01-17T22:59:07.476461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:24:43.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.473428+0000","last_change":"2024-01-17T22:58:49.519307+0000","last_active":"2024-01-17T22:59:07.473428+0000","last_peered":"2024-01-17T22:59:07.473428+0000","last_clean":"2024-01-17T22:59:07.473428+0000","last_became_active":"2024-01-17T22:58:49.519060+0000","last_became_peered":"2024-01-17T22:58:49.519060+0000","last_unstale":"2024-01-17T22:59:07.473428+0000","last_undegraded":"2024-01-17T22:59:07.473428+0000","last_fullsized":"2024-01-17T22:59:07.473428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:48.025499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469006+0000","last_change":"2024-01-17T22:58:48.341584+0000","last_active":"2024-01-17T22:59:07.469006+0000","last_peered":"2024-01-17T22:59:07.469006+0000","last_clean":"2024-01-17T22:59:07.469006+0000","last_became_active":"2024-01-17T22:58:48.339433+0000","last_became_peered":"2024-01-17T22:58:48.339433+0000","last_unstale":"2024-01-17T22:59:07.469006+0000","last_undegraded":"2024-01-17T22:59:07.469006+0000","last_fullsized":"2024-01-17T22:59:07.469006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:01:09.060396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474422+0000","last_change":"2024-01-17T22:58:55.905118+0000","last_active":"2024-01-17T22:59:07.474422+0000","last_peered":"2024-01-17T22:59:07.474422+0000","last_clean":"2024-01-17T22:59:07.474422+0000","last_became_active":"2024-01-17T22:58:55.904690+0000","last_became_peered":"2024-01-17T22:58:55.904690+0000","last_unstale":"2024-01-17T22:59:07.474422+0000","last_undegraded":"2024-01-17T22:59:07.474422+0000","last_fullsized":"2024-01-17T22:59:07.474422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:45:30.212764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477010+0000","last_change":"2024-01-17T22:58:49.352993+0000","last_active":"2024-01-17T22:59:07.477010+0000","last_peered":"2024-01-17T22:59:07.477010+0000","last_clean":"2024-01-17T22:59:07.477010+0000","last_became_active":"2024-01-17T22:58:49.352744+0000","last_became_peered":"2024-01-17T22:58:49.352744+0000","last_unstale":"2024-01-17T22:59:07.477010+0000","last_undegraded":"2024-01-17T22:59:07.477010+0000","last_fullsized":"2024-01-17T22:59:07.477010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:06.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.473284+0000","last_change":"2024-01-17T22:58:48.343793+0000","last_active":"2024-01-17T22:59:07.473284+0000","last_peered":"2024-01-17T22:59:07.473284+0000","last_clean":"2024-01-17T22:59:07.473284+0000","last_became_active":"2024-01-17T22:58:48.343435+0000","last_became_peered":"2024-01-17T22:58:48.343435+0000","last_unstale":"2024-01-17T22:59:07.473284+0000","last_undegraded":"2024-01-17T22:59:07.473284+0000","last_fullsized":"2024-01-17T22:59:07.473284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:50:50.592551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479386+0000","last_change":"2024-01-17T22:58:55.913690+0000","last_active":"2024-01-17T22:59:07.479386+0000","last_peered":"2024-01-17T22:59:07.479386+0000","last_clean":"2024-01-17T22:59:07.479386+0000","last_became_active":"2024-01-17T22:58:55.913197+0000","last_became_peered":"2024-01-17T22:58:55.913197+0000","last_unstale":"2024-01-17T22:59:07.479386+0000","last_undegraded":"2024-01-17T22:59:07.479386+0000","last_fullsized":"2024-01-17T22:59:07.479386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:31.829297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474856+0000","last_change":"2024-01-17T22:58:49.368242+0000","last_active":"2024-01-17T22:59:07.474856+0000","last_peered":"2024-01-17T22:59:07.474856+0000","last_clean":"2024-01-17T22:59:07.474856+0000","last_became_active":"2024-01-17T22:58:49.368018+0000","last_became_peered":"2024-01-17T22:58:49.368018+0000","last_unstale":"2024-01-17T22:59:07.474856+0000","last_undegraded":"2024-01-17T22:59:07.474856+0000","last_fullsized":"2024-01-17T22:59:07.474856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:49:55.661543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'10","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.575506+0000","last_change":"2024-01-17T22:58:48.374293+0000","last_active":"2024-01-17T22:59:25.575506+0000","last_peered":"2024-01-17T22:59:25.575506+0000","last_clean":"2024-01-17T22:59:25.575506+0000","last_became_active":"2024-01-17T22:58:48.373287+0000","last_became_peered":"2024-01-17T22:58:48.373287+0000","last_unstale":"2024-01-17T22:59:25.575506+0000","last_undegraded":"2024-01-17T22:59:25.575506+0000","last_fullsized":"2024-01-17T22:59:25.575506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477137+0000","last_change":"2024-01-17T22:58:55.909679+0000","last_active":"2024-01-17T22:59:07.477137+0000","last_peered":"2024-01-17T22:59:07.477137+0000","last_clean":"2024-01-17T22:59:07.477137+0000","last_became_active":"2024-01-17T22:58:55.909139+0000","last_became_peered":"2024-01-17T22:58:55.909139+0000","last_unstale":"2024-01-17T22:59:07.477137+0000","last_undegraded":"2024-01-17T22:59:07.477137+0000","last_fullsized":"2024-01-17T22:59:07.477137+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:39:50.993158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479057+0000","last_change":"2024-01-17T22:58:49.515761+0000","last_active":"2024-01-17T22:59:07.479057+0000","last_peered":"2024-01-17T22:59:07.479057+0000","last_clean":"2024-01-17T22:59:07.479057+0000","last_became_active":"2024-01-17T22:58:49.514776+0000","last_became_peered":"2024-01-17T22:58:49.514776+0000","last_unstale":"2024-01-17T22:59:07.479057+0000","last_undegraded":"2024-01-17T22:59:07.479057+0000","last_fullsized":"2024-01-17T22:59:07.479057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471100+0000","last_change":"2024-01-17T22:58:48.349505+0000","last_active":"2024-01-17T22:59:07.471100+0000","last_peered":"2024-01-17T22:59:07.471100+0000","last_clean":"2024-01-17T22:59:07.471100+0000","last_became_active":"2024-01-17T22:58:48.349193+0000","last_became_peered":"2024-01-17T22:58:48.349193+0000","last_unstale":"2024-01-17T22:59:07.471100+0000","last_undegraded":"2024-01-17T22:59:07.471100+0000","last_fullsized":"2024-01-17T22:59:07.471100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:10:59.139723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477882+0000","last_change":"2024-01-17T22:58:55.911280+0000","last_active":"2024-01-17T22:59:07.477882+0000","last_peered":"2024-01-17T22:59:07.477882+0000","last_clean":"2024-01-17T22:59:07.477882+0000","last_became_active":"2024-01-17T22:58:55.910147+0000","last_became_peered":"2024-01-17T22:58:55.910147+0000","last_unstale":"2024-01-17T22:59:07.477882+0000","last_undegraded":"2024-01-17T22:59:07.477882+0000","last_fullsized":"2024-01-17T22:59:07.477882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:29:01.453903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475134+0000","last_change":"2024-01-17T22:58:49.366332+0000","last_active":"2024-01-17T22:59:07.475134+0000","last_peered":"2024-01-17T22:59:07.475134+0000","last_clean":"2024-01-17T22:59:07.475134+0000","last_became_active":"2024-01-17T22:58:49.366055+0000","last_became_peered":"2024-01-17T22:58:49.366055+0000","last_unstale":"2024-01-17T22:59:07.475134+0000","last_undegraded":"2024-01-17T22:59:07.475134+0000","last_fullsized":"2024-01-17T22:59:07.475134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:44:30.888903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.577705+0000","last_change":"2024-01-17T22:58:48.378008+0000","last_active":"2024-01-17T22:59:25.577705+0000","last_peered":"2024-01-17T22:59:25.577705+0000","last_clean":"2024-01-17T22:59:25.577705+0000","last_became_active":"2024-01-17T22:58:48.377732+0000","last_became_peered":"2024-01-17T22:58:48.377732+0000","last_unstale":"2024-01-17T22:59:25.577705+0000","last_undegraded":"2024-01-17T22:59:25.577705+0000","last_fullsized":"2024-01-17T22:59:25.577705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:05.032134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:09.245915+0000","last_change":"2024-01-17T22:59:09.245915+0000","last_active":"2024-01-17T22:59:09.245915+0000","last_peered":"2024-01-17T22:59:09.245915+0000","last_clean":"2024-01-17T22:59:09.245915+0000","last_became_active":"2024-01-17T22:59:09.244621+0000","last_became_peered":"2024-01-17T22:59:09.244621+0000","last_unstale":"2024-01-17T22:59:09.245915+0000","last_undegraded":"2024-01-17T22:59:09.245915+0000","last_fullsized":"2024-01-17T22:59:09.245915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:01:38.677481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,5],"acting":[6,4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467973+0000","last_change":"2024-01-17T22:58:49.368620+0000","last_active":"2024-01-17T22:59:07.467973+0000","last_peered":"2024-01-17T22:59:07.467973+0000","last_clean":"2024-01-17T22:59:07.467973+0000","last_became_active":"2024-01-17T22:58:49.367258+0000","last_became_peered":"2024-01-17T22:58:49.367258+0000","last_unstale":"2024-01-17T22:59:07.467973+0000","last_undegraded":"2024-01-17T22:59:07.467973+0000","last_fullsized":"2024-01-17T22:59:07.467973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:25.515983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.655860+0000","last_change":"2024-01-17T22:58:48.371378+0000","last_active":"2024-01-17T22:59:25.655860+0000","last_peered":"2024-01-17T22:59:25.655860+0000","last_clean":"2024-01-17T22:59:25.655860+0000","last_became_active":"2024-01-17T22:58:48.370691+0000","last_became_peered":"2024-01-17T22:58:48.370691+0000","last_unstale":"2024-01-17T22:59:25.655860+0000","last_undegraded":"2024-01-17T22:59:25.655860+0000","last_fullsized":"2024-01-17T22:59:25.655860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:01:21.629083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475936+0000","last_change":"2024-01-17T22:58:55.846853+0000","last_active":"2024-01-17T22:59:07.475936+0000","last_peered":"2024-01-17T22:59:07.475936+0000","last_clean":"2024-01-17T22:59:07.475936+0000","last_became_active":"2024-01-17T22:58:55.846382+0000","last_became_peered":"2024-01-17T22:58:55.846382+0000","last_unstale":"2024-01-17T22:59:07.475936+0000","last_undegraded":"2024-01-17T22:59:07.475936+0000","last_fullsized":"2024-01-17T22:59:07.475936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:00:22.788812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472128+0000","last_change":"2024-01-17T22:58:49.367642+0000","last_active":"2024-01-17T22:59:07.472128+0000","last_peered":"2024-01-17T22:59:07.472128+0000","last_clean":"2024-01-17T22:59:07.472128+0000","last_became_active":"2024-01-17T22:58:49.367370+0000","last_became_peered":"2024-01-17T22:58:49.367370+0000","last_unstale":"2024-01-17T22:59:07.472128+0000","last_undegraded":"2024-01-17T22:59:07.472128+0000","last_fullsized":"2024-01-17T22:59:07.472128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:24:43.594840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'12","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.581180+0000","last_change":"2024-01-17T22:58:48.346833+0000","last_active":"2024-01-17T22:59:25.581180+0000","last_peered":"2024-01-17T22:59:25.581180+0000","last_clean":"2024-01-17T22:59:25.581180+0000","last_became_active":"2024-01-17T22:58:48.346574+0000","last_became_peered":"2024-01-17T22:58:48.346574+0000","last_unstale":"2024-01-17T22:59:25.581180+0000","last_undegraded":"2024-01-17T22:59:25.581180+0000","last_fullsized":"2024-01-17T22:59:25.581180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:55:23.055396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468467+0000","last_change":"2024-01-17T22:58:55.832183+0000","last_active":"2024-01-17T22:59:07.468467+0000","last_peered":"2024-01-17T22:59:07.468467+0000","last_clean":"2024-01-17T22:59:07.468467+0000","last_became_active":"2024-01-17T22:58:55.831090+0000","last_became_peered":"2024-01-17T22:58:55.831090+0000","last_unstale":"2024-01-17T22:59:07.468467+0000","last_undegraded":"2024-01-17T22:59:07.468467+0000","last_fullsized":"2024-01-17T22:59:07.468467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:15.077032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475364+0000","last_change":"2024-01-17T22:58:49.366048+0000","last_active":"2024-01-17T22:59:07.475364+0000","last_peered":"2024-01-17T22:59:07.475364+0000","last_clean":"2024-01-17T22:59:07.475364+0000","last_became_active":"2024-01-17T22:58:49.365846+0000","last_became_peered":"2024-01-17T22:58:49.365846+0000","last_unstale":"2024-01-17T22:59:07.475364+0000","last_undegraded":"2024-01-17T22:59:07.475364+0000","last_fullsized":"2024-01-17T22:59:07.475364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:19:02.000223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.639338+0000","last_change":"2024-01-17T22:58:48.376099+0000","last_active":"2024-01-17T22:59:08.639338+0000","last_peered":"2024-01-17T22:59:08.639338+0000","last_clean":"2024-01-17T22:59:08.639338+0000","last_became_active":"2024-01-17T22:58:48.375504+0000","last_became_peered":"2024-01-17T22:58:48.375504+0000","last_unstale":"2024-01-17T22:59:08.639338+0000","last_undegraded":"2024-01-17T22:59:08.639338+0000","last_fullsized":"2024-01-17T22:59:08.639338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476012+0000","last_change":"2024-01-17T22:58:55.906751+0000","last_active":"2024-01-17T22:59:07.476012+0000","last_peered":"2024-01-17T22:59:07.476012+0000","last_clean":"2024-01-17T22:59:07.476012+0000","last_became_active":"2024-01-17T22:58:55.906429+0000","last_became_peered":"2024-01-17T22:58:55.906429+0000","last_unstale":"2024-01-17T22:59:07.476012+0000","last_undegraded":"2024-01-17T22:59:07.476012+0000","last_fullsized":"2024-01-17T22:59:07.476012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:37:20.317014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477998+0000","last_change":"2024-01-17T22:58:49.361059+0000","last_active":"2024-01-17T22:59:07.477998+0000","last_peered":"2024-01-17T22:59:07.477998+0000","last_clean":"2024-01-17T22:59:07.477998+0000","last_became_active":"2024-01-17T22:58:49.360282+0000","last_became_peered":"2024-01-17T22:58:49.360282+0000","last_unstale":"2024-01-17T22:59:07.477998+0000","last_undegraded":"2024-01-17T22:59:07.477998+0000","last_fullsized":"2024-01-17T22:59:07.477998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:10:15.673364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472938+0000","last_change":"2024-01-17T22:58:48.349585+0000","last_active":"2024-01-17T22:59:07.472938+0000","last_peered":"2024-01-17T22:59:07.472938+0000","last_clean":"2024-01-17T22:59:07.472938+0000","last_became_active":"2024-01-17T22:58:48.349262+0000","last_became_peered":"2024-01-17T22:58:48.349262+0000","last_unstale":"2024-01-17T22:59:07.472938+0000","last_undegraded":"2024-01-17T22:59:07.472938+0000","last_fullsized":"2024-01-17T22:59:07.472938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:32:48.765965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.461673+0000","last_change":"2024-01-17T22:58:55.899604+0000","last_active":"2024-01-17T22:59:07.461673+0000","last_peered":"2024-01-17T22:59:07.461673+0000","last_clean":"2024-01-17T22:59:07.461673+0000","last_became_active":"2024-01-17T22:58:55.899176+0000","last_became_peered":"2024-01-17T22:58:55.899176+0000","last_unstale":"2024-01-17T22:59:07.461673+0000","last_undegraded":"2024-01-17T22:59:07.461673+0000","last_fullsized":"2024-01-17T22:59:07.461673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:47.829295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476942+0000","last_change":"2024-01-17T22:58:49.364258+0000","last_active":"2024-01-17T22:59:07.476942+0000","last_peered":"2024-01-17T22:59:07.476942+0000","last_clean":"2024-01-17T22:59:07.476942+0000","last_became_active":"2024-01-17T22:58:49.363979+0000","last_became_peered":"2024-01-17T22:58:49.363979+0000","last_unstale":"2024-01-17T22:59:07.476942+0000","last_undegraded":"2024-01-17T22:59:07.476942+0000","last_fullsized":"2024-01-17T22:59:07.476942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:15:17.927996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.619819+0000","last_change":"2024-01-17T22:58:48.321573+0000","last_active":"2024-01-17T22:59:25.619819+0000","last_peered":"2024-01-17T22:59:25.619819+0000","last_clean":"2024-01-17T22:59:25.619819+0000","last_became_active":"2024-01-17T22:58:48.321379+0000","last_became_peered":"2024-01-17T22:58:48.321379+0000","last_unstale":"2024-01-17T22:59:25.619819+0000","last_undegraded":"2024-01-17T22:59:25.619819+0000","last_fullsized":"2024-01-17T22:59:25.619819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:55:23.055396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467702+0000","last_change":"2024-01-17T22:58:55.873529+0000","last_active":"2024-01-17T22:59:07.467702+0000","last_peered":"2024-01-17T22:59:07.467702+0000","last_clean":"2024-01-17T22:59:07.467702+0000","last_became_active":"2024-01-17T22:58:55.872885+0000","last_became_peered":"2024-01-17T22:58:55.872885+0000","last_unstale":"2024-01-17T22:59:07.467702+0000","last_undegraded":"2024-01-17T22:59:07.467702+0000","last_fullsized":"2024-01-17T22:59:07.467702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:50:01.974857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469204+0000","last_change":"2024-01-17T22:58:55.903620+0000","last_active":"2024-01-17T22:59:07.469204+0000","last_peered":"2024-01-17T22:59:07.469204+0000","last_clean":"2024-01-17T22:59:07.469204+0000","last_became_active":"2024-01-17T22:58:55.902860+0000","last_became_peered":"2024-01-17T22:58:55.902860+0000","last_unstale":"2024-01-17T22:59:07.469204+0000","last_undegraded":"2024-01-17T22:59:07.469204+0000","last_fullsized":"2024-01-17T22:59:07.469204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:33:56.437178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467826+0000","last_change":"2024-01-17T22:58:49.515108+0000","last_active":"2024-01-17T22:59:07.467826+0000","last_peered":"2024-01-17T22:59:07.467826+0000","last_clean":"2024-01-17T22:59:07.467826+0000","last_became_active":"2024-01-17T22:58:49.514297+0000","last_became_peered":"2024-01-17T22:58:49.514297+0000","last_unstale":"2024-01-17T22:59:07.467826+0000","last_undegraded":"2024-01-17T22:59:07.467826+0000","last_fullsized":"2024-01-17T22:59:07.467826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:15.814647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.669794+0000","last_change":"2024-01-17T22:58:48.331952+0000","last_active":"2024-01-17T22:59:08.669794+0000","last_peered":"2024-01-17T22:59:08.669794+0000","last_clean":"2024-01-17T22:59:08.669794+0000","last_became_active":"2024-01-17T22:58:48.331645+0000","last_became_peered":"2024-01-17T22:58:48.331645+0000","last_unstale":"2024-01-17T22:59:08.669794+0000","last_undegraded":"2024-01-17T22:59:08.669794+0000","last_fullsized":"2024-01-17T22:59:08.669794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:24.260824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475509+0000","last_change":"2024-01-17T22:58:55.906062+0000","last_active":"2024-01-17T22:59:07.475509+0000","last_peered":"2024-01-17T22:59:07.475509+0000","last_clean":"2024-01-17T22:59:07.475509+0000","last_became_active":"2024-01-17T22:58:55.905743+0000","last_became_peered":"2024-01-17T22:58:55.905743+0000","last_unstale":"2024-01-17T22:59:07.475509+0000","last_undegraded":"2024-01-17T22:59:07.475509+0000","last_fullsized":"2024-01-17T22:59:07.475509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:19:20.308367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475626+0000","last_change":"2024-01-17T22:58:49.369540+0000","last_active":"2024-01-17T22:59:07.475626+0000","last_peered":"2024-01-17T22:59:07.475626+0000","last_clean":"2024-01-17T22:59:07.475626+0000","last_became_active":"2024-01-17T22:58:49.366692+0000","last_became_peered":"2024-01-17T22:58:49.366692+0000","last_unstale":"2024-01-17T22:59:07.475626+0000","last_undegraded":"2024-01-17T22:59:07.475626+0000","last_fullsized":"2024-01-17T22:59:07.475626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:39:54.814019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467548+0000","last_change":"2024-01-17T22:58:48.345003+0000","last_active":"2024-01-17T22:59:07.467548+0000","last_peered":"2024-01-17T22:59:07.467548+0000","last_clean":"2024-01-17T22:59:07.467548+0000","last_became_active":"2024-01-17T22:58:48.344271+0000","last_became_peered":"2024-01-17T22:58:48.344271+0000","last_unstale":"2024-01-17T22:59:07.467548+0000","last_undegraded":"2024-01-17T22:59:07.467548+0000","last_fullsized":"2024-01-17T22:59:07.467548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:51:00.037407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474911+0000","last_change":"2024-01-17T22:58:48.342292+0000","last_active":"2024-01-17T22:59:07.474911+0000","last_peered":"2024-01-17T22:59:07.474911+0000","last_clean":"2024-01-17T22:59:07.474911+0000","last_became_active":"2024-01-17T22:58:48.339364+0000","last_became_peered":"2024-01-17T22:58:48.339364+0000","last_unstale":"2024-01-17T22:59:07.474911+0000","last_undegraded":"2024-01-17T22:59:07.474911+0000","last_fullsized":"2024-01-17T22:59:07.474911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:51.848489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468893+0000","last_change":"2024-01-17T22:58:49.414836+0000","last_active":"2024-01-17T22:59:07.468893+0000","last_peered":"2024-01-17T22:59:07.468893+0000","last_clean":"2024-01-17T22:59:07.468893+0000","last_became_active":"2024-01-17T22:58:49.414163+0000","last_became_peered":"2024-01-17T22:58:49.414163+0000","last_unstale":"2024-01-17T22:59:07.468893+0000","last_undegraded":"2024-01-17T22:59:07.468893+0000","last_fullsized":"2024-01-17T22:59:07.468893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:24.988174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.473657+0000","last_change":"2024-01-17T22:58:55.880197+0000","last_active":"2024-01-17T22:59:07.473657+0000","last_peered":"2024-01-17T22:59:07.473657+0000","last_clean":"2024-01-17T22:59:07.473657+0000","last_became_active":"2024-01-17T22:58:55.879263+0000","last_became_peered":"2024-01-17T22:58:55.879263+0000","last_unstale":"2024-01-17T22:59:07.473657+0000","last_undegraded":"2024-01-17T22:59:07.473657+0000","last_fullsized":"2024-01-17T22:59:07.473657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:47:02.273099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476728+0000","last_change":"2024-01-17T22:58:48.339419+0000","last_active":"2024-01-17T22:59:07.476728+0000","last_peered":"2024-01-17T22:59:07.476728+0000","last_clean":"2024-01-17T22:59:07.476728+0000","last_became_active":"2024-01-17T22:58:48.338809+0000","last_became_peered":"2024-01-17T22:58:48.338809+0000","last_unstale":"2024-01-17T22:59:07.476728+0000","last_undegraded":"2024-01-17T22:59:07.476728+0000","last_fullsized":"2024-01-17T22:59:07.476728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:20:07.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479082+0000","last_change":"2024-01-17T22:58:49.518469+0000","last_active":"2024-01-17T22:59:07.479082+0000","last_peered":"2024-01-17T22:59:07.479082+0000","last_clean":"2024-01-17T22:59:07.479082+0000","last_became_active":"2024-01-17T22:58:49.518211+0000","last_became_peered":"2024-01-17T22:58:49.518211+0000","last_unstale":"2024-01-17T22:59:07.479082+0000","last_undegraded":"2024-01-17T22:59:07.479082+0000","last_fullsized":"2024-01-17T22:59:07.479082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:22.954968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.462345+0000","last_change":"2024-01-17T22:58:55.913601+0000","last_active":"2024-01-17T22:59:07.462345+0000","last_peered":"2024-01-17T22:59:07.462345+0000","last_clean":"2024-01-17T22:59:07.462345+0000","last_became_active":"2024-01-17T22:58:55.912825+0000","last_became_peered":"2024-01-17T22:58:55.912825+0000","last_unstale":"2024-01-17T22:59:07.462345+0000","last_undegraded":"2024-01-17T22:59:07.462345+0000","last_fullsized":"2024-01-17T22:59:07.462345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:36.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474545+0000","last_change":"2024-01-17T22:58:49.371282+0000","last_active":"2024-01-17T22:59:07.474545+0000","last_peered":"2024-01-17T22:59:07.474545+0000","last_clean":"2024-01-17T22:59:07.474545+0000","last_became_active":"2024-01-17T22:58:49.371125+0000","last_became_peered":"2024-01-17T22:58:49.371125+0000","last_unstale":"2024-01-17T22:59:07.474545+0000","last_undegraded":"2024-01-17T22:59:07.474545+0000","last_fullsized":"2024-01-17T22:59:07.474545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.461964+0000","last_change":"2024-01-17T22:58:49.510490+0000","last_active":"2024-01-17T22:59:07.461964+0000","last_peered":"2024-01-17T22:59:07.461964+0000","last_clean":"2024-01-17T22:59:07.461964+0000","last_became_active":"2024-01-17T22:58:49.509690+0000","last_became_peered":"2024-01-17T22:58:49.509690+0000","last_unstale":"2024-01-17T22:59:07.461964+0000","last_undegraded":"2024-01-17T22:59:07.461964+0000","last_fullsized":"2024-01-17T22:59:07.461964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474689+0000","last_change":"2024-01-17T22:58:49.371326+0000","last_active":"2024-01-17T22:59:07.474689+0000","last_peered":"2024-01-17T22:59:07.474689+0000","last_clean":"2024-01-17T22:59:07.474689+0000","last_became_active":"2024-01-17T22:58:49.370511+0000","last_became_peered":"2024-01-17T22:58:49.370511+0000","last_unstale":"2024-01-17T22:59:07.474689+0000","last_undegraded":"2024-01-17T22:59:07.474689+0000","last_fullsized":"2024-01-17T22:59:07.474689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:46:55.959786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476531+0000","last_change":"2024-01-17T22:58:49.385500+0000","last_active":"2024-01-17T22:59:07.476531+0000","last_peered":"2024-01-17T22:59:07.476531+0000","last_clean":"2024-01-17T22:59:07.476531+0000","last_became_active":"2024-01-17T22:58:49.384397+0000","last_became_peered":"2024-01-17T22:58:49.384397+0000","last_unstale":"2024-01-17T22:59:07.476531+0000","last_undegraded":"2024-01-17T22:59:07.476531+0000","last_fullsized":"2024-01-17T22:59:07.476531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:18.563360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.470616+0000","last_change":"2024-01-17T22:58:49.369750+0000","last_active":"2024-01-17T22:59:07.470616+0000","last_peered":"2024-01-17T22:59:07.470616+0000","last_clean":"2024-01-17T22:59:07.470616+0000","last_became_active":"2024-01-17T22:58:49.368591+0000","last_became_peered":"2024-01-17T22:58:49.368591+0000","last_unstale":"2024-01-17T22:59:07.470616+0000","last_undegraded":"2024-01-17T22:59:07.470616+0000","last_fullsized":"2024-01-17T22:59:07.470616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:59.773063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469191+0000","last_change":"2024-01-17T22:58:49.380275+0000","last_active":"2024-01-17T22:59:07.469191+0000","last_peered":"2024-01-17T22:59:07.469191+0000","last_clean":"2024-01-17T22:59:07.469191+0000","last_became_active":"2024-01-17T22:58:49.379560+0000","last_became_peered":"2024-01-17T22:58:49.379560+0000","last_unstale":"2024-01-17T22:59:07.469191+0000","last_undegraded":"2024-01-17T22:59:07.469191+0000","last_fullsized":"2024-01-17T22:59:07.469191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:41.515981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476875+0000","last_change":"2024-01-17T22:58:49.368509+0000","last_active":"2024-01-17T22:59:07.476875+0000","last_peered":"2024-01-17T22:59:07.476875+0000","last_clean":"2024-01-17T22:59:07.476875+0000","last_became_active":"2024-01-17T22:58:49.367330+0000","last_became_peered":"2024-01-17T22:58:49.367330+0000","last_unstale":"2024-01-17T22:59:07.476875+0000","last_undegraded":"2024-01-17T22:59:07.476875+0000","last_fullsized":"2024-01-17T22:59:07.476875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476516+0000","last_change":"2024-01-17T22:58:49.514419+0000","last_active":"2024-01-17T22:59:07.476516+0000","last_peered":"2024-01-17T22:59:07.476516+0000","last_clean":"2024-01-17T22:59:07.476516+0000","last_became_active":"2024-01-17T22:58:49.513924+0000","last_became_peered":"2024-01-17T22:58:49.513924+0000","last_unstale":"2024-01-17T22:59:07.476516+0000","last_undegraded":"2024-01-17T22:59:07.476516+0000","last_fullsized":"2024-01-17T22:59:07.476516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:24:43.594840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474620+0000","last_change":"2024-01-17T22:58:49.371064+0000","last_active":"2024-01-17T22:59:07.474620+0000","last_peered":"2024-01-17T22:59:07.474620+0000","last_clean":"2024-01-17T22:59:07.474620+0000","last_became_active":"2024-01-17T22:58:49.370808+0000","last_became_peered":"2024-01-17T22:58:49.370808+0000","last_unstale":"2024-01-17T22:59:07.474620+0000","last_undegraded":"2024-01-17T22:59:07.474620+0000","last_fullsized":"2024-01-17T22:59:07.474620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:39.502451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475665+0000","last_change":"2024-01-17T22:58:49.350539+0000","last_active":"2024-01-17T22:59:07.475665+0000","last_peered":"2024-01-17T22:59:07.475665+0000","last_clean":"2024-01-17T22:59:07.475665+0000","last_became_active":"2024-01-17T22:58:49.350057+0000","last_became_peered":"2024-01-17T22:58:49.350057+0000","last_unstale":"2024-01-17T22:59:07.475665+0000","last_undegraded":"2024-01-17T22:59:07.475665+0000","last_fullsized":"2024-01-17T22:59:07.475665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:43.516572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.478985+0000","last_change":"2024-01-17T22:58:49.517955+0000","last_active":"2024-01-17T22:59:07.478985+0000","last_peered":"2024-01-17T22:59:07.478985+0000","last_clean":"2024-01-17T22:59:07.478985+0000","last_became_active":"2024-01-17T22:58:49.517631+0000","last_became_peered":"2024-01-17T22:58:49.517631+0000","last_unstale":"2024-01-17T22:59:07.478985+0000","last_undegraded":"2024-01-17T22:59:07.478985+0000","last_fullsized":"2024-01-17T22:59:07.478985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:41:25.372897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468791+0000","last_change":"2024-01-17T22:58:49.412901+0000","last_active":"2024-01-17T22:59:07.468791+0000","last_peered":"2024-01-17T22:59:07.468791+0000","last_clean":"2024-01-17T22:59:07.468791+0000","last_became_active":"2024-01-17T22:58:49.411772+0000","last_became_peered":"2024-01-17T22:58:49.411772+0000","last_unstale":"2024-01-17T22:59:07.468791+0000","last_undegraded":"2024-01-17T22:59:07.468791+0000","last_fullsized":"2024-01-17T22:59:07.468791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:30.366002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.752125+0000","last_change":"2024-01-17T22:59:08.750879+0000","last_active":"2024-01-17T22:59:08.752125+0000","last_peered":"2024-01-17T22:59:08.752125+0000","last_clean":"2024-01-17T22:59:08.752125+0000","last_became_active":"2024-01-17T22:59:08.750082+0000","last_became_peered":"2024-01-17T22:59:08.750082+0000","last_unstale":"2024-01-17T22:59:08.752125+0000","last_undegraded":"2024-01-17T22:59:08.752125+0000","last_fullsized":"2024-01-17T22:59:08.752125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:49:12.522334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476266+0000","last_change":"2024-01-17T22:58:49.415138+0000","last_active":"2024-01-17T22:59:07.476266+0000","last_peered":"2024-01-17T22:59:07.476266+0000","last_clean":"2024-01-17T22:59:07.476266+0000","last_became_active":"2024-01-17T22:58:49.414598+0000","last_became_peered":"2024-01-17T22:58:49.414598+0000","last_unstale":"2024-01-17T22:59:07.476266+0000","last_undegraded":"2024-01-17T22:59:07.476266+0000","last_fullsized":"2024-01-17T22:59:07.476266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:40.477976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.462811+0000","last_change":"2024-01-17T22:58:49.388702+0000","last_active":"2024-01-17T22:59:07.462811+0000","last_peered":"2024-01-17T22:59:07.462811+0000","last_clean":"2024-01-17T22:59:07.462811+0000","last_became_active":"2024-01-17T22:58:49.388096+0000","last_became_peered":"2024-01-17T22:58:49.388096+0000","last_unstale":"2024-01-17T22:59:07.462811+0000","last_undegraded":"2024-01-17T22:59:07.462811+0000","last_fullsized":"2024-01-17T22:59:07.462811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475653+0000","last_change":"2024-01-17T22:58:49.370433+0000","last_active":"2024-01-17T22:59:07.475653+0000","last_peered":"2024-01-17T22:59:07.475653+0000","last_clean":"2024-01-17T22:59:07.475653+0000","last_became_active":"2024-01-17T22:58:49.369959+0000","last_became_peered":"2024-01-17T22:58:49.369959+0000","last_unstale":"2024-01-17T22:59:07.475653+0000","last_undegraded":"2024-01-17T22:59:07.475653+0000","last_fullsized":"2024-01-17T22:59:07.475653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:41:09.206436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474554+0000","last_change":"2024-01-17T22:58:49.366356+0000","last_active":"2024-01-17T22:59:07.474554+0000","last_peered":"2024-01-17T22:59:07.474554+0000","last_clean":"2024-01-17T22:59:07.474554+0000","last_became_active":"2024-01-17T22:58:49.366122+0000","last_became_peered":"2024-01-17T22:58:49.366122+0000","last_unstale":"2024-01-17T22:59:07.474554+0000","last_undegraded":"2024-01-17T22:59:07.474554+0000","last_fullsized":"2024-01-17T22:59:07.474554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:33:50.123865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475472+0000","last_change":"2024-01-17T22:58:49.349380+0000","last_active":"2024-01-17T22:59:07.475472+0000","last_peered":"2024-01-17T22:59:07.475472+0000","last_clean":"2024-01-17T22:59:07.475472+0000","last_became_active":"2024-01-17T22:58:49.348630+0000","last_became_peered":"2024-01-17T22:58:49.348630+0000","last_unstale":"2024-01-17T22:59:07.475472+0000","last_undegraded":"2024-01-17T22:59:07.475472+0000","last_fullsized":"2024-01-17T22:59:07.475472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:59:07.405202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467824+0000","last_change":"2024-01-17T22:58:49.383079+0000","last_active":"2024-01-17T22:59:07.467824+0000","last_peered":"2024-01-17T22:59:07.467824+0000","last_clean":"2024-01-17T22:59:07.467824+0000","last_became_active":"2024-01-17T22:58:49.382454+0000","last_became_peered":"2024-01-17T22:58:49.382454+0000","last_unstale":"2024-01-17T22:59:07.467824+0000","last_undegraded":"2024-01-17T22:59:07.467824+0000","last_fullsized":"2024-01-17T22:59:07.467824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:48.465209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468799+0000","last_change":"2024-01-17T22:58:49.366078+0000","last_active":"2024-01-17T22:59:07.468799+0000","last_peered":"2024-01-17T22:59:07.468799+0000","last_clean":"2024-01-17T22:59:07.468799+0000","last_became_active":"2024-01-17T22:58:49.364509+0000","last_became_peered":"2024-01-17T22:58:49.364509+0000","last_unstale":"2024-01-17T22:59:07.468799+0000","last_undegraded":"2024-01-17T22:59:07.468799+0000","last_fullsized":"2024-01-17T22:59:07.468799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:44.036981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471836+0000","last_change":"2024-01-17T22:58:49.518204+0000","last_active":"2024-01-17T22:59:07.471836+0000","last_peered":"2024-01-17T22:59:07.471836+0000","last_clean":"2024-01-17T22:59:07.471836+0000","last_became_active":"2024-01-17T22:58:49.517927+0000","last_became_peered":"2024-01-17T22:58:49.517927+0000","last_unstale":"2024-01-17T22:59:07.471836+0000","last_undegraded":"2024-01-17T22:59:07.471836+0000","last_fullsized":"2024-01-17T22:59:07.471836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:04:38.588573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472056+0000","last_change":"2024-01-17T22:58:49.364080+0000","last_active":"2024-01-17T22:59:07.472056+0000","last_peered":"2024-01-17T22:59:07.472056+0000","last_clean":"2024-01-17T22:59:07.472056+0000","last_became_active":"2024-01-17T22:58:49.363804+0000","last_became_peered":"2024-01-17T22:58:49.363804+0000","last_unstale":"2024-01-17T22:59:07.472056+0000","last_undegraded":"2024-01-17T22:59:07.472056+0000","last_fullsized":"2024-01-17T22:59:07.472056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:59:07.405202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472789+0000","last_change":"2024-01-17T22:58:49.352782+0000","last_active":"2024-01-17T22:59:07.472789+0000","last_peered":"2024-01-17T22:59:07.472789+0000","last_clean":"2024-01-17T22:59:07.472789+0000","last_became_active":"2024-01-17T22:58:49.352513+0000","last_became_peered":"2024-01-17T22:58:49.352513+0000","last_unstale":"2024-01-17T22:59:07.472789+0000","last_undegraded":"2024-01-17T22:59:07.472789+0000","last_fullsized":"2024-01-17T22:59:07.472789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:39:54.814019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479431+0000","last_change":"2024-01-17T22:58:49.519775+0000","last_active":"2024-01-17T22:59:07.479431+0000","last_peered":"2024-01-17T22:59:07.479431+0000","last_clean":"2024-01-17T22:59:07.479431+0000","last_became_active":"2024-01-17T22:58:49.518646+0000","last_became_peered":"2024-01-17T22:58:49.518646+0000","last_unstale":"2024-01-17T22:59:07.479431+0000","last_undegraded":"2024-01-17T22:59:07.479431+0000","last_fullsized":"2024-01-17T22:59:07.479431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475321+0000","last_change":"2024-01-17T22:58:49.349737+0000","last_active":"2024-01-17T22:59:07.475321+0000","last_peered":"2024-01-17T22:59:07.475321+0000","last_clean":"2024-01-17T22:59:07.475321+0000","last_became_active":"2024-01-17T22:58:49.349021+0000","last_became_peered":"2024-01-17T22:58:49.349021+0000","last_unstale":"2024-01-17T22:59:07.475321+0000","last_undegraded":"2024-01-17T22:59:07.475321+0000","last_fullsized":"2024-01-17T22:59:07.475321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:42:24.949957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471093+0000","last_change":"2024-01-17T22:58:49.415068+0000","last_active":"2024-01-17T22:59:07.471093+0000","last_peered":"2024-01-17T22:59:07.471093+0000","last_clean":"2024-01-17T22:59:07.471093+0000","last_became_active":"2024-01-17T22:58:49.414856+0000","last_became_peered":"2024-01-17T22:58:49.414856+0000","last_unstale":"2024-01-17T22:59:07.471093+0000","last_undegraded":"2024-01-17T22:59:07.471093+0000","last_fullsized":"2024-01-17T22:59:07.471093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:02:07.535209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475704+0000","last_change":"2024-01-17T22:58:49.414783+0000","last_active":"2024-01-17T22:59:07.475704+0000","last_peered":"2024-01-17T22:59:07.475704+0000","last_clean":"2024-01-17T22:59:07.475704+0000","last_became_active":"2024-01-17T22:58:49.414446+0000","last_became_peered":"2024-01-17T22:58:49.414446+0000","last_unstale":"2024-01-17T22:59:07.475704+0000","last_undegraded":"2024-01-17T22:59:07.475704+0000","last_fullsized":"2024-01-17T22:59:07.475704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471424+0000","last_change":"2024-01-17T22:58:49.357264+0000","last_active":"2024-01-17T22:59:07.471424+0000","last_peered":"2024-01-17T22:59:07.471424+0000","last_clean":"2024-01-17T22:59:07.471424+0000","last_became_active":"2024-01-17T22:58:49.357085+0000","last_became_peered":"2024-01-17T22:58:49.357085+0000","last_unstale":"2024-01-17T22:59:07.471424+0000","last_undegraded":"2024-01-17T22:59:07.471424+0000","last_fullsized":"2024-01-17T22:59:07.471424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:13:09.466879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476340+0000","last_change":"2024-01-17T22:58:49.414726+0000","last_active":"2024-01-17T22:59:07.476340+0000","last_peered":"2024-01-17T22:59:07.476340+0000","last_clean":"2024-01-17T22:59:07.476340+0000","last_became_active":"2024-01-17T22:58:49.414490+0000","last_became_peered":"2024-01-17T22:58:49.414490+0000","last_unstale":"2024-01-17T22:59:07.476340+0000","last_undegraded":"2024-01-17T22:59:07.476340+0000","last_fullsized":"2024-01-17T22:59:07.476340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:48.465209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476613+0000","last_change":"2024-01-17T22:58:49.413155+0000","last_active":"2024-01-17T22:59:07.476613+0000","last_peered":"2024-01-17T22:59:07.476613+0000","last_clean":"2024-01-17T22:59:07.476613+0000","last_became_active":"2024-01-17T22:58:49.412382+0000","last_became_peered":"2024-01-17T22:58:49.412382+0000","last_unstale":"2024-01-17T22:59:07.476613+0000","last_undegraded":"2024-01-17T22:59:07.476613+0000","last_fullsized":"2024-01-17T22:59:07.476613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:04:38.588573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477075+0000","last_change":"2024-01-17T22:58:49.368686+0000","last_active":"2024-01-17T22:59:07.477075+0000","last_peered":"2024-01-17T22:59:07.477075+0000","last_clean":"2024-01-17T22:59:07.477075+0000","last_became_active":"2024-01-17T22:58:49.367979+0000","last_became_peered":"2024-01-17T22:58:49.367979+0000","last_unstale":"2024-01-17T22:59:07.477075+0000","last_undegraded":"2024-01-17T22:59:07.477075+0000","last_fullsized":"2024-01-17T22:59:07.477075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:02:12.309297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472963+0000","last_change":"2024-01-17T22:58:49.364561+0000","last_active":"2024-01-17T22:59:07.472963+0000","last_peered":"2024-01-17T22:59:07.472963+0000","last_clean":"2024-01-17T22:59:07.472963+0000","last_became_active":"2024-01-17T22:58:49.363810+0000","last_became_peered":"2024-01-17T22:58:49.363810+0000","last_unstale":"2024-01-17T22:59:07.472963+0000","last_undegraded":"2024-01-17T22:59:07.472963+0000","last_fullsized":"2024-01-17T22:59:07.472963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:02:12.309297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5423,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":11378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66578,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":121640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.74199999999999999}]},{"osd":1,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.91400000000000003}]},{"osd":2,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.79900000000000004}]},{"osd":3,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.875}]},{"osd":4,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.131},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.98599999999999999}]},{"osd":5,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.014}]},{"osd":6,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.083},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.0409999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":121556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":1.216}]},{"osd":1,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.70999999999999996}]},{"osd":2,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.995}]},{"osd":3,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.052}]},{"osd":4,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.107},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":1.3839999999999999}]},{"osd":5,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.169},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.94799999999999995}]},{"osd":7,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.327},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.2689999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":126231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.96799999999999997}]},{"osd":1,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.873},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":1.0669999999999999}]},{"osd":2,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.90600000000000003}]},{"osd":3,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.024}]},{"osd":5,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.2470000000000001}]},{"osd":6,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.278}]},{"osd":7,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.304}]}]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":121538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.314}]},{"osd":1,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.35099999999999998}]},{"osd":2,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.51600000000000001}]},{"osd":4,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":1.0089999999999999}]},{"osd":5,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.58799999999999997}]},{"osd":6,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.76800000000000002}]},{"osd":7,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.56999999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":124775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.33400000000000002}]},{"osd":1,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.376},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.437}]},{"osd":3,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.46100000000000002}]},{"osd":4,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.036},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.85599999999999998}]},{"osd":5,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.72699999999999998}]},{"osd":6,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.93100000000000005}]},{"osd":7,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.98899999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":711462,"data_compressed":33289,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.9910000000000001,"5min":2.9910000000000001,"15min":2.9910000000000001},"last":0.38600000000000001}]},{"osd":2,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":3.383,"5min":3.383,"15min":3.383},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.86599999999999999}]},{"osd":5,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.84299999999999997}]},{"osd":6,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":0.878},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.59499999999999997}]},{"osd":7,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.56599999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":120990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2,"5min":2,"15min":2},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53400000000000003}]},{"osd":3,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.58999999999999997}]},{"osd":4,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.93899999999999995}]},{"osd":5,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.68899999999999995}]},{"osd":6,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.89000000000000001}]},{"osd":7,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.98799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":711394,"data_compressed":33289,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.63800000000000001}]},{"osd":1,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.76900000000000002}]},{"osd":2,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.94999999999999996}]},{"osd":3,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.68400000000000005}]},{"osd":4,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.01},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.038}]},{"osd":6,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.111}]},{"osd":7,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.98099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33289,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33289,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-17T22:59:29.016 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-17T22:59:29.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.188+0000 7f5a4cc00640 1 Processor -- start 2024-01-17T22:59:29.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.188+0000 7f5a4cc00640 1 -- start start 2024-01-17T22:59:29.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.192+0000 7f5a4cc00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a480c79c0 0x7f5a48061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.192+0000 7f5a4cc00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a480c9890 con 0x7f5a481539a0 2024-01-17T22:59:29.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.192+0000 7f5a4cc00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a48159bf0 con 0x7f5a48061640 2024-01-17T22:59:29.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.192+0000 7f5a4cc00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4806d570 con 0x7f5a480c79c0 2024-01-17T22:59:29.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.192+0000 7f5a45e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f5a481539a0 0x7f5a480ca410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47724/0 (socket says 172.21.15.161:47724) 2024-01-17T22:59:29.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.192+0000 7f5a45e00640 1 -- 172.21.15.161:0/606305052 learned_addr learned my addr 172.21.15.161:0/606305052 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:29.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.196+0000 7f5a44a00640 1 -- 172.21.15.161:0/606305052 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873985685 0 0) 0x7f5a480c9890 con 0x7f5a481539a0 2024-01-17T22:59:29.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.196+0000 7f5a44a00640 1 -- 172.21.15.161:0/606305052 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a28003530 con 0x7f5a481539a0 2024-01-17T22:59:29.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.196+0000 7f5a45400640 1 --2- 172.21.15.161:0/606305052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a480c79c0 0x7f5a48061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.200+0000 7f5a44a00640 1 -- 172.21.15.161:0/606305052 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 69649449 0 0) 0x7f5a28003530 con 0x7f5a481539a0 2024-01-17T22:59:29.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.200+0000 7f5a44a00640 1 -- 172.21.15.161:0/606305052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a480c79c0 msgr2=0x7f5a48061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:29.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.200+0000 7f5a44a00640 1 --2- 172.21.15.161:0/606305052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a480c79c0 0x7f5a48061100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.200+0000 7f5a44a00640 1 -- 172.21.15.161:0/606305052 >> v1:172.21.15.190:6789/0 conn(0x7f5a48061640 legacy=0x7f5a4815d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.200+0000 7f5a44a00640 1 -- 172.21.15.161:0/606305052 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a48159eb0 con 0x7f5a481539a0 2024-01-17T22:59:29.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.200+0000 7f5a44a00640 1 -- 172.21.15.161:0/606305052 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f5a38001680 con 0x7f5a481539a0 2024-01-17T22:59:29.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.200+0000 7f5a44a00640 1 -- 172.21.15.161:0/606305052 >> v1:172.21.15.161:6789/0 conn(0x7f5a481539a0 legacy=0x7f5a480ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.200+0000 7f5a44a00640 1 --2- 172.21.15.161:0/606305052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a280039b0 0x7f5a28003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.200+0000 7f5a44a00640 1 --2- 172.21.15.161:0/606305052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a280047d0 0x7f5a28004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.200+0000 7f5a44a00640 1 --2- 172.21.15.161:0/606305052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a480c79c0 0x7f5a280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.200+0000 7f5a44a00640 1 -- 172.21.15.161:0/606305052 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2800ba90 con 0x7f5a280047d0 2024-01-17T22:59:29.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.200+0000 7f5a44a00640 1 -- 172.21.15.161:0/606305052 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2800bc00 con 0x7f5a280039b0 2024-01-17T22:59:29.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.200+0000 7f5a44a00640 1 -- 172.21.15.161:0/606305052 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2800bdc0 con 0x7f5a480c79c0 2024-01-17T22:59:29.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.204+0000 7f5a45400640 1 --2- 172.21.15.161:0/606305052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a280047d0 0x7f5a28004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.208+0000 7f5a45400640 1 -- 172.21.15.161:0/606305052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a480c79c0 msgr2=0x7f5a280051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:29.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.208+0000 7f5a45400640 1 --2- 172.21.15.161:0/606305052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a480c79c0 0x7f5a280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.208+0000 7f5a45400640 1 -- 172.21.15.161:0/606305052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a280039b0 msgr2=0x7f5a28003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:29.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.208+0000 7f5a45400640 1 --2- 172.21.15.161:0/606305052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a280039b0 0x7f5a28003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.208+0000 7f5a45400640 1 -- 172.21.15.161:0/606305052 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a28003530 con 0x7f5a280047d0 2024-01-17T22:59:29.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.212+0000 7f5a45400640 1 --2- 172.21.15.161:0/606305052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a280047d0 0x7f5a28004c50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009ae0 tx=0x7f5a3001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f7aff17aa32e7b server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:29.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.220+0000 7f5a44a00640 1 -- 172.21.15.161:0/606305052 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300a5660 con 0x7f5a280047d0 2024-01-17T22:59:29.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.220+0000 7f5a44a00640 1 -- 172.21.15.161:0/606305052 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a300a57c0 con 0x7f5a280047d0 2024-01-17T22:59:29.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.220+0000 7f5a44a00640 1 -- 172.21.15.161:0/606305052 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300a5bb0 con 0x7f5a280047d0 2024-01-17T22:59:29.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.220+0000 7f5a4cc00640 1 -- 172.21.15.161:0/606305052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a280047d0 msgr2=0x7f5a28004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.220+0000 7f5a4cc00640 1 --2- 172.21.15.161:0/606305052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a280047d0 0x7f5a28004c50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009ae0 tx=0x7f5a3001ca90 comp rx=0 tx=0).stop 2024-01-17T22:59:29.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.220+0000 7f5a46800640 1 -- 172.21.15.161:0/606305052 reap_dead start 2024-01-17T22:59:29.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.220+0000 7f5a4cc00640 1 -- 172.21.15.161:0/606305052 shutdown_connections 2024-01-17T22:59:29.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.220+0000 7f5a4cc00640 1 -- 172.21.15.161:0/606305052 >> 172.21.15.161:0/606305052 conn(0x7f5a4806ad40 msgr2=0x7f5a4806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:29.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.220+0000 7f5a4cc00640 1 -- 172.21.15.161:0/606305052 shutdown_connections 2024-01-17T22:59:29.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.220+0000 7f5a4cc00640 1 -- 172.21.15.161:0/606305052 wait complete. 2024-01-17T22:59:29.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.220+0000 7f5a4cc00640 1 Processor -- start 2024-01-17T22:59:29.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.224+0000 7f5a4cc00640 1 -- start start 2024-01-17T22:59:29.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.224+0000 7f5a4cc00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a280047d0 0x7f5a4814fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.224+0000 7f5a4cc00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a48150430 0x7f5a481638e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.224+0000 7f5a4cc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a4806c550 0x7f5a48162940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.224+0000 7f5a4cc00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480b0860 con 0x7f5a4806c550 2024-01-17T22:59:29.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.224+0000 7f5a4cc00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48164400 con 0x7f5a280047d0 2024-01-17T22:59:29.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.224+0000 7f5a4cc00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a481646a0 con 0x7f5a48150430 2024-01-17T22:59:29.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.224+0000 7f5a46800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a4806c550 0x7f5a48162940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.224+0000 7f5a46800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a4806c550 0x7f5a48162940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58024/0 (socket says 172.21.15.161:58024) 2024-01-17T22:59:29.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.224+0000 7f5a46800640 1 -- 172.21.15.161:0/2882067347 learned_addr learned my addr 172.21.15.161:0/2882067347 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:29.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.224+0000 7f5a45e00640 1 --2- 172.21.15.161:0/2882067347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a280047d0 0x7f5a4814fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.228+0000 7f5a45400640 1 --2- 172.21.15.161:0/2882067347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a48150430 0x7f5a481638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.228+0000 7f5a46800640 1 -- 172.21.15.161:0/2882067347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a48150430 msgr2=0x7f5a481638e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.228+0000 7f5a46800640 1 --2- 172.21.15.161:0/2882067347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a48150430 0x7f5a481638e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.228+0000 7f5a46800640 1 -- 172.21.15.161:0/2882067347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a280047d0 msgr2=0x7f5a4814fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.228+0000 7f5a46800640 1 --2- 172.21.15.161:0/2882067347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a280047d0 0x7f5a4814fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.228+0000 7f5a46800640 1 -- 172.21.15.161:0/2882067347 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a481599c0 con 0x7f5a4806c550 2024-01-17T22:59:29.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.232+0000 7f5a46800640 1 --2- 172.21.15.161:0/2882067347 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a4806c550 0x7f5a48162940 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5a480aff30 tx=0x7f5a4000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:29.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.288+0000 7f5a3e000640 1 -- 172.21.15.161:0/2882067347 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a40005d50 con 0x7f5a4806c550 2024-01-17T22:59:29.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.288+0000 7f5a3e000640 1 -- 172.21.15.161:0/2882067347 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4000ced0 con 0x7f5a4806c550 2024-01-17T22:59:29.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.288+0000 7f5a3e000640 1 -- 172.21.15.161:0/2882067347 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4000a850 con 0x7f5a4806c550 2024-01-17T22:59:29.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.288+0000 7f5a4cc00640 1 -- 172.21.15.161:0/2882067347 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a48164980 con 0x7f5a4806c550 2024-01-17T22:59:29.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.288+0000 7f5a4cc00640 1 -- 172.21.15.161:0/2882067347 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a481633c0 con 0x7f5a4806c550 2024-01-17T22:59:29.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.288+0000 7f5a4cc00640 1 -- 172.21.15.161:0/2882067347 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a48164ea0 con 0x7f5a4806c550 2024-01-17T22:59:29.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.308+0000 7f5a3e000640 1 -- 172.21.15.161:0/2882067347 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f5a4000a9b0 con 0x7f5a4806c550 2024-01-17T22:59:29.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.308+0000 7f5a3e000640 1 --2- 172.21.15.161:0/2882067347 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5a20066890 0x7f5a20068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.312+0000 7f5a45e00640 1 --2- 172.21.15.161:0/2882067347 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5a20066890 0x7f5a20068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.312+0000 7f5a45e00640 1 --2- 172.21.15.161:0/2882067347 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5a20066890 0x7f5a20068d50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5a38000c10 tx=0x7f5a38001a60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:29.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.544+0000 7f5a3e000640 1 -- 172.21.15.161:0/2882067347 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f5a400549f0 con 0x7f5a4806c550 2024-01-17T22:59:29.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.544+0000 7f5a3e000640 1 -- 172.21.15.161:0/2882067347 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f5a40050d30 con 0x7f5a4806c550 2024-01-17T22:59:29.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.700+0000 7f5a4cc00640 1 -- 172.21.15.161:0/2882067347 --> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a4815a750 con 0x7f5a20066890 2024-01-17T22:59:29.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.712+0000 7f5a3e000640 1 -- 172.21.15.161:0/2882067347 <== mgr.4110 v2:172.21.15.161:6800/272458188 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369030 (secure 0 0 0) 0x7f5a38004e00 con 0x7f5a20066890 2024-01-17T22:59:29.716 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:29.718 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-01-17T22:59:29.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.720+0000 7f5a4cc00640 1 -- 172.21.15.161:0/2882067347 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5a20066890 msgr2=0x7f5a20068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.720+0000 7f5a4cc00640 1 --2- 172.21.15.161:0/2882067347 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5a20066890 0x7f5a20068d50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5a38000c10 tx=0x7f5a38001a60 comp rx=0 tx=0).stop 2024-01-17T22:59:29.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.720+0000 7f5a4cc00640 1 -- 172.21.15.161:0/2882067347 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a4806c550 msgr2=0x7f5a48162940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.720+0000 7f5a4cc00640 1 --2- 172.21.15.161:0/2882067347 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a4806c550 0x7f5a48162940 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5a480aff30 tx=0x7f5a4000cb90 comp rx=0 tx=0).stop 2024-01-17T22:59:29.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.720+0000 7f5a4cc00640 1 -- 172.21.15.161:0/2882067347 shutdown_connections 2024-01-17T22:59:29.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.720+0000 7f5a4cc00640 1 --2- 172.21.15.161:0/2882067347 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5a20066890 0x7f5a20068d50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.720+0000 7f5a4cc00640 1 --2- 172.21.15.161:0/2882067347 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a4806c550 0x7f5a48162940 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.720+0000 7f5a4cc00640 1 --2- 172.21.15.161:0/2882067347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a48150430 0x7f5a481638e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.720+0000 7f5a4cc00640 1 --2- 172.21.15.161:0/2882067347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a280047d0 0x7f5a4814fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.720+0000 7f5a4cc00640 1 -- 172.21.15.161:0/2882067347 >> 172.21.15.161:0/2882067347 conn(0x7f5a4806ad40 msgr2=0x7f5a48152d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:29.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.720+0000 7f5a4cc00640 1 -- 172.21.15.161:0/2882067347 shutdown_connections 2024-01-17T22:59:29.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.720+0000 7f5a4cc00640 1 -- 172.21.15.161:0/2882067347 wait complete. 2024-01-17T22:59:29.737 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-01-17T22:59:28.655487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595791,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":239,"num_write_kb":2445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":186,"ondisk_log_size":186,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218676,"kb_used_data":2532,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756044,"statfs":{"total":773094113280,"available":772870189056,"internally_reserved":0,"allocated":2592768,"data_stored":2159586,"data_compressed":66578,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":784,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003312"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.470133+0000","last_change":"2024-01-17T22:58:48.328193+0000","last_active":"2024-01-17T22:59:07.470133+0000","last_peered":"2024-01-17T22:59:07.470133+0000","last_clean":"2024-01-17T22:59:07.470133+0000","last_became_active":"2024-01-17T22:58:48.327340+0000","last_became_peered":"2024-01-17T22:58:48.327340+0000","last_unstale":"2024-01-17T22:59:07.470133+0000","last_undegraded":"2024-01-17T22:59:07.470133+0000","last_fullsized":"2024-01-17T22:59:07.470133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:56.524325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477190+0000","last_change":"2024-01-17T22:58:49.351609+0000","last_active":"2024-01-17T22:59:07.477190+0000","last_peered":"2024-01-17T22:59:07.477190+0000","last_clean":"2024-01-17T22:59:07.477190+0000","last_became_active":"2024-01-17T22:58:49.350812+0000","last_became_peered":"2024-01-17T22:58:49.350812+0000","last_unstale":"2024-01-17T22:59:07.477190+0000","last_undegraded":"2024-01-17T22:59:07.477190+0000","last_fullsized":"2024-01-17T22:59:07.477190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:02:07.535209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.461792+0000","last_change":"2024-01-17T22:58:55.903757+0000","last_active":"2024-01-17T22:59:07.461792+0000","last_peered":"2024-01-17T22:59:07.461792+0000","last_clean":"2024-01-17T22:59:07.461792+0000","last_became_active":"2024-01-17T22:58:55.903167+0000","last_became_peered":"2024-01-17T22:58:55.903167+0000","last_unstale":"2024-01-17T22:59:07.461792+0000","last_undegraded":"2024-01-17T22:59:07.461792+0000","last_fullsized":"2024-01-17T22:59:07.461792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:22.127961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477292+0000","last_change":"2024-01-17T22:58:48.373068+0000","last_active":"2024-01-17T22:59:07.477292+0000","last_peered":"2024-01-17T22:59:07.477292+0000","last_clean":"2024-01-17T22:59:07.477292+0000","last_became_active":"2024-01-17T22:58:48.372582+0000","last_became_peered":"2024-01-17T22:58:48.372582+0000","last_unstale":"2024-01-17T22:59:07.477292+0000","last_undegraded":"2024-01-17T22:59:07.477292+0000","last_fullsized":"2024-01-17T22:59:07.477292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:10:59.139723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.478032+0000","last_change":"2024-01-17T22:58:49.511918+0000","last_active":"2024-01-17T22:59:07.478032+0000","last_peered":"2024-01-17T22:59:07.478032+0000","last_clean":"2024-01-17T22:59:07.478032+0000","last_became_active":"2024-01-17T22:58:49.511303+0000","last_became_peered":"2024-01-17T22:58:49.511303+0000","last_unstale":"2024-01-17T22:59:07.478032+0000","last_undegraded":"2024-01-17T22:59:07.478032+0000","last_fullsized":"2024-01-17T22:59:07.478032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:13:09.466879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474413+0000","last_change":"2024-01-17T22:58:55.878752+0000","last_active":"2024-01-17T22:59:07.474413+0000","last_peered":"2024-01-17T22:59:07.474413+0000","last_clean":"2024-01-17T22:59:07.474413+0000","last_became_active":"2024-01-17T22:58:55.878263+0000","last_became_peered":"2024-01-17T22:58:55.878263+0000","last_unstale":"2024-01-17T22:59:07.474413+0000","last_undegraded":"2024-01-17T22:59:07.474413+0000","last_fullsized":"2024-01-17T22:59:07.474413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:19:49.420559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472270+0000","last_change":"2024-01-17T22:58:48.346724+0000","last_active":"2024-01-17T22:59:07.472270+0000","last_peered":"2024-01-17T22:59:07.472270+0000","last_clean":"2024-01-17T22:59:07.472270+0000","last_became_active":"2024-01-17T22:58:48.346411+0000","last_became_peered":"2024-01-17T22:58:48.346411+0000","last_unstale":"2024-01-17T22:59:07.472270+0000","last_undegraded":"2024-01-17T22:59:07.472270+0000","last_fullsized":"2024-01-17T22:59:07.472270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:03:04.691978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479505+0000","last_change":"2024-01-17T22:58:49.517981+0000","last_active":"2024-01-17T22:59:07.479505+0000","last_peered":"2024-01-17T22:59:07.479505+0000","last_clean":"2024-01-17T22:59:07.479505+0000","last_became_active":"2024-01-17T22:58:49.517710+0000","last_became_peered":"2024-01-17T22:58:49.517710+0000","last_unstale":"2024-01-17T22:59:07.479505+0000","last_undegraded":"2024-01-17T22:59:07.479505+0000","last_fullsized":"2024-01-17T22:59:07.479505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475930+0000","last_change":"2024-01-17T22:58:55.847347+0000","last_active":"2024-01-17T22:59:07.475930+0000","last_peered":"2024-01-17T22:59:07.475930+0000","last_clean":"2024-01-17T22:59:07.475930+0000","last_became_active":"2024-01-17T22:58:55.846773+0000","last_became_peered":"2024-01-17T22:58:55.846773+0000","last_unstale":"2024-01-17T22:59:07.475930+0000","last_undegraded":"2024-01-17T22:59:07.475930+0000","last_fullsized":"2024-01-17T22:59:07.475930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:31:43.629750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.473014+0000","last_change":"2024-01-17T22:58:48.346483+0000","last_active":"2024-01-17T22:59:07.473014+0000","last_peered":"2024-01-17T22:59:07.473014+0000","last_clean":"2024-01-17T22:59:07.473014+0000","last_became_active":"2024-01-17T22:58:48.345749+0000","last_became_peered":"2024-01-17T22:58:48.345749+0000","last_unstale":"2024-01-17T22:59:07.473014+0000","last_undegraded":"2024-01-17T22:59:07.473014+0000","last_fullsized":"2024-01-17T22:59:07.473014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:22:41.169668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476010+0000","last_change":"2024-01-17T22:58:49.371509+0000","last_active":"2024-01-17T22:59:07.476010+0000","last_peered":"2024-01-17T22:59:07.476010+0000","last_clean":"2024-01-17T22:59:07.476010+0000","last_became_active":"2024-01-17T22:58:49.370010+0000","last_became_peered":"2024-01-17T22:58:49.370010+0000","last_unstale":"2024-01-17T22:59:07.476010+0000","last_undegraded":"2024-01-17T22:59:07.476010+0000","last_fullsized":"2024-01-17T22:59:07.476010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:36:24.817716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474645+0000","last_change":"2024-01-17T22:58:55.886223+0000","last_active":"2024-01-17T22:59:07.474645+0000","last_peered":"2024-01-17T22:59:07.474645+0000","last_clean":"2024-01-17T22:59:07.474645+0000","last_became_active":"2024-01-17T22:58:55.885739+0000","last_became_peered":"2024-01-17T22:58:55.885739+0000","last_unstale":"2024-01-17T22:59:07.474645+0000","last_undegraded":"2024-01-17T22:59:07.474645+0000","last_fullsized":"2024-01-17T22:59:07.474645+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:49:18.835647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474772+0000","last_change":"2024-01-17T22:58:49.514565+0000","last_active":"2024-01-17T22:59:07.474772+0000","last_peered":"2024-01-17T22:59:07.474772+0000","last_clean":"2024-01-17T22:59:07.474772+0000","last_became_active":"2024-01-17T22:58:49.514310+0000","last_became_peered":"2024-01-17T22:58:49.514310+0000","last_unstale":"2024-01-17T22:59:07.474772+0000","last_undegraded":"2024-01-17T22:59:07.474772+0000","last_fullsized":"2024-01-17T22:59:07.474772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:01:32.364167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.577114+0000","last_change":"2024-01-17T22:58:48.341961+0000","last_active":"2024-01-17T22:59:25.577114+0000","last_peered":"2024-01-17T22:59:25.577114+0000","last_clean":"2024-01-17T22:59:25.577114+0000","last_became_active":"2024-01-17T22:58:48.341498+0000","last_became_peered":"2024-01-17T22:58:48.341498+0000","last_unstale":"2024-01-17T22:59:25.577114+0000","last_undegraded":"2024-01-17T22:59:25.577114+0000","last_fullsized":"2024-01-17T22:59:25.577114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:56.524325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475855+0000","last_change":"2024-01-17T22:58:55.915918+0000","last_active":"2024-01-17T22:59:07.475855+0000","last_peered":"2024-01-17T22:59:07.475855+0000","last_clean":"2024-01-17T22:59:07.475855+0000","last_became_active":"2024-01-17T22:58:55.915556+0000","last_became_peered":"2024-01-17T22:58:55.915556+0000","last_unstale":"2024-01-17T22:59:07.475855+0000","last_undegraded":"2024-01-17T22:59:07.475855+0000","last_fullsized":"2024-01-17T22:59:07.475855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:22:21.478703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.462199+0000","last_change":"2024-01-17T22:58:49.388237+0000","last_active":"2024-01-17T22:59:07.462199+0000","last_peered":"2024-01-17T22:59:07.462199+0000","last_clean":"2024-01-17T22:59:07.462199+0000","last_became_active":"2024-01-17T22:58:49.387500+0000","last_became_peered":"2024-01-17T22:58:49.387500+0000","last_unstale":"2024-01-17T22:59:07.462199+0000","last_undegraded":"2024-01-17T22:59:07.462199+0000","last_fullsized":"2024-01-17T22:59:07.462199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468246+0000","last_change":"2024-01-17T22:58:48.346215+0000","last_active":"2024-01-17T22:59:07.468246+0000","last_peered":"2024-01-17T22:59:07.468246+0000","last_clean":"2024-01-17T22:59:07.468246+0000","last_became_active":"2024-01-17T22:58:48.345584+0000","last_became_peered":"2024-01-17T22:58:48.345584+0000","last_unstale":"2024-01-17T22:59:07.468246+0000","last_undegraded":"2024-01-17T22:59:07.468246+0000","last_fullsized":"2024-01-17T22:59:07.468246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471736+0000","last_change":"2024-01-17T22:58:55.904518+0000","last_active":"2024-01-17T22:59:07.471736+0000","last_peered":"2024-01-17T22:59:07.471736+0000","last_clean":"2024-01-17T22:59:07.471736+0000","last_became_active":"2024-01-17T22:58:55.904182+0000","last_became_peered":"2024-01-17T22:58:55.904182+0000","last_unstale":"2024-01-17T22:59:07.471736+0000","last_undegraded":"2024-01-17T22:59:07.471736+0000","last_fullsized":"2024-01-17T22:59:07.471736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:24:43.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468071+0000","last_change":"2024-01-17T22:58:49.417907+0000","last_active":"2024-01-17T22:59:07.468071+0000","last_peered":"2024-01-17T22:59:07.468071+0000","last_clean":"2024-01-17T22:59:07.468071+0000","last_became_active":"2024-01-17T22:58:49.417440+0000","last_became_peered":"2024-01-17T22:58:49.417440+0000","last_unstale":"2024-01-17T22:59:07.468071+0000","last_undegraded":"2024-01-17T22:59:07.468071+0000","last_fullsized":"2024-01-17T22:59:07.468071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:59.773063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.575301+0000","last_change":"2024-01-17T22:58:48.332092+0000","last_active":"2024-01-17T22:59:25.575301+0000","last_peered":"2024-01-17T22:59:25.575301+0000","last_clean":"2024-01-17T22:59:25.575301+0000","last_became_active":"2024-01-17T22:58:48.331435+0000","last_became_peered":"2024-01-17T22:58:48.331435+0000","last_unstale":"2024-01-17T22:59:25.575301+0000","last_undegraded":"2024-01-17T22:59:25.575301+0000","last_fullsized":"2024-01-17T22:59:25.575301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:41:24.117738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:09.255716+0000","last_change":"2024-01-17T22:59:09.254564+0000","last_active":"2024-01-17T22:59:09.255716+0000","last_peered":"2024-01-17T22:59:09.255716+0000","last_clean":"2024-01-17T22:59:09.255716+0000","last_became_active":"2024-01-17T22:59:09.254084+0000","last_became_peered":"2024-01-17T22:59:09.254084+0000","last_unstale":"2024-01-17T22:59:09.255716+0000","last_undegraded":"2024-01-17T22:59:09.255716+0000","last_fullsized":"2024-01-17T22:59:09.255716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:04:05.785891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2,3],"acting":[0,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474946+0000","last_change":"2024-01-17T22:58:49.416963+0000","last_active":"2024-01-17T22:59:07.474946+0000","last_peered":"2024-01-17T22:59:07.474946+0000","last_clean":"2024-01-17T22:59:07.474946+0000","last_became_active":"2024-01-17T22:58:49.416757+0000","last_became_peered":"2024-01-17T22:58:49.416757+0000","last_unstale":"2024-01-17T22:59:07.474946+0000","last_undegraded":"2024-01-17T22:59:07.474946+0000","last_fullsized":"2024-01-17T22:59:07.474946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:08.763719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.470918+0000","last_change":"2024-01-17T22:58:48.341728+0000","last_active":"2024-01-17T22:59:07.470918+0000","last_peered":"2024-01-17T22:59:07.470918+0000","last_clean":"2024-01-17T22:59:07.470918+0000","last_became_active":"2024-01-17T22:58:48.341359+0000","last_became_peered":"2024-01-17T22:58:48.341359+0000","last_unstale":"2024-01-17T22:59:07.470918+0000","last_undegraded":"2024-01-17T22:59:07.470918+0000","last_fullsized":"2024-01-17T22:59:07.470918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:20:07.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476805+0000","last_change":"2024-01-17T22:58:55.913996+0000","last_active":"2024-01-17T22:59:07.476805+0000","last_peered":"2024-01-17T22:59:07.476805+0000","last_clean":"2024-01-17T22:59:07.476805+0000","last_became_active":"2024-01-17T22:58:55.913645+0000","last_became_peered":"2024-01-17T22:58:55.913645+0000","last_unstale":"2024-01-17T22:59:07.476805+0000","last_undegraded":"2024-01-17T22:59:07.476805+0000","last_fullsized":"2024-01-17T22:59:07.476805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468870+0000","last_change":"2024-01-17T22:58:49.417874+0000","last_active":"2024-01-17T22:59:07.468870+0000","last_peered":"2024-01-17T22:59:07.468870+0000","last_clean":"2024-01-17T22:59:07.468870+0000","last_became_active":"2024-01-17T22:58:49.417385+0000","last_became_peered":"2024-01-17T22:58:49.417385+0000","last_unstale":"2024-01-17T22:59:07.468870+0000","last_undegraded":"2024-01-17T22:59:07.468870+0000","last_fullsized":"2024-01-17T22:59:07.468870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:41.515981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.575922+0000","last_change":"2024-01-17T22:58:48.340052+0000","last_active":"2024-01-17T22:59:25.575922+0000","last_peered":"2024-01-17T22:59:25.575922+0000","last_clean":"2024-01-17T22:59:25.575922+0000","last_became_active":"2024-01-17T22:58:48.339738+0000","last_became_peered":"2024-01-17T22:58:48.339738+0000","last_unstale":"2024-01-17T22:59:25.575922+0000","last_undegraded":"2024-01-17T22:59:25.575922+0000","last_fullsized":"2024-01-17T22:59:25.575922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:58.517904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475163+0000","last_change":"2024-01-17T22:58:55.904749+0000","last_active":"2024-01-17T22:59:07.475163+0000","last_peered":"2024-01-17T22:59:07.475163+0000","last_clean":"2024-01-17T22:59:07.475163+0000","last_became_active":"2024-01-17T22:58:55.904417+0000","last_became_peered":"2024-01-17T22:58:55.904417+0000","last_unstale":"2024-01-17T22:59:07.475163+0000","last_undegraded":"2024-01-17T22:59:07.475163+0000","last_fullsized":"2024-01-17T22:59:07.475163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:22:32.504064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469801+0000","last_change":"2024-01-17T22:58:49.411284+0000","last_active":"2024-01-17T22:59:07.469801+0000","last_peered":"2024-01-17T22:59:07.469801+0000","last_clean":"2024-01-17T22:59:07.469801+0000","last_became_active":"2024-01-17T22:58:49.410830+0000","last_became_peered":"2024-01-17T22:58:49.410830+0000","last_unstale":"2024-01-17T22:59:07.469801+0000","last_undegraded":"2024-01-17T22:59:07.469801+0000","last_fullsized":"2024-01-17T22:59:07.469801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:17:04.832847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469132+0000","last_change":"2024-01-17T22:58:48.339919+0000","last_active":"2024-01-17T22:59:07.469132+0000","last_peered":"2024-01-17T22:59:07.469132+0000","last_clean":"2024-01-17T22:59:07.469132+0000","last_became_active":"2024-01-17T22:58:48.338928+0000","last_became_peered":"2024-01-17T22:58:48.338928+0000","last_unstale":"2024-01-17T22:59:07.469132+0000","last_undegraded":"2024-01-17T22:59:07.469132+0000","last_fullsized":"2024-01-17T22:59:07.469132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:21.699809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467936+0000","last_change":"2024-01-17T22:58:55.909140+0000","last_active":"2024-01-17T22:59:07.467936+0000","last_peered":"2024-01-17T22:59:07.467936+0000","last_clean":"2024-01-17T22:59:07.467936+0000","last_became_active":"2024-01-17T22:58:55.908232+0000","last_became_peered":"2024-01-17T22:58:55.908232+0000","last_unstale":"2024-01-17T22:59:07.467936+0000","last_undegraded":"2024-01-17T22:59:07.467936+0000","last_fullsized":"2024-01-17T22:59:07.467936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.470820+0000","last_change":"2024-01-17T22:58:49.370201+0000","last_active":"2024-01-17T22:59:07.470820+0000","last_peered":"2024-01-17T22:59:07.470820+0000","last_clean":"2024-01-17T22:59:07.470820+0000","last_became_active":"2024-01-17T22:58:49.369598+0000","last_became_peered":"2024-01-17T22:58:49.369598+0000","last_unstale":"2024-01-17T22:59:07.470820+0000","last_undegraded":"2024-01-17T22:59:07.470820+0000","last_fullsized":"2024-01-17T22:59:07.470820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:15.814647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.670757+0000","last_change":"2024-01-17T22:58:48.338556+0000","last_active":"2024-01-17T22:59:08.670757+0000","last_peered":"2024-01-17T22:59:08.670757+0000","last_clean":"2024-01-17T22:59:08.670757+0000","last_became_active":"2024-01-17T22:58:48.338225+0000","last_became_peered":"2024-01-17T22:58:48.338225+0000","last_unstale":"2024-01-17T22:59:08.670757+0000","last_undegraded":"2024-01-17T22:59:08.670757+0000","last_fullsized":"2024-01-17T22:59:08.670757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:47.210049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469567+0000","last_change":"2024-01-17T22:58:55.872734+0000","last_active":"2024-01-17T22:59:07.469567+0000","last_peered":"2024-01-17T22:59:07.469567+0000","last_clean":"2024-01-17T22:59:07.469567+0000","last_became_active":"2024-01-17T22:58:55.872356+0000","last_became_peered":"2024-01-17T22:58:55.872356+0000","last_unstale":"2024-01-17T22:59:07.469567+0000","last_undegraded":"2024-01-17T22:59:07.469567+0000","last_fullsized":"2024-01-17T22:59:07.469567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:22:32.504064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476568+0000","last_change":"2024-01-17T22:58:49.369806+0000","last_active":"2024-01-17T22:59:07.476568+0000","last_peered":"2024-01-17T22:59:07.476568+0000","last_clean":"2024-01-17T22:59:07.476568+0000","last_became_active":"2024-01-17T22:58:49.369487+0000","last_became_peered":"2024-01-17T22:58:49.369487+0000","last_unstale":"2024-01-17T22:59:07.476568+0000","last_undegraded":"2024-01-17T22:59:07.476568+0000","last_fullsized":"2024-01-17T22:59:07.476568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:25.515983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477453+0000","last_change":"2024-01-17T22:58:48.341854+0000","last_active":"2024-01-17T22:59:07.477453+0000","last_peered":"2024-01-17T22:59:07.477453+0000","last_clean":"2024-01-17T22:59:07.477453+0000","last_became_active":"2024-01-17T22:58:48.339996+0000","last_became_peered":"2024-01-17T22:58:48.339996+0000","last_unstale":"2024-01-17T22:59:07.477453+0000","last_undegraded":"2024-01-17T22:59:07.477453+0000","last_fullsized":"2024-01-17T22:59:07.477453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:55:52.894278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467661+0000","last_change":"2024-01-17T22:58:55.877637+0000","last_active":"2024-01-17T22:59:07.467661+0000","last_peered":"2024-01-17T22:59:07.467661+0000","last_clean":"2024-01-17T22:59:07.467661+0000","last_became_active":"2024-01-17T22:58:55.877118+0000","last_became_peered":"2024-01-17T22:58:55.877118+0000","last_unstale":"2024-01-17T22:59:07.467661+0000","last_undegraded":"2024-01-17T22:59:07.467661+0000","last_fullsized":"2024-01-17T22:59:07.467661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:08.327495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471403+0000","last_change":"2024-01-17T22:58:49.352845+0000","last_active":"2024-01-17T22:59:07.471403+0000","last_peered":"2024-01-17T22:59:07.471403+0000","last_clean":"2024-01-17T22:59:07.471403+0000","last_became_active":"2024-01-17T22:58:49.352563+0000","last_became_peered":"2024-01-17T22:58:49.352563+0000","last_unstale":"2024-01-17T22:59:07.471403+0000","last_undegraded":"2024-01-17T22:59:07.471403+0000","last_fullsized":"2024-01-17T22:59:07.471403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:43.516572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475062+0000","last_change":"2024-01-17T22:58:48.343658+0000","last_active":"2024-01-17T22:59:07.475062+0000","last_peered":"2024-01-17T22:59:07.475062+0000","last_clean":"2024-01-17T22:59:07.475062+0000","last_became_active":"2024-01-17T22:58:48.343060+0000","last_became_peered":"2024-01-17T22:58:48.343060+0000","last_unstale":"2024-01-17T22:59:07.475062+0000","last_undegraded":"2024-01-17T22:59:07.475062+0000","last_fullsized":"2024-01-17T22:59:07.475062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:42.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.470375+0000","last_change":"2024-01-17T22:58:55.881076+0000","last_active":"2024-01-17T22:59:07.470375+0000","last_peered":"2024-01-17T22:59:07.470375+0000","last_clean":"2024-01-17T22:59:07.470375+0000","last_became_active":"2024-01-17T22:58:55.880665+0000","last_became_peered":"2024-01-17T22:58:55.880665+0000","last_unstale":"2024-01-17T22:59:07.470375+0000","last_undegraded":"2024-01-17T22:59:07.470375+0000","last_fullsized":"2024-01-17T22:59:07.470375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:37:20.317014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475438+0000","last_change":"2024-01-17T22:58:49.385682+0000","last_active":"2024-01-17T22:59:07.475438+0000","last_peered":"2024-01-17T22:59:07.475438+0000","last_clean":"2024-01-17T22:59:07.475438+0000","last_became_active":"2024-01-17T22:58:49.384655+0000","last_became_peered":"2024-01-17T22:58:49.384655+0000","last_unstale":"2024-01-17T22:59:07.475438+0000","last_undegraded":"2024-01-17T22:59:07.475438+0000","last_fullsized":"2024-01-17T22:59:07.475438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:22:51.592384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.638398+0000","last_change":"2024-01-17T22:58:48.375527+0000","last_active":"2024-01-17T22:59:08.638398+0000","last_peered":"2024-01-17T22:59:08.638398+0000","last_clean":"2024-01-17T22:59:08.638398+0000","last_became_active":"2024-01-17T22:58:48.375210+0000","last_became_peered":"2024-01-17T22:58:48.375210+0000","last_unstale":"2024-01-17T22:59:08.638398+0000","last_undegraded":"2024-01-17T22:59:08.638398+0000","last_fullsized":"2024-01-17T22:59:08.638398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:51:00.037407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468786+0000","last_change":"2024-01-17T22:58:55.903437+0000","last_active":"2024-01-17T22:59:07.468786+0000","last_peered":"2024-01-17T22:59:07.468786+0000","last_clean":"2024-01-17T22:59:07.468786+0000","last_became_active":"2024-01-17T22:58:55.902881+0000","last_became_peered":"2024-01-17T22:58:55.902881+0000","last_unstale":"2024-01-17T22:59:07.468786+0000","last_undegraded":"2024-01-17T22:59:07.468786+0000","last_fullsized":"2024-01-17T22:59:07.468786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467415+0000","last_change":"2024-01-17T22:58:49.367932+0000","last_active":"2024-01-17T22:59:07.467415+0000","last_peered":"2024-01-17T22:59:07.467415+0000","last_clean":"2024-01-17T22:59:07.467415+0000","last_became_active":"2024-01-17T22:58:49.367236+0000","last_became_peered":"2024-01-17T22:58:49.367236+0000","last_unstale":"2024-01-17T22:59:07.467415+0000","last_undegraded":"2024-01-17T22:59:07.467415+0000","last_fullsized":"2024-01-17T22:59:07.467415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:06.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.669794+0000","last_change":"2024-01-17T22:58:48.338730+0000","last_active":"2024-01-17T22:59:08.669794+0000","last_peered":"2024-01-17T22:59:08.669794+0000","last_clean":"2024-01-17T22:59:08.669794+0000","last_became_active":"2024-01-17T22:58:48.337500+0000","last_became_peered":"2024-01-17T22:58:48.337500+0000","last_unstale":"2024-01-17T22:59:08.669794+0000","last_undegraded":"2024-01-17T22:59:08.669794+0000","last_fullsized":"2024-01-17T22:59:08.669794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:54.141445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477014+0000","last_change":"2024-01-17T22:58:55.900298+0000","last_active":"2024-01-17T22:59:07.477014+0000","last_peered":"2024-01-17T22:59:07.477014+0000","last_clean":"2024-01-17T22:59:07.477014+0000","last_became_active":"2024-01-17T22:58:55.899657+0000","last_became_peered":"2024-01-17T22:58:55.899657+0000","last_unstale":"2024-01-17T22:59:07.477014+0000","last_undegraded":"2024-01-17T22:59:07.477014+0000","last_fullsized":"2024-01-17T22:59:07.477014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:30:03.955178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468595+0000","last_change":"2024-01-17T22:58:49.412701+0000","last_active":"2024-01-17T22:59:07.468595+0000","last_peered":"2024-01-17T22:59:07.468595+0000","last_clean":"2024-01-17T22:59:07.468595+0000","last_became_active":"2024-01-17T22:58:49.411848+0000","last_became_peered":"2024-01-17T22:58:49.411848+0000","last_unstale":"2024-01-17T22:59:07.468595+0000","last_undegraded":"2024-01-17T22:59:07.468595+0000","last_fullsized":"2024-01-17T22:59:07.468595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:55:47.020055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.577178+0000","last_change":"2024-01-17T22:58:48.341769+0000","last_active":"2024-01-17T22:59:25.577178+0000","last_peered":"2024-01-17T22:59:25.577178+0000","last_clean":"2024-01-17T22:59:25.577178+0000","last_became_active":"2024-01-17T22:58:48.340963+0000","last_became_peered":"2024-01-17T22:58:48.340963+0000","last_unstale":"2024-01-17T22:59:25.577178+0000","last_undegraded":"2024-01-17T22:59:25.577178+0000","last_fullsized":"2024-01-17T22:59:25.577178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:15:16.672836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479207+0000","last_change":"2024-01-17T22:58:17.322374+0000","last_active":"2024-01-17T22:59:07.479207+0000","last_peered":"2024-01-17T22:59:07.479207+0000","last_clean":"2024-01-17T22:59:07.479207+0000","last_became_active":"2024-01-17T22:58:17.321097+0000","last_became_peered":"2024-01-17T22:58:17.321097+0000","last_unstale":"2024-01-17T22:59:07.479207+0000","last_undegraded":"2024-01-17T22:59:07.479207+0000","last_fullsized":"2024-01-17T22:59:07.479207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:15.452106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:15.452106+0000","last_clean_scrub_stamp":"2024-01-17T22:58:15.452106+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:55:58.924319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476194+0000","last_change":"2024-01-17T22:58:55.909509+0000","last_active":"2024-01-17T22:59:07.476194+0000","last_peered":"2024-01-17T22:59:07.476194+0000","last_clean":"2024-01-17T22:59:07.476194+0000","last_became_active":"2024-01-17T22:58:55.909055+0000","last_became_peered":"2024-01-17T22:58:55.909055+0000","last_unstale":"2024-01-17T22:59:07.476194+0000","last_undegraded":"2024-01-17T22:59:07.476194+0000","last_fullsized":"2024-01-17T22:59:07.476194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:11:12.388395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476079+0000","last_change":"2024-01-17T22:58:49.516198+0000","last_active":"2024-01-17T22:59:07.476079+0000","last_peered":"2024-01-17T22:59:07.476079+0000","last_clean":"2024-01-17T22:59:07.476079+0000","last_became_active":"2024-01-17T22:58:49.515941+0000","last_became_peered":"2024-01-17T22:58:49.515941+0000","last_unstale":"2024-01-17T22:59:07.476079+0000","last_undegraded":"2024-01-17T22:59:07.476079+0000","last_fullsized":"2024-01-17T22:59:07.476079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:54:07.128744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.470970+0000","last_change":"2024-01-17T22:58:48.344998+0000","last_active":"2024-01-17T22:59:07.470970+0000","last_peered":"2024-01-17T22:59:07.470970+0000","last_clean":"2024-01-17T22:59:07.470970+0000","last_became_active":"2024-01-17T22:58:48.344402+0000","last_became_peered":"2024-01-17T22:58:48.344402+0000","last_unstale":"2024-01-17T22:59:07.470970+0000","last_undegraded":"2024-01-17T22:59:07.470970+0000","last_fullsized":"2024-01-17T22:59:07.470970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:01:21.629083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475784+0000","last_change":"2024-01-17T22:58:55.886258+0000","last_active":"2024-01-17T22:59:07.475784+0000","last_peered":"2024-01-17T22:59:07.475784+0000","last_clean":"2024-01-17T22:59:07.475784+0000","last_became_active":"2024-01-17T22:58:55.885809+0000","last_became_peered":"2024-01-17T22:58:55.885809+0000","last_unstale":"2024-01-17T22:59:07.475784+0000","last_undegraded":"2024-01-17T22:59:07.475784+0000","last_fullsized":"2024-01-17T22:59:07.475784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:08.327495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.656010+0000","last_change":"2024-01-17T22:59:08.654953+0000","last_active":"2024-01-17T22:59:08.656010+0000","last_peered":"2024-01-17T22:59:08.656010+0000","last_clean":"2024-01-17T22:59:08.656010+0000","last_became_active":"2024-01-17T22:59:08.654136+0000","last_became_peered":"2024-01-17T22:59:08.654136+0000","last_unstale":"2024-01-17T22:59:08.656010+0000","last_undegraded":"2024-01-17T22:59:08.656010+0000","last_fullsized":"2024-01-17T22:59:08.656010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:19:02.000223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476805+0000","last_change":"2024-01-17T22:58:48.338206+0000","last_active":"2024-01-17T22:59:07.476805+0000","last_peered":"2024-01-17T22:59:07.476805+0000","last_clean":"2024-01-17T22:59:07.476805+0000","last_became_active":"2024-01-17T22:58:48.337489+0000","last_became_peered":"2024-01-17T22:58:48.337489+0000","last_unstale":"2024-01-17T22:59:07.476805+0000","last_undegraded":"2024-01-17T22:59:07.476805+0000","last_fullsized":"2024-01-17T22:59:07.476805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:09:04.579374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476461+0000","last_change":"2024-01-17T22:58:55.903435+0000","last_active":"2024-01-17T22:59:07.476461+0000","last_peered":"2024-01-17T22:59:07.476461+0000","last_clean":"2024-01-17T22:59:07.476461+0000","last_became_active":"2024-01-17T22:58:55.902857+0000","last_became_peered":"2024-01-17T22:58:55.902857+0000","last_unstale":"2024-01-17T22:59:07.476461+0000","last_undegraded":"2024-01-17T22:59:07.476461+0000","last_fullsized":"2024-01-17T22:59:07.476461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:24:43.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.473428+0000","last_change":"2024-01-17T22:58:49.519307+0000","last_active":"2024-01-17T22:59:07.473428+0000","last_peered":"2024-01-17T22:59:07.473428+0000","last_clean":"2024-01-17T22:59:07.473428+0000","last_became_active":"2024-01-17T22:58:49.519060+0000","last_became_peered":"2024-01-17T22:58:49.519060+0000","last_unstale":"2024-01-17T22:59:07.473428+0000","last_undegraded":"2024-01-17T22:59:07.473428+0000","last_fullsized":"2024-01-17T22:59:07.473428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:48.025499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469006+0000","last_change":"2024-01-17T22:58:48.341584+0000","last_active":"2024-01-17T22:59:07.469006+0000","last_peered":"2024-01-17T22:59:07.469006+0000","last_clean":"2024-01-17T22:59:07.469006+0000","last_became_active":"2024-01-17T22:58:48.339433+0000","last_became_peered":"2024-01-17T22:58:48.339433+0000","last_unstale":"2024-01-17T22:59:07.469006+0000","last_undegraded":"2024-01-17T22:59:07.469006+0000","last_fullsized":"2024-01-17T22:59:07.469006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:01:09.060396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474422+0000","last_change":"2024-01-17T22:58:55.905118+0000","last_active":"2024-01-17T22:59:07.474422+0000","last_peered":"2024-01-17T22:59:07.474422+0000","last_clean":"2024-01-17T22:59:07.474422+0000","last_became_active":"2024-01-17T22:58:55.904690+0000","last_became_peered":"2024-01-17T22:58:55.904690+0000","last_unstale":"2024-01-17T22:59:07.474422+0000","last_undegraded":"2024-01-17T22:59:07.474422+0000","last_fullsized":"2024-01-17T22:59:07.474422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:45:30.212764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477010+0000","last_change":"2024-01-17T22:58:49.352993+0000","last_active":"2024-01-17T22:59:07.477010+0000","last_peered":"2024-01-17T22:59:07.477010+0000","last_clean":"2024-01-17T22:59:07.477010+0000","last_became_active":"2024-01-17T22:58:49.352744+0000","last_became_peered":"2024-01-17T22:58:49.352744+0000","last_unstale":"2024-01-17T22:59:07.477010+0000","last_undegraded":"2024-01-17T22:59:07.477010+0000","last_fullsized":"2024-01-17T22:59:07.477010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:06.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.473284+0000","last_change":"2024-01-17T22:58:48.343793+0000","last_active":"2024-01-17T22:59:07.473284+0000","last_peered":"2024-01-17T22:59:07.473284+0000","last_clean":"2024-01-17T22:59:07.473284+0000","last_became_active":"2024-01-17T22:58:48.343435+0000","last_became_peered":"2024-01-17T22:58:48.343435+0000","last_unstale":"2024-01-17T22:59:07.473284+0000","last_undegraded":"2024-01-17T22:59:07.473284+0000","last_fullsized":"2024-01-17T22:59:07.473284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:50:50.592551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479386+0000","last_change":"2024-01-17T22:58:55.913690+0000","last_active":"2024-01-17T22:59:07.479386+0000","last_peered":"2024-01-17T22:59:07.479386+0000","last_clean":"2024-01-17T22:59:07.479386+0000","last_became_active":"2024-01-17T22:58:55.913197+0000","last_became_peered":"2024-01-17T22:58:55.913197+0000","last_unstale":"2024-01-17T22:59:07.479386+0000","last_undegraded":"2024-01-17T22:59:07.479386+0000","last_fullsized":"2024-01-17T22:59:07.479386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:31.829297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474856+0000","last_change":"2024-01-17T22:58:49.368242+0000","last_active":"2024-01-17T22:59:07.474856+0000","last_peered":"2024-01-17T22:59:07.474856+0000","last_clean":"2024-01-17T22:59:07.474856+0000","last_became_active":"2024-01-17T22:58:49.368018+0000","last_became_peered":"2024-01-17T22:58:49.368018+0000","last_unstale":"2024-01-17T22:59:07.474856+0000","last_undegraded":"2024-01-17T22:59:07.474856+0000","last_fullsized":"2024-01-17T22:59:07.474856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:49:55.661543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'10","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.575506+0000","last_change":"2024-01-17T22:58:48.374293+0000","last_active":"2024-01-17T22:59:25.575506+0000","last_peered":"2024-01-17T22:59:25.575506+0000","last_clean":"2024-01-17T22:59:25.575506+0000","last_became_active":"2024-01-17T22:58:48.373287+0000","last_became_peered":"2024-01-17T22:58:48.373287+0000","last_unstale":"2024-01-17T22:59:25.575506+0000","last_undegraded":"2024-01-17T22:59:25.575506+0000","last_fullsized":"2024-01-17T22:59:25.575506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477137+0000","last_change":"2024-01-17T22:58:55.909679+0000","last_active":"2024-01-17T22:59:07.477137+0000","last_peered":"2024-01-17T22:59:07.477137+0000","last_clean":"2024-01-17T22:59:07.477137+0000","last_became_active":"2024-01-17T22:58:55.909139+0000","last_became_peered":"2024-01-17T22:58:55.909139+0000","last_unstale":"2024-01-17T22:59:07.477137+0000","last_undegraded":"2024-01-17T22:59:07.477137+0000","last_fullsized":"2024-01-17T22:59:07.477137+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:39:50.993158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479057+0000","last_change":"2024-01-17T22:58:49.515761+0000","last_active":"2024-01-17T22:59:07.479057+0000","last_peered":"2024-01-17T22:59:07.479057+0000","last_clean":"2024-01-17T22:59:07.479057+0000","last_became_active":"2024-01-17T22:58:49.514776+0000","last_became_peered":"2024-01-17T22:58:49.514776+0000","last_unstale":"2024-01-17T22:59:07.479057+0000","last_undegraded":"2024-01-17T22:59:07.479057+0000","last_fullsized":"2024-01-17T22:59:07.479057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471100+0000","last_change":"2024-01-17T22:58:48.349505+0000","last_active":"2024-01-17T22:59:07.471100+0000","last_peered":"2024-01-17T22:59:07.471100+0000","last_clean":"2024-01-17T22:59:07.471100+0000","last_became_active":"2024-01-17T22:58:48.349193+0000","last_became_peered":"2024-01-17T22:58:48.349193+0000","last_unstale":"2024-01-17T22:59:07.471100+0000","last_undegraded":"2024-01-17T22:59:07.471100+0000","last_fullsized":"2024-01-17T22:59:07.471100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:10:59.139723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477882+0000","last_change":"2024-01-17T22:58:55.911280+0000","last_active":"2024-01-17T22:59:07.477882+0000","last_peered":"2024-01-17T22:59:07.477882+0000","last_clean":"2024-01-17T22:59:07.477882+0000","last_became_active":"2024-01-17T22:58:55.910147+0000","last_became_peered":"2024-01-17T22:58:55.910147+0000","last_unstale":"2024-01-17T22:59:07.477882+0000","last_undegraded":"2024-01-17T22:59:07.477882+0000","last_fullsized":"2024-01-17T22:59:07.477882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:29:01.453903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475134+0000","last_change":"2024-01-17T22:58:49.366332+0000","last_active":"2024-01-17T22:59:07.475134+0000","last_peered":"2024-01-17T22:59:07.475134+0000","last_clean":"2024-01-17T22:59:07.475134+0000","last_became_active":"2024-01-17T22:58:49.366055+0000","last_became_peered":"2024-01-17T22:58:49.366055+0000","last_unstale":"2024-01-17T22:59:07.475134+0000","last_undegraded":"2024-01-17T22:59:07.475134+0000","last_fullsized":"2024-01-17T22:59:07.475134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:44:30.888903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.577705+0000","last_change":"2024-01-17T22:58:48.378008+0000","last_active":"2024-01-17T22:59:25.577705+0000","last_peered":"2024-01-17T22:59:25.577705+0000","last_clean":"2024-01-17T22:59:25.577705+0000","last_became_active":"2024-01-17T22:58:48.377732+0000","last_became_peered":"2024-01-17T22:58:48.377732+0000","last_unstale":"2024-01-17T22:59:25.577705+0000","last_undegraded":"2024-01-17T22:59:25.577705+0000","last_fullsized":"2024-01-17T22:59:25.577705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:05.032134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:09.245915+0000","last_change":"2024-01-17T22:59:09.245915+0000","last_active":"2024-01-17T22:59:09.245915+0000","last_peered":"2024-01-17T22:59:09.245915+0000","last_clean":"2024-01-17T22:59:09.245915+0000","last_became_active":"2024-01-17T22:59:09.244621+0000","last_became_peered":"2024-01-17T22:59:09.244621+0000","last_unstale":"2024-01-17T22:59:09.245915+0000","last_undegraded":"2024-01-17T22:59:09.245915+0000","last_fullsized":"2024-01-17T22:59:09.245915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:01:38.677481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,5],"acting":[6,4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467973+0000","last_change":"2024-01-17T22:58:49.368620+0000","last_active":"2024-01-17T22:59:07.467973+0000","last_peered":"2024-01-17T22:59:07.467973+0000","last_clean":"2024-01-17T22:59:07.467973+0000","last_became_active":"2024-01-17T22:58:49.367258+0000","last_became_peered":"2024-01-17T22:58:49.367258+0000","last_unstale":"2024-01-17T22:59:07.467973+0000","last_undegraded":"2024-01-17T22:59:07.467973+0000","last_fullsized":"2024-01-17T22:59:07.467973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:25.515983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.655860+0000","last_change":"2024-01-17T22:58:48.371378+0000","last_active":"2024-01-17T22:59:25.655860+0000","last_peered":"2024-01-17T22:59:25.655860+0000","last_clean":"2024-01-17T22:59:25.655860+0000","last_became_active":"2024-01-17T22:58:48.370691+0000","last_became_peered":"2024-01-17T22:58:48.370691+0000","last_unstale":"2024-01-17T22:59:25.655860+0000","last_undegraded":"2024-01-17T22:59:25.655860+0000","last_fullsized":"2024-01-17T22:59:25.655860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:01:21.629083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475936+0000","last_change":"2024-01-17T22:58:55.846853+0000","last_active":"2024-01-17T22:59:07.475936+0000","last_peered":"2024-01-17T22:59:07.475936+0000","last_clean":"2024-01-17T22:59:07.475936+0000","last_became_active":"2024-01-17T22:58:55.846382+0000","last_became_peered":"2024-01-17T22:58:55.846382+0000","last_unstale":"2024-01-17T22:59:07.475936+0000","last_undegraded":"2024-01-17T22:59:07.475936+0000","last_fullsized":"2024-01-17T22:59:07.475936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:00:22.788812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472128+0000","last_change":"2024-01-17T22:58:49.367642+0000","last_active":"2024-01-17T22:59:07.472128+0000","last_peered":"2024-01-17T22:59:07.472128+0000","last_clean":"2024-01-17T22:59:07.472128+0000","last_became_active":"2024-01-17T22:58:49.367370+0000","last_became_peered":"2024-01-17T22:58:49.367370+0000","last_unstale":"2024-01-17T22:59:07.472128+0000","last_undegraded":"2024-01-17T22:59:07.472128+0000","last_fullsized":"2024-01-17T22:59:07.472128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:24:43.594840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'12","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.581180+0000","last_change":"2024-01-17T22:58:48.346833+0000","last_active":"2024-01-17T22:59:25.581180+0000","last_peered":"2024-01-17T22:59:25.581180+0000","last_clean":"2024-01-17T22:59:25.581180+0000","last_became_active":"2024-01-17T22:58:48.346574+0000","last_became_peered":"2024-01-17T22:58:48.346574+0000","last_unstale":"2024-01-17T22:59:25.581180+0000","last_undegraded":"2024-01-17T22:59:25.581180+0000","last_fullsized":"2024-01-17T22:59:25.581180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:55:23.055396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468467+0000","last_change":"2024-01-17T22:58:55.832183+0000","last_active":"2024-01-17T22:59:07.468467+0000","last_peered":"2024-01-17T22:59:07.468467+0000","last_clean":"2024-01-17T22:59:07.468467+0000","last_became_active":"2024-01-17T22:58:55.831090+0000","last_became_peered":"2024-01-17T22:58:55.831090+0000","last_unstale":"2024-01-17T22:59:07.468467+0000","last_undegraded":"2024-01-17T22:59:07.468467+0000","last_fullsized":"2024-01-17T22:59:07.468467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:15.077032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475364+0000","last_change":"2024-01-17T22:58:49.366048+0000","last_active":"2024-01-17T22:59:07.475364+0000","last_peered":"2024-01-17T22:59:07.475364+0000","last_clean":"2024-01-17T22:59:07.475364+0000","last_became_active":"2024-01-17T22:58:49.365846+0000","last_became_peered":"2024-01-17T22:58:49.365846+0000","last_unstale":"2024-01-17T22:59:07.475364+0000","last_undegraded":"2024-01-17T22:59:07.475364+0000","last_fullsized":"2024-01-17T22:59:07.475364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:19:02.000223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.639338+0000","last_change":"2024-01-17T22:58:48.376099+0000","last_active":"2024-01-17T22:59:08.639338+0000","last_peered":"2024-01-17T22:59:08.639338+0000","last_clean":"2024-01-17T22:59:08.639338+0000","last_became_active":"2024-01-17T22:58:48.375504+0000","last_became_peered":"2024-01-17T22:58:48.375504+0000","last_unstale":"2024-01-17T22:59:08.639338+0000","last_undegraded":"2024-01-17T22:59:08.639338+0000","last_fullsized":"2024-01-17T22:59:08.639338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476012+0000","last_change":"2024-01-17T22:58:55.906751+0000","last_active":"2024-01-17T22:59:07.476012+0000","last_peered":"2024-01-17T22:59:07.476012+0000","last_clean":"2024-01-17T22:59:07.476012+0000","last_became_active":"2024-01-17T22:58:55.906429+0000","last_became_peered":"2024-01-17T22:58:55.906429+0000","last_unstale":"2024-01-17T22:59:07.476012+0000","last_undegraded":"2024-01-17T22:59:07.476012+0000","last_fullsized":"2024-01-17T22:59:07.476012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:37:20.317014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477998+0000","last_change":"2024-01-17T22:58:49.361059+0000","last_active":"2024-01-17T22:59:07.477998+0000","last_peered":"2024-01-17T22:59:07.477998+0000","last_clean":"2024-01-17T22:59:07.477998+0000","last_became_active":"2024-01-17T22:58:49.360282+0000","last_became_peered":"2024-01-17T22:58:49.360282+0000","last_unstale":"2024-01-17T22:59:07.477998+0000","last_undegraded":"2024-01-17T22:59:07.477998+0000","last_fullsized":"2024-01-17T22:59:07.477998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:10:15.673364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472938+0000","last_change":"2024-01-17T22:58:48.349585+0000","last_active":"2024-01-17T22:59:07.472938+0000","last_peered":"2024-01-17T22:59:07.472938+0000","last_clean":"2024-01-17T22:59:07.472938+0000","last_became_active":"2024-01-17T22:58:48.349262+0000","last_became_peered":"2024-01-17T22:58:48.349262+0000","last_unstale":"2024-01-17T22:59:07.472938+0000","last_undegraded":"2024-01-17T22:59:07.472938+0000","last_fullsized":"2024-01-17T22:59:07.472938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:32:48.765965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.461673+0000","last_change":"2024-01-17T22:58:55.899604+0000","last_active":"2024-01-17T22:59:07.461673+0000","last_peered":"2024-01-17T22:59:07.461673+0000","last_clean":"2024-01-17T22:59:07.461673+0000","last_became_active":"2024-01-17T22:58:55.899176+0000","last_became_peered":"2024-01-17T22:58:55.899176+0000","last_unstale":"2024-01-17T22:59:07.461673+0000","last_undegraded":"2024-01-17T22:59:07.461673+0000","last_fullsized":"2024-01-17T22:59:07.461673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:47.829295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476942+0000","last_change":"2024-01-17T22:58:49.364258+0000","last_active":"2024-01-17T22:59:07.476942+0000","last_peered":"2024-01-17T22:59:07.476942+0000","last_clean":"2024-01-17T22:59:07.476942+0000","last_became_active":"2024-01-17T22:58:49.363979+0000","last_became_peered":"2024-01-17T22:58:49.363979+0000","last_unstale":"2024-01-17T22:59:07.476942+0000","last_undegraded":"2024-01-17T22:59:07.476942+0000","last_fullsized":"2024-01-17T22:59:07.476942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:15:17.927996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.619819+0000","last_change":"2024-01-17T22:58:48.321573+0000","last_active":"2024-01-17T22:59:25.619819+0000","last_peered":"2024-01-17T22:59:25.619819+0000","last_clean":"2024-01-17T22:59:25.619819+0000","last_became_active":"2024-01-17T22:58:48.321379+0000","last_became_peered":"2024-01-17T22:58:48.321379+0000","last_unstale":"2024-01-17T22:59:25.619819+0000","last_undegraded":"2024-01-17T22:59:25.619819+0000","last_fullsized":"2024-01-17T22:59:25.619819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:55:23.055396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467702+0000","last_change":"2024-01-17T22:58:55.873529+0000","last_active":"2024-01-17T22:59:07.467702+0000","last_peered":"2024-01-17T22:59:07.467702+0000","last_clean":"2024-01-17T22:59:07.467702+0000","last_became_active":"2024-01-17T22:58:55.872885+0000","last_became_peered":"2024-01-17T22:58:55.872885+0000","last_unstale":"2024-01-17T22:59:07.467702+0000","last_undegraded":"2024-01-17T22:59:07.467702+0000","last_fullsized":"2024-01-17T22:59:07.467702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:50:01.974857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469204+0000","last_change":"2024-01-17T22:58:55.903620+0000","last_active":"2024-01-17T22:59:07.469204+0000","last_peered":"2024-01-17T22:59:07.469204+0000","last_clean":"2024-01-17T22:59:07.469204+0000","last_became_active":"2024-01-17T22:58:55.902860+0000","last_became_peered":"2024-01-17T22:58:55.902860+0000","last_unstale":"2024-01-17T22:59:07.469204+0000","last_undegraded":"2024-01-17T22:59:07.469204+0000","last_fullsized":"2024-01-17T22:59:07.469204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:33:56.437178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467826+0000","last_change":"2024-01-17T22:58:49.515108+0000","last_active":"2024-01-17T22:59:07.467826+0000","last_peered":"2024-01-17T22:59:07.467826+0000","last_clean":"2024-01-17T22:59:07.467826+0000","last_became_active":"2024-01-17T22:58:49.514297+0000","last_became_peered":"2024-01-17T22:58:49.514297+0000","last_unstale":"2024-01-17T22:59:07.467826+0000","last_undegraded":"2024-01-17T22:59:07.467826+0000","last_fullsized":"2024-01-17T22:59:07.467826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:15.814647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.669794+0000","last_change":"2024-01-17T22:58:48.331952+0000","last_active":"2024-01-17T22:59:08.669794+0000","last_peered":"2024-01-17T22:59:08.669794+0000","last_clean":"2024-01-17T22:59:08.669794+0000","last_became_active":"2024-01-17T22:58:48.331645+0000","last_became_peered":"2024-01-17T22:58:48.331645+0000","last_unstale":"2024-01-17T22:59:08.669794+0000","last_undegraded":"2024-01-17T22:59:08.669794+0000","last_fullsized":"2024-01-17T22:59:08.669794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:24.260824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475509+0000","last_change":"2024-01-17T22:58:55.906062+0000","last_active":"2024-01-17T22:59:07.475509+0000","last_peered":"2024-01-17T22:59:07.475509+0000","last_clean":"2024-01-17T22:59:07.475509+0000","last_became_active":"2024-01-17T22:58:55.905743+0000","last_became_peered":"2024-01-17T22:58:55.905743+0000","last_unstale":"2024-01-17T22:59:07.475509+0000","last_undegraded":"2024-01-17T22:59:07.475509+0000","last_fullsized":"2024-01-17T22:59:07.475509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:19:20.308367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475626+0000","last_change":"2024-01-17T22:58:49.369540+0000","last_active":"2024-01-17T22:59:07.475626+0000","last_peered":"2024-01-17T22:59:07.475626+0000","last_clean":"2024-01-17T22:59:07.475626+0000","last_became_active":"2024-01-17T22:58:49.366692+0000","last_became_peered":"2024-01-17T22:58:49.366692+0000","last_unstale":"2024-01-17T22:59:07.475626+0000","last_undegraded":"2024-01-17T22:59:07.475626+0000","last_fullsized":"2024-01-17T22:59:07.475626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:39:54.814019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467548+0000","last_change":"2024-01-17T22:58:48.345003+0000","last_active":"2024-01-17T22:59:07.467548+0000","last_peered":"2024-01-17T22:59:07.467548+0000","last_clean":"2024-01-17T22:59:07.467548+0000","last_became_active":"2024-01-17T22:58:48.344271+0000","last_became_peered":"2024-01-17T22:58:48.344271+0000","last_unstale":"2024-01-17T22:59:07.467548+0000","last_undegraded":"2024-01-17T22:59:07.467548+0000","last_fullsized":"2024-01-17T22:59:07.467548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:51:00.037407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474911+0000","last_change":"2024-01-17T22:58:48.342292+0000","last_active":"2024-01-17T22:59:07.474911+0000","last_peered":"2024-01-17T22:59:07.474911+0000","last_clean":"2024-01-17T22:59:07.474911+0000","last_became_active":"2024-01-17T22:58:48.339364+0000","last_became_peered":"2024-01-17T22:58:48.339364+0000","last_unstale":"2024-01-17T22:59:07.474911+0000","last_undegraded":"2024-01-17T22:59:07.474911+0000","last_fullsized":"2024-01-17T22:59:07.474911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:51.848489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468893+0000","last_change":"2024-01-17T22:58:49.414836+0000","last_active":"2024-01-17T22:59:07.468893+0000","last_peered":"2024-01-17T22:59:07.468893+0000","last_clean":"2024-01-17T22:59:07.468893+0000","last_became_active":"2024-01-17T22:58:49.414163+0000","last_became_peered":"2024-01-17T22:58:49.414163+0000","last_unstale":"2024-01-17T22:59:07.468893+0000","last_undegraded":"2024-01-17T22:59:07.468893+0000","last_fullsized":"2024-01-17T22:59:07.468893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:24.988174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.473657+0000","last_change":"2024-01-17T22:58:55.880197+0000","last_active":"2024-01-17T22:59:07.473657+0000","last_peered":"2024-01-17T22:59:07.473657+0000","last_clean":"2024-01-17T22:59:07.473657+0000","last_became_active":"2024-01-17T22:58:55.879263+0000","last_became_peered":"2024-01-17T22:58:55.879263+0000","last_unstale":"2024-01-17T22:59:07.473657+0000","last_undegraded":"2024-01-17T22:59:07.473657+0000","last_fullsized":"2024-01-17T22:59:07.473657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:47:02.273099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476728+0000","last_change":"2024-01-17T22:58:48.339419+0000","last_active":"2024-01-17T22:59:07.476728+0000","last_peered":"2024-01-17T22:59:07.476728+0000","last_clean":"2024-01-17T22:59:07.476728+0000","last_became_active":"2024-01-17T22:58:48.338809+0000","last_became_peered":"2024-01-17T22:58:48.338809+0000","last_unstale":"2024-01-17T22:59:07.476728+0000","last_undegraded":"2024-01-17T22:59:07.476728+0000","last_fullsized":"2024-01-17T22:59:07.476728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:20:07.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479082+0000","last_change":"2024-01-17T22:58:49.518469+0000","last_active":"2024-01-17T22:59:07.479082+0000","last_peered":"2024-01-17T22:59:07.479082+0000","last_clean":"2024-01-17T22:59:07.479082+0000","last_became_active":"2024-01-17T22:58:49.518211+0000","last_became_peered":"2024-01-17T22:58:49.518211+0000","last_unstale":"2024-01-17T22:59:07.479082+0000","last_undegraded":"2024-01-17T22:59:07.479082+0000","last_fullsized":"2024-01-17T22:59:07.479082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:22.954968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.462345+0000","last_change":"2024-01-17T22:58:55.913601+0000","last_active":"2024-01-17T22:59:07.462345+0000","last_peered":"2024-01-17T22:59:07.462345+0000","last_clean":"2024-01-17T22:59:07.462345+0000","last_became_active":"2024-01-17T22:58:55.912825+0000","last_became_peered":"2024-01-17T22:58:55.912825+0000","last_unstale":"2024-01-17T22:59:07.462345+0000","last_undegraded":"2024-01-17T22:59:07.462345+0000","last_fullsized":"2024-01-17T22:59:07.462345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:36.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474545+0000","last_change":"2024-01-17T22:58:49.371282+0000","last_active":"2024-01-17T22:59:07.474545+0000","last_peered":"2024-01-17T22:59:07.474545+0000","last_clean":"2024-01-17T22:59:07.474545+0000","last_became_active":"2024-01-17T22:58:49.371125+0000","last_became_peered":"2024-01-17T22:58:49.371125+0000","last_unstale":"2024-01-17T22:59:07.474545+0000","last_undegraded":"2024-01-17T22:59:07.474545+0000","last_fullsized":"2024-01-17T22:59:07.474545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.461964+0000","last_change":"2024-01-17T22:58:49.510490+0000","last_active":"2024-01-17T22:59:07.461964+0000","last_peered":"2024-01-17T22:59:07.461964+0000","last_clean":"2024-01-17T22:59:07.461964+0000","last_became_active":"2024-01-17T22:58:49.509690+0000","last_became_peered":"2024-01-17T22:58:49.509690+0000","last_unstale":"2024-01-17T22:59:07.461964+0000","last_undegraded":"2024-01-17T22:59:07.461964+0000","last_fullsized":"2024-01-17T22:59:07.461964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474689+0000","last_change":"2024-01-17T22:58:49.371326+0000","last_active":"2024-01-17T22:59:07.474689+0000","last_peered":"2024-01-17T22:59:07.474689+0000","last_clean":"2024-01-17T22:59:07.474689+0000","last_became_active":"2024-01-17T22:58:49.370511+0000","last_became_peered":"2024-01-17T22:58:49.370511+0000","last_unstale":"2024-01-17T22:59:07.474689+0000","last_undegraded":"2024-01-17T22:59:07.474689+0000","last_fullsized":"2024-01-17T22:59:07.474689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:46:55.959786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476531+0000","last_change":"2024-01-17T22:58:49.385500+0000","last_active":"2024-01-17T22:59:07.476531+0000","last_peered":"2024-01-17T22:59:07.476531+0000","last_clean":"2024-01-17T22:59:07.476531+0000","last_became_active":"2024-01-17T22:58:49.384397+0000","last_became_peered":"2024-01-17T22:58:49.384397+0000","last_unstale":"2024-01-17T22:59:07.476531+0000","last_undegraded":"2024-01-17T22:59:07.476531+0000","last_fullsized":"2024-01-17T22:59:07.476531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:18.563360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.470616+0000","last_change":"2024-01-17T22:58:49.369750+0000","last_active":"2024-01-17T22:59:07.470616+0000","last_peered":"2024-01-17T22:59:07.470616+0000","last_clean":"2024-01-17T22:59:07.470616+0000","last_became_active":"2024-01-17T22:58:49.368591+0000","last_became_peered":"2024-01-17T22:58:49.368591+0000","last_unstale":"2024-01-17T22:59:07.470616+0000","last_undegraded":"2024-01-17T22:59:07.470616+0000","last_fullsized":"2024-01-17T22:59:07.470616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:59.773063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469191+0000","last_change":"2024-01-17T22:58:49.380275+0000","last_active":"2024-01-17T22:59:07.469191+0000","last_peered":"2024-01-17T22:59:07.469191+0000","last_clean":"2024-01-17T22:59:07.469191+0000","last_became_active":"2024-01-17T22:58:49.379560+0000","last_became_peered":"2024-01-17T22:58:49.379560+0000","last_unstale":"2024-01-17T22:59:07.469191+0000","last_undegraded":"2024-01-17T22:59:07.469191+0000","last_fullsized":"2024-01-17T22:59:07.469191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:41.515981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476875+0000","last_change":"2024-01-17T22:58:49.368509+0000","last_active":"2024-01-17T22:59:07.476875+0000","last_peered":"2024-01-17T22:59:07.476875+0000","last_clean":"2024-01-17T22:59:07.476875+0000","last_became_active":"2024-01-17T22:58:49.367330+0000","last_became_peered":"2024-01-17T22:58:49.367330+0000","last_unstale":"2024-01-17T22:59:07.476875+0000","last_undegraded":"2024-01-17T22:59:07.476875+0000","last_fullsized":"2024-01-17T22:59:07.476875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476516+0000","last_change":"2024-01-17T22:58:49.514419+0000","last_active":"2024-01-17T22:59:07.476516+0000","last_peered":"2024-01-17T22:59:07.476516+0000","last_clean":"2024-01-17T22:59:07.476516+0000","last_became_active":"2024-01-17T22:58:49.513924+0000","last_became_peered":"2024-01-17T22:58:49.513924+0000","last_unstale":"2024-01-17T22:59:07.476516+0000","last_undegraded":"2024-01-17T22:59:07.476516+0000","last_fullsized":"2024-01-17T22:59:07.476516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:24:43.594840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474620+0000","last_change":"2024-01-17T22:58:49.371064+0000","last_active":"2024-01-17T22:59:07.474620+0000","last_peered":"2024-01-17T22:59:07.474620+0000","last_clean":"2024-01-17T22:59:07.474620+0000","last_became_active":"2024-01-17T22:58:49.370808+0000","last_became_peered":"2024-01-17T22:58:49.370808+0000","last_unstale":"2024-01-17T22:59:07.474620+0000","last_undegraded":"2024-01-17T22:59:07.474620+0000","last_fullsized":"2024-01-17T22:59:07.474620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:39.502451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475665+0000","last_change":"2024-01-17T22:58:49.350539+0000","last_active":"2024-01-17T22:59:07.475665+0000","last_peered":"2024-01-17T22:59:07.475665+0000","last_clean":"2024-01-17T22:59:07.475665+0000","last_became_active":"2024-01-17T22:58:49.350057+0000","last_became_peered":"2024-01-17T22:58:49.350057+0000","last_unstale":"2024-01-17T22:59:07.475665+0000","last_undegraded":"2024-01-17T22:59:07.475665+0000","last_fullsized":"2024-01-17T22:59:07.475665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:43.516572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.478985+0000","last_change":"2024-01-17T22:58:49.517955+0000","last_active":"2024-01-17T22:59:07.478985+0000","last_peered":"2024-01-17T22:59:07.478985+0000","last_clean":"2024-01-17T22:59:07.478985+0000","last_became_active":"2024-01-17T22:58:49.517631+0000","last_became_peered":"2024-01-17T22:58:49.517631+0000","last_unstale":"2024-01-17T22:59:07.478985+0000","last_undegraded":"2024-01-17T22:59:07.478985+0000","last_fullsized":"2024-01-17T22:59:07.478985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:41:25.372897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468791+0000","last_change":"2024-01-17T22:58:49.412901+0000","last_active":"2024-01-17T22:59:07.468791+0000","last_peered":"2024-01-17T22:59:07.468791+0000","last_clean":"2024-01-17T22:59:07.468791+0000","last_became_active":"2024-01-17T22:58:49.411772+0000","last_became_peered":"2024-01-17T22:58:49.411772+0000","last_unstale":"2024-01-17T22:59:07.468791+0000","last_undegraded":"2024-01-17T22:59:07.468791+0000","last_fullsized":"2024-01-17T22:59:07.468791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:30.366002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.752125+0000","last_change":"2024-01-17T22:59:08.750879+0000","last_active":"2024-01-17T22:59:08.752125+0000","last_peered":"2024-01-17T22:59:08.752125+0000","last_clean":"2024-01-17T22:59:08.752125+0000","last_became_active":"2024-01-17T22:59:08.750082+0000","last_became_peered":"2024-01-17T22:59:08.750082+0000","last_unstale":"2024-01-17T22:59:08.752125+0000","last_undegraded":"2024-01-17T22:59:08.752125+0000","last_fullsized":"2024-01-17T22:59:08.752125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:49:12.522334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476266+0000","last_change":"2024-01-17T22:58:49.415138+0000","last_active":"2024-01-17T22:59:07.476266+0000","last_peered":"2024-01-17T22:59:07.476266+0000","last_clean":"2024-01-17T22:59:07.476266+0000","last_became_active":"2024-01-17T22:58:49.414598+0000","last_became_peered":"2024-01-17T22:58:49.414598+0000","last_unstale":"2024-01-17T22:59:07.476266+0000","last_undegraded":"2024-01-17T22:59:07.476266+0000","last_fullsized":"2024-01-17T22:59:07.476266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:40.477976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.462811+0000","last_change":"2024-01-17T22:58:49.388702+0000","last_active":"2024-01-17T22:59:07.462811+0000","last_peered":"2024-01-17T22:59:07.462811+0000","last_clean":"2024-01-17T22:59:07.462811+0000","last_became_active":"2024-01-17T22:58:49.388096+0000","last_became_peered":"2024-01-17T22:58:49.388096+0000","last_unstale":"2024-01-17T22:59:07.462811+0000","last_undegraded":"2024-01-17T22:59:07.462811+0000","last_fullsized":"2024-01-17T22:59:07.462811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475653+0000","last_change":"2024-01-17T22:58:49.370433+0000","last_active":"2024-01-17T22:59:07.475653+0000","last_peered":"2024-01-17T22:59:07.475653+0000","last_clean":"2024-01-17T22:59:07.475653+0000","last_became_active":"2024-01-17T22:58:49.369959+0000","last_became_peered":"2024-01-17T22:58:49.369959+0000","last_unstale":"2024-01-17T22:59:07.475653+0000","last_undegraded":"2024-01-17T22:59:07.475653+0000","last_fullsized":"2024-01-17T22:59:07.475653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:41:09.206436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474554+0000","last_change":"2024-01-17T22:58:49.366356+0000","last_active":"2024-01-17T22:59:07.474554+0000","last_peered":"2024-01-17T22:59:07.474554+0000","last_clean":"2024-01-17T22:59:07.474554+0000","last_became_active":"2024-01-17T22:58:49.366122+0000","last_became_peered":"2024-01-17T22:58:49.366122+0000","last_unstale":"2024-01-17T22:59:07.474554+0000","last_undegraded":"2024-01-17T22:59:07.474554+0000","last_fullsized":"2024-01-17T22:59:07.474554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:33:50.123865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475472+0000","last_change":"2024-01-17T22:58:49.349380+0000","last_active":"2024-01-17T22:59:07.475472+0000","last_peered":"2024-01-17T22:59:07.475472+0000","last_clean":"2024-01-17T22:59:07.475472+0000","last_became_active":"2024-01-17T22:58:49.348630+0000","last_became_peered":"2024-01-17T22:58:49.348630+0000","last_unstale":"2024-01-17T22:59:07.475472+0000","last_undegraded":"2024-01-17T22:59:07.475472+0000","last_fullsized":"2024-01-17T22:59:07.475472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:59:07.405202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467824+0000","last_change":"2024-01-17T22:58:49.383079+0000","last_active":"2024-01-17T22:59:07.467824+0000","last_peered":"2024-01-17T22:59:07.467824+0000","last_clean":"2024-01-17T22:59:07.467824+0000","last_became_active":"2024-01-17T22:58:49.382454+0000","last_became_peered":"2024-01-17T22:58:49.382454+0000","last_unstale":"2024-01-17T22:59:07.467824+0000","last_undegraded":"2024-01-17T22:59:07.467824+0000","last_fullsized":"2024-01-17T22:59:07.467824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:48.465209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468799+0000","last_change":"2024-01-17T22:58:49.366078+0000","last_active":"2024-01-17T22:59:07.468799+0000","last_peered":"2024-01-17T22:59:07.468799+0000","last_clean":"2024-01-17T22:59:07.468799+0000","last_became_active":"2024-01-17T22:58:49.364509+0000","last_became_peered":"2024-01-17T22:58:49.364509+0000","last_unstale":"2024-01-17T22:59:07.468799+0000","last_undegraded":"2024-01-17T22:59:07.468799+0000","last_fullsized":"2024-01-17T22:59:07.468799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:44.036981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471836+0000","last_change":"2024-01-17T22:58:49.518204+0000","last_active":"2024-01-17T22:59:07.471836+0000","last_peered":"2024-01-17T22:59:07.471836+0000","last_clean":"2024-01-17T22:59:07.471836+0000","last_became_active":"2024-01-17T22:58:49.517927+0000","last_became_peered":"2024-01-17T22:58:49.517927+0000","last_unstale":"2024-01-17T22:59:07.471836+0000","last_undegraded":"2024-01-17T22:59:07.471836+0000","last_fullsized":"2024-01-17T22:59:07.471836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:04:38.588573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472056+0000","last_change":"2024-01-17T22:58:49.364080+0000","last_active":"2024-01-17T22:59:07.472056+0000","last_peered":"2024-01-17T22:59:07.472056+0000","last_clean":"2024-01-17T22:59:07.472056+0000","last_became_active":"2024-01-17T22:58:49.363804+0000","last_became_peered":"2024-01-17T22:58:49.363804+0000","last_unstale":"2024-01-17T22:59:07.472056+0000","last_undegraded":"2024-01-17T22:59:07.472056+0000","last_fullsized":"2024-01-17T22:59:07.472056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:59:07.405202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472789+0000","last_change":"2024-01-17T22:58:49.352782+0000","last_active":"2024-01-17T22:59:07.472789+0000","last_peered":"2024-01-17T22:59:07.472789+0000","last_clean":"2024-01-17T22:59:07.472789+0000","last_became_active":"2024-01-17T22:58:49.352513+0000","last_became_peered":"2024-01-17T22:58:49.352513+0000","last_unstale":"2024-01-17T22:59:07.472789+0000","last_undegraded":"2024-01-17T22:59:07.472789+0000","last_fullsized":"2024-01-17T22:59:07.472789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:39:54.814019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479431+0000","last_change":"2024-01-17T22:58:49.519775+0000","last_active":"2024-01-17T22:59:07.479431+0000","last_peered":"2024-01-17T22:59:07.479431+0000","last_clean":"2024-01-17T22:59:07.479431+0000","last_became_active":"2024-01-17T22:58:49.518646+0000","last_became_peered":"2024-01-17T22:58:49.518646+0000","last_unstale":"2024-01-17T22:59:07.479431+0000","last_undegraded":"2024-01-17T22:59:07.479431+0000","last_fullsized":"2024-01-17T22:59:07.479431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475321+0000","last_change":"2024-01-17T22:58:49.349737+0000","last_active":"2024-01-17T22:59:07.475321+0000","last_peered":"2024-01-17T22:59:07.475321+0000","last_clean":"2024-01-17T22:59:07.475321+0000","last_became_active":"2024-01-17T22:58:49.349021+0000","last_became_peered":"2024-01-17T22:58:49.349021+0000","last_unstale":"2024-01-17T22:59:07.475321+0000","last_undegraded":"2024-01-17T22:59:07.475321+0000","last_fullsized":"2024-01-17T22:59:07.475321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:42:24.949957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471093+0000","last_change":"2024-01-17T22:58:49.415068+0000","last_active":"2024-01-17T22:59:07.471093+0000","last_peered":"2024-01-17T22:59:07.471093+0000","last_clean":"2024-01-17T22:59:07.471093+0000","last_became_active":"2024-01-17T22:58:49.414856+0000","last_became_peered":"2024-01-17T22:58:49.414856+0000","last_unstale":"2024-01-17T22:59:07.471093+0000","last_undegraded":"2024-01-17T22:59:07.471093+0000","last_fullsized":"2024-01-17T22:59:07.471093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:02:07.535209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475704+0000","last_change":"2024-01-17T22:58:49.414783+0000","last_active":"2024-01-17T22:59:07.475704+0000","last_peered":"2024-01-17T22:59:07.475704+0000","last_clean":"2024-01-17T22:59:07.475704+0000","last_became_active":"2024-01-17T22:58:49.414446+0000","last_became_peered":"2024-01-17T22:58:49.414446+0000","last_unstale":"2024-01-17T22:59:07.475704+0000","last_undegraded":"2024-01-17T22:59:07.475704+0000","last_fullsized":"2024-01-17T22:59:07.475704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471424+0000","last_change":"2024-01-17T22:58:49.357264+0000","last_active":"2024-01-17T22:59:07.471424+0000","last_peered":"2024-01-17T22:59:07.471424+0000","last_clean":"2024-01-17T22:59:07.471424+0000","last_became_active":"2024-01-17T22:58:49.357085+0000","last_became_peered":"2024-01-17T22:58:49.357085+0000","last_unstale":"2024-01-17T22:59:07.471424+0000","last_undegraded":"2024-01-17T22:59:07.471424+0000","last_fullsized":"2024-01-17T22:59:07.471424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:13:09.466879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476340+0000","last_change":"2024-01-17T22:58:49.414726+0000","last_active":"2024-01-17T22:59:07.476340+0000","last_peered":"2024-01-17T22:59:07.476340+0000","last_clean":"2024-01-17T22:59:07.476340+0000","last_became_active":"2024-01-17T22:58:49.414490+0000","last_became_peered":"2024-01-17T22:58:49.414490+0000","last_unstale":"2024-01-17T22:59:07.476340+0000","last_undegraded":"2024-01-17T22:59:07.476340+0000","last_fullsized":"2024-01-17T22:59:07.476340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:48.465209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476613+0000","last_change":"2024-01-17T22:58:49.413155+0000","last_active":"2024-01-17T22:59:07.476613+0000","last_peered":"2024-01-17T22:59:07.476613+0000","last_clean":"2024-01-17T22:59:07.476613+0000","last_became_active":"2024-01-17T22:58:49.412382+0000","last_became_peered":"2024-01-17T22:58:49.412382+0000","last_unstale":"2024-01-17T22:59:07.476613+0000","last_undegraded":"2024-01-17T22:59:07.476613+0000","last_fullsized":"2024-01-17T22:59:07.476613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:04:38.588573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477075+0000","last_change":"2024-01-17T22:58:49.368686+0000","last_active":"2024-01-17T22:59:07.477075+0000","last_peered":"2024-01-17T22:59:07.477075+0000","last_clean":"2024-01-17T22:59:07.477075+0000","last_became_active":"2024-01-17T22:58:49.367979+0000","last_became_peered":"2024-01-17T22:58:49.367979+0000","last_unstale":"2024-01-17T22:59:07.477075+0000","last_undegraded":"2024-01-17T22:59:07.477075+0000","last_fullsized":"2024-01-17T22:59:07.477075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:02:12.309297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472963+0000","last_change":"2024-01-17T22:58:49.364561+0000","last_active":"2024-01-17T22:59:07.472963+0000","last_peered":"2024-01-17T22:59:07.472963+0000","last_clean":"2024-01-17T22:59:07.472963+0000","last_became_active":"2024-01-17T22:58:49.363810+0000","last_became_peered":"2024-01-17T22:58:49.363810+0000","last_unstale":"2024-01-17T22:59:07.472963+0000","last_undegraded":"2024-01-17T22:59:07.472963+0000","last_fullsized":"2024-01-17T22:59:07.472963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:02:12.309297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5423,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":11378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66578,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":121640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.74199999999999999}]},{"osd":1,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.91400000000000003}]},{"osd":2,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.79900000000000004}]},{"osd":3,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.875}]},{"osd":4,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.131},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.98599999999999999}]},{"osd":5,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.014}]},{"osd":6,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.083},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.0409999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":121556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":1.216}]},{"osd":1,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.70999999999999996}]},{"osd":2,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.995}]},{"osd":3,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.052}]},{"osd":4,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.107},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":1.3839999999999999}]},{"osd":5,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.169},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.94799999999999995}]},{"osd":7,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.327},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.2689999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":126231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.96799999999999997}]},{"osd":1,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.873},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":1.0669999999999999}]},{"osd":2,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.90600000000000003}]},{"osd":3,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.024}]},{"osd":5,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.2470000000000001}]},{"osd":6,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.278}]},{"osd":7,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.304}]}]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":121538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.314}]},{"osd":1,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.35099999999999998}]},{"osd":2,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.51600000000000001}]},{"osd":4,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":1.0089999999999999}]},{"osd":5,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.58799999999999997}]},{"osd":6,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.76800000000000002}]},{"osd":7,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.56999999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":124775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.33400000000000002}]},{"osd":1,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.376},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.437}]},{"osd":3,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.46100000000000002}]},{"osd":4,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.036},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.85599999999999998}]},{"osd":5,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.72699999999999998}]},{"osd":6,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.93100000000000005}]},{"osd":7,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.98899999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":711462,"data_compressed":33289,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.9910000000000001,"5min":2.9910000000000001,"15min":2.9910000000000001},"last":0.38600000000000001}]},{"osd":2,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":3.383,"5min":3.383,"15min":3.383},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.86599999999999999}]},{"osd":5,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.84299999999999997}]},{"osd":6,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":0.878},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.59499999999999997}]},{"osd":7,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.56599999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":120990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2,"5min":2,"15min":2},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53400000000000003}]},{"osd":3,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.58999999999999997}]},{"osd":4,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.93899999999999995}]},{"osd":5,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.68899999999999995}]},{"osd":6,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.89000000000000001}]},{"osd":7,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.98799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":711394,"data_compressed":33289,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.63800000000000001}]},{"osd":1,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.76900000000000002}]},{"osd":2,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.94999999999999996}]},{"osd":3,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.68400000000000005}]},{"osd":4,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.01},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.038}]},{"osd":6,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.111}]},{"osd":7,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.98099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33289,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33289,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-17T22:59:29.742 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-17T22:59:29.742 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-17T22:59:29.742 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-17T22:59:29.743 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-17T22:59:29.743 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-17T22:59:29.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.916+0000 7f845a200640 1 Processor -- start 2024-01-17T22:59:29.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.916+0000 7f845a200640 1 -- start start 2024-01-17T22:59:29.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.916+0000 7f845a200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f84540c54d0 0x7f8454061440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.916+0000 7f845a200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84540c58b0 0x7f84540c6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.920+0000 7f845a200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84541572c0 con 0x7f8454150210 2024-01-17T22:59:29.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.920+0000 7f845a200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84540c6930 con 0x7f84540c54d0 2024-01-17T22:59:29.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.920+0000 7f845a200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84541566b0 con 0x7f84540c58b0 2024-01-17T22:59:29.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.920+0000 7f8453400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f84540c54d0 0x7f8454061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.920+0000 7f8453400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f84540c54d0 0x7f8454061440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58032/0 (socket says 172.21.15.161:58032) 2024-01-17T22:59:29.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.920+0000 7f8453400640 1 -- 172.21.15.161:0/893693950 learned_addr learned my addr 172.21.15.161:0/893693950 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:29.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.920+0000 7f8452a00640 1 --2- 172.21.15.161:0/893693950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84540c58b0 0x7f84540c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.924+0000 7f8453400640 1 -- 172.21.15.161:0/893693950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84540c58b0 msgr2=0x7f84540c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:29.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.924+0000 7f8453400640 1 --2- 172.21.15.161:0/893693950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84540c58b0 0x7f84540c6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.924+0000 7f8453400640 1 -- 172.21.15.161:0/893693950 >> v1:172.21.15.161:6789/0 conn(0x7f8454150210 legacy=0x7f84540c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.924+0000 7f8453400640 1 -- 172.21.15.161:0/893693950 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8454156990 con 0x7f84540c54d0 2024-01-17T22:59:29.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.928+0000 7f8453400640 1 --2- 172.21.15.161:0/893693950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84540c54d0 0x7f8454061440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8444009870 tx=0x7f844401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90aeeba6d528f33a server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:29.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.932+0000 7f8452000640 1 -- 172.21.15.161:0/893693950 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84440ab680 con 0x7f84540c54d0 2024-01-17T22:59:29.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.932+0000 7f8452000640 1 -- 172.21.15.161:0/893693950 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84440ab7e0 con 0x7f84540c54d0 2024-01-17T22:59:29.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.932+0000 7f8452000640 1 -- 172.21.15.161:0/893693950 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84440abb70 con 0x7f84540c54d0 2024-01-17T22:59:29.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.932+0000 7f845a200640 1 -- 172.21.15.161:0/893693950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84540c54d0 msgr2=0x7f8454061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.932+0000 7f845a200640 1 --2- 172.21.15.161:0/893693950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84540c54d0 0x7f8454061440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8444009870 tx=0x7f844401c480 comp rx=0 tx=0).stop 2024-01-17T22:59:29.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.932+0000 7f845a200640 1 -- 172.21.15.161:0/893693950 shutdown_connections 2024-01-17T22:59:29.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.932+0000 7f845a200640 1 --2- 172.21.15.161:0/893693950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84540c58b0 0x7f84540c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.932+0000 7f845a200640 1 --2- 172.21.15.161:0/893693950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84540c54d0 0x7f8454061440 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.932+0000 7f845a200640 1 -- 172.21.15.161:0/893693950 >> 172.21.15.161:0/893693950 conn(0x7f84540c8160 msgr2=0x7f84540c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:29.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.932+0000 7f845a200640 1 -- 172.21.15.161:0/893693950 shutdown_connections 2024-01-17T22:59:29.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.932+0000 7f845a200640 1 -- 172.21.15.161:0/893693950 wait complete. 2024-01-17T22:59:29.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.936+0000 7f845a200640 1 Processor -- start 2024-01-17T22:59:29.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.936+0000 7f845a200640 1 -- start start 2024-01-17T22:59:29.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.936+0000 7f845a200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84540c54d0 0x7f845413dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.936+0000 7f845a200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84540c58b0 0x7f84541f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.936+0000 7f845a200640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8454150210 0x7f84541f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.936+0000 7f845a200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845413c590 con 0x7f84540c54d0 2024-01-17T22:59:29.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.936+0000 7f845a200640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845413c860 con 0x7f8454150210 2024-01-17T22:59:29.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.936+0000 7f845a200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845413cb40 con 0x7f84540c58b0 2024-01-17T22:59:29.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.936+0000 7f8453400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84540c54d0 0x7f845413dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.936+0000 7f8453400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84540c54d0 0x7f845413dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58036/0 (socket says 172.21.15.161:58036) 2024-01-17T22:59:29.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.936+0000 7f8453400640 1 -- 172.21.15.161:0/548629051 learned_addr learned my addr 172.21.15.161:0/548629051 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:29.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.936+0000 7f8452a00640 1 --2- 172.21.15.161:0/548629051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84540c58b0 0x7f84541f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.936+0000 7f8453e00640 1 --2- 172.21.15.161:0/548629051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8454150210 0x7f84541f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.940+0000 7f8453400640 1 -- 172.21.15.161:0/548629051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84540c58b0 msgr2=0x7f84541f1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.940+0000 7f8453400640 1 --2- 172.21.15.161:0/548629051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84540c58b0 0x7f84541f1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.940+0000 7f8453400640 1 -- 172.21.15.161:0/548629051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8454150210 msgr2=0x7f84541f2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.940+0000 7f8453400640 1 --2- 172.21.15.161:0/548629051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8454150210 0x7f84541f2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.940+0000 7f8453400640 1 -- 172.21.15.161:0/548629051 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84440094d0 con 0x7f84540c54d0 2024-01-17T22:59:29.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.944+0000 7f8453400640 1 --2- 172.21.15.161:0/548629051 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84540c54d0 0x7f845413dd70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f84440ad040 tx=0x7f844401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:29.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.944+0000 7f844b400640 1 -- 172.21.15.161:0/548629051 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84440ab680 con 0x7f84540c54d0 2024-01-17T22:59:29.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.944+0000 7f844b400640 1 -- 172.21.15.161:0/548629051 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84440b4820 con 0x7f84540c54d0 2024-01-17T22:59:29.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.944+0000 7f844b400640 1 -- 172.21.15.161:0/548629051 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84440b4bd0 con 0x7f84540c54d0 2024-01-17T22:59:29.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.944+0000 7f845a200640 1 -- 172.21.15.161:0/548629051 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845413ce20 con 0x7f84540c54d0 2024-01-17T22:59:29.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.948+0000 7f845a200640 1 -- 172.21.15.161:0/548629051 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845413d3e0 con 0x7f84540c54d0 2024-01-17T22:59:29.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:29.948+0000 7f845a200640 1 -- 172.21.15.161:0/548629051 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8454067c90 con 0x7f84540c54d0 2024-01-17T22:59:30.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.184+0000 7f844b400640 1 -- 172.21.15.161:0/548629051 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f84440b4d30 con 0x7f84540c54d0 2024-01-17T22:59:30.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.188+0000 7f844b400640 1 --2- 172.21.15.161:0/548629051 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f842c0668c0 0x7f842c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:30.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.188+0000 7f8452a00640 1 --2- 172.21.15.161:0/548629051 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f842c0668c0 0x7f842c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:30.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.188+0000 7f8452a00640 1 --2- 172.21.15.161:0/548629051 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f842c0668c0 0x7f842c068d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f84541f13e0 tx=0x7f843c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:30.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.200+0000 7f844b400640 1 -- 172.21.15.161:0/548629051 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f84440f08a0 con 0x7f84540c54d0 2024-01-17T22:59:30.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.200+0000 7f844b400640 1 -- 172.21.15.161:0/548629051 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f84440ec4e0 con 0x7f84540c54d0 2024-01-17T22:59:30.342 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T22:59:30.345 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T22:59:30.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.388+0000 7f845a200640 1 -- 172.21.15.161:0/548629051 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f845406c100 con 0x7f84540c54d0 2024-01-17T22:59:30.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.532+0000 7f844b400640 1 -- 172.21.15.161:0/548629051 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164566 (secure 0 0 0) 0x7f84440efb00 con 0x7f84540c54d0 2024-01-17T22:59:30.532 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:30.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.536+0000 7f845a200640 1 -- 172.21.15.161:0/548629051 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f842c0668c0 msgr2=0x7f842c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:30.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.536+0000 7f845a200640 1 --2- 172.21.15.161:0/548629051 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f842c0668c0 0x7f842c068d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f84541f13e0 tx=0x7f843c008040 comp rx=0 tx=0).stop 2024-01-17T22:59:30.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.536+0000 7f845a200640 1 -- 172.21.15.161:0/548629051 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84540c54d0 msgr2=0x7f845413dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:30.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.536+0000 7f845a200640 1 --2- 172.21.15.161:0/548629051 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84540c54d0 0x7f845413dd70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f84440ad040 tx=0x7f844401acc0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.536+0000 7f845a200640 1 -- 172.21.15.161:0/548629051 shutdown_connections 2024-01-17T22:59:30.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.536+0000 7f845a200640 1 --2- 172.21.15.161:0/548629051 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f842c0668c0 0x7f842c068d80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.536+0000 7f845a200640 1 --2- 172.21.15.161:0/548629051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8454150210 0x7f84541f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.536+0000 7f845a200640 1 --2- 172.21.15.161:0/548629051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f84540c58b0 0x7f84541f1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.536+0000 7f845a200640 1 --2- 172.21.15.161:0/548629051 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84540c54d0 0x7f845413dd70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.536+0000 7f845a200640 1 -- 172.21.15.161:0/548629051 >> 172.21.15.161:0/548629051 conn(0x7f84540c8160 msgr2=0x7f84540c6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:30.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.536+0000 7f845a200640 1 -- 172.21.15.161:0/548629051 shutdown_connections 2024-01-17T22:59:30.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.536+0000 7f845a200640 1 -- 172.21.15.161:0/548629051 wait complete. 2024-01-17T22:59:30.557 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":5,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":272458188},{"type":"v1","addr":"172.21.15.161:6801","nonce":272458188}]},"active_addr":"172.21.15.161:6801/272458188","active_change":"2024-01-17T22:58:06.319951+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4116,"name":"x","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":1439676853}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":2335339649}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":599877028}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":1628224698}]}]} 2024-01-17T22:59:30.560 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-17T22:59:30.561 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-17T22:59:30.561 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T22:59:30.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.708+0000 7f6482800640 1 Processor -- start 2024-01-17T22:59:30.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.708+0000 7f6482800640 1 -- start start 2024-01-17T22:59:30.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.712+0000 7f6482800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c0c6480 0x7f647c06d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:30.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.712+0000 7f6482800640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f647c0c68a0 0x7f647c06dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:30.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.712+0000 7f6482800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647c159ad0 con 0x7f647c14ff10 2024-01-17T22:59:30.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.712+0000 7f6482800640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647c06cc20 con 0x7f647c0c68a0 2024-01-17T22:59:30.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.712+0000 7f6482800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c06cf00 con 0x7f647c0c6480 2024-01-17T22:59:30.710 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.712+0000 7f647aa00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c0c6480 0x7f647c06d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:30.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.712+0000 7f647aa00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c0c6480 0x7f647c06d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:41146/0 (socket says 172.21.15.161:41146) 2024-01-17T22:59:30.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.712+0000 7f647aa00640 1 -- 172.21.15.161:0/3248379171 learned_addr learned my addr 172.21.15.161:0/3248379171 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:30.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.716+0000 7f647be00640 1 --2- 172.21.15.161:0/3248379171 >> v2:172.21.15.190:3300/0 conn(0x7f647c0c68a0 0x7f647c06dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:30.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.724+0000 7f647aa00640 1 -- 172.21.15.161:0/3248379171 >> v2:172.21.15.190:3300/0 conn(0x7f647c0c68a0 msgr2=0x7f647c06dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:30.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.724+0000 7f647aa00640 1 --2- 172.21.15.161:0/3248379171 >> v2:172.21.15.190:3300/0 conn(0x7f647c0c68a0 0x7f647c06dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.724+0000 7f647aa00640 1 -- 172.21.15.161:0/3248379171 >> v1:172.21.15.161:6789/0 conn(0x7f647c14ff10 legacy=0x7f647c156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:30.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.724+0000 7f647aa00640 1 -- 172.21.15.161:0/3248379171 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c1591a0 con 0x7f647c0c6480 2024-01-17T22:59:30.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.820+0000 7f647aa00640 1 --2- 172.21.15.161:0/3248379171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c0c6480 0x7f647c06d730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6464009870 tx=0x7f646401ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea12cc9a4825b4c0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:30.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.828+0000 7f647a000640 1 -- 172.21.15.161:0/3248379171 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64640a89b0 con 0x7f647c0c6480 2024-01-17T22:59:30.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.828+0000 7f647a000640 1 -- 172.21.15.161:0/3248379171 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64640a8b10 con 0x7f647c0c6480 2024-01-17T22:59:30.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.828+0000 7f647a000640 1 -- 172.21.15.161:0/3248379171 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64640a8ea0 con 0x7f647c0c6480 2024-01-17T22:59:30.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.828+0000 7f6482800640 1 -- 172.21.15.161:0/3248379171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c0c6480 msgr2=0x7f647c06d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:30.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.828+0000 7f6482800640 1 --2- 172.21.15.161:0/3248379171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c0c6480 0x7f647c06d730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6464009870 tx=0x7f646401ecf0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.828+0000 7f6482800640 1 -- 172.21.15.161:0/3248379171 shutdown_connections 2024-01-17T22:59:30.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.828+0000 7f6482800640 1 --2- 172.21.15.161:0/3248379171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c0c6480 0x7f647c06d730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.828+0000 7f6482800640 1 --2- 172.21.15.161:0/3248379171 >> v2:172.21.15.190:3300/0 conn(0x7f647c0c68a0 0x7f647c06dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.828+0000 7f6482800640 1 -- 172.21.15.161:0/3248379171 >> 172.21.15.161:0/3248379171 conn(0x7f647c0cb070 msgr2=0x7f647c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:30.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.828+0000 7f6482800640 1 -- 172.21.15.161:0/3248379171 shutdown_connections 2024-01-17T22:59:30.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.828+0000 7f6482800640 1 -- 172.21.15.161:0/3248379171 wait complete. 2024-01-17T22:59:30.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.832+0000 7f6482800640 1 Processor -- start 2024-01-17T22:59:30.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.832+0000 7f6482800640 1 -- start start 2024-01-17T22:59:30.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.832+0000 7f6482800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f647c0c6480 0x7f647c161700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:30.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.832+0000 7f6482800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f647c0c68a0 0x7f647c15e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:30.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.832+0000 7f6482800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c14ff10 0x7f647c151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:30.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.832+0000 7f6482800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c1ef3b0 con 0x7f647c0c68a0 2024-01-17T22:59:30.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.832+0000 7f6482800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c1ef5a0 con 0x7f647c0c6480 2024-01-17T22:59:30.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.832+0000 7f6482800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c0cace0 con 0x7f647c14ff10 2024-01-17T22:59:30.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.832+0000 7f647aa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f647c0c68a0 0x7f647c15e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:30.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.832+0000 7f647aa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f647c0c68a0 0x7f647c15e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58042/0 (socket says 172.21.15.161:58042) 2024-01-17T22:59:30.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.832+0000 7f647aa00640 1 -- 172.21.15.161:0/1725355776 learned_addr learned my addr 172.21.15.161:0/1725355776 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:30.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.832+0000 7f647b400640 1 --2- 172.21.15.161:0/1725355776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f647c0c6480 0x7f647c161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:30.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.840+0000 7f647be00640 1 --2- 172.21.15.161:0/1725355776 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c14ff10 0x7f647c151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:30.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.840+0000 7f647aa00640 1 -- 172.21.15.161:0/1725355776 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c14ff10 msgr2=0x7f647c151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:30.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.840+0000 7f647aa00640 1 --2- 172.21.15.161:0/1725355776 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c14ff10 0x7f647c151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.840+0000 7f647aa00640 1 -- 172.21.15.161:0/1725355776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f647c0c6480 msgr2=0x7f647c161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:30.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.840+0000 7f647aa00640 1 --2- 172.21.15.161:0/1725355776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f647c0c6480 0x7f647c161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.840+0000 7f647aa00640 1 -- 172.21.15.161:0/1725355776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64640094d0 con 0x7f647c0c68a0 2024-01-17T22:59:30.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.844+0000 7f647aa00640 1 --2- 172.21.15.161:0/1725355776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f647c0c68a0 0x7f647c15e6a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f646401c920 tx=0x7f646401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:30.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.848+0000 7f6473400640 1 -- 172.21.15.161:0/1725355776 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64640b1d40 con 0x7f647c0c68a0 2024-01-17T22:59:30.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.848+0000 7f6473400640 1 -- 172.21.15.161:0/1725355776 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64640bb470 con 0x7f647c0c68a0 2024-01-17T22:59:30.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.848+0000 7f6473400640 1 -- 172.21.15.161:0/1725355776 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64640b1ea0 con 0x7f647c0c68a0 2024-01-17T22:59:30.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.848+0000 7f6482800640 1 -- 172.21.15.161:0/1725355776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647c1ef840 con 0x7f647c0c68a0 2024-01-17T22:59:30.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.848+0000 7f6482800640 1 -- 172.21.15.161:0/1725355776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647c1efe00 con 0x7f647c0c68a0 2024-01-17T22:59:30.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.848+0000 7f6482800640 1 -- 172.21.15.161:0/1725355776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647c159f40 con 0x7f647c0c68a0 2024-01-17T22:59:30.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.868+0000 7f6473400640 1 -- 172.21.15.161:0/1725355776 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f64640b7070 con 0x7f647c0c68a0 2024-01-17T22:59:30.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.872+0000 7f6473400640 1 --2- 172.21.15.161:0/1725355776 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6454066840 0x7f6454068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:30.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.872+0000 7f647b400640 1 --2- 172.21.15.161:0/1725355776 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6454066840 0x7f6454068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:30.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.872+0000 7f647b400640 1 --2- 172.21.15.161:0/1725355776 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6454066840 0x7f6454068d00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f646c0098e0 tx=0x7f646c009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:30.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:30.872+0000 7f6473400640 1 -- 172.21.15.161:0/1725355776 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f64640f4140 con 0x7f647c0c68a0 2024-01-17T22:59:31.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.104+0000 7f6473400640 1 -- 172.21.15.161:0/1725355776 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f64640efd80 con 0x7f647c0c68a0 2024-01-17T22:59:31.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.336+0000 7f6482800640 1 -- 172.21.15.161:0/1725355776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f647c159f40 con 0x7f647c0c68a0 2024-01-17T22:59:31.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.416+0000 7f6473400640 1 -- 172.21.15.161:0/1725355776 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18587 (secure 0 0 0) 0x7f647c159f40 con 0x7f647c0c68a0 2024-01-17T22:59:31.415 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:31.415 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":28,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:59:08.571619+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T22:58:46.757110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T22:58:47.930512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T22:58:53.561624+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.614036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.746767+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.689096+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.706485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.628004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.680048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.571249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]},{"pgid":"4.14","mappings":[{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:59:31.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.420+0000 7f6482800640 1 -- 172.21.15.161:0/1725355776 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6454066840 msgr2=0x7f6454068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:31.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.420+0000 7f6482800640 1 --2- 172.21.15.161:0/1725355776 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6454066840 0x7f6454068d00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f646c0098e0 tx=0x7f646c009060 comp rx=0 tx=0).stop 2024-01-17T22:59:31.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.420+0000 7f6482800640 1 -- 172.21.15.161:0/1725355776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f647c0c68a0 msgr2=0x7f647c15e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:31.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.420+0000 7f6482800640 1 --2- 172.21.15.161:0/1725355776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f647c0c68a0 0x7f647c15e6a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f646401c920 tx=0x7f646401ba90 comp rx=0 tx=0).stop 2024-01-17T22:59:31.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.420+0000 7f6482800640 1 -- 172.21.15.161:0/1725355776 shutdown_connections 2024-01-17T22:59:31.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.420+0000 7f6482800640 1 --2- 172.21.15.161:0/1725355776 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6454066840 0x7f6454068d00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.420+0000 7f6482800640 1 --2- 172.21.15.161:0/1725355776 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c14ff10 0x7f647c151850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.420+0000 7f6482800640 1 --2- 172.21.15.161:0/1725355776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f647c0c68a0 0x7f647c15e6a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.420+0000 7f6482800640 1 --2- 172.21.15.161:0/1725355776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f647c0c6480 0x7f647c161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.420+0000 7f6482800640 1 -- 172.21.15.161:0/1725355776 >> 172.21.15.161:0/1725355776 conn(0x7f647c0cb070 msgr2=0x7f647c0c5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:31.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.420+0000 7f6482800640 1 -- 172.21.15.161:0/1725355776 shutdown_connections 2024-01-17T22:59:31.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.420+0000 7f6482800640 1 -- 172.21.15.161:0/1725355776 wait complete. 2024-01-17T22:59:31.439 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-17T22:59:31.439 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T22:59:31.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.580+0000 7f5fdb200640 1 Processor -- start 2024-01-17T22:59:31.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.580+0000 7f5fdb200640 1 -- start start 2024-01-17T22:59:31.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.580+0000 7f5fdb200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5fd4153a80 0x7f5fd40c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:31.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.580+0000 7f5fdb200640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5fd406ba50 0x7f5fd4159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:31.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.580+0000 7f5fdb200640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd406b5c0 con 0x7f5fd415a310 2024-01-17T22:59:31.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.580+0000 7f5fdb200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd4159940 con 0x7f5fd4153a80 2024-01-17T22:59:31.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.580+0000 7f5fdb200640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd4153e60 con 0x7f5fd406ba50 2024-01-17T22:59:31.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.584+0000 7f5fd3e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5fd4153a80 0x7f5fd40c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:31.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.584+0000 7f5fd3e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5fd4153a80 0x7f5fd40c66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58046/0 (socket says 172.21.15.161:58046) 2024-01-17T22:59:31.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.584+0000 7f5fd3e00640 1 -- 172.21.15.161:0/1468584408 learned_addr learned my addr 172.21.15.161:0/1468584408 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:31.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.584+0000 7f5fd3400640 1 --2- 172.21.15.161:0/1468584408 >> v2:172.21.15.190:3300/0 conn(0x7f5fd406ba50 0x7f5fd4159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:31.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.584+0000 7f5fd3e00640 1 -- 172.21.15.161:0/1468584408 >> v2:172.21.15.190:3300/0 conn(0x7f5fd406ba50 msgr2=0x7f5fd4159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:31.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.584+0000 7f5fd3e00640 1 --2- 172.21.15.161:0/1468584408 >> v2:172.21.15.190:3300/0 conn(0x7f5fd406ba50 0x7f5fd4159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.584+0000 7f5fd3e00640 1 -- 172.21.15.161:0/1468584408 >> v1:172.21.15.190:6789/0 conn(0x7f5fd415a310 legacy=0x7f5fd40718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:31.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.584+0000 7f5fd3e00640 1 -- 172.21.15.161:0/1468584408 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd406aa40 con 0x7f5fd4153a80 2024-01-17T22:59:31.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.592+0000 7f5fd3e00640 1 --2- 172.21.15.161:0/1468584408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fd4153a80 0x7f5fd40c66e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5fd406eb90 tx=0x7f5fc401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59a8aa9f3a3ca33 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:31.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.652+0000 7f5fd2a00640 1 -- 172.21.15.161:0/1468584408 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc40ac410 con 0x7f5fd4153a80 2024-01-17T22:59:31.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.652+0000 7f5fd2a00640 1 -- 172.21.15.161:0/1468584408 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc40ac570 con 0x7f5fd4153a80 2024-01-17T22:59:31.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.652+0000 7f5fd2a00640 1 -- 172.21.15.161:0/1468584408 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc40ac900 con 0x7f5fd4153a80 2024-01-17T22:59:31.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.652+0000 7f5fdb200640 1 -- 172.21.15.161:0/1468584408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fd4153a80 msgr2=0x7f5fd40c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:31.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.652+0000 7f5fdb200640 1 --2- 172.21.15.161:0/1468584408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fd4153a80 0x7f5fd40c66e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5fd406eb90 tx=0x7f5fc401c4c0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.652+0000 7f5fdb200640 1 -- 172.21.15.161:0/1468584408 shutdown_connections 2024-01-17T22:59:31.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.652+0000 7f5fdb200640 1 --2- 172.21.15.161:0/1468584408 >> v2:172.21.15.190:3300/0 conn(0x7f5fd406ba50 0x7f5fd4159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.652+0000 7f5fdb200640 1 --2- 172.21.15.161:0/1468584408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fd4153a80 0x7f5fd40c66e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.652+0000 7f5fdb200640 1 -- 172.21.15.161:0/1468584408 >> 172.21.15.161:0/1468584408 conn(0x7f5fd406fba0 msgr2=0x7f5fd40cb660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:31.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.652+0000 7f5fdb200640 1 -- 172.21.15.161:0/1468584408 shutdown_connections 2024-01-17T22:59:31.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.652+0000 7f5fdb200640 1 -- 172.21.15.161:0/1468584408 wait complete. 2024-01-17T22:59:31.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.652+0000 7f5fdb200640 1 Processor -- start 2024-01-17T22:59:31.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.652+0000 7f5fdb200640 1 -- start start 2024-01-17T22:59:31.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.656+0000 7f5fdb200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fd406ba50 0x7f5fd4145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:31.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.656+0000 7f5fdb200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fd4153a80 0x7f5fd41f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:31.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.656+0000 7f5fdb200640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fd415a310 0x7f5fd41f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:31.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.656+0000 7f5fdb200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40c9030 con 0x7f5fd4153a80 2024-01-17T22:59:31.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.656+0000 7f5fdb200640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd41f6420 con 0x7f5fd415a310 2024-01-17T22:59:31.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.656+0000 7f5fdb200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd4158bc0 con 0x7f5fd406ba50 2024-01-17T22:59:31.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.656+0000 7f5fd3400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fd4153a80 0x7f5fd41f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:31.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.656+0000 7f5fd3400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fd4153a80 0x7f5fd41f5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58058/0 (socket says 172.21.15.161:58058) 2024-01-17T22:59:31.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.656+0000 7f5fd3400640 1 -- 172.21.15.161:0/3099596950 learned_addr learned my addr 172.21.15.161:0/3099596950 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:31.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.660+0000 7f5fd3400640 1 -- 172.21.15.161:0/3099596950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fd406ba50 msgr2=0x7f5fd4145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:31.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.660+0000 7f5fd3400640 1 --2- 172.21.15.161:0/3099596950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fd406ba50 0x7f5fd4145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.660+0000 7f5fd3400640 1 -- 172.21.15.161:0/3099596950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fd415a310 msgr2=0x7f5fd41f5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:31.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.660+0000 7f5fd3400640 1 --2- 172.21.15.161:0/3099596950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fd415a310 0x7f5fd41f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.660+0000 7f5fd3400640 1 -- 172.21.15.161:0/3099596950 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc40094d0 con 0x7f5fd4153a80 2024-01-17T22:59:31.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.664+0000 7f5fd3400640 1 --2- 172.21.15.161:0/3099596950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fd4153a80 0x7f5fd41f5530 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc00d5c0 tx=0x7f5fbc00da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:31.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.668+0000 7f5fcbe00640 1 -- 172.21.15.161:0/3099596950 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc0125f0 con 0x7f5fd4153a80 2024-01-17T22:59:31.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.668+0000 7f5fcbe00640 1 -- 172.21.15.161:0/3099596950 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc012750 con 0x7f5fd4153a80 2024-01-17T22:59:31.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.668+0000 7f5fdb200640 1 -- 172.21.15.161:0/3099596950 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd41f6140 con 0x7f5fd4153a80 2024-01-17T22:59:31.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.668+0000 7f5fcbe00640 1 -- 172.21.15.161:0/3099596950 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc012b00 con 0x7f5fd4153a80 2024-01-17T22:59:31.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.668+0000 7f5fdb200640 1 -- 172.21.15.161:0/3099596950 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd41ec3e0 con 0x7f5fd4153a80 2024-01-17T22:59:31.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.668+0000 7f5fdb200640 1 -- 172.21.15.161:0/3099596950 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd40746a0 con 0x7f5fd4153a80 2024-01-17T22:59:31.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.908+0000 7f5fcbe00640 1 -- 172.21.15.161:0/3099596950 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f5fbc012c60 con 0x7f5fd4153a80 2024-01-17T22:59:31.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.912+0000 7f5fcbe00640 1 --2- 172.21.15.161:0/3099596950 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5fac066890 0x7f5fac068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:31.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.912+0000 7f5fd3e00640 1 --2- 172.21.15.161:0/3099596950 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5fac066890 0x7f5fac068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:31.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.912+0000 7f5fd3e00640 1 --2- 172.21.15.161:0/3099596950 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5fac066890 0x7f5fac068d50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40ae000 tx=0x7f5fc4004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:31.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.924+0000 7f5fcbe00640 1 -- 172.21.15.161:0/3099596950 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f5fbc015e40 con 0x7f5fd4153a80 2024-01-17T22:59:31.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:31.924+0000 7f5fcbe00640 1 -- 172.21.15.161:0/3099596950 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f5fbc052340 con 0x7f5fd4153a80 2024-01-17T22:59:32.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.096+0000 7f5fdb200640 1 -- 172.21.15.161:0/3099596950 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fd406b7c0 con 0x7f5fd4153a80 2024-01-17T22:59:32.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.136+0000 7f5fcbe00640 1 -- 172.21.15.161:0/3099596950 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18587 (secure 0 0 0) 0x7f5fbc055960 con 0x7f5fd4153a80 2024-01-17T22:59:32.134 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:32.134 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":28,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:59:08.571619+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T22:58:46.757110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T22:58:47.930512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T22:58:53.561624+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.614036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.746767+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.689096+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.706485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.628004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.680048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.571249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]},{"pgid":"4.14","mappings":[{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:59:32.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.136+0000 7f5fdb200640 1 -- 172.21.15.161:0/3099596950 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5fac066890 msgr2=0x7f5fac068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.136+0000 7f5fdb200640 1 --2- 172.21.15.161:0/3099596950 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5fac066890 0x7f5fac068d50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40ae000 tx=0x7f5fc4004740 comp rx=0 tx=0).stop 2024-01-17T22:59:32.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.136+0000 7f5fdb200640 1 -- 172.21.15.161:0/3099596950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fd4153a80 msgr2=0x7f5fd41f5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.136+0000 7f5fdb200640 1 --2- 172.21.15.161:0/3099596950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fd4153a80 0x7f5fd41f5530 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc00d5c0 tx=0x7f5fbc00da80 comp rx=0 tx=0).stop 2024-01-17T22:59:32.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.140+0000 7f5fdb200640 1 -- 172.21.15.161:0/3099596950 shutdown_connections 2024-01-17T22:59:32.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.140+0000 7f5fdb200640 1 --2- 172.21.15.161:0/3099596950 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f5fac066890 0x7f5fac068d50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.140+0000 7f5fdb200640 1 --2- 172.21.15.161:0/3099596950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fd415a310 0x7f5fd41f5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.140+0000 7f5fdb200640 1 --2- 172.21.15.161:0/3099596950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fd4153a80 0x7f5fd41f5530 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.140+0000 7f5fdb200640 1 --2- 172.21.15.161:0/3099596950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fd406ba50 0x7f5fd4145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.140+0000 7f5fdb200640 1 -- 172.21.15.161:0/3099596950 >> 172.21.15.161:0/3099596950 conn(0x7f5fd406fba0 msgr2=0x7f5fd41528d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.140+0000 7f5fdb200640 1 -- 172.21.15.161:0/3099596950 shutdown_connections 2024-01-17T22:59:32.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.140+0000 7f5fdb200640 1 -- 172.21.15.161:0/3099596950 wait complete. 2024-01-17T22:59:32.158 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-17T22:59:32.158 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-17T22:59:32.159 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-17T22:59:32.159 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-17T22:59:32.159 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-17T22:59:32.160 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-17T22:59:32.160 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-17T22:59:32.161 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-17T22:59:32.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.428+0000 7fd46fe00640 1 Processor -- start 2024-01-17T22:59:32.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.428+0000 7fd46fe00640 1 -- start start 2024-01-17T22:59:32.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.432+0000 7fd46fe00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470153630 0x7fd47006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.432+0000 7fd46fe00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd470159f90 0x7fd47006c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.432+0000 7fd46fe00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47006e180 con 0x7fd47006caa0 2024-01-17T22:59:32.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.432+0000 7fd46fe00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47006cef0 con 0x7fd470159f90 2024-01-17T22:59:32.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.432+0000 7fd46fe00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47006d3f0 con 0x7fd470153630 2024-01-17T22:59:32.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.432+0000 7f6f3e400640 1 Processor -- start 2024-01-17T22:59:32.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.432+0000 7f6f3e400640 1 -- start start 2024-01-17T22:59:32.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.436+0000 7fd46ea00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470153630 0x7fd47006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.436+0000 7f0e98800640 1 Processor -- start 2024-01-17T22:59:32.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.436+0000 7f0e98800640 1 -- start start 2024-01-17T22:59:32.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.436+0000 7f6f3e400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f38153630 0x7f6f3806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.436+0000 7f6f3e400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6f38159f90 0x7f6f3806c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.436+0000 7fd46ea00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470153630 0x7fd47006dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:39930/0 (socket says 172.21.15.161:39930) 2024-01-17T22:59:32.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.436+0000 7fd46ea00640 1 -- 172.21.15.161:0/2997439021 learned_addr learned my addr 172.21.15.161:0/2997439021 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:32.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.436+0000 7f6f3e400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3806e180 con 0x7f6f3806caa0 2024-01-17T22:59:32.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.436+0000 7f6f3e400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3806cef0 con 0x7f6f38159f90 2024-01-17T22:59:32.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.436+0000 7f6f3e400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3806d3f0 con 0x7f6f38153630 2024-01-17T22:59:32.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.436+0000 7fd46e000640 1 --2- 172.21.15.161:0/2997439021 >> v2:172.21.15.161:3300/0 conn(0x7fd470159f90 0x7fd47006c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.436+0000 7f0e98800640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0e901518a0 0x7f0e9006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.436+0000 7f0e98800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9015af40 con 0x7f0e90072300 2024-01-17T22:59:32.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.436+0000 7f0e98800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9015b220 con 0x7f0e9006d210 2024-01-17T22:59:32.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.436+0000 7f0e98800640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e900c5a70 con 0x7f0e901518a0 2024-01-17T22:59:32.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.440+0000 7f6f3da00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6f3806caa0 0x7f6f38071540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38482/0 (socket says 172.21.15.161:38482) 2024-01-17T22:59:32.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.440+0000 7f6f3da00640 1 -- 172.21.15.161:0/1333689723 learned_addr learned my addr 172.21.15.161:0/1333689723 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:32.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.440+0000 7f0e95e00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0e901518a0 0x7f0e9006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.440+0000 7f0e95e00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0e901518a0 0x7f0e9006ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:49318/0 (socket says 172.21.15.161:49318) 2024-01-17T22:59:32.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.440+0000 7f0e95e00640 1 -- 172.21.15.161:0/1619504802 learned_addr learned my addr 172.21.15.161:0/1619504802 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:32.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.440+0000 7f7fe9800640 1 Processor -- start 2024-01-17T22:59:32.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.444+0000 7f7fe9800640 1 -- start start 2024-01-17T22:59:32.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.444+0000 7fd46ea00640 1 -- 172.21.15.161:0/2997439021 >> v2:172.21.15.161:3300/0 conn(0x7fd470159f90 msgr2=0x7fd47006c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.444+0000 7fd46ea00640 1 --2- 172.21.15.161:0/2997439021 >> v2:172.21.15.161:3300/0 conn(0x7fd470159f90 0x7fd47006c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.444+0000 7fd46ea00640 1 -- 172.21.15.161:0/2997439021 >> v1:172.21.15.161:6789/0 conn(0x7fd47006caa0 legacy=0x7fd470071540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.444+0000 7fd46ea00640 1 -- 172.21.15.161:0/2997439021 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd470153a10 con 0x7fd470153630 2024-01-17T22:59:32.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.444+0000 7f6f3d000640 1 --2- 172.21.15.161:0/1333689723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f38153630 0x7f6f3806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.444+0000 7f7fe9800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7fdc0e71f0 0x7f7fdc0462a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.444+0000 7f7fe9800640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7fdc0467e0 0x7f7fdc04ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.444+0000 7f7fe9800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fdc04c690 con 0x7f7fdc0dd2c0 2024-01-17T22:59:32.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.444+0000 7f7fe9800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fdc046c10 con 0x7f7fdc0e71f0 2024-01-17T22:59:32.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.444+0000 7f7fe9800640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fdc0454e0 con 0x7f7fdc0467e0 2024-01-17T22:59:32.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.448+0000 7f0e95e00640 1 -- 172.21.15.161:0/1619504802 >> v1:172.21.15.190:6789/0 conn(0x7f0e9006d210 legacy=0x7f0e90157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.448+0000 7f0e95e00640 1 -- 172.21.15.161:0/1619504802 >> v1:172.21.15.161:6789/0 conn(0x7f0e90072300 legacy=0x7f0e90161e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.448+0000 7f0e95e00640 1 -- 172.21.15.161:0/1619504802 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9015b500 con 0x7f0e901518a0 2024-01-17T22:59:32.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.452+0000 7f7fe3400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7fdc0467e0 0x7f7fdc04ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.452+0000 7f6f3d000640 1 -- 172.21.15.161:0/1333689723 >> v2:172.21.15.161:3300/0 conn(0x7f6f38159f90 msgr2=0x7f6f3806c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.452+0000 7f6f3d000640 1 --2- 172.21.15.161:0/1333689723 >> v2:172.21.15.161:3300/0 conn(0x7f6f38159f90 0x7f6f3806c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.452+0000 7f6f3d000640 1 -- 172.21.15.161:0/1333689723 >> v1:172.21.15.161:6789/0 conn(0x7f6f3806caa0 legacy=0x7f6f38071540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.452+0000 7f6f3d000640 1 -- 172.21.15.161:0/1333689723 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f38153a10 con 0x7f6f38153630 2024-01-17T22:59:32.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.456+0000 7f7fe2a00640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f7fdc0dd2c0 0x7f7fdc0e66f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.161:35208/0 (socket says 172.21.15.161:35208) 2024-01-17T22:59:32.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.456+0000 7f7fe2a00640 1 -- 172.21.15.161:0/195298936 learned_addr learned my addr 172.21.15.161:0/195298936 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:32.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.456+0000 7fd46ea00640 1 --2- 172.21.15.161:0/2997439021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470153630 0x7fd47006dc40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd458009870 tx=0x7fd45801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79375f02dfa1c473 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.464+0000 7fa6eba00640 1 Processor -- start 2024-01-17T22:59:32.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.464+0000 7fa6eba00640 1 -- start start 2024-01-17T22:59:32.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.464+0000 7f6f3d000640 1 --2- 172.21.15.161:0/1333689723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f38153630 0x7f6f3806dc40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6f200097c0 tx=0x7f6f2001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79c742302a79b8ae server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.464+0000 7fa6eba00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa6e4153610 0x7fa6e40cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.464+0000 7fa6eba00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6e406b840 0x7fa6e40ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.464+0000 7fa6eba00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e4159760 con 0x7fa6e40c7170 2024-01-17T22:59:32.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.464+0000 7fa6eba00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e4159a00 con 0x7fa6e4153610 2024-01-17T22:59:32.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.464+0000 7fa6eba00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e4159ce0 con 0x7fa6e406b840 2024-01-17T22:59:32.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.464+0000 7f85b3600640 1 Processor -- start 2024-01-17T22:59:32.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.464+0000 7f85b3600640 1 -- start start 2024-01-17T22:59:32.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.464+0000 7f7fe3400640 1 -- 172.21.15.161:0/195298936 >> v2:172.21.15.161:3300/0 conn(0x7f7fdc0e71f0 msgr2=0x7f7fdc0462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.464+0000 7f7fe3400640 1 --2- 172.21.15.161:0/195298936 >> v2:172.21.15.161:3300/0 conn(0x7f7fdc0e71f0 0x7f7fdc0462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.464+0000 7f7fe3400640 1 -- 172.21.15.161:0/195298936 >> v1:172.21.15.190:6789/0 conn(0x7f7fdc0dd2c0 legacy=0x7f7fdc0e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.464+0000 7f7fe3400640 1 -- 172.21.15.161:0/195298936 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc0457c0 con 0x7f7fdc0467e0 2024-01-17T22:59:32.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.468+0000 7f85b3600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85ac0cccc0 0x7f85ac157910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.468+0000 7f85b3600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ac0c2cd0 con 0x7f85ac0cc8e0 2024-01-17T22:59:32.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.468+0000 7f85b3600640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ac0c2170 con 0x7f85ac0c7170 2024-01-17T22:59:32.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.468+0000 7f85b3600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac0c2430 con 0x7f85ac0cccc0 2024-01-17T22:59:32.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.468+0000 7f0e95e00640 1 --2- 172.21.15.161:0/1619504802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e901518a0 0x7f0e9006ccd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0e80009870 tx=0x7f0e8001c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e89db1c16f8f272d server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.468+0000 7fa6e3e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa6e40c7170 0x7fa6e406b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38496/0 (socket says 172.21.15.161:38496) 2024-01-17T22:59:32.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.468+0000 7fa6e3e00640 1 -- 172.21.15.161:0/2885209492 learned_addr learned my addr 172.21.15.161:0/2885209492 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:32.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.472+0000 7f85b0c00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f85ac0cc8e0 0x7f85ac15e4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38512/0 (socket says 172.21.15.161:38512) 2024-01-17T22:59:32.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.472+0000 7f85b0c00640 1 -- 172.21.15.161:0/1668196885 learned_addr learned my addr 172.21.15.161:0/1668196885 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:32.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.472+0000 7f03f0800640 1 Processor -- start 2024-01-17T22:59:32.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.472+0000 7f03f0800640 1 -- start start 2024-01-17T22:59:32.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.472+0000 7fa6e3400640 1 -- 172.21.15.161:0/2885209492 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67553791 0 0) 0x7fa6e4159760 con 0x7fa6e40c7170 2024-01-17T22:59:32.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.472+0000 7fa6e3400640 1 -- 172.21.15.161:0/2885209492 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6c4003530 con 0x7fa6e40c7170 2024-01-17T22:59:32.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.472+0000 7f03f0800640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f03e80c7880 0x7f03e8156590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.472+0000 7f03f0800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e815a610 con 0x7f03e80cb8a0 2024-01-17T22:59:32.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.472+0000 7f03f0800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e80c5770 con 0x7f03e80cbc80 2024-01-17T22:59:32.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.472+0000 7f03f0800640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e80c8050 con 0x7f03e80c7880 2024-01-17T22:59:32.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fa6e3400640 1 -- 172.21.15.161:0/2885209492 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3246483270 0 0) 0x7fa6c4003530 con 0x7fa6e40c7170 2024-01-17T22:59:32.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fa6e3400640 1 -- 172.21.15.161:0/2885209492 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6e406b840 msgr2=0x7fa6e40ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fa6e3400640 1 --2- 172.21.15.161:0/2885209492 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6e406b840 0x7fa6e40ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fa6e3400640 1 -- 172.21.15.161:0/2885209492 >> v2:172.21.15.190:3300/0 conn(0x7fa6e4153610 msgr2=0x7fa6e40cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fa6e3400640 1 --2- 172.21.15.161:0/2885209492 >> v2:172.21.15.190:3300/0 conn(0x7fa6e4153610 0x7fa6e40cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fa6e3400640 1 -- 172.21.15.161:0/2885209492 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e4159fc0 con 0x7fa6e40c7170 2024-01-17T22:59:32.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fa6e3400640 1 -- 172.21.15.161:0/2885209492 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7fa6cc001680 con 0x7fa6e40c7170 2024-01-17T22:59:32.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7f85ab400640 1 -- 172.21.15.161:0/1668196885 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185509585 0 0) 0x7f85ac0c2cd0 con 0x7f85ac0cc8e0 2024-01-17T22:59:32.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7f85ab400640 1 -- 172.21.15.161:0/1668196885 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f858c003530 con 0x7f85ac0cc8e0 2024-01-17T22:59:32.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fa6e3400640 1 -- 172.21.15.161:0/2885209492 >> v1:172.21.15.161:6789/0 conn(0x7fa6e40c7170 legacy=0x7fa6e406b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fa6e3400640 1 --2- 172.21.15.161:0/2885209492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6c4003980 0x7fa6c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fa6e3400640 1 --2- 172.21.15.161:0/2885209492 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6e406b840 0x7fa6c40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fa6e3400640 1 --2- 172.21.15.161:0/2885209492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6c4004d60 0x7fa6c40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fa6e3400640 1 -- 172.21.15.161:0/2885209492 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e4159a00 con 0x7fa6c4004d60 2024-01-17T22:59:32.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fa6e3400640 1 -- 172.21.15.161:0/2885209492 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e4159ce0 con 0x7fa6c4003980 2024-01-17T22:59:32.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fa6e3400640 1 -- 172.21.15.161:0/2885209492 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c400bbf0 con 0x7fa6e406b840 2024-01-17T22:59:32.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fd46d600640 1 -- 172.21.15.161:0/2997439021 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4580a9400 con 0x7fd470153630 2024-01-17T22:59:32.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fd46d600640 1 -- 172.21.15.161:0/2997439021 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4580a9560 con 0x7fd470153630 2024-01-17T22:59:32.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fd46d600640 1 -- 172.21.15.161:0/2997439021 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4580a98f0 con 0x7fd470153630 2024-01-17T22:59:32.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7f03ede00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f03e80cb8a0 0x7f03e80c5060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38516/0 (socket says 172.21.15.161:38516) 2024-01-17T22:59:32.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7f03ede00640 1 -- 172.21.15.161:0/2802121934 learned_addr learned my addr 172.21.15.161:0/2802121934 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:32.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fd46fe00640 1 -- 172.21.15.161:0/2997439021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470153630 msgr2=0x7fd47006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fd46fe00640 1 --2- 172.21.15.161:0/2997439021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470153630 0x7fd47006dc40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd458009870 tx=0x7fd45801c560 comp rx=0 tx=0).stop 2024-01-17T22:59:32.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fd46fe00640 1 -- 172.21.15.161:0/2997439021 shutdown_connections 2024-01-17T22:59:32.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fd46fe00640 1 --2- 172.21.15.161:0/2997439021 >> v2:172.21.15.161:3300/0 conn(0x7fd470159f90 0x7fd47006c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fd46fe00640 1 --2- 172.21.15.161:0/2997439021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470153630 0x7fd47006dc40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fd46fe00640 1 -- 172.21.15.161:0/2997439021 >> 172.21.15.161:0/2997439021 conn(0x7fd4700c7a90 msgr2=0x7fd4700c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fd46fe00640 1 -- 172.21.15.161:0/2997439021 shutdown_connections 2024-01-17T22:59:32.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fd46fe00640 1 -- 172.21.15.161:0/2997439021 wait complete. 2024-01-17T22:59:32.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.480+0000 7fa6ea400640 1 --2- 172.21.15.161:0/2885209492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6c4004d60 0x7fa6c40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7fd46fe00640 1 Processor -- start 2024-01-17T22:59:32.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7fd46fe00640 1 -- start start 2024-01-17T22:59:32.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7fd46fe00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd47006caa0 0x7fd47015b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7fd46fe00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470153630 0x7fd4700c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7fd46fe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd470159f90 0x7fd470146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7fd46fe00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47014e110 con 0x7fd470159f90 2024-01-17T22:59:32.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7fd46fe00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd470152150 con 0x7fd47006caa0 2024-01-17T22:59:32.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7fd46fe00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd470151bf0 con 0x7fd470153630 2024-01-17T22:59:32.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7f0e94a00640 1 -- 172.21.15.161:0/1619504802 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800ab5f0 con 0x7f0e901518a0 2024-01-17T22:59:32.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7f0e94a00640 1 -- 172.21.15.161:0/1619504802 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e800ab750 con 0x7f0e901518a0 2024-01-17T22:59:32.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7f0e94a00640 1 -- 172.21.15.161:0/1619504802 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800abae0 con 0x7f0e901518a0 2024-01-17T22:59:32.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7f03eca00640 1 -- 172.21.15.161:0/2802121934 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951237759 0 0) 0x7f03e815a610 con 0x7f03e80cb8a0 2024-01-17T22:59:32.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7f03eca00640 1 -- 172.21.15.161:0/2802121934 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c8003530 con 0x7f03e80cb8a0 2024-01-17T22:59:32.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7f0e98800640 1 -- 172.21.15.161:0/1619504802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e901518a0 msgr2=0x7f0e9006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7f0e98800640 1 --2- 172.21.15.161:0/1619504802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e901518a0 0x7f0e9006ccd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0e80009870 tx=0x7f0e8001c500 comp rx=0 tx=0).stop 2024-01-17T22:59:32.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7f0e98800640 1 -- 172.21.15.161:0/1619504802 shutdown_connections 2024-01-17T22:59:32.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7f0e98800640 1 --2- 172.21.15.161:0/1619504802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e901518a0 0x7f0e9006ccd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7f0e98800640 1 -- 172.21.15.161:0/1619504802 >> 172.21.15.161:0/1619504802 conn(0x7f0e900cb070 msgr2=0x7f0e900cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7f0e98800640 1 -- 172.21.15.161:0/1619504802 shutdown_connections 2024-01-17T22:59:32.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.484+0000 7f0e98800640 1 -- 172.21.15.161:0/1619504802 wait complete. 2024-01-17T22:59:32.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.488+0000 7f7fe3400640 1 --2- 172.21.15.161:0/195298936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc0467e0 0x7f7fdc04ba70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4072ff0 tx=0x7f7fe4099d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d5b522f9775662d server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.488+0000 7f0e98800640 1 Processor -- start 2024-01-17T22:59:32.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.488+0000 7f6f37400640 1 -- 172.21.15.161:0/1333689723 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f200ab680 con 0x7f6f38153630 2024-01-17T22:59:32.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.488+0000 7f6f37400640 1 -- 172.21.15.161:0/1333689723 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f200ab7e0 con 0x7f6f38153630 2024-01-17T22:59:32.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.488+0000 7f6f37400640 1 -- 172.21.15.161:0/1333689723 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f200abb70 con 0x7f6f38153630 2024-01-17T22:59:32.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.488+0000 7f6f3e400640 1 -- 172.21.15.161:0/1333689723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f38153630 msgr2=0x7f6f3806dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.488+0000 7f6f3e400640 1 --2- 172.21.15.161:0/1333689723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f38153630 0x7f6f3806dc40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6f200097c0 tx=0x7f6f2001c4c0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.488+0000 7f0e98800640 1 -- start start 2024-01-17T22:59:32.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.488+0000 7f6f3e400640 1 -- 172.21.15.161:0/1333689723 shutdown_connections 2024-01-17T22:59:32.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.488+0000 7f6f3e400640 1 --2- 172.21.15.161:0/1333689723 >> v2:172.21.15.161:3300/0 conn(0x7f6f38159f90 0x7f6f3806c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.488+0000 7f6f3e400640 1 --2- 172.21.15.161:0/1333689723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f38153630 0x7f6f3806dc40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.488+0000 7f6f3e400640 1 -- 172.21.15.161:0/1333689723 >> 172.21.15.161:0/1333689723 conn(0x7f6f380c7a90 msgr2=0x7f6f380c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.488+0000 7f6f3e400640 1 -- 172.21.15.161:0/1333689723 shutdown_connections 2024-01-17T22:59:32.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.488+0000 7f6f3e400640 1 -- 172.21.15.161:0/1333689723 wait complete. 2024-01-17T22:59:32.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.488+0000 7f0e98800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9006d210 0x7f0e90159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.488+0000 7f0e98800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e90072300 0x7f0e90154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.488+0000 7f0e98800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e901518a0 0x7f0e901fa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f0e98800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e90152ac0 con 0x7f0e9006d210 2024-01-17T22:59:32.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f0e98800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e90152440 con 0x7f0e90072300 2024-01-17T22:59:32.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f0e98800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e90154370 con 0x7f0e901518a0 2024-01-17T22:59:32.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f6f3e400640 1 Processor -- start 2024-01-17T22:59:32.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f6f3e400640 1 -- start start 2024-01-17T22:59:32.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7fa6ea400640 1 -- 172.21.15.161:0/2885209492 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6e406b840 msgr2=0x7fa6c40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7fa6ea400640 1 --2- 172.21.15.161:0/2885209492 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6e406b840 0x7fa6c40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7fa6ea400640 1 -- 172.21.15.161:0/2885209492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6c4003980 msgr2=0x7fa6c4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7fa6ea400640 1 --2- 172.21.15.161:0/2885209492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6c4003980 0x7fa6c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7fa6ea400640 1 -- 172.21.15.161:0/2885209492 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e4159fc0 con 0x7fa6c4004d60 2024-01-17T22:59:32.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f6f3e400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f3806caa0 0x7f6f380ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f6f3e400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f38153630 0x7f6f38148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f6f3e400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f38159f90 0x7f6f381428e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f6f3e400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f38149b50 con 0x7f6f3806caa0 2024-01-17T22:59:32.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f6f3e400640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3815c720 con 0x7f6f38153630 2024-01-17T22:59:32.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f6f3e400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3815c9c0 con 0x7f6f38159f90 2024-01-17T22:59:32.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f85ab400640 1 -- 172.21.15.161:0/1668196885 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1734748381 0 0) 0x7f858c003530 con 0x7f85ac0cc8e0 2024-01-17T22:59:32.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f85ab400640 1 -- 172.21.15.161:0/1668196885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85ac0cccc0 msgr2=0x7f85ac157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f85ab400640 1 --2- 172.21.15.161:0/1668196885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85ac0cccc0 0x7f85ac157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f85ab400640 1 -- 172.21.15.161:0/1668196885 >> v1:172.21.15.190:6789/0 conn(0x7f85ac0c7170 legacy=0x7f85ac06b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f85ab400640 1 -- 172.21.15.161:0/1668196885 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac0c2710 con 0x7f85ac0cc8e0 2024-01-17T22:59:32.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f85ab400640 1 -- 172.21.15.161:0/1668196885 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f859c001680 con 0x7f85ac0cc8e0 2024-01-17T22:59:32.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f85ab400640 1 -- 172.21.15.161:0/1668196885 >> v1:172.21.15.161:6789/0 conn(0x7f85ac0cc8e0 legacy=0x7f85ac15e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f85ab400640 1 --2- 172.21.15.161:0/1668196885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f858c0039b0 0x7f858c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f85ab400640 1 --2- 172.21.15.161:0/1668196885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f858c0047d0 0x7f858c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f85ab400640 1 --2- 172.21.15.161:0/1668196885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f858c0051e0 0x7f858c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f85ab400640 1 -- 172.21.15.161:0/1668196885 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac0c2430 con 0x7f858c0051e0 2024-01-17T22:59:32.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f85ab400640 1 -- 172.21.15.161:0/1668196885 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c00c120 con 0x7f858c0047d0 2024-01-17T22:59:32.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.492+0000 7f85ab400640 1 -- 172.21.15.161:0/1668196885 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c00c2e0 con 0x7f858c0039b0 2024-01-17T22:59:32.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.496+0000 7fd46f400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd470159f90 0x7fd470146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.500+0000 7fd46f400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd470159f90 0x7fd470146810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60290/0 (socket says 172.21.15.161:60290) 2024-01-17T22:59:32.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.500+0000 7fd46f400640 1 -- 172.21.15.161:0/3627181561 learned_addr learned my addr 172.21.15.161:0/3627181561 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:32.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.500+0000 7f7fe1600640 1 -- 172.21.15.161:0/195298936 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4123a10 con 0x7f7fdc0467e0 2024-01-17T22:59:32.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.500+0000 7f7fe1600640 1 -- 172.21.15.161:0/195298936 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe4123b70 con 0x7f7fdc0467e0 2024-01-17T22:59:32.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.500+0000 7f7fe1600640 1 -- 172.21.15.161:0/195298936 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe412b440 con 0x7f7fdc0467e0 2024-01-17T22:59:32.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.500+0000 7fd46e000640 1 --2- 172.21.15.161:0/3627181561 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470153630 0x7fd4700c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.500+0000 7f7fe9800640 1 -- 172.21.15.161:0/195298936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc0467e0 msgr2=0x7f7fdc04ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.500+0000 7f7fe9800640 1 --2- 172.21.15.161:0/195298936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc0467e0 0x7f7fdc04ba70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4072ff0 tx=0x7f7fe4099d70 comp rx=0 tx=0).stop 2024-01-17T22:59:32.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.500+0000 7f7fe9800640 1 -- 172.21.15.161:0/195298936 shutdown_connections 2024-01-17T22:59:32.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.500+0000 7f7fe9800640 1 --2- 172.21.15.161:0/195298936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc0467e0 0x7f7fdc04ba70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.500+0000 7f7fe9800640 1 --2- 172.21.15.161:0/195298936 >> v2:172.21.15.161:3300/0 conn(0x7f7fdc0e71f0 0x7f7fdc0462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.500+0000 7f7fe9800640 1 -- 172.21.15.161:0/195298936 >> 172.21.15.161:0/195298936 conn(0x7f7fdc050190 msgr2=0x7f7fdc0505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.500+0000 7f0e95e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9006d210 0x7f0e90159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.500+0000 7f7fe9800640 1 -- 172.21.15.161:0/195298936 shutdown_connections 2024-01-17T22:59:32.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.500+0000 7f7fe9800640 1 -- 172.21.15.161:0/195298936 wait complete. 2024-01-17T22:59:32.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.500+0000 7f6f3d000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f3806caa0 0x7f6f380ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.500+0000 7f0e95e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9006d210 0x7f0e90159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60302/0 (socket says 172.21.15.161:60302) 2024-01-17T22:59:32.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.500+0000 7f0e95e00640 1 -- 172.21.15.161:0/382212488 learned_addr learned my addr 172.21.15.161:0/382212488 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:32.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.504+0000 7f7fe9800640 1 Processor -- start 2024-01-17T22:59:32.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.504+0000 7f7fe9800640 1 -- start start 2024-01-17T22:59:32.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.504+0000 7f7fe9800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc0467e0 0x7f7fdc0da950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.504+0000 7f7fe9800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fdc0dd2c0 0x7f7fdc179170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.504+0000 7f7fe9800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fdc0e71f0 0x7f7fdc1796b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.504+0000 7f7fe9800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc0e61d0 con 0x7f7fdc0e71f0 2024-01-17T22:59:32.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.504+0000 7f7fe9800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc04a460 con 0x7f7fdc0467e0 2024-01-17T22:59:32.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.504+0000 7f7fe9800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc0e5c30 con 0x7f7fdc0dd2c0 2024-01-17T22:59:32.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.504+0000 7f03ed400640 1 --2- 172.21.15.161:0/2802121934 >> v2:172.21.15.190:3300/0 conn(0x7f03e80c7880 0x7f03e8156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.504+0000 7f0e96800640 1 --2- 172.21.15.161:0/382212488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e901518a0 0x7f0e901fa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.508+0000 7fd46f400640 1 -- 172.21.15.161:0/3627181561 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470153630 msgr2=0x7fd4700c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.508+0000 7fd46f400640 1 --2- 172.21.15.161:0/3627181561 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470153630 0x7fd4700c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.508+0000 7fd46f400640 1 -- 172.21.15.161:0/3627181561 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd47006caa0 msgr2=0x7fd47015b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.508+0000 7fd46f400640 1 --2- 172.21.15.161:0/3627181561 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd47006caa0 0x7fd47015b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.508+0000 7fd46f400640 1 -- 172.21.15.161:0/3627181561 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4580094d0 con 0x7fd470159f90 2024-01-17T22:59:32.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.508+0000 7f6f3d000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f3806caa0 0x7f6f380ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60310/0 (socket says 172.21.15.161:60310) 2024-01-17T22:59:32.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.508+0000 7f6f3d000640 1 -- 172.21.15.161:0/2790797593 learned_addr learned my addr 172.21.15.161:0/2790797593 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:32.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.512+0000 7f0e95e00640 1 -- 172.21.15.161:0/382212488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e901518a0 msgr2=0x7f0e901fa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.512+0000 7f0e95e00640 1 --2- 172.21.15.161:0/382212488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e901518a0 0x7f0e901fa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.512+0000 7f0e95e00640 1 -- 172.21.15.161:0/382212488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e90072300 msgr2=0x7f0e90154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.512+0000 7f0e95e00640 1 --2- 172.21.15.161:0/382212488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e90072300 0x7f0e90154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.512+0000 7f0e95e00640 1 -- 172.21.15.161:0/382212488 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e800094d0 con 0x7f0e9006d210 2024-01-17T22:59:32.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.512+0000 7f69b6000640 1 Processor -- start 2024-01-17T22:59:32.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.512+0000 7f69b6000640 1 -- start start 2024-01-17T22:59:32.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.512+0000 7f69b6000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f69b00c3bc0 0x7f69b015e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.512+0000 7f69b6000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69b00c3fa0 0x7f69b00ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.512+0000 7f69b6000640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b01611c0 con 0x7f69b0061100 2024-01-17T22:59:32.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.512+0000 7f69b6000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b00c7cd0 con 0x7f69b00c3bc0 2024-01-17T22:59:32.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.512+0000 7f69b6000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b01613f0 con 0x7f69b00c3fa0 2024-01-17T22:59:32.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.516+0000 7f6f3d000640 1 -- 172.21.15.161:0/2790797593 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f38159f90 msgr2=0x7f6f381428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.516+0000 7f6f3d000640 1 --2- 172.21.15.161:0/2790797593 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f38159f90 0x7f6f381428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.516+0000 7f6f3d000640 1 -- 172.21.15.161:0/2790797593 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f38153630 msgr2=0x7f6f38148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.516+0000 7f6f3d000640 1 --2- 172.21.15.161:0/2790797593 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f38153630 0x7f6f38148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.516+0000 7f6f3d000640 1 -- 172.21.15.161:0/2790797593 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f20009420 con 0x7f6f3806caa0 2024-01-17T22:59:32.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.520+0000 7f03ed400640 1 -- 172.21.15.161:0/2802121934 >> v1:172.21.15.190:6789/0 conn(0x7f03e80cbc80 legacy=0x7f03e8150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.520+0000 7f03ed400640 1 -- 172.21.15.161:0/2802121934 >> v1:172.21.15.161:6789/0 conn(0x7f03e80cb8a0 legacy=0x7f03e80c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.520+0000 7f03ed400640 1 -- 172.21.15.161:0/2802121934 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e8159d20 con 0x7f03e80c7880 2024-01-17T22:59:32.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.520+0000 7f0e95e00640 1 --2- 172.21.15.161:0/382212488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9006d210 0x7f0e90159b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0e800ad040 tx=0x7f0e8001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.520+0000 7fd46f400640 1 --2- 172.21.15.161:0/3627181561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd470159f90 0x7fd470146810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd46000c390 tx=0x7fd46000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.524+0000 7f85b0c00640 1 --2- 172.21.15.161:0/1668196885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f858c0039b0 0x7f858c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.528+0000 7f85abe00640 1 --2- 172.21.15.161:0/1668196885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f858c0047d0 0x7f858c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.528+0000 7f85b2000640 1 --2- 172.21.15.161:0/1668196885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f858c0051e0 0x7f858c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.528+0000 7f6f3d000640 1 --2- 172.21.15.161:0/2790797593 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f3806caa0 0x7f6f380ca170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6f200ad040 tx=0x7f6f2001ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.532+0000 7f85b2000640 1 -- 172.21.15.161:0/1668196885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f858c0039b0 msgr2=0x7f858c003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.532+0000 7f85b2000640 1 --2- 172.21.15.161:0/1668196885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f858c0039b0 0x7f858c003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.532+0000 7f85b2000640 1 -- 172.21.15.161:0/1668196885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f858c0047d0 msgr2=0x7f858c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.532+0000 7f85b2000640 1 --2- 172.21.15.161:0/1668196885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f858c0047d0 0x7f858c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.532+0000 7f85b2000640 1 -- 172.21.15.161:0/1668196885 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac0c2710 con 0x7f858c0051e0 2024-01-17T22:59:32.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.532+0000 7f03ed400640 1 --2- 172.21.15.161:0/2802121934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03e80c7880 0x7f03e8156590 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f03d00097c0 tx=0x7f03d001c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82d02ece582698c server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.536+0000 7f7fe3400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fdc0e71f0 0x7f7fdc1796b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.536+0000 7fa6ea400640 1 --2- 172.21.15.161:0/2885209492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6c4004d60 0x7fa6c40051e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc009ca0 tx=0x7fa6dc01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c516bdea1bc4fe4b server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.536+0000 7f7fe3400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fdc0e71f0 0x7f7fdc1796b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60330/0 (socket says 172.21.15.161:60330) 2024-01-17T22:59:32.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.536+0000 7f7fe3400640 1 -- 172.21.15.161:0/4090041430 learned_addr learned my addr 172.21.15.161:0/4090041430 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:32.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.536+0000 7f85b2000640 1 --2- 172.21.15.161:0/1668196885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f858c0051e0 0x7f858c00b990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f85ac08b3b0 tx=0x7f85a401c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e6b3a4449ed928 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.544+0000 7f7fe2a00640 1 --2- 172.21.15.161:0/4090041430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc0467e0 0x7f7fdc0da950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.544+0000 7f0e8e000640 1 -- 172.21.15.161:0/382212488 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800b4800 con 0x7f0e9006d210 2024-01-17T22:59:32.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.544+0000 7f0e8e000640 1 -- 172.21.15.161:0/382212488 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e800b4960 con 0x7f0e9006d210 2024-01-17T22:59:32.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.544+0000 7f0e8e000640 1 -- 172.21.15.161:0/382212488 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800b4cf0 con 0x7f0e9006d210 2024-01-17T22:59:32.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.544+0000 7f0e98800640 1 -- 172.21.15.161:0/382212488 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e90162e20 con 0x7f0e9006d210 2024-01-17T22:59:32.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.544+0000 7f0e98800640 1 -- 172.21.15.161:0/382212488 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9015a6c0 con 0x7f0e9006d210 2024-01-17T22:59:32.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.544+0000 7f0e98800640 1 -- 172.21.15.161:0/382212488 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0e9006e480 con 0x7f0e9006d210 2024-01-17T22:59:32.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.544+0000 7f7fe2000640 1 --2- 172.21.15.161:0/4090041430 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fdc0dd2c0 0x7f7fdc179170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.544+0000 7f7fe3400640 1 -- 172.21.15.161:0/4090041430 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fdc0dd2c0 msgr2=0x7f7fdc179170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.544+0000 7f7fe3400640 1 --2- 172.21.15.161:0/4090041430 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fdc0dd2c0 0x7f7fdc179170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.544+0000 7f7fe3400640 1 -- 172.21.15.161:0/4090041430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc0467e0 msgr2=0x7f7fdc0da950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.544+0000 7f7fe3400640 1 --2- 172.21.15.161:0/4090041430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc0467e0 0x7f7fdc0da950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.544+0000 7f7fe3400640 1 -- 172.21.15.161:0/4090041430 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4073bf0 con 0x7f7fdc0e71f0 2024-01-17T22:59:32.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7f69aea00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69b00c3fa0 0x7f69b00ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7fa6e3400640 1 -- 172.21.15.161:0/2885209492 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc0a5c60 con 0x7fa6c4004d60 2024-01-17T22:59:32.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7fa6e3400640 1 -- 172.21.15.161:0/2885209492 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc0a5de0 con 0x7fa6c4004d60 2024-01-17T22:59:32.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7fa6e3400640 1 -- 172.21.15.161:0/2885209492 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc0ad680 con 0x7fa6c4004d60 2024-01-17T22:59:32.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7f69aea00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69b00c3fa0 0x7f69b00ca410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:40026/0 (socket says 172.21.15.161:40026) 2024-01-17T22:59:32.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7f69aea00640 1 -- 172.21.15.161:0/206851888 learned_addr learned my addr 172.21.15.161:0/206851888 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:32.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7fd467400640 1 -- 172.21.15.161:0/3627181561 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4600052d0 con 0x7fd470159f90 2024-01-17T22:59:32.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7fd467400640 1 -- 172.21.15.161:0/3627181561 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd460005430 con 0x7fd470159f90 2024-01-17T22:59:32.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7fd467400640 1 -- 172.21.15.161:0/3627181561 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd460007240 con 0x7fd470159f90 2024-01-17T22:59:32.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7fd46fe00640 1 -- 172.21.15.161:0/3627181561 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd470151e90 con 0x7fd470159f90 2024-01-17T22:59:32.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7fd46fe00640 1 -- 172.21.15.161:0/3627181561 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd470152530 con 0x7fd470159f90 2024-01-17T22:59:32.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7fa6eba00640 1 -- 172.21.15.161:0/2885209492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6c4004d60 msgr2=0x7fa6c40051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7fa6eba00640 1 --2- 172.21.15.161:0/2885209492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6c4004d60 0x7fa6c40051e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc009ca0 tx=0x7fa6dc01cc50 comp rx=0 tx=0).stop 2024-01-17T22:59:32.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7fa6ea400640 1 -- 172.21.15.161:0/2885209492 reap_dead start 2024-01-17T22:59:32.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7fa6eba00640 1 -- 172.21.15.161:0/2885209492 shutdown_connections 2024-01-17T22:59:32.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7fa6eba00640 1 -- 172.21.15.161:0/2885209492 >> 172.21.15.161:0/2885209492 conn(0x7fa6e4061100 msgr2=0x7fa6e406e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7fa6eba00640 1 -- 172.21.15.161:0/2885209492 shutdown_connections 2024-01-17T22:59:32.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7fa6eba00640 1 -- 172.21.15.161:0/2885209492 wait complete. 2024-01-17T22:59:32.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.548+0000 7fd46fe00640 1 -- 172.21.15.161:0/3627181561 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd47015d820 con 0x7fd470159f90 2024-01-17T22:59:32.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.552+0000 7fa6eba00640 1 Processor -- start 2024-01-17T22:59:32.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.552+0000 7fa6eba00640 1 -- start start 2024-01-17T22:59:32.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.552+0000 7fa6eba00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6c4004d60 0x7fa6e4159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.552+0000 7fa6eba00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6e40c67e0 0x7fa6e40c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.552+0000 7fa6eba00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6e415a810 0x7fa6e41f28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.552+0000 7fa6eba00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e41f35a0 con 0x7fa6c4004d60 2024-01-17T22:59:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.552+0000 7fa6eba00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e40c4c70 con 0x7fa6e40c67e0 2024-01-17T22:59:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.552+0000 7fa6eba00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e4147c40 con 0x7fa6e415a810 2024-01-17T22:59:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.556+0000 7f85ab400640 1 -- 172.21.15.161:0/1668196885 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4003ba0 con 0x7f858c0051e0 2024-01-17T22:59:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.556+0000 7f85ab400640 1 -- 172.21.15.161:0/1668196885 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a4003d00 con 0x7f858c0051e0 2024-01-17T22:59:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.556+0000 7f85ab400640 1 -- 172.21.15.161:0/1668196885 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4005290 con 0x7f858c0051e0 2024-01-17T22:59:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.556+0000 7f7fe3400640 1 --2- 172.21.15.161:0/4090041430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fdc0e71f0 0x7f7fdc1796b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4068800 tx=0x7f7fe4096b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.556+0000 7f85b3600640 1 -- 172.21.15.161:0/1668196885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f858c0051e0 msgr2=0x7f858c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.556+0000 7f85b3600640 1 --2- 172.21.15.161:0/1668196885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f858c0051e0 0x7f858c00b990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f85ac08b3b0 tx=0x7f85a401c660 comp rx=0 tx=0).stop 2024-01-17T22:59:32.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.556+0000 7f85b2000640 1 -- 172.21.15.161:0/1668196885 reap_dead start 2024-01-17T22:59:32.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.556+0000 7f85b3600640 1 -- 172.21.15.161:0/1668196885 shutdown_connections 2024-01-17T22:59:32.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.556+0000 7f85b3600640 1 -- 172.21.15.161:0/1668196885 >> 172.21.15.161:0/1668196885 conn(0x7f85ac061100 msgr2=0x7f85ac06e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.556+0000 7f85b3600640 1 -- 172.21.15.161:0/1668196885 shutdown_connections 2024-01-17T22:59:32.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.556+0000 7f85b3600640 1 -- 172.21.15.161:0/1668196885 wait complete. 2024-01-17T22:59:32.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.556+0000 7f85b3600640 1 Processor -- start 2024-01-17T22:59:32.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.556+0000 7f85b3600640 1 -- start start 2024-01-17T22:59:32.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f69aea00640 1 -- 172.21.15.161:0/206851888 >> v2:172.21.15.161:3300/0 conn(0x7f69b00c3bc0 msgr2=0x7f69b015e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f69aea00640 1 --2- 172.21.15.161:0/206851888 >> v2:172.21.15.161:3300/0 conn(0x7f69b00c3bc0 0x7f69b015e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f69aea00640 1 -- 172.21.15.161:0/206851888 >> v1:172.21.15.190:6789/0 conn(0x7f69b0061100 legacy=0x7f69b006bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f69aea00640 1 -- 172.21.15.161:0/206851888 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b0161690 con 0x7f69b00c3fa0 2024-01-17T22:59:32.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f85b3600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f858c0051e0 0x7f85ac157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f85b3600640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85ac0c4e10 0x7f85ac0c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f85b3600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85ac153580 0x7f85ac1539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f85b3600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac153f20 con 0x7f85ac153580 2024-01-17T22:59:32.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f85b3600640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac1f3900 con 0x7f85ac0c4e10 2024-01-17T22:59:32.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f85b3600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac0c5d10 con 0x7f858c0051e0 2024-01-17T22:59:32.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f03eca00640 1 -- 172.21.15.161:0/2802121934 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d00ab600 con 0x7f03e80c7880 2024-01-17T22:59:32.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f03eca00640 1 -- 172.21.15.161:0/2802121934 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d00a7050 con 0x7f03e80c7880 2024-01-17T22:59:32.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f03eca00640 1 -- 172.21.15.161:0/2802121934 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d00ab980 con 0x7f03e80c7880 2024-01-17T22:59:32.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7fa6ea400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6e415a810 0x7fa6e41f28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f03f0800640 1 -- 172.21.15.161:0/2802121934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03e80c7880 msgr2=0x7f03e8156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f03f0800640 1 --2- 172.21.15.161:0/2802121934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03e80c7880 0x7f03e8156590 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f03d00097c0 tx=0x7f03d001c440 comp rx=0 tx=0).stop 2024-01-17T22:59:32.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f03f0800640 1 -- 172.21.15.161:0/2802121934 shutdown_connections 2024-01-17T22:59:32.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f03f0800640 1 --2- 172.21.15.161:0/2802121934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03e80c7880 0x7f03e8156590 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f03f0800640 1 -- 172.21.15.161:0/2802121934 >> 172.21.15.161:0/2802121934 conn(0x7f03e806e070 msgr2=0x7f03e806e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f03f0800640 1 -- 172.21.15.161:0/2802121934 shutdown_connections 2024-01-17T22:59:32.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7f03f0800640 1 -- 172.21.15.161:0/2802121934 wait complete. 2024-01-17T22:59:32.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.560+0000 7fa6ea400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6e415a810 0x7fa6e41f28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:40028/0 (socket says 172.21.15.161:40028) 2024-01-17T22:59:32.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.564+0000 7fa6ea400640 1 -- 172.21.15.161:0/1167937414 learned_addr learned my addr 172.21.15.161:0/1167937414 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:32.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.564+0000 7f03f0800640 1 Processor -- start 2024-01-17T22:59:32.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.564+0000 7f03f0800640 1 -- start start 2024-01-17T22:59:32.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.564+0000 7f03f0800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03e80c7880 0x7f03e80c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.564+0000 7f03f0800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03e80cb8a0 0x7f03e81f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.564+0000 7f03f0800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03e80cbc80 0x7f03e81f2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.564+0000 7f03f0800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e815fc00 con 0x7f03e80c7880 2024-01-17T22:59:32.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.564+0000 7f03f0800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e815fee0 con 0x7f03e80cb8a0 2024-01-17T22:59:32.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.564+0000 7f03f0800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e81546b0 con 0x7f03e80cbc80 2024-01-17T22:59:32.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.568+0000 7f69aea00640 1 --2- 172.21.15.161:0/206851888 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69b00c3fa0 0x7f69b00ca410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6998009870 tx=0x7f699801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5b0bf60570828e5 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.576+0000 7fa6e3e00640 1 --2- 172.21.15.161:0/1167937414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6e40c67e0 0x7fa6e40c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.580+0000 7f85abe00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85ac0c4e10 0x7f85ac0c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.580+0000 7f85abe00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85ac0c4e10 0x7f85ac0c5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:49418/0 (socket says 172.21.15.161:49418) 2024-01-17T22:59:32.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.580+0000 7f85abe00640 1 -- 172.21.15.161:0/566860852 learned_addr learned my addr 172.21.15.161:0/566860852 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:32.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.584+0000 7fa6ea400640 1 -- 172.21.15.161:0/1167937414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6e40c67e0 msgr2=0x7fa6e40c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.584+0000 7fa6ea400640 1 --2- 172.21.15.161:0/1167937414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6e40c67e0 0x7fa6e40c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.584+0000 7fa6ea400640 1 -- 172.21.15.161:0/1167937414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6c4004d60 msgr2=0x7fa6e4159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.584+0000 7fa6ea400640 1 --2- 172.21.15.161:0/1167937414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6c4004d60 0x7fa6e4159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.584+0000 7fa6ea400640 1 -- 172.21.15.161:0/1167937414 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e415ac90 con 0x7fa6e415a810 2024-01-17T22:59:32.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.588+0000 7fd467400640 1 -- 172.21.15.161:0/3627181561 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fd4600073a0 con 0x7fd470159f90 2024-01-17T22:59:32.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7fd467400640 1 --2- 172.21.15.161:0/3627181561 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fd448066890 0x7fd448068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7fd46ea00640 1 --2- 172.21.15.161:0/3627181561 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fd448066890 0x7fd448068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7fd46ea00640 1 --2- 172.21.15.161:0/3627181561 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fd448066890 0x7fd448068d50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd4580ae000 tx=0x7fd458008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f85abe00640 1 -- 172.21.15.161:0/566860852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f858c0051e0 msgr2=0x7f85ac157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f85abe00640 1 --2- 172.21.15.161:0/566860852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f858c0051e0 0x7f85ac157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f85abe00640 1 -- 172.21.15.161:0/566860852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85ac153580 msgr2=0x7f85ac1539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f85abe00640 1 --2- 172.21.15.161:0/566860852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85ac153580 0x7f85ac1539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f85abe00640 1 -- 172.21.15.161:0/566860852 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac1f3640 con 0x7f85ac0c4e10 2024-01-17T22:59:32.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f69ae000640 1 -- 172.21.15.161:0/206851888 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69980ac600 con 0x7f69b00c3fa0 2024-01-17T22:59:32.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f69ae000640 1 -- 172.21.15.161:0/206851888 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69980a8050 con 0x7f69b00c3fa0 2024-01-17T22:59:32.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f69ae000640 1 -- 172.21.15.161:0/206851888 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69980ac980 con 0x7f69b00c3fa0 2024-01-17T22:59:32.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f69b6000640 1 -- 172.21.15.161:0/206851888 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69b00c3fa0 msgr2=0x7f69b00ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f69b6000640 1 --2- 172.21.15.161:0/206851888 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69b00c3fa0 0x7f69b00ca410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6998009870 tx=0x7f699801c3e0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f69b6000640 1 -- 172.21.15.161:0/206851888 shutdown_connections 2024-01-17T22:59:32.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f69b6000640 1 --2- 172.21.15.161:0/206851888 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69b00c3fa0 0x7f69b00ca410 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f69b6000640 1 --2- 172.21.15.161:0/206851888 >> v2:172.21.15.161:3300/0 conn(0x7f69b00c3bc0 0x7f69b015e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f69b6000640 1 -- 172.21.15.161:0/206851888 >> 172.21.15.161:0/206851888 conn(0x7f69b006ad40 msgr2=0x7f69b006f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f69b6000640 1 -- 172.21.15.161:0/206851888 shutdown_connections 2024-01-17T22:59:32.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f69b6000640 1 -- 172.21.15.161:0/206851888 wait complete. 2024-01-17T22:59:32.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7fd467400640 1 -- 172.21.15.161:0/3627181561 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fd460007650 con 0x7fd470159f90 2024-01-17T22:59:32.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7fd467400640 1 --2- 172.21.15.161:0/3627181561 >> [v2:172.21.15.190:6816/3551605927,v1:172.21.15.190:6817/3551605927] conn(0x7fd44806fff0 0x7fd448072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7fd467400640 1 -- 172.21.15.161:0/3627181561 --> [v2:172.21.15.190:6816/3551605927,v1:172.21.15.190:6817/3551605927] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd448072b60 con 0x7fd44806fff0 2024-01-17T22:59:32.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7fd467400640 1 -- 172.21.15.161:0/3627181561 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd460001090 con 0x7fd470159f90 2024-01-17T22:59:32.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f6f34c00640 1 -- 172.21.15.161:0/2790797593 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f200b58d0 con 0x7f6f3806caa0 2024-01-17T22:59:32.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f6f34c00640 1 -- 172.21.15.161:0/2790797593 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f200b5a70 con 0x7f6f3806caa0 2024-01-17T22:59:32.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f6f34c00640 1 -- 172.21.15.161:0/2790797593 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f200b5e20 con 0x7f6f3806caa0 2024-01-17T22:59:32.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.592+0000 7f6f3e400640 1 -- 172.21.15.161:0/2790797593 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f38149870 con 0x7f6f3806caa0 2024-01-17T22:59:32.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.596+0000 7f6f3e400640 1 -- 172.21.15.161:0/2790797593 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f38147050 con 0x7f6f3806caa0 2024-01-17T22:59:32.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.596+0000 7fd46e000640 1 --2- 172.21.15.161:0/3627181561 >> [v2:172.21.15.190:6816/3551605927,v1:172.21.15.190:6817/3551605927] conn(0x7fd44806fff0 0x7fd448072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.596+0000 7f69b6000640 1 Processor -- start 2024-01-17T22:59:32.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.596+0000 7fd46e000640 1 --2- 172.21.15.161:0/3627181561 >> [v2:172.21.15.190:6816/3551605927,v1:172.21.15.190:6817/3551605927] conn(0x7fd44806fff0 0x7fd448072490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.596+0000 7f69b6000640 1 -- start start 2024-01-17T22:59:32.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.596+0000 7f6f2e000640 1 -- 172.21.15.161:0/2790797593 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6f3815d820 con 0x7f6f3806caa0 2024-01-17T22:59:32.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.596+0000 7f69b6000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69b0061100 0x7f69b01559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.596+0000 7f69b6000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69b00c3bc0 0x7f69b00cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.596+0000 7f69b6000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69b00c3fa0 0x7f69b00c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.596+0000 7f69b6000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b01584c0 con 0x7f69b0061100 2024-01-17T22:59:32.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.596+0000 7f69b6000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b01587a0 con 0x7f69b00c3bc0 2024-01-17T22:59:32.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.596+0000 7f69b6000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b0156550 con 0x7f69b00c3fa0 2024-01-17T22:59:32.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.596+0000 7fd467400640 1 -- 172.21.15.161:0/3627181561 <== osd.5 v2:172.21.15.190:6816/3551605927 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd448072b60 con 0x7fd44806fff0 2024-01-17T22:59:32.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.600+0000 7f03ed400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03e80cb8a0 0x7f03e81f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.604+0000 7f69afe00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69b00c3fa0 0x7f69b00c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.604+0000 7f03ee800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03e80cbc80 0x7f03e81f2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.604+0000 7fa6ea400640 1 --2- 172.21.15.161:0/1167937414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6e415a810 0x7fa6e41f28a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc01d130 tx=0x7fa6c4005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.608+0000 7f03ee800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03e80cbc80 0x7f03e81f2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:40048/0 (socket says 172.21.15.161:40048) 2024-01-17T22:59:32.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.608+0000 7f03ee800640 1 -- 172.21.15.161:0/2702885178 learned_addr learned my addr 172.21.15.161:0/2702885178 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:32.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.608+0000 7f69afe00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69b00c3fa0 0x7f69b00c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:40060/0 (socket says 172.21.15.161:40060) 2024-01-17T22:59:32.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.608+0000 7f69afe00640 1 -- 172.21.15.161:0/2029928246 learned_addr learned my addr 172.21.15.161:0/2029928246 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:32.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.612+0000 7f0e8e000640 1 -- 172.21.15.161:0/382212488 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f0e800c7390 con 0x7f0e9006d210 2024-01-17T22:59:32.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.612+0000 7fd46fe00640 1 -- 172.21.15.161:0/3627181561 --> [v2:172.21.15.190:6816/3551605927,v1:172.21.15.190:6817/3551605927] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd47015d540 con 0x7fd44806fff0 2024-01-17T22:59:32.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.612+0000 7f0e8e000640 1 --2- 172.21.15.161:0/382212488 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0e68066890 0x7f0e68068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.612+0000 7f0e95400640 1 --2- 172.21.15.161:0/382212488 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0e68066890 0x7f0e68068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.612+0000 7fd467400640 1 -- 172.21.15.161:0/3627181561 <== osd.5 v2:172.21.15.190:6816/3551605927 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd46800f040 con 0x7fd44806fff0 2024-01-17T22:59:32.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.616+0000 7f0e95400640 1 --2- 172.21.15.161:0/382212488 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0e68066890 0x7f0e68068d50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0e90157560 tx=0x7f0e78006bd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.616+0000 7fd46fe00640 1 -- 172.21.15.161:0/3627181561 >> [v2:172.21.15.190:6816/3551605927,v1:172.21.15.190:6817/3551605927] conn(0x7fd44806fff0 msgr2=0x7fd448072490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.616+0000 7fd46fe00640 1 --2- 172.21.15.161:0/3627181561 >> [v2:172.21.15.190:6816/3551605927,v1:172.21.15.190:6817/3551605927] conn(0x7fd44806fff0 0x7fd448072490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.616+0000 7fd46fe00640 1 -- 172.21.15.161:0/3627181561 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fd448066890 msgr2=0x7fd448068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.616+0000 7fd46fe00640 1 --2- 172.21.15.161:0/3627181561 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fd448066890 0x7fd448068d50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd4580ae000 tx=0x7fd458008040 comp rx=0 tx=0).stop 2024-01-17T22:59:32.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.616+0000 7fd46fe00640 1 -- 172.21.15.161:0/3627181561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd470159f90 msgr2=0x7fd470146810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.616+0000 7fd46fe00640 1 --2- 172.21.15.161:0/3627181561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd470159f90 0x7fd470146810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd46000c390 tx=0x7fd46000c850 comp rx=0 tx=0).stop 2024-01-17T22:59:32.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.616+0000 7fd46f400640 1 -- 172.21.15.161:0/3627181561 reap_dead start 2024-01-17T22:59:32.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.616+0000 7fd46fe00640 1 -- 172.21.15.161:0/3627181561 shutdown_connections 2024-01-17T22:59:32.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.616+0000 7fd46fe00640 1 -- 172.21.15.161:0/3627181561 >> 172.21.15.161:0/3627181561 conn(0x7fd4700c7a90 msgr2=0x7fd4700c7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.616+0000 7fd46fe00640 1 -- 172.21.15.161:0/3627181561 shutdown_connections 2024-01-17T22:59:32.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.616+0000 7fd46fe00640 1 -- 172.21.15.161:0/3627181561 wait complete. 2024-01-17T22:59:32.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.616+0000 7f85abe00640 1 --2- 172.21.15.161:0/566860852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85ac0c4e10 0x7f85ac0c5270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f859400d550 tx=0x7f859400da10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.620+0000 7f7fdaa00640 1 -- 172.21.15.161:0/4090041430 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe41239b0 con 0x7f7fdc0e71f0 2024-01-17T22:59:32.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.620+0000 7f7fdaa00640 1 -- 172.21.15.161:0/4090041430 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe4135410 con 0x7f7fdc0e71f0 2024-01-17T22:59:32.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.620+0000 7f7fdaa00640 1 -- 172.21.15.161:0/4090041430 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe41357c0 con 0x7f7fdc0e71f0 2024-01-17T22:59:32.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.620+0000 7f7fe9800640 1 -- 172.21.15.161:0/4090041430 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fdc0e5ef0 con 0x7f7fdc0e71f0 2024-01-17T22:59:32.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.624+0000 7f7fe9800640 1 -- 172.21.15.161:0/4090041430 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fdc04a180 con 0x7f7fdc0e71f0 2024-01-17T22:59:32.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.624+0000 7f7fe9800640 1 -- 172.21.15.161:0/4090041430 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7fdc045d80 con 0x7f7fdc0e71f0 2024-01-17T22:59:32.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.624+0000 7f0e8e000640 1 -- 172.21.15.161:0/382212488 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f0e800a8050 con 0x7f0e9006d210 2024-01-17T22:59:32.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.624+0000 7f0e8e000640 1 --2- 172.21.15.161:0/382212488 >> [v2:172.21.15.161:6810/3517914982,v1:172.21.15.161:6812/3517914982] conn(0x7f0e6806fff0 0x7f0e68072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.624+0000 7f0e8e000640 1 -- 172.21.15.161:0/382212488 --> [v2:172.21.15.161:6810/3517914982,v1:172.21.15.161:6812/3517914982] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e68072b60 con 0x7f0e6806fff0 2024-01-17T22:59:32.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.624+0000 7f0e8e000640 1 -- 172.21.15.161:0/382212488 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e800ebc40 con 0x7f0e9006d210 2024-01-17T22:59:32.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.624+0000 7f0e96800640 1 --2- 172.21.15.161:0/382212488 >> [v2:172.21.15.161:6810/3517914982,v1:172.21.15.161:6812/3517914982] conn(0x7f0e6806fff0 0x7f0e68072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.624+0000 7f0e96800640 1 --2- 172.21.15.161:0/382212488 >> [v2:172.21.15.161:6810/3517914982,v1:172.21.15.161:6812/3517914982] conn(0x7f0e6806fff0 0x7f0e68072490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.624+0000 7f0e8e000640 1 -- 172.21.15.161:0/382212488 <== osd.2 v2:172.21.15.161:6810/3517914982 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0e68072b60 con 0x7f0e6806fff0 2024-01-17T22:59:32.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.624+0000 7f03ede00640 1 --2- 172.21.15.161:0/2702885178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03e80c7880 0x7f03e80c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.632+0000 7f03ee800640 1 -- 172.21.15.161:0/2702885178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03e80cb8a0 msgr2=0x7f03e81f25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.632+0000 7f03ee800640 1 --2- 172.21.15.161:0/2702885178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03e80cb8a0 0x7f03e81f25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.632+0000 7f03ee800640 1 -- 172.21.15.161:0/2702885178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03e80c7880 msgr2=0x7f03e80c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.632+0000 7f03ee800640 1 --2- 172.21.15.161:0/2702885178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03e80c7880 0x7f03e80c6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.632+0000 7f03ee800640 1 -- 172.21.15.161:0/2702885178 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d0009420 con 0x7f03e80cbc80 2024-01-17T22:59:32.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.636+0000 7f69af400640 1 --2- 172.21.15.161:0/2029928246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69b0061100 0x7f69b01559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.636+0000 7f85a8c00640 1 -- 172.21.15.161:0/566860852 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8594014620 con 0x7f85ac0c4e10 2024-01-17T22:59:32.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.636+0000 7f85a8c00640 1 -- 172.21.15.161:0/566860852 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85940147a0 con 0x7f85ac0c4e10 2024-01-17T22:59:32.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.636+0000 7f85a8c00640 1 -- 172.21.15.161:0/566860852 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8594014b50 con 0x7f85ac0c4e10 2024-01-17T22:59:32.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.636+0000 7f85b3600640 1 -- 172.21.15.161:0/566860852 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ac0c3d70 con 0x7f85ac0c4e10 2024-01-17T22:59:32.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.636+0000 7f85b3600640 1 -- 172.21.15.161:0/566860852 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ac0c4330 con 0x7f85ac0c4e10 2024-01-17T22:59:32.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.636+0000 7f85b3600640 1 -- 172.21.15.161:0/566860852 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85ac15df40 con 0x7f85ac0c4e10 2024-01-17T22:59:32.636 INFO:teuthology.orchestra.run.smithi161.stdout:55834574867 2024-01-17T22:59:32.637 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-17T22:59:32.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.640+0000 7f69afe00640 1 -- 172.21.15.161:0/2029928246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69b00c3bc0 msgr2=0x7f69b00cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.640+0000 7f69afe00640 1 --2- 172.21.15.161:0/2029928246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69b00c3bc0 0x7f69b00cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.640+0000 7f69afe00640 1 -- 172.21.15.161:0/2029928246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69b0061100 msgr2=0x7f69b01559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.640+0000 7f69afe00640 1 --2- 172.21.15.161:0/2029928246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69b0061100 0x7f69b01559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.640+0000 7f69afe00640 1 -- 172.21.15.161:0/2029928246 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69980094d0 con 0x7f69b00c3fa0 2024-01-17T22:59:32.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.640+0000 7fa6e0c00640 1 -- 172.21.15.161:0/1167937414 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc0adb20 con 0x7fa6e415a810 2024-01-17T22:59:32.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.640+0000 7fa6e0c00640 1 -- 172.21.15.161:0/1167937414 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc0adca0 con 0x7fa6e415a810 2024-01-17T22:59:32.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.640+0000 7fa6e0c00640 1 -- 172.21.15.161:0/1167937414 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc003bc0 con 0x7fa6e415a810 2024-01-17T22:59:32.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.640+0000 7fa6eba00640 1 -- 172.21.15.161:0/1167937414 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e415d7e0 con 0x7fa6e415a810 2024-01-17T22:59:32.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.640+0000 7fa6eba00640 1 -- 172.21.15.161:0/1167937414 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e40c61b0 con 0x7fa6e415a810 2024-01-17T22:59:32.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.640+0000 7fa6eba00640 1 -- 172.21.15.161:0/1167937414 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6e406f480 con 0x7fa6e415a810 2024-01-17T22:59:32.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.640+0000 7f0e98800640 1 -- 172.21.15.161:0/382212488 --> [v2:172.21.15.161:6810/3517914982,v1:172.21.15.161:6812/3517914982] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0e90151c80 con 0x7f0e6806fff0 2024-01-17T22:59:32.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.644+0000 7f0e8e000640 1 -- 172.21.15.161:0/382212488 <== osd.2 v2:172.21.15.161:6810/3517914982 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0e88001870 con 0x7f0e6806fff0 2024-01-17T22:59:32.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.644+0000 7f0e98800640 1 -- 172.21.15.161:0/382212488 >> [v2:172.21.15.161:6810/3517914982,v1:172.21.15.161:6812/3517914982] conn(0x7f0e6806fff0 msgr2=0x7f0e68072490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.644+0000 7f0e98800640 1 --2- 172.21.15.161:0/382212488 >> [v2:172.21.15.161:6810/3517914982,v1:172.21.15.161:6812/3517914982] conn(0x7f0e6806fff0 0x7f0e68072490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.644+0000 7f0e98800640 1 -- 172.21.15.161:0/382212488 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0e68066890 msgr2=0x7f0e68068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.644+0000 7f0e98800640 1 --2- 172.21.15.161:0/382212488 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0e68066890 0x7f0e68068d50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0e90157560 tx=0x7f0e78006bd0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.644+0000 7f0e98800640 1 -- 172.21.15.161:0/382212488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9006d210 msgr2=0x7f0e90159b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.644+0000 7f0e98800640 1 --2- 172.21.15.161:0/382212488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9006d210 0x7f0e90159b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0e800ad040 tx=0x7f0e8001ad40 comp rx=0 tx=0).stop 2024-01-17T22:59:32.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.644+0000 7f0e96800640 1 -- 172.21.15.161:0/382212488 reap_dead start 2024-01-17T22:59:32.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.644+0000 7f0e98800640 1 -- 172.21.15.161:0/382212488 shutdown_connections 2024-01-17T22:59:32.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.644+0000 7f0e98800640 1 -- 172.21.15.161:0/382212488 >> 172.21.15.161:0/382212488 conn(0x7f0e900cb070 msgr2=0x7f0e90071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.644+0000 7f0e98800640 1 -- 172.21.15.161:0/382212488 shutdown_connections 2024-01-17T22:59:32.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.644+0000 7f0e98800640 1 -- 172.21.15.161:0/382212488 wait complete. 2024-01-17T22:59:32.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.656+0000 7f69afe00640 1 --2- 172.21.15.161:0/2029928246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69b00c3fa0 0x7f69b00c8520 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f69a800c7b0 tx=0x7f69a800cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.656+0000 7f6f34c00640 1 -- 172.21.15.161:0/2790797593 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f6f200c83f0 con 0x7f6f3806caa0 2024-01-17T22:59:32.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.660+0000 7f6f34c00640 1 --2- 172.21.15.161:0/2790797593 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6f10066890 0x7f6f10068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.660+0000 7f6f37e00640 1 --2- 172.21.15.161:0/2790797593 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6f10066890 0x7f6f10068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.660+0000 7f6f37e00640 1 --2- 172.21.15.161:0/2790797593 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6f10066890 0x7f6f10068d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6f3806e050 tx=0x7f6f28006ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.661 INFO:teuthology.orchestra.run.smithi161.stdout:64424509458 2024-01-17T22:59:32.661 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-17T22:59:32.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.664+0000 7f03ee800640 1 --2- 172.21.15.161:0/2702885178 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03e80cbc80 0x7f03e81f2b20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f03e000ba10 tx=0x7f03e000bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.664+0000 7f6f34c00640 1 -- 172.21.15.161:0/2790797593 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f6f200f0b40 con 0x7f6f3806caa0 2024-01-17T22:59:32.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.664+0000 7f6f34c00640 1 --2- 172.21.15.161:0/2790797593 >> [v2:172.21.15.161:6826/1566364308,v1:172.21.15.161:6827/1566364308] conn(0x7f6f1006fff0 0x7f6f10072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.664+0000 7f6f34c00640 1 -- 172.21.15.161:0/2790797593 --> [v2:172.21.15.161:6826/1566364308,v1:172.21.15.161:6827/1566364308] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f10072b60 con 0x7f6f1006fff0 2024-01-17T22:59:32.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.664+0000 7f6f34c00640 1 -- 172.21.15.161:0/2790797593 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f200ec780 con 0x7f6f3806caa0 2024-01-17T22:59:32.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.664+0000 7f6f3da00640 1 --2- 172.21.15.161:0/2790797593 >> [v2:172.21.15.161:6826/1566364308,v1:172.21.15.161:6827/1566364308] conn(0x7f6f1006fff0 0x7f6f10072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.664+0000 7f6f3da00640 1 --2- 172.21.15.161:0/2790797593 >> [v2:172.21.15.161:6826/1566364308,v1:172.21.15.161:6827/1566364308] conn(0x7f6f1006fff0 0x7f6f10072490 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.664+0000 7f6f34c00640 1 -- 172.21.15.161:0/2790797593 <== osd.1 v2:172.21.15.161:6826/1566364308 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6f10072b60 con 0x7f6f1006fff0 2024-01-17T22:59:32.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.680+0000 7f6f2e000640 1 -- 172.21.15.161:0/2790797593 --> [v2:172.21.15.161:6826/1566364308,v1:172.21.15.161:6827/1566364308] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6f3815d540 con 0x7f6f1006fff0 2024-01-17T22:59:32.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.680+0000 7f6f34c00640 1 -- 172.21.15.161:0/2790797593 <== osd.1 v2:172.21.15.161:6826/1566364308 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6f30001b50 con 0x7f6f1006fff0 2024-01-17T22:59:32.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.680+0000 7f6f2e000640 1 -- 172.21.15.161:0/2790797593 >> [v2:172.21.15.161:6826/1566364308,v1:172.21.15.161:6827/1566364308] conn(0x7f6f1006fff0 msgr2=0x7f6f10072490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.680+0000 7f6f2e000640 1 --2- 172.21.15.161:0/2790797593 >> [v2:172.21.15.161:6826/1566364308,v1:172.21.15.161:6827/1566364308] conn(0x7f6f1006fff0 0x7f6f10072490 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.680+0000 7f6f2e000640 1 -- 172.21.15.161:0/2790797593 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6f10066890 msgr2=0x7f6f10068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.680+0000 7f6f2e000640 1 --2- 172.21.15.161:0/2790797593 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6f10066890 0x7f6f10068d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6f3806e050 tx=0x7f6f28006ca0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.680+0000 7f6f2e000640 1 -- 172.21.15.161:0/2790797593 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f3806caa0 msgr2=0x7f6f380ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.680+0000 7f6f2e000640 1 --2- 172.21.15.161:0/2790797593 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f3806caa0 0x7f6f380ca170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6f200ad040 tx=0x7f6f2001ad00 comp rx=0 tx=0).stop 2024-01-17T22:59:32.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.680+0000 7f6f3da00640 1 -- 172.21.15.161:0/2790797593 reap_dead start 2024-01-17T22:59:32.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.680+0000 7f6f2e000640 1 -- 172.21.15.161:0/2790797593 shutdown_connections 2024-01-17T22:59:32.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.680+0000 7f6f2e000640 1 -- 172.21.15.161:0/2790797593 >> 172.21.15.161:0/2790797593 conn(0x7f6f380c7a90 msgr2=0x7f6f38157380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.684+0000 7f6f2e000640 1 -- 172.21.15.161:0/2790797593 shutdown_connections 2024-01-17T22:59:32.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.684+0000 7f6f2e000640 1 -- 172.21.15.161:0/2790797593 wait complete. 2024-01-17T22:59:32.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.692+0000 7f7fdaa00640 1 -- 172.21.15.161:0/4090041430 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f7fe4135920 con 0x7f7fdc0e71f0 2024-01-17T22:59:32.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.692+0000 7f7fdaa00640 1 --2- 172.21.15.161:0/4090041430 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f7fbc066890 0x7f7fbc068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.692+0000 7f7fe2a00640 1 --2- 172.21.15.161:0/4090041430 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f7fbc066890 0x7f7fbc068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.692+0000 7f7fe2a00640 1 --2- 172.21.15.161:0/4090041430 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f7fbc066890 0x7f7fbc068d50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc007fd0 tx=0x7f7fcc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.703 INFO:teuthology.orchestra.run.smithi161.stdout:64424509458 2024-01-17T22:59:32.703 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-17T22:59:32.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.708+0000 7f85a8c00640 1 -- 172.21.15.161:0/566860852 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f8594014cb0 con 0x7f85ac0c4e10 2024-01-17T22:59:32.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.712+0000 7f85a8c00640 1 --2- 172.21.15.161:0/566860852 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8584066840 0x7f8584068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.712+0000 7f85b0c00640 1 --2- 172.21.15.161:0/566860852 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8584066840 0x7f8584068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.712+0000 7f85b0c00640 1 --2- 172.21.15.161:0/566860852 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8584066840 0x7f8584068d00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f859c001000 tx=0x7f859c001ae0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.716+0000 7f7fdaa00640 1 -- 172.21.15.161:0/4090041430 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f7fe416e470 con 0x7f7fdc0e71f0 2024-01-17T22:59:32.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.716+0000 7f7fdaa00640 1 --2- 172.21.15.161:0/4090041430 >> [v2:172.21.15.190:6800/1815468048,v1:172.21.15.190:6801/1815468048] conn(0x7f7fbc06ff70 0x7f7fbc072410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.716+0000 7f7fdaa00640 1 -- 172.21.15.161:0/4090041430 --> [v2:172.21.15.190:6800/1815468048,v1:172.21.15.190:6801/1815468048] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7fbc072ae0 con 0x7f7fbc06ff70 2024-01-17T22:59:32.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.716+0000 7f7fdaa00640 1 -- 172.21.15.161:0/4090041430 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fe416a0b0 con 0x7f7fdc0e71f0 2024-01-17T22:59:32.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.716+0000 7f7fe2000640 1 --2- 172.21.15.161:0/4090041430 >> [v2:172.21.15.190:6800/1815468048,v1:172.21.15.190:6801/1815468048] conn(0x7f7fbc06ff70 0x7f7fbc072410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.716+0000 7f7fe2000640 1 --2- 172.21.15.161:0/4090041430 >> [v2:172.21.15.190:6800/1815468048,v1:172.21.15.190:6801/1815468048] conn(0x7f7fbc06ff70 0x7f7fbc072410 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.720+0000 7f7fdaa00640 1 -- 172.21.15.161:0/4090041430 <== osd.4 v2:172.21.15.190:6800/1815468048 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7fbc072ae0 con 0x7f7fbc06ff70 2024-01-17T22:59:32.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.724+0000 7f85a8c00640 1 -- 172.21.15.161:0/566860852 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f8594011340 con 0x7f85ac0c4e10 2024-01-17T22:59:32.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.724+0000 7f85a8c00640 1 --2- 172.21.15.161:0/566860852 >> [v2:172.21.15.190:6808/3291452378,v1:172.21.15.190:6809/3291452378] conn(0x7f858406fea0 0x7f8584072340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.724+0000 7f85a8c00640 1 -- 172.21.15.161:0/566860852 --> [v2:172.21.15.190:6808/3291452378,v1:172.21.15.190:6809/3291452378] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8584072a10 con 0x7f858406fea0 2024-01-17T22:59:32.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.724+0000 7f85a8c00640 1 -- 172.21.15.161:0/566860852 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8594052030 con 0x7f85ac0c4e10 2024-01-17T22:59:32.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.724+0000 7f85b2000640 1 --2- 172.21.15.161:0/566860852 >> [v2:172.21.15.190:6808/3291452378,v1:172.21.15.190:6809/3291452378] conn(0x7f858406fea0 0x7f8584072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.724+0000 7f85b2000640 1 --2- 172.21.15.161:0/566860852 >> [v2:172.21.15.190:6808/3291452378,v1:172.21.15.190:6809/3291452378] conn(0x7f858406fea0 0x7f8584072340 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.724+0000 7f85a8c00640 1 -- 172.21.15.161:0/566860852 <== osd.6 v2:172.21.15.190:6808/3291452378 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8584072a10 con 0x7f858406fea0 2024-01-17T22:59:32.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.736+0000 7f7fe9800640 1 -- 172.21.15.161:0/4090041430 --> [v2:172.21.15.190:6800/1815468048,v1:172.21.15.190:6801/1815468048] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7fdc0e6e00 con 0x7f7fbc06ff70 2024-01-17T22:59:32.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.736+0000 7f7fdaa00640 1 -- 172.21.15.161:0/4090041430 <== osd.4 v2:172.21.15.190:6800/1815468048 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7fd400a960 con 0x7f7fbc06ff70 2024-01-17T22:59:32.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.736+0000 7f7fe9800640 1 -- 172.21.15.161:0/4090041430 >> [v2:172.21.15.190:6800/1815468048,v1:172.21.15.190:6801/1815468048] conn(0x7f7fbc06ff70 msgr2=0x7f7fbc072410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.736+0000 7f7fe9800640 1 --2- 172.21.15.161:0/4090041430 >> [v2:172.21.15.190:6800/1815468048,v1:172.21.15.190:6801/1815468048] conn(0x7f7fbc06ff70 0x7f7fbc072410 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.736+0000 7f7fe9800640 1 -- 172.21.15.161:0/4090041430 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f7fbc066890 msgr2=0x7f7fbc068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.736+0000 7f7fe9800640 1 --2- 172.21.15.161:0/4090041430 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f7fbc066890 0x7f7fbc068d50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc007fd0 tx=0x7f7fcc009040 comp rx=0 tx=0).stop 2024-01-17T22:59:32.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.736+0000 7f7fe9800640 1 -- 172.21.15.161:0/4090041430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fdc0e71f0 msgr2=0x7f7fdc1796b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.736+0000 7f7fe9800640 1 --2- 172.21.15.161:0/4090041430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fdc0e71f0 0x7f7fdc1796b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4068800 tx=0x7f7fe4096b60 comp rx=0 tx=0).stop 2024-01-17T22:59:32.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.736+0000 7f7fe3400640 1 -- 172.21.15.161:0/4090041430 reap_dead start 2024-01-17T22:59:32.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.736+0000 7f7fe9800640 1 -- 172.21.15.161:0/4090041430 shutdown_connections 2024-01-17T22:59:32.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.736+0000 7f7fe9800640 1 -- 172.21.15.161:0/4090041430 >> 172.21.15.161:0/4090041430 conn(0x7f7fdc050190 msgr2=0x7f7fdc0055b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.736+0000 7fa6e0c00640 1 -- 172.21.15.161:0/1167937414 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fa6dc003d20 con 0x7fa6e415a810 2024-01-17T22:59:32.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.740+0000 7fa6e0c00640 1 --2- 172.21.15.161:0/1167937414 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa6bc0668c0 0x7fa6bc068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.740+0000 7f7fe9800640 1 -- 172.21.15.161:0/4090041430 shutdown_connections 2024-01-17T22:59:32.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.740+0000 7fa6e9000640 1 --2- 172.21.15.161:0/1167937414 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa6bc0668c0 0x7fa6bc068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.740+0000 7f7fe9800640 1 -- 172.21.15.161:0/4090041430 wait complete. 2024-01-17T22:59:32.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.740+0000 7fa6e9000640 1 --2- 172.21.15.161:0/1167937414 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa6bc0668c0 0x7fa6bc068d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40096b0 tx=0x7fa6d4006ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.744+0000 7fa6e0c00640 1 -- 172.21.15.161:0/1167937414 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fa6dc0ef9d0 con 0x7fa6e415a810 2024-01-17T22:59:32.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.744+0000 7fa6e0c00640 1 --2- 172.21.15.161:0/1167937414 >> [v2:172.21.15.161:6802/2733858976,v1:172.21.15.161:6803/2733858976] conn(0x7fa6bc06ffa0 0x7fa6bc072440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.744+0000 7fa6e0c00640 1 -- 172.21.15.161:0/1167937414 --> [v2:172.21.15.161:6802/2733858976,v1:172.21.15.161:6803/2733858976] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6bc072b10 con 0x7fa6bc06ffa0 2024-01-17T22:59:32.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.748+0000 7fa6e0c00640 1 -- 172.21.15.161:0/1167937414 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6dc0ebd10 con 0x7fa6e415a810 2024-01-17T22:59:32.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.748+0000 7fa6e3e00640 1 --2- 172.21.15.161:0/1167937414 >> [v2:172.21.15.161:6802/2733858976,v1:172.21.15.161:6803/2733858976] conn(0x7fa6bc06ffa0 0x7fa6bc072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.748+0000 7fa6e3e00640 1 --2- 172.21.15.161:0/1167937414 >> [v2:172.21.15.161:6802/2733858976,v1:172.21.15.161:6803/2733858976] conn(0x7fa6bc06ffa0 0x7fa6bc072440 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.748+0000 7fa6e0c00640 1 -- 172.21.15.161:0/1167937414 <== osd.0 v2:172.21.15.161:6802/2733858976 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa6bc072b10 con 0x7fa6bc06ffa0 2024-01-17T22:59:32.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.752+0000 7f69a7400640 1 -- 172.21.15.161:0/2029928246 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a8003d90 con 0x7f69b00c3fa0 2024-01-17T22:59:32.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.752+0000 7f69a7400640 1 -- 172.21.15.161:0/2029928246 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a8005070 con 0x7f69b00c3fa0 2024-01-17T22:59:32.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.752+0000 7f69a7400640 1 -- 172.21.15.161:0/2029928246 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a8005420 con 0x7f69b00c3fa0 2024-01-17T22:59:32.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.752+0000 7f69b6000640 1 -- 172.21.15.161:0/2029928246 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b015b0a0 con 0x7f69b00c3fa0 2024-01-17T22:59:32.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.752+0000 7f69b6000640 1 -- 172.21.15.161:0/2029928246 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b0156830 con 0x7f69b00c3fa0 2024-01-17T22:59:32.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.752+0000 7f69b6000640 1 -- 172.21.15.161:0/2029928246 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f69b00619a0 con 0x7f69b00c3fa0 2024-01-17T22:59:32.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.756+0000 7f85b3600640 1 -- 172.21.15.161:0/566860852 --> [v2:172.21.15.190:6808/3291452378,v1:172.21.15.190:6809/3291452378] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f85ac06aef0 con 0x7f858406fea0 2024-01-17T22:59:32.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.756+0000 7f85a8c00640 1 -- 172.21.15.161:0/566860852 <== osd.6 v2:172.21.15.190:6808/3291452378 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f85a4003980 con 0x7f858406fea0 2024-01-17T22:59:32.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.756+0000 7f85b3600640 1 -- 172.21.15.161:0/566860852 >> [v2:172.21.15.190:6808/3291452378,v1:172.21.15.190:6809/3291452378] conn(0x7f858406fea0 msgr2=0x7f8584072340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.756+0000 7f85b3600640 1 --2- 172.21.15.161:0/566860852 >> [v2:172.21.15.190:6808/3291452378,v1:172.21.15.190:6809/3291452378] conn(0x7f858406fea0 0x7f8584072340 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.756+0000 7f85b3600640 1 -- 172.21.15.161:0/566860852 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8584066840 msgr2=0x7f8584068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.756+0000 7f85b3600640 1 --2- 172.21.15.161:0/566860852 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8584066840 0x7f8584068d00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f859c001000 tx=0x7f859c001ae0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.756+0000 7f85b3600640 1 -- 172.21.15.161:0/566860852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85ac0c4e10 msgr2=0x7f85ac0c5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.756+0000 7f85b3600640 1 --2- 172.21.15.161:0/566860852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85ac0c4e10 0x7f85ac0c5270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f859400d550 tx=0x7f859400da10 comp rx=0 tx=0).stop 2024-01-17T22:59:32.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.756+0000 7f85b2000640 1 -- 172.21.15.161:0/566860852 reap_dead start 2024-01-17T22:59:32.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.756+0000 7f85b3600640 1 -- 172.21.15.161:0/566860852 shutdown_connections 2024-01-17T22:59:32.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.756+0000 7f85b3600640 1 -- 172.21.15.161:0/566860852 >> 172.21.15.161:0/566860852 conn(0x7f85ac061100 msgr2=0x7f85ac0cb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.760+0000 7f85b3600640 1 -- 172.21.15.161:0/566860852 shutdown_connections 2024-01-17T22:59:32.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.760+0000 7f85b3600640 1 -- 172.21.15.161:0/566860852 wait complete. 2024-01-17T22:59:32.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.764+0000 7fa6eba00640 1 -- 172.21.15.161:0/1167937414 --> [v2:172.21.15.161:6802/2733858976,v1:172.21.15.161:6803/2733858976] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa6e40c4790 con 0x7fa6bc06ffa0 2024-01-17T22:59:32.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.764+0000 7fa6e0c00640 1 -- 172.21.15.161:0/1167937414 <== osd.0 v2:172.21.15.161:6802/2733858976 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa6e40c4790 con 0x7fa6bc06ffa0 2024-01-17T22:59:32.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.768+0000 7fa6eba00640 1 -- 172.21.15.161:0/1167937414 >> [v2:172.21.15.161:6802/2733858976,v1:172.21.15.161:6803/2733858976] conn(0x7fa6bc06ffa0 msgr2=0x7fa6bc072440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.768+0000 7fa6eba00640 1 --2- 172.21.15.161:0/1167937414 >> [v2:172.21.15.161:6802/2733858976,v1:172.21.15.161:6803/2733858976] conn(0x7fa6bc06ffa0 0x7fa6bc072440 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.768+0000 7fa6eba00640 1 -- 172.21.15.161:0/1167937414 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa6bc0668c0 msgr2=0x7fa6bc068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.768+0000 7fa6eba00640 1 --2- 172.21.15.161:0/1167937414 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa6bc0668c0 0x7fa6bc068d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40096b0 tx=0x7fa6d4006ca0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.768+0000 7fa6eba00640 1 -- 172.21.15.161:0/1167937414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6e415a810 msgr2=0x7fa6e41f28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.768+0000 7fa6eba00640 1 --2- 172.21.15.161:0/1167937414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6e415a810 0x7fa6e41f28a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc01d130 tx=0x7fa6c4005800 comp rx=0 tx=0).stop 2024-01-17T22:59:32.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.768+0000 7fa6ea400640 1 -- 172.21.15.161:0/1167937414 reap_dead start 2024-01-17T22:59:32.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.768+0000 7fa6eba00640 1 -- 172.21.15.161:0/1167937414 shutdown_connections 2024-01-17T22:59:32.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.768+0000 7fa6eba00640 1 -- 172.21.15.161:0/1167937414 >> 172.21.15.161:0/1167937414 conn(0x7fa6e4061100 msgr2=0x7fa6e4150ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.768+0000 7fa6eba00640 1 -- 172.21.15.161:0/1167937414 shutdown_connections 2024-01-17T22:59:32.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.768+0000 7fa6eba00640 1 -- 172.21.15.161:0/1167937414 wait complete. 2024-01-17T22:59:32.773 INFO:teuthology.orchestra.run.smithi161.stdout:64424509458 2024-01-17T22:59:32.773 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-17T22:59:32.791 INFO:teuthology.orchestra.run.smithi161.stdout:60129542161 2024-01-17T22:59:32.791 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-17T22:59:32.793 INFO:teuthology.orchestra.run.smithi161.stdout:64424509458 2024-01-17T22:59:32.793 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-17T22:59:32.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.816+0000 7f69a7400640 1 -- 172.21.15.161:0/2029928246 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f69a8005580 con 0x7f69b00c3fa0 2024-01-17T22:59:32.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.816+0000 7f69a7400640 1 --2- 172.21.15.161:0/2029928246 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6988066890 0x7f6988068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.816+0000 7f69af400640 1 --2- 172.21.15.161:0/2029928246 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6988066890 0x7f6988068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.816+0000 7f69af400640 1 --2- 172.21.15.161:0/2029928246 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6988066890 0x7f6988068d50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f69a000a830 tx=0x7f69a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.820+0000 7f69a7400640 1 -- 172.21.15.161:0/2029928246 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f69a8055720 con 0x7f69b00c3fa0 2024-01-17T22:59:32.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.820+0000 7f69a7400640 1 --2- 172.21.15.161:0/2029928246 >> [v2:172.21.15.190:6818/2131748209,v1:172.21.15.190:6820/2131748209] conn(0x7f698806ff70 0x7f6988072410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.820+0000 7f69a7400640 1 -- 172.21.15.161:0/2029928246 --> [v2:172.21.15.190:6818/2131748209,v1:172.21.15.190:6820/2131748209] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6988072ae0 con 0x7f698806ff70 2024-01-17T22:59:32.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.820+0000 7f69a7400640 1 -- 172.21.15.161:0/2029928246 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69a8005830 con 0x7f69b00c3fa0 2024-01-17T22:59:32.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.820+0000 7f69aea00640 1 --2- 172.21.15.161:0/2029928246 >> [v2:172.21.15.190:6818/2131748209,v1:172.21.15.190:6820/2131748209] conn(0x7f698806ff70 0x7f6988072410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.820+0000 7f69aea00640 1 --2- 172.21.15.161:0/2029928246 >> [v2:172.21.15.190:6818/2131748209,v1:172.21.15.190:6820/2131748209] conn(0x7f698806ff70 0x7f6988072410 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.824+0000 7f69a7400640 1 -- 172.21.15.161:0/2029928246 <== osd.7 v2:172.21.15.190:6818/2131748209 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6988072ae0 con 0x7f698806ff70 2024-01-17T22:59:32.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.824+0000 7f03e6000640 1 -- 172.21.15.161:0/2702885178 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e000cba0 con 0x7f03e80cbc80 2024-01-17T22:59:32.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.824+0000 7f03e6000640 1 -- 172.21.15.161:0/2702885178 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e000cd00 con 0x7f03e80cbc80 2024-01-17T22:59:32.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.824+0000 7f03e6000640 1 -- 172.21.15.161:0/2702885178 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0014680 con 0x7f03e80cbc80 2024-01-17T22:59:32.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.824+0000 7f03f0800640 1 -- 172.21.15.161:0/2702885178 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e815f260 con 0x7f03e80cbc80 2024-01-17T22:59:32.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.824+0000 7fb9ae600640 1 Processor -- start 2024-01-17T22:59:32.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.824+0000 7fb9ae600640 1 -- start start 2024-01-17T22:59:32.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.824+0000 7f03f0800640 1 -- 172.21.15.161:0/2702885178 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e815f820 con 0x7f03e80cbc80 2024-01-17T22:59:32.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.828+0000 7f03f0800640 1 -- 172.21.15.161:0/2702885178 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f03e814c2c0 con 0x7f03e80cbc80 2024-01-17T22:59:32.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.828+0000 7fb9ae600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb9a80c5c90 0x7fb9a80c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.828+0000 7fb9ae600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a80c4540 con 0x7fb9a80c8980 2024-01-17T22:59:32.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.828+0000 7fb9ae600640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a80c7b30 con 0x7fb9a80713a0 2024-01-17T22:59:32.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.828+0000 7fb9ae600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a80c5840 con 0x7fb9a80c5c90 2024-01-17T22:59:32.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.828+0000 7fb9a7400640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fb9a80713a0 0x7fb9a806ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.161:35248/0 (socket says 172.21.15.161:35248) 2024-01-17T22:59:32.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.828+0000 7fb9a7400640 1 -- 172.21.15.161:0/528625960 learned_addr learned my addr 172.21.15.161:0/528625960 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:32.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.832+0000 7fb9a6a00640 1 --2- 172.21.15.161:0/528625960 >> v2:172.21.15.161:3300/0 conn(0x7fb9a80c5c90 0x7fb9a80c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.836+0000 7fb9a6a00640 1 -- 172.21.15.161:0/528625960 >> v1:172.21.15.190:6789/0 conn(0x7fb9a80713a0 legacy=0x7fb9a806ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.836+0000 7fb9a6a00640 1 -- 172.21.15.161:0/528625960 >> v1:172.21.15.161:6789/0 conn(0x7fb9a80c8980 legacy=0x7fb9a806f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.836+0000 7fb9a6a00640 1 -- 172.21.15.161:0/528625960 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a806fc70 con 0x7fb9a80c5c90 2024-01-17T22:59:32.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.844+0000 7f52a0c00640 1 Processor -- start 2024-01-17T22:59:32.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.844+0000 7f52a0c00640 1 -- start start 2024-01-17T22:59:32.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.844+0000 7fb9a6a00640 1 --2- 172.21.15.161:0/528625960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9a80c5c90 0x7fb9a80c49d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb9900097c0 tx=0x7fb99001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e51255ec995d1ce server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.848+0000 7f52a0c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f529c0728f0 0x7f529c15da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.848+0000 7f52a0c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529c0c1c70 con 0x7f529c15df40 2024-01-17T22:59:32.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.848+0000 7f52a0c00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529c0c1f30 con 0x7f529c0c8340 2024-01-17T22:59:32.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.848+0000 7f52a0c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f529c0c2210 con 0x7f529c0728f0 2024-01-17T22:59:32.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.848+0000 7f529b400640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f529c0c8340 0x7f529c0c1480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.161:35256/0 (socket says 172.21.15.161:35256) 2024-01-17T22:59:32.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.848+0000 7f529b400640 1 -- 172.21.15.161:0/2553277142 learned_addr learned my addr 172.21.15.161:0/2553277142 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:32.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.848+0000 7fb9a6000640 1 -- 172.21.15.161:0/528625960 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9900a8970 con 0x7fb9a80c5c90 2024-01-17T22:59:32.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.852+0000 7f529aa00640 1 --2- 172.21.15.161:0/2553277142 >> v2:172.21.15.161:3300/0 conn(0x7f529c0728f0 0x7f529c15da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.856+0000 7f529a000640 1 -- 172.21.15.161:0/2553277142 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011069169 0 0) 0x7f529c0c1f30 con 0x7f529c0c8340 2024-01-17T22:59:32.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.856+0000 7f529a000640 1 -- 172.21.15.161:0/2553277142 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f527c003530 con 0x7f529c0c8340 2024-01-17T22:59:32.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.856+0000 7f529aa00640 1 -- 172.21.15.161:0/2553277142 >> v1:172.21.15.190:6789/0 conn(0x7f529c0c8340 legacy=0x7f529c0c1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.856+0000 7f529aa00640 1 -- 172.21.15.161:0/2553277142 >> v1:172.21.15.161:6789/0 conn(0x7f529c15df40 legacy=0x7f529c071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.856+0000 7f529aa00640 1 -- 172.21.15.161:0/2553277142 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c160ff0 con 0x7f529c0728f0 2024-01-17T22:59:32.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.860+0000 7f69b6000640 1 -- 172.21.15.161:0/2029928246 --> [v2:172.21.15.190:6818/2131748209,v1:172.21.15.190:6820/2131748209] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f69b00ca950 con 0x7f698806ff70 2024-01-17T22:59:32.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.860+0000 7f69a7400640 1 -- 172.21.15.161:0/2029928246 <== osd.7 v2:172.21.15.190:6818/2131748209 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f69980ac480 con 0x7f698806ff70 2024-01-17T22:59:32.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.860+0000 7f69b6000640 1 -- 172.21.15.161:0/2029928246 >> [v2:172.21.15.190:6818/2131748209,v1:172.21.15.190:6820/2131748209] conn(0x7f698806ff70 msgr2=0x7f6988072410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.860+0000 7f69b6000640 1 --2- 172.21.15.161:0/2029928246 >> [v2:172.21.15.190:6818/2131748209,v1:172.21.15.190:6820/2131748209] conn(0x7f698806ff70 0x7f6988072410 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.860+0000 7f69b6000640 1 -- 172.21.15.161:0/2029928246 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6988066890 msgr2=0x7f6988068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.860+0000 7f69b6000640 1 --2- 172.21.15.161:0/2029928246 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6988066890 0x7f6988068d50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f69a000a830 tx=0x7f69a0008040 comp rx=0 tx=0).stop 2024-01-17T22:59:32.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.860+0000 7f69b6000640 1 -- 172.21.15.161:0/2029928246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69b00c3fa0 msgr2=0x7f69b00c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.860+0000 7f69b6000640 1 --2- 172.21.15.161:0/2029928246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69b00c3fa0 0x7f69b00c8520 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f69a800c7b0 tx=0x7f69a800cc70 comp rx=0 tx=0).stop 2024-01-17T22:59:32.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.860+0000 7f69afe00640 1 -- 172.21.15.161:0/2029928246 reap_dead start 2024-01-17T22:59:32.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.860+0000 7f69b6000640 1 -- 172.21.15.161:0/2029928246 shutdown_connections 2024-01-17T22:59:32.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.860+0000 7f69b6000640 1 -- 172.21.15.161:0/2029928246 >> 172.21.15.161:0/2029928246 conn(0x7f69b006ad40 msgr2=0x7f69b015c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.860+0000 7f69b6000640 1 -- 172.21.15.161:0/2029928246 shutdown_connections 2024-01-17T22:59:32.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.860+0000 7f69b6000640 1 -- 172.21.15.161:0/2029928246 wait complete. 2024-01-17T22:59:32.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.860+0000 7fb9a6000640 1 -- 172.21.15.161:0/528625960 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9900a8ad0 con 0x7fb9a80c5c90 2024-01-17T22:59:32.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.860+0000 7fb9a6000640 1 -- 172.21.15.161:0/528625960 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9900a8e60 con 0x7fb9a80c5c90 2024-01-17T22:59:32.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.864+0000 7fb9ae600640 1 -- 172.21.15.161:0/528625960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9a80c5c90 msgr2=0x7fb9a80c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.864+0000 7fb9ae600640 1 --2- 172.21.15.161:0/528625960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9a80c5c90 0x7fb9a80c49d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb9900097c0 tx=0x7fb99001ec70 comp rx=0 tx=0).stop 2024-01-17T22:59:32.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.864+0000 7fb9ae600640 1 -- 172.21.15.161:0/528625960 shutdown_connections 2024-01-17T22:59:32.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.864+0000 7fb9ae600640 1 --2- 172.21.15.161:0/528625960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9a80c5c90 0x7fb9a80c49d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.864+0000 7fb9ae600640 1 -- 172.21.15.161:0/528625960 >> 172.21.15.161:0/528625960 conn(0x7fb9a806e070 msgr2=0x7fb9a806e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.864+0000 7fb9ae600640 1 -- 172.21.15.161:0/528625960 shutdown_connections 2024-01-17T22:59:32.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.864+0000 7fb9ae600640 1 -- 172.21.15.161:0/528625960 wait complete. 2024-01-17T22:59:32.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.864+0000 7f529aa00640 1 --2- 172.21.15.161:0/2553277142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f529c0728f0 0x7f529c15da00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f528c0097c0 tx=0x7f528c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7914a1c08ef1d4a server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.864+0000 7fb9ae600640 1 Processor -- start 2024-01-17T22:59:32.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.868+0000 7fb9ae600640 1 -- start start 2024-01-17T22:59:32.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.868+0000 7fb9ae600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9a80713a0 0x7fb9a813cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.868+0000 7fb9ae600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9a80c5c90 0x7fb9a814bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.868+0000 7fb9ae600640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9a80c8980 0x7fb9a80c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.868+0000 7fb9ae600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a81f3ac0 con 0x7fb9a80c5c90 2024-01-17T22:59:32.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.868+0000 7fb9ae600640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a813d250 con 0x7fb9a80c8980 2024-01-17T22:59:32.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.868+0000 7fb9ae600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a814c3e0 con 0x7fb9a80713a0 2024-01-17T22:59:32.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.868+0000 7fb9a7e00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9a80c8980 0x7fb9a80c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.872+0000 7fb9a7e00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9a80c8980 0x7fb9a80c09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:49452/0 (socket says 172.21.15.161:49452) 2024-01-17T22:59:32.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.872+0000 7fb9a7e00640 1 -- 172.21.15.161:0/1057375681 learned_addr learned my addr 172.21.15.161:0/1057375681 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:32.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.872+0000 7f529a000640 1 -- 172.21.15.161:0/2553277142 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0a8970 con 0x7f529c0728f0 2024-01-17T22:59:32.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.872+0000 7f529a000640 1 -- 172.21.15.161:0/2553277142 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c0a8ad0 con 0x7f529c0728f0 2024-01-17T22:59:32.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.872+0000 7f529a000640 1 -- 172.21.15.161:0/2553277142 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0a8e60 con 0x7f529c0728f0 2024-01-17T22:59:32.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.876+0000 7fb9a6a00640 1 --2- 172.21.15.161:0/1057375681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9a80c5c90 0x7fb9a814bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.876+0000 7f52a0c00640 1 -- 172.21.15.161:0/2553277142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f529c0728f0 msgr2=0x7f529c15da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.876+0000 7f52a0c00640 1 --2- 172.21.15.161:0/2553277142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f529c0728f0 0x7f529c15da00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f528c0097c0 tx=0x7f528c01ec70 comp rx=0 tx=0).stop 2024-01-17T22:59:32.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.876+0000 7f52a0c00640 1 -- 172.21.15.161:0/2553277142 shutdown_connections 2024-01-17T22:59:32.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.876+0000 7f52a0c00640 1 --2- 172.21.15.161:0/2553277142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f529c0728f0 0x7f529c15da00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.876+0000 7f52a0c00640 1 -- 172.21.15.161:0/2553277142 >> 172.21.15.161:0/2553277142 conn(0x7f529c06ee50 msgr2=0x7f529c06f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.876+0000 7f52a0c00640 1 -- 172.21.15.161:0/2553277142 shutdown_connections 2024-01-17T22:59:32.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.876+0000 7f52a0c00640 1 -- 172.21.15.161:0/2553277142 wait complete. 2024-01-17T22:59:32.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.880+0000 7f52a0c00640 1 Processor -- start 2024-01-17T22:59:32.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.880+0000 7f52a0c00640 1 -- start start 2024-01-17T22:59:32.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.880+0000 7f52a0c00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f529c0728f0 0x7f529c1f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.880+0000 7f52a0c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f529c0c8340 0x7f529c0c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.880+0000 7f52a0c00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f529c15df40 0x7f529c1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.880+0000 7f52a0c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c159470 con 0x7f529c0c8340 2024-01-17T22:59:32.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.880+0000 7f52a0c00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c15ed80 con 0x7f529c0728f0 2024-01-17T22:59:32.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.880+0000 7f52a0c00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529c0c2500 con 0x7f529c15df40 2024-01-17T22:59:32.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.880+0000 7fb9a7e00640 1 -- 172.21.15.161:0/1057375681 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9a80713a0 msgr2=0x7fb9a813cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.880+0000 7fb9a7e00640 1 --2- 172.21.15.161:0/1057375681 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9a80713a0 0x7fb9a813cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.880+0000 7fb9a7e00640 1 -- 172.21.15.161:0/1057375681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9a80c5c90 msgr2=0x7fb9a814bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.880+0000 7fb9a7e00640 1 --2- 172.21.15.161:0/1057375681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9a80c5c90 0x7fb9a814bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.880+0000 7fb9a7e00640 1 -- 172.21.15.161:0/1057375681 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb990009420 con 0x7fb9a80c8980 2024-01-17T22:59:32.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.884+0000 7f03e6000640 1 -- 172.21.15.161:0/2702885178 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f03e001d3b0 con 0x7f03e80cbc80 2024-01-17T22:59:32.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.884+0000 7f03e6000640 1 --2- 172.21.15.161:0/2702885178 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f03c0066890 0x7f03c0068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.884+0000 7f03ede00640 1 --2- 172.21.15.161:0/2702885178 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f03c0066890 0x7f03c0068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.888+0000 7f529aa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f529c0c8340 0x7f529c0c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.888+0000 7f529aa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f529c0c8340 0x7f529c0c3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60398/0 (socket says 172.21.15.161:60398) 2024-01-17T22:59:32.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.888+0000 7f529aa00640 1 -- 172.21.15.161:0/2625223730 learned_addr learned my addr 172.21.15.161:0/2625223730 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:32.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.888+0000 7f529b400640 1 --2- 172.21.15.161:0/2625223730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f529c0728f0 0x7f529c1f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.888+0000 7f03ede00640 1 --2- 172.21.15.161:0/2702885178 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f03c0066890 0x7f03c0068d50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03d8007fd0 tx=0x7f03d8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.888+0000 7fb9a7e00640 1 --2- 172.21.15.161:0/1057375681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9a80c8980 0x7fb9a80c09f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000c730 tx=0x7fb9a000cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.892+0000 7f529aa00640 1 -- 172.21.15.161:0/2625223730 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f529c15df40 msgr2=0x7f529c1571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.892+0000 7f529aa00640 1 --2- 172.21.15.161:0/2625223730 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f529c15df40 0x7f529c1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.892+0000 7f529aa00640 1 -- 172.21.15.161:0/2625223730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f529c0728f0 msgr2=0x7f529c1f6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.892+0000 7f529aa00640 1 --2- 172.21.15.161:0/2625223730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f529c0728f0 0x7f529c1f6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.892+0000 7f529aa00640 1 -- 172.21.15.161:0/2625223730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528c009420 con 0x7f529c0c8340 2024-01-17T22:59:32.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.896+0000 7f529aa00640 1 --2- 172.21.15.161:0/2625223730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f529c0c8340 0x7f529c0c3f80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f528c01c8a0 tx=0x7f528c01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.896+0000 7f03e6000640 1 -- 172.21.15.161:0/2702885178 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f03e0055710 con 0x7f03e80cbc80 2024-01-17T22:59:32.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.896+0000 7f03e6000640 1 --2- 172.21.15.161:0/2702885178 >> [v2:172.21.15.161:6811/607538014,v1:172.21.15.161:6813/607538014] conn(0x7f03c006ff70 0x7f03c0072410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.896+0000 7f03e6000640 1 -- 172.21.15.161:0/2702885178 --> [v2:172.21.15.161:6811/607538014,v1:172.21.15.161:6813/607538014] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f03c0072ae0 con 0x7f03c006ff70 2024-01-17T22:59:32.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.896+0000 7f03ed400640 1 --2- 172.21.15.161:0/2702885178 >> [v2:172.21.15.161:6811/607538014,v1:172.21.15.161:6813/607538014] conn(0x7f03c006ff70 0x7f03c0072410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.896+0000 7f03e6000640 1 -- 172.21.15.161:0/2702885178 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03e000ce70 con 0x7f03e80cbc80 2024-01-17T22:59:32.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.900+0000 7f03ed400640 1 --2- 172.21.15.161:0/2702885178 >> [v2:172.21.15.161:6811/607538014,v1:172.21.15.161:6813/607538014] conn(0x7f03c006ff70 0x7f03c0072410 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.898 INFO:teuthology.orchestra.run.smithi161.stdout:64424509459 2024-01-17T22:59:32.898 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-17T22:59:32.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.900+0000 7f03e6000640 1 -- 172.21.15.161:0/2702885178 <== osd.3 v2:172.21.15.161:6811/607538014 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f03c0072ae0 con 0x7f03c006ff70 2024-01-17T22:59:32.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.900+0000 7f5293400640 1 -- 172.21.15.161:0/2625223730 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0b1d60 con 0x7f529c0c8340 2024-01-17T22:59:32.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.900+0000 7f5293400640 1 -- 172.21.15.161:0/2625223730 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c0b9410 con 0x7f529c0c8340 2024-01-17T22:59:32.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.900+0000 7f5293400640 1 -- 172.21.15.161:0/2625223730 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0b97c0 con 0x7f529c0c8340 2024-01-17T22:59:32.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.900+0000 7f52a0c00640 1 -- 172.21.15.161:0/2625223730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529c1f70f0 con 0x7f529c0c8340 2024-01-17T22:59:32.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.900+0000 7f52a0c00640 1 -- 172.21.15.161:0/2625223730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529c1582f0 con 0x7f529c0c8340 2024-01-17T22:59:32.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.904+0000 7f52a0c00640 1 -- 172.21.15.161:0/2625223730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529c0c0f70 con 0x7f529c0c8340 2024-01-17T22:59:32.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.908+0000 7fb99f400640 1 -- 172.21.15.161:0/1057375681 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0003b80 con 0x7fb9a80c8980 2024-01-17T22:59:32.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.912+0000 7fb9ae600640 1 -- 172.21.15.161:0/1057375681 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a813f870 con 0x7fb9a80c8980 2024-01-17T22:59:32.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.912+0000 7fb9ae600640 1 -- 172.21.15.161:0/1057375681 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a81f3cb0 con 0x7fb9a80c8980 2024-01-17T22:59:32.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.912+0000 7fb99f400640 1 -- 172.21.15.161:0/1057375681 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a0003ce0 con 0x7fb9a80c8980 2024-01-17T22:59:32.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.912+0000 7fb99f400640 1 -- 172.21.15.161:0/1057375681 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0003b80 con 0x7fb9a80c8980 2024-01-17T22:59:32.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.912+0000 7fb9ae600640 1 -- 172.21.15.161:0/1057375681 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a80cbc30 con 0x7fb9a80c8980 2024-01-17T22:59:32.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.924+0000 7f1203e00640 1 Processor -- start 2024-01-17T22:59:32.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.924+0000 7f1203e00640 1 -- start start 2024-01-17T22:59:32.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.928+0000 7f1203e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f11fc06d3c0 0x7f11fc161260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.928+0000 7f1203e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11fc06d7a0 0x7f11fc06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.928+0000 7f1203e00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11fc0c2920 con 0x7f11fc0c5150 2024-01-17T22:59:32.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.928+0000 7f1203e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11fc06f5b0 con 0x7f11fc06d3c0 2024-01-17T22:59:32.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.928+0000 7f1203e00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0c5ff0 con 0x7f11fc06d7a0 2024-01-17T22:59:32.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.928+0000 7f03f0800640 1 -- 172.21.15.161:0/2702885178 --> [v2:172.21.15.161:6811/607538014,v1:172.21.15.161:6813/607538014] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f03e8150290 con 0x7f03c006ff70 2024-01-17T22:59:32.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.928+0000 7f1200a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11fc06d7a0 0x7f11fc06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.928+0000 7f03e6000640 1 -- 172.21.15.161:0/2702885178 <== osd.3 v2:172.21.15.161:6811/607538014 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f03e8150290 con 0x7f03c006ff70 2024-01-17T22:59:32.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.928+0000 7f1200a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11fc06d7a0 0x7f11fc06f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:40084/0 (socket says 172.21.15.161:40084) 2024-01-17T22:59:32.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.928+0000 7f1200a00640 1 -- 172.21.15.161:0/945867135 learned_addr learned my addr 172.21.15.161:0/945867135 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:32.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.932+0000 7f03f0800640 1 -- 172.21.15.161:0/2702885178 >> [v2:172.21.15.161:6811/607538014,v1:172.21.15.161:6813/607538014] conn(0x7f03c006ff70 msgr2=0x7f03c0072410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.932+0000 7f03f0800640 1 --2- 172.21.15.161:0/2702885178 >> [v2:172.21.15.161:6811/607538014,v1:172.21.15.161:6813/607538014] conn(0x7f03c006ff70 0x7f03c0072410 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.932+0000 7f03f0800640 1 -- 172.21.15.161:0/2702885178 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f03c0066890 msgr2=0x7f03c0068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.932+0000 7f03f0800640 1 --2- 172.21.15.161:0/2702885178 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f03c0066890 0x7f03c0068d50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03d8007fd0 tx=0x7f03d8009040 comp rx=0 tx=0).stop 2024-01-17T22:59:32.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.932+0000 7f03f0800640 1 -- 172.21.15.161:0/2702885178 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03e80cbc80 msgr2=0x7f03e81f2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.932+0000 7f03f0800640 1 --2- 172.21.15.161:0/2702885178 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f03e80cbc80 0x7f03e81f2b20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f03e000ba10 tx=0x7f03e000bed0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.932+0000 7f03ee800640 1 -- 172.21.15.161:0/2702885178 reap_dead start 2024-01-17T22:59:32.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.932+0000 7f03f0800640 1 -- 172.21.15.161:0/2702885178 shutdown_connections 2024-01-17T22:59:32.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.932+0000 7f03f0800640 1 -- 172.21.15.161:0/2702885178 >> 172.21.15.161:0/2702885178 conn(0x7f03e806e070 msgr2=0x7f03e814b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.932+0000 7f03f0800640 1 -- 172.21.15.161:0/2702885178 shutdown_connections 2024-01-17T22:59:32.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.932+0000 7f03f0800640 1 -- 172.21.15.161:0/2702885178 wait complete. 2024-01-17T22:59:32.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.940+0000 7f1200a00640 1 -- 172.21.15.161:0/945867135 >> v2:172.21.15.161:3300/0 conn(0x7f11fc06d3c0 msgr2=0x7f11fc161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.940+0000 7f1200a00640 1 --2- 172.21.15.161:0/945867135 >> v2:172.21.15.161:3300/0 conn(0x7f11fc06d3c0 0x7f11fc161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.940+0000 7f1200a00640 1 -- 172.21.15.161:0/945867135 >> v1:172.21.15.190:6789/0 conn(0x7f11fc0c5150 legacy=0x7f11fc154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.940+0000 7f1200a00640 1 -- 172.21.15.161:0/945867135 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc0c62d0 con 0x7f11fc06d7a0 2024-01-17T22:59:32.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.948+0000 7f1200a00640 1 --2- 172.21.15.161:0/945867135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11fc06d7a0 0x7f11fc06f9d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f11ec009870 tx=0x7f11ec01ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab74467e0fb4ab5 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.960+0000 7f11fbe00640 1 -- 172.21.15.161:0/945867135 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec0a89b0 con 0x7f11fc06d7a0 2024-01-17T22:59:32.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.960+0000 7f11fbe00640 1 -- 172.21.15.161:0/945867135 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ec0a8b10 con 0x7f11fc06d7a0 2024-01-17T22:59:32.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.960+0000 7f11fbe00640 1 -- 172.21.15.161:0/945867135 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec0a8ea0 con 0x7f11fc06d7a0 2024-01-17T22:59:32.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.960+0000 7f1203e00640 1 -- 172.21.15.161:0/945867135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11fc06d7a0 msgr2=0x7f11fc06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.960+0000 7f1203e00640 1 --2- 172.21.15.161:0/945867135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11fc06d7a0 0x7f11fc06f9d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f11ec009870 tx=0x7f11ec01ed10 comp rx=0 tx=0).stop 2024-01-17T22:59:32.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.964+0000 7f1203e00640 1 -- 172.21.15.161:0/945867135 shutdown_connections 2024-01-17T22:59:32.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.964+0000 7f1203e00640 1 --2- 172.21.15.161:0/945867135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11fc06d7a0 0x7f11fc06f9d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.964+0000 7f1203e00640 1 --2- 172.21.15.161:0/945867135 >> v2:172.21.15.161:3300/0 conn(0x7f11fc06d3c0 0x7f11fc161260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.964+0000 7f1203e00640 1 -- 172.21.15.161:0/945867135 >> 172.21.15.161:0/945867135 conn(0x7f11fc06e070 msgr2=0x7f11fc06e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.964+0000 7f1203e00640 1 -- 172.21.15.161:0/945867135 shutdown_connections 2024-01-17T22:59:32.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.964+0000 7f1203e00640 1 -- 172.21.15.161:0/945867135 wait complete. 2024-01-17T22:59:32.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.968+0000 7f1203e00640 1 Processor -- start 2024-01-17T22:59:32.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.968+0000 7f1203e00640 1 -- start start 2024-01-17T22:59:32.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.968+0000 7f1203e00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11fc06d3c0 0x7f11fc1f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.968+0000 7f1203e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11fc06d7a0 0x7f11fc149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.967 INFO:teuthology.orchestra.run.smithi161.stdout:64424509458 2024-01-17T22:59:32.967 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-17T22:59:32.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.968+0000 7f1203e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11fc0c5150 0x7f11fc1444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.968+0000 7f1203e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc14bd00 con 0x7f11fc06d7a0 2024-01-17T22:59:32.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.968+0000 7f1203e00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc154170 con 0x7f11fc06d3c0 2024-01-17T22:59:32.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.968+0000 7f1203e00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0c99d0 con 0x7f11fc0c5150 2024-01-17T22:59:32.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.968+0000 7f1201e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11fc0c5150 0x7f11fc1444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.972+0000 7f1201e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11fc0c5150 0x7f11fc1444f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:40094/0 (socket says 172.21.15.161:40094) 2024-01-17T22:59:32.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.972+0000 7f1201e00640 1 -- 172.21.15.161:0/3322026711 learned_addr learned my addr 172.21.15.161:0/3322026711 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:32.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.980+0000 7f1201e00640 1 -- 172.21.15.161:0/3322026711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11fc06d3c0 msgr2=0x7f11fc1f69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.980+0000 7f1201e00640 1 --2- 172.21.15.161:0/3322026711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11fc06d3c0 0x7f11fc1f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.980+0000 7f1201e00640 1 -- 172.21.15.161:0/3322026711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11fc06d7a0 msgr2=0x7f11fc149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.980+0000 7f1201e00640 1 --2- 172.21.15.161:0/3322026711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11fc06d7a0 0x7f11fc149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.980+0000 7f1201e00640 1 -- 172.21.15.161:0/3322026711 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ec0094d0 con 0x7f11fc0c5150 2024-01-17T22:59:32.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.988+0000 7f1201e00640 1 --2- 172.21.15.161:0/3322026711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11fc0c5150 0x7f11fc1444f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f11f400c7b0 tx=0x7f11f400cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.996+0000 7f11f9600640 1 -- 172.21.15.161:0/3322026711 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f4003d90 con 0x7f11fc0c5150 2024-01-17T22:59:32.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.996+0000 7f11f9600640 1 -- 172.21.15.161:0/3322026711 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f4005070 con 0x7f11fc0c5150 2024-01-17T22:59:32.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.996+0000 7f11f9600640 1 -- 172.21.15.161:0/3322026711 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f4005420 con 0x7f11fc0c5150 2024-01-17T22:59:32.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.996+0000 7f1203e00640 1 -- 172.21.15.161:0/3322026711 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11fc14b370 con 0x7f11fc0c5150 2024-01-17T22:59:32.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:32.996+0000 7f1203e00640 1 -- 172.21.15.161:0/3322026711 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11fc153bb0 con 0x7f11fc0c5150 2024-01-17T22:59:32.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.000+0000 7f1203e00640 1 -- 172.21.15.161:0/3322026711 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11cc0052a0 con 0x7f11fc0c5150 2024-01-17T22:59:33.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.008+0000 7fa786600640 1 Processor -- start 2024-01-17T22:59:33.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.008+0000 7fa786600640 1 -- start start 2024-01-17T22:59:33.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.008+0000 7fa786600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7800c3fa0 0x7fa78015e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.008+0000 7fa786600640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa780061100 0x7fa780061590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.008+0000 7fa786600640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7801611c0 con 0x7fa7800c3bc0 2024-01-17T22:59:33.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.008+0000 7fa786600640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7800c7cd0 con 0x7fa780061100 2024-01-17T22:59:33.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.008+0000 7fa786600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7801613f0 con 0x7fa7800c3fa0 2024-01-17T22:59:33.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.012+0000 7fc809e00640 1 Processor -- start 2024-01-17T22:59:33.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.016+0000 7fc809e00640 1 -- start start 2024-01-17T22:59:33.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.016+0000 7fc809e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc8041517f0 0x7fc80415b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.016+0000 7fc809e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8040c7d10 con 0x7fc8040ca3a0 2024-01-17T22:59:33.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.016+0000 7fc809e00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8041576d0 con 0x7fc8040ca780 2024-01-17T22:59:33.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.016+0000 7fc809e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc804157970 con 0x7fc8041517f0 2024-01-17T22:59:33.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.032+0000 7f09d1400640 1 Processor -- start 2024-01-17T22:59:33.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.032+0000 7f09d1400640 1 -- start start 2024-01-17T22:59:33.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.032+0000 7f09d1400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09cc15b620 0x7f09cc061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.032+0000 7f09d1400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f09cc061640 0x7f09cc0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.032+0000 7f09d1400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09cc0c7d10 con 0x7f09cc1517f0 2024-01-17T22:59:33.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.032+0000 7f09d1400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09cc1576d0 con 0x7f09cc061640 2024-01-17T22:59:33.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.032+0000 7f09d1400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc157970 con 0x7f09cc15b620 2024-01-17T22:59:33.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.052+0000 7fa77ea00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7800c3fa0 0x7fa78015e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.052+0000 7f11f9600640 1 -- 172.21.15.161:0/3322026711 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f11f4005580 con 0x7f11fc0c5150 2024-01-17T22:59:33.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.056+0000 7f11f9600640 1 --2- 172.21.15.161:0/3322026711 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f11d4066890 0x7f11d4068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.056+0000 7f1201400640 1 --2- 172.21.15.161:0/3322026711 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f11d4066890 0x7f11d4068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.056+0000 7f1201400640 1 --2- 172.21.15.161:0/3322026711 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f11d4066890 0x7f11d4068d50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009690 tx=0x7f11e4006c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:33.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.056+0000 7f5293400640 1 -- 172.21.15.161:0/2625223730 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f528c0b7040 con 0x7f529c0c8340 2024-01-17T22:59:33.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.056+0000 7f5293400640 1 --2- 172.21.15.161:0/2625223730 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f52740668c0 0x7f5274068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.056+0000 7f529b400640 1 --2- 172.21.15.161:0/2625223730 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f52740668c0 0x7f5274068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.060+0000 7f529b400640 1 --2- 172.21.15.161:0/2625223730 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f52740668c0 0x7f5274068d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f52840011f0 tx=0x7f5284007d40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:33.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.092+0000 7fcb0e600640 1 Processor -- start 2024-01-17T22:59:33.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.092+0000 7fcb0e600640 1 -- start start 2024-01-17T22:59:33.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.092+0000 7fcb0e600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb081517f0 0x7fcb0815b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.096+0000 7fcb0e600640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcb080ca3a0 0x7fcb08061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.096+0000 7fcb0e600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcb080ca780 0x7fcb08061640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.096+0000 7fcb0e600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb080c7d10 con 0x7fcb080ca780 2024-01-17T22:59:33.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.096+0000 7fcb0e600640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb081576d0 con 0x7fcb080ca3a0 2024-01-17T22:59:33.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.096+0000 7fcb0e600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb08157970 con 0x7fcb081517f0 2024-01-17T22:59:33.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.132+0000 7fb79d600640 1 Processor -- start 2024-01-17T22:59:33.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.132+0000 7fb79d600640 1 -- start start 2024-01-17T22:59:33.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.136+0000 7fb79d600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb7981539a0 0x7fb7980ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.136+0000 7fb79d600640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb7980c79c0 0x7fb798061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.136+0000 7fb79d600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7980c9890 con 0x7fb798061640 2024-01-17T22:59:33.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.136+0000 7fb79d600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb79806d570 con 0x7fb7981539a0 2024-01-17T22:59:33.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.136+0000 7fb79d600640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb798159bf0 con 0x7fb7980c79c0 2024-01-17T22:59:33.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.192+0000 7f5293400640 1 -- 172.21.15.161:0/2625223730 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f528c0f3ef0 con 0x7f529c0c8340 2024-01-17T22:59:33.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.192+0000 7f5293400640 1 -- 172.21.15.161:0/2625223730 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f528c0efb30 con 0x7f529c0c8340 2024-01-17T22:59:33.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.196+0000 7fc802a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc8041517f0 0x7fc80415b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.200+0000 7fc802a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc8041517f0 0x7fc80415b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60426/0 (socket says 172.21.15.161:60426) 2024-01-17T22:59:33.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.200+0000 7fc802a00640 1 -- 172.21.15.161:0/3084207032 learned_addr learned my addr 172.21.15.161:0/3084207032 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:33.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.204+0000 7fc802a00640 1 -- 172.21.15.161:0/3084207032 >> v1:172.21.15.190:6789/0 conn(0x7fc8040ca780 legacy=0x7fc8040c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:33.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.204+0000 7fc802a00640 1 -- 172.21.15.161:0/3084207032 >> v1:172.21.15.161:6789/0 conn(0x7fc8040ca3a0 legacy=0x7fc804061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:33.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.204+0000 7fc802a00640 1 -- 172.21.15.161:0/3084207032 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc804157c50 con 0x7fc8041517f0 2024-01-17T22:59:33.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.204+0000 7fcb07e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcb080ca780 0x7fcb08061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.204+0000 7fb796a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb7981539a0 0x7fb7980ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.204+0000 7fcb07e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcb080ca780 0x7fcb08061640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60446/0 (socket says 172.21.15.161:60446) 2024-01-17T22:59:33.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.204+0000 7fcb07e00640 1 -- 172.21.15.161:0/2139648467 learned_addr learned my addr 172.21.15.161:0/2139648467 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:33.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.204+0000 7fb796a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb7981539a0 0x7fb7980ca410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60460/0 (socket says 172.21.15.161:60460) 2024-01-17T22:59:33.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.204+0000 7fb796a00640 1 -- 172.21.15.161:0/1049464674 learned_addr learned my addr 172.21.15.161:0/1049464674 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:33.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.208+0000 7fcb07e00640 1 -- 172.21.15.161:0/2139648467 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb081517f0 msgr2=0x7fcb0815b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:33.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.208+0000 7fcb07e00640 1 --2- 172.21.15.161:0/2139648467 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb081517f0 0x7fcb0815b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.208+0000 7fcb07e00640 1 -- 172.21.15.161:0/2139648467 >> v2:172.21.15.190:3300/0 conn(0x7fcb080ca3a0 msgr2=0x7fcb08061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:33.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.208+0000 7fcb07e00640 1 --2- 172.21.15.161:0/2139648467 >> v2:172.21.15.190:3300/0 conn(0x7fcb080ca3a0 0x7fcb08061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.208+0000 7fcb07e00640 1 -- 172.21.15.161:0/2139648467 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb08157c50 con 0x7fcb080ca780 2024-01-17T22:59:33.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.212+0000 7f09cb200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f09cc061640 0x7f09cc0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.212+0000 7f09cb200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f09cc061640 0x7f09cc0c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60432/0 (socket says 172.21.15.161:60432) 2024-01-17T22:59:33.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.212+0000 7f09cb200640 1 -- 172.21.15.161:0/3238466261 learned_addr learned my addr 172.21.15.161:0/3238466261 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:33.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.212+0000 7fb796a00640 1 -- 172.21.15.161:0/1049464674 >> v2:172.21.15.190:3300/0 conn(0x7fb7980c79c0 msgr2=0x7fb798061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:33.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.212+0000 7fb796a00640 1 --2- 172.21.15.161:0/1049464674 >> v2:172.21.15.190:3300/0 conn(0x7fb7980c79c0 0x7fb798061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.212+0000 7fb796a00640 1 -- 172.21.15.161:0/1049464674 >> v1:172.21.15.161:6789/0 conn(0x7fb798061640 legacy=0x7fb79815d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:33.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.212+0000 7fb796a00640 1 -- 172.21.15.161:0/1049464674 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb798159eb0 con 0x7fb7981539a0 2024-01-17T22:59:33.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.220+0000 7f09cb200640 1 -- 172.21.15.161:0/3238466261 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09cc15b620 msgr2=0x7f09cc061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:33.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.220+0000 7f09cb200640 1 --2- 172.21.15.161:0/3238466261 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09cc15b620 0x7f09cc061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.220+0000 7f09cb200640 1 -- 172.21.15.161:0/3238466261 >> v1:172.21.15.161:6789/0 conn(0x7f09cc1517f0 legacy=0x7f09cc0ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:33.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.220+0000 7f09cb200640 1 -- 172.21.15.161:0/3238466261 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc157c50 con 0x7f09cc061640 2024-01-17T22:59:33.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.220+0000 7fc802a00640 1 --2- 172.21.15.161:0/3084207032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8041517f0 0x7fc80415b620 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009870 tx=0x7fc7f401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a5f5d9bacb1904 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:33.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.220+0000 7fcb07e00640 1 --2- 172.21.15.161:0/2139648467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb080ca780 0x7fcb08061640 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcb080ce020 tx=0x7fcaf801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf85a2c9def1d1bf server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:33.243 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.244+0000 7fc801600640 1 -- 172.21.15.161:0/3084207032 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f40aa620 con 0x7fc8041517f0 2024-01-17T22:59:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.244+0000 7fc801600640 1 -- 172.21.15.161:0/3084207032 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f40aa780 con 0x7fc8041517f0 2024-01-17T22:59:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.244+0000 7fc801600640 1 -- 172.21.15.161:0/3084207032 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f40aab10 con 0x7fc8041517f0 2024-01-17T22:59:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.248+0000 7fc809e00640 1 -- 172.21.15.161:0/3084207032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8041517f0 msgr2=0x7fc80415b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.248+0000 7fc809e00640 1 --2- 172.21.15.161:0/3084207032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8041517f0 0x7fc80415b620 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009870 tx=0x7fc7f401c4c0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.248+0000 7fc809e00640 1 -- 172.21.15.161:0/3084207032 shutdown_connections 2024-01-17T22:59:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.248+0000 7fc809e00640 1 --2- 172.21.15.161:0/3084207032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8041517f0 0x7fc80415b620 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.248+0000 7fc809e00640 1 -- 172.21.15.161:0/3084207032 >> 172.21.15.161:0/3084207032 conn(0x7fc80406ad40 msgr2=0x7fc80406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.248+0000 7fb99f400640 1 -- 172.21.15.161:0/1057375681 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fb9a000a7f0 con 0x7fb9a80c8980 2024-01-17T22:59:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.248+0000 7fc809e00640 1 -- 172.21.15.161:0/3084207032 shutdown_connections 2024-01-17T22:59:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.248+0000 7fc809e00640 1 -- 172.21.15.161:0/3084207032 wait complete. 2024-01-17T22:59:33.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.248+0000 7f09cb200640 1 --2- 172.21.15.161:0/3238466261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09cc061640 0x7f09cc0c8a30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f09c4009e50 tx=0x7f09c401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2019e85e89666cc server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:33.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.248+0000 7fb99f400640 1 --2- 172.21.15.161:0/1057375681 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb980066900 0x7fb980068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.248+0000 7fb9a7400640 1 --2- 172.21.15.161:0/1057375681 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb980066900 0x7fb980068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.248+0000 7fb9a7400640 1 --2- 172.21.15.161:0/1057375681 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb980066900 0x7fb980068dc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb998000f70 tx=0x7fb998007a90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:33.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.248+0000 7fc809e00640 1 Processor -- start 2024-01-17T22:59:33.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.248+0000 7fb796a00640 1 --2- 172.21.15.161:0/1049464674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7981539a0 0x7fb7980ca410 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb7980c8150 tx=0x7fb78801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159a70e146685d7f server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:33.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.248+0000 7fc809e00640 1 -- start start 2024-01-17T22:59:33.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fc809e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8040ca3a0 0x7fc8041437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fc809e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8040ca780 0x7fc80406bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fc809e00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8041517f0 0x7fc80406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fc809e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80406cef0 con 0x7fc8040ca3a0 2024-01-17T22:59:33.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fc809e00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80406d170 con 0x7fc8041517f0 2024-01-17T22:59:33.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fc809e00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8041588b0 con 0x7fc8040ca780 2024-01-17T22:59:33.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fcb06000640 1 -- 172.21.15.161:0/2139648467 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf80aa620 con 0x7fcb080ca780 2024-01-17T22:59:33.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fcb06000640 1 -- 172.21.15.161:0/2139648467 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf80aa780 con 0x7fcb080ca780 2024-01-17T22:59:33.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fcb06000640 1 -- 172.21.15.161:0/2139648467 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf80aab10 con 0x7fcb080ca780 2024-01-17T22:59:33.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fb99f400640 1 -- 172.21.15.161:0/1057375681 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fb9a000ce40 con 0x7fb9a80c8980 2024-01-17T22:59:33.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fcb0e600640 1 -- 172.21.15.161:0/2139648467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb080ca780 msgr2=0x7fcb08061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fcb0e600640 1 --2- 172.21.15.161:0/2139648467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb080ca780 0x7fcb08061640 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcb080ce020 tx=0x7fcaf801c500 comp rx=0 tx=0).stop 2024-01-17T22:59:33.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fcb0e600640 1 -- 172.21.15.161:0/2139648467 shutdown_connections 2024-01-17T22:59:33.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fcb0e600640 1 --2- 172.21.15.161:0/2139648467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb080ca780 0x7fcb08061640 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fcb0e600640 1 --2- 172.21.15.161:0/2139648467 >> v2:172.21.15.190:3300/0 conn(0x7fcb080ca3a0 0x7fcb08061100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fcb0e600640 1 --2- 172.21.15.161:0/2139648467 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb081517f0 0x7fcb0815b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fcb0e600640 1 -- 172.21.15.161:0/2139648467 >> 172.21.15.161:0/2139648467 conn(0x7fcb0806ad40 msgr2=0x7fcb0806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:33.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fcb0e600640 1 -- 172.21.15.161:0/2139648467 shutdown_connections 2024-01-17T22:59:33.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.252+0000 7fcb0e600640 1 -- 172.21.15.161:0/2139648467 wait complete. 2024-01-17T22:59:33.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.256+0000 7fcb0e600640 1 Processor -- start 2024-01-17T22:59:33.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.256+0000 7fcb0e600640 1 -- start start 2024-01-17T22:59:33.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.256+0000 7fcb0e600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb080ca3a0 0x7fcb08147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.256+0000 7fcb0e600640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb080ca780 0x7fcb0806c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.256+0000 7fcb0e600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb081517f0 0x7fcb0806ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.256+0000 7fcb0e600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb081570f0 con 0x7fcb081517f0 2024-01-17T22:59:33.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.256+0000 7fcb0e600640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb081f5880 con 0x7fcb080ca780 2024-01-17T22:59:33.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.256+0000 7fcb0e600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb081f5b20 con 0x7fcb080ca3a0 2024-01-17T22:59:33.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7fc802a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8040ca3a0 0x7fc8041437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7f09c9400640 1 -- 172.21.15.161:0/3238466261 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c40a5850 con 0x7f09cc061640 2024-01-17T22:59:33.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7f09c9400640 1 -- 172.21.15.161:0/3238466261 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c40a59b0 con 0x7f09cc061640 2024-01-17T22:59:33.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7f09c9400640 1 -- 172.21.15.161:0/3238466261 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c40a5d40 con 0x7f09cc061640 2024-01-17T22:59:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7fb795600640 1 -- 172.21.15.161:0/1049464674 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7880aa620 con 0x7fb7981539a0 2024-01-17T22:59:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7fb795600640 1 -- 172.21.15.161:0/1049464674 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7880aa780 con 0x7fb7981539a0 2024-01-17T22:59:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7fb795600640 1 -- 172.21.15.161:0/1049464674 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7880aab10 con 0x7fb7981539a0 2024-01-17T22:59:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7f09d1400640 1 -- 172.21.15.161:0/3238466261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09cc061640 msgr2=0x7f09cc0c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7f09d1400640 1 --2- 172.21.15.161:0/3238466261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09cc061640 0x7f09cc0c8a30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f09c4009e50 tx=0x7f09c401c9d0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7f09d1400640 1 -- 172.21.15.161:0/3238466261 shutdown_connections 2024-01-17T22:59:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7f09d1400640 1 --2- 172.21.15.161:0/3238466261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09cc061640 0x7f09cc0c8a30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7f09d1400640 1 --2- 172.21.15.161:0/3238466261 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09cc15b620 0x7f09cc061100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7f09d1400640 1 -- 172.21.15.161:0/3238466261 >> 172.21.15.161:0/3238466261 conn(0x7f09cc06ad40 msgr2=0x7f09cc06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7fb79d600640 1 -- 172.21.15.161:0/1049464674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7981539a0 msgr2=0x7fb7980ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7fb79d600640 1 --2- 172.21.15.161:0/1049464674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7981539a0 0x7fb7980ca410 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb7980c8150 tx=0x7fb78801c4c0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7fc802a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8040ca3a0 0x7fc8041437a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60476/0 (socket says 172.21.15.161:60476) 2024-01-17T22:59:33.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7fc802a00640 1 -- 172.21.15.161:0/3906033561 learned_addr learned my addr 172.21.15.161:0/3906033561 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:33.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7f09d1400640 1 -- 172.21.15.161:0/3238466261 shutdown_connections 2024-01-17T22:59:33.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7f09d1400640 1 -- 172.21.15.161:0/3238466261 wait complete. 2024-01-17T22:59:33.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7fb79d600640 1 -- 172.21.15.161:0/1049464674 shutdown_connections 2024-01-17T22:59:33.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7fb79d600640 1 --2- 172.21.15.161:0/1049464674 >> v2:172.21.15.190:3300/0 conn(0x7fb7980c79c0 0x7fb798061100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7fb79d600640 1 --2- 172.21.15.161:0/1049464674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7981539a0 0x7fb7980ca410 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7fb79d600640 1 -- 172.21.15.161:0/1049464674 >> 172.21.15.161:0/1049464674 conn(0x7fb79806ad40 msgr2=0x7fb79806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:33.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7fb79d600640 1 -- 172.21.15.161:0/1049464674 shutdown_connections 2024-01-17T22:59:33.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.260+0000 7fb79d600640 1 -- 172.21.15.161:0/1049464674 wait complete. 2024-01-17T22:59:33.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.264+0000 7f09d1400640 1 Processor -- start 2024-01-17T22:59:33.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.264+0000 7f09d1400640 1 -- start start 2024-01-17T22:59:33.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.264+0000 7fb79d600640 1 Processor -- start 2024-01-17T22:59:33.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.264+0000 7fb79d600640 1 -- start start 2024-01-17T22:59:33.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.264+0000 7f09d1400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f09cc061640 0x7f09cc1f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.264+0000 7f09d1400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09cc1517f0 0x7f09cc14edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.264+0000 7f09d1400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09cc15b620 0x7f09cc150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.264+0000 7f09d1400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc0b06d0 con 0x7f09cc1517f0 2024-01-17T22:59:33.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.264+0000 7f09d1400640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc143300 con 0x7f09cc061640 2024-01-17T22:59:33.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.264+0000 7f09d1400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc1435e0 con 0x7f09cc15b620 2024-01-17T22:59:33.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.264+0000 7fb79d600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb798061640 0x7fb79814ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.264+0000 7fb79d600640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7980c79c0 0x7fb79814b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.264+0000 7fb79d600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7981539a0 0x7fb7980b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.264+0000 7fb79d600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb798154650 con 0x7fb798061640 2024-01-17T22:59:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.264+0000 7fb79d600640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb798155900 con 0x7fb7980c79c0 2024-01-17T22:59:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.264+0000 7fb79d600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79815bef0 con 0x7fb7981539a0 2024-01-17T22:59:33.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.268+0000 7fc802a00640 1 -- 172.21.15.161:0/3906033561 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8040ca780 msgr2=0x7fc80406bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.268+0000 7fc802a00640 1 --2- 172.21.15.161:0/3906033561 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8040ca780 0x7fc80406bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.268+0000 7fc802a00640 1 -- 172.21.15.161:0/3906033561 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8041517f0 msgr2=0x7fc80406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.268+0000 7fc802a00640 1 --2- 172.21.15.161:0/3906033561 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8041517f0 0x7fc80406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.268+0000 7fc802a00640 1 -- 172.21.15.161:0/3906033561 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f40094d0 con 0x7fc8040ca3a0 2024-01-17T22:59:33.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.268+0000 7fb99f400640 1 -- 172.21.15.161:0/1057375681 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fb9a00517b0 con 0x7fb9a80c8980 2024-01-17T22:59:33.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.276+0000 7fc802a00640 1 --2- 172.21.15.161:0/3906033561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8040ca3a0 0x7fc8041437a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40ac040 tx=0x7fc7f401ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:33.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.276+0000 7f09c9e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09cc1517f0 0x7f09cc14edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.276+0000 7f09c9e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09cc1517f0 0x7f09cc14edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60504/0 (socket says 172.21.15.161:60504) 2024-01-17T22:59:33.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.276+0000 7f09c9e00640 1 -- 172.21.15.161:0/1011388388 learned_addr learned my addr 172.21.15.161:0/1011388388 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:33.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.276+0000 7fb796a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb798061640 0x7fb79814ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.276+0000 7fb796a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb798061640 0x7fb79814ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60490/0 (socket says 172.21.15.161:60490) 2024-01-17T22:59:33.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.276+0000 7fb796a00640 1 -- 172.21.15.161:0/2864179770 learned_addr learned my addr 172.21.15.161:0/2864179770 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:33.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.280+0000 7fcb06a00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb080ca780 0x7fcb0806c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.280+0000 7fcb06a00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb080ca780 0x7fcb0806c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:49506/0 (socket says 172.21.15.161:49506) 2024-01-17T22:59:33.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.280+0000 7fcb06a00640 1 -- 172.21.15.161:0/2056353224 learned_addr learned my addr 172.21.15.161:0/2056353224 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:33.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.284+0000 7f09c9e00640 1 -- 172.21.15.161:0/1011388388 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09cc15b620 msgr2=0x7f09cc150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.284+0000 7f09c9e00640 1 --2- 172.21.15.161:0/1011388388 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09cc15b620 0x7f09cc150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.284+0000 7f09c9e00640 1 -- 172.21.15.161:0/1011388388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f09cc061640 msgr2=0x7f09cc1f0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.284+0000 7f09c9e00640 1 --2- 172.21.15.161:0/1011388388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f09cc061640 0x7f09cc1f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.284+0000 7f09c9e00640 1 -- 172.21.15.161:0/1011388388 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c4009b30 con 0x7f09cc1517f0 2024-01-17T22:59:33.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.284+0000 7fcb06a00640 1 -- 172.21.15.161:0/2056353224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb080ca3a0 msgr2=0x7fcb08147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.284+0000 7fcb06a00640 1 --2- 172.21.15.161:0/2056353224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb080ca3a0 0x7fcb08147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.284+0000 7fcb06a00640 1 -- 172.21.15.161:0/2056353224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb081517f0 msgr2=0x7fcb0806ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.284+0000 7fcb06a00640 1 --2- 172.21.15.161:0/2056353224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb081517f0 0x7fcb0806ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.284+0000 7fcb06a00640 1 -- 172.21.15.161:0/2056353224 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf80094d0 con 0x7fcb080ca780 2024-01-17T22:59:33.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.292+0000 7fcb06a00640 1 --2- 172.21.15.161:0/2056353224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb080ca780 0x7fcb0806c970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000b550 tx=0x7fcaf000ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:33.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.292+0000 7fb796000640 1 --2- 172.21.15.161:0/2864179770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7980c79c0 0x7fb79814b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.292+0000 7fb796a00640 1 -- 172.21.15.161:0/2864179770 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7981539a0 msgr2=0x7fb7980b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.292+0000 7fb796a00640 1 --2- 172.21.15.161:0/2864179770 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7981539a0 0x7fb7980b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.292+0000 7fb796a00640 1 -- 172.21.15.161:0/2864179770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7980c79c0 msgr2=0x7fb79814b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.292+0000 7fb796a00640 1 --2- 172.21.15.161:0/2864179770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7980c79c0 0x7fb79814b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.292+0000 7fb796a00640 1 -- 172.21.15.161:0/2864179770 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7880094d0 con 0x7fb798061640 2024-01-17T22:59:33.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.292+0000 7f09c9e00640 1 --2- 172.21.15.161:0/1011388388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09cc1517f0 0x7f09cc14edf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f09b400b410 tx=0x7f09b400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:33.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.292+0000 7fa77fe00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa780061100 0x7fa780061590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.296+0000 7fb796a00640 1 --2- 172.21.15.161:0/2864179770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb798061640 0x7fb79814ad70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb78801a0f0 tx=0x7fb78801ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:33.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.300+0000 7fa77fe00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa780061100 0x7fa780061590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:49476/0 (socket says 172.21.15.161:49476) 2024-01-17T22:59:33.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.300+0000 7fa77fe00640 1 -- 172.21.15.161:0/3577222392 learned_addr learned my addr 172.21.15.161:0/3577222392 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:33.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.304+0000 7fc7fb400640 1 -- 172.21.15.161:0/3906033561 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f40bd5f0 con 0x7fc8040ca3a0 2024-01-17T22:59:33.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.308+0000 7fc7fb400640 1 -- 172.21.15.161:0/3906033561 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f40bd750 con 0x7fc8040ca3a0 2024-01-17T22:59:33.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.308+0000 7fc7fb400640 1 -- 172.21.15.161:0/3906033561 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f40bdb00 con 0x7fc8040ca3a0 2024-01-17T22:59:33.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.308+0000 7fc809e00640 1 -- 172.21.15.161:0/3906033561 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc804158b90 con 0x7fc8040ca3a0 2024-01-17T22:59:33.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.308+0000 7fc809e00640 1 -- 172.21.15.161:0/3906033561 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc804143ce0 con 0x7fc8040ca3a0 2024-01-17T22:59:33.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.308+0000 7fa77fe00640 1 -- 172.21.15.161:0/3577222392 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7800c3fa0 msgr2=0x7fa78015e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:33.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.308+0000 7fa77fe00640 1 --2- 172.21.15.161:0/3577222392 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7800c3fa0 0x7fa78015e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.308+0000 7fa77fe00640 1 -- 172.21.15.161:0/3577222392 >> v1:172.21.15.190:6789/0 conn(0x7fa7800c3bc0 legacy=0x7fa7800ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:33.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.308+0000 7fa77fe00640 1 -- 172.21.15.161:0/3577222392 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa780161690 con 0x7fa780061100 2024-01-17T22:59:33.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.308+0000 7f09c2a00640 1 -- 172.21.15.161:0/1011388388 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b4011830 con 0x7f09cc1517f0 2024-01-17T22:59:33.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.308+0000 7f09c2a00640 1 -- 172.21.15.161:0/1011388388 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b40119b0 con 0x7f09cc1517f0 2024-01-17T22:59:33.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.308+0000 7f09c2a00640 1 -- 172.21.15.161:0/1011388388 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b4011d60 con 0x7f09cc1517f0 2024-01-17T22:59:33.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.308+0000 7f09d1400640 1 -- 172.21.15.161:0/1011388388 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09cc1eff40 con 0x7f09cc1517f0 2024-01-17T22:59:33.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.308+0000 7f09d1400640 1 -- 172.21.15.161:0/1011388388 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09cc1f0500 con 0x7f09cc1517f0 2024-01-17T22:59:33.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.308+0000 7fc809e00640 1 -- 172.21.15.161:0/3906033561 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc804158710 con 0x7fc8040ca3a0 2024-01-17T22:59:33.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.308+0000 7f09d1400640 1 -- 172.21.15.161:0/1011388388 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09cc1f0720 con 0x7f09cc1517f0 2024-01-17T22:59:33.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.312+0000 7fcaff400640 1 -- 172.21.15.161:0/2056353224 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0011890 con 0x7fcb080ca780 2024-01-17T22:59:33.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.312+0000 7fcaff400640 1 -- 172.21.15.161:0/2056353224 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf0011a10 con 0x7fcb080ca780 2024-01-17T22:59:33.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.312+0000 7fcaff400640 1 -- 172.21.15.161:0/2056353224 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0011dc0 con 0x7fcb080ca780 2024-01-17T22:59:33.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.312+0000 7fcb0e600640 1 -- 172.21.15.161:0/2056353224 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb081f5e00 con 0x7fcb080ca780 2024-01-17T22:59:33.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.312+0000 7fcb0e600640 1 -- 172.21.15.161:0/2056353224 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb081f63c0 con 0x7fcb080ca780 2024-01-17T22:59:33.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.312+0000 7fa77fe00640 1 --2- 172.21.15.161:0/3577222392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa780061100 0x7fa780061590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa778009e50 tx=0x7fa77801c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16fb5bd644a7a8bb server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:33.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.316+0000 7fcb0e600640 1 -- 172.21.15.161:0/2056353224 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0806c7a0 con 0x7fcb080ca780 2024-01-17T22:59:33.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.324+0000 7fa77e000640 1 -- 172.21.15.161:0/3577222392 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7780a5640 con 0x7fa780061100 2024-01-17T22:59:33.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.324+0000 7fa77e000640 1 -- 172.21.15.161:0/3577222392 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7780a57a0 con 0x7fa780061100 2024-01-17T22:59:33.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.324+0000 7fa77e000640 1 -- 172.21.15.161:0/3577222392 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7780a5b30 con 0x7fa780061100 2024-01-17T22:59:33.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.324+0000 7fa786600640 1 -- 172.21.15.161:0/3577222392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa780061100 msgr2=0x7fa780061590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.324+0000 7fa786600640 1 --2- 172.21.15.161:0/3577222392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa780061100 0x7fa780061590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa778009e50 tx=0x7fa77801c8b0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.328+0000 7fa786600640 1 -- 172.21.15.161:0/3577222392 shutdown_connections 2024-01-17T22:59:33.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.328+0000 7fa786600640 1 --2- 172.21.15.161:0/3577222392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa780061100 0x7fa780061590 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.328+0000 7fa786600640 1 --2- 172.21.15.161:0/3577222392 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7800c3fa0 0x7fa78015e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.328+0000 7fa786600640 1 -- 172.21.15.161:0/3577222392 >> 172.21.15.161:0/3577222392 conn(0x7fa78006ad40 msgr2=0x7fa78006f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:33.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.328+0000 7fa786600640 1 -- 172.21.15.161:0/3577222392 shutdown_connections 2024-01-17T22:59:33.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.328+0000 7fa786600640 1 -- 172.21.15.161:0/3577222392 wait complete. 2024-01-17T22:59:33.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.328+0000 7fa786600640 1 Processor -- start 2024-01-17T22:59:33.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.328+0000 7fa786600640 1 -- start start 2024-01-17T22:59:33.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.328+0000 7fa786600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa780061100 0x7fa780156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.328+0000 7fa786600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7800c3bc0 0x7fa7800cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.328+0000 7fa786600640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7800c3fa0 0x7fa7800caf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.328+0000 7fa786600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa780157380 con 0x7fa780061100 2024-01-17T22:59:33.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.328+0000 7fa786600640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa780157650 con 0x7fa7800c3fa0 2024-01-17T22:59:33.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.328+0000 7fa786600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7801f9ab0 con 0x7fa7800c3bc0 2024-01-17T22:59:33.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.340+0000 7fc7fb400640 1 -- 172.21.15.161:0/3906033561 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fc7f40b33f0 con 0x7fc8040ca3a0 2024-01-17T22:59:33.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.340+0000 7fc7fb400640 1 --2- 172.21.15.161:0/3906033561 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc7dc066890 0x7fc7dc068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.340+0000 7fc802000640 1 --2- 172.21.15.161:0/3906033561 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc7dc066890 0x7fc7dc068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.340+0000 7fc802000640 1 --2- 172.21.15.161:0/3906033561 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc7dc066890 0x7fc7dc068d50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc80406d750 tx=0x7fc7ec006bb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:33.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.380+0000 7f52a0c00640 1 -- 172.21.15.161:0/2625223730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f529c0746a0 con 0x7f529c0c8340 2024-01-17T22:59:33.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.380+0000 7f11f9600640 1 -- 172.21.15.161:0/3322026711 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f11f4055440 con 0x7f11fc0c5150 2024-01-17T22:59:33.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.416+0000 7f11f9600640 1 -- 172.21.15.161:0/3322026711 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f11f4051080 con 0x7f11fc0c5150 2024-01-17T22:59:33.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.436+0000 7fa77ea00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7800c3bc0 0x7fa7800cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.444+0000 7fa77ea00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7800c3bc0 0x7fa7800cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:40168/0 (socket says 172.21.15.161:40168) 2024-01-17T22:59:33.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.444+0000 7fa77ea00640 1 -- 172.21.15.161:0/6836711 learned_addr learned my addr 172.21.15.161:0/6836711 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:33.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.452+0000 7fa77ea00640 1 -- 172.21.15.161:0/6836711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7800c3fa0 msgr2=0x7fa7800caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.452+0000 7fa77ea00640 1 --2- 172.21.15.161:0/6836711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7800c3fa0 0x7fa7800caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.452+0000 7fa77ea00640 1 -- 172.21.15.161:0/6836711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa780061100 msgr2=0x7fa780156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.452+0000 7fa77ea00640 1 --2- 172.21.15.161:0/6836711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa780061100 0x7fa780156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.452+0000 7fa77ea00640 1 -- 172.21.15.161:0/6836711 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa778009b30 con 0x7fa7800c3bc0 2024-01-17T22:59:33.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.460+0000 7fa77ea00640 1 --2- 172.21.15.161:0/6836711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7800c3bc0 0x7fa7800cc640 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa76800c7f0 tx=0x7fa76800ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:33.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.460+0000 7fb9ae600640 1 -- 172.21.15.161:0/1057375681 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb9a80746a0 con 0x7fb9a80c8980 2024-01-17T22:59:33.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.468+0000 7fa777400640 1 -- 172.21.15.161:0/6836711 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7680077a0 con 0x7fa7800c3bc0 2024-01-17T22:59:33.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.468+0000 7fa777400640 1 -- 172.21.15.161:0/6836711 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa768007900 con 0x7fa7800c3bc0 2024-01-17T22:59:33.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.468+0000 7fa786600640 1 -- 172.21.15.161:0/6836711 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7801f9d90 con 0x7fa7800c3bc0 2024-01-17T22:59:33.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.468+0000 7fa777400640 1 -- 172.21.15.161:0/6836711 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768007cb0 con 0x7fa7800c3bc0 2024-01-17T22:59:33.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.468+0000 7fa786600640 1 -- 172.21.15.161:0/6836711 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7801fa350 con 0x7fa7800c3bc0 2024-01-17T22:59:33.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.468+0000 7fa786600640 1 -- 172.21.15.161:0/6836711 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7800746a0 con 0x7fa7800c3bc0 2024-01-17T22:59:33.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.528+0000 7fa777400640 1 -- 172.21.15.161:0/6836711 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fa768024480 con 0x7fa7800c3bc0 2024-01-17T22:59:33.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.528+0000 7fa777400640 1 --2- 172.21.15.161:0/6836711 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa758066890 0x7fa758068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.528+0000 7fa77f400640 1 --2- 172.21.15.161:0/6836711 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa758066890 0x7fa758068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.528+0000 7fa77f400640 1 --2- 172.21.15.161:0/6836711 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa758066890 0x7fa758068d50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa770007fd0 tx=0x7fa7700079a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:33.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.536+0000 7fa777400640 1 -- 172.21.15.161:0/6836711 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fa768055dd0 con 0x7fa7800c3bc0 2024-01-17T22:59:33.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.544+0000 7fb78ea00640 1 -- 172.21.15.161:0/2864179770 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7880bd3f0 con 0x7fb798061640 2024-01-17T22:59:33.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.544+0000 7fb79d600640 1 -- 172.21.15.161:0/2864179770 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb798154110 con 0x7fb798061640 2024-01-17T22:59:33.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.544+0000 7fb79d600640 1 -- 172.21.15.161:0/2864179770 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79815b5c0 con 0x7fb798061640 2024-01-17T22:59:33.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.544+0000 7fb79d600640 1 -- 172.21.15.161:0/2864179770 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb79806b620 con 0x7fb798061640 2024-01-17T22:59:33.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.588+0000 7f1203e00640 1 -- 172.21.15.161:0/3322026711 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f11cc005820 con 0x7f11fc0c5150 2024-01-17T22:59:33.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.628+0000 7fcaff400640 1 -- 172.21.15.161:0/2056353224 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fcaf001a400 con 0x7fcb080ca780 2024-01-17T22:59:33.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.632+0000 7fcaff400640 1 --2- 172.21.15.161:0/2056353224 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fcae0066890 0x7fcae0068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.632+0000 7fcb07400640 1 --2- 172.21.15.161:0/2056353224 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fcae0066890 0x7fcae0068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.632+0000 7fcb07400640 1 --2- 172.21.15.161:0/2056353224 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fcae0066890 0x7fcae0068d50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000ab90 tx=0x7fcb00009250 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:33.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.632+0000 7fcaff400640 1 -- 172.21.15.161:0/2056353224 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fcaf00560f0 con 0x7fcb080ca780 2024-01-17T22:59:33.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.668+0000 7fcaff400640 1 -- 172.21.15.161:0/2056353224 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fcaf0051d30 con 0x7fcb080ca780 2024-01-17T22:59:33.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.688+0000 7fb99f400640 1 -- 172.21.15.161:0/1057375681 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb9a0054dd0 con 0x7fb9a80c8980 2024-01-17T22:59:33.688 INFO:teuthology.orchestra.run.smithi161.stdout:55834574866 2024-01-17T22:59:33.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.692+0000 7fb9ae600640 1 -- 172.21.15.161:0/1057375681 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb980066900 msgr2=0x7fb980068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.692+0000 7fb9ae600640 1 --2- 172.21.15.161:0/1057375681 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb980066900 0x7fb980068dc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb998000f70 tx=0x7fb998007a90 comp rx=0 tx=0).stop 2024-01-17T22:59:33.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.692+0000 7fb9ae600640 1 -- 172.21.15.161:0/1057375681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9a80c8980 msgr2=0x7fb9a80c09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.692+0000 7fb9ae600640 1 --2- 172.21.15.161:0/1057375681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9a80c8980 0x7fb9a80c09f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000c730 tx=0x7fb9a000cbf0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.692+0000 7fb9ae600640 1 -- 172.21.15.161:0/1057375681 shutdown_connections 2024-01-17T22:59:33.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.692+0000 7fb9ae600640 1 --2- 172.21.15.161:0/1057375681 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb980066900 0x7fb980068dc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.692+0000 7fb9ae600640 1 --2- 172.21.15.161:0/1057375681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9a80c8980 0x7fb9a80c09f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.692+0000 7fb9ae600640 1 --2- 172.21.15.161:0/1057375681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9a80c5c90 0x7fb9a814bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.692+0000 7fb9ae600640 1 --2- 172.21.15.161:0/1057375681 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9a80713a0 0x7fb9a813cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.692+0000 7fb9ae600640 1 -- 172.21.15.161:0/1057375681 >> 172.21.15.161:0/1057375681 conn(0x7fb9a806e070 msgr2=0x7fb9a80c6290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:33.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.692+0000 7fb9ae600640 1 -- 172.21.15.161:0/1057375681 shutdown_connections 2024-01-17T22:59:33.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.692+0000 7fb9ae600640 1 -- 172.21.15.161:0/1057375681 wait complete. 2024-01-17T22:59:33.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574867 got 55834574866 for osd.5 2024-01-17T22:59:33.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.792+0000 7fb78ea00640 1 -- 172.21.15.161:0/2864179770 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7880bd550 con 0x7fb798061640 2024-01-17T22:59:33.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.792+0000 7fb78ea00640 1 -- 172.21.15.161:0/2864179770 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7880bd8c0 con 0x7fb798061640 2024-01-17T22:59:33.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.808+0000 7f09c2a00640 1 -- 172.21.15.161:0/1011388388 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f09b401a400 con 0x7f09cc1517f0 2024-01-17T22:59:33.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.808+0000 7f09c2a00640 1 --2- 172.21.15.161:0/1011388388 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f09a40668c0 0x7f09a4068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:33.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.808+0000 7f09ca800640 1 --2- 172.21.15.161:0/1011388388 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f09a40668c0 0x7f09a4068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:33.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.808+0000 7f09ca800640 1 --2- 172.21.15.161:0/1011388388 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f09a40668c0 0x7f09a4068d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f09bc007fd0 tx=0x7f09bc0079a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:33.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.824+0000 7f09c2a00640 1 -- 172.21.15.161:0/1011388388 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f09b4055db0 con 0x7f09cc1517f0 2024-01-17T22:59:33.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.824+0000 7f09c2a00640 1 -- 172.21.15.161:0/1011388388 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f09b40519f0 con 0x7f09cc1517f0 2024-01-17T22:59:33.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.828+0000 7fcb0e600640 1 -- 172.21.15.161:0/2056353224 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fcb08155980 con 0x7fcb080ca780 2024-01-17T22:59:33.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.832+0000 7f11f9600640 1 -- 172.21.15.161:0/3322026711 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f11f4017020 con 0x7f11fc0c5150 2024-01-17T22:59:33.831 INFO:teuthology.orchestra.run.smithi161.stdout:64424509456 2024-01-17T22:59:33.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.836+0000 7f1203e00640 1 -- 172.21.15.161:0/3322026711 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f11d4066890 msgr2=0x7f11d4068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.836+0000 7f1203e00640 1 --2- 172.21.15.161:0/3322026711 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f11d4066890 0x7f11d4068d50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009690 tx=0x7f11e4006c00 comp rx=0 tx=0).stop 2024-01-17T22:59:33.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.836+0000 7f1203e00640 1 -- 172.21.15.161:0/3322026711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11fc0c5150 msgr2=0x7f11fc1444f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.836+0000 7f1203e00640 1 --2- 172.21.15.161:0/3322026711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11fc0c5150 0x7f11fc1444f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f11f400c7b0 tx=0x7f11f400cc70 comp rx=0 tx=0).stop 2024-01-17T22:59:33.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.836+0000 7f1203e00640 1 -- 172.21.15.161:0/3322026711 shutdown_connections 2024-01-17T22:59:33.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.836+0000 7f1203e00640 1 --2- 172.21.15.161:0/3322026711 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f11d4066890 0x7f11d4068d50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.836+0000 7f1203e00640 1 --2- 172.21.15.161:0/3322026711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11fc0c5150 0x7f11fc1444f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.836+0000 7f1203e00640 1 --2- 172.21.15.161:0/3322026711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11fc06d7a0 0x7f11fc149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.836+0000 7f1203e00640 1 --2- 172.21.15.161:0/3322026711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11fc06d3c0 0x7f11fc1f69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.836+0000 7f1203e00640 1 -- 172.21.15.161:0/3322026711 >> 172.21.15.161:0/3322026711 conn(0x7f11fc06e070 msgr2=0x7f11fc0c3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:33.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.836+0000 7f1203e00640 1 -- 172.21.15.161:0/3322026711 shutdown_connections 2024-01-17T22:59:33.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.836+0000 7f1203e00640 1 -- 172.21.15.161:0/3322026711 wait complete. 2024-01-17T22:59:33.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.840+0000 7fcaff400640 1 -- 172.21.15.161:0/2056353224 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcaf0015020 con 0x7fcb080ca780 2024-01-17T22:59:33.838 INFO:teuthology.orchestra.run.smithi161.stdout:64424509457 2024-01-17T22:59:33.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.840+0000 7fc7fb400640 1 -- 172.21.15.161:0/3906033561 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fc7f40f0760 con 0x7fc8040ca3a0 2024-01-17T22:59:33.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.840+0000 7fc7fb400640 1 -- 172.21.15.161:0/3906033561 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fc7f40ec3e0 con 0x7fc8040ca3a0 2024-01-17T22:59:33.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.840+0000 7fcb0e600640 1 -- 172.21.15.161:0/2056353224 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fcae0066890 msgr2=0x7fcae0068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.840+0000 7fcb0e600640 1 --2- 172.21.15.161:0/2056353224 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fcae0066890 0x7fcae0068d50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000ab90 tx=0x7fcb00009250 comp rx=0 tx=0).stop 2024-01-17T22:59:33.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.840+0000 7fcb0e600640 1 -- 172.21.15.161:0/2056353224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb080ca780 msgr2=0x7fcb0806c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.840+0000 7fcb0e600640 1 --2- 172.21.15.161:0/2056353224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb080ca780 0x7fcb0806c970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000b550 tx=0x7fcaf000ba10 comp rx=0 tx=0).stop 2024-01-17T22:59:33.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.844+0000 7fcb0e600640 1 -- 172.21.15.161:0/2056353224 shutdown_connections 2024-01-17T22:59:33.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.844+0000 7fcb0e600640 1 --2- 172.21.15.161:0/2056353224 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fcae0066890 0x7fcae0068d50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.844+0000 7fcb0e600640 1 --2- 172.21.15.161:0/2056353224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb080ca780 0x7fcb0806c970 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.844+0000 7fcb0e600640 1 --2- 172.21.15.161:0/2056353224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb081517f0 0x7fcb0806ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.844+0000 7fcb0e600640 1 --2- 172.21.15.161:0/2056353224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb080ca3a0 0x7fcb08147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.844+0000 7fcb0e600640 1 -- 172.21.15.161:0/2056353224 >> 172.21.15.161:0/2056353224 conn(0x7fcb0806ad40 msgr2=0x7fcb080cc180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:33.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.844+0000 7fcb0e600640 1 -- 172.21.15.161:0/2056353224 shutdown_connections 2024-01-17T22:59:33.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.844+0000 7fcb0e600640 1 -- 172.21.15.161:0/2056353224 wait complete. 2024-01-17T22:59:33.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509456 for osd.1 2024-01-17T22:59:33.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:33.864+0000 7fa777400640 1 -- 172.21.15.161:0/6836711 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fa768051a10 con 0x7fa7800c3bc0 2024-01-17T22:59:33.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509459 got 64424509457 for osd.7 2024-01-17T22:59:33.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.000+0000 7f09d1400640 1 -- 172.21.15.161:0/1011388388 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f09cc0746a0 con 0x7f09cc1517f0 2024-01-17T22:59:34.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.016+0000 7fc809e00640 1 -- 172.21.15.161:0/3906033561 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc804158710 con 0x7fc8040ca3a0 2024-01-17T22:59:34.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.044+0000 7fa786600640 1 -- 172.21.15.161:0/6836711 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa7800c88e0 con 0x7fa7800c3bc0 2024-01-17T22:59:34.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.048+0000 7fa777400640 1 -- 172.21.15.161:0/6836711 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa76801f070 con 0x7fa7800c3bc0 2024-01-17T22:59:34.048 INFO:teuthology.orchestra.run.smithi161.stdout:60129542160 2024-01-17T22:59:34.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.052+0000 7fa786600640 1 -- 172.21.15.161:0/6836711 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa758066890 msgr2=0x7fa758068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.052+0000 7fa786600640 1 --2- 172.21.15.161:0/6836711 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa758066890 0x7fa758068d50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa770007fd0 tx=0x7fa7700079a0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.052+0000 7fa786600640 1 -- 172.21.15.161:0/6836711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7800c3bc0 msgr2=0x7fa7800cc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.052+0000 7fa786600640 1 --2- 172.21.15.161:0/6836711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7800c3bc0 0x7fa7800cc640 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa76800c7f0 tx=0x7fa76800ccb0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.052+0000 7fa786600640 1 -- 172.21.15.161:0/6836711 shutdown_connections 2024-01-17T22:59:34.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.052+0000 7fa786600640 1 --2- 172.21.15.161:0/6836711 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa758066890 0x7fa758068d50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.052+0000 7fa786600640 1 --2- 172.21.15.161:0/6836711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7800c3fa0 0x7fa7800caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.052+0000 7fa786600640 1 --2- 172.21.15.161:0/6836711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7800c3bc0 0x7fa7800cc640 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.052+0000 7fa786600640 1 --2- 172.21.15.161:0/6836711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa780061100 0x7fa780156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.052+0000 7fa786600640 1 -- 172.21.15.161:0/6836711 >> 172.21.15.161:0/6836711 conn(0x7fa78006ad40 msgr2=0x7fa780154570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:34.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.052+0000 7fa786600640 1 -- 172.21.15.161:0/6836711 shutdown_connections 2024-01-17T22:59:34.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.052+0000 7fa786600640 1 -- 172.21.15.161:0/6836711 wait complete. 2024-01-17T22:59:34.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542161 got 60129542160 for osd.0 2024-01-17T22:59:34.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.112+0000 7f5293400640 1 -- 172.21.15.161:0/2625223730 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f528c0b5070 con 0x7f529c0c8340 2024-01-17T22:59:34.111 INFO:teuthology.orchestra.run.smithi161.stdout:64424509456 2024-01-17T22:59:34.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.116+0000 7f52a0c00640 1 -- 172.21.15.161:0/2625223730 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f52740668c0 msgr2=0x7f5274068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.116+0000 7f52a0c00640 1 --2- 172.21.15.161:0/2625223730 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f52740668c0 0x7f5274068d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f52840011f0 tx=0x7f5284007d40 comp rx=0 tx=0).stop 2024-01-17T22:59:34.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.116+0000 7f52a0c00640 1 -- 172.21.15.161:0/2625223730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f529c0c8340 msgr2=0x7f529c0c3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.116+0000 7f52a0c00640 1 --2- 172.21.15.161:0/2625223730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f529c0c8340 0x7f529c0c3f80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f528c01c8a0 tx=0x7f528c01ba10 comp rx=0 tx=0).stop 2024-01-17T22:59:34.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.116+0000 7f52a0c00640 1 -- 172.21.15.161:0/2625223730 shutdown_connections 2024-01-17T22:59:34.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.116+0000 7f52a0c00640 1 --2- 172.21.15.161:0/2625223730 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f52740668c0 0x7f5274068d80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.116+0000 7f52a0c00640 1 --2- 172.21.15.161:0/2625223730 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f529c15df40 0x7f529c1571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.116+0000 7f52a0c00640 1 --2- 172.21.15.161:0/2625223730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f529c0c8340 0x7f529c0c3f80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.116+0000 7f52a0c00640 1 --2- 172.21.15.161:0/2625223730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f529c0728f0 0x7f529c1f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.116+0000 7f52a0c00640 1 -- 172.21.15.161:0/2625223730 >> 172.21.15.161:0/2625223730 conn(0x7f529c06ee50 msgr2=0x7f529c15c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:34.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.116+0000 7f52a0c00640 1 -- 172.21.15.161:0/2625223730 shutdown_connections 2024-01-17T22:59:34.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.116+0000 7f52a0c00640 1 -- 172.21.15.161:0/2625223730 wait complete. 2024-01-17T22:59:34.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.128+0000 7fb78ea00640 1 -- 172.21.15.161:0/2864179770 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fb7880b33f0 con 0x7fb798061640 2024-01-17T22:59:34.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.132+0000 7fb78ea00640 1 --2- 172.21.15.161:0/2864179770 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb770066870 0x7fb770068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:34.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.132+0000 7fb796000640 1 --2- 172.21.15.161:0/2864179770 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb770066870 0x7fb770068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:34.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.132+0000 7fb796000640 1 --2- 172.21.15.161:0/2864179770 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb770066870 0x7fb770068d30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb7980c9760 tx=0x7fb780008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:34.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509456 for osd.2 2024-01-17T22:59:34.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.144+0000 7fb78ea00640 1 -- 172.21.15.161:0/2864179770 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fb7880c8e30 con 0x7fb798061640 2024-01-17T22:59:34.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.144+0000 7fb78ea00640 1 -- 172.21.15.161:0/2864179770 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fb7880ebb70 con 0x7fb798061640 2024-01-17T22:59:34.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.216+0000 7f09c2a00640 1 -- 172.21.15.161:0/1011388388 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09b4015020 con 0x7f09cc1517f0 2024-01-17T22:59:34.214 INFO:teuthology.orchestra.run.smithi161.stdout:64424509456 2024-01-17T22:59:34.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.216+0000 7f09d1400640 1 -- 172.21.15.161:0/1011388388 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f09a40668c0 msgr2=0x7f09a4068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.216+0000 7f09d1400640 1 --2- 172.21.15.161:0/1011388388 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f09a40668c0 0x7f09a4068d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f09bc007fd0 tx=0x7f09bc0079a0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.216+0000 7f09d1400640 1 -- 172.21.15.161:0/1011388388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09cc1517f0 msgr2=0x7f09cc14edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.216+0000 7f09d1400640 1 --2- 172.21.15.161:0/1011388388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09cc1517f0 0x7f09cc14edf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f09b400b410 tx=0x7f09b400b8d0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.216+0000 7f09d1400640 1 -- 172.21.15.161:0/1011388388 shutdown_connections 2024-01-17T22:59:34.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.216+0000 7f09d1400640 1 --2- 172.21.15.161:0/1011388388 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f09a40668c0 0x7f09a4068d80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.216+0000 7f09d1400640 1 --2- 172.21.15.161:0/1011388388 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09cc15b620 0x7f09cc150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.216+0000 7f09d1400640 1 --2- 172.21.15.161:0/1011388388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09cc1517f0 0x7f09cc14edf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.216+0000 7f09d1400640 1 --2- 172.21.15.161:0/1011388388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f09cc061640 0x7f09cc1f0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.216+0000 7f09d1400640 1 -- 172.21.15.161:0/1011388388 >> 172.21.15.161:0/1011388388 conn(0x7f09cc06ad40 msgr2=0x7f09cc156e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:34.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.220+0000 7f09d1400640 1 -- 172.21.15.161:0/1011388388 shutdown_connections 2024-01-17T22:59:34.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.220+0000 7f09d1400640 1 -- 172.21.15.161:0/1011388388 wait complete. 2024-01-17T22:59:34.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.220+0000 7fc7fb400640 1 -- 172.21.15.161:0/3906033561 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc804158710 con 0x7fc8040ca3a0 2024-01-17T22:59:34.218 INFO:teuthology.orchestra.run.smithi161.stdout:64424509456 2024-01-17T22:59:34.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.224+0000 7fc809e00640 1 -- 172.21.15.161:0/3906033561 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc7dc066890 msgr2=0x7fc7dc068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.224+0000 7fc809e00640 1 --2- 172.21.15.161:0/3906033561 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc7dc066890 0x7fc7dc068d50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc80406d750 tx=0x7fc7ec006bb0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.224+0000 7fc809e00640 1 -- 172.21.15.161:0/3906033561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8040ca3a0 msgr2=0x7fc8041437a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.224+0000 7fc809e00640 1 --2- 172.21.15.161:0/3906033561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8040ca3a0 0x7fc8041437a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40ac040 tx=0x7fc7f401ad00 comp rx=0 tx=0).stop 2024-01-17T22:59:34.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.224+0000 7fc809e00640 1 -- 172.21.15.161:0/3906033561 shutdown_connections 2024-01-17T22:59:34.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.224+0000 7fc809e00640 1 --2- 172.21.15.161:0/3906033561 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc7dc066890 0x7fc7dc068d50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.224+0000 7fc809e00640 1 --2- 172.21.15.161:0/3906033561 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8041517f0 0x7fc80406c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.224+0000 7fc809e00640 1 --2- 172.21.15.161:0/3906033561 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8040ca780 0x7fc80406bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.224+0000 7fc809e00640 1 --2- 172.21.15.161:0/3906033561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8040ca3a0 0x7fc8041437a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.224+0000 7fc809e00640 1 -- 172.21.15.161:0/3906033561 >> 172.21.15.161:0/3906033561 conn(0x7fc80406ad40 msgr2=0x7fc8040cc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:34.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.224+0000 7fc809e00640 1 -- 172.21.15.161:0/3906033561 shutdown_connections 2024-01-17T22:59:34.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.224+0000 7fc809e00640 1 -- 172.21.15.161:0/3906033561 wait complete. 2024-01-17T22:59:34.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509456 for osd.6 2024-01-17T22:59:34.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509456 for osd.4 2024-01-17T22:59:34.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.324+0000 7fb79d600640 1 -- 172.21.15.161:0/2864179770 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb7980746a0 con 0x7fb798061640 2024-01-17T22:59:34.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.368+0000 7fb78ea00640 1 -- 172.21.15.161:0/2864179770 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb7880ef190 con 0x7fb798061640 2024-01-17T22:59:34.368 INFO:teuthology.orchestra.run.smithi161.stdout:64424509457 2024-01-17T22:59:34.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.372+0000 7fb79d600640 1 -- 172.21.15.161:0/2864179770 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb770066870 msgr2=0x7fb770068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.372+0000 7fb79d600640 1 --2- 172.21.15.161:0/2864179770 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb770066870 0x7fb770068d30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb7980c9760 tx=0x7fb780008040 comp rx=0 tx=0).stop 2024-01-17T22:59:34.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.372+0000 7fb79d600640 1 -- 172.21.15.161:0/2864179770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb798061640 msgr2=0x7fb79814ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.372+0000 7fb79d600640 1 --2- 172.21.15.161:0/2864179770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb798061640 0x7fb79814ad70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb78801a0f0 tx=0x7fb78801ad00 comp rx=0 tx=0).stop 2024-01-17T22:59:34.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.372+0000 7fb79d600640 1 -- 172.21.15.161:0/2864179770 shutdown_connections 2024-01-17T22:59:34.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.372+0000 7fb79d600640 1 --2- 172.21.15.161:0/2864179770 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb770066870 0x7fb770068d30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.372+0000 7fb79d600640 1 --2- 172.21.15.161:0/2864179770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7980c79c0 0x7fb79814b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.372+0000 7fb79d600640 1 --2- 172.21.15.161:0/2864179770 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7981539a0 0x7fb7980b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.372+0000 7fb79d600640 1 --2- 172.21.15.161:0/2864179770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb798061640 0x7fb79814ad70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.372+0000 7fb79d600640 1 -- 172.21.15.161:0/2864179770 >> 172.21.15.161:0/2864179770 conn(0x7fb79806ad40 msgr2=0x7fb79815d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:34.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.372+0000 7fb79d600640 1 -- 172.21.15.161:0/2864179770 shutdown_connections 2024-01-17T22:59:34.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.372+0000 7fb79d600640 1 -- 172.21.15.161:0/2864179770 wait complete. 2024-01-17T22:59:34.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509457 for osd.3 2024-01-17T22:59:34.713 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-17T22:59:34.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.852+0000 7fba20600640 1 Processor -- start 2024-01-17T22:59:34.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.852+0000 7fba20600640 1 -- start start 2024-01-17T22:59:34.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.852+0000 7fba20600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fba181517a0 0x7fba1806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:34.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.852+0000 7fba20600640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fba1806d210 0x7fba18072300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:34.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.852+0000 7fba20600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1815b9c0 con 0x7fba18072840 2024-01-17T22:59:34.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.852+0000 7fba20600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1815ae40 con 0x7fba181517a0 2024-01-17T22:59:34.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.852+0000 7fba20600640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1815b120 con 0x7fba1806d210 2024-01-17T22:59:34.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.852+0000 7fba1dc00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fba181517a0 0x7fba1806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:34.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.852+0000 7fba1dc00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fba181517a0 0x7fba1806ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60524/0 (socket says 172.21.15.161:60524) 2024-01-17T22:59:34.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.852+0000 7fba1dc00640 1 -- 172.21.15.161:0/3237032425 learned_addr learned my addr 172.21.15.161:0/3237032425 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:34.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.856+0000 7fba1d200640 1 --2- 172.21.15.161:0/3237032425 >> v2:172.21.15.190:3300/0 conn(0x7fba1806d210 0x7fba18072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:34.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.856+0000 7fba1dc00640 1 -- 172.21.15.161:0/3237032425 >> v2:172.21.15.190:3300/0 conn(0x7fba1806d210 msgr2=0x7fba18072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:34.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.856+0000 7fba1dc00640 1 --2- 172.21.15.161:0/3237032425 >> v2:172.21.15.190:3300/0 conn(0x7fba1806d210 0x7fba18072300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.856+0000 7fba1dc00640 1 -- 172.21.15.161:0/3237032425 >> v1:172.21.15.161:6789/0 conn(0x7fba18072840 legacy=0x7fba18157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.856+0000 7fba1dc00640 1 -- 172.21.15.161:0/3237032425 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1815b400 con 0x7fba181517a0 2024-01-17T22:59:34.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.860+0000 7fba1dc00640 1 --2- 172.21.15.161:0/3237032425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba181517a0 0x7fba1806ccd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fba180cbea0 tx=0x7fba0801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13233f42118f645c server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:34.860 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-17T22:59:34.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.864+0000 7fba17e00640 1 -- 172.21.15.161:0/3237032425 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba080aa660 con 0x7fba181517a0 2024-01-17T22:59:34.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.864+0000 7fba17e00640 1 -- 172.21.15.161:0/3237032425 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba080aa7c0 con 0x7fba181517a0 2024-01-17T22:59:34.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.864+0000 7fba17e00640 1 -- 172.21.15.161:0/3237032425 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba080aab50 con 0x7fba181517a0 2024-01-17T22:59:34.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.868+0000 7fba20600640 1 -- 172.21.15.161:0/3237032425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba181517a0 msgr2=0x7fba1806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.868+0000 7fba20600640 1 --2- 172.21.15.161:0/3237032425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba181517a0 0x7fba1806ccd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fba180cbea0 tx=0x7fba0801c500 comp rx=0 tx=0).stop 2024-01-17T22:59:34.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.868+0000 7fba20600640 1 -- 172.21.15.161:0/3237032425 shutdown_connections 2024-01-17T22:59:34.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.868+0000 7fba20600640 1 --2- 172.21.15.161:0/3237032425 >> v2:172.21.15.190:3300/0 conn(0x7fba1806d210 0x7fba18072300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.868+0000 7fba20600640 1 --2- 172.21.15.161:0/3237032425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba181517a0 0x7fba1806ccd0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.868+0000 7fba20600640 1 -- 172.21.15.161:0/3237032425 >> 172.21.15.161:0/3237032425 conn(0x7fba180cb070 msgr2=0x7fba180cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:34.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.868+0000 7fba20600640 1 -- 172.21.15.161:0/3237032425 shutdown_connections 2024-01-17T22:59:34.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.868+0000 7fba20600640 1 -- 172.21.15.161:0/3237032425 wait complete. 2024-01-17T22:59:34.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.868+0000 7fba20600640 1 Processor -- start 2024-01-17T22:59:34.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.868+0000 7fba20600640 1 -- start start 2024-01-17T22:59:34.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.868+0000 7fba20600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba1806d210 0x7fba18159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:34.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.868+0000 7fba20600640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba18072840 0x7fba18159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:34.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.868+0000 7fba20600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba181517a0 0x7fba181f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:34.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.868+0000 7fba20600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1814d970 con 0x7fba1806d210 2024-01-17T22:59:34.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.868+0000 7fba20600640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba18158fb0 con 0x7fba18072840 2024-01-17T22:59:34.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.868+0000 7fba20600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1814d0d0 con 0x7fba181517a0 2024-01-17T22:59:34.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.872+0000 7fba1dc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba1806d210 0x7fba18159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:34.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.872+0000 7fba1dc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba1806d210 0x7fba18159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60526/0 (socket says 172.21.15.161:60526) 2024-01-17T22:59:34.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.872+0000 7fba1dc00640 1 -- 172.21.15.161:0/2617196221 learned_addr learned my addr 172.21.15.161:0/2617196221 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:34.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.872+0000 7fba1d200640 1 --2- 172.21.15.161:0/2617196221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba18072840 0x7fba18159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:34.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.872+0000 7fba1e600640 1 --2- 172.21.15.161:0/2617196221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba181517a0 0x7fba181f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:34.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.876+0000 7fba1dc00640 1 -- 172.21.15.161:0/2617196221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba181517a0 msgr2=0x7fba181f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.876+0000 7fba1dc00640 1 --2- 172.21.15.161:0/2617196221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba181517a0 0x7fba181f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.876+0000 7fba1dc00640 1 -- 172.21.15.161:0/2617196221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba18072840 msgr2=0x7fba18159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.876+0000 7fba1dc00640 1 --2- 172.21.15.161:0/2617196221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba18072840 0x7fba18159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.876+0000 7fba1dc00640 1 -- 172.21.15.161:0/2617196221 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba080094d0 con 0x7fba1806d210 2024-01-17T22:59:34.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.876+0000 7fba1dc00640 1 --2- 172.21.15.161:0/2617196221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba1806d210 0x7fba18159440 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba0801a130 tx=0x7fba0801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:34.875 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-17T22:59:34.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.880+0000 7fba15600640 1 -- 172.21.15.161:0/2617196221 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba080b3800 con 0x7fba1806d210 2024-01-17T22:59:34.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.880+0000 7fba15600640 1 -- 172.21.15.161:0/2617196221 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba080b3960 con 0x7fba1806d210 2024-01-17T22:59:34.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.880+0000 7fba20600640 1 -- 172.21.15.161:0/2617196221 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1814d3b0 con 0x7fba1806d210 2024-01-17T22:59:34.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.880+0000 7fba15600640 1 -- 172.21.15.161:0/2617196221 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba080b3d10 con 0x7fba1806d210 2024-01-17T22:59:34.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.880+0000 7fba20600640 1 -- 172.21.15.161:0/2617196221 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba18158c40 con 0x7fba1806d210 2024-01-17T22:59:34.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.884+0000 7fba20600640 1 -- 172.21.15.161:0/2617196221 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba180746a0 con 0x7fba1806d210 2024-01-17T22:59:34.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.904+0000 7fba15600640 1 -- 172.21.15.161:0/2617196221 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fba080c6390 con 0x7fba1806d210 2024-01-17T22:59:34.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.908+0000 7fba15600640 1 --2- 172.21.15.161:0/2617196221 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb9f0066890 0x7fb9f0068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:34.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.908+0000 7fba1d200640 1 --2- 172.21.15.161:0/2617196221 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb9f0066890 0x7fb9f0068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:34.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:34.908+0000 7fba1d200640 1 --2- 172.21.15.161:0/2617196221 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb9f0066890 0x7fb9f0068d50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fba180c4fc0 tx=0x7fba00009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.004+0000 7fba15600640 1 -- 172.21.15.161:0/2617196221 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fba080a6040 con 0x7fba1806d210 2024-01-17T22:59:35.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.008+0000 7fd952400640 1 Processor -- start 2024-01-17T22:59:35.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.008+0000 7fd952400640 1 -- start start 2024-01-17T22:59:35.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.008+0000 7fd952400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd94c1517f0 0x7fd94c15b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.008+0000 7fd952400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd94c0ca3a0 0x7fd94c061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.008+0000 7fd952400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd94c0ca780 0x7fd94c061640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.008+0000 7fd952400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94c0c7d10 con 0x7fd94c1517f0 2024-01-17T22:59:35.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.008+0000 7fd952400640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94c1576d0 con 0x7fd94c0ca780 2024-01-17T22:59:35.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.008+0000 7fd952400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c157970 con 0x7fd94c0ca3a0 2024-01-17T22:59:35.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.012+0000 7fd94aa00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd94c0ca3a0 0x7fd94c061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.012+0000 7fd94be00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd94c0ca780 0x7fd94c061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.012+0000 7fd94be00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd94c0ca780 0x7fd94c061640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:49556/0 (socket says 172.21.15.161:49556) 2024-01-17T22:59:35.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.012+0000 7fd94be00640 1 -- 172.21.15.161:0/1096286224 learned_addr learned my addr 172.21.15.161:0/1096286224 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:35.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.016+0000 7fd94be00640 1 -- 172.21.15.161:0/1096286224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd94c0ca3a0 msgr2=0x7fd94c061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:35.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.016+0000 7fd94be00640 1 --2- 172.21.15.161:0/1096286224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd94c0ca3a0 0x7fd94c061100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.016+0000 7fd94be00640 1 -- 172.21.15.161:0/1096286224 >> v2:172.21.15.161:3300/0 conn(0x7fd94c1517f0 msgr2=0x7fd94c15b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:35.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.016+0000 7fd94be00640 1 --2- 172.21.15.161:0/1096286224 >> v2:172.21.15.161:3300/0 conn(0x7fd94c1517f0 0x7fd94c15b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.016+0000 7fd94be00640 1 -- 172.21.15.161:0/1096286224 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c157c50 con 0x7fd94c0ca780 2024-01-17T22:59:35.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.024+0000 7fd94be00640 1 --2- 172.21.15.161:0/1096286224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd94c0ca780 0x7fd94c061640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd94c06e960 tx=0x7fd93c01c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5c41479e12c277f server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.024+0000 7fec99600640 1 Processor -- start 2024-01-17T22:59:35.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.024+0000 7fec99600640 1 -- start start 2024-01-17T22:59:35.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.024+0000 7fec99600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fec940c79c0 0x7fec94061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.024+0000 7fec99600640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fec94061640 0x7fec9415d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.024+0000 7fec99600640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec940c9890 con 0x7fec941539a0 2024-01-17T22:59:35.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.024+0000 7fec99600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9406d570 con 0x7fec940c79c0 2024-01-17T22:59:35.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.024+0000 7fec99600640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec94159bf0 con 0x7fec94061640 2024-01-17T22:59:35.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.032+0000 7fec93400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fec94061640 0x7fec9415d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.036+0000 7fd94a000640 1 -- 172.21.15.161:0/1096286224 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c0aa620 con 0x7fd94c0ca780 2024-01-17T22:59:35.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.036+0000 7fd94a000640 1 -- 172.21.15.161:0/1096286224 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93c0aa780 con 0x7fd94c0ca780 2024-01-17T22:59:35.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.036+0000 7fd94a000640 1 -- 172.21.15.161:0/1096286224 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c0aab10 con 0x7fd94c0ca780 2024-01-17T22:59:35.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.036+0000 7fd952400640 1 -- 172.21.15.161:0/1096286224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd94c0ca780 msgr2=0x7fd94c061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.036+0000 7fd952400640 1 --2- 172.21.15.161:0/1096286224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd94c0ca780 0x7fd94c061640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd94c06e960 tx=0x7fd93c01c500 comp rx=0 tx=0).stop 2024-01-17T22:59:35.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.036+0000 7fec92a00640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fec941539a0 0x7fec940ca410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.161:35312/0 (socket says 172.21.15.161:35312) 2024-01-17T22:59:35.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.036+0000 7fec92a00640 1 -- 172.21.15.161:0/3295067461 learned_addr learned my addr 172.21.15.161:0/3295067461 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:35.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.036+0000 7fd952400640 1 -- 172.21.15.161:0/1096286224 shutdown_connections 2024-01-17T22:59:35.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.036+0000 7fd952400640 1 --2- 172.21.15.161:0/1096286224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd94c0ca780 0x7fd94c061640 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.036+0000 7fd952400640 1 --2- 172.21.15.161:0/1096286224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd94c0ca3a0 0x7fd94c061100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.036+0000 7fd952400640 1 --2- 172.21.15.161:0/1096286224 >> v2:172.21.15.161:3300/0 conn(0x7fd94c1517f0 0x7fd94c15b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.036+0000 7fd952400640 1 -- 172.21.15.161:0/1096286224 >> 172.21.15.161:0/1096286224 conn(0x7fd94c06ad40 msgr2=0x7fd94c06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:35.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.036+0000 7fd952400640 1 -- 172.21.15.161:0/1096286224 shutdown_connections 2024-01-17T22:59:35.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.036+0000 7fd952400640 1 -- 172.21.15.161:0/1096286224 wait complete. 2024-01-17T22:59:35.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.040+0000 7fd952400640 1 Processor -- start 2024-01-17T22:59:35.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.040+0000 7fd952400640 1 -- start start 2024-01-17T22:59:35.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.040+0000 7fd952400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd94c0ca3a0 0x7fd94c1f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.040+0000 7fd952400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd94c0ca780 0x7fd94c146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.040+0000 7fd952400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd94c1517f0 0x7fd94c146dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.040+0000 7fd952400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0c4710 con 0x7fd94c1517f0 2024-01-17T22:59:35.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.040+0000 7fd952400640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0c4290 con 0x7fd94c0ca3a0 2024-01-17T22:59:35.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.040+0000 7fd952400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c06d280 con 0x7fd94c0ca780 2024-01-17T22:59:35.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.040+0000 7fd94aa00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd94c0ca780 0x7fd94c146890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.040+0000 7fd94aa00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd94c0ca780 0x7fd94c146890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:40184/0 (socket says 172.21.15.161:40184) 2024-01-17T22:59:35.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.040+0000 7fd94aa00640 1 -- 172.21.15.161:0/2531010041 learned_addr learned my addr 172.21.15.161:0/2531010041 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:35.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.048+0000 7fec93400640 1 -- 172.21.15.161:0/3295067461 >> v2:172.21.15.161:3300/0 conn(0x7fec940c79c0 msgr2=0x7fec94061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:35.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.048+0000 7fec93400640 1 --2- 172.21.15.161:0/3295067461 >> v2:172.21.15.161:3300/0 conn(0x7fec940c79c0 0x7fec94061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.048+0000 7fec93400640 1 -- 172.21.15.161:0/3295067461 >> v1:172.21.15.190:6789/0 conn(0x7fec941539a0 legacy=0x7fec940ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.048+0000 7fec93400640 1 -- 172.21.15.161:0/3295067461 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec94159eb0 con 0x7fec94061640 2024-01-17T22:59:35.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.052+0000 7fd94aa00640 1 -- 172.21.15.161:0/2531010041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd94c0ca3a0 msgr2=0x7fd94c1f21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.052+0000 7fd94aa00640 1 --2- 172.21.15.161:0/2531010041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd94c0ca3a0 0x7fd94c1f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.052+0000 7fd94aa00640 1 -- 172.21.15.161:0/2531010041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd94c1517f0 msgr2=0x7fd94c146dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.052+0000 7fd94aa00640 1 --2- 172.21.15.161:0/2531010041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd94c1517f0 0x7fd94c146dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.052+0000 7fd94aa00640 1 -- 172.21.15.161:0/2531010041 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c0094d0 con 0x7fd94c0ca780 2024-01-17T22:59:35.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.056+0000 7fd94aa00640 1 --2- 172.21.15.161:0/2531010041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd94c0ca780 0x7fd94c146890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd93400e930 tx=0x7fd93400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.064+0000 7fec93400640 1 --2- 172.21.15.161:0/3295067461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec94061640 0x7fec9415d3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fec9406d9d0 tx=0x7fec8c01c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa276cc77c135ae6 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.068+0000 7fd943400640 1 -- 172.21.15.161:0/2531010041 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd934009690 con 0x7fd94c0ca780 2024-01-17T22:59:35.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.068+0000 7fd943400640 1 -- 172.21.15.161:0/2531010041 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93400c980 con 0x7fd94c0ca780 2024-01-17T22:59:35.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.068+0000 7fd943400640 1 -- 172.21.15.161:0/2531010041 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93400ccf0 con 0x7fd94c0ca780 2024-01-17T22:59:35.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.068+0000 7fd952400640 1 -- 172.21.15.161:0/2531010041 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd94c15a770 con 0x7fd94c0ca780 2024-01-17T22:59:35.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.068+0000 7fd952400640 1 -- 172.21.15.161:0/2531010041 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94c06cf10 con 0x7fd94c0ca780 2024-01-17T22:59:35.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.068+0000 7fd952400640 1 -- 172.21.15.161:0/2531010041 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd94c06ca90 con 0x7fd94c0ca780 2024-01-17T22:59:35.072 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-17T22:59:35.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.076+0000 7fec91600640 1 -- 172.21.15.161:0/3295067461 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c0a5940 con 0x7fec94061640 2024-01-17T22:59:35.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.076+0000 7fec91600640 1 -- 172.21.15.161:0/3295067461 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c0a5aa0 con 0x7fec94061640 2024-01-17T22:59:35.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.076+0000 7fec91600640 1 -- 172.21.15.161:0/3295067461 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c0a5e30 con 0x7fec94061640 2024-01-17T22:59:35.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.080+0000 7fec99600640 1 -- 172.21.15.161:0/3295067461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec94061640 msgr2=0x7fec9415d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.080+0000 7fec99600640 1 --2- 172.21.15.161:0/3295067461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec94061640 0x7fec9415d3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fec9406d9d0 tx=0x7fec8c01c880 comp rx=0 tx=0).stop 2024-01-17T22:59:35.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.080+0000 7fec99600640 1 -- 172.21.15.161:0/3295067461 shutdown_connections 2024-01-17T22:59:35.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.080+0000 7fec99600640 1 --2- 172.21.15.161:0/3295067461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec94061640 0x7fec9415d3f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.080+0000 7fec99600640 1 --2- 172.21.15.161:0/3295067461 >> v2:172.21.15.161:3300/0 conn(0x7fec940c79c0 0x7fec94061100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.080+0000 7fec99600640 1 -- 172.21.15.161:0/3295067461 >> 172.21.15.161:0/3295067461 conn(0x7fec9406ad40 msgr2=0x7fec9406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:35.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.080+0000 7fec99600640 1 -- 172.21.15.161:0/3295067461 shutdown_connections 2024-01-17T22:59:35.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.080+0000 7fec99600640 1 -- 172.21.15.161:0/3295067461 wait complete. 2024-01-17T22:59:35.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.080+0000 7fec99600640 1 Processor -- start 2024-01-17T22:59:35.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.080+0000 7fec99600640 1 -- start start 2024-01-17T22:59:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.080+0000 7fec99600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec94061640 0x7fec940ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.080+0000 7fec99600640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec940c79c0 0x7fec940ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.080+0000 7fec99600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec941539a0 0x7fec940aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.080+0000 7fec99600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec940af560 con 0x7fec94061640 2024-01-17T22:59:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.080+0000 7fec99600640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec940b1fc0 con 0x7fec940c79c0 2024-01-17T22:59:35.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.080+0000 7fec99600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec941f6030 con 0x7fec941539a0 2024-01-17T22:59:35.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.084+0000 7fec92000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec940c79c0 0x7fec940ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.084+0000 7fec92000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec940c79c0 0x7fec940ae850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:49592/0 (socket says 172.21.15.161:49592) 2024-01-17T22:59:35.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.084+0000 7fec92000640 1 -- 172.21.15.161:0/1471883000 learned_addr learned my addr 172.21.15.161:0/1471883000 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:35.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.092+0000 7fec92000640 1 -- 172.21.15.161:0/1471883000 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec941539a0 msgr2=0x7fec940aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.092+0000 7fec92000640 1 --2- 172.21.15.161:0/1471883000 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec941539a0 0x7fec940aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.092+0000 7fec92000640 1 -- 172.21.15.161:0/1471883000 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec94061640 msgr2=0x7fec940ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.092+0000 7fec92000640 1 --2- 172.21.15.161:0/1471883000 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec94061640 0x7fec940ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.092+0000 7fec92000640 1 -- 172.21.15.161:0/1471883000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c009a70 con 0x7fec940c79c0 2024-01-17T22:59:35.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.100+0000 7fec92000640 1 --2- 172.21.15.161:0/1471883000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec940c79c0 0x7fec940ae850 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00b550 tx=0x7fec7c00ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.108+0000 7fec8aa00640 1 -- 172.21.15.161:0/1471883000 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c010870 con 0x7fec940c79c0 2024-01-17T22:59:35.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.108+0000 7fec8aa00640 1 -- 172.21.15.161:0/1471883000 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c0109f0 con 0x7fec940c79c0 2024-01-17T22:59:35.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.108+0000 7fec8aa00640 1 -- 172.21.15.161:0/1471883000 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c010da0 con 0x7fec940c79c0 2024-01-17T22:59:35.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.108+0000 7fec99600640 1 -- 172.21.15.161:0/1471883000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec941f6310 con 0x7fec940c79c0 2024-01-17T22:59:35.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.108+0000 7fec99600640 1 -- 172.21.15.161:0/1471883000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec940b2280 con 0x7fec940c79c0 2024-01-17T22:59:35.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.108+0000 7fec99600640 1 -- 172.21.15.161:0/1471883000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec9406b620 con 0x7fec940c79c0 2024-01-17T22:59:35.134 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-17T22:59:35.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.152+0000 7fba15600640 1 -- 172.21.15.161:0/2617196221 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fba080ebf60 con 0x7fba1806d210 2024-01-17T22:59:35.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.220+0000 7fc1f6400640 1 Processor -- start 2024-01-17T22:59:35.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.220+0000 7fc1f6400640 1 -- start start 2024-01-17T22:59:35.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.220+0000 7fc1f6400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1f014cb40 0x7fc1f00c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.220+0000 7fc1f6400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc1f014cf20 0x7fc1f00c2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.220+0000 7fc1f6400640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f00c6820 con 0x7fc1f00c2c60 2024-01-17T22:59:35.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.220+0000 7fc1f6400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f01571e0 con 0x7fc1f014cf20 2024-01-17T22:59:35.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.220+0000 7fc1f6400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00c6540 con 0x7fc1f014cb40 2024-01-17T22:59:35.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.224+0000 7fc1eea00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc1f014cf20 0x7fc1f00c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.224+0000 7fc1eea00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc1f014cf20 0x7fc1f00c2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60568/0 (socket says 172.21.15.161:60568) 2024-01-17T22:59:35.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.224+0000 7fc1eea00640 1 -- 172.21.15.161:0/1312576460 learned_addr learned my addr 172.21.15.161:0/1312576460 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:35.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.224+0000 7fc1eea00640 1 -- 172.21.15.161:0/1312576460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1f014cb40 msgr2=0x7fc1f00c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:35.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.224+0000 7fc1eea00640 1 --2- 172.21.15.161:0/1312576460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1f014cb40 0x7fc1f00c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.224+0000 7fc1eea00640 1 -- 172.21.15.161:0/1312576460 >> v1:172.21.15.190:6789/0 conn(0x7fc1f00c2c60 legacy=0x7fc1f00cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:35.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.224+0000 7fc1eea00640 1 -- 172.21.15.161:0/1312576460 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f0156420 con 0x7fc1f014cf20 2024-01-17T22:59:35.240 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-17T22:59:35.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.252+0000 7fc1eea00640 1 --2- 172.21.15.161:0/1312576460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1f014cf20 0x7fc1f00c2720 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009870 tx=0x7fc1d801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3447a357c580cc0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.254 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-17T22:59:35.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.256+0000 7fc1ee000640 1 -- 172.21.15.161:0/1312576460 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80ab600 con 0x7fc1f014cf20 2024-01-17T22:59:35.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.256+0000 7fc1ee000640 1 -- 172.21.15.161:0/1312576460 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d80a7050 con 0x7fc1f014cf20 2024-01-17T22:59:35.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.256+0000 7fc1ee000640 1 -- 172.21.15.161:0/1312576460 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80ab980 con 0x7fc1f014cf20 2024-01-17T22:59:35.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.260+0000 7fc1f6400640 1 -- 172.21.15.161:0/1312576460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1f014cf20 msgr2=0x7fc1f00c2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.260+0000 7fc1f6400640 1 --2- 172.21.15.161:0/1312576460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1f014cf20 0x7fc1f00c2720 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009870 tx=0x7fc1d801c500 comp rx=0 tx=0).stop 2024-01-17T22:59:35.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.260+0000 7fc1f6400640 1 -- 172.21.15.161:0/1312576460 shutdown_connections 2024-01-17T22:59:35.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.260+0000 7fc1f6400640 1 --2- 172.21.15.161:0/1312576460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1f014cf20 0x7fc1f00c2720 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.260+0000 7fc1f6400640 1 --2- 172.21.15.161:0/1312576460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1f014cb40 0x7fc1f00c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.260+0000 7fc1f6400640 1 -- 172.21.15.161:0/1312576460 >> 172.21.15.161:0/1312576460 conn(0x7fc1f0071670 msgr2=0x7fc1f006f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:35.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.260+0000 7fc1f6400640 1 -- 172.21.15.161:0/1312576460 shutdown_connections 2024-01-17T22:59:35.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.260+0000 7fc1f6400640 1 -- 172.21.15.161:0/1312576460 wait complete. 2024-01-17T22:59:35.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.264+0000 7fc1f6400640 1 Processor -- start 2024-01-17T22:59:35.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.264+0000 7fc1f6400640 1 -- start start 2024-01-17T22:59:35.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.264+0000 7fc1f6400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1f00c2c60 0x7fc1f00ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.264+0000 7fc1f6400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1f014cb40 0x7fc1f01f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.264+0000 7fc1f6400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1f014cf20 0x7fc1f0140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.264+0000 7fc1f6400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f0158000 con 0x7fc1f014cb40 2024-01-17T22:59:35.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.264+0000 7fc1f6400640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f01f5730 con 0x7fc1f00c2c60 2024-01-17T22:59:35.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.264+0000 7fc1f6400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f0157c50 con 0x7fc1f014cf20 2024-01-17T22:59:35.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.264+0000 7fc1eea00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1f014cb40 0x7fc1f01f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.264+0000 7fc1eea00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1f014cb40 0x7fc1f01f5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60580/0 (socket says 172.21.15.161:60580) 2024-01-17T22:59:35.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.264+0000 7fc1eea00640 1 -- 172.21.15.161:0/3596345533 learned_addr learned my addr 172.21.15.161:0/3596345533 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:35.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.272+0000 7fc1eea00640 1 -- 172.21.15.161:0/3596345533 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1f014cf20 msgr2=0x7fc1f0140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.272+0000 7fc1eea00640 1 --2- 172.21.15.161:0/3596345533 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1f014cf20 0x7fc1f0140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.272+0000 7fc1eea00640 1 -- 172.21.15.161:0/3596345533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1f00c2c60 msgr2=0x7fc1f00ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.272+0000 7fc1eea00640 1 --2- 172.21.15.161:0/3596345533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1f00c2c60 0x7fc1f00ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.272+0000 7fc1eea00640 1 -- 172.21.15.161:0/3596345533 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d80094d0 con 0x7fc1f014cb40 2024-01-17T22:59:35.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.276+0000 7fc1eea00640 1 --2- 172.21.15.161:0/3596345533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1f014cb40 0x7fc1f01f5ea0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80ae040 tx=0x7fc1d80192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.280+0000 7fc1e7400640 1 -- 172.21.15.161:0/3596345533 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80b7650 con 0x7fc1f014cb40 2024-01-17T22:59:35.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.280+0000 7fc1e7400640 1 -- 172.21.15.161:0/3596345533 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d80b77f0 con 0x7fc1f014cb40 2024-01-17T22:59:35.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.280+0000 7fc1e7400640 1 -- 172.21.15.161:0/3596345533 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80b7ba0 con 0x7fc1f014cb40 2024-01-17T22:59:35.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.280+0000 7fc1f6400640 1 -- 172.21.15.161:0/3596345533 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f0158210 con 0x7fc1f014cb40 2024-01-17T22:59:35.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.280+0000 7fc1f6400640 1 -- 172.21.15.161:0/3596345533 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f01f5980 con 0x7fc1f014cb40 2024-01-17T22:59:35.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.280+0000 7fc1f6400640 1 -- 172.21.15.161:0/3596345533 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f00746a0 con 0x7fc1f014cb40 2024-01-17T22:59:35.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.300+0000 7f3405000640 1 Processor -- start 2024-01-17T22:59:35.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.300+0000 7f3405000640 1 -- start start 2024-01-17T22:59:35.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.300+0000 7f3405000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3400156b80 0x7f3400157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.300+0000 7f3405000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34000c1450 con 0x7f3400156fe0 2024-01-17T22:59:35.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.300+0000 7f3405000640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34000c1730 con 0x7f34001508d0 2024-01-17T22:59:35.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.300+0000 7f3405000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3400159820 con 0x7f3400156b80 2024-01-17T22:59:35.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.328+0000 7fba20600640 1 -- 172.21.15.161:0/2617196221 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fba1806cab0 con 0x7fba1806d210 2024-01-17T22:59:35.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.388+0000 7fd943400640 1 -- 172.21.15.161:0/2531010041 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fd934013470 con 0x7fd94c0ca780 2024-01-17T22:59:35.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.392+0000 7fd943400640 1 --2- 172.21.15.161:0/2531010041 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fd924066890 0x7fd924068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.392+0000 7fd94b400640 1 --2- 172.21.15.161:0/2531010041 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fd924066890 0x7fd924068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.392+0000 7fd94b400640 1 --2- 172.21.15.161:0/2531010041 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fd924066890 0x7fd924068d50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd94400ab90 tx=0x7fd944009250 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.392+0000 7fd943400640 1 -- 172.21.15.161:0/2531010041 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fd934056080 con 0x7fd94c0ca780 2024-01-17T22:59:35.392 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-17T22:59:35.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.416+0000 7fd943400640 1 -- 172.21.15.161:0/2531010041 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fd934055750 con 0x7fd94c0ca780 2024-01-17T22:59:35.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.420+0000 7efe14600640 1 Processor -- start 2024-01-17T22:59:35.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.424+0000 7efe14600640 1 -- start start 2024-01-17T22:59:35.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.424+0000 7efe14600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efe0c1517f0 0x7efe0c15b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.424+0000 7efe14600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0c0c7d10 con 0x7efe0c0ca780 2024-01-17T22:59:35.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.424+0000 7efe14600640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0c1576d0 con 0x7efe0c0ca3a0 2024-01-17T22:59:35.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.424+0000 7efe14600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0c157970 con 0x7efe0c1517f0 2024-01-17T22:59:35.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.432+0000 7f33fe800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3400156b80 0x7f3400157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.436+0000 7f33e9c00640 1 Processor -- start 2024-01-17T22:59:35.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.436+0000 7f33e9c00640 1 -- start start 2024-01-17T22:59:35.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.436+0000 7f33e9c00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f33e4153730 0x7f33e40ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.436+0000 7f33e9c00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33e40cda40 0x7f33e4070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.436+0000 7f33e9c00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e41598e0 con 0x7f33e4071360 2024-01-17T22:59:35.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.436+0000 7f33e9c00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e41596f0 con 0x7f33e4153730 2024-01-17T22:59:35.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.436+0000 7f33e9c00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40cde80 con 0x7f33e40cda40 2024-01-17T22:59:35.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.440+0000 7f33fe800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3400156b80 0x7f3400157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:40218/0 (socket says 172.21.15.161:40218) 2024-01-17T22:59:35.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.440+0000 7f33fe800640 1 -- 172.21.15.161:0/4177625610 learned_addr learned my addr 172.21.15.161:0/4177625610 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:35.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.444+0000 7f33e2000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33e40cda40 0x7f33e4070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.444+0000 7f33e2000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33e40cda40 0x7f33e4070e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:40226/0 (socket says 172.21.15.161:40226) 2024-01-17T22:59:35.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.444+0000 7f33e2000640 1 -- 172.21.15.161:0/1655435827 learned_addr learned my addr 172.21.15.161:0/1655435827 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:35.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.452+0000 7f33fe800640 1 -- 172.21.15.161:0/4177625610 >> v1:172.21.15.190:6789/0 conn(0x7f34001508d0 legacy=0x7f340006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:35.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.452+0000 7f33fe800640 1 -- 172.21.15.161:0/4177625610 >> v1:172.21.15.161:6789/0 conn(0x7f3400156fe0 legacy=0x7f3400156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:35.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.452+0000 7f33fe800640 1 -- 172.21.15.161:0/4177625610 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34000c1a10 con 0x7f3400156b80 2024-01-17T22:59:35.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.452+0000 7fec8aa00640 1 -- 172.21.15.161:0/1471883000 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fec7c023480 con 0x7fec940c79c0 2024-01-17T22:59:35.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.452+0000 7fec8aa00640 1 --2- 172.21.15.161:0/1471883000 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fec6c066890 0x7fec6c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.452+0000 7fec92a00640 1 --2- 172.21.15.161:0/1471883000 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fec6c066890 0x7fec6c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.452+0000 7f33e2000640 1 -- 172.21.15.161:0/1655435827 >> v2:172.21.15.190:3300/0 conn(0x7f33e4153730 msgr2=0x7f33e40ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:35.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.452+0000 7f33e2000640 1 --2- 172.21.15.161:0/1655435827 >> v2:172.21.15.190:3300/0 conn(0x7f33e4153730 0x7f33e40ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.452+0000 7f33e2000640 1 -- 172.21.15.161:0/1655435827 >> v1:172.21.15.190:6789/0 conn(0x7f33e4071360 legacy=0x7f33e415d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:35.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.452+0000 7f33e2000640 1 -- 172.21.15.161:0/1655435827 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e4159b80 con 0x7f33e40cda40 2024-01-17T22:59:35.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.452+0000 7fec92a00640 1 --2- 172.21.15.161:0/1471883000 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fec6c066890 0x7fec6c068d50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fec84000f70 tx=0x7fec84007a90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.456+0000 7f33fe800640 1 --2- 172.21.15.161:0/4177625610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3400156b80 0x7f3400157ec0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009e80 tx=0x7f33f801f1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a255c530d0c7ba5 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.456+0000 7fc1e7400640 1 -- 172.21.15.161:0/3596345533 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fc1d80b7d00 con 0x7fc1f014cb40 2024-01-17T22:59:35.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.460+0000 7fc1e7400640 1 --2- 172.21.15.161:0/3596345533 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc1c8066890 0x7fc1c8068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.460+0000 7fc1ef400640 1 --2- 172.21.15.161:0/3596345533 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc1c8066890 0x7fc1c8068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.460+0000 7fc1ef400640 1 --2- 172.21.15.161:0/3596345533 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc1c8066890 0x7fc1c8068d50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009730 tx=0x7fc1e0006ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.464+0000 7fec8aa00640 1 -- 172.21.15.161:0/1471883000 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fec7c055bb0 con 0x7fec940c79c0 2024-01-17T22:59:35.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.464+0000 7f33e2000640 1 --2- 172.21.15.161:0/1655435827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33e40cda40 0x7f33e4070e20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009870 tx=0x7f33cc01ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d160a6427b077dfb server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.468+0000 7f33fca00640 1 -- 172.21.15.161:0/4177625610 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f80af400 con 0x7f3400156b80 2024-01-17T22:59:35.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.468+0000 7f33fca00640 1 -- 172.21.15.161:0/4177625610 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f80ab050 con 0x7f3400156b80 2024-01-17T22:59:35.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.468+0000 7f33fca00640 1 -- 172.21.15.161:0/4177625610 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f80af780 con 0x7f3400156b80 2024-01-17T22:59:35.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.468+0000 7f3405000640 1 -- 172.21.15.161:0/4177625610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3400156b80 msgr2=0x7f3400157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.468+0000 7f3405000640 1 --2- 172.21.15.161:0/4177625610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3400156b80 0x7f3400157ec0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009e80 tx=0x7f33f801f1a0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.468+0000 7f3405000640 1 -- 172.21.15.161:0/4177625610 shutdown_connections 2024-01-17T22:59:35.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.468+0000 7f3405000640 1 --2- 172.21.15.161:0/4177625610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3400156b80 0x7f3400157ec0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.468+0000 7f3405000640 1 -- 172.21.15.161:0/4177625610 >> 172.21.15.161:0/4177625610 conn(0x7f340006fc50 msgr2=0x7f3400070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:35.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.468+0000 7f3405000640 1 -- 172.21.15.161:0/4177625610 shutdown_connections 2024-01-17T22:59:35.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.468+0000 7f3405000640 1 -- 172.21.15.161:0/4177625610 wait complete. 2024-01-17T22:59:35.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.472+0000 7f3405000640 1 Processor -- start 2024-01-17T22:59:35.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.472+0000 7f3405000640 1 -- start start 2024-01-17T22:59:35.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.472+0000 7f3405000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34001508d0 0x7f34001490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.472+0000 7f3405000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3400156fe0 0x7f3400149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.472+0000 7f3405000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34000c59a0 0x7f34000c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.472+0000 7f3405000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34000c5310 con 0x7f34000c59a0 2024-01-17T22:59:35.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.472+0000 7f3405000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34001ef740 con 0x7f3400156fe0 2024-01-17T22:59:35.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.472+0000 7f3405000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34001ef9e0 con 0x7f34001508d0 2024-01-17T22:59:35.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.476+0000 7f33e1600640 1 -- 172.21.15.161:0/1655435827 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc0a89b0 con 0x7f33e40cda40 2024-01-17T22:59:35.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.476+0000 7f33e1600640 1 -- 172.21.15.161:0/1655435827 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33cc0a8b10 con 0x7f33e40cda40 2024-01-17T22:59:35.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.476+0000 7f33e1600640 1 -- 172.21.15.161:0/1655435827 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc0a8ea0 con 0x7f33e40cda40 2024-01-17T22:59:35.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.480+0000 7f33e9c00640 1 -- 172.21.15.161:0/1655435827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33e40cda40 msgr2=0x7f33e4070e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.480+0000 7f33e9c00640 1 --2- 172.21.15.161:0/1655435827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33e40cda40 0x7f33e4070e20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009870 tx=0x7f33cc01ecf0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.480+0000 7f33fde00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34001508d0 0x7f34001490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.480+0000 7f33e9c00640 1 -- 172.21.15.161:0/1655435827 shutdown_connections 2024-01-17T22:59:35.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.480+0000 7f33e9c00640 1 --2- 172.21.15.161:0/1655435827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33e40cda40 0x7f33e4070e20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.480+0000 7f33e9c00640 1 --2- 172.21.15.161:0/1655435827 >> v2:172.21.15.190:3300/0 conn(0x7f33e4153730 0x7f33e40ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.480+0000 7f33e9c00640 1 -- 172.21.15.161:0/1655435827 >> 172.21.15.161:0/1655435827 conn(0x7f33e4070460 msgr2=0x7f33e406f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:35.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.480+0000 7f33e9c00640 1 -- 172.21.15.161:0/1655435827 shutdown_connections 2024-01-17T22:59:35.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.480+0000 7f33e9c00640 1 -- 172.21.15.161:0/1655435827 wait complete. 2024-01-17T22:59:35.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.480+0000 7f33e9c00640 1 Processor -- start 2024-01-17T22:59:35.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.480+0000 7f33e9c00640 1 -- start start 2024-01-17T22:59:35.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.484+0000 7f33fde00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34001508d0 0x7f34001490f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:40234/0 (socket says 172.21.15.161:40234) 2024-01-17T22:59:35.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.484+0000 7f33fde00640 1 -- 172.21.15.161:0/3694085047 learned_addr learned my addr 172.21.15.161:0/3694085047 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:35.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.484+0000 7f33e9c00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33e4071360 0x7f33e4150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.484+0000 7f33e9c00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33e40cda40 0x7f33e41f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.484+0000 7f33e9c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33e4153730 0x7f33e40ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.484+0000 7f33e9c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e414e0e0 con 0x7f33e4153730 2024-01-17T22:59:35.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.484+0000 7f33e9c00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40ad640 con 0x7f33e40cda40 2024-01-17T22:59:35.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.484+0000 7f33e9c00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40ae9c0 con 0x7f33e4071360 2024-01-17T22:59:35.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.492+0000 7f33fde00640 1 -- 172.21.15.161:0/3694085047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3400156fe0 msgr2=0x7f3400149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.492+0000 7f33fde00640 1 --2- 172.21.15.161:0/3694085047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3400156fe0 0x7f3400149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.492+0000 7f33fde00640 1 -- 172.21.15.161:0/3694085047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34000c59a0 msgr2=0x7f34000c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.492+0000 7f33fde00640 1 --2- 172.21.15.161:0/3694085047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34000c59a0 0x7f34000c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.492+0000 7f33fde00640 1 -- 172.21.15.161:0/3694085047 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f8009b30 con 0x7f34001508d0 2024-01-17T22:59:35.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.500+0000 7f33fde00640 1 --2- 172.21.15.161:0/3694085047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34001508d0 0x7f34001490f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f33f000c4c0 tx=0x7f33f0001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.504+0000 7fec8aa00640 1 -- 172.21.15.161:0/1471883000 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fec7c0517f0 con 0x7fec940c79c0 2024-01-17T22:59:35.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.508+0000 7f33e2a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33e4071360 0x7f33e4150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.508+0000 7f33e2a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33e4071360 0x7f33e4150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:40236/0 (socket says 172.21.15.161:40236) 2024-01-17T22:59:35.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.508+0000 7f33e2a00640 1 -- 172.21.15.161:0/1980679238 learned_addr learned my addr 172.21.15.161:0/1980679238 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.512+0000 7f33f6000640 1 -- 172.21.15.161:0/3694085047 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0003600 con 0x7f34001508d0 2024-01-17T22:59:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.512+0000 7f33f6000640 1 -- 172.21.15.161:0/3694085047 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f0003780 con 0x7f34001508d0 2024-01-17T22:59:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.512+0000 7f3405000640 1 -- 172.21.15.161:0/3694085047 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3400147bc0 con 0x7f34001508d0 2024-01-17T22:59:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.512+0000 7f33f6000640 1 -- 172.21.15.161:0/3694085047 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0003b30 con 0x7f34001508d0 2024-01-17T22:59:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.512+0000 7f3405000640 1 -- 172.21.15.161:0/3694085047 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3400148180 con 0x7f34001508d0 2024-01-17T22:59:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.512+0000 7efe11200640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7efe0c0ca3a0 0x7efe0c061100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.161:35330/0 (socket says 172.21.15.161:35330) 2024-01-17T22:59:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.512+0000 7efe11200640 1 -- 172.21.15.161:0/1982233259 learned_addr learned my addr 172.21.15.161:0/1982233259 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:35.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.512+0000 7f3405000640 1 -- 172.21.15.161:0/3694085047 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3400067c90 con 0x7f34001508d0 2024-01-17T22:59:35.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.516+0000 7f33e2a00640 1 -- 172.21.15.161:0/1980679238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33e40cda40 msgr2=0x7f33e41f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.516+0000 7f33e2a00640 1 --2- 172.21.15.161:0/1980679238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33e40cda40 0x7f33e41f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.516+0000 7f33e2a00640 1 -- 172.21.15.161:0/1980679238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33e4153730 msgr2=0x7f33e40ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.516+0000 7f33e2a00640 1 --2- 172.21.15.161:0/1980679238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33e4153730 0x7f33e40ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.516+0000 7f33e2a00640 1 -- 172.21.15.161:0/1980679238 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc0094d0 con 0x7f33e4071360 2024-01-17T22:59:35.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.556+0000 7fd456400640 1 Processor -- start 2024-01-17T22:59:35.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.556+0000 7fd456400640 1 -- start start 2024-01-17T22:59:35.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.556+0000 7fd456400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd45006ab40 0x7fd45006bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.556+0000 7fd456400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd450157f40 0x7fd4500c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.556+0000 7fd456400640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4500cbd70 con 0x7fd450151840 2024-01-17T22:59:35.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.556+0000 7fd456400640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45015acf0 con 0x7fd450157f40 2024-01-17T22:59:35.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.556+0000 7fd456400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4500c7c20 con 0x7fd45006ab40 2024-01-17T22:59:35.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.560+0000 7fd44f400640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fd450151840 0x7fd45015b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.161:35348/0 (socket says 172.21.15.161:35348) 2024-01-17T22:59:35.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.560+0000 7fd44f400640 1 -- 172.21.15.161:0/2368086071 learned_addr learned my addr 172.21.15.161:0/2368086071 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:35.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.564+0000 7fd44fe00640 1 --2- 172.21.15.161:0/2368086071 >> v2:172.21.15.190:3300/0 conn(0x7fd450157f40 0x7fd4500c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.572+0000 7fd44fe00640 1 -- 172.21.15.161:0/2368086071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd45006ab40 msgr2=0x7fd45006bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:35.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.572+0000 7fd44fe00640 1 --2- 172.21.15.161:0/2368086071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd45006ab40 0x7fd45006bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.572+0000 7fd44fe00640 1 -- 172.21.15.161:0/2368086071 >> v1:172.21.15.190:6789/0 conn(0x7fd450151840 legacy=0x7fd45015b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.572+0000 7fd44fe00640 1 -- 172.21.15.161:0/2368086071 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd450151c20 con 0x7fd450157f40 2024-01-17T22:59:35.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.580+0000 7fc1e7400640 1 -- 172.21.15.161:0/3596345533 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fc1d80aa3a0 con 0x7fc1f014cb40 2024-01-17T22:59:35.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.580+0000 7fc1e7400640 1 -- 172.21.15.161:0/3596345533 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fc1d80ec6e0 con 0x7fc1f014cb40 2024-01-17T22:59:35.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.584+0000 7fd44fe00640 1 --2- 172.21.15.161:0/2368086071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd450157f40 0x7fd4500c4d70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd448009d90 tx=0x7fd44801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8441781bbb65a10 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.592+0000 7fba15600640 1 -- 172.21.15.161:0/2617196221 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fba080aa620 con 0x7fba1806d210 2024-01-17T22:59:35.590 INFO:teuthology.orchestra.run.smithi161.stdout:55834574867 2024-01-17T22:59:35.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.592+0000 7fd44e000640 1 -- 172.21.15.161:0/2368086071 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4480a5810 con 0x7fd450157f40 2024-01-17T22:59:35.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.592+0000 7fd44e000640 1 -- 172.21.15.161:0/2368086071 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4480a5970 con 0x7fd450157f40 2024-01-17T22:59:35.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.592+0000 7fd44e000640 1 -- 172.21.15.161:0/2368086071 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4480a5d00 con 0x7fd450157f40 2024-01-17T22:59:35.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.592+0000 7fd456400640 1 -- 172.21.15.161:0/2368086071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd450157f40 msgr2=0x7fd4500c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.592+0000 7fd456400640 1 --2- 172.21.15.161:0/2368086071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd450157f40 0x7fd4500c4d70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd448009d90 tx=0x7fd44801c950 comp rx=0 tx=0).stop 2024-01-17T22:59:35.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.592+0000 7fd456400640 1 -- 172.21.15.161:0/2368086071 shutdown_connections 2024-01-17T22:59:35.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.592+0000 7fd456400640 1 --2- 172.21.15.161:0/2368086071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd450157f40 0x7fd4500c4d70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.592+0000 7fd456400640 1 --2- 172.21.15.161:0/2368086071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd45006ab40 0x7fd45006bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.592+0000 7fd456400640 1 -- 172.21.15.161:0/2368086071 >> 172.21.15.161:0/2368086071 conn(0x7fd45006fba0 msgr2=0x7fd4500cb660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:35.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.596+0000 7fd456400640 1 -- 172.21.15.161:0/2368086071 shutdown_connections 2024-01-17T22:59:35.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.596+0000 7fd456400640 1 -- 172.21.15.161:0/2368086071 wait complete. 2024-01-17T22:59:35.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.596+0000 7efe11c00640 1 --2- 172.21.15.161:0/1982233259 >> v2:172.21.15.161:3300/0 conn(0x7efe0c1517f0 0x7efe0c15b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.596+0000 7fba20600640 1 -- 172.21.15.161:0/2617196221 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb9f0066890 msgr2=0x7fb9f0068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.596+0000 7fba20600640 1 --2- 172.21.15.161:0/2617196221 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb9f0066890 0x7fb9f0068d50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fba180c4fc0 tx=0x7fba00009190 comp rx=0 tx=0).stop 2024-01-17T22:59:35.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.596+0000 7fba20600640 1 -- 172.21.15.161:0/2617196221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba1806d210 msgr2=0x7fba18159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.596+0000 7fba20600640 1 --2- 172.21.15.161:0/2617196221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba1806d210 0x7fba18159440 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba0801a130 tx=0x7fba0801ad40 comp rx=0 tx=0).stop 2024-01-17T22:59:35.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.596+0000 7fd456400640 1 Processor -- start 2024-01-17T22:59:35.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.596+0000 7fd456400640 1 -- start start 2024-01-17T22:59:35.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.600+0000 7fba20600640 1 -- 172.21.15.161:0/2617196221 shutdown_connections 2024-01-17T22:59:35.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.600+0000 7fba20600640 1 --2- 172.21.15.161:0/2617196221 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb9f0066890 0x7fb9f0068d50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.600+0000 7fba20600640 1 --2- 172.21.15.161:0/2617196221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba18072840 0x7fba18159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.600+0000 7fba20600640 1 --2- 172.21.15.161:0/2617196221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba181517a0 0x7fba181f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.600+0000 7fba20600640 1 --2- 172.21.15.161:0/2617196221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba1806d210 0x7fba18159440 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.600+0000 7fba20600640 1 -- 172.21.15.161:0/2617196221 >> 172.21.15.161:0/2617196221 conn(0x7fba180cb070 msgr2=0x7fba1814aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:35.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.600+0000 7fba20600640 1 -- 172.21.15.161:0/2617196221 shutdown_connections 2024-01-17T22:59:35.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.600+0000 7fd456400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd45006ab40 0x7fd45014e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.600+0000 7fd456400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd450151840 0x7fd450156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.600+0000 7fd456400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd450157f40 0x7fd4501ebfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.600+0000 7fd456400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45015f190 con 0x7fd45006ab40 2024-01-17T22:59:35.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.600+0000 7fd456400640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4501f33d0 con 0x7fd450151840 2024-01-17T22:59:35.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.600+0000 7fd456400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4501f27e0 con 0x7fd450157f40 2024-01-17T22:59:35.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.600+0000 7fba20600640 1 -- 172.21.15.161:0/2617196221 wait complete. 2024-01-17T22:59:35.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.600+0000 7fd44ea00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd450151840 0x7fd450156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.600+0000 7fd44ea00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd450151840 0x7fd450156790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:49640/0 (socket says 172.21.15.161:49640) 2024-01-17T22:59:35.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.600+0000 7fd44ea00640 1 -- 172.21.15.161:0/1164294110 learned_addr learned my addr 172.21.15.161:0/1164294110 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:35.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.608+0000 7fd44ea00640 1 -- 172.21.15.161:0/1164294110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd450157f40 msgr2=0x7fd4501ebfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.608+0000 7fd44ea00640 1 --2- 172.21.15.161:0/1164294110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd450157f40 0x7fd4501ebfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.608+0000 7fd44ea00640 1 -- 172.21.15.161:0/1164294110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd45006ab40 msgr2=0x7fd45014e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.608+0000 7fd44ea00640 1 --2- 172.21.15.161:0/1164294110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd45006ab40 0x7fd45014e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.608+0000 7fd44ea00640 1 -- 172.21.15.161:0/1164294110 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd448009a70 con 0x7fd450151840 2024-01-17T22:59:35.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.608+0000 7efe11c00640 1 -- 172.21.15.161:0/1982233259 >> v1:172.21.15.190:6789/0 conn(0x7efe0c0ca3a0 legacy=0x7efe0c061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.608+0000 7efe11c00640 1 -- 172.21.15.161:0/1982233259 >> v1:172.21.15.161:6789/0 conn(0x7efe0c0ca780 legacy=0x7efe0c0c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.612+0000 7efe11c00640 1 -- 172.21.15.161:0/1982233259 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c157c50 con 0x7efe0c1517f0 2024-01-17T22:59:35.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.616+0000 7fd44ea00640 1 --2- 172.21.15.161:0/1164294110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd450151840 0x7fd450156790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd43800b480 tx=0x7fd43800b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.620+0000 7fd952400640 1 -- 172.21.15.161:0/2531010041 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd94c06ca90 con 0x7fd94c0ca780 2024-01-17T22:59:35.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574867 got 55834574867 for osd.5 2024-01-17T22:59:35.623 DEBUG:teuthology.parallel:result is None 2024-01-17T22:59:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.628+0000 7fd447400640 1 -- 172.21.15.161:0/1164294110 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd438010870 con 0x7fd450151840 2024-01-17T22:59:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.628+0000 7fd447400640 1 -- 172.21.15.161:0/1164294110 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4380109d0 con 0x7fd450151840 2024-01-17T22:59:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.628+0000 7fd456400640 1 -- 172.21.15.161:0/1164294110 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4501570b0 con 0x7fd450151840 2024-01-17T22:59:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.628+0000 7fd447400640 1 -- 172.21.15.161:0/1164294110 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd438010d80 con 0x7fd450151840 2024-01-17T22:59:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.628+0000 7fd456400640 1 -- 172.21.15.161:0/1164294110 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4501f2d80 con 0x7fd450151840 2024-01-17T22:59:35.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.628+0000 7fd456400640 1 -- 172.21.15.161:0/1164294110 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4500746a0 con 0x7fd450151840 2024-01-17T22:59:35.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.636+0000 7efe11c00640 1 --2- 172.21.15.161:0/1982233259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe0c1517f0 0x7efe0c15b620 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0097c0 tx=0x7efdfc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd5b0b705367df1 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.684+0000 7fd447400640 1 -- 172.21.15.161:0/1164294110 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fd438023480 con 0x7fd450151840 2024-01-17T22:59:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.684+0000 7fd447400640 1 --2- 172.21.15.161:0/1164294110 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fd4280668c0 0x7fd428068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.688+0000 7fd44f400640 1 --2- 172.21.15.161:0/1164294110 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fd4280668c0 0x7fd428068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.688+0000 7fd44f400640 1 --2- 172.21.15.161:0/1164294110 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fd4280668c0 0x7fd428068d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd440001600 tx=0x7fd440007a50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.692+0000 7fd447400640 1 -- 172.21.15.161:0/1164294110 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fd438055ad0 con 0x7fd450151840 2024-01-17T22:59:35.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.704+0000 7fec99600640 1 -- 172.21.15.161:0/1471883000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fec940746a0 con 0x7fec940c79c0 2024-01-17T22:59:35.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.708+0000 7efe0be00640 1 -- 172.21.15.161:0/1982233259 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc0ab680 con 0x7efe0c1517f0 2024-01-17T22:59:35.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.708+0000 7efe0be00640 1 -- 172.21.15.161:0/1982233259 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc0ab7e0 con 0x7efe0c1517f0 2024-01-17T22:59:35.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.708+0000 7efe0be00640 1 -- 172.21.15.161:0/1982233259 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc0abb70 con 0x7efe0c1517f0 2024-01-17T22:59:35.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.712+0000 7efe14600640 1 -- 172.21.15.161:0/1982233259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe0c1517f0 msgr2=0x7efe0c15b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.712+0000 7efe14600640 1 --2- 172.21.15.161:0/1982233259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe0c1517f0 0x7efe0c15b620 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0097c0 tx=0x7efdfc01c480 comp rx=0 tx=0).stop 2024-01-17T22:59:35.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.712+0000 7efe14600640 1 -- 172.21.15.161:0/1982233259 shutdown_connections 2024-01-17T22:59:35.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.712+0000 7efe14600640 1 --2- 172.21.15.161:0/1982233259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe0c1517f0 0x7efe0c15b620 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.712+0000 7efe14600640 1 -- 172.21.15.161:0/1982233259 >> 172.21.15.161:0/1982233259 conn(0x7efe0c06ad40 msgr2=0x7efe0c06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:35.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.712+0000 7efe14600640 1 -- 172.21.15.161:0/1982233259 shutdown_connections 2024-01-17T22:59:35.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.712+0000 7efe14600640 1 -- 172.21.15.161:0/1982233259 wait complete. 2024-01-17T22:59:35.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.712+0000 7efe14600640 1 Processor -- start 2024-01-17T22:59:35.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.712+0000 7efe14600640 1 -- start start 2024-01-17T22:59:35.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.712+0000 7efe14600640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe0c0ca3a0 0x7efe0c0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.712+0000 7efe14600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe0c0ca780 0x7efe0c06caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.712+0000 7efe14600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe0c1517f0 0x7efe0c1406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.712+0000 7efe14600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c146510 con 0x7efe0c0ca780 2024-01-17T22:59:35.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.712+0000 7efe14600640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c145850 con 0x7efe0c0ca3a0 2024-01-17T22:59:35.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.712+0000 7efe14600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c145af0 con 0x7efe0c1517f0 2024-01-17T22:59:35.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.716+0000 7efe11200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe0c0ca780 0x7efe0c06caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.716+0000 7efe11200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe0c0ca780 0x7efe0c06caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60620/0 (socket says 172.21.15.161:60620) 2024-01-17T22:59:35.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.716+0000 7efe11200640 1 -- 172.21.15.161:0/3381385360 learned_addr learned my addr 172.21.15.161:0/3381385360 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:35.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.720+0000 7efe11200640 1 -- 172.21.15.161:0/3381385360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe0c1517f0 msgr2=0x7efe0c1406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.720+0000 7efe11200640 1 --2- 172.21.15.161:0/3381385360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe0c1517f0 0x7efe0c1406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.720+0000 7efe11200640 1 -- 172.21.15.161:0/3381385360 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe0c0ca3a0 msgr2=0x7efe0c0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.720+0000 7efe11200640 1 --2- 172.21.15.161:0/3381385360 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe0c0ca3a0 0x7efe0c0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.720+0000 7efe11200640 1 -- 172.21.15.161:0/3381385360 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc009420 con 0x7efe0c0ca780 2024-01-17T22:59:35.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.720+0000 7efe11200640 1 --2- 172.21.15.161:0/3381385360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe0c0ca780 0x7efe0c06caf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efdf400c400 tx=0x7efdf400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.724+0000 7efe09600640 1 -- 172.21.15.161:0/3381385360 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4005cf0 con 0x7efe0c0ca780 2024-01-17T22:59:35.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.724+0000 7efe09600640 1 -- 172.21.15.161:0/3381385360 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf4005e50 con 0x7efe0c0ca780 2024-01-17T22:59:35.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.724+0000 7efe09600640 1 -- 172.21.15.161:0/3381385360 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf40072d0 con 0x7efe0c0ca780 2024-01-17T22:59:35.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.724+0000 7efe14600640 1 -- 172.21.15.161:0/3381385360 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0c1461a0 con 0x7efe0c0ca780 2024-01-17T22:59:35.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.724+0000 7efe14600640 1 -- 172.21.15.161:0/3381385360 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0c06bf60 con 0x7efe0c0ca780 2024-01-17T22:59:35.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.724+0000 7efe14600640 1 -- 172.21.15.161:0/3381385360 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0c146000 con 0x7efe0c0ca780 2024-01-17T22:59:35.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.744+0000 7efe09600640 1 -- 172.21.15.161:0/3381385360 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7efdf4007430 con 0x7efe0c0ca780 2024-01-17T22:59:35.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.748+0000 7efe09600640 1 --2- 172.21.15.161:0/3381385360 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efde4066890 0x7efde4068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.748+0000 7efe11c00640 1 --2- 172.21.15.161:0/3381385360 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efde4066890 0x7efde4068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.748+0000 7efe11c00640 1 --2- 172.21.15.161:0/3381385360 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efde4066890 0x7efde4068d50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0af000 tx=0x7efdfc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.768+0000 7fc1f6400640 1 -- 172.21.15.161:0/3596345533 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc1f0160a00 con 0x7fc1f014cb40 2024-01-17T22:59:35.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.836+0000 7f33f6000640 1 -- 172.21.15.161:0/3694085047 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f33f0003c90 con 0x7f34001508d0 2024-01-17T22:59:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.840+0000 7f33f6000640 1 --2- 172.21.15.161:0/3694085047 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f33d80668c0 0x7f33d8068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.840+0000 7f33fd400640 1 --2- 172.21.15.161:0/3694085047 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f33d80668c0 0x7f33d8068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:35.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.840+0000 7f33fd400640 1 --2- 172.21.15.161:0/3694085047 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f33d80668c0 0x7f33d8068d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f34000c9b50 tx=0x7f33e8006bb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.852+0000 7f33f6000640 1 -- 172.21.15.161:0/3694085047 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f33f00551f0 con 0x7f34001508d0 2024-01-17T22:59:35.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.860+0000 7f33e2a00640 1 --2- 172.21.15.161:0/1980679238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33e4071360 0x7f33e4150620 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00ba80 tx=0x7f33dc00bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.912+0000 7f33f6000640 1 -- 172.21.15.161:0/3694085047 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f33f0050e30 con 0x7f34001508d0 2024-01-17T22:59:35.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.996+0000 7efe09600640 1 -- 172.21.15.161:0/3381385360 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7efdf401de50 con 0x7efe0c0ca780 2024-01-17T22:59:35.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.996+0000 7efe09600640 1 -- 172.21.15.161:0/3381385360 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7efdf4050c70 con 0x7efe0c0ca780 2024-01-17T22:59:35.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:35.996+0000 7fc1e7400640 1 -- 172.21.15.161:0/3596345533 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc1d80b0030 con 0x7fc1f014cb40 2024-01-17T22:59:35.995 INFO:teuthology.orchestra.run.smithi161.stdout:60129542160 2024-01-17T22:59:35.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.000+0000 7fc1f6400640 1 -- 172.21.15.161:0/3596345533 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc1c8066890 msgr2=0x7fc1c8068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.000+0000 7fc1f6400640 1 --2- 172.21.15.161:0/3596345533 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc1c8066890 0x7fc1c8068d50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009730 tx=0x7fc1e0006ca0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.000+0000 7fc1f6400640 1 -- 172.21.15.161:0/3596345533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1f014cb40 msgr2=0x7fc1f01f5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:35.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.000+0000 7fc1f6400640 1 --2- 172.21.15.161:0/3596345533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1f014cb40 0x7fc1f01f5ea0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80ae040 tx=0x7fc1d80192a0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.000+0000 7fc1f6400640 1 -- 172.21.15.161:0/3596345533 shutdown_connections 2024-01-17T22:59:35.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.000+0000 7fc1f6400640 1 --2- 172.21.15.161:0/3596345533 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc1c8066890 0x7fc1c8068d50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.000+0000 7fc1f6400640 1 --2- 172.21.15.161:0/3596345533 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1f014cf20 0x7fc1f0140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.000+0000 7fc1f6400640 1 --2- 172.21.15.161:0/3596345533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1f014cb40 0x7fc1f01f5ea0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.000+0000 7fc1f6400640 1 --2- 172.21.15.161:0/3596345533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1f00c2c60 0x7fc1f00ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:35.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.000+0000 7fc1f6400640 1 -- 172.21.15.161:0/3596345533 >> 172.21.15.161:0/3596345533 conn(0x7fc1f0071670 msgr2=0x7fc1f00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:35.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.000+0000 7fc1f6400640 1 -- 172.21.15.161:0/3596345533 shutdown_connections 2024-01-17T22:59:35.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.000+0000 7fc1f6400640 1 -- 172.21.15.161:0/3596345533 wait complete. 2024-01-17T22:59:36.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542161 got 60129542160 for osd.0 2024-01-17T22:59:36.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.036+0000 7f33daa00640 1 -- 172.21.15.161:0/1980679238 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc00cc00 con 0x7f33e4071360 2024-01-17T22:59:36.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.036+0000 7f33daa00640 1 -- 172.21.15.161:0/1980679238 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc00cd80 con 0x7f33e4071360 2024-01-17T22:59:36.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.036+0000 7f33daa00640 1 -- 172.21.15.161:0/1980679238 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc014680 con 0x7f33e4071360 2024-01-17T22:59:36.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.036+0000 7f33e9c00640 1 -- 172.21.15.161:0/1980679238 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e41f35b0 con 0x7f33e4071360 2024-01-17T22:59:36.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.036+0000 7f33e9c00640 1 -- 172.21.15.161:0/1980679238 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e40ad8e0 con 0x7f33e4071360 2024-01-17T22:59:36.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.036+0000 7fd943400640 1 -- 172.21.15.161:0/2531010041 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd94c06ca90 con 0x7fd94c0ca780 2024-01-17T22:59:36.035 INFO:teuthology.orchestra.run.smithi161.stdout:64424509457 2024-01-17T22:59:36.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.036+0000 7f33e9c00640 1 -- 172.21.15.161:0/1980679238 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e40adad0 con 0x7f33e4071360 2024-01-17T22:59:36.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.040+0000 7fd952400640 1 -- 172.21.15.161:0/2531010041 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fd924066890 msgr2=0x7fd924068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:36.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.040+0000 7fd952400640 1 --2- 172.21.15.161:0/2531010041 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fd924066890 0x7fd924068d50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd94400ab90 tx=0x7fd944009250 comp rx=0 tx=0).stop 2024-01-17T22:59:36.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.040+0000 7fd952400640 1 -- 172.21.15.161:0/2531010041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd94c0ca780 msgr2=0x7fd94c146890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:36.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.040+0000 7fd952400640 1 --2- 172.21.15.161:0/2531010041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd94c0ca780 0x7fd94c146890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd93400e930 tx=0x7fd93400edf0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.040+0000 7fd952400640 1 -- 172.21.15.161:0/2531010041 shutdown_connections 2024-01-17T22:59:36.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.040+0000 7fd952400640 1 --2- 172.21.15.161:0/2531010041 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fd924066890 0x7fd924068d50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.040+0000 7fd952400640 1 --2- 172.21.15.161:0/2531010041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd94c1517f0 0x7fd94c146dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.040+0000 7fd952400640 1 --2- 172.21.15.161:0/2531010041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd94c0ca780 0x7fd94c146890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.040+0000 7fd952400640 1 --2- 172.21.15.161:0/2531010041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd94c0ca3a0 0x7fd94c1f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.040+0000 7fd952400640 1 -- 172.21.15.161:0/2531010041 >> 172.21.15.161:0/2531010041 conn(0x7fd94c06ad40 msgr2=0x7fd94c0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:36.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.040+0000 7fd952400640 1 -- 172.21.15.161:0/2531010041 shutdown_connections 2024-01-17T22:59:36.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.040+0000 7fd952400640 1 -- 172.21.15.161:0/2531010041 wait complete. 2024-01-17T22:59:36.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509457 for osd.1 2024-01-17T22:59:36.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.080+0000 7fec8aa00640 1 -- 172.21.15.161:0/1471883000 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec7c01e090 con 0x7fec940c79c0 2024-01-17T22:59:36.081 INFO:teuthology.orchestra.run.smithi161.stdout:64424509458 2024-01-17T22:59:36.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.084+0000 7fec99600640 1 -- 172.21.15.161:0/1471883000 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fec6c066890 msgr2=0x7fec6c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:36.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.084+0000 7fec99600640 1 --2- 172.21.15.161:0/1471883000 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fec6c066890 0x7fec6c068d50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fec84000f70 tx=0x7fec84007a90 comp rx=0 tx=0).stop 2024-01-17T22:59:36.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.084+0000 7fec99600640 1 -- 172.21.15.161:0/1471883000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec940c79c0 msgr2=0x7fec940ae850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:36.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.084+0000 7fec99600640 1 --2- 172.21.15.161:0/1471883000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec940c79c0 0x7fec940ae850 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00b550 tx=0x7fec7c00ba10 comp rx=0 tx=0).stop 2024-01-17T22:59:36.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.084+0000 7fec99600640 1 -- 172.21.15.161:0/1471883000 shutdown_connections 2024-01-17T22:59:36.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.084+0000 7fec99600640 1 --2- 172.21.15.161:0/1471883000 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fec6c066890 0x7fec6c068d50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.084+0000 7fec99600640 1 --2- 172.21.15.161:0/1471883000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec940c79c0 0x7fec940ae850 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.084+0000 7fec99600640 1 --2- 172.21.15.161:0/1471883000 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec941539a0 0x7fec940aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.084+0000 7fec99600640 1 --2- 172.21.15.161:0/1471883000 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec94061640 0x7fec940ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.084+0000 7fec99600640 1 -- 172.21.15.161:0/1471883000 >> 172.21.15.161:0/1471883000 conn(0x7fec9406ad40 msgr2=0x7fec9406c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:36.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.084+0000 7fec99600640 1 -- 172.21.15.161:0/1471883000 shutdown_connections 2024-01-17T22:59:36.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.084+0000 7fec99600640 1 -- 172.21.15.161:0/1471883000 wait complete. 2024-01-17T22:59:36.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509459 got 64424509458 for osd.7 2024-01-17T22:59:36.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.116+0000 7f3405000640 1 -- 172.21.15.161:0/3694085047 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f34000746a0 con 0x7f34001508d0 2024-01-17T22:59:36.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.120+0000 7fd447400640 1 -- 172.21.15.161:0/1164294110 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fd4380551a0 con 0x7fd450151840 2024-01-17T22:59:36.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.204+0000 7efe14600640 1 -- 172.21.15.161:0/3381385360 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7efe0c146000 con 0x7efe0c0ca780 2024-01-17T22:59:36.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.212+0000 7efe09600640 1 -- 172.21.15.161:0/3381385360 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efdf4017020 con 0x7efe0c0ca780 2024-01-17T22:59:36.209 INFO:teuthology.orchestra.run.smithi161.stdout:64424509458 2024-01-17T22:59:36.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.212+0000 7efe14600640 1 -- 172.21.15.161:0/3381385360 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efde4066890 msgr2=0x7efde4068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:36.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.212+0000 7efe14600640 1 --2- 172.21.15.161:0/3381385360 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efde4066890 0x7efde4068d50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0af000 tx=0x7efdfc008040 comp rx=0 tx=0).stop 2024-01-17T22:59:36.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.212+0000 7efe14600640 1 -- 172.21.15.161:0/3381385360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe0c0ca780 msgr2=0x7efe0c06caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:36.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.212+0000 7efe14600640 1 --2- 172.21.15.161:0/3381385360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe0c0ca780 0x7efe0c06caf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efdf400c400 tx=0x7efdf400c8c0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.212+0000 7efe14600640 1 -- 172.21.15.161:0/3381385360 shutdown_connections 2024-01-17T22:59:36.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.212+0000 7efe14600640 1 --2- 172.21.15.161:0/3381385360 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efde4066890 0x7efde4068d50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.212+0000 7efe14600640 1 --2- 172.21.15.161:0/3381385360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe0c1517f0 0x7efe0c1406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.212+0000 7efe14600640 1 --2- 172.21.15.161:0/3381385360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe0c0ca780 0x7efe0c06caf0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.212+0000 7efe14600640 1 --2- 172.21.15.161:0/3381385360 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe0c0ca3a0 0x7efe0c0cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.212+0000 7efe14600640 1 -- 172.21.15.161:0/3381385360 >> 172.21.15.161:0/3381385360 conn(0x7efe0c06ad40 msgr2=0x7efe0c0cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:36.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.216+0000 7efe14600640 1 -- 172.21.15.161:0/3381385360 shutdown_connections 2024-01-17T22:59:36.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.216+0000 7efe14600640 1 -- 172.21.15.161:0/3381385360 wait complete. 2024-01-17T22:59:36.233 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509458 for osd.6 2024-01-17T22:59:36.233 DEBUG:teuthology.parallel:result is None 2024-01-17T22:59:36.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.284+0000 7fd456400640 1 -- 172.21.15.161:0/1164294110 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd45006a890 con 0x7fd450151840 2024-01-17T22:59:36.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.288+0000 7fd447400640 1 -- 172.21.15.161:0/1164294110 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd43801e020 con 0x7fd450151840 2024-01-17T22:59:36.288 INFO:teuthology.orchestra.run.smithi161.stdout:64424509458 2024-01-17T22:59:36.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.292+0000 7fd456400640 1 -- 172.21.15.161:0/1164294110 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fd4280668c0 msgr2=0x7fd428068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:36.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.292+0000 7fd456400640 1 --2- 172.21.15.161:0/1164294110 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fd4280668c0 0x7fd428068d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd440001600 tx=0x7fd440007a50 comp rx=0 tx=0).stop 2024-01-17T22:59:36.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.292+0000 7fd456400640 1 -- 172.21.15.161:0/1164294110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd450151840 msgr2=0x7fd450156790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:36.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.292+0000 7fd456400640 1 --2- 172.21.15.161:0/1164294110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd450151840 0x7fd450156790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd43800b480 tx=0x7fd43800b940 comp rx=0 tx=0).stop 2024-01-17T22:59:36.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.292+0000 7fd456400640 1 -- 172.21.15.161:0/1164294110 shutdown_connections 2024-01-17T22:59:36.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.292+0000 7fd456400640 1 --2- 172.21.15.161:0/1164294110 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fd4280668c0 0x7fd428068d80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.292+0000 7fd456400640 1 --2- 172.21.15.161:0/1164294110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd450151840 0x7fd450156790 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.292+0000 7fd456400640 1 --2- 172.21.15.161:0/1164294110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd450157f40 0x7fd4501ebfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.292+0000 7fd456400640 1 --2- 172.21.15.161:0/1164294110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd45006ab40 0x7fd45014e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.292+0000 7fd456400640 1 -- 172.21.15.161:0/1164294110 >> 172.21.15.161:0/1164294110 conn(0x7fd45006fba0 msgr2=0x7fd4500c68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:36.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.292+0000 7fd456400640 1 -- 172.21.15.161:0/1164294110 shutdown_connections 2024-01-17T22:59:36.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.292+0000 7fd456400640 1 -- 172.21.15.161:0/1164294110 wait complete. 2024-01-17T22:59:36.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509458 for osd.3 2024-01-17T22:59:36.310 DEBUG:teuthology.parallel:result is None 2024-01-17T22:59:36.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.376+0000 7f33daa00640 1 -- 172.21.15.161:0/1980679238 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f33dc01d3b0 con 0x7f33e4071360 2024-01-17T22:59:36.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.380+0000 7f33daa00640 1 --2- 172.21.15.161:0/1980679238 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f33bc066890 0x7f33bc068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:36.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.380+0000 7f33e2000640 1 --2- 172.21.15.161:0/1980679238 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f33bc066890 0x7f33bc068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:36.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.380+0000 7f33e2000640 1 --2- 172.21.15.161:0/1980679238 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f33bc066890 0x7f33bc068d50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0b2000 tx=0x7f33cc004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:36.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.392+0000 7f33daa00640 1 -- 172.21.15.161:0/1980679238 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f33dc055bd0 con 0x7f33e4071360 2024-01-17T22:59:36.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.420+0000 7f33f6000640 1 -- 172.21.15.161:0/3694085047 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f33f0017090 con 0x7f34001508d0 2024-01-17T22:59:36.419 INFO:teuthology.orchestra.run.smithi161.stdout:64424509458 2024-01-17T22:59:36.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.424+0000 7f33daa00640 1 -- 172.21.15.161:0/1980679238 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f33dc051810 con 0x7f33e4071360 2024-01-17T22:59:36.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.424+0000 7f3405000640 1 -- 172.21.15.161:0/3694085047 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f33d80668c0 msgr2=0x7f33d8068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:36.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.424+0000 7f3405000640 1 --2- 172.21.15.161:0/3694085047 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f33d80668c0 0x7f33d8068d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f34000c9b50 tx=0x7f33e8006bb0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.424+0000 7f3405000640 1 -- 172.21.15.161:0/3694085047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34001508d0 msgr2=0x7f34001490f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.424+0000 7f3405000640 1 --2- 172.21.15.161:0/3694085047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34001508d0 0x7f34001490f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f33f000c4c0 tx=0x7f33f0001e80 comp rx=0 tx=0).stop 2024-01-17T22:59:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.424+0000 7f3405000640 1 -- 172.21.15.161:0/3694085047 shutdown_connections 2024-01-17T22:59:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.424+0000 7f3405000640 1 --2- 172.21.15.161:0/3694085047 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f33d80668c0 0x7f33d8068d80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.424+0000 7f3405000640 1 --2- 172.21.15.161:0/3694085047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3400156fe0 0x7f3400149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.424+0000 7f3405000640 1 --2- 172.21.15.161:0/3694085047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34000c59a0 0x7f34000c3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.424+0000 7f3405000640 1 --2- 172.21.15.161:0/3694085047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34001508d0 0x7f34001490f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.424+0000 7f3405000640 1 -- 172.21.15.161:0/3694085047 >> 172.21.15.161:0/3694085047 conn(0x7f340006fc50 msgr2=0x7f340006e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.424+0000 7f3405000640 1 -- 172.21.15.161:0/3694085047 shutdown_connections 2024-01-17T22:59:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.424+0000 7f3405000640 1 -- 172.21.15.161:0/3694085047 wait complete. 2024-01-17T22:59:36.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509458 for osd.2 2024-01-17T22:59:36.450 DEBUG:teuthology.parallel:result is None 2024-01-17T22:59:36.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.592+0000 7f33e9c00640 1 -- 172.21.15.161:0/1980679238 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f33e40746a0 con 0x7f33e4071360 2024-01-17T22:59:36.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.616+0000 7f33daa00640 1 -- 172.21.15.161:0/1980679238 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f33dc019020 con 0x7f33e4071360 2024-01-17T22:59:36.614 INFO:teuthology.orchestra.run.smithi161.stdout:64424509458 2024-01-17T22:59:36.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.616+0000 7f33e9c00640 1 -- 172.21.15.161:0/1980679238 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f33bc066890 msgr2=0x7f33bc068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:36.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.616+0000 7f33e9c00640 1 --2- 172.21.15.161:0/1980679238 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f33bc066890 0x7f33bc068d50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0b2000 tx=0x7f33cc004740 comp rx=0 tx=0).stop 2024-01-17T22:59:36.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.616+0000 7f33e9c00640 1 -- 172.21.15.161:0/1980679238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33e4071360 msgr2=0x7f33e4150620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:36.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.616+0000 7f33e9c00640 1 --2- 172.21.15.161:0/1980679238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33e4071360 0x7f33e4150620 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00ba80 tx=0x7f33dc00bf40 comp rx=0 tx=0).stop 2024-01-17T22:59:36.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.616+0000 7f33e9c00640 1 -- 172.21.15.161:0/1980679238 shutdown_connections 2024-01-17T22:59:36.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.616+0000 7f33e9c00640 1 --2- 172.21.15.161:0/1980679238 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f33bc066890 0x7f33bc068d50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.616+0000 7f33e9c00640 1 --2- 172.21.15.161:0/1980679238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33e40cda40 0x7f33e41f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.616+0000 7f33e9c00640 1 --2- 172.21.15.161:0/1980679238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33e4153730 0x7f33e40ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.616+0000 7f33e9c00640 1 --2- 172.21.15.161:0/1980679238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33e4071360 0x7f33e4150620 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:36.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.616+0000 7f33e9c00640 1 -- 172.21.15.161:0/1980679238 >> 172.21.15.161:0/1980679238 conn(0x7f33e4070460 msgr2=0x7f33e40cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:36.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.620+0000 7f33e9c00640 1 -- 172.21.15.161:0/1980679238 shutdown_connections 2024-01-17T22:59:36.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:36.620+0000 7f33e9c00640 1 -- 172.21.15.161:0/1980679238 wait complete. 2024-01-17T22:59:36.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509458 for osd.4 2024-01-17T22:59:36.637 DEBUG:teuthology.parallel:result is None 2024-01-17T22:59:37.018 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-17T22:59:37.059 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-17T22:59:37.106 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-17T22:59:37.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.164+0000 7f3d89a00640 1 Processor -- start 2024-01-17T22:59:37.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.164+0000 7f3d89a00640 1 -- start start 2024-01-17T22:59:37.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.164+0000 7f3d89a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d841539a0 0x7f3d840ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:37.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.164+0000 7f3d89a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3d840c79c0 0x7f3d84061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:37.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.164+0000 7f3d89a00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d840c9890 con 0x7f3d84061640 2024-01-17T22:59:37.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.164+0000 7f3d89a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8406d570 con 0x7f3d840c79c0 2024-01-17T22:59:37.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.164+0000 7f3d89a00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d84159bf0 con 0x7f3d841539a0 2024-01-17T22:59:37.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.164+0000 7f3d82000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3d840c79c0 0x7f3d84061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:37.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.164+0000 7f3d82000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3d840c79c0 0x7f3d84061100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60630/0 (socket says 172.21.15.161:60630) 2024-01-17T22:59:37.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.164+0000 7f3d82000640 1 -- 172.21.15.161:0/328722610 learned_addr learned my addr 172.21.15.161:0/328722610 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:37.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.168+0000 7f3d82a00640 1 --2- 172.21.15.161:0/328722610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d841539a0 0x7f3d840ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:37.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.168+0000 7f3d82000640 1 -- 172.21.15.161:0/328722610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d841539a0 msgr2=0x7f3d840ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:37.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.168+0000 7f3d82000640 1 --2- 172.21.15.161:0/328722610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d841539a0 0x7f3d840ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.168+0000 7f3d82000640 1 -- 172.21.15.161:0/328722610 >> v1:172.21.15.190:6789/0 conn(0x7f3d84061640 legacy=0x7f3d8415d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:37.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.168+0000 7f3d82000640 1 -- 172.21.15.161:0/328722610 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d84159eb0 con 0x7f3d840c79c0 2024-01-17T22:59:37.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.172+0000 7f3d82000640 1 --2- 172.21.15.161:0/328722610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d840c79c0 0x7f3d84061100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009870 tx=0x7f3d6c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570620b14a83f69 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:37.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.176+0000 7f3d81600640 1 -- 172.21.15.161:0/328722610 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c0a9400 con 0x7f3d840c79c0 2024-01-17T22:59:37.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.176+0000 7f3d81600640 1 -- 172.21.15.161:0/328722610 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c0a9560 con 0x7f3d840c79c0 2024-01-17T22:59:37.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.176+0000 7f3d81600640 1 -- 172.21.15.161:0/328722610 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c0a98f0 con 0x7f3d840c79c0 2024-01-17T22:59:37.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.176+0000 7f3d89a00640 1 -- 172.21.15.161:0/328722610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d840c79c0 msgr2=0x7f3d84061100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:37.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.176+0000 7f3d89a00640 1 --2- 172.21.15.161:0/328722610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d840c79c0 0x7f3d84061100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009870 tx=0x7f3d6c01c540 comp rx=0 tx=0).stop 2024-01-17T22:59:37.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.180+0000 7f3d89a00640 1 -- 172.21.15.161:0/328722610 shutdown_connections 2024-01-17T22:59:37.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.180+0000 7f3d89a00640 1 --2- 172.21.15.161:0/328722610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d840c79c0 0x7f3d84061100 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.180+0000 7f3d89a00640 1 --2- 172.21.15.161:0/328722610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d841539a0 0x7f3d840ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.180+0000 7f3d89a00640 1 -- 172.21.15.161:0/328722610 >> 172.21.15.161:0/328722610 conn(0x7f3d8406ad40 msgr2=0x7f3d8406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:37.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.180+0000 7f3d89a00640 1 -- 172.21.15.161:0/328722610 shutdown_connections 2024-01-17T22:59:37.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.180+0000 7f3d89a00640 1 -- 172.21.15.161:0/328722610 wait complete. 2024-01-17T22:59:37.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.180+0000 7f3d89a00640 1 Processor -- start 2024-01-17T22:59:37.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.180+0000 7f3d89a00640 1 -- start start 2024-01-17T22:59:37.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.184+0000 7f3d89a00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d84061640 0x7f3d840c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:37.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.184+0000 7f3d89a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d840c79c0 0x7f3d8414ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:37.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.184+0000 7f3d89a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d841539a0 0x7f3d840b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:37.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.184+0000 7f3d89a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d840b1fa0 con 0x7f3d840c79c0 2024-01-17T22:59:37.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.184+0000 7f3d89a00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d840b19e0 con 0x7f3d84061640 2024-01-17T22:59:37.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.184+0000 7f3d89a00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d840b1cc0 con 0x7f3d841539a0 2024-01-17T22:59:37.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.184+0000 7f3d82000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d840c79c0 0x7f3d8414ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:37.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.184+0000 7f3d82000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d840c79c0 0x7f3d8414ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60640/0 (socket says 172.21.15.161:60640) 2024-01-17T22:59:37.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.184+0000 7f3d82000640 1 -- 172.21.15.161:0/2379863551 learned_addr learned my addr 172.21.15.161:0/2379863551 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:37.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.184+0000 7f3d83400640 1 --2- 172.21.15.161:0/2379863551 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d841539a0 0x7f3d840b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:37.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.184+0000 7f3d82a00640 1 --2- 172.21.15.161:0/2379863551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d84061640 0x7f3d840c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:37.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.188+0000 7f3d82000640 1 -- 172.21.15.161:0/2379863551 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d841539a0 msgr2=0x7f3d840b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:37.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.188+0000 7f3d82000640 1 --2- 172.21.15.161:0/2379863551 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d841539a0 0x7f3d840b0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.188+0000 7f3d82000640 1 -- 172.21.15.161:0/2379863551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d84061640 msgr2=0x7f3d840c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:37.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.188+0000 7f3d82000640 1 --2- 172.21.15.161:0/2379863551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d84061640 0x7f3d840c25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.188+0000 7f3d82000640 1 -- 172.21.15.161:0/2379863551 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c0094d0 con 0x7f3d840c79c0 2024-01-17T22:59:37.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.192+0000 7f3d82000640 1 --2- 172.21.15.161:0/2379863551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d840c79c0 0x7f3d8414ea80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c01a170 tx=0x7f3d6c01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.196+0000 7f3d7aa00640 1 -- 172.21.15.161:0/2379863551 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c0a9400 con 0x7f3d840c79c0 2024-01-17T22:59:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.196+0000 7f3d7aa00640 1 -- 172.21.15.161:0/2379863551 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c0b1800 con 0x7f3d840c79c0 2024-01-17T22:59:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.196+0000 7f3d7aa00640 1 -- 172.21.15.161:0/2379863551 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c0b1b70 con 0x7f3d840c79c0 2024-01-17T22:59:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.196+0000 7f3d89a00640 1 -- 172.21.15.161:0/2379863551 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8414dfa0 con 0x7f3d840c79c0 2024-01-17T22:59:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.196+0000 7f3d89a00640 1 -- 172.21.15.161:0/2379863551 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8414e560 con 0x7f3d840c79c0 2024-01-17T22:59:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.196+0000 7f3d89a00640 1 -- 172.21.15.161:0/2379863551 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8406b620 con 0x7f3d840c79c0 2024-01-17T22:59:37.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.216+0000 7fab69800640 1 Processor -- start 2024-01-17T22:59:37.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.216+0000 7fab69800640 1 -- start start 2024-01-17T22:59:37.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.216+0000 7fab69800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab64151a90 0x7fab64157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:37.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.216+0000 7fab69800640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fab640c9650 0x7fab640c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:37.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.216+0000 7fab69800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab64158530 con 0x7fab640c8970 2024-01-17T22:59:37.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.216+0000 7fab69800640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6415b5d0 con 0x7fab640c9650 2024-01-17T22:59:37.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.216+0000 7fab69800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6406efe0 con 0x7fab64151a90 2024-01-17T22:59:37.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.220+0000 7fab62000640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fab640c9650 0x7fab640c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:37.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.220+0000 7fab62a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab64151a90 0x7fab64157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:37.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.220+0000 7fab62a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab64151a90 0x7fab64157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:40292/0 (socket says 172.21.15.161:40292) 2024-01-17T22:59:37.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.220+0000 7fab62a00640 1 -- 172.21.15.161:0/513947192 learned_addr learned my addr 172.21.15.161:0/513947192 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:37.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.220+0000 7f3d7aa00640 1 -- 172.21.15.161:0/2379863551 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f3d6c0c5430 con 0x7f3d840c79c0 2024-01-17T22:59:37.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.224+0000 7f3d7aa00640 1 --2- 172.21.15.161:0/2379863551 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3d5c066890 0x7f3d5c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:37.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.224+0000 7f3d82a00640 1 --2- 172.21.15.161:0/2379863551 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3d5c066890 0x7f3d5c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:37.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.224+0000 7f3d82a00640 1 --2- 172.21.15.161:0/2379863551 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3d5c066890 0x7f3d5c068d50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3d740079c0 tx=0x7f3d74008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:37.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.224+0000 7f3d7aa00640 1 -- 172.21.15.161:0/2379863551 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f3d6c0efc60 con 0x7f3d840c79c0 2024-01-17T22:59:37.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.228+0000 7fab62a00640 1 -- 172.21.15.161:0/513947192 >> v2:172.21.15.190:3300/0 conn(0x7fab640c9650 msgr2=0x7fab640c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:37.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.228+0000 7fab62a00640 1 --2- 172.21.15.161:0/513947192 >> v2:172.21.15.190:3300/0 conn(0x7fab640c9650 0x7fab640c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.228+0000 7fab62a00640 1 -- 172.21.15.161:0/513947192 >> v1:172.21.15.190:6789/0 conn(0x7fab640c8970 legacy=0x7fab640c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:37.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.228+0000 7fab62a00640 1 -- 172.21.15.161:0/513947192 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6406ed00 con 0x7fab64151a90 2024-01-17T22:59:37.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.236+0000 7fab62a00640 1 --2- 172.21.15.161:0/513947192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab64151a90 0x7fab64157ff0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fab54009870 tx=0x7fab5401ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21e956e0b4e8a47a server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:37.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.244+0000 7fab61600640 1 -- 172.21.15.161:0/513947192 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540a8a30 con 0x7fab64151a90 2024-01-17T22:59:37.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.244+0000 7fab61600640 1 -- 172.21.15.161:0/513947192 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab540a8b90 con 0x7fab64151a90 2024-01-17T22:59:37.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.244+0000 7fab61600640 1 -- 172.21.15.161:0/513947192 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540b0440 con 0x7fab64151a90 2024-01-17T22:59:37.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.248+0000 7fab69800640 1 -- 172.21.15.161:0/513947192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab64151a90 msgr2=0x7fab64157ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:37.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.248+0000 7fab69800640 1 --2- 172.21.15.161:0/513947192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab64151a90 0x7fab64157ff0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fab54009870 tx=0x7fab5401ed30 comp rx=0 tx=0).stop 2024-01-17T22:59:37.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.248+0000 7fab69800640 1 -- 172.21.15.161:0/513947192 shutdown_connections 2024-01-17T22:59:37.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.248+0000 7fab69800640 1 --2- 172.21.15.161:0/513947192 >> v2:172.21.15.190:3300/0 conn(0x7fab640c9650 0x7fab640c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.248+0000 7fab69800640 1 --2- 172.21.15.161:0/513947192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab64151a90 0x7fab64157ff0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.248+0000 7fab69800640 1 -- 172.21.15.161:0/513947192 >> 172.21.15.161:0/513947192 conn(0x7fab6406fc50 msgr2=0x7fab64070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:37.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.248+0000 7fab69800640 1 -- 172.21.15.161:0/513947192 shutdown_connections 2024-01-17T22:59:37.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.248+0000 7fab69800640 1 -- 172.21.15.161:0/513947192 wait complete. 2024-01-17T22:59:37.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.248+0000 7fab69800640 1 Processor -- start 2024-01-17T22:59:37.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.248+0000 7fab69800640 1 -- start start 2024-01-17T22:59:37.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.252+0000 7fab69800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab640c8970 0x7fab641e19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:37.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.252+0000 7fab69800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab640c9650 0x7fab641579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:37.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.252+0000 7fab69800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab64151a90 0x7fab641f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:37.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.252+0000 7fab69800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab641e2380 con 0x7fab640c9650 2024-01-17T22:59:37.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.252+0000 7fab69800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab641e32f0 con 0x7fab640c8970 2024-01-17T22:59:37.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.252+0000 7fab69800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab641e35d0 con 0x7fab64151a90 2024-01-17T22:59:37.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.252+0000 7fab62a00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab640c8970 0x7fab641e19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:37.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.252+0000 7fab63400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab64151a90 0x7fab641f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:37.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.256+0000 7fab62a00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab640c8970 0x7fab641e19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:49684/0 (socket says 172.21.15.161:49684) 2024-01-17T22:59:37.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.256+0000 7fab63400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab64151a90 0x7fab641f2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:40296/0 (socket says 172.21.15.161:40296) 2024-01-17T22:59:37.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.256+0000 7fab62a00640 1 -- 172.21.15.161:0/2246996717 learned_addr learned my addr 172.21.15.161:0/2246996717 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:37.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.260+0000 7f2e1d000640 1 Processor -- start 2024-01-17T22:59:37.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.260+0000 7f2e1d000640 1 -- start start 2024-01-17T22:59:37.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.260+0000 7f2e1d000640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2e180c8a30 0x7f2e180c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:37.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.260+0000 7f2e1d000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e180c7d10 con 0x7f2e1815b620 2024-01-17T22:59:37.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.260+0000 7f2e1d000640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e181576d0 con 0x7f2e181517f0 2024-01-17T22:59:37.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.260+0000 7f2e1d000640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e18157970 con 0x7f2e180c8a30 2024-01-17T22:59:37.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.268+0000 7fab62a00640 1 -- 172.21.15.161:0/2246996717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab64151a90 msgr2=0x7fab641f2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:37.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.268+0000 7fab62a00640 1 --2- 172.21.15.161:0/2246996717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab64151a90 0x7fab641f2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.268+0000 7fab62a00640 1 -- 172.21.15.161:0/2246996717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab640c9650 msgr2=0x7fab641579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:37.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.268+0000 7fab62a00640 1 --2- 172.21.15.161:0/2246996717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab640c9650 0x7fab641579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.268+0000 7fab62a00640 1 -- 172.21.15.161:0/2246996717 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab540094d0 con 0x7fab640c8970 2024-01-17T22:59:37.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.268+0000 7fab63400640 1 --2- 172.21.15.161:0/2246996717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab64151a90 0x7fab641f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-17T22:59:37.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.276+0000 7f2e16800640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2e180c8a30 0x7f2e180c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:37.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.276+0000 7f2e15e00640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f2e181517f0 0x7f2e180ca3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.161:35374/0 (socket says 172.21.15.161:35374) 2024-01-17T22:59:37.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.276+0000 7f2e15e00640 1 -- 172.21.15.161:0/964589370 learned_addr learned my addr 172.21.15.161:0/964589370 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:37.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.280+0000 7fab62a00640 1 --2- 172.21.15.161:0/2246996717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab640c8970 0x7fab641e19e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fab5401b940 tx=0x7fab5401bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:37.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.288+0000 7f2e16800640 1 -- 172.21.15.161:0/964589370 >> v1:172.21.15.190:6789/0 conn(0x7f2e181517f0 legacy=0x7f2e180ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:37.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.288+0000 7f2e16800640 1 -- 172.21.15.161:0/964589370 >> v1:172.21.15.161:6789/0 conn(0x7f2e1815b620 legacy=0x7f2e18061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:37.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.288+0000 7f2e16800640 1 -- 172.21.15.161:0/964589370 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e18157c50 con 0x7f2e180c8a30 2024-01-17T22:59:37.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.296+0000 7f2e16800640 1 --2- 172.21.15.161:0/964589370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e180c8a30 0x7f2e180c8e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009d90 tx=0x7f2e1001c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4e62f8994dfe0fe server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:37.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.316+0000 7fab5aa00640 1 -- 172.21.15.161:0/2246996717 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540be070 con 0x7fab640c8970 2024-01-17T22:59:37.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.316+0000 7fab5aa00640 1 -- 172.21.15.161:0/2246996717 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab540b1ae0 con 0x7fab640c8970 2024-01-17T22:59:37.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.316+0000 7fab5aa00640 1 -- 172.21.15.161:0/2246996717 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540b9440 con 0x7fab640c8970 2024-01-17T22:59:37.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.316+0000 7fab69800640 1 -- 172.21.15.161:0/2246996717 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab641e25d0 con 0x7fab640c8970 2024-01-17T22:59:37.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.316+0000 7fab69800640 1 -- 172.21.15.161:0/2246996717 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab641e2b90 con 0x7fab640c8970 2024-01-17T22:59:37.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.316+0000 7fab69800640 1 -- 172.21.15.161:0/2246996717 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab64154fa0 con 0x7fab640c8970 2024-01-17T22:59:37.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.320+0000 7f2e14a00640 1 -- 172.21.15.161:0/964589370 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e100a59d0 con 0x7f2e180c8a30 2024-01-17T22:59:37.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.320+0000 7f2e14a00640 1 -- 172.21.15.161:0/964589370 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e100a5b30 con 0x7f2e180c8a30 2024-01-17T22:59:37.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.320+0000 7f2e14a00640 1 -- 172.21.15.161:0/964589370 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e100ad440 con 0x7f2e180c8a30 2024-01-17T22:59:37.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.320+0000 7f2e1d000640 1 -- 172.21.15.161:0/964589370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e180c8a30 msgr2=0x7f2e180c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:37.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.320+0000 7f2e1d000640 1 --2- 172.21.15.161:0/964589370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e180c8a30 0x7f2e180c8e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009d90 tx=0x7f2e1001c910 comp rx=0 tx=0).stop 2024-01-17T22:59:37.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.320+0000 7f2e1d000640 1 -- 172.21.15.161:0/964589370 shutdown_connections 2024-01-17T22:59:37.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.320+0000 7f2e1d000640 1 --2- 172.21.15.161:0/964589370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e180c8a30 0x7f2e180c8e10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.320+0000 7f2e1d000640 1 -- 172.21.15.161:0/964589370 >> 172.21.15.161:0/964589370 conn(0x7f2e1806ad40 msgr2=0x7f2e1806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:37.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.320+0000 7f2e1d000640 1 -- 172.21.15.161:0/964589370 shutdown_connections 2024-01-17T22:59:37.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.320+0000 7f2e1d000640 1 -- 172.21.15.161:0/964589370 wait complete. 2024-01-17T22:59:37.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.320+0000 7f2e1d000640 1 Processor -- start 2024-01-17T22:59:37.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.320+0000 7f2e1d000640 1 -- start start 2024-01-17T22:59:37.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.324+0000 7f2e1d000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e180c8a30 0x7f2e1806c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:37.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.324+0000 7f2e1d000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e181517f0 0x7f2e18159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:37.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.324+0000 7f2e1d000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e1815b620 0x7f2e18159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:37.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.324+0000 7f2e1d000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e181f63a0 con 0x7f2e1815b620 2024-01-17T22:59:37.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.324+0000 7f2e1d000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e181597d0 con 0x7f2e180c8a30 2024-01-17T22:59:37.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.324+0000 7f2e1d000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e18158e00 con 0x7f2e181517f0 2024-01-17T22:59:37.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.324+0000 7f2e15400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e181517f0 0x7f2e18159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:37.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.324+0000 7f2e15400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e181517f0 0x7f2e18159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:40308/0 (socket says 172.21.15.161:40308) 2024-01-17T22:59:37.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.324+0000 7f2e15400640 1 -- 172.21.15.161:0/271183400 learned_addr learned my addr 172.21.15.161:0/271183400 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:37.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.336+0000 7f2e15400640 1 -- 172.21.15.161:0/271183400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e180c8a30 msgr2=0x7f2e1806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:37.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.336+0000 7f2e15400640 1 --2- 172.21.15.161:0/271183400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e180c8a30 0x7f2e1806c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.336+0000 7f2e15400640 1 -- 172.21.15.161:0/271183400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e1815b620 msgr2=0x7f2e18159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:37.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.336+0000 7f2e15400640 1 --2- 172.21.15.161:0/271183400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e1815b620 0x7f2e18159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.336+0000 7f2e15400640 1 -- 172.21.15.161:0/271183400 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e10009a70 con 0x7f2e181517f0 2024-01-17T22:59:37.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.340+0000 7f2e15400640 1 --2- 172.21.15.161:0/271183400 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e181517f0 0x7f2e18159290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800b410 tx=0x7f2e0800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:37.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.352+0000 7f2e0e000640 1 -- 172.21.15.161:0/271183400 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08011830 con 0x7f2e181517f0 2024-01-17T22:59:37.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.352+0000 7f2e0e000640 1 -- 172.21.15.161:0/271183400 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e080119b0 con 0x7f2e181517f0 2024-01-17T22:59:37.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.352+0000 7f2e0e000640 1 -- 172.21.15.161:0/271183400 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08011d60 con 0x7f2e181517f0 2024-01-17T22:59:37.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.352+0000 7f2e1d000640 1 -- 172.21.15.161:0/271183400 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e181f6860 con 0x7f2e181517f0 2024-01-17T22:59:37.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.352+0000 7f2e1d000640 1 -- 172.21.15.161:0/271183400 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e181587b0 con 0x7f2e181517f0 2024-01-17T22:59:37.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.352+0000 7f2e1d000640 1 -- 172.21.15.161:0/271183400 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e1806b620 con 0x7f2e181517f0 2024-01-17T22:59:37.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.472+0000 7f3d7aa00640 1 -- 172.21.15.161:0/2379863551 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f3d6c0ebfa0 con 0x7f3d840c79c0 2024-01-17T22:59:37.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.628+0000 7f3d89a00640 1 -- 172.21.15.161:0/2379863551 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3d8414e750 con 0x7f3d840c79c0 2024-01-17T22:59:37.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.632+0000 7f3d7aa00640 1 -- 172.21.15.161:0/2379863551 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d6c0c0020 con 0x7f3d840c79c0 2024-01-17T22:59:37.629 INFO:teuthology.orchestra.run.smithi161.stdout:60129542161 2024-01-17T22:59:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.632+0000 7f3d89a00640 1 -- 172.21.15.161:0/2379863551 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3d5c066890 msgr2=0x7f3d5c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.632+0000 7f3d89a00640 1 --2- 172.21.15.161:0/2379863551 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3d5c066890 0x7f3d5c068d50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3d740079c0 tx=0x7f3d74008040 comp rx=0 tx=0).stop 2024-01-17T22:59:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.632+0000 7f3d89a00640 1 -- 172.21.15.161:0/2379863551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d840c79c0 msgr2=0x7f3d8414ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.632+0000 7f3d89a00640 1 --2- 172.21.15.161:0/2379863551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d840c79c0 0x7f3d8414ea80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c01a170 tx=0x7f3d6c01ad80 comp rx=0 tx=0).stop 2024-01-17T22:59:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.632+0000 7f3d89a00640 1 -- 172.21.15.161:0/2379863551 shutdown_connections 2024-01-17T22:59:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.632+0000 7f3d89a00640 1 --2- 172.21.15.161:0/2379863551 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3d5c066890 0x7f3d5c068d50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.632+0000 7f3d89a00640 1 --2- 172.21.15.161:0/2379863551 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d841539a0 0x7f3d840b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.632+0000 7f3d89a00640 1 --2- 172.21.15.161:0/2379863551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d840c79c0 0x7f3d8414ea80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.632+0000 7f3d89a00640 1 --2- 172.21.15.161:0/2379863551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d84061640 0x7f3d840c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.632+0000 7f3d89a00640 1 -- 172.21.15.161:0/2379863551 >> 172.21.15.161:0/2379863551 conn(0x7f3d8406ad40 msgr2=0x7f3d84152d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.632+0000 7f3d89a00640 1 -- 172.21.15.161:0/2379863551 shutdown_connections 2024-01-17T22:59:37.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.632+0000 7f3d89a00640 1 -- 172.21.15.161:0/2379863551 wait complete. 2024-01-17T22:59:37.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.640+0000 7fab5aa00640 1 -- 172.21.15.161:0/2246996717 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fab540b7070 con 0x7fab640c8970 2024-01-17T22:59:37.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.640+0000 7fab5aa00640 1 --2- 172.21.15.161:0/2246996717 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fab3c066890 0x7fab3c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:37.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.644+0000 7fab62000640 1 --2- 172.21.15.161:0/2246996717 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fab3c066890 0x7fab3c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:37.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.644+0000 7fab62000640 1 --2- 172.21.15.161:0/2246996717 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fab3c066890 0x7fab3c068d50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fab640b1a60 tx=0x7fab4c0095c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:37.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.644+0000 7fab5aa00640 1 -- 172.21.15.161:0/2246996717 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fab540f3340 con 0x7fab640c8970 2024-01-17T22:59:37.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542161 got 60129542161 for osd.0 2024-01-17T22:59:37.652 DEBUG:teuthology.parallel:result is None 2024-01-17T22:59:37.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.664+0000 7fab5aa00640 1 -- 172.21.15.161:0/2246996717 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fab540eef80 con 0x7fab640c8970 2024-01-17T22:59:37.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.692+0000 7f2e0e000640 1 -- 172.21.15.161:0/271183400 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f2e0801a400 con 0x7f2e181517f0 2024-01-17T22:59:37.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.692+0000 7f2e0e000640 1 --2- 172.21.15.161:0/271183400 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2df0066890 0x7f2df0068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:37.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.692+0000 7f2e15e00640 1 --2- 172.21.15.161:0/271183400 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2df0066890 0x7f2df0068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:37.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.692+0000 7f2e15e00640 1 --2- 172.21.15.161:0/271183400 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2df0066890 0x7f2df0068d50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2e00001600 tx=0x7f2e00007a50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:37.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.696+0000 7f2e0e000640 1 -- 172.21.15.161:0/271183400 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f2e08055e70 con 0x7f2e181517f0 2024-01-17T22:59:37.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.712+0000 7f2e0e000640 1 -- 172.21.15.161:0/271183400 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f2e08051ab0 con 0x7f2e181517f0 2024-01-17T22:59:37.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.832+0000 7fab69800640 1 -- 172.21.15.161:0/2246996717 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fab640746a0 con 0x7fab640c8970 2024-01-17T22:59:37.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.860+0000 7fab5aa00640 1 -- 172.21.15.161:0/2246996717 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab540b5020 con 0x7fab640c8970 2024-01-17T22:59:37.857 INFO:teuthology.orchestra.run.smithi161.stdout:64424509458 2024-01-17T22:59:37.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.860+0000 7fab69800640 1 -- 172.21.15.161:0/2246996717 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fab3c066890 msgr2=0x7fab3c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:37.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.860+0000 7fab69800640 1 --2- 172.21.15.161:0/2246996717 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fab3c066890 0x7fab3c068d50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fab640b1a60 tx=0x7fab4c0095c0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.860+0000 7fab69800640 1 -- 172.21.15.161:0/2246996717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab640c8970 msgr2=0x7fab641e19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:37.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.860+0000 7fab69800640 1 --2- 172.21.15.161:0/2246996717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab640c8970 0x7fab641e19e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fab5401b940 tx=0x7fab5401bad0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.864+0000 7fab69800640 1 -- 172.21.15.161:0/2246996717 shutdown_connections 2024-01-17T22:59:37.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.864+0000 7fab69800640 1 --2- 172.21.15.161:0/2246996717 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fab3c066890 0x7fab3c068d50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.864+0000 7fab69800640 1 --2- 172.21.15.161:0/2246996717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab64151a90 0x7fab641f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.864+0000 7fab69800640 1 --2- 172.21.15.161:0/2246996717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab640c9650 0x7fab641579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.864+0000 7fab69800640 1 --2- 172.21.15.161:0/2246996717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab640c8970 0x7fab641e19e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.864+0000 7fab69800640 1 -- 172.21.15.161:0/2246996717 >> 172.21.15.161:0/2246996717 conn(0x7fab6406fc50 msgr2=0x7fab640ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:37.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.864+0000 7fab69800640 1 -- 172.21.15.161:0/2246996717 shutdown_connections 2024-01-17T22:59:37.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.864+0000 7fab69800640 1 -- 172.21.15.161:0/2246996717 wait complete. 2024-01-17T22:59:37.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509458 for osd.1 2024-01-17T22:59:37.892 DEBUG:teuthology.parallel:result is None 2024-01-17T22:59:37.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.896+0000 7f2e1d000640 1 -- 172.21.15.161:0/271183400 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2e180746a0 con 0x7f2e181517f0 2024-01-17T22:59:37.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.904+0000 7f2e0e000640 1 -- 172.21.15.161:0/271183400 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2e08015020 con 0x7f2e181517f0 2024-01-17T22:59:37.902 INFO:teuthology.orchestra.run.smithi161.stdout:64424509459 2024-01-17T22:59:37.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.904+0000 7f2e1d000640 1 -- 172.21.15.161:0/271183400 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2df0066890 msgr2=0x7f2df0068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:37.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.904+0000 7f2e1d000640 1 --2- 172.21.15.161:0/271183400 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2df0066890 0x7f2df0068d50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2e00001600 tx=0x7f2e00007a50 comp rx=0 tx=0).stop 2024-01-17T22:59:37.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.904+0000 7f2e1d000640 1 -- 172.21.15.161:0/271183400 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e181517f0 msgr2=0x7f2e18159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:37.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.904+0000 7f2e1d000640 1 --2- 172.21.15.161:0/271183400 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e181517f0 0x7f2e18159290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800b410 tx=0x7f2e0800b8d0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.904+0000 7f2e1d000640 1 -- 172.21.15.161:0/271183400 shutdown_connections 2024-01-17T22:59:37.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.904+0000 7f2e1d000640 1 --2- 172.21.15.161:0/271183400 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2df0066890 0x7f2df0068d50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.904+0000 7f2e1d000640 1 --2- 172.21.15.161:0/271183400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e1815b620 0x7f2e18159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.904+0000 7f2e1d000640 1 --2- 172.21.15.161:0/271183400 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e181517f0 0x7f2e18159290 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.904+0000 7f2e1d000640 1 --2- 172.21.15.161:0/271183400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e180c8a30 0x7f2e1806c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:37.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.904+0000 7f2e1d000640 1 -- 172.21.15.161:0/271183400 >> 172.21.15.161:0/271183400 conn(0x7f2e1806ad40 msgr2=0x7f2e18156e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:37.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.908+0000 7f2e1d000640 1 -- 172.21.15.161:0/271183400 shutdown_connections 2024-01-17T22:59:37.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:37.908+0000 7f2e1d000640 1 -- 172.21.15.161:0/271183400 wait complete. 2024-01-17T22:59:37.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509459 got 64424509459 for osd.7 2024-01-17T22:59:37.926 DEBUG:teuthology.parallel:result is None 2024-01-17T22:59:37.926 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-17T22:59:37.926 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-17T22:59:38.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.108+0000 7fdaa1000640 1 Processor -- start 2024-01-17T22:59:38.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.108+0000 7fdaa1000640 1 -- start start 2024-01-17T22:59:38.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.108+0000 7fdaa1000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda9c1517a0 0x7fda9c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:38.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.108+0000 7fdaa1000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fda9c06d210 0x7fda9c072300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:38.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.108+0000 7fdaa1000640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c15b9c0 con 0x7fda9c072840 2024-01-17T22:59:38.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.108+0000 7fdaa1000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c15ae40 con 0x7fda9c06d210 2024-01-17T22:59:38.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.108+0000 7fdaa1000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c15b120 con 0x7fda9c1517a0 2024-01-17T22:59:38.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.108+0000 7fda99400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fda9c06d210 0x7fda9c072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:38.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.108+0000 7fda99400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fda9c06d210 0x7fda9c072300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60666/0 (socket says 172.21.15.161:60666) 2024-01-17T22:59:38.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.108+0000 7fda99400640 1 -- 172.21.15.161:0/3614357036 learned_addr learned my addr 172.21.15.161:0/3614357036 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:38.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.112+0000 7fda99e00640 1 --2- 172.21.15.161:0/3614357036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda9c1517a0 0x7fda9c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:38.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.112+0000 7fda99400640 1 -- 172.21.15.161:0/3614357036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda9c1517a0 msgr2=0x7fda9c06ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:38.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.112+0000 7fda99400640 1 --2- 172.21.15.161:0/3614357036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda9c1517a0 0x7fda9c06ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:38.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.112+0000 7fda99400640 1 -- 172.21.15.161:0/3614357036 >> v1:172.21.15.190:6789/0 conn(0x7fda9c072840 legacy=0x7fda9c157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:38.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.112+0000 7fda99400640 1 -- 172.21.15.161:0/3614357036 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c15b400 con 0x7fda9c06d210 2024-01-17T22:59:38.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.116+0000 7fda99400640 1 --2- 172.21.15.161:0/3614357036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c06d210 0x7fda9c072300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fda84009870 tx=0x7fda8401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8592803c9431bfa server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:38.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.120+0000 7fda98a00640 1 -- 172.21.15.161:0/3614357036 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda840ab620 con 0x7fda9c06d210 2024-01-17T22:59:38.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.120+0000 7fda98a00640 1 -- 172.21.15.161:0/3614357036 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda840ab780 con 0x7fda9c06d210 2024-01-17T22:59:38.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.120+0000 7fda98a00640 1 -- 172.21.15.161:0/3614357036 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda840abb10 con 0x7fda9c06d210 2024-01-17T22:59:38.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.120+0000 7fdaa1000640 1 -- 172.21.15.161:0/3614357036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c06d210 msgr2=0x7fda9c072300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:38.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.120+0000 7fdaa1000640 1 --2- 172.21.15.161:0/3614357036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c06d210 0x7fda9c072300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fda84009870 tx=0x7fda8401c510 comp rx=0 tx=0).stop 2024-01-17T22:59:38.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.120+0000 7fdaa1000640 1 -- 172.21.15.161:0/3614357036 shutdown_connections 2024-01-17T22:59:38.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.120+0000 7fdaa1000640 1 --2- 172.21.15.161:0/3614357036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c06d210 0x7fda9c072300 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:38.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.120+0000 7fdaa1000640 1 --2- 172.21.15.161:0/3614357036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda9c1517a0 0x7fda9c06ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:38.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.120+0000 7fdaa1000640 1 -- 172.21.15.161:0/3614357036 >> 172.21.15.161:0/3614357036 conn(0x7fda9c0cb070 msgr2=0x7fda9c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:38.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.120+0000 7fdaa1000640 1 -- 172.21.15.161:0/3614357036 shutdown_connections 2024-01-17T22:59:38.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.120+0000 7fdaa1000640 1 -- 172.21.15.161:0/3614357036 wait complete. 2024-01-17T22:59:38.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.124+0000 7fdaa1000640 1 Processor -- start 2024-01-17T22:59:38.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.124+0000 7fdaa1000640 1 -- start start 2024-01-17T22:59:38.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.124+0000 7fdaa1000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c06d210 0x7fda9c1419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:38.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.124+0000 7fdaa1000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda9c072840 0x7fda9c1433c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:38.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.124+0000 7fdaa1000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda9c1517a0 0x7fda9c147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:38.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.124+0000 7fdaa1000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0c4c10 con 0x7fda9c06d210 2024-01-17T22:59:38.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.124+0000 7fdaa1000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0c3010 con 0x7fda9c1517a0 2024-01-17T22:59:38.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.124+0000 7fdaa1000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c145350 con 0x7fda9c072840 2024-01-17T22:59:38.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.124+0000 7fda99e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c06d210 0x7fda9c1419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:38.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.124+0000 7fda99e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c06d210 0x7fda9c1419f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60678/0 (socket says 172.21.15.161:60678) 2024-01-17T22:59:38.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.124+0000 7fda99e00640 1 -- 172.21.15.161:0/2964784736 learned_addr learned my addr 172.21.15.161:0/2964784736 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:38.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.124+0000 7fda9a800640 1 --2- 172.21.15.161:0/2964784736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda9c1517a0 0x7fda9c147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:38.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.124+0000 7fda99400640 1 --2- 172.21.15.161:0/2964784736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda9c072840 0x7fda9c1433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:38.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.128+0000 7fda99e00640 1 -- 172.21.15.161:0/2964784736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda9c072840 msgr2=0x7fda9c1433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:38.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.128+0000 7fda99e00640 1 --2- 172.21.15.161:0/2964784736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda9c072840 0x7fda9c1433c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:38.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.128+0000 7fda99e00640 1 -- 172.21.15.161:0/2964784736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda9c1517a0 msgr2=0x7fda9c147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:38.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.128+0000 7fda99e00640 1 --2- 172.21.15.161:0/2964784736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda9c1517a0 0x7fda9c147bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:38.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.128+0000 7fda99e00640 1 -- 172.21.15.161:0/2964784736 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda840094d0 con 0x7fda9c06d210 2024-01-17T22:59:38.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.132+0000 7fda99e00640 1 --2- 172.21.15.161:0/2964784736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c06d210 0x7fda9c1419f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00d800 tx=0x7fda8c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:38.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.136+0000 7fda92000640 1 -- 172.21.15.161:0/2964784736 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c00b6c0 con 0x7fda9c06d210 2024-01-17T22:59:38.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.136+0000 7fda92000640 1 -- 172.21.15.161:0/2964784736 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c00b820 con 0x7fda9c06d210 2024-01-17T22:59:38.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.136+0000 7fda92000640 1 -- 172.21.15.161:0/2964784736 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c00bb90 con 0x7fda9c06d210 2024-01-17T22:59:38.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.136+0000 7fdaa1000640 1 -- 172.21.15.161:0/2964784736 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c145070 con 0x7fda9c06d210 2024-01-17T22:59:38.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.136+0000 7fdaa1000640 1 -- 172.21.15.161:0/2964784736 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c0c4930 con 0x7fda9c06d210 2024-01-17T22:59:38.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.136+0000 7fdaa1000640 1 -- 172.21.15.161:0/2964784736 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c0746a0 con 0x7fda9c06d210 2024-01-17T22:59:38.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.200+0000 7fda92000640 1 -- 172.21.15.161:0/2964784736 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fda8c00bcf0 con 0x7fda9c06d210 2024-01-17T22:59:38.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.200+0000 7fda92000640 1 --2- 172.21.15.161:0/2964784736 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fda74066890 0x7fda74068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:38.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.200+0000 7fda99400640 1 --2- 172.21.15.161:0/2964784736 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fda74066890 0x7fda74068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:38.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.200+0000 7fda99400640 1 --2- 172.21.15.161:0/2964784736 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fda74066890 0x7fda74068d50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fda840af000 tx=0x7fda840b6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:38.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.384+0000 7fda92000640 1 -- 172.21.15.161:0/2964784736 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fda8c015e40 con 0x7fda9c06d210 2024-01-17T22:59:38.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.384+0000 7fda92000640 1 -- 172.21.15.161:0/2964784736 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fda8c052320 con 0x7fda9c06d210 2024-01-17T22:59:38.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.536+0000 7fdaa1000640 1 -- 172.21.15.161:0/2964784736 --> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda9c06e3a0 con 0x7fda74066890 2024-01-17T22:59:38.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.548+0000 7fda92000640 1 -- 172.21.15.161:0/2964784736 <== mgr.4110 v2:172.21.15.161:6800/272458188 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368872 (secure 0 0 0) 0x7fda840ab5a0 con 0x7fda74066890 2024-01-17T22:59:38.549 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:38.552 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-01-17T22:59:38.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.552+0000 7fdaa1000640 1 -- 172.21.15.161:0/2964784736 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fda74066890 msgr2=0x7fda74068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:38.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.552+0000 7fdaa1000640 1 --2- 172.21.15.161:0/2964784736 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fda74066890 0x7fda74068d50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fda840af000 tx=0x7fda840b6040 comp rx=0 tx=0).stop 2024-01-17T22:59:38.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.552+0000 7fdaa1000640 1 -- 172.21.15.161:0/2964784736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c06d210 msgr2=0x7fda9c1419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:38.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.552+0000 7fdaa1000640 1 --2- 172.21.15.161:0/2964784736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c06d210 0x7fda9c1419f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00d800 tx=0x7fda8c00dcc0 comp rx=0 tx=0).stop 2024-01-17T22:59:38.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.552+0000 7fdaa1000640 1 -- 172.21.15.161:0/2964784736 shutdown_connections 2024-01-17T22:59:38.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.552+0000 7fdaa1000640 1 --2- 172.21.15.161:0/2964784736 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fda74066890 0x7fda74068d50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:38.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.552+0000 7fdaa1000640 1 --2- 172.21.15.161:0/2964784736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda9c1517a0 0x7fda9c147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:38.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.552+0000 7fdaa1000640 1 --2- 172.21.15.161:0/2964784736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda9c072840 0x7fda9c1433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:38.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.552+0000 7fdaa1000640 1 --2- 172.21.15.161:0/2964784736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c06d210 0x7fda9c1419f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:38.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.552+0000 7fdaa1000640 1 -- 172.21.15.161:0/2964784736 >> 172.21.15.161:0/2964784736 conn(0x7fda9c0cb070 msgr2=0x7fda9c0c78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:38.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.552+0000 7fdaa1000640 1 -- 172.21.15.161:0/2964784736 shutdown_connections 2024-01-17T22:59:38.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.552+0000 7fdaa1000640 1 -- 172.21.15.161:0/2964784736 wait complete. 2024-01-17T22:59:38.571 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-01-17T22:59:36.657395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597819,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":287,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218720,"kb_used_data":2592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756000,"statfs":{"total":773094113280,"available":772870144000,"internally_reserved":0,"allocated":2654208,"data_stored":2163110,"data_compressed":66578,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2812,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002991"},"pg_stats":[{"pgid":"2.1f","version":"28'9","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.309615+0000","last_change":"2024-01-17T22:58:48.328193+0000","last_active":"2024-01-17T22:59:32.309615+0000","last_peered":"2024-01-17T22:59:32.309615+0000","last_clean":"2024-01-17T22:59:32.309615+0000","last_became_active":"2024-01-17T22:58:48.327340+0000","last_became_peered":"2024-01-17T22:58:48.327340+0000","last_unstale":"2024-01-17T22:59:32.309615+0000","last_undegraded":"2024-01-17T22:59:32.309615+0000","last_fullsized":"2024-01-17T22:59:32.309615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:56.524325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477190+0000","last_change":"2024-01-17T22:58:49.351609+0000","last_active":"2024-01-17T22:59:07.477190+0000","last_peered":"2024-01-17T22:59:07.477190+0000","last_clean":"2024-01-17T22:59:07.477190+0000","last_became_active":"2024-01-17T22:58:49.350812+0000","last_became_peered":"2024-01-17T22:58:49.350812+0000","last_unstale":"2024-01-17T22:59:07.477190+0000","last_undegraded":"2024-01-17T22:59:07.477190+0000","last_fullsized":"2024-01-17T22:59:07.477190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:02:07.535209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.461792+0000","last_change":"2024-01-17T22:58:55.903757+0000","last_active":"2024-01-17T22:59:07.461792+0000","last_peered":"2024-01-17T22:59:07.461792+0000","last_clean":"2024-01-17T22:59:07.461792+0000","last_became_active":"2024-01-17T22:58:55.903167+0000","last_became_peered":"2024-01-17T22:58:55.903167+0000","last_unstale":"2024-01-17T22:59:07.461792+0000","last_undegraded":"2024-01-17T22:59:07.461792+0000","last_fullsized":"2024-01-17T22:59:07.461792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:22.127961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:09.241367+0000","last_change":"2024-01-17T22:58:48.373068+0000","last_active":"2024-01-17T22:59:09.241367+0000","last_peered":"2024-01-17T22:59:09.241367+0000","last_clean":"2024-01-17T22:59:09.241367+0000","last_became_active":"2024-01-17T22:58:48.372582+0000","last_became_peered":"2024-01-17T22:58:48.372582+0000","last_unstale":"2024-01-17T22:59:09.241367+0000","last_undegraded":"2024-01-17T22:59:09.241367+0000","last_fullsized":"2024-01-17T22:59:09.241367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:10:59.139723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.478032+0000","last_change":"2024-01-17T22:58:49.511918+0000","last_active":"2024-01-17T22:59:07.478032+0000","last_peered":"2024-01-17T22:59:07.478032+0000","last_clean":"2024-01-17T22:59:07.478032+0000","last_became_active":"2024-01-17T22:58:49.511303+0000","last_became_peered":"2024-01-17T22:58:49.511303+0000","last_unstale":"2024-01-17T22:59:07.478032+0000","last_undegraded":"2024-01-17T22:59:07.478032+0000","last_fullsized":"2024-01-17T22:59:07.478032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:13:09.466879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474413+0000","last_change":"2024-01-17T22:58:55.878752+0000","last_active":"2024-01-17T22:59:07.474413+0000","last_peered":"2024-01-17T22:59:07.474413+0000","last_clean":"2024-01-17T22:59:07.474413+0000","last_became_active":"2024-01-17T22:58:55.878263+0000","last_became_peered":"2024-01-17T22:58:55.878263+0000","last_unstale":"2024-01-17T22:59:07.474413+0000","last_undegraded":"2024-01-17T22:59:07.474413+0000","last_fullsized":"2024-01-17T22:59:07.474413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:19:49.420559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.315007+0000","last_change":"2024-01-17T22:58:48.346724+0000","last_active":"2024-01-17T22:59:32.315007+0000","last_peered":"2024-01-17T22:59:32.315007+0000","last_clean":"2024-01-17T22:59:32.315007+0000","last_became_active":"2024-01-17T22:58:48.346411+0000","last_became_peered":"2024-01-17T22:58:48.346411+0000","last_unstale":"2024-01-17T22:59:32.315007+0000","last_undegraded":"2024-01-17T22:59:32.315007+0000","last_fullsized":"2024-01-17T22:59:32.315007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:03:04.691978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479505+0000","last_change":"2024-01-17T22:58:49.517981+0000","last_active":"2024-01-17T22:59:07.479505+0000","last_peered":"2024-01-17T22:59:07.479505+0000","last_clean":"2024-01-17T22:59:07.479505+0000","last_became_active":"2024-01-17T22:58:49.517710+0000","last_became_peered":"2024-01-17T22:58:49.517710+0000","last_unstale":"2024-01-17T22:59:07.479505+0000","last_undegraded":"2024-01-17T22:59:07.479505+0000","last_fullsized":"2024-01-17T22:59:07.479505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475930+0000","last_change":"2024-01-17T22:58:55.847347+0000","last_active":"2024-01-17T22:59:07.475930+0000","last_peered":"2024-01-17T22:59:07.475930+0000","last_clean":"2024-01-17T22:59:07.475930+0000","last_became_active":"2024-01-17T22:58:55.846773+0000","last_became_peered":"2024-01-17T22:58:55.846773+0000","last_unstale":"2024-01-17T22:59:07.475930+0000","last_undegraded":"2024-01-17T22:59:07.475930+0000","last_fullsized":"2024-01-17T22:59:07.475930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:31:43.629750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.473014+0000","last_change":"2024-01-17T22:58:48.346483+0000","last_active":"2024-01-17T22:59:07.473014+0000","last_peered":"2024-01-17T22:59:07.473014+0000","last_clean":"2024-01-17T22:59:07.473014+0000","last_became_active":"2024-01-17T22:58:48.345749+0000","last_became_peered":"2024-01-17T22:58:48.345749+0000","last_unstale":"2024-01-17T22:59:07.473014+0000","last_undegraded":"2024-01-17T22:59:07.473014+0000","last_fullsized":"2024-01-17T22:59:07.473014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:22:41.169668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476010+0000","last_change":"2024-01-17T22:58:49.371509+0000","last_active":"2024-01-17T22:59:07.476010+0000","last_peered":"2024-01-17T22:59:07.476010+0000","last_clean":"2024-01-17T22:59:07.476010+0000","last_became_active":"2024-01-17T22:58:49.370010+0000","last_became_peered":"2024-01-17T22:58:49.370010+0000","last_unstale":"2024-01-17T22:59:07.476010+0000","last_undegraded":"2024-01-17T22:59:07.476010+0000","last_fullsized":"2024-01-17T22:59:07.476010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:36:24.817716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474645+0000","last_change":"2024-01-17T22:58:55.886223+0000","last_active":"2024-01-17T22:59:07.474645+0000","last_peered":"2024-01-17T22:59:07.474645+0000","last_clean":"2024-01-17T22:59:07.474645+0000","last_became_active":"2024-01-17T22:58:55.885739+0000","last_became_peered":"2024-01-17T22:58:55.885739+0000","last_unstale":"2024-01-17T22:59:07.474645+0000","last_undegraded":"2024-01-17T22:59:07.474645+0000","last_fullsized":"2024-01-17T22:59:07.474645+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:49:18.835647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474772+0000","last_change":"2024-01-17T22:58:49.514565+0000","last_active":"2024-01-17T22:59:07.474772+0000","last_peered":"2024-01-17T22:59:07.474772+0000","last_clean":"2024-01-17T22:59:07.474772+0000","last_became_active":"2024-01-17T22:58:49.514310+0000","last_became_peered":"2024-01-17T22:58:49.514310+0000","last_unstale":"2024-01-17T22:59:07.474772+0000","last_undegraded":"2024-01-17T22:59:07.474772+0000","last_fullsized":"2024-01-17T22:59:07.474772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:01:32.364167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.577114+0000","last_change":"2024-01-17T22:58:48.341961+0000","last_active":"2024-01-17T22:59:25.577114+0000","last_peered":"2024-01-17T22:59:25.577114+0000","last_clean":"2024-01-17T22:59:25.577114+0000","last_became_active":"2024-01-17T22:58:48.341498+0000","last_became_peered":"2024-01-17T22:58:48.341498+0000","last_unstale":"2024-01-17T22:59:25.577114+0000","last_undegraded":"2024-01-17T22:59:25.577114+0000","last_fullsized":"2024-01-17T22:59:25.577114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:56.524325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475855+0000","last_change":"2024-01-17T22:58:55.915918+0000","last_active":"2024-01-17T22:59:07.475855+0000","last_peered":"2024-01-17T22:59:07.475855+0000","last_clean":"2024-01-17T22:59:07.475855+0000","last_became_active":"2024-01-17T22:58:55.915556+0000","last_became_peered":"2024-01-17T22:58:55.915556+0000","last_unstale":"2024-01-17T22:59:07.475855+0000","last_undegraded":"2024-01-17T22:59:07.475855+0000","last_fullsized":"2024-01-17T22:59:07.475855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:22:21.478703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.462199+0000","last_change":"2024-01-17T22:58:49.388237+0000","last_active":"2024-01-17T22:59:07.462199+0000","last_peered":"2024-01-17T22:59:07.462199+0000","last_clean":"2024-01-17T22:59:07.462199+0000","last_became_active":"2024-01-17T22:58:49.387500+0000","last_became_peered":"2024-01-17T22:58:49.387500+0000","last_unstale":"2024-01-17T22:59:07.462199+0000","last_undegraded":"2024-01-17T22:59:07.462199+0000","last_fullsized":"2024-01-17T22:59:07.462199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.647283+0000","last_change":"2024-01-17T22:58:48.346215+0000","last_active":"2024-01-17T22:59:08.647283+0000","last_peered":"2024-01-17T22:59:08.647283+0000","last_clean":"2024-01-17T22:59:08.647283+0000","last_became_active":"2024-01-17T22:58:48.345584+0000","last_became_peered":"2024-01-17T22:58:48.345584+0000","last_unstale":"2024-01-17T22:59:08.647283+0000","last_undegraded":"2024-01-17T22:59:08.647283+0000","last_fullsized":"2024-01-17T22:59:08.647283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471736+0000","last_change":"2024-01-17T22:58:55.904518+0000","last_active":"2024-01-17T22:59:07.471736+0000","last_peered":"2024-01-17T22:59:07.471736+0000","last_clean":"2024-01-17T22:59:07.471736+0000","last_became_active":"2024-01-17T22:58:55.904182+0000","last_became_peered":"2024-01-17T22:58:55.904182+0000","last_unstale":"2024-01-17T22:59:07.471736+0000","last_undegraded":"2024-01-17T22:59:07.471736+0000","last_fullsized":"2024-01-17T22:59:07.471736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:24:43.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468071+0000","last_change":"2024-01-17T22:58:49.417907+0000","last_active":"2024-01-17T22:59:07.468071+0000","last_peered":"2024-01-17T22:59:07.468071+0000","last_clean":"2024-01-17T22:59:07.468071+0000","last_became_active":"2024-01-17T22:58:49.417440+0000","last_became_peered":"2024-01-17T22:58:49.417440+0000","last_unstale":"2024-01-17T22:59:07.468071+0000","last_undegraded":"2024-01-17T22:59:07.468071+0000","last_fullsized":"2024-01-17T22:59:07.468071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:59.773063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.575301+0000","last_change":"2024-01-17T22:58:48.332092+0000","last_active":"2024-01-17T22:59:25.575301+0000","last_peered":"2024-01-17T22:59:25.575301+0000","last_clean":"2024-01-17T22:59:25.575301+0000","last_became_active":"2024-01-17T22:58:48.331435+0000","last_became_peered":"2024-01-17T22:58:48.331435+0000","last_unstale":"2024-01-17T22:59:25.575301+0000","last_undegraded":"2024-01-17T22:59:25.575301+0000","last_fullsized":"2024-01-17T22:59:25.575301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:41:24.117738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:09.255716+0000","last_change":"2024-01-17T22:59:09.254564+0000","last_active":"2024-01-17T22:59:09.255716+0000","last_peered":"2024-01-17T22:59:09.255716+0000","last_clean":"2024-01-17T22:59:09.255716+0000","last_became_active":"2024-01-17T22:59:09.254084+0000","last_became_peered":"2024-01-17T22:59:09.254084+0000","last_unstale":"2024-01-17T22:59:09.255716+0000","last_undegraded":"2024-01-17T22:59:09.255716+0000","last_fullsized":"2024-01-17T22:59:09.255716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:04:05.785891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2,3],"acting":[0,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474946+0000","last_change":"2024-01-17T22:58:49.416963+0000","last_active":"2024-01-17T22:59:07.474946+0000","last_peered":"2024-01-17T22:59:07.474946+0000","last_clean":"2024-01-17T22:59:07.474946+0000","last_became_active":"2024-01-17T22:58:49.416757+0000","last_became_peered":"2024-01-17T22:58:49.416757+0000","last_unstale":"2024-01-17T22:59:07.474946+0000","last_undegraded":"2024-01-17T22:59:07.474946+0000","last_fullsized":"2024-01-17T22:59:07.474946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:08.763719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.653441+0000","last_change":"2024-01-17T22:58:48.341728+0000","last_active":"2024-01-17T22:59:25.653441+0000","last_peered":"2024-01-17T22:59:25.653441+0000","last_clean":"2024-01-17T22:59:25.653441+0000","last_became_active":"2024-01-17T22:58:48.341359+0000","last_became_peered":"2024-01-17T22:58:48.341359+0000","last_unstale":"2024-01-17T22:59:25.653441+0000","last_undegraded":"2024-01-17T22:59:25.653441+0000","last_fullsized":"2024-01-17T22:59:25.653441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:20:07.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476805+0000","last_change":"2024-01-17T22:58:55.913996+0000","last_active":"2024-01-17T22:59:07.476805+0000","last_peered":"2024-01-17T22:59:07.476805+0000","last_clean":"2024-01-17T22:59:07.476805+0000","last_became_active":"2024-01-17T22:58:55.913645+0000","last_became_peered":"2024-01-17T22:58:55.913645+0000","last_unstale":"2024-01-17T22:59:07.476805+0000","last_undegraded":"2024-01-17T22:59:07.476805+0000","last_fullsized":"2024-01-17T22:59:07.476805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468870+0000","last_change":"2024-01-17T22:58:49.417874+0000","last_active":"2024-01-17T22:59:07.468870+0000","last_peered":"2024-01-17T22:59:07.468870+0000","last_clean":"2024-01-17T22:59:07.468870+0000","last_became_active":"2024-01-17T22:58:49.417385+0000","last_became_peered":"2024-01-17T22:58:49.417385+0000","last_unstale":"2024-01-17T22:59:07.468870+0000","last_undegraded":"2024-01-17T22:59:07.468870+0000","last_fullsized":"2024-01-17T22:59:07.468870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:41.515981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.575922+0000","last_change":"2024-01-17T22:58:48.340052+0000","last_active":"2024-01-17T22:59:25.575922+0000","last_peered":"2024-01-17T22:59:25.575922+0000","last_clean":"2024-01-17T22:59:25.575922+0000","last_became_active":"2024-01-17T22:58:48.339738+0000","last_became_peered":"2024-01-17T22:58:48.339738+0000","last_unstale":"2024-01-17T22:59:25.575922+0000","last_undegraded":"2024-01-17T22:59:25.575922+0000","last_fullsized":"2024-01-17T22:59:25.575922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:58.517904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475163+0000","last_change":"2024-01-17T22:58:55.904749+0000","last_active":"2024-01-17T22:59:07.475163+0000","last_peered":"2024-01-17T22:59:07.475163+0000","last_clean":"2024-01-17T22:59:07.475163+0000","last_became_active":"2024-01-17T22:58:55.904417+0000","last_became_peered":"2024-01-17T22:58:55.904417+0000","last_unstale":"2024-01-17T22:59:07.475163+0000","last_undegraded":"2024-01-17T22:59:07.475163+0000","last_fullsized":"2024-01-17T22:59:07.475163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:22:32.504064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469801+0000","last_change":"2024-01-17T22:58:49.411284+0000","last_active":"2024-01-17T22:59:07.469801+0000","last_peered":"2024-01-17T22:59:07.469801+0000","last_clean":"2024-01-17T22:59:07.469801+0000","last_became_active":"2024-01-17T22:58:49.410830+0000","last_became_peered":"2024-01-17T22:58:49.410830+0000","last_unstale":"2024-01-17T22:59:07.469801+0000","last_undegraded":"2024-01-17T22:59:07.469801+0000","last_fullsized":"2024-01-17T22:59:07.469801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:17:04.832847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.302355+0000","last_change":"2024-01-17T22:58:48.339919+0000","last_active":"2024-01-17T22:59:32.302355+0000","last_peered":"2024-01-17T22:59:32.302355+0000","last_clean":"2024-01-17T22:59:32.302355+0000","last_became_active":"2024-01-17T22:58:48.338928+0000","last_became_peered":"2024-01-17T22:58:48.338928+0000","last_unstale":"2024-01-17T22:59:32.302355+0000","last_undegraded":"2024-01-17T22:59:32.302355+0000","last_fullsized":"2024-01-17T22:59:32.302355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:21.699809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467936+0000","last_change":"2024-01-17T22:58:55.909140+0000","last_active":"2024-01-17T22:59:07.467936+0000","last_peered":"2024-01-17T22:59:07.467936+0000","last_clean":"2024-01-17T22:59:07.467936+0000","last_became_active":"2024-01-17T22:58:55.908232+0000","last_became_peered":"2024-01-17T22:58:55.908232+0000","last_unstale":"2024-01-17T22:59:07.467936+0000","last_undegraded":"2024-01-17T22:59:07.467936+0000","last_fullsized":"2024-01-17T22:59:07.467936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.470820+0000","last_change":"2024-01-17T22:58:49.370201+0000","last_active":"2024-01-17T22:59:07.470820+0000","last_peered":"2024-01-17T22:59:07.470820+0000","last_clean":"2024-01-17T22:59:07.470820+0000","last_became_active":"2024-01-17T22:58:49.369598+0000","last_became_peered":"2024-01-17T22:58:49.369598+0000","last_unstale":"2024-01-17T22:59:07.470820+0000","last_undegraded":"2024-01-17T22:59:07.470820+0000","last_fullsized":"2024-01-17T22:59:07.470820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:15.814647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.670757+0000","last_change":"2024-01-17T22:58:48.338556+0000","last_active":"2024-01-17T22:59:08.670757+0000","last_peered":"2024-01-17T22:59:08.670757+0000","last_clean":"2024-01-17T22:59:08.670757+0000","last_became_active":"2024-01-17T22:58:48.338225+0000","last_became_peered":"2024-01-17T22:58:48.338225+0000","last_unstale":"2024-01-17T22:59:08.670757+0000","last_undegraded":"2024-01-17T22:59:08.670757+0000","last_fullsized":"2024-01-17T22:59:08.670757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:47.210049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469567+0000","last_change":"2024-01-17T22:58:55.872734+0000","last_active":"2024-01-17T22:59:07.469567+0000","last_peered":"2024-01-17T22:59:07.469567+0000","last_clean":"2024-01-17T22:59:07.469567+0000","last_became_active":"2024-01-17T22:58:55.872356+0000","last_became_peered":"2024-01-17T22:58:55.872356+0000","last_unstale":"2024-01-17T22:59:07.469567+0000","last_undegraded":"2024-01-17T22:59:07.469567+0000","last_fullsized":"2024-01-17T22:59:07.469567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:22:32.504064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476568+0000","last_change":"2024-01-17T22:58:49.369806+0000","last_active":"2024-01-17T22:59:07.476568+0000","last_peered":"2024-01-17T22:59:07.476568+0000","last_clean":"2024-01-17T22:59:07.476568+0000","last_became_active":"2024-01-17T22:58:49.369487+0000","last_became_peered":"2024-01-17T22:58:49.369487+0000","last_unstale":"2024-01-17T22:59:07.476568+0000","last_undegraded":"2024-01-17T22:59:07.476568+0000","last_fullsized":"2024-01-17T22:59:07.476568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:25.515983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477453+0000","last_change":"2024-01-17T22:58:48.341854+0000","last_active":"2024-01-17T22:59:07.477453+0000","last_peered":"2024-01-17T22:59:07.477453+0000","last_clean":"2024-01-17T22:59:07.477453+0000","last_became_active":"2024-01-17T22:58:48.339996+0000","last_became_peered":"2024-01-17T22:58:48.339996+0000","last_unstale":"2024-01-17T22:59:07.477453+0000","last_undegraded":"2024-01-17T22:59:07.477453+0000","last_fullsized":"2024-01-17T22:59:07.477453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:55:52.894278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467661+0000","last_change":"2024-01-17T22:58:55.877637+0000","last_active":"2024-01-17T22:59:07.467661+0000","last_peered":"2024-01-17T22:59:07.467661+0000","last_clean":"2024-01-17T22:59:07.467661+0000","last_became_active":"2024-01-17T22:58:55.877118+0000","last_became_peered":"2024-01-17T22:58:55.877118+0000","last_unstale":"2024-01-17T22:59:07.467661+0000","last_undegraded":"2024-01-17T22:59:07.467661+0000","last_fullsized":"2024-01-17T22:59:07.467661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:08.327495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471403+0000","last_change":"2024-01-17T22:58:49.352845+0000","last_active":"2024-01-17T22:59:07.471403+0000","last_peered":"2024-01-17T22:59:07.471403+0000","last_clean":"2024-01-17T22:59:07.471403+0000","last_became_active":"2024-01-17T22:58:49.352563+0000","last_became_peered":"2024-01-17T22:58:49.352563+0000","last_unstale":"2024-01-17T22:59:07.471403+0000","last_undegraded":"2024-01-17T22:59:07.471403+0000","last_fullsized":"2024-01-17T22:59:07.471403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:43.516572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.670274+0000","last_change":"2024-01-17T22:58:48.343658+0000","last_active":"2024-01-17T22:59:08.670274+0000","last_peered":"2024-01-17T22:59:08.670274+0000","last_clean":"2024-01-17T22:59:08.670274+0000","last_became_active":"2024-01-17T22:58:48.343060+0000","last_became_peered":"2024-01-17T22:58:48.343060+0000","last_unstale":"2024-01-17T22:59:08.670274+0000","last_undegraded":"2024-01-17T22:59:08.670274+0000","last_fullsized":"2024-01-17T22:59:08.670274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:42.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.470375+0000","last_change":"2024-01-17T22:58:55.881076+0000","last_active":"2024-01-17T22:59:07.470375+0000","last_peered":"2024-01-17T22:59:07.470375+0000","last_clean":"2024-01-17T22:59:07.470375+0000","last_became_active":"2024-01-17T22:58:55.880665+0000","last_became_peered":"2024-01-17T22:58:55.880665+0000","last_unstale":"2024-01-17T22:59:07.470375+0000","last_undegraded":"2024-01-17T22:59:07.470375+0000","last_fullsized":"2024-01-17T22:59:07.470375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:37:20.317014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475438+0000","last_change":"2024-01-17T22:58:49.385682+0000","last_active":"2024-01-17T22:59:07.475438+0000","last_peered":"2024-01-17T22:59:07.475438+0000","last_clean":"2024-01-17T22:59:07.475438+0000","last_became_active":"2024-01-17T22:58:49.384655+0000","last_became_peered":"2024-01-17T22:58:49.384655+0000","last_unstale":"2024-01-17T22:59:07.475438+0000","last_undegraded":"2024-01-17T22:59:07.475438+0000","last_fullsized":"2024-01-17T22:59:07.475438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:22:51.592384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.209484+0000","last_change":"2024-01-17T22:58:48.375527+0000","last_active":"2024-01-17T22:59:32.209484+0000","last_peered":"2024-01-17T22:59:32.209484+0000","last_clean":"2024-01-17T22:59:32.209484+0000","last_became_active":"2024-01-17T22:58:48.375210+0000","last_became_peered":"2024-01-17T22:58:48.375210+0000","last_unstale":"2024-01-17T22:59:32.209484+0000","last_undegraded":"2024-01-17T22:59:32.209484+0000","last_fullsized":"2024-01-17T22:59:32.209484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:51:00.037407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468786+0000","last_change":"2024-01-17T22:58:55.903437+0000","last_active":"2024-01-17T22:59:07.468786+0000","last_peered":"2024-01-17T22:59:07.468786+0000","last_clean":"2024-01-17T22:59:07.468786+0000","last_became_active":"2024-01-17T22:58:55.902881+0000","last_became_peered":"2024-01-17T22:58:55.902881+0000","last_unstale":"2024-01-17T22:59:07.468786+0000","last_undegraded":"2024-01-17T22:59:07.468786+0000","last_fullsized":"2024-01-17T22:59:07.468786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467415+0000","last_change":"2024-01-17T22:58:49.367932+0000","last_active":"2024-01-17T22:59:07.467415+0000","last_peered":"2024-01-17T22:59:07.467415+0000","last_clean":"2024-01-17T22:59:07.467415+0000","last_became_active":"2024-01-17T22:58:49.367236+0000","last_became_peered":"2024-01-17T22:58:49.367236+0000","last_unstale":"2024-01-17T22:59:07.467415+0000","last_undegraded":"2024-01-17T22:59:07.467415+0000","last_fullsized":"2024-01-17T22:59:07.467415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:06.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.273528+0000","last_change":"2024-01-17T22:58:48.338730+0000","last_active":"2024-01-17T22:59:32.273528+0000","last_peered":"2024-01-17T22:59:32.273528+0000","last_clean":"2024-01-17T22:59:32.273528+0000","last_became_active":"2024-01-17T22:58:48.337500+0000","last_became_peered":"2024-01-17T22:58:48.337500+0000","last_unstale":"2024-01-17T22:59:32.273528+0000","last_undegraded":"2024-01-17T22:59:32.273528+0000","last_fullsized":"2024-01-17T22:59:32.273528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:54.141445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477014+0000","last_change":"2024-01-17T22:58:55.900298+0000","last_active":"2024-01-17T22:59:07.477014+0000","last_peered":"2024-01-17T22:59:07.477014+0000","last_clean":"2024-01-17T22:59:07.477014+0000","last_became_active":"2024-01-17T22:58:55.899657+0000","last_became_peered":"2024-01-17T22:58:55.899657+0000","last_unstale":"2024-01-17T22:59:07.477014+0000","last_undegraded":"2024-01-17T22:59:07.477014+0000","last_fullsized":"2024-01-17T22:59:07.477014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:30:03.955178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468595+0000","last_change":"2024-01-17T22:58:49.412701+0000","last_active":"2024-01-17T22:59:07.468595+0000","last_peered":"2024-01-17T22:59:07.468595+0000","last_clean":"2024-01-17T22:59:07.468595+0000","last_became_active":"2024-01-17T22:58:49.411848+0000","last_became_peered":"2024-01-17T22:58:49.411848+0000","last_unstale":"2024-01-17T22:59:07.468595+0000","last_undegraded":"2024-01-17T22:59:07.468595+0000","last_fullsized":"2024-01-17T22:59:07.468595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:55:47.020055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.577746+0000","last_change":"2024-01-17T22:58:48.341769+0000","last_active":"2024-01-17T22:59:25.577746+0000","last_peered":"2024-01-17T22:59:25.577746+0000","last_clean":"2024-01-17T22:59:25.577746+0000","last_became_active":"2024-01-17T22:58:48.340963+0000","last_became_peered":"2024-01-17T22:58:48.340963+0000","last_unstale":"2024-01-17T22:59:25.577746+0000","last_undegraded":"2024-01-17T22:59:25.577746+0000","last_fullsized":"2024-01-17T22:59:25.577746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:15:16.672836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479207+0000","last_change":"2024-01-17T22:58:17.322374+0000","last_active":"2024-01-17T22:59:07.479207+0000","last_peered":"2024-01-17T22:59:07.479207+0000","last_clean":"2024-01-17T22:59:07.479207+0000","last_became_active":"2024-01-17T22:58:17.321097+0000","last_became_peered":"2024-01-17T22:58:17.321097+0000","last_unstale":"2024-01-17T22:59:07.479207+0000","last_undegraded":"2024-01-17T22:59:07.479207+0000","last_fullsized":"2024-01-17T22:59:07.479207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:15.452106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:15.452106+0000","last_clean_scrub_stamp":"2024-01-17T22:58:15.452106+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:55:58.924319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476194+0000","last_change":"2024-01-17T22:58:55.909509+0000","last_active":"2024-01-17T22:59:07.476194+0000","last_peered":"2024-01-17T22:59:07.476194+0000","last_clean":"2024-01-17T22:59:07.476194+0000","last_became_active":"2024-01-17T22:58:55.909055+0000","last_became_peered":"2024-01-17T22:58:55.909055+0000","last_unstale":"2024-01-17T22:59:07.476194+0000","last_undegraded":"2024-01-17T22:59:07.476194+0000","last_fullsized":"2024-01-17T22:59:07.476194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:11:12.388395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476079+0000","last_change":"2024-01-17T22:58:49.516198+0000","last_active":"2024-01-17T22:59:07.476079+0000","last_peered":"2024-01-17T22:59:07.476079+0000","last_clean":"2024-01-17T22:59:07.476079+0000","last_became_active":"2024-01-17T22:58:49.515941+0000","last_became_peered":"2024-01-17T22:58:49.515941+0000","last_unstale":"2024-01-17T22:59:07.476079+0000","last_undegraded":"2024-01-17T22:59:07.476079+0000","last_fullsized":"2024-01-17T22:59:07.476079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:54:07.128744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.323194+0000","last_change":"2024-01-17T22:58:48.344998+0000","last_active":"2024-01-17T22:59:32.323194+0000","last_peered":"2024-01-17T22:59:32.323194+0000","last_clean":"2024-01-17T22:59:32.323194+0000","last_became_active":"2024-01-17T22:58:48.344402+0000","last_became_peered":"2024-01-17T22:58:48.344402+0000","last_unstale":"2024-01-17T22:59:32.323194+0000","last_undegraded":"2024-01-17T22:59:32.323194+0000","last_fullsized":"2024-01-17T22:59:32.323194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:01:21.629083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475784+0000","last_change":"2024-01-17T22:58:55.886258+0000","last_active":"2024-01-17T22:59:07.475784+0000","last_peered":"2024-01-17T22:59:07.475784+0000","last_clean":"2024-01-17T22:59:07.475784+0000","last_became_active":"2024-01-17T22:58:55.885809+0000","last_became_peered":"2024-01-17T22:58:55.885809+0000","last_unstale":"2024-01-17T22:59:07.475784+0000","last_undegraded":"2024-01-17T22:59:07.475784+0000","last_fullsized":"2024-01-17T22:59:07.475784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:08.327495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.656010+0000","last_change":"2024-01-17T22:59:08.654953+0000","last_active":"2024-01-17T22:59:08.656010+0000","last_peered":"2024-01-17T22:59:08.656010+0000","last_clean":"2024-01-17T22:59:08.656010+0000","last_became_active":"2024-01-17T22:59:08.654136+0000","last_became_peered":"2024-01-17T22:59:08.654136+0000","last_unstale":"2024-01-17T22:59:08.656010+0000","last_undegraded":"2024-01-17T22:59:08.656010+0000","last_fullsized":"2024-01-17T22:59:08.656010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:19:02.000223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476805+0000","last_change":"2024-01-17T22:58:48.338206+0000","last_active":"2024-01-17T22:59:07.476805+0000","last_peered":"2024-01-17T22:59:07.476805+0000","last_clean":"2024-01-17T22:59:07.476805+0000","last_became_active":"2024-01-17T22:58:48.337489+0000","last_became_peered":"2024-01-17T22:58:48.337489+0000","last_unstale":"2024-01-17T22:59:07.476805+0000","last_undegraded":"2024-01-17T22:59:07.476805+0000","last_fullsized":"2024-01-17T22:59:07.476805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:09:04.579374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476461+0000","last_change":"2024-01-17T22:58:55.903435+0000","last_active":"2024-01-17T22:59:07.476461+0000","last_peered":"2024-01-17T22:59:07.476461+0000","last_clean":"2024-01-17T22:59:07.476461+0000","last_became_active":"2024-01-17T22:58:55.902857+0000","last_became_peered":"2024-01-17T22:58:55.902857+0000","last_unstale":"2024-01-17T22:59:07.476461+0000","last_undegraded":"2024-01-17T22:59:07.476461+0000","last_fullsized":"2024-01-17T22:59:07.476461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:24:43.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.473428+0000","last_change":"2024-01-17T22:58:49.519307+0000","last_active":"2024-01-17T22:59:07.473428+0000","last_peered":"2024-01-17T22:59:07.473428+0000","last_clean":"2024-01-17T22:59:07.473428+0000","last_became_active":"2024-01-17T22:58:49.519060+0000","last_became_peered":"2024-01-17T22:58:49.519060+0000","last_unstale":"2024-01-17T22:59:07.473428+0000","last_undegraded":"2024-01-17T22:59:07.473428+0000","last_fullsized":"2024-01-17T22:59:07.473428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:48.025499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469006+0000","last_change":"2024-01-17T22:58:48.341584+0000","last_active":"2024-01-17T22:59:07.469006+0000","last_peered":"2024-01-17T22:59:07.469006+0000","last_clean":"2024-01-17T22:59:07.469006+0000","last_became_active":"2024-01-17T22:58:48.339433+0000","last_became_peered":"2024-01-17T22:58:48.339433+0000","last_unstale":"2024-01-17T22:59:07.469006+0000","last_undegraded":"2024-01-17T22:59:07.469006+0000","last_fullsized":"2024-01-17T22:59:07.469006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:01:09.060396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474422+0000","last_change":"2024-01-17T22:58:55.905118+0000","last_active":"2024-01-17T22:59:07.474422+0000","last_peered":"2024-01-17T22:59:07.474422+0000","last_clean":"2024-01-17T22:59:07.474422+0000","last_became_active":"2024-01-17T22:58:55.904690+0000","last_became_peered":"2024-01-17T22:58:55.904690+0000","last_unstale":"2024-01-17T22:59:07.474422+0000","last_undegraded":"2024-01-17T22:59:07.474422+0000","last_fullsized":"2024-01-17T22:59:07.474422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:45:30.212764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477010+0000","last_change":"2024-01-17T22:58:49.352993+0000","last_active":"2024-01-17T22:59:07.477010+0000","last_peered":"2024-01-17T22:59:07.477010+0000","last_clean":"2024-01-17T22:59:07.477010+0000","last_became_active":"2024-01-17T22:58:49.352744+0000","last_became_peered":"2024-01-17T22:58:49.352744+0000","last_unstale":"2024-01-17T22:59:07.477010+0000","last_undegraded":"2024-01-17T22:59:07.477010+0000","last_fullsized":"2024-01-17T22:59:07.477010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:06.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.473284+0000","last_change":"2024-01-17T22:58:48.343793+0000","last_active":"2024-01-17T22:59:07.473284+0000","last_peered":"2024-01-17T22:59:07.473284+0000","last_clean":"2024-01-17T22:59:07.473284+0000","last_became_active":"2024-01-17T22:58:48.343435+0000","last_became_peered":"2024-01-17T22:58:48.343435+0000","last_unstale":"2024-01-17T22:59:07.473284+0000","last_undegraded":"2024-01-17T22:59:07.473284+0000","last_fullsized":"2024-01-17T22:59:07.473284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:50:50.592551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479386+0000","last_change":"2024-01-17T22:58:55.913690+0000","last_active":"2024-01-17T22:59:07.479386+0000","last_peered":"2024-01-17T22:59:07.479386+0000","last_clean":"2024-01-17T22:59:07.479386+0000","last_became_active":"2024-01-17T22:58:55.913197+0000","last_became_peered":"2024-01-17T22:58:55.913197+0000","last_unstale":"2024-01-17T22:59:07.479386+0000","last_undegraded":"2024-01-17T22:59:07.479386+0000","last_fullsized":"2024-01-17T22:59:07.479386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:31.829297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474856+0000","last_change":"2024-01-17T22:58:49.368242+0000","last_active":"2024-01-17T22:59:07.474856+0000","last_peered":"2024-01-17T22:59:07.474856+0000","last_clean":"2024-01-17T22:59:07.474856+0000","last_became_active":"2024-01-17T22:58:49.368018+0000","last_became_peered":"2024-01-17T22:58:49.368018+0000","last_unstale":"2024-01-17T22:59:07.474856+0000","last_undegraded":"2024-01-17T22:59:07.474856+0000","last_fullsized":"2024-01-17T22:59:07.474856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:49:55.661543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'15","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.304352+0000","last_change":"2024-01-17T22:58:48.374293+0000","last_active":"2024-01-17T22:59:32.304352+0000","last_peered":"2024-01-17T22:59:32.304352+0000","last_clean":"2024-01-17T22:59:32.304352+0000","last_became_active":"2024-01-17T22:58:48.373287+0000","last_became_peered":"2024-01-17T22:58:48.373287+0000","last_unstale":"2024-01-17T22:59:32.304352+0000","last_undegraded":"2024-01-17T22:59:32.304352+0000","last_fullsized":"2024-01-17T22:59:32.304352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477137+0000","last_change":"2024-01-17T22:58:55.909679+0000","last_active":"2024-01-17T22:59:07.477137+0000","last_peered":"2024-01-17T22:59:07.477137+0000","last_clean":"2024-01-17T22:59:07.477137+0000","last_became_active":"2024-01-17T22:58:55.909139+0000","last_became_peered":"2024-01-17T22:58:55.909139+0000","last_unstale":"2024-01-17T22:59:07.477137+0000","last_undegraded":"2024-01-17T22:59:07.477137+0000","last_fullsized":"2024-01-17T22:59:07.477137+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:39:50.993158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479057+0000","last_change":"2024-01-17T22:58:49.515761+0000","last_active":"2024-01-17T22:59:07.479057+0000","last_peered":"2024-01-17T22:59:07.479057+0000","last_clean":"2024-01-17T22:59:07.479057+0000","last_became_active":"2024-01-17T22:58:49.514776+0000","last_became_peered":"2024-01-17T22:58:49.514776+0000","last_unstale":"2024-01-17T22:59:07.479057+0000","last_undegraded":"2024-01-17T22:59:07.479057+0000","last_fullsized":"2024-01-17T22:59:07.479057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.307111+0000","last_change":"2024-01-17T22:58:48.349505+0000","last_active":"2024-01-17T22:59:32.307111+0000","last_peered":"2024-01-17T22:59:32.307111+0000","last_clean":"2024-01-17T22:59:32.307111+0000","last_became_active":"2024-01-17T22:58:48.349193+0000","last_became_peered":"2024-01-17T22:58:48.349193+0000","last_unstale":"2024-01-17T22:59:32.307111+0000","last_undegraded":"2024-01-17T22:59:32.307111+0000","last_fullsized":"2024-01-17T22:59:32.307111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:10:59.139723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477882+0000","last_change":"2024-01-17T22:58:55.911280+0000","last_active":"2024-01-17T22:59:07.477882+0000","last_peered":"2024-01-17T22:59:07.477882+0000","last_clean":"2024-01-17T22:59:07.477882+0000","last_became_active":"2024-01-17T22:58:55.910147+0000","last_became_peered":"2024-01-17T22:58:55.910147+0000","last_unstale":"2024-01-17T22:59:07.477882+0000","last_undegraded":"2024-01-17T22:59:07.477882+0000","last_fullsized":"2024-01-17T22:59:07.477882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:29:01.453903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475134+0000","last_change":"2024-01-17T22:58:49.366332+0000","last_active":"2024-01-17T22:59:07.475134+0000","last_peered":"2024-01-17T22:59:07.475134+0000","last_clean":"2024-01-17T22:59:07.475134+0000","last_became_active":"2024-01-17T22:58:49.366055+0000","last_became_peered":"2024-01-17T22:58:49.366055+0000","last_unstale":"2024-01-17T22:59:07.475134+0000","last_undegraded":"2024-01-17T22:59:07.475134+0000","last_fullsized":"2024-01-17T22:59:07.475134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:44:30.888903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.577705+0000","last_change":"2024-01-17T22:58:48.378008+0000","last_active":"2024-01-17T22:59:25.577705+0000","last_peered":"2024-01-17T22:59:25.577705+0000","last_clean":"2024-01-17T22:59:25.577705+0000","last_became_active":"2024-01-17T22:58:48.377732+0000","last_became_peered":"2024-01-17T22:58:48.377732+0000","last_unstale":"2024-01-17T22:59:25.577705+0000","last_undegraded":"2024-01-17T22:59:25.577705+0000","last_fullsized":"2024-01-17T22:59:25.577705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:05.032134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:09.245915+0000","last_change":"2024-01-17T22:59:09.245915+0000","last_active":"2024-01-17T22:59:09.245915+0000","last_peered":"2024-01-17T22:59:09.245915+0000","last_clean":"2024-01-17T22:59:09.245915+0000","last_became_active":"2024-01-17T22:59:09.244621+0000","last_became_peered":"2024-01-17T22:59:09.244621+0000","last_unstale":"2024-01-17T22:59:09.245915+0000","last_undegraded":"2024-01-17T22:59:09.245915+0000","last_fullsized":"2024-01-17T22:59:09.245915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:01:38.677481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,5],"acting":[6,4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467973+0000","last_change":"2024-01-17T22:58:49.368620+0000","last_active":"2024-01-17T22:59:07.467973+0000","last_peered":"2024-01-17T22:59:07.467973+0000","last_clean":"2024-01-17T22:59:07.467973+0000","last_became_active":"2024-01-17T22:58:49.367258+0000","last_became_peered":"2024-01-17T22:58:49.367258+0000","last_unstale":"2024-01-17T22:59:07.467973+0000","last_undegraded":"2024-01-17T22:59:07.467973+0000","last_fullsized":"2024-01-17T22:59:07.467973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:25.515983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'6","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.217053+0000","last_change":"2024-01-17T22:58:48.371378+0000","last_active":"2024-01-17T22:59:32.217053+0000","last_peered":"2024-01-17T22:59:32.217053+0000","last_clean":"2024-01-17T22:59:32.217053+0000","last_became_active":"2024-01-17T22:58:48.370691+0000","last_became_peered":"2024-01-17T22:58:48.370691+0000","last_unstale":"2024-01-17T22:59:32.217053+0000","last_undegraded":"2024-01-17T22:59:32.217053+0000","last_fullsized":"2024-01-17T22:59:32.217053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:01:21.629083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475936+0000","last_change":"2024-01-17T22:58:55.846853+0000","last_active":"2024-01-17T22:59:07.475936+0000","last_peered":"2024-01-17T22:59:07.475936+0000","last_clean":"2024-01-17T22:59:07.475936+0000","last_became_active":"2024-01-17T22:58:55.846382+0000","last_became_peered":"2024-01-17T22:58:55.846382+0000","last_unstale":"2024-01-17T22:59:07.475936+0000","last_undegraded":"2024-01-17T22:59:07.475936+0000","last_fullsized":"2024-01-17T22:59:07.475936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:00:22.788812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472128+0000","last_change":"2024-01-17T22:58:49.367642+0000","last_active":"2024-01-17T22:59:07.472128+0000","last_peered":"2024-01-17T22:59:07.472128+0000","last_clean":"2024-01-17T22:59:07.472128+0000","last_became_active":"2024-01-17T22:58:49.367370+0000","last_became_peered":"2024-01-17T22:58:49.367370+0000","last_unstale":"2024-01-17T22:59:07.472128+0000","last_undegraded":"2024-01-17T22:59:07.472128+0000","last_fullsized":"2024-01-17T22:59:07.472128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:24:43.594840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'12","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.581180+0000","last_change":"2024-01-17T22:58:48.346833+0000","last_active":"2024-01-17T22:59:25.581180+0000","last_peered":"2024-01-17T22:59:25.581180+0000","last_clean":"2024-01-17T22:59:25.581180+0000","last_became_active":"2024-01-17T22:58:48.346574+0000","last_became_peered":"2024-01-17T22:58:48.346574+0000","last_unstale":"2024-01-17T22:59:25.581180+0000","last_undegraded":"2024-01-17T22:59:25.581180+0000","last_fullsized":"2024-01-17T22:59:25.581180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:55:23.055396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468467+0000","last_change":"2024-01-17T22:58:55.832183+0000","last_active":"2024-01-17T22:59:07.468467+0000","last_peered":"2024-01-17T22:59:07.468467+0000","last_clean":"2024-01-17T22:59:07.468467+0000","last_became_active":"2024-01-17T22:58:55.831090+0000","last_became_peered":"2024-01-17T22:58:55.831090+0000","last_unstale":"2024-01-17T22:59:07.468467+0000","last_undegraded":"2024-01-17T22:59:07.468467+0000","last_fullsized":"2024-01-17T22:59:07.468467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:15.077032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475364+0000","last_change":"2024-01-17T22:58:49.366048+0000","last_active":"2024-01-17T22:59:07.475364+0000","last_peered":"2024-01-17T22:59:07.475364+0000","last_clean":"2024-01-17T22:59:07.475364+0000","last_became_active":"2024-01-17T22:58:49.365846+0000","last_became_peered":"2024-01-17T22:58:49.365846+0000","last_unstale":"2024-01-17T22:59:07.475364+0000","last_undegraded":"2024-01-17T22:59:07.475364+0000","last_fullsized":"2024-01-17T22:59:07.475364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:19:02.000223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.639338+0000","last_change":"2024-01-17T22:58:48.376099+0000","last_active":"2024-01-17T22:59:08.639338+0000","last_peered":"2024-01-17T22:59:08.639338+0000","last_clean":"2024-01-17T22:59:08.639338+0000","last_became_active":"2024-01-17T22:58:48.375504+0000","last_became_peered":"2024-01-17T22:58:48.375504+0000","last_unstale":"2024-01-17T22:59:08.639338+0000","last_undegraded":"2024-01-17T22:59:08.639338+0000","last_fullsized":"2024-01-17T22:59:08.639338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476012+0000","last_change":"2024-01-17T22:58:55.906751+0000","last_active":"2024-01-17T22:59:07.476012+0000","last_peered":"2024-01-17T22:59:07.476012+0000","last_clean":"2024-01-17T22:59:07.476012+0000","last_became_active":"2024-01-17T22:58:55.906429+0000","last_became_peered":"2024-01-17T22:58:55.906429+0000","last_unstale":"2024-01-17T22:59:07.476012+0000","last_undegraded":"2024-01-17T22:59:07.476012+0000","last_fullsized":"2024-01-17T22:59:07.476012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:37:20.317014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477998+0000","last_change":"2024-01-17T22:58:49.361059+0000","last_active":"2024-01-17T22:59:07.477998+0000","last_peered":"2024-01-17T22:59:07.477998+0000","last_clean":"2024-01-17T22:59:07.477998+0000","last_became_active":"2024-01-17T22:58:49.360282+0000","last_became_peered":"2024-01-17T22:58:49.360282+0000","last_unstale":"2024-01-17T22:59:07.477998+0000","last_undegraded":"2024-01-17T22:59:07.477998+0000","last_fullsized":"2024-01-17T22:59:07.477998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:10:15.673364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.653165+0000","last_change":"2024-01-17T22:58:48.349585+0000","last_active":"2024-01-17T22:59:25.653165+0000","last_peered":"2024-01-17T22:59:25.653165+0000","last_clean":"2024-01-17T22:59:25.653165+0000","last_became_active":"2024-01-17T22:58:48.349262+0000","last_became_peered":"2024-01-17T22:58:48.349262+0000","last_unstale":"2024-01-17T22:59:25.653165+0000","last_undegraded":"2024-01-17T22:59:25.653165+0000","last_fullsized":"2024-01-17T22:59:25.653165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:32:48.765965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.461673+0000","last_change":"2024-01-17T22:58:55.899604+0000","last_active":"2024-01-17T22:59:07.461673+0000","last_peered":"2024-01-17T22:59:07.461673+0000","last_clean":"2024-01-17T22:59:07.461673+0000","last_became_active":"2024-01-17T22:58:55.899176+0000","last_became_peered":"2024-01-17T22:58:55.899176+0000","last_unstale":"2024-01-17T22:59:07.461673+0000","last_undegraded":"2024-01-17T22:59:07.461673+0000","last_fullsized":"2024-01-17T22:59:07.461673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:47.829295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476942+0000","last_change":"2024-01-17T22:58:49.364258+0000","last_active":"2024-01-17T22:59:07.476942+0000","last_peered":"2024-01-17T22:59:07.476942+0000","last_clean":"2024-01-17T22:59:07.476942+0000","last_became_active":"2024-01-17T22:58:49.363979+0000","last_became_peered":"2024-01-17T22:58:49.363979+0000","last_unstale":"2024-01-17T22:59:07.476942+0000","last_undegraded":"2024-01-17T22:59:07.476942+0000","last_fullsized":"2024-01-17T22:59:07.476942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:15:17.927996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.619819+0000","last_change":"2024-01-17T22:58:48.321573+0000","last_active":"2024-01-17T22:59:25.619819+0000","last_peered":"2024-01-17T22:59:25.619819+0000","last_clean":"2024-01-17T22:59:25.619819+0000","last_became_active":"2024-01-17T22:58:48.321379+0000","last_became_peered":"2024-01-17T22:58:48.321379+0000","last_unstale":"2024-01-17T22:59:25.619819+0000","last_undegraded":"2024-01-17T22:59:25.619819+0000","last_fullsized":"2024-01-17T22:59:25.619819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:55:23.055396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467702+0000","last_change":"2024-01-17T22:58:55.873529+0000","last_active":"2024-01-17T22:59:07.467702+0000","last_peered":"2024-01-17T22:59:07.467702+0000","last_clean":"2024-01-17T22:59:07.467702+0000","last_became_active":"2024-01-17T22:58:55.872885+0000","last_became_peered":"2024-01-17T22:58:55.872885+0000","last_unstale":"2024-01-17T22:59:07.467702+0000","last_undegraded":"2024-01-17T22:59:07.467702+0000","last_fullsized":"2024-01-17T22:59:07.467702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:50:01.974857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469204+0000","last_change":"2024-01-17T22:58:55.903620+0000","last_active":"2024-01-17T22:59:07.469204+0000","last_peered":"2024-01-17T22:59:07.469204+0000","last_clean":"2024-01-17T22:59:07.469204+0000","last_became_active":"2024-01-17T22:58:55.902860+0000","last_became_peered":"2024-01-17T22:58:55.902860+0000","last_unstale":"2024-01-17T22:59:07.469204+0000","last_undegraded":"2024-01-17T22:59:07.469204+0000","last_fullsized":"2024-01-17T22:59:07.469204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:33:56.437178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467826+0000","last_change":"2024-01-17T22:58:49.515108+0000","last_active":"2024-01-17T22:59:07.467826+0000","last_peered":"2024-01-17T22:59:07.467826+0000","last_clean":"2024-01-17T22:59:07.467826+0000","last_became_active":"2024-01-17T22:58:49.514297+0000","last_became_peered":"2024-01-17T22:58:49.514297+0000","last_unstale":"2024-01-17T22:59:07.467826+0000","last_undegraded":"2024-01-17T22:59:07.467826+0000","last_fullsized":"2024-01-17T22:59:07.467826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:15.814647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.669794+0000","last_change":"2024-01-17T22:58:48.331952+0000","last_active":"2024-01-17T22:59:08.669794+0000","last_peered":"2024-01-17T22:59:08.669794+0000","last_clean":"2024-01-17T22:59:08.669794+0000","last_became_active":"2024-01-17T22:58:48.331645+0000","last_became_peered":"2024-01-17T22:58:48.331645+0000","last_unstale":"2024-01-17T22:59:08.669794+0000","last_undegraded":"2024-01-17T22:59:08.669794+0000","last_fullsized":"2024-01-17T22:59:08.669794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:24.260824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475509+0000","last_change":"2024-01-17T22:58:55.906062+0000","last_active":"2024-01-17T22:59:07.475509+0000","last_peered":"2024-01-17T22:59:07.475509+0000","last_clean":"2024-01-17T22:59:07.475509+0000","last_became_active":"2024-01-17T22:58:55.905743+0000","last_became_peered":"2024-01-17T22:58:55.905743+0000","last_unstale":"2024-01-17T22:59:07.475509+0000","last_undegraded":"2024-01-17T22:59:07.475509+0000","last_fullsized":"2024-01-17T22:59:07.475509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:19:20.308367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475626+0000","last_change":"2024-01-17T22:58:49.369540+0000","last_active":"2024-01-17T22:59:07.475626+0000","last_peered":"2024-01-17T22:59:07.475626+0000","last_clean":"2024-01-17T22:59:07.475626+0000","last_became_active":"2024-01-17T22:58:49.366692+0000","last_became_peered":"2024-01-17T22:58:49.366692+0000","last_unstale":"2024-01-17T22:59:07.475626+0000","last_undegraded":"2024-01-17T22:59:07.475626+0000","last_fullsized":"2024-01-17T22:59:07.475626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:39:54.814019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.322984+0000","last_change":"2024-01-17T22:58:48.345003+0000","last_active":"2024-01-17T22:59:32.322984+0000","last_peered":"2024-01-17T22:59:32.322984+0000","last_clean":"2024-01-17T22:59:32.322984+0000","last_became_active":"2024-01-17T22:58:48.344271+0000","last_became_peered":"2024-01-17T22:58:48.344271+0000","last_unstale":"2024-01-17T22:59:32.322984+0000","last_undegraded":"2024-01-17T22:59:32.322984+0000","last_fullsized":"2024-01-17T22:59:32.322984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:51:00.037407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.274520+0000","last_change":"2024-01-17T22:58:48.342292+0000","last_active":"2024-01-17T22:59:32.274520+0000","last_peered":"2024-01-17T22:59:32.274520+0000","last_clean":"2024-01-17T22:59:32.274520+0000","last_became_active":"2024-01-17T22:58:48.339364+0000","last_became_peered":"2024-01-17T22:58:48.339364+0000","last_unstale":"2024-01-17T22:59:32.274520+0000","last_undegraded":"2024-01-17T22:59:32.274520+0000","last_fullsized":"2024-01-17T22:59:32.274520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:51.848489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468893+0000","last_change":"2024-01-17T22:58:49.414836+0000","last_active":"2024-01-17T22:59:07.468893+0000","last_peered":"2024-01-17T22:59:07.468893+0000","last_clean":"2024-01-17T22:59:07.468893+0000","last_became_active":"2024-01-17T22:58:49.414163+0000","last_became_peered":"2024-01-17T22:58:49.414163+0000","last_unstale":"2024-01-17T22:59:07.468893+0000","last_undegraded":"2024-01-17T22:59:07.468893+0000","last_fullsized":"2024-01-17T22:59:07.468893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:24.988174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.473657+0000","last_change":"2024-01-17T22:58:55.880197+0000","last_active":"2024-01-17T22:59:07.473657+0000","last_peered":"2024-01-17T22:59:07.473657+0000","last_clean":"2024-01-17T22:59:07.473657+0000","last_became_active":"2024-01-17T22:58:55.879263+0000","last_became_peered":"2024-01-17T22:58:55.879263+0000","last_unstale":"2024-01-17T22:59:07.473657+0000","last_undegraded":"2024-01-17T22:59:07.473657+0000","last_fullsized":"2024-01-17T22:59:07.473657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:47:02.273099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.680886+0000","last_change":"2024-01-17T22:58:48.339419+0000","last_active":"2024-01-17T22:59:25.680886+0000","last_peered":"2024-01-17T22:59:25.680886+0000","last_clean":"2024-01-17T22:59:25.680886+0000","last_became_active":"2024-01-17T22:58:48.338809+0000","last_became_peered":"2024-01-17T22:58:48.338809+0000","last_unstale":"2024-01-17T22:59:25.680886+0000","last_undegraded":"2024-01-17T22:59:25.680886+0000","last_fullsized":"2024-01-17T22:59:25.680886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:20:07.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479082+0000","last_change":"2024-01-17T22:58:49.518469+0000","last_active":"2024-01-17T22:59:07.479082+0000","last_peered":"2024-01-17T22:59:07.479082+0000","last_clean":"2024-01-17T22:59:07.479082+0000","last_became_active":"2024-01-17T22:58:49.518211+0000","last_became_peered":"2024-01-17T22:58:49.518211+0000","last_unstale":"2024-01-17T22:59:07.479082+0000","last_undegraded":"2024-01-17T22:59:07.479082+0000","last_fullsized":"2024-01-17T22:59:07.479082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:22.954968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.462345+0000","last_change":"2024-01-17T22:58:55.913601+0000","last_active":"2024-01-17T22:59:07.462345+0000","last_peered":"2024-01-17T22:59:07.462345+0000","last_clean":"2024-01-17T22:59:07.462345+0000","last_became_active":"2024-01-17T22:58:55.912825+0000","last_became_peered":"2024-01-17T22:58:55.912825+0000","last_unstale":"2024-01-17T22:59:07.462345+0000","last_undegraded":"2024-01-17T22:59:07.462345+0000","last_fullsized":"2024-01-17T22:59:07.462345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:36.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474545+0000","last_change":"2024-01-17T22:58:49.371282+0000","last_active":"2024-01-17T22:59:07.474545+0000","last_peered":"2024-01-17T22:59:07.474545+0000","last_clean":"2024-01-17T22:59:07.474545+0000","last_became_active":"2024-01-17T22:58:49.371125+0000","last_became_peered":"2024-01-17T22:58:49.371125+0000","last_unstale":"2024-01-17T22:59:07.474545+0000","last_undegraded":"2024-01-17T22:59:07.474545+0000","last_fullsized":"2024-01-17T22:59:07.474545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.461964+0000","last_change":"2024-01-17T22:58:49.510490+0000","last_active":"2024-01-17T22:59:07.461964+0000","last_peered":"2024-01-17T22:59:07.461964+0000","last_clean":"2024-01-17T22:59:07.461964+0000","last_became_active":"2024-01-17T22:58:49.509690+0000","last_became_peered":"2024-01-17T22:58:49.509690+0000","last_unstale":"2024-01-17T22:59:07.461964+0000","last_undegraded":"2024-01-17T22:59:07.461964+0000","last_fullsized":"2024-01-17T22:59:07.461964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474689+0000","last_change":"2024-01-17T22:58:49.371326+0000","last_active":"2024-01-17T22:59:07.474689+0000","last_peered":"2024-01-17T22:59:07.474689+0000","last_clean":"2024-01-17T22:59:07.474689+0000","last_became_active":"2024-01-17T22:58:49.370511+0000","last_became_peered":"2024-01-17T22:58:49.370511+0000","last_unstale":"2024-01-17T22:59:07.474689+0000","last_undegraded":"2024-01-17T22:59:07.474689+0000","last_fullsized":"2024-01-17T22:59:07.474689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:46:55.959786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476531+0000","last_change":"2024-01-17T22:58:49.385500+0000","last_active":"2024-01-17T22:59:07.476531+0000","last_peered":"2024-01-17T22:59:07.476531+0000","last_clean":"2024-01-17T22:59:07.476531+0000","last_became_active":"2024-01-17T22:58:49.384397+0000","last_became_peered":"2024-01-17T22:58:49.384397+0000","last_unstale":"2024-01-17T22:59:07.476531+0000","last_undegraded":"2024-01-17T22:59:07.476531+0000","last_fullsized":"2024-01-17T22:59:07.476531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:18.563360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.470616+0000","last_change":"2024-01-17T22:58:49.369750+0000","last_active":"2024-01-17T22:59:07.470616+0000","last_peered":"2024-01-17T22:59:07.470616+0000","last_clean":"2024-01-17T22:59:07.470616+0000","last_became_active":"2024-01-17T22:58:49.368591+0000","last_became_peered":"2024-01-17T22:58:49.368591+0000","last_unstale":"2024-01-17T22:59:07.470616+0000","last_undegraded":"2024-01-17T22:59:07.470616+0000","last_fullsized":"2024-01-17T22:59:07.470616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:59.773063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469191+0000","last_change":"2024-01-17T22:58:49.380275+0000","last_active":"2024-01-17T22:59:07.469191+0000","last_peered":"2024-01-17T22:59:07.469191+0000","last_clean":"2024-01-17T22:59:07.469191+0000","last_became_active":"2024-01-17T22:58:49.379560+0000","last_became_peered":"2024-01-17T22:58:49.379560+0000","last_unstale":"2024-01-17T22:59:07.469191+0000","last_undegraded":"2024-01-17T22:59:07.469191+0000","last_fullsized":"2024-01-17T22:59:07.469191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:41.515981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476875+0000","last_change":"2024-01-17T22:58:49.368509+0000","last_active":"2024-01-17T22:59:07.476875+0000","last_peered":"2024-01-17T22:59:07.476875+0000","last_clean":"2024-01-17T22:59:07.476875+0000","last_became_active":"2024-01-17T22:58:49.367330+0000","last_became_peered":"2024-01-17T22:58:49.367330+0000","last_unstale":"2024-01-17T22:59:07.476875+0000","last_undegraded":"2024-01-17T22:59:07.476875+0000","last_fullsized":"2024-01-17T22:59:07.476875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476516+0000","last_change":"2024-01-17T22:58:49.514419+0000","last_active":"2024-01-17T22:59:07.476516+0000","last_peered":"2024-01-17T22:59:07.476516+0000","last_clean":"2024-01-17T22:59:07.476516+0000","last_became_active":"2024-01-17T22:58:49.513924+0000","last_became_peered":"2024-01-17T22:58:49.513924+0000","last_unstale":"2024-01-17T22:59:07.476516+0000","last_undegraded":"2024-01-17T22:59:07.476516+0000","last_fullsized":"2024-01-17T22:59:07.476516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:24:43.594840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474620+0000","last_change":"2024-01-17T22:58:49.371064+0000","last_active":"2024-01-17T22:59:07.474620+0000","last_peered":"2024-01-17T22:59:07.474620+0000","last_clean":"2024-01-17T22:59:07.474620+0000","last_became_active":"2024-01-17T22:58:49.370808+0000","last_became_peered":"2024-01-17T22:58:49.370808+0000","last_unstale":"2024-01-17T22:59:07.474620+0000","last_undegraded":"2024-01-17T22:59:07.474620+0000","last_fullsized":"2024-01-17T22:59:07.474620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:39.502451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475665+0000","last_change":"2024-01-17T22:58:49.350539+0000","last_active":"2024-01-17T22:59:07.475665+0000","last_peered":"2024-01-17T22:59:07.475665+0000","last_clean":"2024-01-17T22:59:07.475665+0000","last_became_active":"2024-01-17T22:58:49.350057+0000","last_became_peered":"2024-01-17T22:58:49.350057+0000","last_unstale":"2024-01-17T22:59:07.475665+0000","last_undegraded":"2024-01-17T22:59:07.475665+0000","last_fullsized":"2024-01-17T22:59:07.475665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:43.516572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.478985+0000","last_change":"2024-01-17T22:58:49.517955+0000","last_active":"2024-01-17T22:59:07.478985+0000","last_peered":"2024-01-17T22:59:07.478985+0000","last_clean":"2024-01-17T22:59:07.478985+0000","last_became_active":"2024-01-17T22:58:49.517631+0000","last_became_peered":"2024-01-17T22:58:49.517631+0000","last_unstale":"2024-01-17T22:59:07.478985+0000","last_undegraded":"2024-01-17T22:59:07.478985+0000","last_fullsized":"2024-01-17T22:59:07.478985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:41:25.372897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468791+0000","last_change":"2024-01-17T22:58:49.412901+0000","last_active":"2024-01-17T22:59:07.468791+0000","last_peered":"2024-01-17T22:59:07.468791+0000","last_clean":"2024-01-17T22:59:07.468791+0000","last_became_active":"2024-01-17T22:58:49.411772+0000","last_became_peered":"2024-01-17T22:58:49.411772+0000","last_unstale":"2024-01-17T22:59:07.468791+0000","last_undegraded":"2024-01-17T22:59:07.468791+0000","last_fullsized":"2024-01-17T22:59:07.468791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:30.366002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.752125+0000","last_change":"2024-01-17T22:59:08.750879+0000","last_active":"2024-01-17T22:59:08.752125+0000","last_peered":"2024-01-17T22:59:08.752125+0000","last_clean":"2024-01-17T22:59:08.752125+0000","last_became_active":"2024-01-17T22:59:08.750082+0000","last_became_peered":"2024-01-17T22:59:08.750082+0000","last_unstale":"2024-01-17T22:59:08.752125+0000","last_undegraded":"2024-01-17T22:59:08.752125+0000","last_fullsized":"2024-01-17T22:59:08.752125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:49:12.522334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476266+0000","last_change":"2024-01-17T22:58:49.415138+0000","last_active":"2024-01-17T22:59:07.476266+0000","last_peered":"2024-01-17T22:59:07.476266+0000","last_clean":"2024-01-17T22:59:07.476266+0000","last_became_active":"2024-01-17T22:58:49.414598+0000","last_became_peered":"2024-01-17T22:58:49.414598+0000","last_unstale":"2024-01-17T22:59:07.476266+0000","last_undegraded":"2024-01-17T22:59:07.476266+0000","last_fullsized":"2024-01-17T22:59:07.476266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:40.477976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.462811+0000","last_change":"2024-01-17T22:58:49.388702+0000","last_active":"2024-01-17T22:59:07.462811+0000","last_peered":"2024-01-17T22:59:07.462811+0000","last_clean":"2024-01-17T22:59:07.462811+0000","last_became_active":"2024-01-17T22:58:49.388096+0000","last_became_peered":"2024-01-17T22:58:49.388096+0000","last_unstale":"2024-01-17T22:59:07.462811+0000","last_undegraded":"2024-01-17T22:59:07.462811+0000","last_fullsized":"2024-01-17T22:59:07.462811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475653+0000","last_change":"2024-01-17T22:58:49.370433+0000","last_active":"2024-01-17T22:59:07.475653+0000","last_peered":"2024-01-17T22:59:07.475653+0000","last_clean":"2024-01-17T22:59:07.475653+0000","last_became_active":"2024-01-17T22:58:49.369959+0000","last_became_peered":"2024-01-17T22:58:49.369959+0000","last_unstale":"2024-01-17T22:59:07.475653+0000","last_undegraded":"2024-01-17T22:59:07.475653+0000","last_fullsized":"2024-01-17T22:59:07.475653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:41:09.206436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474554+0000","last_change":"2024-01-17T22:58:49.366356+0000","last_active":"2024-01-17T22:59:07.474554+0000","last_peered":"2024-01-17T22:59:07.474554+0000","last_clean":"2024-01-17T22:59:07.474554+0000","last_became_active":"2024-01-17T22:58:49.366122+0000","last_became_peered":"2024-01-17T22:58:49.366122+0000","last_unstale":"2024-01-17T22:59:07.474554+0000","last_undegraded":"2024-01-17T22:59:07.474554+0000","last_fullsized":"2024-01-17T22:59:07.474554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:33:50.123865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475472+0000","last_change":"2024-01-17T22:58:49.349380+0000","last_active":"2024-01-17T22:59:07.475472+0000","last_peered":"2024-01-17T22:59:07.475472+0000","last_clean":"2024-01-17T22:59:07.475472+0000","last_became_active":"2024-01-17T22:58:49.348630+0000","last_became_peered":"2024-01-17T22:58:49.348630+0000","last_unstale":"2024-01-17T22:59:07.475472+0000","last_undegraded":"2024-01-17T22:59:07.475472+0000","last_fullsized":"2024-01-17T22:59:07.475472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:59:07.405202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467824+0000","last_change":"2024-01-17T22:58:49.383079+0000","last_active":"2024-01-17T22:59:07.467824+0000","last_peered":"2024-01-17T22:59:07.467824+0000","last_clean":"2024-01-17T22:59:07.467824+0000","last_became_active":"2024-01-17T22:58:49.382454+0000","last_became_peered":"2024-01-17T22:58:49.382454+0000","last_unstale":"2024-01-17T22:59:07.467824+0000","last_undegraded":"2024-01-17T22:59:07.467824+0000","last_fullsized":"2024-01-17T22:59:07.467824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:48.465209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468799+0000","last_change":"2024-01-17T22:58:49.366078+0000","last_active":"2024-01-17T22:59:07.468799+0000","last_peered":"2024-01-17T22:59:07.468799+0000","last_clean":"2024-01-17T22:59:07.468799+0000","last_became_active":"2024-01-17T22:58:49.364509+0000","last_became_peered":"2024-01-17T22:58:49.364509+0000","last_unstale":"2024-01-17T22:59:07.468799+0000","last_undegraded":"2024-01-17T22:59:07.468799+0000","last_fullsized":"2024-01-17T22:59:07.468799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:44.036981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471836+0000","last_change":"2024-01-17T22:58:49.518204+0000","last_active":"2024-01-17T22:59:07.471836+0000","last_peered":"2024-01-17T22:59:07.471836+0000","last_clean":"2024-01-17T22:59:07.471836+0000","last_became_active":"2024-01-17T22:58:49.517927+0000","last_became_peered":"2024-01-17T22:58:49.517927+0000","last_unstale":"2024-01-17T22:59:07.471836+0000","last_undegraded":"2024-01-17T22:59:07.471836+0000","last_fullsized":"2024-01-17T22:59:07.471836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:04:38.588573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472056+0000","last_change":"2024-01-17T22:58:49.364080+0000","last_active":"2024-01-17T22:59:07.472056+0000","last_peered":"2024-01-17T22:59:07.472056+0000","last_clean":"2024-01-17T22:59:07.472056+0000","last_became_active":"2024-01-17T22:58:49.363804+0000","last_became_peered":"2024-01-17T22:58:49.363804+0000","last_unstale":"2024-01-17T22:59:07.472056+0000","last_undegraded":"2024-01-17T22:59:07.472056+0000","last_fullsized":"2024-01-17T22:59:07.472056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:59:07.405202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472789+0000","last_change":"2024-01-17T22:58:49.352782+0000","last_active":"2024-01-17T22:59:07.472789+0000","last_peered":"2024-01-17T22:59:07.472789+0000","last_clean":"2024-01-17T22:59:07.472789+0000","last_became_active":"2024-01-17T22:58:49.352513+0000","last_became_peered":"2024-01-17T22:58:49.352513+0000","last_unstale":"2024-01-17T22:59:07.472789+0000","last_undegraded":"2024-01-17T22:59:07.472789+0000","last_fullsized":"2024-01-17T22:59:07.472789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:39:54.814019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479431+0000","last_change":"2024-01-17T22:58:49.519775+0000","last_active":"2024-01-17T22:59:07.479431+0000","last_peered":"2024-01-17T22:59:07.479431+0000","last_clean":"2024-01-17T22:59:07.479431+0000","last_became_active":"2024-01-17T22:58:49.518646+0000","last_became_peered":"2024-01-17T22:58:49.518646+0000","last_unstale":"2024-01-17T22:59:07.479431+0000","last_undegraded":"2024-01-17T22:59:07.479431+0000","last_fullsized":"2024-01-17T22:59:07.479431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475321+0000","last_change":"2024-01-17T22:58:49.349737+0000","last_active":"2024-01-17T22:59:07.475321+0000","last_peered":"2024-01-17T22:59:07.475321+0000","last_clean":"2024-01-17T22:59:07.475321+0000","last_became_active":"2024-01-17T22:58:49.349021+0000","last_became_peered":"2024-01-17T22:58:49.349021+0000","last_unstale":"2024-01-17T22:59:07.475321+0000","last_undegraded":"2024-01-17T22:59:07.475321+0000","last_fullsized":"2024-01-17T22:59:07.475321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:42:24.949957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471093+0000","last_change":"2024-01-17T22:58:49.415068+0000","last_active":"2024-01-17T22:59:07.471093+0000","last_peered":"2024-01-17T22:59:07.471093+0000","last_clean":"2024-01-17T22:59:07.471093+0000","last_became_active":"2024-01-17T22:58:49.414856+0000","last_became_peered":"2024-01-17T22:58:49.414856+0000","last_unstale":"2024-01-17T22:59:07.471093+0000","last_undegraded":"2024-01-17T22:59:07.471093+0000","last_fullsized":"2024-01-17T22:59:07.471093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:02:07.535209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475704+0000","last_change":"2024-01-17T22:58:49.414783+0000","last_active":"2024-01-17T22:59:07.475704+0000","last_peered":"2024-01-17T22:59:07.475704+0000","last_clean":"2024-01-17T22:59:07.475704+0000","last_became_active":"2024-01-17T22:58:49.414446+0000","last_became_peered":"2024-01-17T22:58:49.414446+0000","last_unstale":"2024-01-17T22:59:07.475704+0000","last_undegraded":"2024-01-17T22:59:07.475704+0000","last_fullsized":"2024-01-17T22:59:07.475704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471424+0000","last_change":"2024-01-17T22:58:49.357264+0000","last_active":"2024-01-17T22:59:07.471424+0000","last_peered":"2024-01-17T22:59:07.471424+0000","last_clean":"2024-01-17T22:59:07.471424+0000","last_became_active":"2024-01-17T22:58:49.357085+0000","last_became_peered":"2024-01-17T22:58:49.357085+0000","last_unstale":"2024-01-17T22:59:07.471424+0000","last_undegraded":"2024-01-17T22:59:07.471424+0000","last_fullsized":"2024-01-17T22:59:07.471424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:13:09.466879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476340+0000","last_change":"2024-01-17T22:58:49.414726+0000","last_active":"2024-01-17T22:59:07.476340+0000","last_peered":"2024-01-17T22:59:07.476340+0000","last_clean":"2024-01-17T22:59:07.476340+0000","last_became_active":"2024-01-17T22:58:49.414490+0000","last_became_peered":"2024-01-17T22:58:49.414490+0000","last_unstale":"2024-01-17T22:59:07.476340+0000","last_undegraded":"2024-01-17T22:59:07.476340+0000","last_fullsized":"2024-01-17T22:59:07.476340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:48.465209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476613+0000","last_change":"2024-01-17T22:58:49.413155+0000","last_active":"2024-01-17T22:59:07.476613+0000","last_peered":"2024-01-17T22:59:07.476613+0000","last_clean":"2024-01-17T22:59:07.476613+0000","last_became_active":"2024-01-17T22:58:49.412382+0000","last_became_peered":"2024-01-17T22:58:49.412382+0000","last_unstale":"2024-01-17T22:59:07.476613+0000","last_undegraded":"2024-01-17T22:59:07.476613+0000","last_fullsized":"2024-01-17T22:59:07.476613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:04:38.588573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477075+0000","last_change":"2024-01-17T22:58:49.368686+0000","last_active":"2024-01-17T22:59:07.477075+0000","last_peered":"2024-01-17T22:59:07.477075+0000","last_clean":"2024-01-17T22:59:07.477075+0000","last_became_active":"2024-01-17T22:58:49.367979+0000","last_became_peered":"2024-01-17T22:58:49.367979+0000","last_unstale":"2024-01-17T22:59:07.477075+0000","last_undegraded":"2024-01-17T22:59:07.477075+0000","last_fullsized":"2024-01-17T22:59:07.477075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:02:12.309297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472963+0000","last_change":"2024-01-17T22:58:49.364561+0000","last_active":"2024-01-17T22:59:07.472963+0000","last_peered":"2024-01-17T22:59:07.472963+0000","last_clean":"2024-01-17T22:59:07.472963+0000","last_became_active":"2024-01-17T22:58:49.363810+0000","last_became_peered":"2024-01-17T22:58:49.363810+0000","last_unstale":"2024-01-17T22:59:07.472963+0000","last_undegraded":"2024-01-17T22:59:07.472963+0000","last_fullsized":"2024-01-17T22:59:07.472963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:02:12.309297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7451,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66578,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509460,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":121842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.97899999999999998}]},{"osd":1,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.83399999999999996}]},{"osd":2,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.79200000000000004}]},{"osd":3,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":1.042}]},{"osd":4,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.097},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.95099999999999996}]},{"osd":5,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.194}]},{"osd":6,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.0189999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":122138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.56499999999999995}]},{"osd":1,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":1.079},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.51000000000000001}]},{"osd":2,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.96499999999999997}]},{"osd":4,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":1.008}]},{"osd":5,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.1160000000000001}]},{"osd":7,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.375}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":126343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.036},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.436}]},{"osd":1,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.76900000000000002}]},{"osd":2,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.91900000000000004}]},{"osd":3,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.96599999999999997}]},{"osd":5,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.47599999999999998}]},{"osd":6,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.121}]},{"osd":7,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.155}]}]},{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":122160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.316},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.46800000000000003}]},{"osd":1,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.54900000000000004}]},{"osd":2,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.505},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.60399999999999998}]},{"osd":4,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.58899999999999997}]},{"osd":5,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.88},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.51600000000000001}]},{"osd":6,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.63900000000000001}]},{"osd":7,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.74199999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":124809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":1.004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.85099999999999998}]},{"osd":1,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":1.5429999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.0649999999999999}]},{"osd":3,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.044}]},{"osd":4,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.0309999999999999}]},{"osd":5,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.351},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.1819999999999999}]},{"osd":6,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.242},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.3939999999999999}]},{"osd":7,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.212},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.415}]}]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":711462,"data_compressed":33289,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.9910000000000001,"5min":2.9910000000000001,"15min":2.9910000000000001},"last":0.79800000000000004}]},{"osd":2,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.435},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.54300000000000004}]},{"osd":3,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.495},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":3.383,"5min":3.383,"15min":3.383},"last":0.59599999999999997}]},{"osd":4,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.60899999999999999}]},{"osd":5,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.77700000000000002}]},{"osd":6,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":0.63},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.69899999999999995}]},{"osd":7,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.76600000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":122250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.443}]},{"osd":2,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2,"5min":2,"15min":2},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.36399999999999999}]},{"osd":3,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.46800000000000003}]},{"osd":4,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.82199999999999995}]},{"osd":6,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.748}]},{"osd":7,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.62}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":380928,"data_stored":712106,"data_compressed":33289,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.73499999999999999}]},{"osd":1,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.94499999999999995}]},{"osd":2,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.028}]},{"osd":3,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.81000000000000005}]},{"osd":4,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.115}]},{"osd":6,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.089},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.236}]},{"osd":7,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.304},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33289,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33289,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-17T22:59:38.576 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-17T22:59:38.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.756+0000 7ff606600640 1 Processor -- start 2024-01-17T22:59:38.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.756+0000 7ff606600640 1 -- start start 2024-01-17T22:59:38.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.756+0000 7ff606600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6001539a0 0x7ff6000ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:38.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.756+0000 7ff606600640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff6000c79c0 0x7ff600061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:38.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.756+0000 7ff606600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6000c9890 con 0x7ff600061640 2024-01-17T22:59:38.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.756+0000 7ff606600640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60006d570 con 0x7ff6000c79c0 2024-01-17T22:59:38.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.756+0000 7ff606600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff600159bf0 con 0x7ff6001539a0 2024-01-17T22:59:38.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.756+0000 7ff5ffe00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff600061640 0x7ff60015d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38600/0 (socket says 172.21.15.161:38600) 2024-01-17T22:59:38.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.756+0000 7ff5ffe00640 1 -- 172.21.15.161:0/2871902128 learned_addr learned my addr 172.21.15.161:0/2871902128 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:38.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.756+0000 7ff5ff400640 1 --2- 172.21.15.161:0/2871902128 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6001539a0 0x7ff6000ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:38.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.756+0000 7ff5fea00640 1 --2- 172.21.15.161:0/2871902128 >> v2:172.21.15.190:3300/0 conn(0x7ff6000c79c0 0x7ff600061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:38.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.760+0000 7ff5fe000640 1 -- 172.21.15.161:0/2871902128 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928628212 0 0) 0x7ff6000c9890 con 0x7ff600061640 2024-01-17T22:59:38.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.760+0000 7ff5fe000640 1 -- 172.21.15.161:0/2871902128 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5e0003530 con 0x7ff600061640 2024-01-17T22:59:38.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.764+0000 7ff5fe000640 1 -- 172.21.15.161:0/2871902128 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 96026244 0 0) 0x7ff5e0003530 con 0x7ff600061640 2024-01-17T22:59:38.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.764+0000 7ff5fe000640 1 -- 172.21.15.161:0/2871902128 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6001539a0 msgr2=0x7ff6000ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:38.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.764+0000 7ff5fe000640 1 --2- 172.21.15.161:0/2871902128 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6001539a0 0x7ff6000ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:38.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.764+0000 7ff5fe000640 1 -- 172.21.15.161:0/2871902128 >> v2:172.21.15.190:3300/0 conn(0x7ff6000c79c0 msgr2=0x7ff600061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:38.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.764+0000 7ff5fe000640 1 --2- 172.21.15.161:0/2871902128 >> v2:172.21.15.190:3300/0 conn(0x7ff6000c79c0 0x7ff600061100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:38.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.764+0000 7ff5fe000640 1 -- 172.21.15.161:0/2871902128 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff600159eb0 con 0x7ff600061640 2024-01-17T22:59:38.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.764+0000 7ff5fe000640 1 -- 172.21.15.161:0/2871902128 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7ff5f8001a00 con 0x7ff600061640 2024-01-17T22:59:38.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.764+0000 7ff5fe000640 1 -- 172.21.15.161:0/2871902128 >> v1:172.21.15.161:6789/0 conn(0x7ff600061640 legacy=0x7ff60015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:38.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.764+0000 7ff5fe000640 1 --2- 172.21.15.161:0/2871902128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5e0003980 0x7ff5e0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:38.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.764+0000 7ff5fe000640 1 --2- 172.21.15.161:0/2871902128 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e00047d0 0x7ff5e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:38.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.764+0000 7ff5fe000640 1 --2- 172.21.15.161:0/2871902128 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6001539a0 0x7ff5e0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:38.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.764+0000 7ff5fe000640 1 -- 172.21.15.161:0/2871902128 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff600159bf0 con 0x7ff5e00047d0 2024-01-17T22:59:38.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.764+0000 7ff5fe000640 1 -- 172.21.15.161:0/2871902128 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e000b990 con 0x7ff5e0003980 2024-01-17T22:59:38.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.764+0000 7ff5fe000640 1 -- 172.21.15.161:0/2871902128 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e000bad0 con 0x7ff6001539a0 2024-01-17T22:59:38.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.764+0000 7ff5fea00640 1 --2- 172.21.15.161:0/2871902128 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e00047d0 0x7ff5e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:38.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.768+0000 7ff5fea00640 1 -- 172.21.15.161:0/2871902128 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6001539a0 msgr2=0x7ff5e0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:38.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.768+0000 7ff5fea00640 1 --2- 172.21.15.161:0/2871902128 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6001539a0 0x7ff5e0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:38.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.768+0000 7ff5fea00640 1 -- 172.21.15.161:0/2871902128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5e0003980 msgr2=0x7ff5e0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:38.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.768+0000 7ff5fea00640 1 --2- 172.21.15.161:0/2871902128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5e0003980 0x7ff5e0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:38.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.768+0000 7ff5fea00640 1 -- 172.21.15.161:0/2871902128 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e0003530 con 0x7ff5e00047d0 2024-01-17T22:59:38.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.772+0000 7ff5fea00640 1 --2- 172.21.15.161:0/2871902128 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e00047d0 0x7ff5e0004c50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8009ae0 tx=0x7ff5e801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5f5cf05623b297 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:38.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.776+0000 7ff5fe000640 1 -- 172.21.15.161:0/2871902128 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80a55a0 con 0x7ff5e00047d0 2024-01-17T22:59:38.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.776+0000 7ff5fe000640 1 -- 172.21.15.161:0/2871902128 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e80a5700 con 0x7ff5e00047d0 2024-01-17T22:59:38.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.776+0000 7ff5fe000640 1 -- 172.21.15.161:0/2871902128 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80a5ab0 con 0x7ff5e00047d0 2024-01-17T22:59:38.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.776+0000 7ff606600640 1 -- 172.21.15.161:0/2871902128 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e00047d0 msgr2=0x7ff5e0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:38.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.776+0000 7ff606600640 1 --2- 172.21.15.161:0/2871902128 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e00047d0 0x7ff5e0004c50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8009ae0 tx=0x7ff5e801ca30 comp rx=0 tx=0).stop 2024-01-17T22:59:38.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.776+0000 7ff5ffe00640 1 -- 172.21.15.161:0/2871902128 reap_dead start 2024-01-17T22:59:38.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.776+0000 7ff606600640 1 -- 172.21.15.161:0/2871902128 shutdown_connections 2024-01-17T22:59:38.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.776+0000 7ff606600640 1 -- 172.21.15.161:0/2871902128 >> 172.21.15.161:0/2871902128 conn(0x7ff60006ad40 msgr2=0x7ff60006f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:38.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.776+0000 7ff606600640 1 -- 172.21.15.161:0/2871902128 shutdown_connections 2024-01-17T22:59:38.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.776+0000 7ff606600640 1 -- 172.21.15.161:0/2871902128 wait complete. 2024-01-17T22:59:38.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.780+0000 7ff606600640 1 Processor -- start 2024-01-17T22:59:38.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.780+0000 7ff606600640 1 -- start start 2024-01-17T22:59:38.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.780+0000 7ff606600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e00047d0 0x7ff6001e4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:38.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.780+0000 7ff606600640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6001e2070 0x7ff6001e3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:38.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.780+0000 7ff606600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6001e40f0 0x7ff6001f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:38.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.780+0000 7ff606600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60014f040 con 0x7ff5e00047d0 2024-01-17T22:59:38.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.780+0000 7ff606600640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60014f570 con 0x7ff6001e2070 2024-01-17T22:59:38.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.780+0000 7ff606600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6001e4740 con 0x7ff6001e40f0 2024-01-17T22:59:38.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.780+0000 7ff5ff400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e00047d0 0x7ff6001e4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:38.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.780+0000 7ff5ff400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e00047d0 0x7ff6001e4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60696/0 (socket says 172.21.15.161:60696) 2024-01-17T22:59:38.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.780+0000 7ff5ff400640 1 -- 172.21.15.161:0/871796167 learned_addr learned my addr 172.21.15.161:0/871796167 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:38.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.780+0000 7ff5ffe00640 1 --2- 172.21.15.161:0/871796167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6001e40f0 0x7ff6001f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:38.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.784+0000 7ff5fea00640 1 --2- 172.21.15.161:0/871796167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6001e2070 0x7ff6001e3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:38.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.784+0000 7ff5ff400640 1 -- 172.21.15.161:0/871796167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6001e40f0 msgr2=0x7ff6001f2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:38.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.784+0000 7ff5ff400640 1 --2- 172.21.15.161:0/871796167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6001e40f0 0x7ff6001f2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:38.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.784+0000 7ff5ff400640 1 -- 172.21.15.161:0/871796167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6001e2070 msgr2=0x7ff6001e3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:38.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.784+0000 7ff5ff400640 1 --2- 172.21.15.161:0/871796167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6001e2070 0x7ff6001e3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:38.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.784+0000 7ff5ff400640 1 -- 172.21.15.161:0/871796167 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6001efaf0 con 0x7ff5e00047d0 2024-01-17T22:59:38.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.788+0000 7ff5ff400640 1 --2- 172.21.15.161:0/871796167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e00047d0 0x7ff6001e4bb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000e7c0 tx=0x7ff5f000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:38.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.792+0000 7ff5f7400640 1 -- 172.21.15.161:0/871796167 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f000eed0 con 0x7ff5e00047d0 2024-01-17T22:59:38.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.792+0000 7ff606600640 1 -- 172.21.15.161:0/871796167 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6001efdd0 con 0x7ff5e00047d0 2024-01-17T22:59:38.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.792+0000 7ff606600640 1 -- 172.21.15.161:0/871796167 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6000aff60 con 0x7ff5e00047d0 2024-01-17T22:59:38.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.792+0000 7ff5f7400640 1 -- 172.21.15.161:0/871796167 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f00059a0 con 0x7ff5e00047d0 2024-01-17T22:59:38.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.792+0000 7ff5f7400640 1 -- 172.21.15.161:0/871796167 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0005d10 con 0x7ff5e00047d0 2024-01-17T22:59:38.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.792+0000 7ff606600640 1 -- 172.21.15.161:0/871796167 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d00052a0 con 0x7ff5e00047d0 2024-01-17T22:59:38.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.812+0000 7ff5f7400640 1 -- 172.21.15.161:0/871796167 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7ff5f000c940 con 0x7ff5e00047d0 2024-01-17T22:59:38.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.812+0000 7ff5f7400640 1 --2- 172.21.15.161:0/871796167 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7ff5d8066840 0x7ff5d8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:38.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.812+0000 7ff5fea00640 1 --2- 172.21.15.161:0/871796167 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7ff5d8066840 0x7ff5d8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:38.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.812+0000 7ff5fea00640 1 --2- 172.21.15.161:0/871796167 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7ff5d8066840 0x7ff5d8068d00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80af000 tx=0x7ff5e80046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:38.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:38.816+0000 7ff5f7400640 1 -- 172.21.15.161:0/871796167 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7ff5f0055420 con 0x7ff5e00047d0 2024-01-17T22:59:39.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.048+0000 7ff5f7400640 1 -- 172.21.15.161:0/871796167 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7ff5f0051760 con 0x7ff5e00047d0 2024-01-17T22:59:39.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.200+0000 7ff606600640 1 -- 172.21.15.161:0/871796167 --> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5d0000bd0 con 0x7ff5d8066840 2024-01-17T22:59:39.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.212+0000 7ff5f7400640 1 -- 172.21.15.161:0/871796167 <== mgr.4110 v2:172.21.15.161:6800/272458188 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368872 (secure 0 0 0) 0x7ff5d0000bd0 con 0x7ff5d8066840 2024-01-17T22:59:39.214 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:39.216 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-01-17T22:59:39.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.216+0000 7ff606600640 1 -- 172.21.15.161:0/871796167 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7ff5d8066840 msgr2=0x7ff5d8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:39.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.216+0000 7ff606600640 1 --2- 172.21.15.161:0/871796167 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7ff5d8066840 0x7ff5d8068d00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80af000 tx=0x7ff5e80046d0 comp rx=0 tx=0).stop 2024-01-17T22:59:39.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.216+0000 7ff606600640 1 -- 172.21.15.161:0/871796167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e00047d0 msgr2=0x7ff6001e4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:39.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.216+0000 7ff606600640 1 --2- 172.21.15.161:0/871796167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e00047d0 0x7ff6001e4bb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000e7c0 tx=0x7ff5f000ec80 comp rx=0 tx=0).stop 2024-01-17T22:59:39.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.216+0000 7ff606600640 1 -- 172.21.15.161:0/871796167 shutdown_connections 2024-01-17T22:59:39.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.216+0000 7ff606600640 1 --2- 172.21.15.161:0/871796167 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7ff5d8066840 0x7ff5d8068d00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:39.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.216+0000 7ff606600640 1 --2- 172.21.15.161:0/871796167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6001e2070 0x7ff6001e3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:39.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.216+0000 7ff606600640 1 --2- 172.21.15.161:0/871796167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6001e40f0 0x7ff6001f2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:39.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.216+0000 7ff606600640 1 --2- 172.21.15.161:0/871796167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e00047d0 0x7ff6001e4bb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:39.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.216+0000 7ff606600640 1 -- 172.21.15.161:0/871796167 >> 172.21.15.161:0/871796167 conn(0x7ff60006ad40 msgr2=0x7ff6000c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:39.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.216+0000 7ff606600640 1 -- 172.21.15.161:0/871796167 shutdown_connections 2024-01-17T22:59:39.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.216+0000 7ff606600640 1 -- 172.21.15.161:0/871796167 wait complete. 2024-01-17T22:59:39.235 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-01-17T22:59:38.657917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597819,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":287,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218720,"kb_used_data":2592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756000,"statfs":{"total":773094113280,"available":772870144000,"internally_reserved":0,"allocated":2654208,"data_stored":2163110,"data_compressed":66578,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2028,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003070"},"pg_stats":[{"pgid":"2.1f","version":"28'9","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.309615+0000","last_change":"2024-01-17T22:58:48.328193+0000","last_active":"2024-01-17T22:59:32.309615+0000","last_peered":"2024-01-17T22:59:32.309615+0000","last_clean":"2024-01-17T22:59:32.309615+0000","last_became_active":"2024-01-17T22:58:48.327340+0000","last_became_peered":"2024-01-17T22:58:48.327340+0000","last_unstale":"2024-01-17T22:59:32.309615+0000","last_undegraded":"2024-01-17T22:59:32.309615+0000","last_fullsized":"2024-01-17T22:59:32.309615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:56.524325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477190+0000","last_change":"2024-01-17T22:58:49.351609+0000","last_active":"2024-01-17T22:59:07.477190+0000","last_peered":"2024-01-17T22:59:07.477190+0000","last_clean":"2024-01-17T22:59:07.477190+0000","last_became_active":"2024-01-17T22:58:49.350812+0000","last_became_peered":"2024-01-17T22:58:49.350812+0000","last_unstale":"2024-01-17T22:59:07.477190+0000","last_undegraded":"2024-01-17T22:59:07.477190+0000","last_fullsized":"2024-01-17T22:59:07.477190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:02:07.535209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.461792+0000","last_change":"2024-01-17T22:58:55.903757+0000","last_active":"2024-01-17T22:59:07.461792+0000","last_peered":"2024-01-17T22:59:07.461792+0000","last_clean":"2024-01-17T22:59:07.461792+0000","last_became_active":"2024-01-17T22:58:55.903167+0000","last_became_peered":"2024-01-17T22:58:55.903167+0000","last_unstale":"2024-01-17T22:59:07.461792+0000","last_undegraded":"2024-01-17T22:59:07.461792+0000","last_fullsized":"2024-01-17T22:59:07.461792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:22.127961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:09.241367+0000","last_change":"2024-01-17T22:58:48.373068+0000","last_active":"2024-01-17T22:59:09.241367+0000","last_peered":"2024-01-17T22:59:09.241367+0000","last_clean":"2024-01-17T22:59:09.241367+0000","last_became_active":"2024-01-17T22:58:48.372582+0000","last_became_peered":"2024-01-17T22:58:48.372582+0000","last_unstale":"2024-01-17T22:59:09.241367+0000","last_undegraded":"2024-01-17T22:59:09.241367+0000","last_fullsized":"2024-01-17T22:59:09.241367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:10:59.139723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.478032+0000","last_change":"2024-01-17T22:58:49.511918+0000","last_active":"2024-01-17T22:59:07.478032+0000","last_peered":"2024-01-17T22:59:07.478032+0000","last_clean":"2024-01-17T22:59:07.478032+0000","last_became_active":"2024-01-17T22:58:49.511303+0000","last_became_peered":"2024-01-17T22:58:49.511303+0000","last_unstale":"2024-01-17T22:59:07.478032+0000","last_undegraded":"2024-01-17T22:59:07.478032+0000","last_fullsized":"2024-01-17T22:59:07.478032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:13:09.466879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474413+0000","last_change":"2024-01-17T22:58:55.878752+0000","last_active":"2024-01-17T22:59:07.474413+0000","last_peered":"2024-01-17T22:59:07.474413+0000","last_clean":"2024-01-17T22:59:07.474413+0000","last_became_active":"2024-01-17T22:58:55.878263+0000","last_became_peered":"2024-01-17T22:58:55.878263+0000","last_unstale":"2024-01-17T22:59:07.474413+0000","last_undegraded":"2024-01-17T22:59:07.474413+0000","last_fullsized":"2024-01-17T22:59:07.474413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:19:49.420559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.315007+0000","last_change":"2024-01-17T22:58:48.346724+0000","last_active":"2024-01-17T22:59:32.315007+0000","last_peered":"2024-01-17T22:59:32.315007+0000","last_clean":"2024-01-17T22:59:32.315007+0000","last_became_active":"2024-01-17T22:58:48.346411+0000","last_became_peered":"2024-01-17T22:58:48.346411+0000","last_unstale":"2024-01-17T22:59:32.315007+0000","last_undegraded":"2024-01-17T22:59:32.315007+0000","last_fullsized":"2024-01-17T22:59:32.315007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:03:04.691978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479505+0000","last_change":"2024-01-17T22:58:49.517981+0000","last_active":"2024-01-17T22:59:07.479505+0000","last_peered":"2024-01-17T22:59:07.479505+0000","last_clean":"2024-01-17T22:59:07.479505+0000","last_became_active":"2024-01-17T22:58:49.517710+0000","last_became_peered":"2024-01-17T22:58:49.517710+0000","last_unstale":"2024-01-17T22:59:07.479505+0000","last_undegraded":"2024-01-17T22:59:07.479505+0000","last_fullsized":"2024-01-17T22:59:07.479505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475930+0000","last_change":"2024-01-17T22:58:55.847347+0000","last_active":"2024-01-17T22:59:07.475930+0000","last_peered":"2024-01-17T22:59:07.475930+0000","last_clean":"2024-01-17T22:59:07.475930+0000","last_became_active":"2024-01-17T22:58:55.846773+0000","last_became_peered":"2024-01-17T22:58:55.846773+0000","last_unstale":"2024-01-17T22:59:07.475930+0000","last_undegraded":"2024-01-17T22:59:07.475930+0000","last_fullsized":"2024-01-17T22:59:07.475930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:31:43.629750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.473014+0000","last_change":"2024-01-17T22:58:48.346483+0000","last_active":"2024-01-17T22:59:07.473014+0000","last_peered":"2024-01-17T22:59:07.473014+0000","last_clean":"2024-01-17T22:59:07.473014+0000","last_became_active":"2024-01-17T22:58:48.345749+0000","last_became_peered":"2024-01-17T22:58:48.345749+0000","last_unstale":"2024-01-17T22:59:07.473014+0000","last_undegraded":"2024-01-17T22:59:07.473014+0000","last_fullsized":"2024-01-17T22:59:07.473014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:22:41.169668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476010+0000","last_change":"2024-01-17T22:58:49.371509+0000","last_active":"2024-01-17T22:59:07.476010+0000","last_peered":"2024-01-17T22:59:07.476010+0000","last_clean":"2024-01-17T22:59:07.476010+0000","last_became_active":"2024-01-17T22:58:49.370010+0000","last_became_peered":"2024-01-17T22:58:49.370010+0000","last_unstale":"2024-01-17T22:59:07.476010+0000","last_undegraded":"2024-01-17T22:59:07.476010+0000","last_fullsized":"2024-01-17T22:59:07.476010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:36:24.817716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474645+0000","last_change":"2024-01-17T22:58:55.886223+0000","last_active":"2024-01-17T22:59:07.474645+0000","last_peered":"2024-01-17T22:59:07.474645+0000","last_clean":"2024-01-17T22:59:07.474645+0000","last_became_active":"2024-01-17T22:58:55.885739+0000","last_became_peered":"2024-01-17T22:58:55.885739+0000","last_unstale":"2024-01-17T22:59:07.474645+0000","last_undegraded":"2024-01-17T22:59:07.474645+0000","last_fullsized":"2024-01-17T22:59:07.474645+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:49:18.835647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474772+0000","last_change":"2024-01-17T22:58:49.514565+0000","last_active":"2024-01-17T22:59:07.474772+0000","last_peered":"2024-01-17T22:59:07.474772+0000","last_clean":"2024-01-17T22:59:07.474772+0000","last_became_active":"2024-01-17T22:58:49.514310+0000","last_became_peered":"2024-01-17T22:58:49.514310+0000","last_unstale":"2024-01-17T22:59:07.474772+0000","last_undegraded":"2024-01-17T22:59:07.474772+0000","last_fullsized":"2024-01-17T22:59:07.474772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:01:32.364167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.577114+0000","last_change":"2024-01-17T22:58:48.341961+0000","last_active":"2024-01-17T22:59:25.577114+0000","last_peered":"2024-01-17T22:59:25.577114+0000","last_clean":"2024-01-17T22:59:25.577114+0000","last_became_active":"2024-01-17T22:58:48.341498+0000","last_became_peered":"2024-01-17T22:58:48.341498+0000","last_unstale":"2024-01-17T22:59:25.577114+0000","last_undegraded":"2024-01-17T22:59:25.577114+0000","last_fullsized":"2024-01-17T22:59:25.577114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:56.524325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475855+0000","last_change":"2024-01-17T22:58:55.915918+0000","last_active":"2024-01-17T22:59:07.475855+0000","last_peered":"2024-01-17T22:59:07.475855+0000","last_clean":"2024-01-17T22:59:07.475855+0000","last_became_active":"2024-01-17T22:58:55.915556+0000","last_became_peered":"2024-01-17T22:58:55.915556+0000","last_unstale":"2024-01-17T22:59:07.475855+0000","last_undegraded":"2024-01-17T22:59:07.475855+0000","last_fullsized":"2024-01-17T22:59:07.475855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:22:21.478703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.462199+0000","last_change":"2024-01-17T22:58:49.388237+0000","last_active":"2024-01-17T22:59:07.462199+0000","last_peered":"2024-01-17T22:59:07.462199+0000","last_clean":"2024-01-17T22:59:07.462199+0000","last_became_active":"2024-01-17T22:58:49.387500+0000","last_became_peered":"2024-01-17T22:58:49.387500+0000","last_unstale":"2024-01-17T22:59:07.462199+0000","last_undegraded":"2024-01-17T22:59:07.462199+0000","last_fullsized":"2024-01-17T22:59:07.462199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.647283+0000","last_change":"2024-01-17T22:58:48.346215+0000","last_active":"2024-01-17T22:59:08.647283+0000","last_peered":"2024-01-17T22:59:08.647283+0000","last_clean":"2024-01-17T22:59:08.647283+0000","last_became_active":"2024-01-17T22:58:48.345584+0000","last_became_peered":"2024-01-17T22:58:48.345584+0000","last_unstale":"2024-01-17T22:59:08.647283+0000","last_undegraded":"2024-01-17T22:59:08.647283+0000","last_fullsized":"2024-01-17T22:59:08.647283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471736+0000","last_change":"2024-01-17T22:58:55.904518+0000","last_active":"2024-01-17T22:59:07.471736+0000","last_peered":"2024-01-17T22:59:07.471736+0000","last_clean":"2024-01-17T22:59:07.471736+0000","last_became_active":"2024-01-17T22:58:55.904182+0000","last_became_peered":"2024-01-17T22:58:55.904182+0000","last_unstale":"2024-01-17T22:59:07.471736+0000","last_undegraded":"2024-01-17T22:59:07.471736+0000","last_fullsized":"2024-01-17T22:59:07.471736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:24:43.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468071+0000","last_change":"2024-01-17T22:58:49.417907+0000","last_active":"2024-01-17T22:59:07.468071+0000","last_peered":"2024-01-17T22:59:07.468071+0000","last_clean":"2024-01-17T22:59:07.468071+0000","last_became_active":"2024-01-17T22:58:49.417440+0000","last_became_peered":"2024-01-17T22:58:49.417440+0000","last_unstale":"2024-01-17T22:59:07.468071+0000","last_undegraded":"2024-01-17T22:59:07.468071+0000","last_fullsized":"2024-01-17T22:59:07.468071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:59.773063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.575301+0000","last_change":"2024-01-17T22:58:48.332092+0000","last_active":"2024-01-17T22:59:25.575301+0000","last_peered":"2024-01-17T22:59:25.575301+0000","last_clean":"2024-01-17T22:59:25.575301+0000","last_became_active":"2024-01-17T22:58:48.331435+0000","last_became_peered":"2024-01-17T22:58:48.331435+0000","last_unstale":"2024-01-17T22:59:25.575301+0000","last_undegraded":"2024-01-17T22:59:25.575301+0000","last_fullsized":"2024-01-17T22:59:25.575301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:41:24.117738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:09.255716+0000","last_change":"2024-01-17T22:59:09.254564+0000","last_active":"2024-01-17T22:59:09.255716+0000","last_peered":"2024-01-17T22:59:09.255716+0000","last_clean":"2024-01-17T22:59:09.255716+0000","last_became_active":"2024-01-17T22:59:09.254084+0000","last_became_peered":"2024-01-17T22:59:09.254084+0000","last_unstale":"2024-01-17T22:59:09.255716+0000","last_undegraded":"2024-01-17T22:59:09.255716+0000","last_fullsized":"2024-01-17T22:59:09.255716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:04:05.785891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2,3],"acting":[0,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474946+0000","last_change":"2024-01-17T22:58:49.416963+0000","last_active":"2024-01-17T22:59:07.474946+0000","last_peered":"2024-01-17T22:59:07.474946+0000","last_clean":"2024-01-17T22:59:07.474946+0000","last_became_active":"2024-01-17T22:58:49.416757+0000","last_became_peered":"2024-01-17T22:58:49.416757+0000","last_unstale":"2024-01-17T22:59:07.474946+0000","last_undegraded":"2024-01-17T22:59:07.474946+0000","last_fullsized":"2024-01-17T22:59:07.474946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:08.763719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.653441+0000","last_change":"2024-01-17T22:58:48.341728+0000","last_active":"2024-01-17T22:59:25.653441+0000","last_peered":"2024-01-17T22:59:25.653441+0000","last_clean":"2024-01-17T22:59:25.653441+0000","last_became_active":"2024-01-17T22:58:48.341359+0000","last_became_peered":"2024-01-17T22:58:48.341359+0000","last_unstale":"2024-01-17T22:59:25.653441+0000","last_undegraded":"2024-01-17T22:59:25.653441+0000","last_fullsized":"2024-01-17T22:59:25.653441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:20:07.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476805+0000","last_change":"2024-01-17T22:58:55.913996+0000","last_active":"2024-01-17T22:59:07.476805+0000","last_peered":"2024-01-17T22:59:07.476805+0000","last_clean":"2024-01-17T22:59:07.476805+0000","last_became_active":"2024-01-17T22:58:55.913645+0000","last_became_peered":"2024-01-17T22:58:55.913645+0000","last_unstale":"2024-01-17T22:59:07.476805+0000","last_undegraded":"2024-01-17T22:59:07.476805+0000","last_fullsized":"2024-01-17T22:59:07.476805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468870+0000","last_change":"2024-01-17T22:58:49.417874+0000","last_active":"2024-01-17T22:59:07.468870+0000","last_peered":"2024-01-17T22:59:07.468870+0000","last_clean":"2024-01-17T22:59:07.468870+0000","last_became_active":"2024-01-17T22:58:49.417385+0000","last_became_peered":"2024-01-17T22:58:49.417385+0000","last_unstale":"2024-01-17T22:59:07.468870+0000","last_undegraded":"2024-01-17T22:59:07.468870+0000","last_fullsized":"2024-01-17T22:59:07.468870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:41.515981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.575922+0000","last_change":"2024-01-17T22:58:48.340052+0000","last_active":"2024-01-17T22:59:25.575922+0000","last_peered":"2024-01-17T22:59:25.575922+0000","last_clean":"2024-01-17T22:59:25.575922+0000","last_became_active":"2024-01-17T22:58:48.339738+0000","last_became_peered":"2024-01-17T22:58:48.339738+0000","last_unstale":"2024-01-17T22:59:25.575922+0000","last_undegraded":"2024-01-17T22:59:25.575922+0000","last_fullsized":"2024-01-17T22:59:25.575922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:58.517904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475163+0000","last_change":"2024-01-17T22:58:55.904749+0000","last_active":"2024-01-17T22:59:07.475163+0000","last_peered":"2024-01-17T22:59:07.475163+0000","last_clean":"2024-01-17T22:59:07.475163+0000","last_became_active":"2024-01-17T22:58:55.904417+0000","last_became_peered":"2024-01-17T22:58:55.904417+0000","last_unstale":"2024-01-17T22:59:07.475163+0000","last_undegraded":"2024-01-17T22:59:07.475163+0000","last_fullsized":"2024-01-17T22:59:07.475163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:22:32.504064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469801+0000","last_change":"2024-01-17T22:58:49.411284+0000","last_active":"2024-01-17T22:59:07.469801+0000","last_peered":"2024-01-17T22:59:07.469801+0000","last_clean":"2024-01-17T22:59:07.469801+0000","last_became_active":"2024-01-17T22:58:49.410830+0000","last_became_peered":"2024-01-17T22:58:49.410830+0000","last_unstale":"2024-01-17T22:59:07.469801+0000","last_undegraded":"2024-01-17T22:59:07.469801+0000","last_fullsized":"2024-01-17T22:59:07.469801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:17:04.832847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.302355+0000","last_change":"2024-01-17T22:58:48.339919+0000","last_active":"2024-01-17T22:59:32.302355+0000","last_peered":"2024-01-17T22:59:32.302355+0000","last_clean":"2024-01-17T22:59:32.302355+0000","last_became_active":"2024-01-17T22:58:48.338928+0000","last_became_peered":"2024-01-17T22:58:48.338928+0000","last_unstale":"2024-01-17T22:59:32.302355+0000","last_undegraded":"2024-01-17T22:59:32.302355+0000","last_fullsized":"2024-01-17T22:59:32.302355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:21.699809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467936+0000","last_change":"2024-01-17T22:58:55.909140+0000","last_active":"2024-01-17T22:59:07.467936+0000","last_peered":"2024-01-17T22:59:07.467936+0000","last_clean":"2024-01-17T22:59:07.467936+0000","last_became_active":"2024-01-17T22:58:55.908232+0000","last_became_peered":"2024-01-17T22:58:55.908232+0000","last_unstale":"2024-01-17T22:59:07.467936+0000","last_undegraded":"2024-01-17T22:59:07.467936+0000","last_fullsized":"2024-01-17T22:59:07.467936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.470820+0000","last_change":"2024-01-17T22:58:49.370201+0000","last_active":"2024-01-17T22:59:07.470820+0000","last_peered":"2024-01-17T22:59:07.470820+0000","last_clean":"2024-01-17T22:59:07.470820+0000","last_became_active":"2024-01-17T22:58:49.369598+0000","last_became_peered":"2024-01-17T22:58:49.369598+0000","last_unstale":"2024-01-17T22:59:07.470820+0000","last_undegraded":"2024-01-17T22:59:07.470820+0000","last_fullsized":"2024-01-17T22:59:07.470820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:15.814647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.670757+0000","last_change":"2024-01-17T22:58:48.338556+0000","last_active":"2024-01-17T22:59:08.670757+0000","last_peered":"2024-01-17T22:59:08.670757+0000","last_clean":"2024-01-17T22:59:08.670757+0000","last_became_active":"2024-01-17T22:58:48.338225+0000","last_became_peered":"2024-01-17T22:58:48.338225+0000","last_unstale":"2024-01-17T22:59:08.670757+0000","last_undegraded":"2024-01-17T22:59:08.670757+0000","last_fullsized":"2024-01-17T22:59:08.670757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:47.210049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469567+0000","last_change":"2024-01-17T22:58:55.872734+0000","last_active":"2024-01-17T22:59:07.469567+0000","last_peered":"2024-01-17T22:59:07.469567+0000","last_clean":"2024-01-17T22:59:07.469567+0000","last_became_active":"2024-01-17T22:58:55.872356+0000","last_became_peered":"2024-01-17T22:58:55.872356+0000","last_unstale":"2024-01-17T22:59:07.469567+0000","last_undegraded":"2024-01-17T22:59:07.469567+0000","last_fullsized":"2024-01-17T22:59:07.469567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:22:32.504064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476568+0000","last_change":"2024-01-17T22:58:49.369806+0000","last_active":"2024-01-17T22:59:07.476568+0000","last_peered":"2024-01-17T22:59:07.476568+0000","last_clean":"2024-01-17T22:59:07.476568+0000","last_became_active":"2024-01-17T22:58:49.369487+0000","last_became_peered":"2024-01-17T22:58:49.369487+0000","last_unstale":"2024-01-17T22:59:07.476568+0000","last_undegraded":"2024-01-17T22:59:07.476568+0000","last_fullsized":"2024-01-17T22:59:07.476568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:25.515983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477453+0000","last_change":"2024-01-17T22:58:48.341854+0000","last_active":"2024-01-17T22:59:07.477453+0000","last_peered":"2024-01-17T22:59:07.477453+0000","last_clean":"2024-01-17T22:59:07.477453+0000","last_became_active":"2024-01-17T22:58:48.339996+0000","last_became_peered":"2024-01-17T22:58:48.339996+0000","last_unstale":"2024-01-17T22:59:07.477453+0000","last_undegraded":"2024-01-17T22:59:07.477453+0000","last_fullsized":"2024-01-17T22:59:07.477453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:55:52.894278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467661+0000","last_change":"2024-01-17T22:58:55.877637+0000","last_active":"2024-01-17T22:59:07.467661+0000","last_peered":"2024-01-17T22:59:07.467661+0000","last_clean":"2024-01-17T22:59:07.467661+0000","last_became_active":"2024-01-17T22:58:55.877118+0000","last_became_peered":"2024-01-17T22:58:55.877118+0000","last_unstale":"2024-01-17T22:59:07.467661+0000","last_undegraded":"2024-01-17T22:59:07.467661+0000","last_fullsized":"2024-01-17T22:59:07.467661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:08.327495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471403+0000","last_change":"2024-01-17T22:58:49.352845+0000","last_active":"2024-01-17T22:59:07.471403+0000","last_peered":"2024-01-17T22:59:07.471403+0000","last_clean":"2024-01-17T22:59:07.471403+0000","last_became_active":"2024-01-17T22:58:49.352563+0000","last_became_peered":"2024-01-17T22:58:49.352563+0000","last_unstale":"2024-01-17T22:59:07.471403+0000","last_undegraded":"2024-01-17T22:59:07.471403+0000","last_fullsized":"2024-01-17T22:59:07.471403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:43.516572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.670274+0000","last_change":"2024-01-17T22:58:48.343658+0000","last_active":"2024-01-17T22:59:08.670274+0000","last_peered":"2024-01-17T22:59:08.670274+0000","last_clean":"2024-01-17T22:59:08.670274+0000","last_became_active":"2024-01-17T22:58:48.343060+0000","last_became_peered":"2024-01-17T22:58:48.343060+0000","last_unstale":"2024-01-17T22:59:08.670274+0000","last_undegraded":"2024-01-17T22:59:08.670274+0000","last_fullsized":"2024-01-17T22:59:08.670274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:42.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.470375+0000","last_change":"2024-01-17T22:58:55.881076+0000","last_active":"2024-01-17T22:59:07.470375+0000","last_peered":"2024-01-17T22:59:07.470375+0000","last_clean":"2024-01-17T22:59:07.470375+0000","last_became_active":"2024-01-17T22:58:55.880665+0000","last_became_peered":"2024-01-17T22:58:55.880665+0000","last_unstale":"2024-01-17T22:59:07.470375+0000","last_undegraded":"2024-01-17T22:59:07.470375+0000","last_fullsized":"2024-01-17T22:59:07.470375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:37:20.317014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475438+0000","last_change":"2024-01-17T22:58:49.385682+0000","last_active":"2024-01-17T22:59:07.475438+0000","last_peered":"2024-01-17T22:59:07.475438+0000","last_clean":"2024-01-17T22:59:07.475438+0000","last_became_active":"2024-01-17T22:58:49.384655+0000","last_became_peered":"2024-01-17T22:58:49.384655+0000","last_unstale":"2024-01-17T22:59:07.475438+0000","last_undegraded":"2024-01-17T22:59:07.475438+0000","last_fullsized":"2024-01-17T22:59:07.475438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:22:51.592384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.209484+0000","last_change":"2024-01-17T22:58:48.375527+0000","last_active":"2024-01-17T22:59:32.209484+0000","last_peered":"2024-01-17T22:59:32.209484+0000","last_clean":"2024-01-17T22:59:32.209484+0000","last_became_active":"2024-01-17T22:58:48.375210+0000","last_became_peered":"2024-01-17T22:58:48.375210+0000","last_unstale":"2024-01-17T22:59:32.209484+0000","last_undegraded":"2024-01-17T22:59:32.209484+0000","last_fullsized":"2024-01-17T22:59:32.209484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:51:00.037407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468786+0000","last_change":"2024-01-17T22:58:55.903437+0000","last_active":"2024-01-17T22:59:07.468786+0000","last_peered":"2024-01-17T22:59:07.468786+0000","last_clean":"2024-01-17T22:59:07.468786+0000","last_became_active":"2024-01-17T22:58:55.902881+0000","last_became_peered":"2024-01-17T22:58:55.902881+0000","last_unstale":"2024-01-17T22:59:07.468786+0000","last_undegraded":"2024-01-17T22:59:07.468786+0000","last_fullsized":"2024-01-17T22:59:07.468786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467415+0000","last_change":"2024-01-17T22:58:49.367932+0000","last_active":"2024-01-17T22:59:07.467415+0000","last_peered":"2024-01-17T22:59:07.467415+0000","last_clean":"2024-01-17T22:59:07.467415+0000","last_became_active":"2024-01-17T22:58:49.367236+0000","last_became_peered":"2024-01-17T22:58:49.367236+0000","last_unstale":"2024-01-17T22:59:07.467415+0000","last_undegraded":"2024-01-17T22:59:07.467415+0000","last_fullsized":"2024-01-17T22:59:07.467415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:06.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.273528+0000","last_change":"2024-01-17T22:58:48.338730+0000","last_active":"2024-01-17T22:59:32.273528+0000","last_peered":"2024-01-17T22:59:32.273528+0000","last_clean":"2024-01-17T22:59:32.273528+0000","last_became_active":"2024-01-17T22:58:48.337500+0000","last_became_peered":"2024-01-17T22:58:48.337500+0000","last_unstale":"2024-01-17T22:59:32.273528+0000","last_undegraded":"2024-01-17T22:59:32.273528+0000","last_fullsized":"2024-01-17T22:59:32.273528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:54.141445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477014+0000","last_change":"2024-01-17T22:58:55.900298+0000","last_active":"2024-01-17T22:59:07.477014+0000","last_peered":"2024-01-17T22:59:07.477014+0000","last_clean":"2024-01-17T22:59:07.477014+0000","last_became_active":"2024-01-17T22:58:55.899657+0000","last_became_peered":"2024-01-17T22:58:55.899657+0000","last_unstale":"2024-01-17T22:59:07.477014+0000","last_undegraded":"2024-01-17T22:59:07.477014+0000","last_fullsized":"2024-01-17T22:59:07.477014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:30:03.955178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468595+0000","last_change":"2024-01-17T22:58:49.412701+0000","last_active":"2024-01-17T22:59:07.468595+0000","last_peered":"2024-01-17T22:59:07.468595+0000","last_clean":"2024-01-17T22:59:07.468595+0000","last_became_active":"2024-01-17T22:58:49.411848+0000","last_became_peered":"2024-01-17T22:58:49.411848+0000","last_unstale":"2024-01-17T22:59:07.468595+0000","last_undegraded":"2024-01-17T22:59:07.468595+0000","last_fullsized":"2024-01-17T22:59:07.468595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:55:47.020055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.577746+0000","last_change":"2024-01-17T22:58:48.341769+0000","last_active":"2024-01-17T22:59:25.577746+0000","last_peered":"2024-01-17T22:59:25.577746+0000","last_clean":"2024-01-17T22:59:25.577746+0000","last_became_active":"2024-01-17T22:58:48.340963+0000","last_became_peered":"2024-01-17T22:58:48.340963+0000","last_unstale":"2024-01-17T22:59:25.577746+0000","last_undegraded":"2024-01-17T22:59:25.577746+0000","last_fullsized":"2024-01-17T22:59:25.577746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:15:16.672836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479207+0000","last_change":"2024-01-17T22:58:17.322374+0000","last_active":"2024-01-17T22:59:07.479207+0000","last_peered":"2024-01-17T22:59:07.479207+0000","last_clean":"2024-01-17T22:59:07.479207+0000","last_became_active":"2024-01-17T22:58:17.321097+0000","last_became_peered":"2024-01-17T22:58:17.321097+0000","last_unstale":"2024-01-17T22:59:07.479207+0000","last_undegraded":"2024-01-17T22:59:07.479207+0000","last_fullsized":"2024-01-17T22:59:07.479207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:15.452106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:15.452106+0000","last_clean_scrub_stamp":"2024-01-17T22:58:15.452106+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:55:58.924319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476194+0000","last_change":"2024-01-17T22:58:55.909509+0000","last_active":"2024-01-17T22:59:07.476194+0000","last_peered":"2024-01-17T22:59:07.476194+0000","last_clean":"2024-01-17T22:59:07.476194+0000","last_became_active":"2024-01-17T22:58:55.909055+0000","last_became_peered":"2024-01-17T22:58:55.909055+0000","last_unstale":"2024-01-17T22:59:07.476194+0000","last_undegraded":"2024-01-17T22:59:07.476194+0000","last_fullsized":"2024-01-17T22:59:07.476194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:11:12.388395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476079+0000","last_change":"2024-01-17T22:58:49.516198+0000","last_active":"2024-01-17T22:59:07.476079+0000","last_peered":"2024-01-17T22:59:07.476079+0000","last_clean":"2024-01-17T22:59:07.476079+0000","last_became_active":"2024-01-17T22:58:49.515941+0000","last_became_peered":"2024-01-17T22:58:49.515941+0000","last_unstale":"2024-01-17T22:59:07.476079+0000","last_undegraded":"2024-01-17T22:59:07.476079+0000","last_fullsized":"2024-01-17T22:59:07.476079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:54:07.128744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.323194+0000","last_change":"2024-01-17T22:58:48.344998+0000","last_active":"2024-01-17T22:59:32.323194+0000","last_peered":"2024-01-17T22:59:32.323194+0000","last_clean":"2024-01-17T22:59:32.323194+0000","last_became_active":"2024-01-17T22:58:48.344402+0000","last_became_peered":"2024-01-17T22:58:48.344402+0000","last_unstale":"2024-01-17T22:59:32.323194+0000","last_undegraded":"2024-01-17T22:59:32.323194+0000","last_fullsized":"2024-01-17T22:59:32.323194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:01:21.629083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475784+0000","last_change":"2024-01-17T22:58:55.886258+0000","last_active":"2024-01-17T22:59:07.475784+0000","last_peered":"2024-01-17T22:59:07.475784+0000","last_clean":"2024-01-17T22:59:07.475784+0000","last_became_active":"2024-01-17T22:58:55.885809+0000","last_became_peered":"2024-01-17T22:58:55.885809+0000","last_unstale":"2024-01-17T22:59:07.475784+0000","last_undegraded":"2024-01-17T22:59:07.475784+0000","last_fullsized":"2024-01-17T22:59:07.475784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:08.327495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.656010+0000","last_change":"2024-01-17T22:59:08.654953+0000","last_active":"2024-01-17T22:59:08.656010+0000","last_peered":"2024-01-17T22:59:08.656010+0000","last_clean":"2024-01-17T22:59:08.656010+0000","last_became_active":"2024-01-17T22:59:08.654136+0000","last_became_peered":"2024-01-17T22:59:08.654136+0000","last_unstale":"2024-01-17T22:59:08.656010+0000","last_undegraded":"2024-01-17T22:59:08.656010+0000","last_fullsized":"2024-01-17T22:59:08.656010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:19:02.000223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476805+0000","last_change":"2024-01-17T22:58:48.338206+0000","last_active":"2024-01-17T22:59:07.476805+0000","last_peered":"2024-01-17T22:59:07.476805+0000","last_clean":"2024-01-17T22:59:07.476805+0000","last_became_active":"2024-01-17T22:58:48.337489+0000","last_became_peered":"2024-01-17T22:58:48.337489+0000","last_unstale":"2024-01-17T22:59:07.476805+0000","last_undegraded":"2024-01-17T22:59:07.476805+0000","last_fullsized":"2024-01-17T22:59:07.476805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:09:04.579374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476461+0000","last_change":"2024-01-17T22:58:55.903435+0000","last_active":"2024-01-17T22:59:07.476461+0000","last_peered":"2024-01-17T22:59:07.476461+0000","last_clean":"2024-01-17T22:59:07.476461+0000","last_became_active":"2024-01-17T22:58:55.902857+0000","last_became_peered":"2024-01-17T22:58:55.902857+0000","last_unstale":"2024-01-17T22:59:07.476461+0000","last_undegraded":"2024-01-17T22:59:07.476461+0000","last_fullsized":"2024-01-17T22:59:07.476461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:24:43.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.473428+0000","last_change":"2024-01-17T22:58:49.519307+0000","last_active":"2024-01-17T22:59:07.473428+0000","last_peered":"2024-01-17T22:59:07.473428+0000","last_clean":"2024-01-17T22:59:07.473428+0000","last_became_active":"2024-01-17T22:58:49.519060+0000","last_became_peered":"2024-01-17T22:58:49.519060+0000","last_unstale":"2024-01-17T22:59:07.473428+0000","last_undegraded":"2024-01-17T22:59:07.473428+0000","last_fullsized":"2024-01-17T22:59:07.473428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:48.025499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469006+0000","last_change":"2024-01-17T22:58:48.341584+0000","last_active":"2024-01-17T22:59:07.469006+0000","last_peered":"2024-01-17T22:59:07.469006+0000","last_clean":"2024-01-17T22:59:07.469006+0000","last_became_active":"2024-01-17T22:58:48.339433+0000","last_became_peered":"2024-01-17T22:58:48.339433+0000","last_unstale":"2024-01-17T22:59:07.469006+0000","last_undegraded":"2024-01-17T22:59:07.469006+0000","last_fullsized":"2024-01-17T22:59:07.469006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:01:09.060396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474422+0000","last_change":"2024-01-17T22:58:55.905118+0000","last_active":"2024-01-17T22:59:07.474422+0000","last_peered":"2024-01-17T22:59:07.474422+0000","last_clean":"2024-01-17T22:59:07.474422+0000","last_became_active":"2024-01-17T22:58:55.904690+0000","last_became_peered":"2024-01-17T22:58:55.904690+0000","last_unstale":"2024-01-17T22:59:07.474422+0000","last_undegraded":"2024-01-17T22:59:07.474422+0000","last_fullsized":"2024-01-17T22:59:07.474422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:45:30.212764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477010+0000","last_change":"2024-01-17T22:58:49.352993+0000","last_active":"2024-01-17T22:59:07.477010+0000","last_peered":"2024-01-17T22:59:07.477010+0000","last_clean":"2024-01-17T22:59:07.477010+0000","last_became_active":"2024-01-17T22:58:49.352744+0000","last_became_peered":"2024-01-17T22:58:49.352744+0000","last_unstale":"2024-01-17T22:59:07.477010+0000","last_undegraded":"2024-01-17T22:59:07.477010+0000","last_fullsized":"2024-01-17T22:59:07.477010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:06.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.473284+0000","last_change":"2024-01-17T22:58:48.343793+0000","last_active":"2024-01-17T22:59:07.473284+0000","last_peered":"2024-01-17T22:59:07.473284+0000","last_clean":"2024-01-17T22:59:07.473284+0000","last_became_active":"2024-01-17T22:58:48.343435+0000","last_became_peered":"2024-01-17T22:58:48.343435+0000","last_unstale":"2024-01-17T22:59:07.473284+0000","last_undegraded":"2024-01-17T22:59:07.473284+0000","last_fullsized":"2024-01-17T22:59:07.473284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:50:50.592551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479386+0000","last_change":"2024-01-17T22:58:55.913690+0000","last_active":"2024-01-17T22:59:07.479386+0000","last_peered":"2024-01-17T22:59:07.479386+0000","last_clean":"2024-01-17T22:59:07.479386+0000","last_became_active":"2024-01-17T22:58:55.913197+0000","last_became_peered":"2024-01-17T22:58:55.913197+0000","last_unstale":"2024-01-17T22:59:07.479386+0000","last_undegraded":"2024-01-17T22:59:07.479386+0000","last_fullsized":"2024-01-17T22:59:07.479386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:31.829297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474856+0000","last_change":"2024-01-17T22:58:49.368242+0000","last_active":"2024-01-17T22:59:07.474856+0000","last_peered":"2024-01-17T22:59:07.474856+0000","last_clean":"2024-01-17T22:59:07.474856+0000","last_became_active":"2024-01-17T22:58:49.368018+0000","last_became_peered":"2024-01-17T22:58:49.368018+0000","last_unstale":"2024-01-17T22:59:07.474856+0000","last_undegraded":"2024-01-17T22:59:07.474856+0000","last_fullsized":"2024-01-17T22:59:07.474856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:49:55.661543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'15","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.304352+0000","last_change":"2024-01-17T22:58:48.374293+0000","last_active":"2024-01-17T22:59:32.304352+0000","last_peered":"2024-01-17T22:59:32.304352+0000","last_clean":"2024-01-17T22:59:32.304352+0000","last_became_active":"2024-01-17T22:58:48.373287+0000","last_became_peered":"2024-01-17T22:58:48.373287+0000","last_unstale":"2024-01-17T22:59:32.304352+0000","last_undegraded":"2024-01-17T22:59:32.304352+0000","last_fullsized":"2024-01-17T22:59:32.304352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477137+0000","last_change":"2024-01-17T22:58:55.909679+0000","last_active":"2024-01-17T22:59:07.477137+0000","last_peered":"2024-01-17T22:59:07.477137+0000","last_clean":"2024-01-17T22:59:07.477137+0000","last_became_active":"2024-01-17T22:58:55.909139+0000","last_became_peered":"2024-01-17T22:58:55.909139+0000","last_unstale":"2024-01-17T22:59:07.477137+0000","last_undegraded":"2024-01-17T22:59:07.477137+0000","last_fullsized":"2024-01-17T22:59:07.477137+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:39:50.993158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479057+0000","last_change":"2024-01-17T22:58:49.515761+0000","last_active":"2024-01-17T22:59:07.479057+0000","last_peered":"2024-01-17T22:59:07.479057+0000","last_clean":"2024-01-17T22:59:07.479057+0000","last_became_active":"2024-01-17T22:58:49.514776+0000","last_became_peered":"2024-01-17T22:58:49.514776+0000","last_unstale":"2024-01-17T22:59:07.479057+0000","last_undegraded":"2024-01-17T22:59:07.479057+0000","last_fullsized":"2024-01-17T22:59:07.479057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.307111+0000","last_change":"2024-01-17T22:58:48.349505+0000","last_active":"2024-01-17T22:59:32.307111+0000","last_peered":"2024-01-17T22:59:32.307111+0000","last_clean":"2024-01-17T22:59:32.307111+0000","last_became_active":"2024-01-17T22:58:48.349193+0000","last_became_peered":"2024-01-17T22:58:48.349193+0000","last_unstale":"2024-01-17T22:59:32.307111+0000","last_undegraded":"2024-01-17T22:59:32.307111+0000","last_fullsized":"2024-01-17T22:59:32.307111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:10:59.139723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477882+0000","last_change":"2024-01-17T22:58:55.911280+0000","last_active":"2024-01-17T22:59:07.477882+0000","last_peered":"2024-01-17T22:59:07.477882+0000","last_clean":"2024-01-17T22:59:07.477882+0000","last_became_active":"2024-01-17T22:58:55.910147+0000","last_became_peered":"2024-01-17T22:58:55.910147+0000","last_unstale":"2024-01-17T22:59:07.477882+0000","last_undegraded":"2024-01-17T22:59:07.477882+0000","last_fullsized":"2024-01-17T22:59:07.477882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:29:01.453903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475134+0000","last_change":"2024-01-17T22:58:49.366332+0000","last_active":"2024-01-17T22:59:07.475134+0000","last_peered":"2024-01-17T22:59:07.475134+0000","last_clean":"2024-01-17T22:59:07.475134+0000","last_became_active":"2024-01-17T22:58:49.366055+0000","last_became_peered":"2024-01-17T22:58:49.366055+0000","last_unstale":"2024-01-17T22:59:07.475134+0000","last_undegraded":"2024-01-17T22:59:07.475134+0000","last_fullsized":"2024-01-17T22:59:07.475134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:44:30.888903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.577705+0000","last_change":"2024-01-17T22:58:48.378008+0000","last_active":"2024-01-17T22:59:25.577705+0000","last_peered":"2024-01-17T22:59:25.577705+0000","last_clean":"2024-01-17T22:59:25.577705+0000","last_became_active":"2024-01-17T22:58:48.377732+0000","last_became_peered":"2024-01-17T22:58:48.377732+0000","last_unstale":"2024-01-17T22:59:25.577705+0000","last_undegraded":"2024-01-17T22:59:25.577705+0000","last_fullsized":"2024-01-17T22:59:25.577705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:05.032134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:09.245915+0000","last_change":"2024-01-17T22:59:09.245915+0000","last_active":"2024-01-17T22:59:09.245915+0000","last_peered":"2024-01-17T22:59:09.245915+0000","last_clean":"2024-01-17T22:59:09.245915+0000","last_became_active":"2024-01-17T22:59:09.244621+0000","last_became_peered":"2024-01-17T22:59:09.244621+0000","last_unstale":"2024-01-17T22:59:09.245915+0000","last_undegraded":"2024-01-17T22:59:09.245915+0000","last_fullsized":"2024-01-17T22:59:09.245915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:01:38.677481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,5],"acting":[6,4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467973+0000","last_change":"2024-01-17T22:58:49.368620+0000","last_active":"2024-01-17T22:59:07.467973+0000","last_peered":"2024-01-17T22:59:07.467973+0000","last_clean":"2024-01-17T22:59:07.467973+0000","last_became_active":"2024-01-17T22:58:49.367258+0000","last_became_peered":"2024-01-17T22:58:49.367258+0000","last_unstale":"2024-01-17T22:59:07.467973+0000","last_undegraded":"2024-01-17T22:59:07.467973+0000","last_fullsized":"2024-01-17T22:59:07.467973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:25.515983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'6","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.217053+0000","last_change":"2024-01-17T22:58:48.371378+0000","last_active":"2024-01-17T22:59:32.217053+0000","last_peered":"2024-01-17T22:59:32.217053+0000","last_clean":"2024-01-17T22:59:32.217053+0000","last_became_active":"2024-01-17T22:58:48.370691+0000","last_became_peered":"2024-01-17T22:58:48.370691+0000","last_unstale":"2024-01-17T22:59:32.217053+0000","last_undegraded":"2024-01-17T22:59:32.217053+0000","last_fullsized":"2024-01-17T22:59:32.217053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:01:21.629083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475936+0000","last_change":"2024-01-17T22:58:55.846853+0000","last_active":"2024-01-17T22:59:07.475936+0000","last_peered":"2024-01-17T22:59:07.475936+0000","last_clean":"2024-01-17T22:59:07.475936+0000","last_became_active":"2024-01-17T22:58:55.846382+0000","last_became_peered":"2024-01-17T22:58:55.846382+0000","last_unstale":"2024-01-17T22:59:07.475936+0000","last_undegraded":"2024-01-17T22:59:07.475936+0000","last_fullsized":"2024-01-17T22:59:07.475936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:00:22.788812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472128+0000","last_change":"2024-01-17T22:58:49.367642+0000","last_active":"2024-01-17T22:59:07.472128+0000","last_peered":"2024-01-17T22:59:07.472128+0000","last_clean":"2024-01-17T22:59:07.472128+0000","last_became_active":"2024-01-17T22:58:49.367370+0000","last_became_peered":"2024-01-17T22:58:49.367370+0000","last_unstale":"2024-01-17T22:59:07.472128+0000","last_undegraded":"2024-01-17T22:59:07.472128+0000","last_fullsized":"2024-01-17T22:59:07.472128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:24:43.594840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'12","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.581180+0000","last_change":"2024-01-17T22:58:48.346833+0000","last_active":"2024-01-17T22:59:25.581180+0000","last_peered":"2024-01-17T22:59:25.581180+0000","last_clean":"2024-01-17T22:59:25.581180+0000","last_became_active":"2024-01-17T22:58:48.346574+0000","last_became_peered":"2024-01-17T22:58:48.346574+0000","last_unstale":"2024-01-17T22:59:25.581180+0000","last_undegraded":"2024-01-17T22:59:25.581180+0000","last_fullsized":"2024-01-17T22:59:25.581180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:55:23.055396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468467+0000","last_change":"2024-01-17T22:58:55.832183+0000","last_active":"2024-01-17T22:59:07.468467+0000","last_peered":"2024-01-17T22:59:07.468467+0000","last_clean":"2024-01-17T22:59:07.468467+0000","last_became_active":"2024-01-17T22:58:55.831090+0000","last_became_peered":"2024-01-17T22:58:55.831090+0000","last_unstale":"2024-01-17T22:59:07.468467+0000","last_undegraded":"2024-01-17T22:59:07.468467+0000","last_fullsized":"2024-01-17T22:59:07.468467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:15.077032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475364+0000","last_change":"2024-01-17T22:58:49.366048+0000","last_active":"2024-01-17T22:59:07.475364+0000","last_peered":"2024-01-17T22:59:07.475364+0000","last_clean":"2024-01-17T22:59:07.475364+0000","last_became_active":"2024-01-17T22:58:49.365846+0000","last_became_peered":"2024-01-17T22:58:49.365846+0000","last_unstale":"2024-01-17T22:59:07.475364+0000","last_undegraded":"2024-01-17T22:59:07.475364+0000","last_fullsized":"2024-01-17T22:59:07.475364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:19:02.000223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.639338+0000","last_change":"2024-01-17T22:58:48.376099+0000","last_active":"2024-01-17T22:59:08.639338+0000","last_peered":"2024-01-17T22:59:08.639338+0000","last_clean":"2024-01-17T22:59:08.639338+0000","last_became_active":"2024-01-17T22:58:48.375504+0000","last_became_peered":"2024-01-17T22:58:48.375504+0000","last_unstale":"2024-01-17T22:59:08.639338+0000","last_undegraded":"2024-01-17T22:59:08.639338+0000","last_fullsized":"2024-01-17T22:59:08.639338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476012+0000","last_change":"2024-01-17T22:58:55.906751+0000","last_active":"2024-01-17T22:59:07.476012+0000","last_peered":"2024-01-17T22:59:07.476012+0000","last_clean":"2024-01-17T22:59:07.476012+0000","last_became_active":"2024-01-17T22:58:55.906429+0000","last_became_peered":"2024-01-17T22:58:55.906429+0000","last_unstale":"2024-01-17T22:59:07.476012+0000","last_undegraded":"2024-01-17T22:59:07.476012+0000","last_fullsized":"2024-01-17T22:59:07.476012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:37:20.317014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477998+0000","last_change":"2024-01-17T22:58:49.361059+0000","last_active":"2024-01-17T22:59:07.477998+0000","last_peered":"2024-01-17T22:59:07.477998+0000","last_clean":"2024-01-17T22:59:07.477998+0000","last_became_active":"2024-01-17T22:58:49.360282+0000","last_became_peered":"2024-01-17T22:58:49.360282+0000","last_unstale":"2024-01-17T22:59:07.477998+0000","last_undegraded":"2024-01-17T22:59:07.477998+0000","last_fullsized":"2024-01-17T22:59:07.477998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:10:15.673364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.653165+0000","last_change":"2024-01-17T22:58:48.349585+0000","last_active":"2024-01-17T22:59:25.653165+0000","last_peered":"2024-01-17T22:59:25.653165+0000","last_clean":"2024-01-17T22:59:25.653165+0000","last_became_active":"2024-01-17T22:58:48.349262+0000","last_became_peered":"2024-01-17T22:58:48.349262+0000","last_unstale":"2024-01-17T22:59:25.653165+0000","last_undegraded":"2024-01-17T22:59:25.653165+0000","last_fullsized":"2024-01-17T22:59:25.653165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:32:48.765965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.461673+0000","last_change":"2024-01-17T22:58:55.899604+0000","last_active":"2024-01-17T22:59:07.461673+0000","last_peered":"2024-01-17T22:59:07.461673+0000","last_clean":"2024-01-17T22:59:07.461673+0000","last_became_active":"2024-01-17T22:58:55.899176+0000","last_became_peered":"2024-01-17T22:58:55.899176+0000","last_unstale":"2024-01-17T22:59:07.461673+0000","last_undegraded":"2024-01-17T22:59:07.461673+0000","last_fullsized":"2024-01-17T22:59:07.461673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:47.829295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476942+0000","last_change":"2024-01-17T22:58:49.364258+0000","last_active":"2024-01-17T22:59:07.476942+0000","last_peered":"2024-01-17T22:59:07.476942+0000","last_clean":"2024-01-17T22:59:07.476942+0000","last_became_active":"2024-01-17T22:58:49.363979+0000","last_became_peered":"2024-01-17T22:58:49.363979+0000","last_unstale":"2024-01-17T22:59:07.476942+0000","last_undegraded":"2024-01-17T22:59:07.476942+0000","last_fullsized":"2024-01-17T22:59:07.476942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:15:17.927996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.619819+0000","last_change":"2024-01-17T22:58:48.321573+0000","last_active":"2024-01-17T22:59:25.619819+0000","last_peered":"2024-01-17T22:59:25.619819+0000","last_clean":"2024-01-17T22:59:25.619819+0000","last_became_active":"2024-01-17T22:58:48.321379+0000","last_became_peered":"2024-01-17T22:58:48.321379+0000","last_unstale":"2024-01-17T22:59:25.619819+0000","last_undegraded":"2024-01-17T22:59:25.619819+0000","last_fullsized":"2024-01-17T22:59:25.619819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:55:23.055396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467702+0000","last_change":"2024-01-17T22:58:55.873529+0000","last_active":"2024-01-17T22:59:07.467702+0000","last_peered":"2024-01-17T22:59:07.467702+0000","last_clean":"2024-01-17T22:59:07.467702+0000","last_became_active":"2024-01-17T22:58:55.872885+0000","last_became_peered":"2024-01-17T22:58:55.872885+0000","last_unstale":"2024-01-17T22:59:07.467702+0000","last_undegraded":"2024-01-17T22:59:07.467702+0000","last_fullsized":"2024-01-17T22:59:07.467702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:50:01.974857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469204+0000","last_change":"2024-01-17T22:58:55.903620+0000","last_active":"2024-01-17T22:59:07.469204+0000","last_peered":"2024-01-17T22:59:07.469204+0000","last_clean":"2024-01-17T22:59:07.469204+0000","last_became_active":"2024-01-17T22:58:55.902860+0000","last_became_peered":"2024-01-17T22:58:55.902860+0000","last_unstale":"2024-01-17T22:59:07.469204+0000","last_undegraded":"2024-01-17T22:59:07.469204+0000","last_fullsized":"2024-01-17T22:59:07.469204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:33:56.437178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467826+0000","last_change":"2024-01-17T22:58:49.515108+0000","last_active":"2024-01-17T22:59:07.467826+0000","last_peered":"2024-01-17T22:59:07.467826+0000","last_clean":"2024-01-17T22:59:07.467826+0000","last_became_active":"2024-01-17T22:58:49.514297+0000","last_became_peered":"2024-01-17T22:58:49.514297+0000","last_unstale":"2024-01-17T22:59:07.467826+0000","last_undegraded":"2024-01-17T22:59:07.467826+0000","last_fullsized":"2024-01-17T22:59:07.467826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:15.814647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.669794+0000","last_change":"2024-01-17T22:58:48.331952+0000","last_active":"2024-01-17T22:59:08.669794+0000","last_peered":"2024-01-17T22:59:08.669794+0000","last_clean":"2024-01-17T22:59:08.669794+0000","last_became_active":"2024-01-17T22:58:48.331645+0000","last_became_peered":"2024-01-17T22:58:48.331645+0000","last_unstale":"2024-01-17T22:59:08.669794+0000","last_undegraded":"2024-01-17T22:59:08.669794+0000","last_fullsized":"2024-01-17T22:59:08.669794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:24.260824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475509+0000","last_change":"2024-01-17T22:58:55.906062+0000","last_active":"2024-01-17T22:59:07.475509+0000","last_peered":"2024-01-17T22:59:07.475509+0000","last_clean":"2024-01-17T22:59:07.475509+0000","last_became_active":"2024-01-17T22:58:55.905743+0000","last_became_peered":"2024-01-17T22:58:55.905743+0000","last_unstale":"2024-01-17T22:59:07.475509+0000","last_undegraded":"2024-01-17T22:59:07.475509+0000","last_fullsized":"2024-01-17T22:59:07.475509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:19:20.308367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475626+0000","last_change":"2024-01-17T22:58:49.369540+0000","last_active":"2024-01-17T22:59:07.475626+0000","last_peered":"2024-01-17T22:59:07.475626+0000","last_clean":"2024-01-17T22:59:07.475626+0000","last_became_active":"2024-01-17T22:58:49.366692+0000","last_became_peered":"2024-01-17T22:58:49.366692+0000","last_unstale":"2024-01-17T22:59:07.475626+0000","last_undegraded":"2024-01-17T22:59:07.475626+0000","last_fullsized":"2024-01-17T22:59:07.475626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:39:54.814019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.322984+0000","last_change":"2024-01-17T22:58:48.345003+0000","last_active":"2024-01-17T22:59:32.322984+0000","last_peered":"2024-01-17T22:59:32.322984+0000","last_clean":"2024-01-17T22:59:32.322984+0000","last_became_active":"2024-01-17T22:58:48.344271+0000","last_became_peered":"2024-01-17T22:58:48.344271+0000","last_unstale":"2024-01-17T22:59:32.322984+0000","last_undegraded":"2024-01-17T22:59:32.322984+0000","last_fullsized":"2024-01-17T22:59:32.322984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:51:00.037407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:32.274520+0000","last_change":"2024-01-17T22:58:48.342292+0000","last_active":"2024-01-17T22:59:32.274520+0000","last_peered":"2024-01-17T22:59:32.274520+0000","last_clean":"2024-01-17T22:59:32.274520+0000","last_became_active":"2024-01-17T22:58:48.339364+0000","last_became_peered":"2024-01-17T22:58:48.339364+0000","last_unstale":"2024-01-17T22:59:32.274520+0000","last_undegraded":"2024-01-17T22:59:32.274520+0000","last_fullsized":"2024-01-17T22:59:32.274520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:51.848489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468893+0000","last_change":"2024-01-17T22:58:49.414836+0000","last_active":"2024-01-17T22:59:07.468893+0000","last_peered":"2024-01-17T22:59:07.468893+0000","last_clean":"2024-01-17T22:59:07.468893+0000","last_became_active":"2024-01-17T22:58:49.414163+0000","last_became_peered":"2024-01-17T22:58:49.414163+0000","last_unstale":"2024-01-17T22:59:07.468893+0000","last_undegraded":"2024-01-17T22:59:07.468893+0000","last_fullsized":"2024-01-17T22:59:07.468893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:24.988174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.473657+0000","last_change":"2024-01-17T22:58:55.880197+0000","last_active":"2024-01-17T22:59:07.473657+0000","last_peered":"2024-01-17T22:59:07.473657+0000","last_clean":"2024-01-17T22:59:07.473657+0000","last_became_active":"2024-01-17T22:58:55.879263+0000","last_became_peered":"2024-01-17T22:58:55.879263+0000","last_unstale":"2024-01-17T22:59:07.473657+0000","last_undegraded":"2024-01-17T22:59:07.473657+0000","last_fullsized":"2024-01-17T22:59:07.473657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:47:02.273099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:25.680886+0000","last_change":"2024-01-17T22:58:48.339419+0000","last_active":"2024-01-17T22:59:25.680886+0000","last_peered":"2024-01-17T22:59:25.680886+0000","last_clean":"2024-01-17T22:59:25.680886+0000","last_became_active":"2024-01-17T22:58:48.338809+0000","last_became_peered":"2024-01-17T22:58:48.338809+0000","last_unstale":"2024-01-17T22:59:25.680886+0000","last_undegraded":"2024-01-17T22:59:25.680886+0000","last_fullsized":"2024-01-17T22:59:25.680886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:20:07.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479082+0000","last_change":"2024-01-17T22:58:49.518469+0000","last_active":"2024-01-17T22:59:07.479082+0000","last_peered":"2024-01-17T22:59:07.479082+0000","last_clean":"2024-01-17T22:59:07.479082+0000","last_became_active":"2024-01-17T22:58:49.518211+0000","last_became_peered":"2024-01-17T22:58:49.518211+0000","last_unstale":"2024-01-17T22:59:07.479082+0000","last_undegraded":"2024-01-17T22:59:07.479082+0000","last_fullsized":"2024-01-17T22:59:07.479082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:22.954968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.462345+0000","last_change":"2024-01-17T22:58:55.913601+0000","last_active":"2024-01-17T22:59:07.462345+0000","last_peered":"2024-01-17T22:59:07.462345+0000","last_clean":"2024-01-17T22:59:07.462345+0000","last_became_active":"2024-01-17T22:58:55.912825+0000","last_became_peered":"2024-01-17T22:58:55.912825+0000","last_unstale":"2024-01-17T22:59:07.462345+0000","last_undegraded":"2024-01-17T22:59:07.462345+0000","last_fullsized":"2024-01-17T22:59:07.462345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:36.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474545+0000","last_change":"2024-01-17T22:58:49.371282+0000","last_active":"2024-01-17T22:59:07.474545+0000","last_peered":"2024-01-17T22:59:07.474545+0000","last_clean":"2024-01-17T22:59:07.474545+0000","last_became_active":"2024-01-17T22:58:49.371125+0000","last_became_peered":"2024-01-17T22:58:49.371125+0000","last_unstale":"2024-01-17T22:59:07.474545+0000","last_undegraded":"2024-01-17T22:59:07.474545+0000","last_fullsized":"2024-01-17T22:59:07.474545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.461964+0000","last_change":"2024-01-17T22:58:49.510490+0000","last_active":"2024-01-17T22:59:07.461964+0000","last_peered":"2024-01-17T22:59:07.461964+0000","last_clean":"2024-01-17T22:59:07.461964+0000","last_became_active":"2024-01-17T22:58:49.509690+0000","last_became_peered":"2024-01-17T22:58:49.509690+0000","last_unstale":"2024-01-17T22:59:07.461964+0000","last_undegraded":"2024-01-17T22:59:07.461964+0000","last_fullsized":"2024-01-17T22:59:07.461964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474689+0000","last_change":"2024-01-17T22:58:49.371326+0000","last_active":"2024-01-17T22:59:07.474689+0000","last_peered":"2024-01-17T22:59:07.474689+0000","last_clean":"2024-01-17T22:59:07.474689+0000","last_became_active":"2024-01-17T22:58:49.370511+0000","last_became_peered":"2024-01-17T22:58:49.370511+0000","last_unstale":"2024-01-17T22:59:07.474689+0000","last_undegraded":"2024-01-17T22:59:07.474689+0000","last_fullsized":"2024-01-17T22:59:07.474689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:46:55.959786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476531+0000","last_change":"2024-01-17T22:58:49.385500+0000","last_active":"2024-01-17T22:59:07.476531+0000","last_peered":"2024-01-17T22:59:07.476531+0000","last_clean":"2024-01-17T22:59:07.476531+0000","last_became_active":"2024-01-17T22:58:49.384397+0000","last_became_peered":"2024-01-17T22:58:49.384397+0000","last_unstale":"2024-01-17T22:59:07.476531+0000","last_undegraded":"2024-01-17T22:59:07.476531+0000","last_fullsized":"2024-01-17T22:59:07.476531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:18.563360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.470616+0000","last_change":"2024-01-17T22:58:49.369750+0000","last_active":"2024-01-17T22:59:07.470616+0000","last_peered":"2024-01-17T22:59:07.470616+0000","last_clean":"2024-01-17T22:59:07.470616+0000","last_became_active":"2024-01-17T22:58:49.368591+0000","last_became_peered":"2024-01-17T22:58:49.368591+0000","last_unstale":"2024-01-17T22:59:07.470616+0000","last_undegraded":"2024-01-17T22:59:07.470616+0000","last_fullsized":"2024-01-17T22:59:07.470616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:59.773063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.469191+0000","last_change":"2024-01-17T22:58:49.380275+0000","last_active":"2024-01-17T22:59:07.469191+0000","last_peered":"2024-01-17T22:59:07.469191+0000","last_clean":"2024-01-17T22:59:07.469191+0000","last_became_active":"2024-01-17T22:58:49.379560+0000","last_became_peered":"2024-01-17T22:58:49.379560+0000","last_unstale":"2024-01-17T22:59:07.469191+0000","last_undegraded":"2024-01-17T22:59:07.469191+0000","last_fullsized":"2024-01-17T22:59:07.469191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:41.515981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476875+0000","last_change":"2024-01-17T22:58:49.368509+0000","last_active":"2024-01-17T22:59:07.476875+0000","last_peered":"2024-01-17T22:59:07.476875+0000","last_clean":"2024-01-17T22:59:07.476875+0000","last_became_active":"2024-01-17T22:58:49.367330+0000","last_became_peered":"2024-01-17T22:58:49.367330+0000","last_unstale":"2024-01-17T22:59:07.476875+0000","last_undegraded":"2024-01-17T22:59:07.476875+0000","last_fullsized":"2024-01-17T22:59:07.476875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476516+0000","last_change":"2024-01-17T22:58:49.514419+0000","last_active":"2024-01-17T22:59:07.476516+0000","last_peered":"2024-01-17T22:59:07.476516+0000","last_clean":"2024-01-17T22:59:07.476516+0000","last_became_active":"2024-01-17T22:58:49.513924+0000","last_became_peered":"2024-01-17T22:58:49.513924+0000","last_unstale":"2024-01-17T22:59:07.476516+0000","last_undegraded":"2024-01-17T22:59:07.476516+0000","last_fullsized":"2024-01-17T22:59:07.476516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:24:43.594840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474620+0000","last_change":"2024-01-17T22:58:49.371064+0000","last_active":"2024-01-17T22:59:07.474620+0000","last_peered":"2024-01-17T22:59:07.474620+0000","last_clean":"2024-01-17T22:59:07.474620+0000","last_became_active":"2024-01-17T22:58:49.370808+0000","last_became_peered":"2024-01-17T22:58:49.370808+0000","last_unstale":"2024-01-17T22:59:07.474620+0000","last_undegraded":"2024-01-17T22:59:07.474620+0000","last_fullsized":"2024-01-17T22:59:07.474620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:39.502451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475665+0000","last_change":"2024-01-17T22:58:49.350539+0000","last_active":"2024-01-17T22:59:07.475665+0000","last_peered":"2024-01-17T22:59:07.475665+0000","last_clean":"2024-01-17T22:59:07.475665+0000","last_became_active":"2024-01-17T22:58:49.350057+0000","last_became_peered":"2024-01-17T22:58:49.350057+0000","last_unstale":"2024-01-17T22:59:07.475665+0000","last_undegraded":"2024-01-17T22:59:07.475665+0000","last_fullsized":"2024-01-17T22:59:07.475665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:43.516572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.478985+0000","last_change":"2024-01-17T22:58:49.517955+0000","last_active":"2024-01-17T22:59:07.478985+0000","last_peered":"2024-01-17T22:59:07.478985+0000","last_clean":"2024-01-17T22:59:07.478985+0000","last_became_active":"2024-01-17T22:58:49.517631+0000","last_became_peered":"2024-01-17T22:58:49.517631+0000","last_unstale":"2024-01-17T22:59:07.478985+0000","last_undegraded":"2024-01-17T22:59:07.478985+0000","last_fullsized":"2024-01-17T22:59:07.478985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:41:25.372897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468791+0000","last_change":"2024-01-17T22:58:49.412901+0000","last_active":"2024-01-17T22:59:07.468791+0000","last_peered":"2024-01-17T22:59:07.468791+0000","last_clean":"2024-01-17T22:59:07.468791+0000","last_became_active":"2024-01-17T22:58:49.411772+0000","last_became_peered":"2024-01-17T22:58:49.411772+0000","last_unstale":"2024-01-17T22:59:07.468791+0000","last_undegraded":"2024-01-17T22:59:07.468791+0000","last_fullsized":"2024-01-17T22:59:07.468791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:30.366002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T22:59:08.752125+0000","last_change":"2024-01-17T22:59:08.750879+0000","last_active":"2024-01-17T22:59:08.752125+0000","last_peered":"2024-01-17T22:59:08.752125+0000","last_clean":"2024-01-17T22:59:08.752125+0000","last_became_active":"2024-01-17T22:59:08.750082+0000","last_became_peered":"2024-01-17T22:59:08.750082+0000","last_unstale":"2024-01-17T22:59:08.752125+0000","last_undegraded":"2024-01-17T22:59:08.752125+0000","last_fullsized":"2024-01-17T22:59:08.752125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:49:12.522334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476266+0000","last_change":"2024-01-17T22:58:49.415138+0000","last_active":"2024-01-17T22:59:07.476266+0000","last_peered":"2024-01-17T22:59:07.476266+0000","last_clean":"2024-01-17T22:59:07.476266+0000","last_became_active":"2024-01-17T22:58:49.414598+0000","last_became_peered":"2024-01-17T22:58:49.414598+0000","last_unstale":"2024-01-17T22:59:07.476266+0000","last_undegraded":"2024-01-17T22:59:07.476266+0000","last_fullsized":"2024-01-17T22:59:07.476266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:40.477976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.462811+0000","last_change":"2024-01-17T22:58:49.388702+0000","last_active":"2024-01-17T22:59:07.462811+0000","last_peered":"2024-01-17T22:59:07.462811+0000","last_clean":"2024-01-17T22:59:07.462811+0000","last_became_active":"2024-01-17T22:58:49.388096+0000","last_became_peered":"2024-01-17T22:58:49.388096+0000","last_unstale":"2024-01-17T22:59:07.462811+0000","last_undegraded":"2024-01-17T22:59:07.462811+0000","last_fullsized":"2024-01-17T22:59:07.462811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475653+0000","last_change":"2024-01-17T22:58:49.370433+0000","last_active":"2024-01-17T22:59:07.475653+0000","last_peered":"2024-01-17T22:59:07.475653+0000","last_clean":"2024-01-17T22:59:07.475653+0000","last_became_active":"2024-01-17T22:58:49.369959+0000","last_became_peered":"2024-01-17T22:58:49.369959+0000","last_unstale":"2024-01-17T22:59:07.475653+0000","last_undegraded":"2024-01-17T22:59:07.475653+0000","last_fullsized":"2024-01-17T22:59:07.475653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:41:09.206436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.474554+0000","last_change":"2024-01-17T22:58:49.366356+0000","last_active":"2024-01-17T22:59:07.474554+0000","last_peered":"2024-01-17T22:59:07.474554+0000","last_clean":"2024-01-17T22:59:07.474554+0000","last_became_active":"2024-01-17T22:58:49.366122+0000","last_became_peered":"2024-01-17T22:58:49.366122+0000","last_unstale":"2024-01-17T22:59:07.474554+0000","last_undegraded":"2024-01-17T22:59:07.474554+0000","last_fullsized":"2024-01-17T22:59:07.474554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:33:50.123865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475472+0000","last_change":"2024-01-17T22:58:49.349380+0000","last_active":"2024-01-17T22:59:07.475472+0000","last_peered":"2024-01-17T22:59:07.475472+0000","last_clean":"2024-01-17T22:59:07.475472+0000","last_became_active":"2024-01-17T22:58:49.348630+0000","last_became_peered":"2024-01-17T22:58:49.348630+0000","last_unstale":"2024-01-17T22:59:07.475472+0000","last_undegraded":"2024-01-17T22:59:07.475472+0000","last_fullsized":"2024-01-17T22:59:07.475472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:59:07.405202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.467824+0000","last_change":"2024-01-17T22:58:49.383079+0000","last_active":"2024-01-17T22:59:07.467824+0000","last_peered":"2024-01-17T22:59:07.467824+0000","last_clean":"2024-01-17T22:59:07.467824+0000","last_became_active":"2024-01-17T22:58:49.382454+0000","last_became_peered":"2024-01-17T22:58:49.382454+0000","last_unstale":"2024-01-17T22:59:07.467824+0000","last_undegraded":"2024-01-17T22:59:07.467824+0000","last_fullsized":"2024-01-17T22:59:07.467824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:48.465209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.468799+0000","last_change":"2024-01-17T22:58:49.366078+0000","last_active":"2024-01-17T22:59:07.468799+0000","last_peered":"2024-01-17T22:59:07.468799+0000","last_clean":"2024-01-17T22:59:07.468799+0000","last_became_active":"2024-01-17T22:58:49.364509+0000","last_became_peered":"2024-01-17T22:58:49.364509+0000","last_unstale":"2024-01-17T22:59:07.468799+0000","last_undegraded":"2024-01-17T22:59:07.468799+0000","last_fullsized":"2024-01-17T22:59:07.468799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:44.036981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471836+0000","last_change":"2024-01-17T22:58:49.518204+0000","last_active":"2024-01-17T22:59:07.471836+0000","last_peered":"2024-01-17T22:59:07.471836+0000","last_clean":"2024-01-17T22:59:07.471836+0000","last_became_active":"2024-01-17T22:58:49.517927+0000","last_became_peered":"2024-01-17T22:58:49.517927+0000","last_unstale":"2024-01-17T22:59:07.471836+0000","last_undegraded":"2024-01-17T22:59:07.471836+0000","last_fullsized":"2024-01-17T22:59:07.471836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:04:38.588573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472056+0000","last_change":"2024-01-17T22:58:49.364080+0000","last_active":"2024-01-17T22:59:07.472056+0000","last_peered":"2024-01-17T22:59:07.472056+0000","last_clean":"2024-01-17T22:59:07.472056+0000","last_became_active":"2024-01-17T22:58:49.363804+0000","last_became_peered":"2024-01-17T22:58:49.363804+0000","last_unstale":"2024-01-17T22:59:07.472056+0000","last_undegraded":"2024-01-17T22:59:07.472056+0000","last_fullsized":"2024-01-17T22:59:07.472056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:59:07.405202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472789+0000","last_change":"2024-01-17T22:58:49.352782+0000","last_active":"2024-01-17T22:59:07.472789+0000","last_peered":"2024-01-17T22:59:07.472789+0000","last_clean":"2024-01-17T22:59:07.472789+0000","last_became_active":"2024-01-17T22:58:49.352513+0000","last_became_peered":"2024-01-17T22:58:49.352513+0000","last_unstale":"2024-01-17T22:59:07.472789+0000","last_undegraded":"2024-01-17T22:59:07.472789+0000","last_fullsized":"2024-01-17T22:59:07.472789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:39:54.814019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.479431+0000","last_change":"2024-01-17T22:58:49.519775+0000","last_active":"2024-01-17T22:59:07.479431+0000","last_peered":"2024-01-17T22:59:07.479431+0000","last_clean":"2024-01-17T22:59:07.479431+0000","last_became_active":"2024-01-17T22:58:49.518646+0000","last_became_peered":"2024-01-17T22:58:49.518646+0000","last_unstale":"2024-01-17T22:59:07.479431+0000","last_undegraded":"2024-01-17T22:59:07.479431+0000","last_fullsized":"2024-01-17T22:59:07.479431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475321+0000","last_change":"2024-01-17T22:58:49.349737+0000","last_active":"2024-01-17T22:59:07.475321+0000","last_peered":"2024-01-17T22:59:07.475321+0000","last_clean":"2024-01-17T22:59:07.475321+0000","last_became_active":"2024-01-17T22:58:49.349021+0000","last_became_peered":"2024-01-17T22:58:49.349021+0000","last_unstale":"2024-01-17T22:59:07.475321+0000","last_undegraded":"2024-01-17T22:59:07.475321+0000","last_fullsized":"2024-01-17T22:59:07.475321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:42:24.949957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471093+0000","last_change":"2024-01-17T22:58:49.415068+0000","last_active":"2024-01-17T22:59:07.471093+0000","last_peered":"2024-01-17T22:59:07.471093+0000","last_clean":"2024-01-17T22:59:07.471093+0000","last_became_active":"2024-01-17T22:58:49.414856+0000","last_became_peered":"2024-01-17T22:58:49.414856+0000","last_unstale":"2024-01-17T22:59:07.471093+0000","last_undegraded":"2024-01-17T22:59:07.471093+0000","last_fullsized":"2024-01-17T22:59:07.471093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:02:07.535209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.475704+0000","last_change":"2024-01-17T22:58:49.414783+0000","last_active":"2024-01-17T22:59:07.475704+0000","last_peered":"2024-01-17T22:59:07.475704+0000","last_clean":"2024-01-17T22:59:07.475704+0000","last_became_active":"2024-01-17T22:58:49.414446+0000","last_became_peered":"2024-01-17T22:58:49.414446+0000","last_unstale":"2024-01-17T22:59:07.475704+0000","last_undegraded":"2024-01-17T22:59:07.475704+0000","last_fullsized":"2024-01-17T22:59:07.475704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.471424+0000","last_change":"2024-01-17T22:58:49.357264+0000","last_active":"2024-01-17T22:59:07.471424+0000","last_peered":"2024-01-17T22:59:07.471424+0000","last_clean":"2024-01-17T22:59:07.471424+0000","last_became_active":"2024-01-17T22:58:49.357085+0000","last_became_peered":"2024-01-17T22:58:49.357085+0000","last_unstale":"2024-01-17T22:59:07.471424+0000","last_undegraded":"2024-01-17T22:59:07.471424+0000","last_fullsized":"2024-01-17T22:59:07.471424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:13:09.466879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476340+0000","last_change":"2024-01-17T22:58:49.414726+0000","last_active":"2024-01-17T22:59:07.476340+0000","last_peered":"2024-01-17T22:59:07.476340+0000","last_clean":"2024-01-17T22:59:07.476340+0000","last_became_active":"2024-01-17T22:58:49.414490+0000","last_became_peered":"2024-01-17T22:58:49.414490+0000","last_unstale":"2024-01-17T22:59:07.476340+0000","last_undegraded":"2024-01-17T22:59:07.476340+0000","last_fullsized":"2024-01-17T22:59:07.476340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:48.465209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.476613+0000","last_change":"2024-01-17T22:58:49.413155+0000","last_active":"2024-01-17T22:59:07.476613+0000","last_peered":"2024-01-17T22:59:07.476613+0000","last_clean":"2024-01-17T22:59:07.476613+0000","last_became_active":"2024-01-17T22:58:49.412382+0000","last_became_peered":"2024-01-17T22:58:49.412382+0000","last_unstale":"2024-01-17T22:59:07.476613+0000","last_undegraded":"2024-01-17T22:59:07.476613+0000","last_fullsized":"2024-01-17T22:59:07.476613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:04:38.588573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.477075+0000","last_change":"2024-01-17T22:58:49.368686+0000","last_active":"2024-01-17T22:59:07.477075+0000","last_peered":"2024-01-17T22:59:07.477075+0000","last_clean":"2024-01-17T22:59:07.477075+0000","last_became_active":"2024-01-17T22:58:49.367979+0000","last_became_peered":"2024-01-17T22:58:49.367979+0000","last_unstale":"2024-01-17T22:59:07.477075+0000","last_undegraded":"2024-01-17T22:59:07.477075+0000","last_fullsized":"2024-01-17T22:59:07.477075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:02:12.309297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-17T22:59:07.472963+0000","last_change":"2024-01-17T22:58:49.364561+0000","last_active":"2024-01-17T22:59:07.472963+0000","last_peered":"2024-01-17T22:59:07.472963+0000","last_clean":"2024-01-17T22:59:07.472963+0000","last_became_active":"2024-01-17T22:58:49.363810+0000","last_became_peered":"2024-01-17T22:58:49.363810+0000","last_unstale":"2024-01-17T22:59:07.472963+0000","last_undegraded":"2024-01-17T22:59:07.472963+0000","last_fullsized":"2024-01-17T22:59:07.472963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:02:12.309297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7451,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66578,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509460,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":121842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.97899999999999998}]},{"osd":1,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.83399999999999996}]},{"osd":2,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.79200000000000004}]},{"osd":3,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":1.042}]},{"osd":4,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.097},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.95099999999999996}]},{"osd":5,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.194}]},{"osd":6,"last update":"Wed Jan 17 22:59:19 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.0189999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":122138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.56499999999999995}]},{"osd":1,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":1.079},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.51000000000000001}]},{"osd":2,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.96499999999999997}]},{"osd":4,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":1.008}]},{"osd":5,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.1160000000000001}]},{"osd":7,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.375}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":126343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.036},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.436}]},{"osd":1,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.76900000000000002}]},{"osd":2,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.91900000000000004}]},{"osd":3,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.96599999999999997}]},{"osd":5,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.47599999999999998}]},{"osd":6,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.121}]},{"osd":7,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.155}]}]},{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":122160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.316},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.46800000000000003}]},{"osd":1,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.54900000000000004}]},{"osd":2,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.505},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.60399999999999998}]},{"osd":4,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.58899999999999997}]},{"osd":5,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.88},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.51600000000000001}]},{"osd":6,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.63900000000000001}]},{"osd":7,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.74199999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":124809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":1.004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.85099999999999998}]},{"osd":1,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":1.5429999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.0649999999999999}]},{"osd":3,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.044}]},{"osd":4,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.0309999999999999}]},{"osd":5,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.351},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.1819999999999999}]},{"osd":6,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.242},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.3939999999999999}]},{"osd":7,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.212},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.415}]}]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":711462,"data_compressed":33289,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.9910000000000001,"5min":2.9910000000000001,"15min":2.9910000000000001},"last":0.79800000000000004}]},{"osd":2,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.435},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.54300000000000004}]},{"osd":3,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.495},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":3.383,"5min":3.383,"15min":3.383},"last":0.59599999999999997}]},{"osd":4,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.60899999999999999}]},{"osd":5,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.77700000000000002}]},{"osd":6,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":0.63},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.69899999999999995}]},{"osd":7,"last update":"Wed Jan 17 22:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.76600000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":122250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.443}]},{"osd":2,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2,"5min":2,"15min":2},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.36399999999999999}]},{"osd":3,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.46800000000000003}]},{"osd":4,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.82199999999999995}]},{"osd":6,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.748}]},{"osd":7,"last update":"Wed Jan 17 22:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.62}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":380928,"data_stored":712106,"data_compressed":33289,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.73499999999999999}]},{"osd":1,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.94499999999999995}]},{"osd":2,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.028}]},{"osd":3,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.81000000000000005}]},{"osd":4,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.115}]},{"osd":6,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.089},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.236}]},{"osd":7,"last update":"Wed Jan 17 22:59:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.304},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33289,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33289,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-17T22:59:39.240 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-17T22:59:39.240 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-17T22:59:39.241 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-17T22:59:39.241 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-17T22:59:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.420+0000 7ffa67000640 1 Processor -- start 2024-01-17T22:59:39.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.420+0000 7ffa67000640 1 -- start start 2024-01-17T22:59:39.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.420+0000 7ffa67000640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ffa600ca2f0 0x7ffa60159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:39.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.420+0000 7ffa67000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa60159c40 con 0x7ffa60153780 2024-01-17T22:59:39.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.420+0000 7ffa67000640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa60159f20 con 0x7ffa6015d410 2024-01-17T22:59:39.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.420+0000 7ffa67000640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa60153b60 con 0x7ffa600ca2f0 2024-01-17T22:59:39.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.420+0000 7ffa5fe00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ffa60153780 0x7ffa6006c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38612/0 (socket says 172.21.15.161:38612) 2024-01-17T22:59:39.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.420+0000 7ffa5fe00640 1 -- 172.21.15.161:0/3562196797 learned_addr learned my addr 172.21.15.161:0/3562196797 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:39.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.420+0000 7ffa5f400640 1 --2- 172.21.15.161:0/3562196797 >> v2:172.21.15.190:3300/0 conn(0x7ffa600ca2f0 0x7ffa60159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:39.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.424+0000 7ffa5ea00640 1 -- 172.21.15.161:0/3562196797 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182100350 0 0) 0x7ffa60159c40 con 0x7ffa60153780 2024-01-17T22:59:39.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.424+0000 7ffa5ea00640 1 -- 172.21.15.161:0/3562196797 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa40003530 con 0x7ffa60153780 2024-01-17T22:59:39.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.428+0000 7ffa5ea00640 1 -- 172.21.15.161:0/3562196797 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1247608254 0 0) 0x7ffa40003530 con 0x7ffa60153780 2024-01-17T22:59:39.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.428+0000 7ffa5ea00640 1 -- 172.21.15.161:0/3562196797 >> v2:172.21.15.190:3300/0 conn(0x7ffa600ca2f0 msgr2=0x7ffa60159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:39.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.428+0000 7ffa5ea00640 1 --2- 172.21.15.161:0/3562196797 >> v2:172.21.15.190:3300/0 conn(0x7ffa600ca2f0 0x7ffa60159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:39.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.428+0000 7ffa5ea00640 1 -- 172.21.15.161:0/3562196797 >> v1:172.21.15.190:6789/0 conn(0x7ffa6015d410 legacy=0x7ffa60070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:39.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.428+0000 7ffa5ea00640 1 -- 172.21.15.161:0/3562196797 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6015a200 con 0x7ffa60153780 2024-01-17T22:59:39.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.428+0000 7ffa5ea00640 1 -- 172.21.15.161:0/3562196797 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7ffa50001680 con 0x7ffa60153780 2024-01-17T22:59:39.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.428+0000 7ffa5ea00640 1 -- 172.21.15.161:0/3562196797 >> v1:172.21.15.161:6789/0 conn(0x7ffa60153780 legacy=0x7ffa6006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:39.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.428+0000 7ffa5ea00640 1 --2- 172.21.15.161:0/3562196797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa400039d0 0x7ffa40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:39.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.428+0000 7ffa5ea00640 1 --2- 172.21.15.161:0/3562196797 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa400047d0 0x7ffa40004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:39.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.428+0000 7ffa5ea00640 1 --2- 172.21.15.161:0/3562196797 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa40005190 0x7ffa4000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:39.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.428+0000 7ffa5ea00640 1 -- 172.21.15.161:0/3562196797 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60153b60 con 0x7ffa400039d0 2024-01-17T22:59:39.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.428+0000 7ffa5ea00640 1 -- 172.21.15.161:0/3562196797 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4000c040 con 0x7ffa40005190 2024-01-17T22:59:39.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.428+0000 7ffa5ea00640 1 -- 172.21.15.161:0/3562196797 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4000c200 con 0x7ffa400047d0 2024-01-17T22:59:39.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.428+0000 7ffa5f400640 1 --2- 172.21.15.161:0/3562196797 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa400047d0 0x7ffa40004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:39.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.428+0000 7ffa5fe00640 1 --2- 172.21.15.161:0/3562196797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa400039d0 0x7ffa40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:39.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.432+0000 7ffa5fe00640 1 -- 172.21.15.161:0/3562196797 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa400047d0 msgr2=0x7ffa40004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:39.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.432+0000 7ffa5fe00640 1 --2- 172.21.15.161:0/3562196797 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa400047d0 0x7ffa40004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:39.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.432+0000 7ffa5fe00640 1 -- 172.21.15.161:0/3562196797 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa40005190 msgr2=0x7ffa4000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:39.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.432+0000 7ffa5fe00640 1 --2- 172.21.15.161:0/3562196797 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa40005190 0x7ffa4000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:39.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.432+0000 7ffa5fe00640 1 -- 172.21.15.161:0/3562196797 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa40003530 con 0x7ffa400039d0 2024-01-17T22:59:39.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.432+0000 7ffa65000640 1 -- 172.21.15.161:0/3562196797 reap_dead start 2024-01-17T22:59:39.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.436+0000 7ffa5fe00640 1 --2- 172.21.15.161:0/3562196797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa400039d0 0x7ffa40003dd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000c190 tx=0x7ffa5001f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b4555e4bd32588 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:39.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.440+0000 7ffa5ea00640 1 -- 172.21.15.161:0/3562196797 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa50005ae0 con 0x7ffa400039d0 2024-01-17T22:59:39.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.440+0000 7ffa5ea00640 1 -- 172.21.15.161:0/3562196797 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa500ab070 con 0x7ffa400039d0 2024-01-17T22:59:39.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.440+0000 7ffa5ea00640 1 -- 172.21.15.161:0/3562196797 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa50007070 con 0x7ffa400039d0 2024-01-17T22:59:39.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.440+0000 7ffa67000640 1 -- 172.21.15.161:0/3562196797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa400039d0 msgr2=0x7ffa40003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:39.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.440+0000 7ffa67000640 1 --2- 172.21.15.161:0/3562196797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa400039d0 0x7ffa40003dd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000c190 tx=0x7ffa5001f370 comp rx=0 tx=0).stop 2024-01-17T22:59:39.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.440+0000 7ffa67000640 1 -- 172.21.15.161:0/3562196797 shutdown_connections 2024-01-17T22:59:39.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.440+0000 7ffa67000640 1 --2- 172.21.15.161:0/3562196797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa400039d0 0x7ffa40003dd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:39.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.440+0000 7ffa67000640 1 -- 172.21.15.161:0/3562196797 >> 172.21.15.161:0/3562196797 conn(0x7ffa60070390 msgr2=0x7ffa6006f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:39.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.440+0000 7ffa67000640 1 -- 172.21.15.161:0/3562196797 shutdown_connections 2024-01-17T22:59:39.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.440+0000 7ffa67000640 1 -- 172.21.15.161:0/3562196797 wait complete. 2024-01-17T22:59:39.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.444+0000 7ffa67000640 1 Processor -- start 2024-01-17T22:59:39.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.444+0000 7ffa67000640 1 -- start start 2024-01-17T22:59:39.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.444+0000 7ffa67000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa400039d0 0x7ffa6014ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:39.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.444+0000 7ffa67000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa600af0f0 0x7ffa600af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:39.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.444+0000 7ffa67000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa600b1020 0x7ffa600b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:39.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.444+0000 7ffa67000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60159340 con 0x7ffa600b1020 2024-01-17T22:59:39.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.444+0000 7ffa67000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa601f08b0 con 0x7ffa600af0f0 2024-01-17T22:59:39.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.444+0000 7ffa67000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600b2150 con 0x7ffa400039d0 2024-01-17T22:59:39.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.444+0000 7ffa65000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa600b1020 0x7ffa600b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:39.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.444+0000 7ffa65000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa600b1020 0x7ffa600b14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60710/0 (socket says 172.21.15.161:60710) 2024-01-17T22:59:39.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.444+0000 7ffa65000640 1 -- 172.21.15.161:0/922591666 learned_addr learned my addr 172.21.15.161:0/922591666 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:39.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.444+0000 7ffa5f400640 1 --2- 172.21.15.161:0/922591666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa600af0f0 0x7ffa600af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:39.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.444+0000 7ffa5fe00640 1 --2- 172.21.15.161:0/922591666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa400039d0 0x7ffa6014ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:39.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.448+0000 7ffa65000640 1 -- 172.21.15.161:0/922591666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa400039d0 msgr2=0x7ffa6014ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:39.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.448+0000 7ffa65000640 1 --2- 172.21.15.161:0/922591666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa400039d0 0x7ffa6014ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:39.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.448+0000 7ffa65000640 1 -- 172.21.15.161:0/922591666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa600af0f0 msgr2=0x7ffa600af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:39.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.448+0000 7ffa65000640 1 --2- 172.21.15.161:0/922591666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa600af0f0 0x7ffa600af570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:39.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.448+0000 7ffa65000640 1 -- 172.21.15.161:0/922591666 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa601f0b50 con 0x7ffa600b1020 2024-01-17T22:59:39.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.452+0000 7ffa65000640 1 --2- 172.21.15.161:0/922591666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa600b1020 0x7ffa600b14a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffa600b2670 tx=0x7ffa5800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:39.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.456+0000 7ffa57e00640 1 -- 172.21.15.161:0/922591666 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa580070d0 con 0x7ffa600b1020 2024-01-17T22:59:39.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.456+0000 7ffa57e00640 1 -- 172.21.15.161:0/922591666 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa58007250 con 0x7ffa600b1020 2024-01-17T22:59:39.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.456+0000 7ffa57e00640 1 -- 172.21.15.161:0/922591666 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa58007600 con 0x7ffa600b1020 2024-01-17T22:59:39.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.456+0000 7ffa67000640 1 -- 172.21.15.161:0/922591666 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa60159590 con 0x7ffa600b1020 2024-01-17T22:59:39.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.456+0000 7ffa67000640 1 -- 172.21.15.161:0/922591666 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa600b2410 con 0x7ffa600b1020 2024-01-17T22:59:39.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.460+0000 7ffa67000640 1 -- 172.21.15.161:0/922591666 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6006f1c0 con 0x7ffa600b1020 2024-01-17T22:59:39.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.480+0000 7ffa57e00640 1 -- 172.21.15.161:0/922591666 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7ffa58007760 con 0x7ffa600b1020 2024-01-17T22:59:39.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.484+0000 7ffa57e00640 1 --2- 172.21.15.161:0/922591666 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7ffa38066890 0x7ffa38068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:39.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.484+0000 7ffa5fe00640 1 --2- 172.21.15.161:0/922591666 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7ffa38066890 0x7ffa38068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:39.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.484+0000 7ffa5fe00640 1 --2- 172.21.15.161:0/922591666 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7ffa38066890 0x7ffa38068d50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffa500af000 tx=0x7ffa500aa000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:39.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.484+0000 7ffa57e00640 1 -- 172.21.15.161:0/922591666 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7ffa58054930 con 0x7ffa600b1020 2024-01-17T22:59:39.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.716+0000 7ffa57e00640 1 -- 172.21.15.161:0/922591666 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7ffa58050c70 con 0x7ffa600b1020 2024-01-17T22:59:39.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.900+0000 7ffa67000640 1 -- 172.21.15.161:0/922591666 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ffa600746a0 con 0x7ffa600b1020 2024-01-17T22:59:39.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.908+0000 7ffa57e00640 1 -- 172.21.15.161:0/922591666 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ffa58017080 con 0x7ffa600b1020 2024-01-17T22:59:39.905 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:39.905 INFO:teuthology.orchestra.run.smithi161.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-17T22:59:39.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.908+0000 7ffa67000640 1 -- 172.21.15.161:0/922591666 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7ffa38066890 msgr2=0x7ffa38068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:39.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.908+0000 7ffa67000640 1 --2- 172.21.15.161:0/922591666 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7ffa38066890 0x7ffa38068d50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffa500af000 tx=0x7ffa500aa000 comp rx=0 tx=0).stop 2024-01-17T22:59:39.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.908+0000 7ffa67000640 1 -- 172.21.15.161:0/922591666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa600b1020 msgr2=0x7ffa600b14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:39.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.908+0000 7ffa67000640 1 --2- 172.21.15.161:0/922591666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa600b1020 0x7ffa600b14a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffa600b2670 tx=0x7ffa5800c8a0 comp rx=0 tx=0).stop 2024-01-17T22:59:39.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.908+0000 7ffa67000640 1 -- 172.21.15.161:0/922591666 shutdown_connections 2024-01-17T22:59:39.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.908+0000 7ffa67000640 1 --2- 172.21.15.161:0/922591666 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7ffa38066890 0x7ffa38068d50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:39.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.908+0000 7ffa67000640 1 --2- 172.21.15.161:0/922591666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa600af0f0 0x7ffa600af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:39.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.908+0000 7ffa67000640 1 --2- 172.21.15.161:0/922591666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa600b1020 0x7ffa600b14a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:39.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.908+0000 7ffa67000640 1 --2- 172.21.15.161:0/922591666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa400039d0 0x7ffa6014ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:39.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.908+0000 7ffa67000640 1 -- 172.21.15.161:0/922591666 >> 172.21.15.161:0/922591666 conn(0x7ffa60070390 msgr2=0x7ffa60151d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:39.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.908+0000 7ffa67000640 1 -- 172.21.15.161:0/922591666 shutdown_connections 2024-01-17T22:59:39.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:39.908+0000 7ffa67000640 1 -- 172.21.15.161:0/922591666 wait complete. 2024-01-17T22:59:39.927 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-17T22:59:39.927 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T22:59:40.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.064+0000 7fecdac00640 1 Processor -- start 2024-01-17T22:59:40.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.064+0000 7fecdac00640 1 -- start start 2024-01-17T22:59:40.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.064+0000 7fecdac00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fecd4151850 0x7fecd40aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:40.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.064+0000 7fecdac00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fecd40c9770 0x7fecd406aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:40.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.064+0000 7fecdac00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd4151c30 con 0x7fecd40af2e0 2024-01-17T22:59:40.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.064+0000 7fecdac00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd415b890 con 0x7fecd40c9770 2024-01-17T22:59:40.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.064+0000 7fecdac00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd415ad10 con 0x7fecd4151850 2024-01-17T22:59:40.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.064+0000 7fecd9600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fecd40c9770 0x7fecd406aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:40.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.068+0000 7fecd9600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fecd40c9770 0x7fecd406aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60720/0 (socket says 172.21.15.161:60720) 2024-01-17T22:59:40.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.068+0000 7fecd9600640 1 -- 172.21.15.161:0/3228486940 learned_addr learned my addr 172.21.15.161:0/3228486940 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:40.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.068+0000 7fecd3e00640 1 --2- 172.21.15.161:0/3228486940 >> v2:172.21.15.190:3300/0 conn(0x7fecd4151850 0x7fecd40aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:40.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.068+0000 7fecd9600640 1 -- 172.21.15.161:0/3228486940 >> v2:172.21.15.190:3300/0 conn(0x7fecd4151850 msgr2=0x7fecd40aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:40.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.068+0000 7fecd9600640 1 --2- 172.21.15.161:0/3228486940 >> v2:172.21.15.190:3300/0 conn(0x7fecd4151850 0x7fecd40aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:40.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.068+0000 7fecd9600640 1 -- 172.21.15.161:0/3228486940 >> v1:172.21.15.161:6789/0 conn(0x7fecd40af2e0 legacy=0x7fecd40c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:40.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.068+0000 7fecd9600640 1 -- 172.21.15.161:0/3228486940 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd415aff0 con 0x7fecd40c9770 2024-01-17T22:59:40.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.076+0000 7fecd9600640 1 --2- 172.21.15.161:0/3228486940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecd40c9770 0x7fecd406aca0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fecd4071600 tx=0x7feccc01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae32d24b5c502c33 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:40.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.076+0000 7fecd2a00640 1 -- 172.21.15.161:0/3228486940 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc0af400 con 0x7fecd40c9770 2024-01-17T22:59:40.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.076+0000 7fecd2a00640 1 -- 172.21.15.161:0/3228486940 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc0ab050 con 0x7fecd40c9770 2024-01-17T22:59:40.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.076+0000 7fecd2a00640 1 -- 172.21.15.161:0/3228486940 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc0af780 con 0x7fecd40c9770 2024-01-17T22:59:40.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.080+0000 7fecdac00640 1 -- 172.21.15.161:0/3228486940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecd40c9770 msgr2=0x7fecd406aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:40.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.080+0000 7fecdac00640 1 --2- 172.21.15.161:0/3228486940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecd40c9770 0x7fecd406aca0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fecd4071600 tx=0x7feccc01f1c0 comp rx=0 tx=0).stop 2024-01-17T22:59:40.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.080+0000 7fecdac00640 1 -- 172.21.15.161:0/3228486940 shutdown_connections 2024-01-17T22:59:40.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.080+0000 7fecdac00640 1 --2- 172.21.15.161:0/3228486940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecd40c9770 0x7fecd406aca0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:40.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.080+0000 7fecdac00640 1 --2- 172.21.15.161:0/3228486940 >> v2:172.21.15.190:3300/0 conn(0x7fecd4151850 0x7fecd40aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:40.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.080+0000 7fecdac00640 1 -- 172.21.15.161:0/3228486940 >> 172.21.15.161:0/3228486940 conn(0x7fecd40705c0 msgr2=0x7fecd40709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:40.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.080+0000 7fecdac00640 1 -- 172.21.15.161:0/3228486940 shutdown_connections 2024-01-17T22:59:40.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.080+0000 7fecdac00640 1 -- 172.21.15.161:0/3228486940 wait complete. 2024-01-17T22:59:40.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.080+0000 7fecdac00640 1 Processor -- start 2024-01-17T22:59:40.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.080+0000 7fecdac00640 1 -- start start 2024-01-17T22:59:40.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.080+0000 7fecdac00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fecd40af2e0 0x7fecd414ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:40.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.080+0000 7fecdac00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecd40c9770 0x7fecd40b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:40.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.080+0000 7fecdac00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fecd4151850 0x7fecd4146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:40.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.080+0000 7fecdac00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd41ecd10 con 0x7fecd40c9770 2024-01-17T22:59:40.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.080+0000 7fecdac00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd41526e0 con 0x7fecd4151850 2024-01-17T22:59:40.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.080+0000 7fecdac00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd41529a0 con 0x7fecd40af2e0 2024-01-17T22:59:40.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.084+0000 7fecd3400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecd40c9770 0x7fecd40b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:40.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.084+0000 7fecd3400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecd40c9770 0x7fecd40b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60734/0 (socket says 172.21.15.161:60734) 2024-01-17T22:59:40.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.084+0000 7fecd3400640 1 -- 172.21.15.161:0/3031112512 learned_addr learned my addr 172.21.15.161:0/3031112512 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:40.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.084+0000 7fecd9600640 1 --2- 172.21.15.161:0/3031112512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fecd4151850 0x7fecd4146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:40.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.084+0000 7fecd3e00640 1 --2- 172.21.15.161:0/3031112512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fecd40af2e0 0x7fecd414ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:40.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.088+0000 7fecd3400640 1 -- 172.21.15.161:0/3031112512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fecd40af2e0 msgr2=0x7fecd414ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:40.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.088+0000 7fecd3400640 1 --2- 172.21.15.161:0/3031112512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fecd40af2e0 0x7fecd414ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:40.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.088+0000 7fecd3400640 1 -- 172.21.15.161:0/3031112512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fecd4151850 msgr2=0x7fecd4146e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:40.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.088+0000 7fecd3400640 1 --2- 172.21.15.161:0/3031112512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fecd4151850 0x7fecd4146e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:40.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.088+0000 7fecd3400640 1 -- 172.21.15.161:0/3031112512 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc009b30 con 0x7fecd40c9770 2024-01-17T22:59:40.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.088+0000 7fecd3400640 1 --2- 172.21.15.161:0/3031112512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecd40c9770 0x7fecd40b1c00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00c420 tx=0x7fecbc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:40.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.092+0000 7feccbe00640 1 -- 172.21.15.161:0/3031112512 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0052d0 con 0x7fecd40c9770 2024-01-17T22:59:40.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.092+0000 7fecdac00640 1 -- 172.21.15.161:0/3031112512 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd41ecf20 con 0x7fecd40c9770 2024-01-17T22:59:40.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.092+0000 7fecdac00640 1 -- 172.21.15.161:0/3031112512 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd414f1b0 con 0x7fecd40c9770 2024-01-17T22:59:40.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.092+0000 7fecdac00640 1 -- 172.21.15.161:0/3031112512 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd41ed720 con 0x7fecd40c9770 2024-01-17T22:59:40.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.092+0000 7feccbe00640 1 -- 172.21.15.161:0/3031112512 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc005430 con 0x7fecd40c9770 2024-01-17T22:59:40.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.092+0000 7feccbe00640 1 -- 172.21.15.161:0/3031112512 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0011b0 con 0x7fecd40c9770 2024-01-17T22:59:40.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.344+0000 7feccbe00640 1 -- 172.21.15.161:0/3031112512 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fecbc007240 con 0x7fecd40c9770 2024-01-17T22:59:40.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.344+0000 7feccbe00640 1 --2- 172.21.15.161:0/3031112512 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fecac066840 0x7fecac068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:40.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.344+0000 7fecd3e00640 1 --2- 172.21.15.161:0/3031112512 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fecac066840 0x7fecac068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:40.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.348+0000 7fecd3e00640 1 --2- 172.21.15.161:0/3031112512 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fecac066840 0x7fecac068d00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009ac0 tx=0x7fecc4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:40.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.356+0000 7feccbe00640 1 -- 172.21.15.161:0/3031112512 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fecbc054b40 con 0x7fecd40c9770 2024-01-17T22:59:40.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.356+0000 7feccbe00640 1 -- 172.21.15.161:0/3031112512 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fecbc050e80 con 0x7fecd40c9770 2024-01-17T22:59:40.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.516+0000 7fecdac00640 1 -- 172.21.15.161:0/3031112512 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecd41ed720 con 0x7fecd40c9770 2024-01-17T22:59:40.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.556+0000 7feccbe00640 1 -- 172.21.15.161:0/3031112512 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18587 (secure 0 0 0) 0x7fecd41ed720 con 0x7fecd40c9770 2024-01-17T22:59:40.554 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:40.554 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":28,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:59:08.571619+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T22:58:46.757110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T22:58:47.930512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T22:58:53.561624+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.614036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.746767+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.689096+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.706485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.628004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.680048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.571249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]},{"pgid":"4.14","mappings":[{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:59:40.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.560+0000 7fecdac00640 1 -- 172.21.15.161:0/3031112512 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fecac066840 msgr2=0x7fecac068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:40.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.560+0000 7fecdac00640 1 --2- 172.21.15.161:0/3031112512 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fecac066840 0x7fecac068d00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009ac0 tx=0x7fecc4009190 comp rx=0 tx=0).stop 2024-01-17T22:59:40.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.560+0000 7fecdac00640 1 -- 172.21.15.161:0/3031112512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecd40c9770 msgr2=0x7fecd40b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:40.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.560+0000 7fecdac00640 1 --2- 172.21.15.161:0/3031112512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecd40c9770 0x7fecd40b1c00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00c420 tx=0x7fecbc00c8e0 comp rx=0 tx=0).stop 2024-01-17T22:59:40.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.560+0000 7fecdac00640 1 -- 172.21.15.161:0/3031112512 shutdown_connections 2024-01-17T22:59:40.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.560+0000 7fecdac00640 1 --2- 172.21.15.161:0/3031112512 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fecac066840 0x7fecac068d00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:40.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.560+0000 7fecdac00640 1 --2- 172.21.15.161:0/3031112512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fecd4151850 0x7fecd4146e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:40.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.560+0000 7fecdac00640 1 --2- 172.21.15.161:0/3031112512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecd40c9770 0x7fecd40b1c00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:40.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.560+0000 7fecdac00640 1 --2- 172.21.15.161:0/3031112512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fecd40af2e0 0x7fecd414ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:40.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.560+0000 7fecdac00640 1 -- 172.21.15.161:0/3031112512 >> 172.21.15.161:0/3031112512 conn(0x7fecd40705c0 msgr2=0x7fecd406f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:40.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.560+0000 7fecdac00640 1 -- 172.21.15.161:0/3031112512 shutdown_connections 2024-01-17T22:59:40.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.560+0000 7fecdac00640 1 -- 172.21.15.161:0/3031112512 wait complete. 2024-01-17T22:59:40.577 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-17T22:58:14.876386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-17T22:58:46.757110+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-17T22:58:47.930512+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-17T22:58:53.561624+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-17T22:59:40.577 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-17T22:59:40.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.720+0000 7fc50d800640 1 Processor -- start 2024-01-17T22:59:40.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.720+0000 7fc50d800640 1 -- start start 2024-01-17T22:59:40.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.720+0000 7fc50d800640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc5080c6780 0x7fc5080c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:40.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.720+0000 7fc50d800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc5080b0640 0x7fc5080b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:40.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.720+0000 7fc50d800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5080c5cc0 con 0x7fc5081516c0 2024-01-17T22:59:40.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.720+0000 7fc50d800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc508158410 con 0x7fc5080b0640 2024-01-17T22:59:40.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.720+0000 7fc50d800640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5081573c0 con 0x7fc5080c6780 2024-01-17T22:59:40.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.724+0000 7fc507400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc5080b0640 0x7fc5080b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:40.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.724+0000 7fc507400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc5080b0640 0x7fc5080b0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60736/0 (socket says 172.21.15.161:60736) 2024-01-17T22:59:40.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.724+0000 7fc507400640 1 -- 172.21.15.161:0/1433707678 learned_addr learned my addr 172.21.15.161:0/1433707678 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:40.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.724+0000 7fc506000640 1 --2- 172.21.15.161:0/1433707678 >> v2:172.21.15.190:3300/0 conn(0x7fc5080c6780 0x7fc5080c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:40.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.724+0000 7fc507400640 1 -- 172.21.15.161:0/1433707678 >> v2:172.21.15.190:3300/0 conn(0x7fc5080c6780 msgr2=0x7fc5080c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:40.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.724+0000 7fc507400640 1 --2- 172.21.15.161:0/1433707678 >> v2:172.21.15.190:3300/0 conn(0x7fc5080c6780 0x7fc5080c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:40.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.724+0000 7fc507400640 1 -- 172.21.15.161:0/1433707678 >> v1:172.21.15.190:6789/0 conn(0x7fc5081516c0 legacy=0x7fc50806db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:40.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.724+0000 7fc507400640 1 -- 172.21.15.161:0/1433707678 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5081575b0 con 0x7fc5080b0640 2024-01-17T22:59:40.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.728+0000 7fc507400640 1 --2- 172.21.15.161:0/1433707678 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5080b0640 0x7fc5080b0a90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc508070e50 tx=0x7fc50001f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a316625518cca00c server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:40.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.732+0000 7fc505600640 1 -- 172.21.15.161:0/1433707678 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5000af400 con 0x7fc5080b0640 2024-01-17T22:59:40.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.732+0000 7fc505600640 1 -- 172.21.15.161:0/1433707678 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5000ab050 con 0x7fc5080b0640 2024-01-17T22:59:40.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.732+0000 7fc505600640 1 -- 172.21.15.161:0/1433707678 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5000af780 con 0x7fc5080b0640 2024-01-17T22:59:40.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.732+0000 7fc50d800640 1 -- 172.21.15.161:0/1433707678 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5080b0640 msgr2=0x7fc5080b0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:40.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.732+0000 7fc50d800640 1 --2- 172.21.15.161:0/1433707678 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5080b0640 0x7fc5080b0a90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc508070e50 tx=0x7fc50001f180 comp rx=0 tx=0).stop 2024-01-17T22:59:40.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.736+0000 7fc50d800640 1 -- 172.21.15.161:0/1433707678 shutdown_connections 2024-01-17T22:59:40.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.736+0000 7fc50d800640 1 --2- 172.21.15.161:0/1433707678 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5080b0640 0x7fc5080b0a90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:40.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.736+0000 7fc50d800640 1 --2- 172.21.15.161:0/1433707678 >> v2:172.21.15.190:3300/0 conn(0x7fc5080c6780 0x7fc5080c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:40.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.736+0000 7fc50d800640 1 -- 172.21.15.161:0/1433707678 >> 172.21.15.161:0/1433707678 conn(0x7fc5080c7a90 msgr2=0x7fc5080c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:40.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.736+0000 7fc50d800640 1 -- 172.21.15.161:0/1433707678 shutdown_connections 2024-01-17T22:59:40.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.736+0000 7fc50d800640 1 -- 172.21.15.161:0/1433707678 wait complete. 2024-01-17T22:59:40.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.736+0000 7fc50d800640 1 Processor -- start 2024-01-17T22:59:40.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.736+0000 7fc50d800640 1 -- start start 2024-01-17T22:59:40.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.736+0000 7fc50d800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5080b0640 0x7fc5081f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:40.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.736+0000 7fc50d800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5080c6780 0x7fc5081ef1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:40.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.736+0000 7fc50d800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5081516c0 0x7fc508156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:40.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.736+0000 7fc50d800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5081508c0 con 0x7fc5080b0640 2024-01-17T22:59:40.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.736+0000 7fc50d800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc508150ba0 con 0x7fc5081516c0 2024-01-17T22:59:40.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.736+0000 7fc50d800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc508150e80 con 0x7fc5080c6780 2024-01-17T22:59:40.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.736+0000 7fc506a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5080b0640 0x7fc5081f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:40.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.740+0000 7fc506a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5080b0640 0x7fc5081f32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60748/0 (socket says 172.21.15.161:60748) 2024-01-17T22:59:40.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.740+0000 7fc506a00640 1 -- 172.21.15.161:0/2985449899 learned_addr learned my addr 172.21.15.161:0/2985449899 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:40.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.740+0000 7fc506000640 1 --2- 172.21.15.161:0/2985449899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5080c6780 0x7fc5081ef1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:40.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.740+0000 7fc507400640 1 --2- 172.21.15.161:0/2985449899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5081516c0 0x7fc508156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:40.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.740+0000 7fc506a00640 1 -- 172.21.15.161:0/2985449899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5080c6780 msgr2=0x7fc5081ef1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:40.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.740+0000 7fc506a00640 1 --2- 172.21.15.161:0/2985449899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5080c6780 0x7fc5081ef1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:40.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.740+0000 7fc506a00640 1 -- 172.21.15.161:0/2985449899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5081516c0 msgr2=0x7fc508156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:40.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.740+0000 7fc506a00640 1 --2- 172.21.15.161:0/2985449899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5081516c0 0x7fc508156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:40.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.740+0000 7fc506a00640 1 -- 172.21.15.161:0/2985449899 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc500009b30 con 0x7fc5080b0640 2024-01-17T22:59:40.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.744+0000 7fc506a00640 1 --2- 172.21.15.161:0/2985449899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5080b0640 0x7fc5081f32f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800b3e0 tx=0x7fc4f800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:40.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.748+0000 7fc4fea00640 1 -- 172.21.15.161:0/2985449899 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8011830 con 0x7fc5080b0640 2024-01-17T22:59:40.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.748+0000 7fc50d800640 1 -- 172.21.15.161:0/2985449899 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5081f2830 con 0x7fc5080b0640 2024-01-17T22:59:40.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.748+0000 7fc50d800640 1 -- 172.21.15.161:0/2985449899 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5081f2df0 con 0x7fc5080b0640 2024-01-17T22:59:40.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.748+0000 7fc4fea00640 1 -- 172.21.15.161:0/2985449899 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f8009210 con 0x7fc5080b0640 2024-01-17T22:59:40.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.748+0000 7fc4fea00640 1 -- 172.21.15.161:0/2985449899 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8011b90 con 0x7fc5080b0640 2024-01-17T22:59:40.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.748+0000 7fc50d800640 1 -- 172.21.15.161:0/2985449899 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d80052a0 con 0x7fc5080b0640 2024-01-17T22:59:40.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.768+0000 7fc4fea00640 1 -- 172.21.15.161:0/2985449899 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fc4f8024440 con 0x7fc5080b0640 2024-01-17T22:59:40.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.768+0000 7fc4fea00640 1 --2- 172.21.15.161:0/2985449899 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc4e0066840 0x7fc4e0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:40.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.768+0000 7fc506000640 1 --2- 172.21.15.161:0/2985449899 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc4e0066840 0x7fc4e0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:40.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.768+0000 7fc506000640 1 --2- 172.21.15.161:0/2985449899 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc4e0066840 0x7fc4e0068d00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc5080c8230 tx=0x7fc4f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:40.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:40.772+0000 7fc4fea00640 1 -- 172.21.15.161:0/2985449899 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fc4f8055770 con 0x7fc5080b0640 2024-01-17T22:59:41.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.016+0000 7fc4fea00640 1 -- 172.21.15.161:0/2985449899 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fc4f8055540 con 0x7fc5080b0640 2024-01-17T22:59:41.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.172+0000 7fc50d800640 1 -- 172.21.15.161:0/2985449899 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc4d8005ad0 con 0x7fc5080b0640 2024-01-17T22:59:41.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.184+0000 7fc4fea00640 1 -- 172.21.15.161:0/2985449899 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc4f8015020 con 0x7fc5080b0640 2024-01-17T22:59:41.182 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-01-17T22:59:41.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.184+0000 7fc50d800640 1 -- 172.21.15.161:0/2985449899 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc4e0066840 msgr2=0x7fc4e0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:41.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.184+0000 7fc50d800640 1 --2- 172.21.15.161:0/2985449899 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc4e0066840 0x7fc4e0068d00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc5080c8230 tx=0x7fc4f0008040 comp rx=0 tx=0).stop 2024-01-17T22:59:41.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.184+0000 7fc50d800640 1 -- 172.21.15.161:0/2985449899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5080b0640 msgr2=0x7fc5081f32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:41.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.184+0000 7fc50d800640 1 --2- 172.21.15.161:0/2985449899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5080b0640 0x7fc5081f32f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800b3e0 tx=0x7fc4f800b8a0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.184+0000 7fc50d800640 1 -- 172.21.15.161:0/2985449899 shutdown_connections 2024-01-17T22:59:41.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.184+0000 7fc50d800640 1 --2- 172.21.15.161:0/2985449899 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc4e0066840 0x7fc4e0068d00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.184+0000 7fc50d800640 1 --2- 172.21.15.161:0/2985449899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5081516c0 0x7fc508156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.184+0000 7fc50d800640 1 --2- 172.21.15.161:0/2985449899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5080c6780 0x7fc5081ef1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.184+0000 7fc50d800640 1 --2- 172.21.15.161:0/2985449899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5080b0640 0x7fc5081f32f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.184+0000 7fc50d800640 1 -- 172.21.15.161:0/2985449899 >> 172.21.15.161:0/2985449899 conn(0x7fc5080c7a90 msgr2=0x7fc508146d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:41.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.184+0000 7fc50d800640 1 -- 172.21.15.161:0/2985449899 shutdown_connections 2024-01-17T22:59:41.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.188+0000 7fc50d800640 1 -- 172.21.15.161:0/2985449899 wait complete. 2024-01-17T22:59:41.204 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-17T22:59:41.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.351+0000 7fa18da00640 1 Processor -- start 2024-01-17T22:59:41.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.351+0000 7fa18da00640 1 -- start start 2024-01-17T22:59:41.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.351+0000 7fa18da00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa188070270 0x7fa1880ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:41.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.351+0000 7fa18da00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa1880cd510 0x7fa1880c2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:41.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.351+0000 7fa18da00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18815cc30 con 0x7fa188153920 2024-01-17T22:59:41.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.351+0000 7fa18da00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1880c2290 con 0x7fa1880cd510 2024-01-17T22:59:41.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.351+0000 7fa18da00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18815ce60 con 0x7fa188070270 2024-01-17T22:59:41.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.351+0000 7fa186a00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa188153920 0x7fa18806c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38630/0 (socket says 172.21.15.161:38630) 2024-01-17T22:59:41.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.351+0000 7fa186a00640 1 -- 172.21.15.161:0/1988850815 learned_addr learned my addr 172.21.15.161:0/1988850815 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:41.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.351+0000 7fa186000640 1 --2- 172.21.15.161:0/1988850815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa188070270 0x7fa1880ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:41.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.351+0000 7fa187400640 1 --2- 172.21.15.161:0/1988850815 >> v2:172.21.15.190:3300/0 conn(0x7fa1880cd510 0x7fa1880c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:41.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.355+0000 7fa185600640 1 -- 172.21.15.161:0/1988850815 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219298368 0 0) 0x7fa18815cc30 con 0x7fa188153920 2024-01-17T22:59:41.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.355+0000 7fa185600640 1 -- 172.21.15.161:0/1988850815 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa168003530 con 0x7fa188153920 2024-01-17T22:59:41.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.359+0000 7fa185600640 1 -- 172.21.15.161:0/1988850815 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2847331972 0 0) 0x7fa168003530 con 0x7fa188153920 2024-01-17T22:59:41.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.359+0000 7fa185600640 1 -- 172.21.15.161:0/1988850815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa188070270 msgr2=0x7fa1880ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:41.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.359+0000 7fa185600640 1 --2- 172.21.15.161:0/1988850815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa188070270 0x7fa1880ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.359+0000 7fa185600640 1 -- 172.21.15.161:0/1988850815 >> v2:172.21.15.190:3300/0 conn(0x7fa1880cd510 msgr2=0x7fa1880c2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:41.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.359+0000 7fa185600640 1 --2- 172.21.15.161:0/1988850815 >> v2:172.21.15.190:3300/0 conn(0x7fa1880cd510 0x7fa1880c2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.359+0000 7fa185600640 1 -- 172.21.15.161:0/1988850815 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18815d120 con 0x7fa188153920 2024-01-17T22:59:41.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.359+0000 7fa185600640 1 -- 172.21.15.161:0/1988850815 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7fa180001680 con 0x7fa188153920 2024-01-17T22:59:41.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.359+0000 7fa185600640 1 -- 172.21.15.161:0/1988850815 >> v1:172.21.15.161:6789/0 conn(0x7fa188153920 legacy=0x7fa18806c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:41.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.359+0000 7fa185600640 1 --2- 172.21.15.161:0/1988850815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa168003980 0x7fa168003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:41.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.359+0000 7fa185600640 1 --2- 172.21.15.161:0/1988850815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa188070270 0x7fa1680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:41.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.359+0000 7fa185600640 1 --2- 172.21.15.161:0/1988850815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa168004d10 0x7fa168005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:41.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.359+0000 7fa185600640 1 -- 172.21.15.161:0/1988850815 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1880c2290 con 0x7fa168004d10 2024-01-17T22:59:41.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.359+0000 7fa185600640 1 -- 172.21.15.161:0/1988850815 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18815ce60 con 0x7fa168003980 2024-01-17T22:59:41.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.359+0000 7fa185600640 1 -- 172.21.15.161:0/1988850815 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16800b9c0 con 0x7fa188070270 2024-01-17T22:59:41.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.363+0000 7fa187400640 1 --2- 172.21.15.161:0/1988850815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa168004d10 0x7fa168005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:41.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.363+0000 7fa187400640 1 -- 172.21.15.161:0/1988850815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa188070270 msgr2=0x7fa1680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:41.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.363+0000 7fa187400640 1 --2- 172.21.15.161:0/1988850815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa188070270 0x7fa1680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.363+0000 7fa187400640 1 -- 172.21.15.161:0/1988850815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa168003980 msgr2=0x7fa168003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:41.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.363+0000 7fa187400640 1 --2- 172.21.15.161:0/1988850815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa168003980 0x7fa168003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.363+0000 7fa187400640 1 -- 172.21.15.161:0/1988850815 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa168003530 con 0x7fa168004d10 2024-01-17T22:59:41.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.367+0000 7fa187400640 1 --2- 172.21.15.161:0/1988850815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa168004d10 0x7fa168005190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa178009fc0 tx=0x7fa17801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f8e88e6ef99ce server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:41.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.371+0000 7fa185600640 1 -- 172.21.15.161:0/1988850815 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1780a5cb0 con 0x7fa168004d10 2024-01-17T22:59:41.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.371+0000 7fa185600640 1 -- 172.21.15.161:0/1988850815 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17800f040 con 0x7fa168004d10 2024-01-17T22:59:41.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.371+0000 7fa185600640 1 -- 172.21.15.161:0/1988850815 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1780ad680 con 0x7fa168004d10 2024-01-17T22:59:41.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.371+0000 7fa18da00640 1 -- 172.21.15.161:0/1988850815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa168004d10 msgr2=0x7fa168005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:41.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.371+0000 7fa18da00640 1 --2- 172.21.15.161:0/1988850815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa168004d10 0x7fa168005190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa178009fc0 tx=0x7fa17801cca0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.371+0000 7fa187400640 1 -- 172.21.15.161:0/1988850815 reap_dead start 2024-01-17T22:59:41.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.371+0000 7fa18da00640 1 -- 172.21.15.161:0/1988850815 shutdown_connections 2024-01-17T22:59:41.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.371+0000 7fa18da00640 1 -- 172.21.15.161:0/1988850815 >> 172.21.15.161:0/1988850815 conn(0x7fa188061100 msgr2=0x7fa188061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:41.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.371+0000 7fa18da00640 1 -- 172.21.15.161:0/1988850815 shutdown_connections 2024-01-17T22:59:41.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.371+0000 7fa18da00640 1 -- 172.21.15.161:0/1988850815 wait complete. 2024-01-17T22:59:41.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.375+0000 7fa18da00640 1 Processor -- start 2024-01-17T22:59:41.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.375+0000 7fa18da00640 1 -- start start 2024-01-17T22:59:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.375+0000 7fa18da00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa168004d10 0x7fa1880acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.375+0000 7fa18da00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1880af850 0x7fa1880b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.375+0000 7fa18da00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa18814c300 0x7fa18814c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.375+0000 7fa18da00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1881f2680 con 0x7fa1880af850 2024-01-17T22:59:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.375+0000 7fa18da00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1880ae6a0 con 0x7fa168004d10 2024-01-17T22:59:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.375+0000 7fa18da00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1881f07f0 con 0x7fa18814c300 2024-01-17T22:59:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.375+0000 7fa186000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1880af850 0x7fa1880b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:41.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.375+0000 7fa186a00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa168004d10 0x7fa1880acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:41.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.375+0000 7fa187400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa18814c300 0x7fa18814c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:41.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.375+0000 7fa186000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1880af850 0x7fa1880b1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60760/0 (socket says 172.21.15.161:60760) 2024-01-17T22:59:41.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.375+0000 7fa186000640 1 -- 172.21.15.161:0/1142138307 learned_addr learned my addr 172.21.15.161:0/1142138307 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:41.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.383+0000 7fa186000640 1 -- 172.21.15.161:0/1142138307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa18814c300 msgr2=0x7fa18814c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:41.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.383+0000 7fa186000640 1 --2- 172.21.15.161:0/1142138307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa18814c300 0x7fa18814c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.383+0000 7fa186000640 1 -- 172.21.15.161:0/1142138307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa168004d10 msgr2=0x7fa1880acc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.383+0000 7fa186000640 1 --2- 172.21.15.161:0/1142138307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa168004d10 0x7fa1880acc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.383+0000 7fa186000640 1 -- 172.21.15.161:0/1142138307 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1881f2830 con 0x7fa1880af850 2024-01-17T22:59:41.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.387+0000 7fa186000640 1 --2- 172.21.15.161:0/1142138307 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1880af850 0x7fa1880b1400 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa17000e7f0 tx=0x7fa17000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:41.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.391+0000 7fa17ea00640 1 -- 172.21.15.161:0/1142138307 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17000eea0 con 0x7fa1880af850 2024-01-17T22:59:41.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.391+0000 7fa17ea00640 1 -- 172.21.15.161:0/1142138307 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17000c860 con 0x7fa1880af850 2024-01-17T22:59:41.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.391+0000 7fa17ea00640 1 -- 172.21.15.161:0/1142138307 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17000cbf0 con 0x7fa1880af850 2024-01-17T22:59:41.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.391+0000 7fa18da00640 1 -- 172.21.15.161:0/1142138307 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1881f2af0 con 0x7fa1880af850 2024-01-17T22:59:41.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.391+0000 7fa18da00640 1 -- 172.21.15.161:0/1142138307 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1881f30b0 con 0x7fa1880af850 2024-01-17T22:59:41.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.391+0000 7fa18da00640 1 -- 172.21.15.161:0/1142138307 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1880746a0 con 0x7fa1880af850 2024-01-17T22:59:41.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.411+0000 7fa17ea00640 1 -- 172.21.15.161:0/1142138307 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fa17000cd50 con 0x7fa1880af850 2024-01-17T22:59:41.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.415+0000 7fa17ea00640 1 --2- 172.21.15.161:0/1142138307 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa1600668c0 0x7fa160068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:41.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.415+0000 7fa186a00640 1 --2- 172.21.15.161:0/1142138307 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa1600668c0 0x7fa160068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:41.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.415+0000 7fa186a00640 1 --2- 172.21.15.161:0/1142138307 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa1600668c0 0x7fa160068d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa180001000 tx=0x7fa1800019c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:41.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.639+0000 7fa17ea00640 1 -- 172.21.15.161:0/1142138307 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fa1700557d0 con 0x7fa1880af850 2024-01-17T22:59:41.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.643+0000 7fa17ea00640 1 -- 172.21.15.161:0/1142138307 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fa170051b10 con 0x7fa1880af850 2024-01-17T22:59:41.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.803+0000 7fa18da00640 1 -- 172.21.15.161:0/1142138307 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa1881f0930 con 0x7fa1880af850 2024-01-17T22:59:41.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.831+0000 7fa17ea00640 1 -- 172.21.15.161:0/1142138307 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa1700170a0 con 0x7fa1880af850 2024-01-17T22:59:41.831 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-01-17T22:59:41.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.835+0000 7fa18da00640 1 -- 172.21.15.161:0/1142138307 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa1600668c0 msgr2=0x7fa160068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:41.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.835+0000 7fa18da00640 1 --2- 172.21.15.161:0/1142138307 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa1600668c0 0x7fa160068d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa180001000 tx=0x7fa1800019c0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.835+0000 7fa18da00640 1 -- 172.21.15.161:0/1142138307 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1880af850 msgr2=0x7fa1880b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:41.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.835+0000 7fa18da00640 1 --2- 172.21.15.161:0/1142138307 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1880af850 0x7fa1880b1400 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa17000e7f0 tx=0x7fa17000ecb0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.835+0000 7fa18da00640 1 -- 172.21.15.161:0/1142138307 shutdown_connections 2024-01-17T22:59:41.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.835+0000 7fa18da00640 1 --2- 172.21.15.161:0/1142138307 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fa1600668c0 0x7fa160068d80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.835+0000 7fa18da00640 1 --2- 172.21.15.161:0/1142138307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa18814c300 0x7fa18814c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.835+0000 7fa18da00640 1 --2- 172.21.15.161:0/1142138307 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1880af850 0x7fa1880b1400 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.835+0000 7fa18da00640 1 --2- 172.21.15.161:0/1142138307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa168004d10 0x7fa1880acc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.835+0000 7fa18da00640 1 -- 172.21.15.161:0/1142138307 >> 172.21.15.161:0/1142138307 conn(0x7fa188061100 msgr2=0x7fa18815b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:41.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.835+0000 7fa18da00640 1 -- 172.21.15.161:0/1142138307 shutdown_connections 2024-01-17T22:59:41.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.835+0000 7fa18da00640 1 -- 172.21.15.161:0/1142138307 wait complete. 2024-01-17T22:59:41.852 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-17T22:59:41.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.991+0000 7fe624c00640 1 Processor -- start 2024-01-17T22:59:41.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.991+0000 7fe624c00640 1 -- start start 2024-01-17T22:59:41.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.995+0000 7fe624c00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe62006d330 0x7fe620071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:41.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.995+0000 7fe624c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe62015cb70 con 0x7fe62006c8c0 2024-01-17T22:59:41.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.995+0000 7fe624c00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe62015ce10 con 0x7fe62006cca0 2024-01-17T22:59:41.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.995+0000 7fe624c00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62015a5e0 con 0x7fe62006d330 2024-01-17T22:59:41.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.995+0000 7fe61de00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fe62006c8c0 0x7fe62006df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:54030/0 (socket says 172.21.15.161:54030) 2024-01-17T22:59:41.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.995+0000 7fe61de00640 1 -- 172.21.15.161:0/3827911086 learned_addr learned my addr 172.21.15.161:0/3827911086 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:41.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.995+0000 7fe61e800640 1 --2- 172.21.15.161:0/3827911086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe62006d330 0x7fe620071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:41.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.999+0000 7fe61ca00640 1 -- 172.21.15.161:0/3827911086 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289337938 0 0) 0x7fe62015cb70 con 0x7fe62006c8c0 2024-01-17T22:59:41.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:41.999+0000 7fe61ca00640 1 -- 172.21.15.161:0/3827911086 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe600003530 con 0x7fe62006c8c0 2024-01-17T22:59:42.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.003+0000 7fe61ca00640 1 -- 172.21.15.161:0/3827911086 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 880229188 0 0) 0x7fe600003530 con 0x7fe62006c8c0 2024-01-17T22:59:42.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.003+0000 7fe61ca00640 1 -- 172.21.15.161:0/3827911086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe62006d330 msgr2=0x7fe620071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:42.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.003+0000 7fe61ca00640 1 --2- 172.21.15.161:0/3827911086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe62006d330 0x7fe620071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.003+0000 7fe61ca00640 1 -- 172.21.15.161:0/3827911086 >> v1:172.21.15.190:6789/0 conn(0x7fe62006cca0 legacy=0x7fe620153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:42.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.003+0000 7fe61ca00640 1 -- 172.21.15.161:0/3827911086 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62015d0f0 con 0x7fe62006c8c0 2024-01-17T22:59:42.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.003+0000 7fe61ca00640 1 -- 172.21.15.161:0/3827911086 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7fe610001680 con 0x7fe62006c8c0 2024-01-17T22:59:42.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.003+0000 7fe61ca00640 1 -- 172.21.15.161:0/3827911086 >> v1:172.21.15.161:6789/0 conn(0x7fe62006c8c0 legacy=0x7fe62006df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:42.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.003+0000 7fe61ca00640 1 --2- 172.21.15.161:0/3827911086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6000039b0 0x7fe600003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:42.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.003+0000 7fe61ca00640 1 --2- 172.21.15.161:0/3827911086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6000047d0 0x7fe600004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:42.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.003+0000 7fe61ca00640 1 --2- 172.21.15.161:0/3827911086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe62006d330 0x7fe600005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:42.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.003+0000 7fe61ca00640 1 -- 172.21.15.161:0/3827911086 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62015a5e0 con 0x7fe6000039b0 2024-01-17T22:59:42.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.003+0000 7fe61ca00640 1 -- 172.21.15.161:0/3827911086 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60000bb20 con 0x7fe6000047d0 2024-01-17T22:59:42.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.003+0000 7fe61ca00640 1 -- 172.21.15.161:0/3827911086 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60000bce0 con 0x7fe62006d330 2024-01-17T22:59:42.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.003+0000 7fe61de00640 1 --2- 172.21.15.161:0/3827911086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6000039b0 0x7fe600003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:42.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.007+0000 7fe61de00640 1 -- 172.21.15.161:0/3827911086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe62006d330 msgr2=0x7fe600005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:42.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.007+0000 7fe61de00640 1 --2- 172.21.15.161:0/3827911086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe62006d330 0x7fe600005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.007+0000 7fe61de00640 1 -- 172.21.15.161:0/3827911086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6000047d0 msgr2=0x7fe600004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:42.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.007+0000 7fe61de00640 1 --2- 172.21.15.161:0/3827911086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6000047d0 0x7fe600004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.007+0000 7fe61de00640 1 -- 172.21.15.161:0/3827911086 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600003530 con 0x7fe6000039b0 2024-01-17T22:59:42.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.011+0000 7fe61de00640 1 --2- 172.21.15.161:0/3827911086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6000039b0 0x7fe600003dd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe61000c110 tx=0x7fe61001cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae42e6811b4d643a server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:42.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.015+0000 7fe61ca00640 1 -- 172.21.15.161:0/3827911086 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe610005ae0 con 0x7fe6000039b0 2024-01-17T22:59:42.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.015+0000 7fe61ca00640 1 -- 172.21.15.161:0/3827911086 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe610005c60 con 0x7fe6000039b0 2024-01-17T22:59:42.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.015+0000 7fe61ca00640 1 -- 172.21.15.161:0/3827911086 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6100a5840 con 0x7fe6000039b0 2024-01-17T22:59:42.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.015+0000 7fe624c00640 1 -- 172.21.15.161:0/3827911086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6000039b0 msgr2=0x7fe600003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:42.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.015+0000 7fe624c00640 1 --2- 172.21.15.161:0/3827911086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6000039b0 0x7fe600003dd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe61000c110 tx=0x7fe61001cb60 comp rx=0 tx=0).stop 2024-01-17T22:59:42.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.015+0000 7fe61e800640 1 -- 172.21.15.161:0/3827911086 reap_dead start 2024-01-17T22:59:42.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.015+0000 7fe624c00640 1 -- 172.21.15.161:0/3827911086 shutdown_connections 2024-01-17T22:59:42.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.015+0000 7fe624c00640 1 -- 172.21.15.161:0/3827911086 >> 172.21.15.161:0/3827911086 conn(0x7fe6200c7a90 msgr2=0x7fe6200c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:42.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.015+0000 7fe624c00640 1 -- 172.21.15.161:0/3827911086 shutdown_connections 2024-01-17T22:59:42.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.015+0000 7fe624c00640 1 -- 172.21.15.161:0/3827911086 wait complete. 2024-01-17T22:59:42.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.019+0000 7fe624c00640 1 Processor -- start 2024-01-17T22:59:42.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.019+0000 7fe624c00640 1 -- start start 2024-01-17T22:59:42.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.019+0000 7fe624c00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6000039b0 0x7fe62015c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:42.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.019+0000 7fe624c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6201f58f0 0x7fe62014c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:42.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.019+0000 7fe624c00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe62015a9a0 0x7fe6201f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:42.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.019+0000 7fe624c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62006e670 con 0x7fe6201f58f0 2024-01-17T22:59:42.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.019+0000 7fe624c00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62015be10 con 0x7fe62015a9a0 2024-01-17T22:59:42.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.019+0000 7fe624c00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6201f3230 con 0x7fe6000039b0 2024-01-17T22:59:42.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.019+0000 7fe61d400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6201f58f0 0x7fe62014c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:42.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.019+0000 7fe61d400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6201f58f0 0x7fe62014c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49642/0 (socket says 172.21.15.161:49642) 2024-01-17T22:59:42.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.019+0000 7fe61d400640 1 -- 172.21.15.161:0/1768153675 learned_addr learned my addr 172.21.15.161:0/1768153675 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:42.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.019+0000 7fe61e800640 1 --2- 172.21.15.161:0/1768153675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe62015a9a0 0x7fe6201f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:42.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.019+0000 7fe61de00640 1 --2- 172.21.15.161:0/1768153675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6000039b0 0x7fe62015c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:42.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.023+0000 7fe61d400640 1 -- 172.21.15.161:0/1768153675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6000039b0 msgr2=0x7fe62015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:42.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.023+0000 7fe61d400640 1 --2- 172.21.15.161:0/1768153675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6000039b0 0x7fe62015c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.023+0000 7fe61d400640 1 -- 172.21.15.161:0/1768153675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe62015a9a0 msgr2=0x7fe6201f22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:42.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.023+0000 7fe61d400640 1 --2- 172.21.15.161:0/1768153675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe62015a9a0 0x7fe6201f22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.023+0000 7fe61d400640 1 -- 172.21.15.161:0/1768153675 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6201f2f50 con 0x7fe6201f58f0 2024-01-17T22:59:42.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.027+0000 7fe61d400640 1 --2- 172.21.15.161:0/1768153675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6201f58f0 0x7fe62014c7e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe60800c4b0 tx=0x7fe60800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:42.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.031+0000 7fe616000640 1 -- 172.21.15.161:0/1768153675 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6080052d0 con 0x7fe6201f58f0 2024-01-17T22:59:42.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.031+0000 7fe616000640 1 -- 172.21.15.161:0/1768153675 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe608005450 con 0x7fe6201f58f0 2024-01-17T22:59:42.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.031+0000 7fe616000640 1 -- 172.21.15.161:0/1768153675 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608012870 con 0x7fe6201f58f0 2024-01-17T22:59:42.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.031+0000 7fe624c00640 1 -- 172.21.15.161:0/1768153675 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62015b4e0 con 0x7fe6201f58f0 2024-01-17T22:59:42.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.031+0000 7fe624c00640 1 -- 172.21.15.161:0/1768153675 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62015baa0 con 0x7fe6201f58f0 2024-01-17T22:59:42.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.031+0000 7fe624c00640 1 -- 172.21.15.161:0/1768153675 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6200c8e30 con 0x7fe6201f58f0 2024-01-17T22:59:42.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.051+0000 7fe616000640 1 -- 172.21.15.161:0/1768153675 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fe6080129d0 con 0x7fe6201f58f0 2024-01-17T22:59:42.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.051+0000 7fe616000640 1 --2- 172.21.15.161:0/1768153675 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe5f8066870 0x7fe5f8068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:42.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.051+0000 7fe61de00640 1 --2- 172.21.15.161:0/1768153675 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe5f8066870 0x7fe5f8068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:42.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.051+0000 7fe61de00640 1 --2- 172.21.15.161:0/1768153675 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe5f8066870 0x7fe5f8068d30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe610005fd0 tx=0x7fe6100a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:42.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.283+0000 7fe616000640 1 -- 172.21.15.161:0/1768153675 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fe608055590 con 0x7fe6201f58f0 2024-01-17T22:59:42.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.283+0000 7fe616000640 1 -- 172.21.15.161:0/1768153675 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fe6080518d0 con 0x7fe6201f58f0 2024-01-17T22:59:42.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.435+0000 7fe624c00640 1 -- 172.21.15.161:0/1768153675 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6200746a0 con 0x7fe6201f58f0 2024-01-17T22:59:42.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.439+0000 7fe616000640 1 -- 172.21.15.161:0/1768153675 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe608054ef0 con 0x7fe6201f58f0 2024-01-17T22:59:42.439 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2024-01-17T22:59:42.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.443+0000 7fe624c00640 1 -- 172.21.15.161:0/1768153675 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe5f8066870 msgr2=0x7fe5f8068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:42.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.443+0000 7fe624c00640 1 --2- 172.21.15.161:0/1768153675 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe5f8066870 0x7fe5f8068d30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe610005fd0 tx=0x7fe6100a7070 comp rx=0 tx=0).stop 2024-01-17T22:59:42.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.443+0000 7fe624c00640 1 -- 172.21.15.161:0/1768153675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6201f58f0 msgr2=0x7fe62014c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:42.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.443+0000 7fe624c00640 1 --2- 172.21.15.161:0/1768153675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6201f58f0 0x7fe62014c7e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe60800c4b0 tx=0x7fe60800c970 comp rx=0 tx=0).stop 2024-01-17T22:59:42.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.443+0000 7fe624c00640 1 -- 172.21.15.161:0/1768153675 shutdown_connections 2024-01-17T22:59:42.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.443+0000 7fe624c00640 1 --2- 172.21.15.161:0/1768153675 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe5f8066870 0x7fe5f8068d30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.443+0000 7fe624c00640 1 --2- 172.21.15.161:0/1768153675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe62015a9a0 0x7fe6201f22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.443+0000 7fe624c00640 1 --2- 172.21.15.161:0/1768153675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6201f58f0 0x7fe62014c7e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.443+0000 7fe624c00640 1 --2- 172.21.15.161:0/1768153675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6000039b0 0x7fe62015c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.443+0000 7fe624c00640 1 -- 172.21.15.161:0/1768153675 >> 172.21.15.161:0/1768153675 conn(0x7fe6200c7a90 msgr2=0x7fe62006e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:42.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.443+0000 7fe624c00640 1 -- 172.21.15.161:0/1768153675 shutdown_connections 2024-01-17T22:59:42.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.443+0000 7fe624c00640 1 -- 172.21.15.161:0/1768153675 wait complete. 2024-01-17T22:59:42.461 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-17T22:59:42.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.599+0000 7f850fc00640 1 Processor -- start 2024-01-17T22:59:42.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.599+0000 7f850fc00640 1 -- start start 2024-01-17T22:59:42.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.603+0000 7f850fc00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f85080c6780 0x7f85080c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:42.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.603+0000 7f850fc00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f85080b0640 0x7f85080b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:42.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.603+0000 7f850fc00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85080c5cc0 con 0x7f85081516c0 2024-01-17T22:59:42.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.603+0000 7f850fc00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8508158410 con 0x7f85080b0640 2024-01-17T22:59:42.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.603+0000 7f850fc00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85081573c0 con 0x7f85080c6780 2024-01-17T22:59:42.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.603+0000 7f850dc00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f85080b0640 0x7f85080b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:42.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.603+0000 7f850dc00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f85080b0640 0x7f85080b0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49646/0 (socket says 172.21.15.161:49646) 2024-01-17T22:59:42.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.603+0000 7f850dc00640 1 -- 172.21.15.161:0/2996061696 learned_addr learned my addr 172.21.15.161:0/2996061696 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:42.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.603+0000 7f8507e00640 1 --2- 172.21.15.161:0/2996061696 >> v2:172.21.15.190:3300/0 conn(0x7f85080c6780 0x7f85080c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:42.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.607+0000 7f850dc00640 1 -- 172.21.15.161:0/2996061696 >> v2:172.21.15.190:3300/0 conn(0x7f85080c6780 msgr2=0x7f85080c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:42.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.607+0000 7f850dc00640 1 --2- 172.21.15.161:0/2996061696 >> v2:172.21.15.190:3300/0 conn(0x7f85080c6780 0x7f85080c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.607+0000 7f850dc00640 1 -- 172.21.15.161:0/2996061696 >> v1:172.21.15.190:6789/0 conn(0x7f85081516c0 legacy=0x7f850806db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:42.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.607+0000 7f850dc00640 1 -- 172.21.15.161:0/2996061696 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85081575b0 con 0x7f85080b0640 2024-01-17T22:59:42.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.611+0000 7f850dc00640 1 --2- 172.21.15.161:0/2996061696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85080b0640 0x7f85080b0a90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8508070e50 tx=0x7f850001f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc982f52645e6cf server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:42.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.611+0000 7f8507400640 1 -- 172.21.15.161:0/2996061696 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85000af400 con 0x7f85080b0640 2024-01-17T22:59:42.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.615+0000 7f8507400640 1 -- 172.21.15.161:0/2996061696 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85000ab050 con 0x7f85080b0640 2024-01-17T22:59:42.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.615+0000 7f8507400640 1 -- 172.21.15.161:0/2996061696 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85000af780 con 0x7f85080b0640 2024-01-17T22:59:42.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.615+0000 7f850fc00640 1 -- 172.21.15.161:0/2996061696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85080b0640 msgr2=0x7f85080b0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:42.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.615+0000 7f850fc00640 1 --2- 172.21.15.161:0/2996061696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85080b0640 0x7f85080b0a90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8508070e50 tx=0x7f850001f180 comp rx=0 tx=0).stop 2024-01-17T22:59:42.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.615+0000 7f850fc00640 1 -- 172.21.15.161:0/2996061696 shutdown_connections 2024-01-17T22:59:42.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.615+0000 7f850fc00640 1 --2- 172.21.15.161:0/2996061696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85080b0640 0x7f85080b0a90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.615+0000 7f850fc00640 1 --2- 172.21.15.161:0/2996061696 >> v2:172.21.15.190:3300/0 conn(0x7f85080c6780 0x7f85080c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.615+0000 7f850fc00640 1 -- 172.21.15.161:0/2996061696 >> 172.21.15.161:0/2996061696 conn(0x7f85080c7a90 msgr2=0x7f85080c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:42.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.615+0000 7f850fc00640 1 -- 172.21.15.161:0/2996061696 shutdown_connections 2024-01-17T22:59:42.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.615+0000 7f850fc00640 1 -- 172.21.15.161:0/2996061696 wait complete. 2024-01-17T22:59:42.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.615+0000 7f850fc00640 1 Processor -- start 2024-01-17T22:59:42.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.615+0000 7f850fc00640 1 -- start start 2024-01-17T22:59:42.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.615+0000 7f850fc00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85080b0640 0x7f85081ef260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:42.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.615+0000 7f850fc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85080c6780 0x7f85080ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:42.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.619+0000 7f850fc00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85081516c0 0x7f85080c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:42.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.619+0000 7f850fc00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85080c0920 con 0x7f85080c6780 2024-01-17T22:59:42.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.619+0000 7f850fc00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85080c1bf0 con 0x7f85080b0640 2024-01-17T22:59:42.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.619+0000 7f850fc00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85080c1630 con 0x7f85081516c0 2024-01-17T22:59:42.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.619+0000 7f8507e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85080c6780 0x7f85080ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:42.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.619+0000 7f850d200640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85080b0640 0x7f85081ef260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:42.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.619+0000 7f850dc00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85081516c0 0x7f85080c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:42.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.619+0000 7f8507e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85080c6780 0x7f85080ca6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49652/0 (socket says 172.21.15.161:49652) 2024-01-17T22:59:42.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.619+0000 7f8507e00640 1 -- 172.21.15.161:0/3223655396 learned_addr learned my addr 172.21.15.161:0/3223655396 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:42.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.623+0000 7f8507e00640 1 -- 172.21.15.161:0/3223655396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85081516c0 msgr2=0x7f85080c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:42.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.623+0000 7f8507e00640 1 --2- 172.21.15.161:0/3223655396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85081516c0 0x7f85080c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.623+0000 7f8507e00640 1 -- 172.21.15.161:0/3223655396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85080b0640 msgr2=0x7f85081ef260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:42.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.623+0000 7f8507e00640 1 --2- 172.21.15.161:0/3223655396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85080b0640 0x7f85081ef260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.623+0000 7f8507e00640 1 -- 172.21.15.161:0/3223655396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8500009b30 con 0x7f85080c6780 2024-01-17T22:59:42.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.623+0000 7f8507e00640 1 --2- 172.21.15.161:0/3223655396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85080c6780 0x7f85080ca6e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f84f000d800 tx=0x7f84f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:42.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.627+0000 7f8504c00640 1 -- 172.21.15.161:0/3223655396 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f000b660 con 0x7f85080c6780 2024-01-17T22:59:42.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.627+0000 7f8504c00640 1 -- 172.21.15.161:0/3223655396 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f000b7c0 con 0x7f85080c6780 2024-01-17T22:59:42.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.627+0000 7f8504c00640 1 -- 172.21.15.161:0/3223655396 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f000bb30 con 0x7f85080c6780 2024-01-17T22:59:42.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.627+0000 7f850fc00640 1 -- 172.21.15.161:0/3223655396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85080c1910 con 0x7f85080c6780 2024-01-17T22:59:42.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.627+0000 7f850fc00640 1 -- 172.21.15.161:0/3223655396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85081f2c50 con 0x7f85080c6780 2024-01-17T22:59:42.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.631+0000 7f850fc00640 1 -- 172.21.15.161:0/3223655396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85080c28c0 con 0x7f85080c6780 2024-01-17T22:59:42.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.647+0000 7f8504c00640 1 -- 172.21.15.161:0/3223655396 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f84f000bc90 con 0x7f85080c6780 2024-01-17T22:59:42.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.651+0000 7f8504c00640 1 --2- 172.21.15.161:0/3223655396 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f84e00668c0 0x7f84e0068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:42.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.651+0000 7f850d200640 1 --2- 172.21.15.161:0/3223655396 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f84e00668c0 0x7f84e0068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:42.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.651+0000 7f850d200640 1 --2- 172.21.15.161:0/3223655396 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f84e00668c0 0x7f84e0068d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f84f80098e0 tx=0x7f84f8009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:42.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.879+0000 7f8504c00640 1 -- 172.21.15.161:0/3223655396 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f84f0015e40 con 0x7f85080c6780 2024-01-17T22:59:42.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:42.879+0000 7f8504c00640 1 -- 172.21.15.161:0/3223655396 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f84f00522d0 con 0x7f85080c6780 2024-01-17T22:59:43.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.039+0000 7f850fc00640 1 -- 172.21.15.161:0/3223655396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f85081f27d0 con 0x7f85080c6780 2024-01-17T22:59:43.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.047+0000 7f8504c00640 1 -- 172.21.15.161:0/3223655396 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f85081f27d0 con 0x7f85080c6780 2024-01-17T22:59:43.044 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-01-17T22:59:43.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.047+0000 7f850fc00640 1 -- 172.21.15.161:0/3223655396 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f84e00668c0 msgr2=0x7f84e0068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:43.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.047+0000 7f850fc00640 1 --2- 172.21.15.161:0/3223655396 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f84e00668c0 0x7f84e0068d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f84f80098e0 tx=0x7f84f8009060 comp rx=0 tx=0).stop 2024-01-17T22:59:43.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.047+0000 7f850fc00640 1 -- 172.21.15.161:0/3223655396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85080c6780 msgr2=0x7f85080ca6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:43.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.047+0000 7f850fc00640 1 --2- 172.21.15.161:0/3223655396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85080c6780 0x7f85080ca6e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f84f000d800 tx=0x7f84f000dcc0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.047+0000 7f850fc00640 1 -- 172.21.15.161:0/3223655396 shutdown_connections 2024-01-17T22:59:43.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.047+0000 7f850fc00640 1 --2- 172.21.15.161:0/3223655396 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f84e00668c0 0x7f84e0068d80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.047+0000 7f850fc00640 1 --2- 172.21.15.161:0/3223655396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85081516c0 0x7f85080c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.047+0000 7f850fc00640 1 --2- 172.21.15.161:0/3223655396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85080c6780 0x7f85080ca6e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.047+0000 7f850fc00640 1 --2- 172.21.15.161:0/3223655396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85080b0640 0x7f85081ef260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.047+0000 7f850fc00640 1 -- 172.21.15.161:0/3223655396 >> 172.21.15.161:0/3223655396 conn(0x7f85080c7a90 msgr2=0x7f85081551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:43.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.047+0000 7f850fc00640 1 -- 172.21.15.161:0/3223655396 shutdown_connections 2024-01-17T22:59:43.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.047+0000 7f850fc00640 1 -- 172.21.15.161:0/3223655396 wait complete. 2024-01-17T22:59:43.069 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T22:59:43.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.207+0000 7f743e800640 1 Processor -- start 2024-01-17T22:59:43.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.207+0000 7f743e800640 1 -- start start 2024-01-17T22:59:43.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.211+0000 7f743e800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7438150560 0x7f7438156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:43.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.211+0000 7f743e800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743806dc10 con 0x7f74380c0090 2024-01-17T22:59:43.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.211+0000 7f743e800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743806d7e0 con 0x7f74380c5a70 2024-01-17T22:59:43.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.211+0000 7f743e800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74381564c0 con 0x7f7438150560 2024-01-17T22:59:43.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.211+0000 7f7437e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f74380c0090 0x7f7438160ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:54032/0 (socket says 172.21.15.161:54032) 2024-01-17T22:59:43.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.211+0000 7f7437e00640 1 -- 172.21.15.161:0/691481299 learned_addr learned my addr 172.21.15.161:0/691481299 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:43.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.211+0000 7f7437400640 1 --2- 172.21.15.161:0/691481299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7438150560 0x7f7438156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:43.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.215+0000 7f7436000640 1 -- 172.21.15.161:0/691481299 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280131778 0 0) 0x7f743806dc10 con 0x7f74380c0090 2024-01-17T22:59:43.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.215+0000 7f7436000640 1 -- 172.21.15.161:0/691481299 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7418003530 con 0x7f74380c0090 2024-01-17T22:59:43.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.215+0000 7f7436000640 1 -- 172.21.15.161:0/691481299 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076847229 0 0) 0x7f743806d7e0 con 0x7f74380c5a70 2024-01-17T22:59:43.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.215+0000 7f7436000640 1 -- 172.21.15.161:0/691481299 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f743806dc10 con 0x7f74380c5a70 2024-01-17T22:59:43.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.219+0000 7f7436000640 1 -- 172.21.15.161:0/691481299 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 771384357 0 0) 0x7f7418003530 con 0x7f74380c0090 2024-01-17T22:59:43.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.219+0000 7f7436000640 1 -- 172.21.15.161:0/691481299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7438150560 msgr2=0x7f7438156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:43.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.219+0000 7f7436000640 1 --2- 172.21.15.161:0/691481299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7438150560 0x7f7438156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.219+0000 7f7436000640 1 -- 172.21.15.161:0/691481299 >> v1:172.21.15.190:6789/0 conn(0x7f74380c5a70 legacy=0x7f74380722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:43.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.219+0000 7f7436000640 1 -- 172.21.15.161:0/691481299 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743806d220 con 0x7f74380c0090 2024-01-17T22:59:43.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.219+0000 7f7436000640 1 -- 172.21.15.161:0/691481299 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f7430001a20 con 0x7f74380c0090 2024-01-17T22:59:43.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.219+0000 7f7436000640 1 -- 172.21.15.161:0/691481299 >> v1:172.21.15.161:6789/0 conn(0x7f74380c0090 legacy=0x7f7438160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:43.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.219+0000 7f7436000640 1 --2- 172.21.15.161:0/691481299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7418003b40 0x7f7418003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:43.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.219+0000 7f7436000640 1 --2- 172.21.15.161:0/691481299 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74180047d0 0x7f7418004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:43.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.219+0000 7f7436000640 1 --2- 172.21.15.161:0/691481299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7438150560 0x7f74180051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:43.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.219+0000 7f7436000640 1 -- 172.21.15.161:0/691481299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74381564c0 con 0x7f7418003b40 2024-01-17T22:59:43.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.219+0000 7f7436000640 1 -- 172.21.15.161:0/691481299 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741800bb20 con 0x7f74180047d0 2024-01-17T22:59:43.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.219+0000 7f7436000640 1 -- 172.21.15.161:0/691481299 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741800bcb0 con 0x7f7438150560 2024-01-17T22:59:43.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.219+0000 7f7437400640 1 --2- 172.21.15.161:0/691481299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7418003b40 0x7f7418003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:43.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.223+0000 7f7437400640 1 -- 172.21.15.161:0/691481299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7438150560 msgr2=0x7f74180051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:43.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.223+0000 7f7437400640 1 --2- 172.21.15.161:0/691481299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7438150560 0x7f74180051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.223+0000 7f7437400640 1 -- 172.21.15.161:0/691481299 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74180047d0 msgr2=0x7f7418004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:43.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.223+0000 7f7437400640 1 --2- 172.21.15.161:0/691481299 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74180047d0 0x7f7418004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.223+0000 7f7437400640 1 -- 172.21.15.161:0/691481299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7418003530 con 0x7f7418003b40 2024-01-17T22:59:43.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.227+0000 7f7437400640 1 --2- 172.21.15.161:0/691481299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7418003b40 0x7f7418003f40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7428009b10 tx=0x7f742801eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4d09c27a45b52e server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:43.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.231+0000 7f7436000640 1 -- 172.21.15.161:0/691481299 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74280a7690 con 0x7f7418003b40 2024-01-17T22:59:43.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.231+0000 7f7436000640 1 -- 172.21.15.161:0/691481299 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74280a77f0 con 0x7f7418003b40 2024-01-17T22:59:43.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.231+0000 7f7436000640 1 -- 172.21.15.161:0/691481299 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74280a7ba0 con 0x7f7418003b40 2024-01-17T22:59:43.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.231+0000 7f743e800640 1 -- 172.21.15.161:0/691481299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7418003b40 msgr2=0x7f7418003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:43.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.231+0000 7f743e800640 1 --2- 172.21.15.161:0/691481299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7418003b40 0x7f7418003f40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7428009b10 tx=0x7f742801eca0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.231+0000 7f7437e00640 1 -- 172.21.15.161:0/691481299 reap_dead start 2024-01-17T22:59:43.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.231+0000 7f743e800640 1 -- 172.21.15.161:0/691481299 shutdown_connections 2024-01-17T22:59:43.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.231+0000 7f743e800640 1 -- 172.21.15.161:0/691481299 >> 172.21.15.161:0/691481299 conn(0x7f74380cb070 msgr2=0x7f74380cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:43.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.231+0000 7f743e800640 1 -- 172.21.15.161:0/691481299 shutdown_connections 2024-01-17T22:59:43.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.231+0000 7f743e800640 1 -- 172.21.15.161:0/691481299 wait complete. 2024-01-17T22:59:43.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.235+0000 7f743e800640 1 Processor -- start 2024-01-17T22:59:43.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.235+0000 7f743e800640 1 -- start start 2024-01-17T22:59:43.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.235+0000 7f743e800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7418003b40 0x7f74380c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:43.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.235+0000 7f743e800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74380caa50 0x7f74380c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:43.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.235+0000 7f743e800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74380c9440 0x7f74381f1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:43.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.235+0000 7f743e800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74380c2a40 con 0x7f74380caa50 2024-01-17T22:59:43.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.235+0000 7f743e800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743814ae80 con 0x7f7418003b40 2024-01-17T22:59:43.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.235+0000 7f743e800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74380c98c0 con 0x7f74380c9440 2024-01-17T22:59:43.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.235+0000 7f7436a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74380caa50 0x7f74380c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:43.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.235+0000 7f7436a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74380caa50 0x7f74380c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49670/0 (socket says 172.21.15.161:49670) 2024-01-17T22:59:43.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.235+0000 7f7436a00640 1 -- 172.21.15.161:0/309797278 learned_addr learned my addr 172.21.15.161:0/309797278 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:43.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.235+0000 7f7437e00640 1 --2- 172.21.15.161:0/309797278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74380c9440 0x7f74381f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:43.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.235+0000 7f7437400640 1 --2- 172.21.15.161:0/309797278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7418003b40 0x7f74380c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:43.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.239+0000 7f7436a00640 1 -- 172.21.15.161:0/309797278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74380c9440 msgr2=0x7f74381f1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:43.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.239+0000 7f7436a00640 1 --2- 172.21.15.161:0/309797278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74380c9440 0x7f74381f1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.239+0000 7f7436a00640 1 -- 172.21.15.161:0/309797278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7418003b40 msgr2=0x7f74380c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:43.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.239+0000 7f7436a00640 1 --2- 172.21.15.161:0/309797278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7418003b40 0x7f74380c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.239+0000 7f7436a00640 1 -- 172.21.15.161:0/309797278 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74380c3d70 con 0x7f74380caa50 2024-01-17T22:59:43.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.243+0000 7f7436a00640 1 --2- 172.21.15.161:0/309797278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74380caa50 0x7f74380c8f00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f742000c730 tx=0x7f742000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:43.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.247+0000 7f742f400640 1 -- 172.21.15.161:0/309797278 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74200052d0 con 0x7f74380caa50 2024-01-17T22:59:43.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.247+0000 7f743e800640 1 -- 172.21.15.161:0/309797278 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74380c2110 con 0x7f74380caa50 2024-01-17T22:59:43.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.247+0000 7f743e800640 1 -- 172.21.15.161:0/309797278 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74380c26d0 con 0x7f74380caa50 2024-01-17T22:59:43.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.247+0000 7f742f400640 1 -- 172.21.15.161:0/309797278 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7420005430 con 0x7f74380caa50 2024-01-17T22:59:43.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.247+0000 7f742f400640 1 -- 172.21.15.161:0/309797278 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742000a840 con 0x7f74380caa50 2024-01-17T22:59:43.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.247+0000 7f743e800640 1 -- 172.21.15.161:0/309797278 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74080052a0 con 0x7f74380caa50 2024-01-17T22:59:43.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.267+0000 7f742f400640 1 -- 172.21.15.161:0/309797278 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f742000a9a0 con 0x7f74380caa50 2024-01-17T22:59:43.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.267+0000 7f742f400640 1 --2- 172.21.15.161:0/309797278 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f7410066840 0x7f7410068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:43.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.267+0000 7f7437400640 1 --2- 172.21.15.161:0/309797278 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f7410066840 0x7f7410068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:43.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.267+0000 7f742f400640 1 -- 172.21.15.161:0/309797278 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f74200557e0 con 0x7f74380caa50 2024-01-17T22:59:43.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.267+0000 7f7437400640 1 --2- 172.21.15.161:0/309797278 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f7410066840 0x7f7410068d00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f74280b1000 tx=0x7f74280046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:43.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.511+0000 7f742f400640 1 -- 172.21.15.161:0/309797278 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f7420051b20 con 0x7f74380caa50 2024-01-17T22:59:43.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.699+0000 7f743e800640 1 -- 172.21.15.161:0/309797278 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7408005900 con 0x7f74380caa50 2024-01-17T22:59:43.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.711+0000 7f742f400640 1 -- 172.21.15.161:0/309797278 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6561 (secure 0 0 0) 0x7f7408005900 con 0x7f74380caa50 2024-01-17T22:59:43.712 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:43.712 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6839/2820898287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":2820898287},{"type":"v1","addr":"172.21.15.161:6839","nonce":2820898287}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/2332272186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2332272186},{"type":"v1","addr":"172.21.15.190:6833","nonce":2332272186}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3170137737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3170137737},{"type":"v1","addr":"172.21.15.190:6835","nonce":3170137737}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-17T22:58:49.015246+0000","modified":"2024-01-17T22:59:32.464347+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4269,"mds_1":4263,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":17,"addr":"172.21.15.161:6835/1671527613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1671527613},{"type":"v1","addr":"172.21.15.161:6835","nonce":1671527613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4263":{"gid":4263,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":16,"addr":"172.21.15.161:6837/409686078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":409686078},{"type":"v1","addr":"172.21.15.161:6837","nonce":409686078}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4269":{"gid":4269,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":7,"addr":"172.21.15.190:6837/561131647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":561131647},{"type":"v1","addr":"172.21.15.190:6837","nonce":561131647}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-17T22:59:43.712 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 15 2024-01-17T22:59:43.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.715+0000 7f743e800640 1 -- 172.21.15.161:0/309797278 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f7410066840 msgr2=0x7f7410068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:43.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.715+0000 7f743e800640 1 --2- 172.21.15.161:0/309797278 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f7410066840 0x7f7410068d00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f74280b1000 tx=0x7f74280046d0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.715+0000 7f743e800640 1 -- 172.21.15.161:0/309797278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74380caa50 msgr2=0x7f74380c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:43.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.715+0000 7f743e800640 1 --2- 172.21.15.161:0/309797278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74380caa50 0x7f74380c8f00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f742000c730 tx=0x7f742000cbf0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.715+0000 7f743e800640 1 -- 172.21.15.161:0/309797278 shutdown_connections 2024-01-17T22:59:43.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.715+0000 7f743e800640 1 --2- 172.21.15.161:0/309797278 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f7410066840 0x7f7410068d00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.715+0000 7f743e800640 1 --2- 172.21.15.161:0/309797278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74380c9440 0x7f74381f1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.715+0000 7f743e800640 1 --2- 172.21.15.161:0/309797278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74380caa50 0x7f74380c8f00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.715+0000 7f743e800640 1 --2- 172.21.15.161:0/309797278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7418003b40 0x7f74380c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.715+0000 7f743e800640 1 -- 172.21.15.161:0/309797278 >> 172.21.15.161:0/309797278 conn(0x7f74380cb070 msgr2=0x7f743814ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:43.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.715+0000 7f743e800640 1 -- 172.21.15.161:0/309797278 shutdown_connections 2024-01-17T22:59:43.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.715+0000 7f743e800640 1 -- 172.21.15.161:0/309797278 wait complete. 2024-01-17T22:59:43.734 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T22:59:43.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.871+0000 7fbffde00640 1 Processor -- start 2024-01-17T22:59:43.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.871+0000 7fbffde00640 1 -- start start 2024-01-17T22:59:43.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.871+0000 7fbffde00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbff80c5a70 0x7fbff8156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:43.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.871+0000 7fbffde00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbff80c0090 0x7fbff8159910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:43.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.871+0000 7fbffde00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff806dc10 con 0x7fbff8150560 2024-01-17T22:59:43.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.871+0000 7fbffde00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff806d7e0 con 0x7fbff80c5a70 2024-01-17T22:59:43.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.871+0000 7fbffde00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff81564c0 con 0x7fbff80c0090 2024-01-17T22:59:43.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.875+0000 7fbff6000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbff80c5a70 0x7fbff8156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:43.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.875+0000 7fbff6000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbff80c5a70 0x7fbff8156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49678/0 (socket says 172.21.15.161:49678) 2024-01-17T22:59:43.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.875+0000 7fbff6000640 1 -- 172.21.15.161:0/2289254941 learned_addr learned my addr 172.21.15.161:0/2289254941 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:43.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.875+0000 7fbff7400640 1 --2- 172.21.15.161:0/2289254941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbff80c0090 0x7fbff8159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:43.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.875+0000 7fbff6000640 1 -- 172.21.15.161:0/2289254941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbff80c0090 msgr2=0x7fbff8159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:43.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.875+0000 7fbff6000640 1 --2- 172.21.15.161:0/2289254941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbff80c0090 0x7fbff8159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.875+0000 7fbff6000640 1 -- 172.21.15.161:0/2289254941 >> v1:172.21.15.190:6789/0 conn(0x7fbff8150560 legacy=0x7fbff80722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:43.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.875+0000 7fbff6000640 1 -- 172.21.15.161:0/2289254941 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff806d220 con 0x7fbff80c5a70 2024-01-17T22:59:43.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.883+0000 7fbff6000640 1 --2- 172.21.15.161:0/2289254941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbff80c5a70 0x7fbff8156f60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000bb10 tx=0x7fbfe001ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4bd9a15a4ab477b server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:43.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.887+0000 7fbff5600640 1 -- 172.21.15.161:0/2289254941 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe00a7af0 con 0x7fbff80c5a70 2024-01-17T22:59:43.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.887+0000 7fbff5600640 1 -- 172.21.15.161:0/2289254941 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe00a7c50 con 0x7fbff80c5a70 2024-01-17T22:59:43.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.887+0000 7fbff5600640 1 -- 172.21.15.161:0/2289254941 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe00af440 con 0x7fbff80c5a70 2024-01-17T22:59:43.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.887+0000 7fbffde00640 1 -- 172.21.15.161:0/2289254941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbff80c5a70 msgr2=0x7fbff8156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:43.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.887+0000 7fbffde00640 1 --2- 172.21.15.161:0/2289254941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbff80c5a70 0x7fbff8156f60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000bb10 tx=0x7fbfe001ec10 comp rx=0 tx=0).stop 2024-01-17T22:59:43.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.887+0000 7fbffde00640 1 -- 172.21.15.161:0/2289254941 shutdown_connections 2024-01-17T22:59:43.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.887+0000 7fbffde00640 1 --2- 172.21.15.161:0/2289254941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbff80c0090 0x7fbff8159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.887+0000 7fbffde00640 1 --2- 172.21.15.161:0/2289254941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbff80c5a70 0x7fbff8156f60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.887+0000 7fbffde00640 1 -- 172.21.15.161:0/2289254941 >> 172.21.15.161:0/2289254941 conn(0x7fbff80cb070 msgr2=0x7fbff80cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:43.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.887+0000 7fbffde00640 1 -- 172.21.15.161:0/2289254941 shutdown_connections 2024-01-17T22:59:43.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.887+0000 7fbffde00640 1 -- 172.21.15.161:0/2289254941 wait complete. 2024-01-17T22:59:43.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.887+0000 7fbffde00640 1 Processor -- start 2024-01-17T22:59:43.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.887+0000 7fbffde00640 1 -- start start 2024-01-17T22:59:43.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.891+0000 7fbffde00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbff80c0090 0x7fbff80c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:43.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.891+0000 7fbffde00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbff80c5a70 0x7fbff814f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:43.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.891+0000 7fbffde00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbff8150560 0x7fbff814b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:43.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.891+0000 7fbffde00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff814e520 con 0x7fbff80c5a70 2024-01-17T22:59:43.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.891+0000 7fbffde00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff81f6f20 con 0x7fbff80c0090 2024-01-17T22:59:43.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.891+0000 7fbffde00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff8147a40 con 0x7fbff8150560 2024-01-17T22:59:43.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.891+0000 7fbff6000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbff80c5a70 0x7fbff814f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:43.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.891+0000 7fbff6000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbff80c5a70 0x7fbff814f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49686/0 (socket says 172.21.15.161:49686) 2024-01-17T22:59:43.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.891+0000 7fbff6000640 1 -- 172.21.15.161:0/4279387734 learned_addr learned my addr 172.21.15.161:0/4279387734 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:43.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.891+0000 7fbff7400640 1 --2- 172.21.15.161:0/4279387734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbff8150560 0x7fbff814b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:43.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.891+0000 7fbff6a00640 1 --2- 172.21.15.161:0/4279387734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbff80c0090 0x7fbff80c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:43.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.895+0000 7fbff6000640 1 -- 172.21.15.161:0/4279387734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbff8150560 msgr2=0x7fbff814b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:43.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.895+0000 7fbff6000640 1 --2- 172.21.15.161:0/4279387734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbff8150560 0x7fbff814b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.895+0000 7fbff6000640 1 -- 172.21.15.161:0/4279387734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbff80c0090 msgr2=0x7fbff80c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:43.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.895+0000 7fbff6000640 1 --2- 172.21.15.161:0/4279387734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbff80c0090 0x7fbff80c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.895+0000 7fbff6000640 1 -- 172.21.15.161:0/4279387734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe000b770 con 0x7fbff80c5a70 2024-01-17T22:59:43.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.899+0000 7fbff6000640 1 --2- 172.21.15.161:0/4279387734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbff80c5a70 0x7fbff814f550 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbfe001c840 tx=0x7fbfe001b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:43.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.903+0000 7fbfef400640 1 -- 172.21.15.161:0/4279387734 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe00b8660 con 0x7fbff80c5a70 2024-01-17T22:59:43.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.903+0000 7fbfef400640 1 -- 172.21.15.161:0/4279387734 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe00b87e0 con 0x7fbff80c5a70 2024-01-17T22:59:43.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.903+0000 7fbfef400640 1 -- 172.21.15.161:0/4279387734 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe00b8b90 con 0x7fbff80c5a70 2024-01-17T22:59:43.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.903+0000 7fbffde00640 1 -- 172.21.15.161:0/4279387734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff8155ea0 con 0x7fbff80c5a70 2024-01-17T22:59:43.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.903+0000 7fbffde00640 1 -- 172.21.15.161:0/4279387734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff814a6d0 con 0x7fbff80c5a70 2024-01-17T22:59:43.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.903+0000 7fbffde00640 1 -- 172.21.15.161:0/4279387734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff814b4e0 con 0x7fbff80c5a70 2024-01-17T22:59:43.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.927+0000 7fbfef400640 1 -- 172.21.15.161:0/4279387734 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fbfe00b6070 con 0x7fbff80c5a70 2024-01-17T22:59:43.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.927+0000 7fbfef400640 1 --2- 172.21.15.161:0/4279387734 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fbfd00668c0 0x7fbfd0068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:43.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.927+0000 7fbff6a00640 1 --2- 172.21.15.161:0/4279387734 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fbfd00668c0 0x7fbfd0068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:43.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:43.927+0000 7fbff6a00640 1 --2- 172.21.15.161:0/4279387734 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fbfd00668c0 0x7fbfd0068d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8007fd0 tx=0x7fbfe8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:44.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.155+0000 7fbfef400640 1 -- 172.21.15.161:0/4279387734 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fbfe00f0540 con 0x7fbff80c5a70 2024-01-17T22:59:44.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.155+0000 7fbfef400640 1 -- 172.21.15.161:0/4279387734 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fbfe00ec880 con 0x7fbff80c5a70 2024-01-17T22:59:44.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.311+0000 7fbffde00640 1 -- 172.21.15.161:0/4279387734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbff814b4e0 con 0x7fbff80c5a70 2024-01-17T22:59:44.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.351+0000 7fbfef400640 1 -- 172.21.15.161:0/4279387734 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18587 (secure 0 0 0) 0x7fbff814b4e0 con 0x7fbff80c5a70 2024-01-17T22:59:44.350 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:44.350 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":28,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:59:08.571619+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T22:58:46.757110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T22:58:47.930512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T22:58:53.561624+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.614036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.746767+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.689096+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.706485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.628004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.680048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.571249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]},{"pgid":"4.14","mappings":[{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:59:44.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.351+0000 7fbffde00640 1 -- 172.21.15.161:0/4279387734 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fbfd00668c0 msgr2=0x7fbfd0068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:44.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.351+0000 7fbffde00640 1 --2- 172.21.15.161:0/4279387734 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fbfd00668c0 0x7fbfd0068d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8007fd0 tx=0x7fbfe8009040 comp rx=0 tx=0).stop 2024-01-17T22:59:44.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.351+0000 7fbffde00640 1 -- 172.21.15.161:0/4279387734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbff80c5a70 msgr2=0x7fbff814f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:44.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.351+0000 7fbffde00640 1 --2- 172.21.15.161:0/4279387734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbff80c5a70 0x7fbff814f550 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbfe001c840 tx=0x7fbfe001b9b0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.355+0000 7fbffde00640 1 -- 172.21.15.161:0/4279387734 shutdown_connections 2024-01-17T22:59:44.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.355+0000 7fbffde00640 1 --2- 172.21.15.161:0/4279387734 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fbfd00668c0 0x7fbfd0068d80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.355+0000 7fbffde00640 1 --2- 172.21.15.161:0/4279387734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbff8150560 0x7fbff814b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.355+0000 7fbffde00640 1 --2- 172.21.15.161:0/4279387734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbff80c5a70 0x7fbff814f550 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.355+0000 7fbffde00640 1 --2- 172.21.15.161:0/4279387734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbff80c0090 0x7fbff80c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.355+0000 7fbffde00640 1 -- 172.21.15.161:0/4279387734 >> 172.21.15.161:0/4279387734 conn(0x7fbff80cb070 msgr2=0x7fbff814d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:44.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.355+0000 7fbffde00640 1 -- 172.21.15.161:0/4279387734 shutdown_connections 2024-01-17T22:59:44.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.355+0000 7fbffde00640 1 -- 172.21.15.161:0/4279387734 wait complete. 2024-01-17T22:59:44.374 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-17T22:58:14.876386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-17T22:58:46.757110+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-17T22:58:47.930512+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-17T22:58:53.561624+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-17T22:59:44.374 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-17T22:59:44.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.515+0000 7f8b77400640 1 Processor -- start 2024-01-17T22:59:44.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.515+0000 7f8b77400640 1 -- start start 2024-01-17T22:59:44.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.515+0000 7f8b77400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8b700c2a60 0x7f8b700ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:44.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.515+0000 7f8b77400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8b701579d0 0x7f8b70157e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:44.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.515+0000 7f8b77400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b700ca950 con 0x7f8b70151760 2024-01-17T22:59:44.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.515+0000 7f8b77400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b70157540 con 0x7f8b701579d0 2024-01-17T22:59:44.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.515+0000 7f8b77400640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b700c2eb0 con 0x7f8b700c2a60 2024-01-17T22:59:44.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.515+0000 7f8b75400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8b701579d0 0x7f8b70157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:44.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.519+0000 7f8b6fe00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8b700c2a60 0x7f8b700ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:44.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.519+0000 7f8b75400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8b701579d0 0x7f8b70157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49692/0 (socket says 172.21.15.161:49692) 2024-01-17T22:59:44.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.519+0000 7f8b75400640 1 -- 172.21.15.161:0/4102032691 learned_addr learned my addr 172.21.15.161:0/4102032691 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:44.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.519+0000 7f8b75400640 1 -- 172.21.15.161:0/4102032691 >> v2:172.21.15.190:3300/0 conn(0x7f8b700c2a60 msgr2=0x7f8b700ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:44.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.519+0000 7f8b75400640 1 --2- 172.21.15.161:0/4102032691 >> v2:172.21.15.190:3300/0 conn(0x7f8b700c2a60 0x7f8b700ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.519+0000 7f8b75400640 1 -- 172.21.15.161:0/4102032691 >> v1:172.21.15.161:6789/0 conn(0x7f8b70151760 legacy=0x7f8b70070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:44.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.519+0000 7f8b75400640 1 -- 172.21.15.161:0/4102032691 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b70151b40 con 0x7f8b701579d0 2024-01-17T22:59:44.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.523+0000 7f8b75400640 1 --2- 172.21.15.161:0/4102032691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b701579d0 0x7f8b70157e10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8b70070b90 tx=0x7f8b6801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2c703f8c4b4d35 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:44.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.527+0000 7f8b6f400640 1 -- 172.21.15.161:0/4102032691 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b680af400 con 0x7f8b701579d0 2024-01-17T22:59:44.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.527+0000 7f8b6f400640 1 -- 172.21.15.161:0/4102032691 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b680ab050 con 0x7f8b701579d0 2024-01-17T22:59:44.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.527+0000 7f8b6f400640 1 -- 172.21.15.161:0/4102032691 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b680af780 con 0x7f8b701579d0 2024-01-17T22:59:44.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.531+0000 7f8b77400640 1 -- 172.21.15.161:0/4102032691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b701579d0 msgr2=0x7f8b70157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:44.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.531+0000 7f8b77400640 1 --2- 172.21.15.161:0/4102032691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b701579d0 0x7f8b70157e10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8b70070b90 tx=0x7f8b6801f1c0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.531+0000 7f8b77400640 1 -- 172.21.15.161:0/4102032691 shutdown_connections 2024-01-17T22:59:44.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.531+0000 7f8b77400640 1 --2- 172.21.15.161:0/4102032691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b701579d0 0x7f8b70157e10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.531+0000 7f8b77400640 1 --2- 172.21.15.161:0/4102032691 >> v2:172.21.15.190:3300/0 conn(0x7f8b700c2a60 0x7f8b700ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.531+0000 7f8b77400640 1 -- 172.21.15.161:0/4102032691 >> 172.21.15.161:0/4102032691 conn(0x7f8b70070390 msgr2=0x7f8b7006f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:44.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.531+0000 7f8b77400640 1 -- 172.21.15.161:0/4102032691 shutdown_connections 2024-01-17T22:59:44.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.531+0000 7f8b77400640 1 -- 172.21.15.161:0/4102032691 wait complete. 2024-01-17T22:59:44.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.531+0000 7f8b77400640 1 Processor -- start 2024-01-17T22:59:44.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.531+0000 7f8b77400640 1 -- start start 2024-01-17T22:59:44.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.531+0000 7f8b77400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b700c2a60 0x7f8b7006c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:44.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.531+0000 7f8b77400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b70151760 0x7f8b701f2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:44.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.531+0000 7f8b77400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b701579d0 0x7f8b700b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:44.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.531+0000 7f8b77400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b701570e0 con 0x7f8b70151760 2024-01-17T22:59:44.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.531+0000 7f8b77400640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7006c1e0 con 0x7f8b701579d0 2024-01-17T22:59:44.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.531+0000 7f8b77400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b701f32a0 con 0x7f8b700c2a60 2024-01-17T22:59:44.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.535+0000 7f8b6fe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b70151760 0x7f8b701f2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:44.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.535+0000 7f8b74a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b700c2a60 0x7f8b7006c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:44.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.535+0000 7f8b6fe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b70151760 0x7f8b701f2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49694/0 (socket says 172.21.15.161:49694) 2024-01-17T22:59:44.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.535+0000 7f8b6fe00640 1 -- 172.21.15.161:0/3921209871 learned_addr learned my addr 172.21.15.161:0/3921209871 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:44.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.535+0000 7f8b75400640 1 --2- 172.21.15.161:0/3921209871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b701579d0 0x7f8b700b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:44.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.539+0000 7f8b6fe00640 1 -- 172.21.15.161:0/3921209871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b700c2a60 msgr2=0x7f8b7006c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:44.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.539+0000 7f8b6fe00640 1 --2- 172.21.15.161:0/3921209871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b700c2a60 0x7f8b7006c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.539+0000 7f8b6fe00640 1 -- 172.21.15.161:0/3921209871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b701579d0 msgr2=0x7f8b700b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:44.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.539+0000 7f8b6fe00640 1 --2- 172.21.15.161:0/3921209871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b701579d0 0x7f8b700b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.539+0000 7f8b6fe00640 1 -- 172.21.15.161:0/3921209871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b68009b30 con 0x7f8b70151760 2024-01-17T22:59:44.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.539+0000 7f8b6fe00640 1 --2- 172.21.15.161:0/3921209871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b70151760 0x7f8b701f2940 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800e8a0 tx=0x7f8b5800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:44.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.543+0000 7f8b6cc00640 1 -- 172.21.15.161:0/3921209871 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b58009510 con 0x7f8b70151760 2024-01-17T22:59:44.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.543+0000 7f8b6cc00640 1 -- 172.21.15.161:0/3921209871 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5800c940 con 0x7f8b70151760 2024-01-17T22:59:44.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.543+0000 7f8b6cc00640 1 -- 172.21.15.161:0/3921209871 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5800ccb0 con 0x7f8b70151760 2024-01-17T22:59:44.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.543+0000 7f8b77400640 1 -- 172.21.15.161:0/3921209871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b70155210 con 0x7f8b70151760 2024-01-17T22:59:44.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.543+0000 7f8b77400640 1 -- 172.21.15.161:0/3921209871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7006bc20 con 0x7f8b70151760 2024-01-17T22:59:44.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.543+0000 7f8b77400640 1 -- 172.21.15.161:0/3921209871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b700746a0 con 0x7f8b70151760 2024-01-17T22:59:44.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.563+0000 7f8b6cc00640 1 -- 172.21.15.161:0/3921209871 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f8b58013470 con 0x7f8b70151760 2024-01-17T22:59:44.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.563+0000 7f8b6cc00640 1 --2- 172.21.15.161:0/3921209871 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8b48066870 0x7f8b48068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:44.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.563+0000 7f8b74a00640 1 --2- 172.21.15.161:0/3921209871 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8b48066870 0x7f8b48068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:44.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.563+0000 7f8b74a00640 1 --2- 172.21.15.161:0/3921209871 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8b48066870 0x7f8b48068d30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8b60001810 tx=0x7f8b60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:44.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.567+0000 7f8b6cc00640 1 -- 172.21.15.161:0/3921209871 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f8b58055910 con 0x7f8b70151760 2024-01-17T22:59:44.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.811+0000 7f8b6cc00640 1 -- 172.21.15.161:0/3921209871 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f8b58051c50 con 0x7f8b70151760 2024-01-17T22:59:44.963 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.963+0000 7f8b77400640 1 -- 172.21.15.161:0/3921209871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b700c7be0 con 0x7f8b70151760 2024-01-17T22:59:44.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.967+0000 7f8b6cc00640 1 -- 172.21.15.161:0/3921209871 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b580210a0 con 0x7f8b70151760 2024-01-17T22:59:44.968 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-01-17T22:59:44.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.971+0000 7f8b77400640 1 -- 172.21.15.161:0/3921209871 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8b48066870 msgr2=0x7f8b48068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:44.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.971+0000 7f8b77400640 1 --2- 172.21.15.161:0/3921209871 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8b48066870 0x7f8b48068d30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8b60001810 tx=0x7f8b60009040 comp rx=0 tx=0).stop 2024-01-17T22:59:44.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.971+0000 7f8b77400640 1 -- 172.21.15.161:0/3921209871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b70151760 msgr2=0x7f8b701f2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:44.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.971+0000 7f8b77400640 1 --2- 172.21.15.161:0/3921209871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b70151760 0x7f8b701f2940 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800e8a0 tx=0x7f8b5800eca0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.971+0000 7f8b77400640 1 -- 172.21.15.161:0/3921209871 shutdown_connections 2024-01-17T22:59:44.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.971+0000 7f8b77400640 1 --2- 172.21.15.161:0/3921209871 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8b48066870 0x7f8b48068d30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.971+0000 7f8b77400640 1 --2- 172.21.15.161:0/3921209871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b701579d0 0x7f8b700b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.971+0000 7f8b77400640 1 --2- 172.21.15.161:0/3921209871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b70151760 0x7f8b701f2940 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.971+0000 7f8b77400640 1 --2- 172.21.15.161:0/3921209871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b700c2a60 0x7f8b7006c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.971+0000 7f8b77400640 1 -- 172.21.15.161:0/3921209871 >> 172.21.15.161:0/3921209871 conn(0x7f8b70070390 msgr2=0x7f8b700ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:44.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.971+0000 7f8b77400640 1 -- 172.21.15.161:0/3921209871 shutdown_connections 2024-01-17T22:59:44.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:44.971+0000 7f8b77400640 1 -- 172.21.15.161:0/3921209871 wait complete. 2024-01-17T22:59:44.990 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-17T22:59:45.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.131+0000 7f0a15000640 1 Processor -- start 2024-01-17T22:59:45.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.131+0000 7f0a15000640 1 -- start start 2024-01-17T22:59:45.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.131+0000 7f0a15000640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0a1014fe30 0x7f0a100c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:45.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.131+0000 7f0a15000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a101569b0 con 0x7f0a100bffb0 2024-01-17T22:59:45.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.131+0000 7f0a15000640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a10155da0 con 0x7f0a100c0410 2024-01-17T22:59:45.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.131+0000 7f0a15000640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a100c21d0 con 0x7f0a1014fe30 2024-01-17T22:59:45.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.131+0000 7f0a0d400640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0a100bffb0 0x7f0a10071e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:54054/0 (socket says 172.21.15.161:54054) 2024-01-17T22:59:45.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.131+0000 7f0a0d400640 1 -- 172.21.15.161:0/737754763 learned_addr learned my addr 172.21.15.161:0/737754763 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:45.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.131+0000 7f0a0de00640 1 --2- 172.21.15.161:0/737754763 >> v2:172.21.15.190:3300/0 conn(0x7f0a1014fe30 0x7f0a100c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:45.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.135+0000 7f0a0ca00640 1 -- 172.21.15.161:0/737754763 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386832948 0 0) 0x7f0a101569b0 con 0x7f0a100bffb0 2024-01-17T22:59:45.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.135+0000 7f0a0ca00640 1 -- 172.21.15.161:0/737754763 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09f0003530 con 0x7f0a100bffb0 2024-01-17T22:59:45.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.139+0000 7f0a0ca00640 1 -- 172.21.15.161:0/737754763 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3186199859 0 0) 0x7f09f0003530 con 0x7f0a100bffb0 2024-01-17T22:59:45.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.139+0000 7f0a0ca00640 1 -- 172.21.15.161:0/737754763 >> v2:172.21.15.190:3300/0 conn(0x7f0a1014fe30 msgr2=0x7f0a100c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:45.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.139+0000 7f0a0ca00640 1 --2- 172.21.15.161:0/737754763 >> v2:172.21.15.190:3300/0 conn(0x7f0a1014fe30 0x7f0a100c1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.139+0000 7f0a0ca00640 1 -- 172.21.15.161:0/737754763 >> v1:172.21.15.190:6789/0 conn(0x7f0a100c0410 legacy=0x7f0a100c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:45.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.139+0000 7f0a0ca00640 1 -- 172.21.15.161:0/737754763 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a10156080 con 0x7f0a100bffb0 2024-01-17T22:59:45.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.139+0000 7f0a0ca00640 1 -- 172.21.15.161:0/737754763 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f09f8001680 con 0x7f0a100bffb0 2024-01-17T22:59:45.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.139+0000 7f0a0ca00640 1 -- 172.21.15.161:0/737754763 >> v1:172.21.15.161:6789/0 conn(0x7f0a100bffb0 legacy=0x7f0a10071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:45.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.139+0000 7f0a0ca00640 1 --2- 172.21.15.161:0/737754763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f09f00039d0 0x7f09f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:45.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.139+0000 7f0a0ca00640 1 --2- 172.21.15.161:0/737754763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09f00047d0 0x7f09f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:45.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.139+0000 7f0a0ca00640 1 --2- 172.21.15.161:0/737754763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09f0005190 0x7f09f000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:45.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.139+0000 7f0a0ca00640 1 -- 172.21.15.161:0/737754763 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100c21d0 con 0x7f09f00047d0 2024-01-17T22:59:45.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.139+0000 7f0a0ca00640 1 -- 172.21.15.161:0/737754763 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f000c040 con 0x7f09f00039d0 2024-01-17T22:59:45.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.139+0000 7f0a0ca00640 1 -- 172.21.15.161:0/737754763 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f000c200 con 0x7f09f0005190 2024-01-17T22:59:45.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.139+0000 7f0a0e800640 1 --2- 172.21.15.161:0/737754763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09f0005190 0x7f09f000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:45.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.143+0000 7f0a0d400640 1 --2- 172.21.15.161:0/737754763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09f00047d0 0x7f09f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:45.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.143+0000 7f0a0d400640 1 -- 172.21.15.161:0/737754763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09f0005190 msgr2=0x7f09f000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:45.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.143+0000 7f0a0d400640 1 --2- 172.21.15.161:0/737754763 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09f0005190 0x7f09f000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.143+0000 7f0a0d400640 1 -- 172.21.15.161:0/737754763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f09f00039d0 msgr2=0x7f09f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:45.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.143+0000 7f0a0d400640 1 --2- 172.21.15.161:0/737754763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f09f00039d0 0x7f09f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.143+0000 7f0a0d400640 1 -- 172.21.15.161:0/737754763 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f0003530 con 0x7f09f00047d0 2024-01-17T22:59:45.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.143+0000 7f0a0e800640 1 -- 172.21.15.161:0/737754763 reap_dead start 2024-01-17T22:59:45.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.147+0000 7f0a0d400640 1 --2- 172.21.15.161:0/737754763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09f00047d0 0x7f09f0004c50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f09f800c190 tx=0x7f09f801cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172facc0992eca94 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:45.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.151+0000 7f0a0ca00640 1 -- 172.21.15.161:0/737754763 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f8005ae0 con 0x7f09f00047d0 2024-01-17T22:59:45.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.151+0000 7f0a0ca00640 1 -- 172.21.15.161:0/737754763 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f8005c40 con 0x7f09f00047d0 2024-01-17T22:59:45.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.151+0000 7f0a0ca00640 1 -- 172.21.15.161:0/737754763 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f80a5850 con 0x7f09f00047d0 2024-01-17T22:59:45.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.151+0000 7f0a15000640 1 -- 172.21.15.161:0/737754763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09f00047d0 msgr2=0x7f09f0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:45.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.151+0000 7f0a15000640 1 --2- 172.21.15.161:0/737754763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09f00047d0 0x7f09f0004c50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f09f800c190 tx=0x7f09f801cbe0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.151+0000 7f0a15000640 1 -- 172.21.15.161:0/737754763 shutdown_connections 2024-01-17T22:59:45.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.151+0000 7f0a15000640 1 --2- 172.21.15.161:0/737754763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09f00047d0 0x7f09f0004c50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.151+0000 7f0a15000640 1 -- 172.21.15.161:0/737754763 >> 172.21.15.161:0/737754763 conn(0x7f0a100c7a90 msgr2=0x7f0a100c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:45.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.151+0000 7f0a15000640 1 -- 172.21.15.161:0/737754763 shutdown_connections 2024-01-17T22:59:45.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.151+0000 7f0a15000640 1 -- 172.21.15.161:0/737754763 wait complete. 2024-01-17T22:59:45.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.155+0000 7f0a15000640 1 Processor -- start 2024-01-17T22:59:45.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.155+0000 7f0a15000640 1 -- start start 2024-01-17T22:59:45.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.155+0000 7f0a15000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09f00047d0 0x7f0a10159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:45.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.155+0000 7f0a15000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a10159c90 0x7f0a101f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:45.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.155+0000 7f0a15000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0a101f2670 0x7f0a101579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:45.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.155+0000 7f0a15000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a10158cb0 con 0x7f09f00047d0 2024-01-17T22:59:45.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.155+0000 7f0a15000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a101446c0 con 0x7f0a10159c90 2024-01-17T22:59:45.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.155+0000 7f0a15000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1014a900 con 0x7f0a101f2670 2024-01-17T22:59:45.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.155+0000 7f0a0de00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09f00047d0 0x7f0a10159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:45.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.155+0000 7f0a0de00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09f00047d0 0x7f0a10159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49700/0 (socket says 172.21.15.161:49700) 2024-01-17T22:59:45.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.155+0000 7f0a0de00640 1 -- 172.21.15.161:0/1807069173 learned_addr learned my addr 172.21.15.161:0/1807069173 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:45.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.159+0000 7f0a0e800640 1 --2- 172.21.15.161:0/1807069173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0a101f2670 0x7f0a101579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:45.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.159+0000 7f0a0d400640 1 --2- 172.21.15.161:0/1807069173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a10159c90 0x7f0a101f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:45.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.159+0000 7f0a0de00640 1 -- 172.21.15.161:0/1807069173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0a101f2670 msgr2=0x7f0a101579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:45.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.159+0000 7f0a0de00640 1 --2- 172.21.15.161:0/1807069173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0a101f2670 0x7f0a101579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.159+0000 7f0a0de00640 1 -- 172.21.15.161:0/1807069173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a10159c90 msgr2=0x7f0a101f2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:45.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.159+0000 7f0a0de00640 1 --2- 172.21.15.161:0/1807069173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a10159c90 0x7f0a101f2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.159+0000 7f0a0de00640 1 -- 172.21.15.161:0/1807069173 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1014abe0 con 0x7f09f00047d0 2024-01-17T22:59:45.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.163+0000 7f0a0de00640 1 --2- 172.21.15.161:0/1807069173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09f00047d0 0x7f0a10159750 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000e840 tx=0x7f0a0000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:45.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.167+0000 7f0a06000640 1 -- 172.21.15.161:0/1807069173 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a00009620 con 0x7f09f00047d0 2024-01-17T22:59:45.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.167+0000 7f0a06000640 1 -- 172.21.15.161:0/1807069173 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0000c940 con 0x7f09f00047d0 2024-01-17T22:59:45.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.167+0000 7f0a06000640 1 -- 172.21.15.161:0/1807069173 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0000ccf0 con 0x7f09f00047d0 2024-01-17T22:59:45.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.167+0000 7f0a15000640 1 -- 172.21.15.161:0/1807069173 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1014aec0 con 0x7f09f00047d0 2024-01-17T22:59:45.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.167+0000 7f0a15000640 1 -- 172.21.15.161:0/1807069173 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a101588d0 con 0x7f09f00047d0 2024-01-17T22:59:45.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.167+0000 7f0a15000640 1 -- 172.21.15.161:0/1807069173 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a100746a0 con 0x7f09f00047d0 2024-01-17T22:59:45.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.187+0000 7f0a06000640 1 -- 172.21.15.161:0/1807069173 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f0a00013470 con 0x7f09f00047d0 2024-01-17T22:59:45.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.187+0000 7f0a06000640 1 --2- 172.21.15.161:0/1807069173 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f09e8066890 0x7f09e8068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:45.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.187+0000 7f0a0d400640 1 --2- 172.21.15.161:0/1807069173 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f09e8066890 0x7f09e8068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:45.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.191+0000 7f0a0d400640 1 --2- 172.21.15.161:0/1807069173 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f09e8066890 0x7f09e8068d50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f09f80ab000 tx=0x7f09f80b1040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:45.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.415+0000 7f0a06000640 1 -- 172.21.15.161:0/1807069173 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f0a00055980 con 0x7f09f00047d0 2024-01-17T22:59:45.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.415+0000 7f0a06000640 1 -- 172.21.15.161:0/1807069173 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f0a00051cc0 con 0x7f09f00047d0 2024-01-17T22:59:45.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.571+0000 7f0a15000640 1 -- 172.21.15.161:0/1807069173 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a100c5670 con 0x7f09f00047d0 2024-01-17T22:59:45.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.579+0000 7f0a06000640 1 -- 172.21.15.161:0/1807069173 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a000210a0 con 0x7f09f00047d0 2024-01-17T22:59:45.577 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-01-17T22:59:45.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.579+0000 7f0a15000640 1 -- 172.21.15.161:0/1807069173 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f09e8066890 msgr2=0x7f09e8068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:45.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.579+0000 7f0a15000640 1 --2- 172.21.15.161:0/1807069173 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f09e8066890 0x7f09e8068d50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f09f80ab000 tx=0x7f09f80b1040 comp rx=0 tx=0).stop 2024-01-17T22:59:45.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.579+0000 7f0a15000640 1 -- 172.21.15.161:0/1807069173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09f00047d0 msgr2=0x7f0a10159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:45.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.579+0000 7f0a15000640 1 --2- 172.21.15.161:0/1807069173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09f00047d0 0x7f0a10159750 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000e840 tx=0x7f0a0000ed00 comp rx=0 tx=0).stop 2024-01-17T22:59:45.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.579+0000 7f0a15000640 1 -- 172.21.15.161:0/1807069173 shutdown_connections 2024-01-17T22:59:45.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.579+0000 7f0a15000640 1 --2- 172.21.15.161:0/1807069173 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f09e8066890 0x7f09e8068d50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.579+0000 7f0a15000640 1 --2- 172.21.15.161:0/1807069173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a10159c90 0x7f0a101f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.579+0000 7f0a15000640 1 --2- 172.21.15.161:0/1807069173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0a101f2670 0x7f0a101579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.579+0000 7f0a15000640 1 --2- 172.21.15.161:0/1807069173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09f00047d0 0x7f0a10159750 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.579+0000 7f0a15000640 1 -- 172.21.15.161:0/1807069173 >> 172.21.15.161:0/1807069173 conn(0x7f0a100c7a90 msgr2=0x7f0a1014da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:45.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.579+0000 7f0a15000640 1 -- 172.21.15.161:0/1807069173 shutdown_connections 2024-01-17T22:59:45.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.579+0000 7f0a15000640 1 -- 172.21.15.161:0/1807069173 wait complete. 2024-01-17T22:59:45.599 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-17T22:59:45.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.743+0000 7f4bf9800640 1 Processor -- start 2024-01-17T22:59:45.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.743+0000 7f4bf9800640 1 -- start start 2024-01-17T22:59:45.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.743+0000 7f4bf9800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4bf4150000 0x7f4bf40c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:45.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.743+0000 7f4bf9800640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4bf40700e0 0x7f4bf40c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:45.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.743+0000 7f4bf9800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf41503e0 con 0x7f4bf40c2620 2024-01-17T22:59:45.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.743+0000 7f4bf9800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf4156c30 con 0x7f4bf4150000 2024-01-17T22:59:45.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.743+0000 7f4bf9800640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf4155dd0 con 0x7f4bf40700e0 2024-01-17T22:59:45.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.743+0000 7f4bf2a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4bf4150000 0x7f4bf40c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:45.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.743+0000 7f4bf3400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4bf40700e0 0x7f4bf40c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:45.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.743+0000 7f4bf2000640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4bf40c2620 0x7f4bf40c2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:54064/0 (socket says 172.21.15.161:54064) 2024-01-17T22:59:45.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.743+0000 7f4bf2000640 1 -- 172.21.15.161:0/1181940338 learned_addr learned my addr 172.21.15.161:0/1181940338 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:45.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.747+0000 7f4bf2a00640 1 -- 172.21.15.161:0/1181940338 >> v2:172.21.15.190:3300/0 conn(0x7f4bf40700e0 msgr2=0x7f4bf40c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:45.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.747+0000 7f4bf2a00640 1 --2- 172.21.15.161:0/1181940338 >> v2:172.21.15.190:3300/0 conn(0x7f4bf40700e0 0x7f4bf40c4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.747+0000 7f4bf2a00640 1 -- 172.21.15.161:0/1181940338 >> v1:172.21.15.161:6789/0 conn(0x7f4bf40c2620 legacy=0x7f4bf40c2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:45.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.747+0000 7f4bf2a00640 1 -- 172.21.15.161:0/1181940338 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf41560b0 con 0x7f4bf4150000 2024-01-17T22:59:45.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.755+0000 7f4bf2a00640 1 --2- 172.21.15.161:0/1181940338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4150000 0x7f4bf40c61d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4bf406edb0 tx=0x7f4be401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f2c8183e9474e7 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:45.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.755+0000 7f4bf1600640 1 -- 172.21.15.161:0/1181940338 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be40a8950 con 0x7f4bf4150000 2024-01-17T22:59:45.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.755+0000 7f4bf1600640 1 -- 172.21.15.161:0/1181940338 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be40a8ab0 con 0x7f4bf4150000 2024-01-17T22:59:45.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.755+0000 7f4bf1600640 1 -- 172.21.15.161:0/1181940338 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be40a8e40 con 0x7f4bf4150000 2024-01-17T22:59:45.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.759+0000 7f4bf9800640 1 -- 172.21.15.161:0/1181940338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4150000 msgr2=0x7f4bf40c61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:45.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.759+0000 7f4bf9800640 1 --2- 172.21.15.161:0/1181940338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4150000 0x7f4bf40c61d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4bf406edb0 tx=0x7f4be401ec50 comp rx=0 tx=0).stop 2024-01-17T22:59:45.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.759+0000 7f4bf9800640 1 -- 172.21.15.161:0/1181940338 shutdown_connections 2024-01-17T22:59:45.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.759+0000 7f4bf9800640 1 --2- 172.21.15.161:0/1181940338 >> v2:172.21.15.190:3300/0 conn(0x7f4bf40700e0 0x7f4bf40c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.759+0000 7f4bf9800640 1 --2- 172.21.15.161:0/1181940338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4150000 0x7f4bf40c61d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.759+0000 7f4bf9800640 1 -- 172.21.15.161:0/1181940338 >> 172.21.15.161:0/1181940338 conn(0x7f4bf40c82d0 msgr2=0x7f4bf40c86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:45.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.759+0000 7f4bf9800640 1 -- 172.21.15.161:0/1181940338 shutdown_connections 2024-01-17T22:59:45.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.759+0000 7f4bf9800640 1 -- 172.21.15.161:0/1181940338 wait complete. 2024-01-17T22:59:45.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.759+0000 7f4bf9800640 1 Processor -- start 2024-01-17T22:59:45.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.759+0000 7f4bf9800640 1 -- start start 2024-01-17T22:59:45.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.759+0000 7f4bf9800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bf40700e0 0x7f4bf41f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:45.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.759+0000 7f4bf9800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bf40c2620 0x7f4bf41e45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:45.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.759+0000 7f4bf9800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4150000 0x7f4bf414b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:45.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.759+0000 7f4bf9800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf40cb2c0 con 0x7f4bf4150000 2024-01-17T22:59:45.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.759+0000 7f4bf9800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf41e3ec0 con 0x7f4bf40c2620 2024-01-17T22:59:45.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.759+0000 7f4bf9800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf41f3830 con 0x7f4bf40700e0 2024-01-17T22:59:45.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.763+0000 7f4bf3400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4150000 0x7f4bf414b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:45.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.763+0000 7f4bf2000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bf40c2620 0x7f4bf41e45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:45.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.763+0000 7f4bf3400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4150000 0x7f4bf414b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49718/0 (socket says 172.21.15.161:49718) 2024-01-17T22:59:45.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.763+0000 7f4bf3400640 1 -- 172.21.15.161:0/711508509 learned_addr learned my addr 172.21.15.161:0/711508509 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:45.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.763+0000 7f4bf2a00640 1 --2- 172.21.15.161:0/711508509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bf40700e0 0x7f4bf41f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:45.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.767+0000 7f4bf3400640 1 -- 172.21.15.161:0/711508509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bf40700e0 msgr2=0x7f4bf41f32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:45.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.767+0000 7f4bf3400640 1 --2- 172.21.15.161:0/711508509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bf40700e0 0x7f4bf41f32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.767+0000 7f4bf3400640 1 -- 172.21.15.161:0/711508509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bf40c2620 msgr2=0x7f4bf41e45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:45.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.767+0000 7f4bf3400640 1 --2- 172.21.15.161:0/711508509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bf40c2620 0x7f4bf41e45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.767+0000 7f4bf3400640 1 -- 172.21.15.161:0/711508509 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be4009420 con 0x7f4bf4150000 2024-01-17T22:59:45.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.767+0000 7f4bf3400640 1 --2- 172.21.15.161:0/711508509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4150000 0x7f4bf414b610 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009de0 tx=0x7f4bec0075e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:45.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.771+0000 7f4beaa00640 1 -- 172.21.15.161:0/711508509 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec007e70 con 0x7f4bf4150000 2024-01-17T22:59:45.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.771+0000 7f4beaa00640 1 -- 172.21.15.161:0/711508509 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec010040 con 0x7f4bf4150000 2024-01-17T22:59:45.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.771+0000 7f4beaa00640 1 -- 172.21.15.161:0/711508509 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec003be0 con 0x7f4bf4150000 2024-01-17T22:59:45.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.771+0000 7f4bf9800640 1 -- 172.21.15.161:0/711508509 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf41e4160 con 0x7f4bf4150000 2024-01-17T22:59:45.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.771+0000 7f4bf9800640 1 -- 172.21.15.161:0/711508509 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf41e2f90 con 0x7f4bf4150000 2024-01-17T22:59:45.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.775+0000 7f4bf9800640 1 -- 172.21.15.161:0/711508509 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf41e42f0 con 0x7f4bf4150000 2024-01-17T22:59:45.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.791+0000 7f4beaa00640 1 -- 172.21.15.161:0/711508509 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f4bec003d40 con 0x7f4bf4150000 2024-01-17T22:59:45.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.795+0000 7f4beaa00640 1 --2- 172.21.15.161:0/711508509 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4bcc066890 0x7f4bcc068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:45.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.795+0000 7f4bf2a00640 1 --2- 172.21.15.161:0/711508509 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4bcc066890 0x7f4bcc068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:45.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.795+0000 7f4bf2a00640 1 --2- 172.21.15.161:0/711508509 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4bcc066890 0x7f4bcc068d50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4be40b2000 tx=0x7f4be4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:45.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:45.795+0000 7f4beaa00640 1 -- 172.21.15.161:0/711508509 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f4bec01fe50 con 0x7f4bf4150000 2024-01-17T22:59:46.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.027+0000 7f4beaa00640 1 -- 172.21.15.161:0/711508509 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f4bec0517f0 con 0x7f4bf4150000 2024-01-17T22:59:46.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.183+0000 7f4bf9800640 1 -- 172.21.15.161:0/711508509 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4bf40ca7a0 con 0x7f4bf4150000 2024-01-17T22:59:46.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.187+0000 7f4beaa00640 1 -- 172.21.15.161:0/711508509 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4bec019070 con 0x7f4bf4150000 2024-01-17T22:59:46.186 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2024-01-17T22:59:46.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.191+0000 7f4bf9800640 1 -- 172.21.15.161:0/711508509 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4bcc066890 msgr2=0x7f4bcc068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:46.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.191+0000 7f4bf9800640 1 --2- 172.21.15.161:0/711508509 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4bcc066890 0x7f4bcc068d50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4be40b2000 tx=0x7f4be4008040 comp rx=0 tx=0).stop 2024-01-17T22:59:46.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.191+0000 7f4bf9800640 1 -- 172.21.15.161:0/711508509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4150000 msgr2=0x7f4bf414b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:46.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.191+0000 7f4bf9800640 1 --2- 172.21.15.161:0/711508509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4150000 0x7f4bf414b610 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009de0 tx=0x7f4bec0075e0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.191+0000 7f4bf9800640 1 -- 172.21.15.161:0/711508509 shutdown_connections 2024-01-17T22:59:46.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.191+0000 7f4bf9800640 1 --2- 172.21.15.161:0/711508509 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4bcc066890 0x7f4bcc068d50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.191+0000 7f4bf9800640 1 --2- 172.21.15.161:0/711508509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bf40c2620 0x7f4bf41e45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.191+0000 7f4bf9800640 1 --2- 172.21.15.161:0/711508509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4150000 0x7f4bf414b610 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.191+0000 7f4bf9800640 1 --2- 172.21.15.161:0/711508509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bf40700e0 0x7f4bf41f32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.191+0000 7f4bf9800640 1 -- 172.21.15.161:0/711508509 >> 172.21.15.161:0/711508509 conn(0x7f4bf40c82d0 msgr2=0x7f4bf40c8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:46.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.191+0000 7f4bf9800640 1 -- 172.21.15.161:0/711508509 shutdown_connections 2024-01-17T22:59:46.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.191+0000 7f4bf9800640 1 -- 172.21.15.161:0/711508509 wait complete. 2024-01-17T22:59:46.209 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-17T22:59:46.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.351+0000 7f6530800640 1 Processor -- start 2024-01-17T22:59:46.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.351+0000 7f6530800640 1 -- start start 2024-01-17T22:59:46.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.351+0000 7f6530800640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f65280c38c0 0x7f65280c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:46.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.351+0000 7f6530800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f65280c9490 0x7f65280c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:46.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.351+0000 7f6530800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65280c9e20 con 0x7f65280c8710 2024-01-17T22:59:46.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.351+0000 7f6530800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65280c2640 con 0x7f65280c9490 2024-01-17T22:59:46.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.351+0000 7f6530800640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65280c9030 con 0x7f65280c38c0 2024-01-17T22:59:46.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.351+0000 7f652e800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f65280c9490 0x7f65280c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:46.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.351+0000 7f652de00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f65280c8710 0x7f65280cd030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:54080/0 (socket says 172.21.15.161:54080) 2024-01-17T22:59:46.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.351+0000 7f652de00640 1 -- 172.21.15.161:0/2212419539 learned_addr learned my addr 172.21.15.161:0/2212419539 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:46.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.351+0000 7f652d400640 1 --2- 172.21.15.161:0/2212419539 >> v2:172.21.15.190:3300/0 conn(0x7f65280c38c0 0x7f65280c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:46.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.359+0000 7f652e800640 1 -- 172.21.15.161:0/2212419539 >> v2:172.21.15.190:3300/0 conn(0x7f65280c38c0 msgr2=0x7f65280c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:46.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.359+0000 7f652e800640 1 --2- 172.21.15.161:0/2212419539 >> v2:172.21.15.190:3300/0 conn(0x7f65280c38c0 0x7f65280c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.359+0000 7f652e800640 1 -- 172.21.15.161:0/2212419539 >> v1:172.21.15.161:6789/0 conn(0x7f65280c8710 legacy=0x7f65280cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:46.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.359+0000 7f652e800640 1 -- 172.21.15.161:0/2212419539 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65280c7df0 con 0x7f65280c9490 2024-01-17T22:59:46.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.363+0000 7f652e800640 1 --2- 172.21.15.161:0/2212419539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65280c9490 0x7f65280c98e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f652806d9d0 tx=0x7f652001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc96632eb86739b server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:46.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.367+0000 7f652ca00640 1 -- 172.21.15.161:0/2212419539 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65200b0440 con 0x7f65280c9490 2024-01-17T22:59:46.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.367+0000 7f652ca00640 1 -- 172.21.15.161:0/2212419539 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65200b05a0 con 0x7f65280c9490 2024-01-17T22:59:46.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.367+0000 7f652ca00640 1 -- 172.21.15.161:0/2212419539 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65200b0930 con 0x7f65280c9490 2024-01-17T22:59:46.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.367+0000 7f6530800640 1 -- 172.21.15.161:0/2212419539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65280c9490 msgr2=0x7f65280c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:46.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.367+0000 7f6530800640 1 --2- 172.21.15.161:0/2212419539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65280c9490 0x7f65280c98e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f652806d9d0 tx=0x7f652001f0f0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.367+0000 7f6530800640 1 -- 172.21.15.161:0/2212419539 shutdown_connections 2024-01-17T22:59:46.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.367+0000 7f6530800640 1 --2- 172.21.15.161:0/2212419539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65280c9490 0x7f65280c98e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.367+0000 7f6530800640 1 --2- 172.21.15.161:0/2212419539 >> v2:172.21.15.190:3300/0 conn(0x7f65280c38c0 0x7f65280c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.367+0000 7f6530800640 1 -- 172.21.15.161:0/2212419539 >> 172.21.15.161:0/2212419539 conn(0x7f6528061100 msgr2=0x7f6528061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:46.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.367+0000 7f6530800640 1 -- 172.21.15.161:0/2212419539 shutdown_connections 2024-01-17T22:59:46.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.367+0000 7f6530800640 1 -- 172.21.15.161:0/2212419539 wait complete. 2024-01-17T22:59:46.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.371+0000 7f6530800640 1 Processor -- start 2024-01-17T22:59:46.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.371+0000 7f6530800640 1 -- start start 2024-01-17T22:59:46.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.371+0000 7f6530800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65280c38c0 0x7f652814acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:46.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.371+0000 7f6530800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65280c8710 0x7f6528154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:46.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.371+0000 7f6530800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65280c9490 0x7f6528154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:46.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.371+0000 7f6530800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65281effb0 con 0x7f65280c9490 2024-01-17T22:59:46.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.371+0000 7f6530800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65281ef430 con 0x7f65280c38c0 2024-01-17T22:59:46.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.371+0000 7f6530800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65281ef710 con 0x7f65280c8710 2024-01-17T22:59:46.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.371+0000 7f652e800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65280c9490 0x7f6528154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:46.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.371+0000 7f652e800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65280c9490 0x7f6528154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49728/0 (socket says 172.21.15.161:49728) 2024-01-17T22:59:46.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.371+0000 7f652e800640 1 -- 172.21.15.161:0/708381658 learned_addr learned my addr 172.21.15.161:0/708381658 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:46.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.371+0000 7f652de00640 1 --2- 172.21.15.161:0/708381658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65280c38c0 0x7f652814acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:46.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.371+0000 7f652d400640 1 --2- 172.21.15.161:0/708381658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65280c8710 0x7f6528154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:46.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.375+0000 7f652e800640 1 -- 172.21.15.161:0/708381658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65280c8710 msgr2=0x7f6528154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:46.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.375+0000 7f652e800640 1 --2- 172.21.15.161:0/708381658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65280c8710 0x7f6528154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.375+0000 7f652e800640 1 -- 172.21.15.161:0/708381658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65280c38c0 msgr2=0x7f652814acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:46.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.375+0000 7f652e800640 1 --2- 172.21.15.161:0/708381658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65280c38c0 0x7f652814acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.375+0000 7f652e800640 1 -- 172.21.15.161:0/708381658 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6520009a70 con 0x7f65280c9490 2024-01-17T22:59:46.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.379+0000 7f652e800640 1 --2- 172.21.15.161:0/708381658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65280c9490 0x7f6528154ba0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f652001bd00 tx=0x7f652001be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:46.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.383+0000 7f6526000640 1 -- 172.21.15.161:0/708381658 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65200b0440 con 0x7f65280c9490 2024-01-17T22:59:46.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.383+0000 7f6526000640 1 -- 172.21.15.161:0/708381658 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65200bc860 con 0x7f65280c9490 2024-01-17T22:59:46.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.383+0000 7f6526000640 1 -- 172.21.15.161:0/708381658 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65200bcc10 con 0x7f65280c9490 2024-01-17T22:59:46.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.383+0000 7f6530800640 1 -- 172.21.15.161:0/708381658 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65281ef9f0 con 0x7f65280c9490 2024-01-17T22:59:46.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.383+0000 7f6530800640 1 -- 172.21.15.161:0/708381658 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6528154140 con 0x7f65280c9490 2024-01-17T22:59:46.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.383+0000 7f6530800640 1 -- 172.21.15.161:0/708381658 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6528153fa0 con 0x7f65280c9490 2024-01-17T22:59:46.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.403+0000 7f6526000640 1 -- 172.21.15.161:0/708381658 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f65200d1430 con 0x7f65280c9490 2024-01-17T22:59:46.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.403+0000 7f6526000640 1 --2- 172.21.15.161:0/708381658 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6500066890 0x7f6500068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:46.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.403+0000 7f652de00640 1 --2- 172.21.15.161:0/708381658 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6500066890 0x7f6500068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:46.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.407+0000 7f652de00640 1 --2- 172.21.15.161:0/708381658 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6500066890 0x7f6500068d50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6518000f70 tx=0x7f6518007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:46.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.631+0000 7f6526000640 1 -- 172.21.15.161:0/708381658 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f65200b0e20 con 0x7f65280c9490 2024-01-17T22:59:46.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.631+0000 7f6526000640 1 -- 172.21.15.161:0/708381658 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f65200f0a80 con 0x7f65280c9490 2024-01-17T22:59:46.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.791+0000 7f6530800640 1 -- 172.21.15.161:0/708381658 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6528153fa0 con 0x7f65280c9490 2024-01-17T22:59:46.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.795+0000 7f6526000640 1 -- 172.21.15.161:0/708381658 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6528153fa0 con 0x7f65280c9490 2024-01-17T22:59:46.795 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-01-17T22:59:46.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.799+0000 7f6530800640 1 -- 172.21.15.161:0/708381658 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6500066890 msgr2=0x7f6500068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:46.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.799+0000 7f6530800640 1 --2- 172.21.15.161:0/708381658 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6500066890 0x7f6500068d50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6518000f70 tx=0x7f6518007e90 comp rx=0 tx=0).stop 2024-01-17T22:59:46.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.799+0000 7f6530800640 1 -- 172.21.15.161:0/708381658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65280c9490 msgr2=0x7f6528154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:46.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.799+0000 7f6530800640 1 --2- 172.21.15.161:0/708381658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65280c9490 0x7f6528154ba0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f652001bd00 tx=0x7f652001be90 comp rx=0 tx=0).stop 2024-01-17T22:59:46.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.799+0000 7f6530800640 1 -- 172.21.15.161:0/708381658 shutdown_connections 2024-01-17T22:59:46.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.799+0000 7f6530800640 1 --2- 172.21.15.161:0/708381658 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6500066890 0x7f6500068d50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.799+0000 7f6530800640 1 --2- 172.21.15.161:0/708381658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65280c9490 0x7f6528154ba0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.799+0000 7f6530800640 1 --2- 172.21.15.161:0/708381658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65280c8710 0x7f6528154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.799+0000 7f6530800640 1 --2- 172.21.15.161:0/708381658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65280c38c0 0x7f652814acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.799+0000 7f6530800640 1 -- 172.21.15.161:0/708381658 >> 172.21.15.161:0/708381658 conn(0x7f6528061100 msgr2=0x7f652806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:46.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.799+0000 7f6530800640 1 -- 172.21.15.161:0/708381658 shutdown_connections 2024-01-17T22:59:46.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.799+0000 7f6530800640 1 -- 172.21.15.161:0/708381658 wait complete. 2024-01-17T22:59:46.817 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T22:59:46.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.951+0000 7f77d6400640 1 Processor -- start 2024-01-17T22:59:46.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.951+0000 7f77d6400640 1 -- start start 2024-01-17T22:59:46.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.955+0000 7f77d6400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d0153730 0x7f77d00ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:46.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.955+0000 7f77d6400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f77d00cda40 0x7f77d0070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:46.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.955+0000 7f77d6400640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d01598e0 con 0x7f77d0071360 2024-01-17T22:59:46.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.955+0000 7f77d6400640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d01596f0 con 0x7f77d00cda40 2024-01-17T22:59:46.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.955+0000 7f77d6400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d00cde80 con 0x7f77d0153730 2024-01-17T22:59:46.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.955+0000 7f77cf400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d0153730 0x7f77d00ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:46.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.955+0000 7f77cea00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f77d00cda40 0x7f77d0070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:46.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.955+0000 7f77cf400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d0153730 0x7f77d00ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:50690/0 (socket says 172.21.15.161:50690) 2024-01-17T22:59:46.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.955+0000 7f77cea00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f77d00cda40 0x7f77d0070e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:37964/0 (socket says 172.21.15.161:37964) 2024-01-17T22:59:46.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.955+0000 7f77cf400640 1 -- 172.21.15.161:0/3260347354 learned_addr learned my addr 172.21.15.161:0/3260347354 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:46.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.963+0000 7f77cf400640 1 -- 172.21.15.161:0/3260347354 >> v2:172.21.15.190:3300/0 conn(0x7f77d00cda40 msgr2=0x7f77d0070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:46.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.963+0000 7f77cf400640 1 --2- 172.21.15.161:0/3260347354 >> v2:172.21.15.190:3300/0 conn(0x7f77d00cda40 0x7f77d0070e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.963+0000 7f77cf400640 1 -- 172.21.15.161:0/3260347354 >> v1:172.21.15.190:6789/0 conn(0x7f77d0071360 legacy=0x7f77d015d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:46.963 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.963+0000 7f77cf400640 1 -- 172.21.15.161:0/3260347354 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d0159b80 con 0x7f77d0153730 2024-01-17T22:59:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.967+0000 7f77cf400640 1 --2- 172.21.15.161:0/3260347354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d0153730 0x7f77d00ca330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009870 tx=0x7f77c001ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=237ca8ce0c6add3f server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:46.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.979+0000 7f77ce000640 1 -- 172.21.15.161:0/3260347354 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c00a8a30 con 0x7f77d0153730 2024-01-17T22:59:46.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.979+0000 7f77ce000640 1 -- 172.21.15.161:0/3260347354 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c00a8b90 con 0x7f77d0153730 2024-01-17T22:59:46.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.979+0000 7f77ce000640 1 -- 172.21.15.161:0/3260347354 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c00b0440 con 0x7f77d0153730 2024-01-17T22:59:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.979+0000 7f77d6400640 1 -- 172.21.15.161:0/3260347354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d0153730 msgr2=0x7f77d00ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.979+0000 7f77d6400640 1 --2- 172.21.15.161:0/3260347354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d0153730 0x7f77d00ca330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009870 tx=0x7f77c001ed30 comp rx=0 tx=0).stop 2024-01-17T22:59:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.979+0000 7f77d6400640 1 -- 172.21.15.161:0/3260347354 shutdown_connections 2024-01-17T22:59:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.979+0000 7f77d6400640 1 --2- 172.21.15.161:0/3260347354 >> v2:172.21.15.190:3300/0 conn(0x7f77d00cda40 0x7f77d0070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.979+0000 7f77d6400640 1 --2- 172.21.15.161:0/3260347354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d0153730 0x7f77d00ca330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.979+0000 7f77d6400640 1 -- 172.21.15.161:0/3260347354 >> 172.21.15.161:0/3260347354 conn(0x7f77d0070460 msgr2=0x7f77d006f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.979+0000 7f77d6400640 1 -- 172.21.15.161:0/3260347354 shutdown_connections 2024-01-17T22:59:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.979+0000 7f77d6400640 1 -- 172.21.15.161:0/3260347354 wait complete. 2024-01-17T22:59:46.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.983+0000 7f77d6400640 1 Processor -- start 2024-01-17T22:59:46.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.983+0000 7f77d6400640 1 -- start start 2024-01-17T22:59:46.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.983+0000 7f77d6400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77d0071360 0x7f77d014d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:46.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.983+0000 7f77d6400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d00cda40 0x7f77d01562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:46.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.983+0000 7f77d6400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77d0153730 0x7f77d015bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:46.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.983+0000 7f77d6400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d01505c0 con 0x7f77d0153730 2024-01-17T22:59:46.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.983+0000 7f77d6400640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d0155290 con 0x7f77d0071360 2024-01-17T22:59:46.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.983+0000 7f77d6400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d0155e10 con 0x7f77d00cda40 2024-01-17T22:59:46.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.983+0000 7f77cfe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77d0153730 0x7f77d015bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:46.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.983+0000 7f77cfe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77d0153730 0x7f77d015bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49738/0 (socket says 172.21.15.161:49738) 2024-01-17T22:59:46.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.983+0000 7f77cfe00640 1 -- 172.21.15.161:0/140198608 learned_addr learned my addr 172.21.15.161:0/140198608 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:46.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.983+0000 7f77cf400640 1 --2- 172.21.15.161:0/140198608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77d0071360 0x7f77d014d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:46.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.987+0000 7f77cea00640 1 --2- 172.21.15.161:0/140198608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d00cda40 0x7f77d01562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:46.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.987+0000 7f77cfe00640 1 -- 172.21.15.161:0/140198608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d00cda40 msgr2=0x7f77d01562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:46.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.987+0000 7f77cfe00640 1 --2- 172.21.15.161:0/140198608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d00cda40 0x7f77d01562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.987+0000 7f77cfe00640 1 -- 172.21.15.161:0/140198608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77d0071360 msgr2=0x7f77d014d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:46.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.987+0000 7f77cfe00640 1 --2- 172.21.15.161:0/140198608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77d0071360 0x7f77d014d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:46.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.987+0000 7f77cfe00640 1 -- 172.21.15.161:0/140198608 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c00094d0 con 0x7f77d0153730 2024-01-17T22:59:46.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.991+0000 7f77cfe00640 1 --2- 172.21.15.161:0/140198608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77d0153730 0x7f77d015bd70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f77c800c760 tx=0x7f77c800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:46.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.995+0000 7f77c7400640 1 -- 172.21.15.161:0/140198608 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8003b80 con 0x7f77d0153730 2024-01-17T22:59:46.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.995+0000 7f77c7400640 1 -- 172.21.15.161:0/140198608 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c8003ce0 con 0x7f77d0153730 2024-01-17T22:59:46.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.995+0000 7f77c7400640 1 -- 172.21.15.161:0/140198608 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c800aa30 con 0x7f77d0153730 2024-01-17T22:59:46.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.995+0000 7f77d6400640 1 -- 172.21.15.161:0/140198608 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d01f2f50 con 0x7f77d0153730 2024-01-17T22:59:46.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.995+0000 7f77d6400640 1 -- 172.21.15.161:0/140198608 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d01557c0 con 0x7f77d0153730 2024-01-17T22:59:46.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:46.995+0000 7f77d6400640 1 -- 172.21.15.161:0/140198608 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d015cd80 con 0x7f77d0153730 2024-01-17T22:59:47.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.015+0000 7f77c7400640 1 -- 172.21.15.161:0/140198608 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f77c800ab90 con 0x7f77d0153730 2024-01-17T22:59:47.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.015+0000 7f77c7400640 1 --2- 172.21.15.161:0/140198608 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f77a8066890 0x7f77a8068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:47.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.015+0000 7f77cf400640 1 --2- 172.21.15.161:0/140198608 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f77a8066890 0x7f77a8068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:47.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.015+0000 7f77cf400640 1 --2- 172.21.15.161:0/140198608 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f77a8066890 0x7f77a8068d50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f77c00b2000 tx=0x7f77c00aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:47.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.015+0000 7f77c7400640 1 -- 172.21.15.161:0/140198608 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f77c800ae40 con 0x7f77d0153730 2024-01-17T22:59:47.243 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.243+0000 7f77c7400640 1 -- 172.21.15.161:0/140198608 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f77c8051b70 con 0x7f77d0153730 2024-01-17T22:59:47.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.431+0000 7f77d6400640 1 -- 172.21.15.161:0/140198608 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77d00746a0 con 0x7f77d0153730 2024-01-17T22:59:47.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.443+0000 7f77c7400640 1 -- 172.21.15.161:0/140198608 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6561 (secure 0 0 0) 0x7f77c8055190 con 0x7f77d0153730 2024-01-17T22:59:47.442 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:47.442 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6839/2820898287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":2820898287},{"type":"v1","addr":"172.21.15.161:6839","nonce":2820898287}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/2332272186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2332272186},{"type":"v1","addr":"172.21.15.190:6833","nonce":2332272186}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3170137737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3170137737},{"type":"v1","addr":"172.21.15.190:6835","nonce":3170137737}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-17T22:58:49.015246+0000","modified":"2024-01-17T22:59:32.464347+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4269,"mds_1":4263,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":17,"addr":"172.21.15.161:6835/1671527613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1671527613},{"type":"v1","addr":"172.21.15.161:6835","nonce":1671527613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4263":{"gid":4263,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":16,"addr":"172.21.15.161:6837/409686078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":409686078},{"type":"v1","addr":"172.21.15.161:6837","nonce":409686078}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4269":{"gid":4269,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":7,"addr":"172.21.15.190:6837/561131647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":561131647},{"type":"v1","addr":"172.21.15.190:6837","nonce":561131647}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-17T22:59:47.442 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 15 2024-01-17T22:59:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.443+0000 7f77d6400640 1 -- 172.21.15.161:0/140198608 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f77a8066890 msgr2=0x7f77a8068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.443+0000 7f77d6400640 1 --2- 172.21.15.161:0/140198608 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f77a8066890 0x7f77a8068d50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f77c00b2000 tx=0x7f77c00aa070 comp rx=0 tx=0).stop 2024-01-17T22:59:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.443+0000 7f77d6400640 1 -- 172.21.15.161:0/140198608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77d0153730 msgr2=0x7f77d015bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.443+0000 7f77d6400640 1 --2- 172.21.15.161:0/140198608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77d0153730 0x7f77d015bd70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f77c800c760 tx=0x7f77c800cc20 comp rx=0 tx=0).stop 2024-01-17T22:59:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.443+0000 7f77d6400640 1 -- 172.21.15.161:0/140198608 shutdown_connections 2024-01-17T22:59:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.443+0000 7f77d6400640 1 --2- 172.21.15.161:0/140198608 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f77a8066890 0x7f77a8068d50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.443+0000 7f77d6400640 1 --2- 172.21.15.161:0/140198608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77d0153730 0x7f77d015bd70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.443+0000 7f77d6400640 1 --2- 172.21.15.161:0/140198608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d00cda40 0x7f77d01562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.443+0000 7f77d6400640 1 --2- 172.21.15.161:0/140198608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77d0071360 0x7f77d014d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:47.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.443+0000 7f77d6400640 1 -- 172.21.15.161:0/140198608 >> 172.21.15.161:0/140198608 conn(0x7f77d0070460 msgr2=0x7f77d00c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:47.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.443+0000 7f77d6400640 1 -- 172.21.15.161:0/140198608 shutdown_connections 2024-01-17T22:59:47.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.443+0000 7f77d6400640 1 -- 172.21.15.161:0/140198608 wait complete. 2024-01-17T22:59:47.464 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T22:59:47.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.603+0000 7f2038400640 1 Processor -- start 2024-01-17T22:59:47.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.603+0000 7f2038400640 1 -- start start 2024-01-17T22:59:47.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.603+0000 7f2038400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f20301517a0 0x7f203006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:47.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.603+0000 7f2038400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f203006d210 0x7f2030072300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:47.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.603+0000 7f2038400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203015b9c0 con 0x7f2030072840 2024-01-17T22:59:47.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.603+0000 7f2038400640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203015ae40 con 0x7f20301517a0 2024-01-17T22:59:47.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.603+0000 7f2038400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203015b120 con 0x7f203006d210 2024-01-17T22:59:47.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.603+0000 7f2036400640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f2030072840 0x7f2030157bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:54086/0 (socket says 172.21.15.161:54086) 2024-01-17T22:59:47.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.603+0000 7f2036400640 1 -- 172.21.15.161:0/2375642081 learned_addr learned my addr 172.21.15.161:0/2375642081 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-17T22:59:47.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.603+0000 7f2035a00640 1 --2- 172.21.15.161:0/2375642081 >> v2:172.21.15.190:3300/0 conn(0x7f20301517a0 0x7f203006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:47.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.603+0000 7f2035000640 1 --2- 172.21.15.161:0/2375642081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f203006d210 0x7f2030072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:47.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.607+0000 7f202fe00640 1 -- 172.21.15.161:0/2375642081 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351972496 0 0) 0x7f203015b9c0 con 0x7f2030072840 2024-01-17T22:59:47.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.607+0000 7f202fe00640 1 -- 172.21.15.161:0/2375642081 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2010003530 con 0x7f2030072840 2024-01-17T22:59:47.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.611+0000 7f2035000640 1 -- 172.21.15.161:0/2375642081 >> v2:172.21.15.190:3300/0 conn(0x7f20301517a0 msgr2=0x7f203006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:47.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.611+0000 7f2035000640 1 --2- 172.21.15.161:0/2375642081 >> v2:172.21.15.190:3300/0 conn(0x7f20301517a0 0x7f203006ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:47.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.611+0000 7f2035000640 1 -- 172.21.15.161:0/2375642081 >> v1:172.21.15.161:6789/0 conn(0x7f2030072840 legacy=0x7f2030157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:47.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.611+0000 7f2035000640 1 -- 172.21.15.161:0/2375642081 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203015b400 con 0x7f203006d210 2024-01-17T22:59:47.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.619+0000 7f2035000640 1 --2- 172.21.15.161:0/2375642081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f203006d210 0x7f2030072300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f20180097c0 tx=0x7f201801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d75d6fd91141cd20 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.627+0000 7f202fe00640 1 -- 172.21.15.161:0/2375642081 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20180ad660 con 0x7f203006d210 2024-01-17T22:59:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.627+0000 7f202fe00640 1 -- 172.21.15.161:0/2375642081 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20180ad7c0 con 0x7f203006d210 2024-01-17T22:59:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.627+0000 7f202fe00640 1 -- 172.21.15.161:0/2375642081 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20180adb50 con 0x7f203006d210 2024-01-17T22:59:47.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.627+0000 7f2038400640 1 -- 172.21.15.161:0/2375642081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f203006d210 msgr2=0x7f2030072300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:47.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.627+0000 7f2038400640 1 --2- 172.21.15.161:0/2375642081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f203006d210 0x7f2030072300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f20180097c0 tx=0x7f201801c450 comp rx=0 tx=0).stop 2024-01-17T22:59:47.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.627+0000 7f2038400640 1 -- 172.21.15.161:0/2375642081 shutdown_connections 2024-01-17T22:59:47.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.627+0000 7f2038400640 1 --2- 172.21.15.161:0/2375642081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f203006d210 0x7f2030072300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:47.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.627+0000 7f2038400640 1 --2- 172.21.15.161:0/2375642081 >> v2:172.21.15.190:3300/0 conn(0x7f20301517a0 0x7f203006ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:47.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.627+0000 7f2038400640 1 -- 172.21.15.161:0/2375642081 >> 172.21.15.161:0/2375642081 conn(0x7f20300cb070 msgr2=0x7f20300cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:47.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.627+0000 7f2038400640 1 -- 172.21.15.161:0/2375642081 shutdown_connections 2024-01-17T22:59:47.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.627+0000 7f2038400640 1 -- 172.21.15.161:0/2375642081 wait complete. 2024-01-17T22:59:47.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.631+0000 7f2038400640 1 Processor -- start 2024-01-17T22:59:47.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.631+0000 7f2038400640 1 -- start start 2024-01-17T22:59:47.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.631+0000 7f2038400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f203006d210 0x7f203013def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:47.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.631+0000 7f2038400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2030072840 0x7f20301f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:47.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.631+0000 7f2038400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20301517a0 0x7f20301f1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:47.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.631+0000 7f2038400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203013e430 con 0x7f20301517a0 2024-01-17T22:59:47.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.631+0000 7f2038400640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2030142e40 con 0x7f2030072840 2024-01-17T22:59:47.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.631+0000 7f2038400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2030161aa0 con 0x7f203006d210 2024-01-17T22:59:47.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.631+0000 7f2036400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20301517a0 0x7f20301f1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.631+0000 7f2036400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20301517a0 0x7f20301f1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49744/0 (socket says 172.21.15.161:49744) 2024-01-17T22:59:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.631+0000 7f2036400640 1 -- 172.21.15.161:0/3270346114 learned_addr learned my addr 172.21.15.161:0/3270346114 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.631+0000 7f2035000640 1 --2- 172.21.15.161:0/3270346114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2030072840 0x7f20301f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.631+0000 7f2035a00640 1 --2- 172.21.15.161:0/3270346114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f203006d210 0x7f203013def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.635+0000 7f2036400640 1 -- 172.21.15.161:0/3270346114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f203006d210 msgr2=0x7f203013def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.635+0000 7f2036400640 1 --2- 172.21.15.161:0/3270346114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f203006d210 0x7f203013def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.635+0000 7f2036400640 1 -- 172.21.15.161:0/3270346114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2030072840 msgr2=0x7f20301f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.635+0000 7f2036400640 1 --2- 172.21.15.161:0/3270346114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2030072840 0x7f20301f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.635+0000 7f2036400640 1 -- 172.21.15.161:0/3270346114 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2018009420 con 0x7f20301517a0 2024-01-17T22:59:47.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.639+0000 7f2036400640 1 --2- 172.21.15.161:0/3270346114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20301517a0 0x7f20301f1e20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f202800cb40 tx=0x7f202800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:47.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.643+0000 7f202d600640 1 -- 172.21.15.161:0/3270346114 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202800ac40 con 0x7f20301517a0 2024-01-17T22:59:47.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.643+0000 7f202d600640 1 -- 172.21.15.161:0/3270346114 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202800ada0 con 0x7f20301517a0 2024-01-17T22:59:47.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.643+0000 7f202d600640 1 -- 172.21.15.161:0/3270346114 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2028012620 con 0x7f20301517a0 2024-01-17T22:59:47.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.643+0000 7f2038400640 1 -- 172.21.15.161:0/3270346114 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20301f5bd0 con 0x7f20301517a0 2024-01-17T22:59:47.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.643+0000 7f2038400640 1 -- 172.21.15.161:0/3270346114 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20301425a0 con 0x7f20301517a0 2024-01-17T22:59:47.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.643+0000 7f2038400640 1 -- 172.21.15.161:0/3270346114 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20300746a0 con 0x7f20301517a0 2024-01-17T22:59:47.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.663+0000 7f202d600640 1 -- 172.21.15.161:0/3270346114 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f2028007070 con 0x7f20301517a0 2024-01-17T22:59:47.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.663+0000 7f202d600640 1 --2- 172.21.15.161:0/3270346114 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f20080668c0 0x7f2008068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:47.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.667+0000 7f2035a00640 1 --2- 172.21.15.161:0/3270346114 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f20080668c0 0x7f2008068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:47.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.667+0000 7f2035a00640 1 --2- 172.21.15.161:0/3270346114 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f20080668c0 0x7f2008068d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2020009b60 tx=0x7f2020009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:47.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.667+0000 7f202d600640 1 -- 172.21.15.161:0/3270346114 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f2028055550 con 0x7f20301517a0 2024-01-17T22:59:47.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:47.903+0000 7f202d600640 1 -- 172.21.15.161:0/3270346114 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f2028051890 con 0x7f20301517a0 2024-01-17T22:59:48.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.063+0000 7f2038400640 1 -- 172.21.15.161:0/3270346114 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20300c2040 con 0x7f20301517a0 2024-01-17T22:59:48.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.103+0000 7f202d600640 1 -- 172.21.15.161:0/3270346114 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18587 (secure 0 0 0) 0x7f2028054eb0 con 0x7f20301517a0 2024-01-17T22:59:48.103 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:48.103 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":28,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:59:08.571619+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T22:58:46.757110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T22:58:47.930512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T22:58:53.561624+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.614036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.746767+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.689096+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.706485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.628004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.680048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.571249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]},{"pgid":"4.14","mappings":[{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:59:48.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.107+0000 7f2038400640 1 -- 172.21.15.161:0/3270346114 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f20080668c0 msgr2=0x7f2008068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:48.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.107+0000 7f2038400640 1 --2- 172.21.15.161:0/3270346114 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f20080668c0 0x7f2008068d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2020009b60 tx=0x7f2020009190 comp rx=0 tx=0).stop 2024-01-17T22:59:48.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.107+0000 7f2038400640 1 -- 172.21.15.161:0/3270346114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20301517a0 msgr2=0x7f20301f1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:48.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.107+0000 7f2038400640 1 --2- 172.21.15.161:0/3270346114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20301517a0 0x7f20301f1e20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f202800cb40 tx=0x7f202800a060 comp rx=0 tx=0).stop 2024-01-17T22:59:48.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.107+0000 7f2038400640 1 -- 172.21.15.161:0/3270346114 shutdown_connections 2024-01-17T22:59:48.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.107+0000 7f2038400640 1 --2- 172.21.15.161:0/3270346114 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f20080668c0 0x7f2008068d80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.107+0000 7f2038400640 1 --2- 172.21.15.161:0/3270346114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2030072840 0x7f20301f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.107+0000 7f2038400640 1 --2- 172.21.15.161:0/3270346114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20301517a0 0x7f20301f1e20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.107+0000 7f2038400640 1 --2- 172.21.15.161:0/3270346114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f203006d210 0x7f203013def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.107+0000 7f2038400640 1 -- 172.21.15.161:0/3270346114 >> 172.21.15.161:0/3270346114 conn(0x7f20300cb070 msgr2=0x7f2030073e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:48.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.107+0000 7f2038400640 1 -- 172.21.15.161:0/3270346114 shutdown_connections 2024-01-17T22:59:48.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.107+0000 7f2038400640 1 -- 172.21.15.161:0/3270346114 wait complete. 2024-01-17T22:59:48.128 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T22:59:48.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.267+0000 7f43a0200640 1 Processor -- start 2024-01-17T22:59:48.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.267+0000 7f43a0200640 1 -- start start 2024-01-17T22:59:48.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.271+0000 7f43a0200640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4398153ed0 0x7f439815a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:48.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.271+0000 7f43a0200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f439806b7f0 0x7f439815cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:48.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.271+0000 7f43a0200640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439806bc70 con 0x7f4398153af0 2024-01-17T22:59:48.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.271+0000 7f43a0200640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439815d7e0 con 0x7f4398153ed0 2024-01-17T22:59:48.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.271+0000 7f43a0200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439815dd80 con 0x7f439806b7f0 2024-01-17T22:59:48.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.271+0000 7f439e200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f439806b7f0 0x7f439815cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:48.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.271+0000 7f439ce00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4398153ed0 0x7f439815a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:48.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.271+0000 7f439e200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f439806b7f0 0x7f439815cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:50726/0 (socket says 172.21.15.161:50726) 2024-01-17T22:59:48.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.271+0000 7f439e200640 1 -- 172.21.15.161:0/3079122232 learned_addr learned my addr 172.21.15.161:0/3079122232 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:48.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.279+0000 7f439e200640 1 -- 172.21.15.161:0/3079122232 >> v2:172.21.15.190:3300/0 conn(0x7f4398153ed0 msgr2=0x7f439815a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:48.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.279+0000 7f439e200640 1 --2- 172.21.15.161:0/3079122232 >> v2:172.21.15.190:3300/0 conn(0x7f4398153ed0 0x7f439815a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.279+0000 7f439e200640 1 -- 172.21.15.161:0/3079122232 >> v1:172.21.15.190:6789/0 conn(0x7f4398153af0 legacy=0x7f43980ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:48.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.279+0000 7f439e200640 1 -- 172.21.15.161:0/3079122232 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439815daa0 con 0x7f439806b7f0 2024-01-17T22:59:48.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.283+0000 7f439e200640 1 --2- 172.21.15.161:0/3079122232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f439806b7f0 0x7f439815cee0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4390009e50 tx=0x7f439001c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60586f069a621673 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:48.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.295+0000 7f4397e00640 1 -- 172.21.15.161:0/3079122232 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43900a5790 con 0x7f439806b7f0 2024-01-17T22:59:48.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.295+0000 7f4397e00640 1 -- 172.21.15.161:0/3079122232 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43900a58f0 con 0x7f439806b7f0 2024-01-17T22:59:48.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.295+0000 7f4397e00640 1 -- 172.21.15.161:0/3079122232 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43900a5c80 con 0x7f439806b7f0 2024-01-17T22:59:48.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.295+0000 7f43a0200640 1 -- 172.21.15.161:0/3079122232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f439806b7f0 msgr2=0x7f439815cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:48.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.295+0000 7f43a0200640 1 --2- 172.21.15.161:0/3079122232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f439806b7f0 0x7f439815cee0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4390009e50 tx=0x7f439001c910 comp rx=0 tx=0).stop 2024-01-17T22:59:48.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.295+0000 7f43a0200640 1 -- 172.21.15.161:0/3079122232 shutdown_connections 2024-01-17T22:59:48.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.295+0000 7f43a0200640 1 --2- 172.21.15.161:0/3079122232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f439806b7f0 0x7f439815cee0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.295+0000 7f43a0200640 1 --2- 172.21.15.161:0/3079122232 >> v2:172.21.15.190:3300/0 conn(0x7f4398153ed0 0x7f439815a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.295+0000 7f43a0200640 1 -- 172.21.15.161:0/3079122232 >> 172.21.15.161:0/3079122232 conn(0x7f43980704f0 msgr2=0x7f439806f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:48.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.295+0000 7f43a0200640 1 -- 172.21.15.161:0/3079122232 shutdown_connections 2024-01-17T22:59:48.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.295+0000 7f43a0200640 1 -- 172.21.15.161:0/3079122232 wait complete. 2024-01-17T22:59:48.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.299+0000 7f43a0200640 1 Processor -- start 2024-01-17T22:59:48.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.299+0000 7f43a0200640 1 -- start start 2024-01-17T22:59:48.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.299+0000 7f43a0200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f439806b7f0 0x7f4398156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:48.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.299+0000 7f43a0200640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4398153af0 0x7f439813db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:48.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.299+0000 7f43a0200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4398153ed0 0x7f439813e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:48.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.299+0000 7f43a0200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439813d670 con 0x7f439806b7f0 2024-01-17T22:59:48.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.299+0000 7f43a0200640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439813f250 con 0x7f4398153af0 2024-01-17T22:59:48.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.299+0000 7f43a0200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439813ed90 con 0x7f4398153ed0 2024-01-17T22:59:48.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.299+0000 7f439d800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f439806b7f0 0x7f4398156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:48.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.299+0000 7f439d800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f439806b7f0 0x7f4398156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49758/0 (socket says 172.21.15.161:49758) 2024-01-17T22:59:48.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.299+0000 7f439d800640 1 -- 172.21.15.161:0/441359072 learned_addr learned my addr 172.21.15.161:0/441359072 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:48.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.299+0000 7f439ce00640 1 --2- 172.21.15.161:0/441359072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4398153af0 0x7f439813db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:48.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.299+0000 7f439e200640 1 --2- 172.21.15.161:0/441359072 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4398153ed0 0x7f439813e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:48.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.303+0000 7f439d800640 1 -- 172.21.15.161:0/441359072 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4398153ed0 msgr2=0x7f439813e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:48.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.303+0000 7f439d800640 1 --2- 172.21.15.161:0/441359072 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4398153ed0 0x7f439813e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.303+0000 7f439d800640 1 -- 172.21.15.161:0/441359072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4398153af0 msgr2=0x7f439813db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:48.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.303+0000 7f439d800640 1 --2- 172.21.15.161:0/441359072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4398153af0 0x7f439813db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.303+0000 7f439d800640 1 -- 172.21.15.161:0/441359072 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4390009b30 con 0x7f439806b7f0 2024-01-17T22:59:48.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.307+0000 7f439d800640 1 --2- 172.21.15.161:0/441359072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f439806b7f0 0x7f4398156f60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f438800b410 tx=0x7f438800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:48.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.311+0000 7f4395600640 1 -- 172.21.15.161:0/441359072 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388004020 con 0x7f439806b7f0 2024-01-17T22:59:48.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.311+0000 7f4395600640 1 -- 172.21.15.161:0/441359072 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4388004180 con 0x7f439806b7f0 2024-01-17T22:59:48.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.311+0000 7f4395600640 1 -- 172.21.15.161:0/441359072 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388011630 con 0x7f439806b7f0 2024-01-17T22:59:48.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.311+0000 7f43a0200640 1 -- 172.21.15.161:0/441359072 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439813f4c0 con 0x7f439806b7f0 2024-01-17T22:59:48.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.311+0000 7f43a0200640 1 -- 172.21.15.161:0/441359072 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439813e7c0 con 0x7f439806b7f0 2024-01-17T22:59:48.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.311+0000 7f43a0200640 1 -- 172.21.15.161:0/441359072 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43980746a0 con 0x7f439806b7f0 2024-01-17T22:59:48.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.331+0000 7f4395600640 1 -- 172.21.15.161:0/441359072 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f4388011790 con 0x7f439806b7f0 2024-01-17T22:59:48.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.331+0000 7f4395600640 1 --2- 172.21.15.161:0/441359072 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4370066890 0x7f4370068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:48.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.331+0000 7f439ce00640 1 --2- 172.21.15.161:0/441359072 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4370066890 0x7f4370068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:48.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.335+0000 7f439ce00640 1 --2- 172.21.15.161:0/441359072 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4370066890 0x7f4370068d50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f439815c430 tx=0x7f4380009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:48.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.559+0000 7f4395600640 1 -- 172.21.15.161:0/441359072 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f438801be20 con 0x7f439806b7f0 2024-01-17T22:59:48.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.559+0000 7f4395600640 1 -- 172.21.15.161:0/441359072 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f4388051830 con 0x7f439806b7f0 2024-01-17T22:59:48.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.763+0000 7f43a0200640 1 -- 172.21.15.161:0/441359072 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43980c9c10 con 0x7f439806b7f0 2024-01-17T22:59:48.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.775+0000 7f4395600640 1 -- 172.21.15.161:0/441359072 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6561 (secure 0 0 0) 0x7f4388015020 con 0x7f439806b7f0 2024-01-17T22:59:48.776 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-17T22:59:48.776 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6839/2820898287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":2820898287},{"type":"v1","addr":"172.21.15.161:6839","nonce":2820898287}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/2332272186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2332272186},{"type":"v1","addr":"172.21.15.190:6833","nonce":2332272186}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3170137737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3170137737},{"type":"v1","addr":"172.21.15.190:6835","nonce":3170137737}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-17T22:58:49.015246+0000","modified":"2024-01-17T22:59:32.464347+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4269,"mds_1":4263,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":17,"addr":"172.21.15.161:6835/1671527613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1671527613},{"type":"v1","addr":"172.21.15.161:6835","nonce":1671527613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4263":{"gid":4263,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":16,"addr":"172.21.15.161:6837/409686078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":409686078},{"type":"v1","addr":"172.21.15.161:6837","nonce":409686078}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4269":{"gid":4269,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":7,"addr":"172.21.15.190:6837/561131647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":561131647},{"type":"v1","addr":"172.21.15.190:6837","nonce":561131647}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-17T22:59:48.776 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 15 2024-01-17T22:59:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.779+0000 7f43a0200640 1 -- 172.21.15.161:0/441359072 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4370066890 msgr2=0x7f4370068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.779+0000 7f43a0200640 1 --2- 172.21.15.161:0/441359072 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4370066890 0x7f4370068d50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f439815c430 tx=0x7f4380009190 comp rx=0 tx=0).stop 2024-01-17T22:59:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.779+0000 7f43a0200640 1 -- 172.21.15.161:0/441359072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f439806b7f0 msgr2=0x7f4398156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.779+0000 7f43a0200640 1 --2- 172.21.15.161:0/441359072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f439806b7f0 0x7f4398156f60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f438800b410 tx=0x7f438800b8d0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.779+0000 7f43a0200640 1 -- 172.21.15.161:0/441359072 shutdown_connections 2024-01-17T22:59:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.779+0000 7f43a0200640 1 --2- 172.21.15.161:0/441359072 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4370066890 0x7f4370068d50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.779+0000 7f43a0200640 1 --2- 172.21.15.161:0/441359072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4398153af0 0x7f439813db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.779+0000 7f43a0200640 1 --2- 172.21.15.161:0/441359072 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4398153ed0 0x7f439813e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.779+0000 7f43a0200640 1 --2- 172.21.15.161:0/441359072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f439806b7f0 0x7f4398156f60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.779+0000 7f43a0200640 1 -- 172.21.15.161:0/441359072 >> 172.21.15.161:0/441359072 conn(0x7f43980704f0 msgr2=0x7f43980c8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:48.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.779+0000 7f43a0200640 1 -- 172.21.15.161:0/441359072 shutdown_connections 2024-01-17T22:59:48.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:48.779+0000 7f43a0200640 1 -- 172.21.15.161:0/441359072 wait complete. 2024-01-17T22:59:49.402 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-17T22:58:49.015246+0000', 'modified': '2024-01-17T22:59:32.464347+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4269, 'mds_1': 4263, 'mds_2': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'c', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.161:6835/1671527613', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6834', 'nonce': 1671527613}, {'type': 'v1', 'addr': '172.21.15.161:6835', 'nonce': 1671527613}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4263': {'gid': 4263, 'name': 'e', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.161:6837/409686078', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6836', 'nonce': 409686078}, {'type': 'v1', 'addr': '172.21.15.161:6837', 'nonce': 409686078}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4269': {'gid': 4269, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.190:6837/561131647', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6836', 'nonce': 561131647}, {'type': 'v1', 'addr': '172.21.15.190:6837', 'nonce': 561131647}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-17T22:59:49.403 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-01-17T22:59:49.403 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-17T22:59:49.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.543+0000 7f3eeb200640 1 Processor -- start 2024-01-17T22:59:49.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.543+0000 7f3eeb200640 1 -- start start 2024-01-17T22:59:49.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.543+0000 7f3eeb200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3ee406f3f0 0x7f3ee40c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.543+0000 7f3eeb200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ee40c6060 0x7f3ee4155e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.543+0000 7f3eeb200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee40c6860 con 0x7f3ee406f7d0 2024-01-17T22:59:49.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.543+0000 7f3eeb200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee40c73e0 con 0x7f3ee406f3f0 2024-01-17T22:59:49.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.543+0000 7f3eeb200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40c7e10 con 0x7f3ee40c6060 2024-01-17T22:59:49.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.543+0000 7f3ee3e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3ee406f3f0 0x7f3ee40c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.543+0000 7f3ee3e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3ee406f3f0 0x7f3ee40c77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49762/0 (socket says 172.21.15.161:49762) 2024-01-17T22:59:49.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.543+0000 7f3ee3e00640 1 -- 172.21.15.161:0/2693391638 learned_addr learned my addr 172.21.15.161:0/2693391638 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:49.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.543+0000 7f3ee9200640 1 --2- 172.21.15.161:0/2693391638 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ee40c6060 0x7f3ee4155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.547+0000 7f3ee3e00640 1 -- 172.21.15.161:0/2693391638 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ee40c6060 msgr2=0x7f3ee4155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:49.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.547+0000 7f3ee3e00640 1 --2- 172.21.15.161:0/2693391638 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ee40c6060 0x7f3ee4155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.547+0000 7f3ee3e00640 1 -- 172.21.15.161:0/2693391638 >> v1:172.21.15.161:6789/0 conn(0x7f3ee406f7d0 legacy=0x7f3ee414fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:49.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.547+0000 7f3ee3e00640 1 -- 172.21.15.161:0/2693391638 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee40c6ab0 con 0x7f3ee406f3f0 2024-01-17T22:59:49.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.551+0000 7f3ee3e00640 1 --2- 172.21.15.161:0/2693391638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee406f3f0 0x7f3ee40c77d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009870 tx=0x7f3ed401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d905793288b942e server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:49.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.555+0000 7f3ee2a00640 1 -- 172.21.15.161:0/2693391638 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed40a8a30 con 0x7f3ee406f3f0 2024-01-17T22:59:49.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.555+0000 7f3ee2a00640 1 -- 172.21.15.161:0/2693391638 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed40a8b90 con 0x7f3ee406f3f0 2024-01-17T22:59:49.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.555+0000 7f3ee2a00640 1 -- 172.21.15.161:0/2693391638 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed40b0440 con 0x7f3ee406f3f0 2024-01-17T22:59:49.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.555+0000 7f3eeb200640 1 -- 172.21.15.161:0/2693391638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee406f3f0 msgr2=0x7f3ee40c77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.555+0000 7f3eeb200640 1 --2- 172.21.15.161:0/2693391638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee406f3f0 0x7f3ee40c77d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009870 tx=0x7f3ed401ed30 comp rx=0 tx=0).stop 2024-01-17T22:59:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.555+0000 7f3eeb200640 1 -- 172.21.15.161:0/2693391638 shutdown_connections 2024-01-17T22:59:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.555+0000 7f3eeb200640 1 --2- 172.21.15.161:0/2693391638 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ee40c6060 0x7f3ee4155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.555+0000 7f3eeb200640 1 --2- 172.21.15.161:0/2693391638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee406f3f0 0x7f3ee40c77d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.555+0000 7f3eeb200640 1 -- 172.21.15.161:0/2693391638 >> 172.21.15.161:0/2693391638 conn(0x7f3ee40c8160 msgr2=0x7f3ee40c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.555+0000 7f3eeb200640 1 -- 172.21.15.161:0/2693391638 shutdown_connections 2024-01-17T22:59:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.555+0000 7f3eeb200640 1 -- 172.21.15.161:0/2693391638 wait complete. 2024-01-17T22:59:49.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.559+0000 7f3eeb200640 1 Processor -- start 2024-01-17T22:59:49.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.559+0000 7f3eeb200640 1 -- start start 2024-01-17T22:59:49.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.559+0000 7f3eeb200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ee406f3f0 0x7f3ee41f2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.559+0000 7f3eeb200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee406f7d0 0x7f3ee414dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.559+0000 7f3eeb200640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ee40c6060 0x7f3ee414e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.559+0000 7f3eeb200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee4149060 con 0x7f3ee406f7d0 2024-01-17T22:59:49.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.559+0000 7f3eeb200640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee41f2450 con 0x7f3ee40c6060 2024-01-17T22:59:49.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.559+0000 7f3eeb200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee4144950 con 0x7f3ee406f3f0 2024-01-17T22:59:49.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.559+0000 7f3ee3400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee406f7d0 0x7f3ee414dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.559+0000 7f3ee3400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee406f7d0 0x7f3ee414dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49764/0 (socket says 172.21.15.161:49764) 2024-01-17T22:59:49.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.559+0000 7f3ee3400640 1 -- 172.21.15.161:0/2923013946 learned_addr learned my addr 172.21.15.161:0/2923013946 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:49.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.559+0000 7f3ee9200640 1 --2- 172.21.15.161:0/2923013946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ee40c6060 0x7f3ee414e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.559+0000 7f3ee3e00640 1 --2- 172.21.15.161:0/2923013946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ee406f3f0 0x7f3ee41f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.563+0000 7f3ee3400640 1 -- 172.21.15.161:0/2923013946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ee406f3f0 msgr2=0x7f3ee41f2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.563+0000 7f3ee3400640 1 --2- 172.21.15.161:0/2923013946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ee406f3f0 0x7f3ee41f2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.563+0000 7f3ee3400640 1 -- 172.21.15.161:0/2923013946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ee40c6060 msgr2=0x7f3ee414e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.563+0000 7f3ee3400640 1 --2- 172.21.15.161:0/2923013946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ee40c6060 0x7f3ee414e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.563+0000 7f3ee3400640 1 -- 172.21.15.161:0/2923013946 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed40094d0 con 0x7f3ee406f7d0 2024-01-17T22:59:49.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.567+0000 7f3ee3400640 1 --2- 172.21.15.161:0/2923013946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee406f7d0 0x7f3ee414dfa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00c430 tx=0x7f3ecc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:49.569 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.571+0000 7f3edbe00640 1 -- 172.21.15.161:0/2923013946 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc0052d0 con 0x7f3ee406f7d0 2024-01-17T22:59:49.569 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.571+0000 7f3edbe00640 1 -- 172.21.15.161:0/2923013946 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc005430 con 0x7f3ee406f7d0 2024-01-17T22:59:49.569 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.571+0000 7f3edbe00640 1 -- 172.21.15.161:0/2923013946 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc007260 con 0x7f3ee406f7d0 2024-01-17T22:59:49.569 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.571+0000 7f3eeb200640 1 -- 172.21.15.161:0/2923013946 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee4148d80 con 0x7f3ee406f7d0 2024-01-17T22:59:49.569 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.571+0000 7f3eeb200640 1 -- 172.21.15.161:0/2923013946 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee4144e40 con 0x7f3ee406f7d0 2024-01-17T22:59:49.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.571+0000 7f3eee753000 1 Processor -- start 2024-01-17T22:59:49.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.575+0000 7f3eee753000 1 -- start start 2024-01-17T22:59:49.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.575+0000 7f3eee753000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb30730 0x561bdbb30b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.575+0000 7f3eee753000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb6b7d0 0x561bdbb6bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.575+0000 7f3eee753000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb6c0f0 0x561bdbb76a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.575+0000 7f3eee753000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bdb986d70 con 0x561bdbb6b7d0 2024-01-17T22:59:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.575+0000 7f3eee753000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bdb982ba0 con 0x561bdbb30730 2024-01-17T22:59:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.575+0000 7f3eee753000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x561bdb9800d0 con 0x561bdbb6c0f0 2024-01-17T22:59:49.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.579+0000 7f3ee9200640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb30730 0x561bdbb30b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.579+0000 7f3ee3400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb6c0f0 0x561bdbb76a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.579+0000 7f3ee9200640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb30730 0x561bdbb30b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:38020/0 (socket says 172.21.15.161:38020) 2024-01-17T22:59:49.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.579+0000 7f3ee9200640 1 -- 172.21.15.161:0/1322252515 learned_addr learned my addr 172.21.15.161:0/1322252515 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.583+0000 7f3ee9200640 1 -- 172.21.15.161:0/1322252515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb6c0f0 msgr2=0x561bdbb76a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.583+0000 7f3ee9200640 1 --2- 172.21.15.161:0/1322252515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb6c0f0 0x561bdbb76a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.583+0000 7f3ee9200640 1 -- 172.21.15.161:0/1322252515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb6b7d0 msgr2=0x561bdbb6bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.583+0000 7f3ee9200640 1 --2- 172.21.15.161:0/1322252515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb6b7d0 0x561bdbb6bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.583+0000 7f3ee9200640 1 -- 172.21.15.161:0/1322252515 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bdb672890 con 0x561bdbb30730 2024-01-17T22:59:49.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.587+0000 7f3ee9200640 1 --2- 172.21.15.161:0/1322252515 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb30730 0x561bdbb30b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3edc011550 tx=0x7f3edc009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46f7ea07e06ccc0f server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:49.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.591+0000 7f3edbe00640 1 -- 172.21.15.161:0/2923013946 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f3ecc007560 con 0x7f3ee406f7d0 2024-01-17T22:59:49.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.591+0000 7f3edbe00640 1 --2- 172.21.15.161:0/2923013946 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3ebc066890 0x7f3ebc068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.591+0000 7f3ee3e00640 1 --2- 172.21.15.161:0/2923013946 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3ebc066890 0x7f3ebc068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.591+0000 7f3ee3e00640 1 --2- 172.21.15.161:0/2923013946 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3ebc066890 0x7f3ebc068d50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40b2000 tx=0x7f3ed4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:49.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.595+0000 7f3edbe00640 1 -- 172.21.15.161:0/2923013946 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f3ecc0549b0 con 0x7f3ee406f7d0 2024-01-17T22:59:49.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.595+0000 7f3ed8c00640 1 -- 172.21.15.161:0/1322252515 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc00e040 con 0x561bdbb30730 2024-01-17T22:59:49.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.595+0000 7f3ed8c00640 1 -- 172.21.15.161:0/1322252515 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc00f040 con 0x561bdbb30730 2024-01-17T22:59:49.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.595+0000 7f3ed8c00640 1 -- 172.21.15.161:0/1322252515 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc015a60 con 0x561bdbb30730 2024-01-17T22:59:49.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.595+0000 7f3eee753000 1 -- 172.21.15.161:0/1322252515 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb30730 msgr2=0x561bdbb30b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:49.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.595+0000 7f3eee753000 1 --2- 172.21.15.161:0/1322252515 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb30730 0x561bdbb30b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3edc011550 tx=0x7f3edc009750 comp rx=0 tx=0).stop 2024-01-17T22:59:49.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.595+0000 7f3eee753000 1 -- 172.21.15.161:0/1322252515 shutdown_connections 2024-01-17T22:59:49.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.595+0000 7f3eee753000 1 --2- 172.21.15.161:0/1322252515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb6c0f0 0x561bdbb76a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.595+0000 7f3eee753000 1 --2- 172.21.15.161:0/1322252515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb6b7d0 0x561bdbb6bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.595+0000 7f3eee753000 1 --2- 172.21.15.161:0/1322252515 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb30730 0x561bdbb30b10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.595+0000 7f3eee753000 1 -- 172.21.15.161:0/1322252515 >> 172.21.15.161:0/1322252515 conn(0x561bdbb67580 msgr2=0x561bdbb69970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:49.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.595+0000 7f3eee753000 1 -- 172.21.15.161:0/1322252515 shutdown_connections 2024-01-17T22:59:49.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.595+0000 7f3eee753000 1 -- 172.21.15.161:0/1322252515 wait complete. 2024-01-17T22:59:49.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.595+0000 7f3eee753000 1 -- start start 2024-01-17T22:59:49.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.599+0000 7f3eee753000 1 Processor -- start 2024-01-17T22:59:49.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.599+0000 7f3eee753000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb30730 0x561bdbb65d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.599+0000 7f3eee753000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb6b7d0 0x561bdbb66240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.599+0000 7f3eee753000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb6c0f0 0x561bdbb2b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.599+0000 7f3eee753000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bdb97b9c0 con 0x561bdbb30730 2024-01-17T22:59:49.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.599+0000 7f3eee753000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bdb933040 con 0x561bdbb6c0f0 2024-01-17T22:59:49.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.599+0000 7f3eee753000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x561bdb938ee0 con 0x561bdbb6b7d0 2024-01-17T22:59:49.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.599+0000 7f3eee753000 10 client.0 _ll_register_callbacks cb 0x561bdb9361b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-17T22:59:49.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.599+0000 7f3ee3e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb30730 0x561bdbb65d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.599+0000 7f3ee3e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb30730 0x561bdbb65d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49780/0 (socket says 172.21.15.161:49780) 2024-01-17T22:59:49.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.599+0000 7f3ee3e00640 1 -- 172.21.15.161:0/88677110 learned_addr learned my addr 172.21.15.161:0/88677110 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:49.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.599+0000 7f3ee3400640 1 --2- 172.21.15.161:0/88677110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb6b7d0 0x561bdbb66240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.603+0000 7f3ee9200640 1 --2- 172.21.15.161:0/88677110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb6c0f0 0x561bdbb2b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.603+0000 7f3ee3e00640 1 -- 172.21.15.161:0/88677110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb6b7d0 msgr2=0x561bdbb66240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:49.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.603+0000 7f3ee3e00640 1 --2- 172.21.15.161:0/88677110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb6b7d0 0x561bdbb66240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.603+0000 7f3ee3e00640 1 -- 172.21.15.161:0/88677110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb6c0f0 msgr2=0x561bdbb2b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:49.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.603+0000 7f3ee3e00640 1 --2- 172.21.15.161:0/88677110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb6c0f0 0x561bdbb2b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.603+0000 7f3ee3e00640 1 -- 172.21.15.161:0/88677110 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3edc011230 con 0x561bdbb30730 2024-01-17T22:59:49.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.603+0000 7f3ee3e00640 1 --2- 172.21.15.161:0/88677110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb30730 0x561bdbb65d00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3ed401f5d0 tx=0x7f3ed401d570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec07d1403a71da1 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:49.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.603+0000 7f3ed1600640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2024-01-17T22:59:49.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.607+0000 7f3ed1600640 1 -- 172.21.15.161:0/88677110 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed40b0d70 con 0x561bdbb30730 2024-01-17T22:59:49.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.607+0000 7f3ed1600640 1 -- 172.21.15.161:0/88677110 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f3ed40c5420 con 0x561bdbb30730 2024-01-17T22:59:49.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.607+0000 7f3eee753000 1 -- 172.21.15.161:0/88677110 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561bdb901e30 con 0x561bdbb30730 2024-01-17T22:59:49.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.611+0000 7f3ed1600640 1 -- 172.21.15.161:0/88677110 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ed40c55e0 con 0x561bdbb30730 2024-01-17T22:59:49.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.611+0000 7f3eee753000 10 client.4767 fetch_fsmap learned FSMap version 15 2024-01-17T22:59:49.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.611+0000 7f3eee753000 1 -- 172.21.15.161:0/88677110 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x561bdb93b5e0 con 0x561bdbb30730 2024-01-17T22:59:49.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.615+0000 7f3ed1600640 1 -- 172.21.15.161:0/88677110 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561bdb901e30 con 0x561bdbb30730 2024-01-17T22:59:49.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.615+0000 7f3ed1600640 1 -- 172.21.15.161:0/88677110 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 15) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f3ed40c5740 con 0x561bdbb30730 2024-01-17T22:59:49.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.615+0000 7f3eee753000 10 client.4767 fetch_fsmap finished waiting for FSMap version 15 2024-01-17T22:59:49.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.615+0000 7f3eee753000 10 client.4767 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-17T22:59:49.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.615+0000 7f3eee753000 20 client.4767 populate_metadata read hostname 'smithi161' 2024-01-17T22:59:49.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.615+0000 7f3eee753000 1 --2- 172.21.15.161:0/88677110 >> [v2:172.21.15.161:6834/1671527613,v1:172.21.15.161:6835/1671527613] conn(0x561bdbb2c650 0x561bdbb2ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.615+0000 7f3eee753000 4 client.4767 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-17T22:59:49.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.615+0000 7f3eee753000 1 -- 172.21.15.161:0/88677110 --> [v2:172.21.15.161:6834/1671527613,v1:172.21.15.161:6835/1671527613] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561bdb938870 con 0x561bdbb2c650 2024-01-17T22:59:49.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.615+0000 7f3ee3400640 1 --2- 172.21.15.161:0/88677110 >> [v2:172.21.15.161:6834/1671527613,v1:172.21.15.161:6835/1671527613] conn(0x561bdbb2c650 0x561bdbb2ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.655+0000 7f3ed1600640 10 client.4767 ms_handle_connect on v2:172.21.15.161:6834/1671527613 2024-01-17T22:59:49.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.655+0000 7f3ee3400640 1 --2- 172.21.15.161:0/88677110 >> [v2:172.21.15.161:6834/1671527613,v1:172.21.15.161:6835/1671527613] conn(0x561bdbb2c650 0x561bdbb2ca30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=26a2211821d11b0 server_cookie=c64d92e4049a7dce in_seq=0 out_seq=0 2024-01-17T22:59:49.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.755+0000 7f3ed1600640 1 -- 172.21.15.161:0/88677110 <== mds.2 v2:172.21.15.161:6834/1671527613 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561bdb938870 con 0x561bdbb2c650 2024-01-17T22:59:49.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.755+0000 7f3ed1600640 10 client.4767 handle_command_reply: tid=0 2024-01-17T22:59:49.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.755+0000 7f3eee753000 1 client.4767 shutdown 2024-01-17T22:59:49.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.759+0000 7f3eee753000 1 -- 172.21.15.161:0/88677110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb30730 msgr2=0x561bdbb65d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:49.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.759+0000 7f3eee753000 1 --2- 172.21.15.161:0/88677110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb30730 0x561bdbb65d00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3ed401f5d0 tx=0x7f3ed401d570 comp rx=0 tx=0).stop 2024-01-17T22:59:49.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.759+0000 7f3eee753000 1 -- 172.21.15.161:0/88677110 shutdown_connections 2024-01-17T22:59:49.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.759+0000 7f3eee753000 1 --2- 172.21.15.161:0/88677110 >> [v2:172.21.15.161:6834/1671527613,v1:172.21.15.161:6835/1671527613] conn(0x561bdbb2c650 0x561bdbb2ca30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.759+0000 7f3eee753000 1 --2- 172.21.15.161:0/88677110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb6c0f0 0x561bdbb2b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.759+0000 7f3eee753000 1 --2- 172.21.15.161:0/88677110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb6b7d0 0x561bdbb66240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.759+0000 7f3eee753000 1 --2- 172.21.15.161:0/88677110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb30730 0x561bdbb65d00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.759+0000 7f3ed1600640 0 client.4767 ms_handle_reset on v2:172.21.15.161:6834/1671527613 2024-01-17T22:59:49.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.759+0000 7f3eee753000 1 -- 172.21.15.161:0/88677110 >> 172.21.15.161:0/88677110 conn(0x561bdbb67580 msgr2=0x561bdbb66d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:49.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.759+0000 7f3eee753000 1 -- 172.21.15.161:0/88677110 shutdown_connections 2024-01-17T22:59:49.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.759+0000 7f3eee753000 1 -- 172.21.15.161:0/88677110 wait complete. 2024-01-17T22:59:49.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.759+0000 7f3eee753000 20 client.4767 trim_cache size 0 max 16384 2024-01-17T22:59:49.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.775+0000 7f3eee753000 1 Processor -- start 2024-01-17T22:59:49.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.775+0000 7f3eee753000 1 -- start start 2024-01-17T22:59:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.775+0000 7f3eee753000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb30730 0x561bdbb6afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.775+0000 7f3eee753000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb6b7d0 0x561bdbb663b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.775+0000 7f3eee753000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb6c0f0 0x561bdbb668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.775+0000 7f3eee753000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bdb633940 con 0x561bdbb6b7d0 2024-01-17T22:59:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.775+0000 7f3eee753000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bdb937e00 con 0x561bdbb6c0f0 2024-01-17T22:59:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.775+0000 7f3eee753000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x561bdbb15ca0 con 0x561bdbb30730 2024-01-17T22:59:49.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.775+0000 7f3ee3400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb6b7d0 0x561bdbb663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.775+0000 7f3ee3400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb6b7d0 0x561bdbb663b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49794/0 (socket says 172.21.15.161:49794) 2024-01-17T22:59:49.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.775+0000 7f3ee3400640 1 -- 172.21.15.161:0/3734994773 learned_addr learned my addr 172.21.15.161:0/3734994773 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:49.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.775+0000 7f3ee3e00640 1 --2- 172.21.15.161:0/3734994773 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb30730 0x561bdbb6afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.775+0000 7f3ee9200640 1 --2- 172.21.15.161:0/3734994773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb6c0f0 0x561bdbb668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.779+0000 7f3ee3400640 1 -- 172.21.15.161:0/3734994773 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb30730 msgr2=0x561bdbb6afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:49.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.779+0000 7f3ee3400640 1 --2- 172.21.15.161:0/3734994773 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb30730 0x561bdbb6afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.779+0000 7f3ee3400640 1 -- 172.21.15.161:0/3734994773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb6c0f0 msgr2=0x561bdbb668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:49.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.779+0000 7f3ee3400640 1 --2- 172.21.15.161:0/3734994773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb6c0f0 0x561bdbb668f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.779+0000 7f3ee3400640 1 -- 172.21.15.161:0/3734994773 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bdb9218e0 con 0x561bdbb6b7d0 2024-01-17T22:59:49.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.779+0000 7f3ee3400640 1 --2- 172.21.15.161:0/3734994773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb6b7d0 0x561bdbb663b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc054b70 tx=0x7f3ecc005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e14a97da4e74d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:49.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.783+0000 7f3ed3e00640 1 -- 172.21.15.161:0/3734994773 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc06c0b0 con 0x561bdbb6b7d0 2024-01-17T22:59:49.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.783+0000 7f3ed3e00640 1 -- 172.21.15.161:0/3734994773 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc06c210 con 0x561bdbb6b7d0 2024-01-17T22:59:49.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.783+0000 7f3ed3e00640 1 -- 172.21.15.161:0/3734994773 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc05ca00 con 0x561bdbb6b7d0 2024-01-17T22:59:49.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.783+0000 7f3eee753000 1 -- 172.21.15.161:0/3734994773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb6b7d0 msgr2=0x561bdbb663b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:49.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.783+0000 7f3eee753000 1 --2- 172.21.15.161:0/3734994773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb6b7d0 0x561bdbb663b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc054b70 tx=0x7f3ecc005040 comp rx=0 tx=0).stop 2024-01-17T22:59:49.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.783+0000 7f3eee753000 1 -- 172.21.15.161:0/3734994773 shutdown_connections 2024-01-17T22:59:49.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.783+0000 7f3eee753000 1 --2- 172.21.15.161:0/3734994773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb6c0f0 0x561bdbb668f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.783+0000 7f3eee753000 1 --2- 172.21.15.161:0/3734994773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb6b7d0 0x561bdbb663b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.783+0000 7f3eee753000 1 --2- 172.21.15.161:0/3734994773 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb30730 0x561bdbb6afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.783+0000 7f3eee753000 1 -- 172.21.15.161:0/3734994773 >> 172.21.15.161:0/3734994773 conn(0x561bdbb67580 msgr2=0x561bdbb86d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:49.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.783+0000 7f3eee753000 1 -- 172.21.15.161:0/3734994773 shutdown_connections 2024-01-17T22:59:49.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.783+0000 7f3eee753000 1 -- 172.21.15.161:0/3734994773 wait complete. 2024-01-17T22:59:49.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.787+0000 7f3eee753000 1 -- start start 2024-01-17T22:59:49.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.787+0000 7f3eee753000 1 Processor -- start 2024-01-17T22:59:49.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.787+0000 7f3eee753000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb30730 0x561bdbbcd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.787+0000 7f3eee753000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb6b7d0 0x561bdbbcdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.787+0000 7f3eee753000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb6c0f0 0x561bdbb85770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.787+0000 7f3eee753000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bdb9843f0 con 0x561bdbb6c0f0 2024-01-17T22:59:49.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.787+0000 7f3eee753000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bdb972a40 con 0x561bdbb6b7d0 2024-01-17T22:59:49.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.787+0000 7f3eee753000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x561bdb9835f0 con 0x561bdbb30730 2024-01-17T22:59:49.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.787+0000 7f3eee753000 10 client.0 _ll_register_callbacks cb 0x561bdb9a8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-17T22:59:49.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.787+0000 7f3ee3400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb6b7d0 0x561bdbbcdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.787+0000 7f3ee3400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb6b7d0 0x561bdbbcdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:38056/0 (socket says 172.21.15.161:38056) 2024-01-17T22:59:49.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.791+0000 7f3ee3400640 1 -- 172.21.15.161:0/214023539 learned_addr learned my addr 172.21.15.161:0/214023539 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:49.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.791+0000 7f3ee3e00640 1 --2- 172.21.15.161:0/214023539 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb30730 0x561bdbbcd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.791+0000 7f3ee9200640 1 --2- 172.21.15.161:0/214023539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb6c0f0 0x561bdbb85770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.791+0000 7f3ee9200640 1 -- 172.21.15.161:0/214023539 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb30730 msgr2=0x561bdbbcd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:49.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.791+0000 7f3ee9200640 1 --2- 172.21.15.161:0/214023539 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb30730 0x561bdbbcd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.791+0000 7f3ee9200640 1 -- 172.21.15.161:0/214023539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb6b7d0 msgr2=0x561bdbbcdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:49.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.791+0000 7f3ee9200640 1 --2- 172.21.15.161:0/214023539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb6b7d0 0x561bdbbcdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.791+0000 7f3ee9200640 1 -- 172.21.15.161:0/214023539 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee4144e40 con 0x561bdbb6c0f0 2024-01-17T22:59:49.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.795+0000 7f3ee9200640 1 --2- 172.21.15.161:0/214023539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb6c0f0 0x561bdbb85770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3edc007220 tx=0x7f3edc004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9324f67272ce3713 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:49.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.795+0000 7f3ed1600640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2024-01-17T22:59:49.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.799+0000 7f3ed1600640 1 -- 172.21.15.161:0/214023539 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc021040 con 0x561bdbb6c0f0 2024-01-17T22:59:49.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.799+0000 7f3ed1600640 1 -- 172.21.15.161:0/214023539 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f3edc003e40 con 0x561bdbb6c0f0 2024-01-17T22:59:49.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.799+0000 7f3eee753000 1 -- 172.21.15.161:0/214023539 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561bdbb29bc0 con 0x561bdbb6c0f0 2024-01-17T22:59:49.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.799+0000 7f3ed1600640 1 -- 172.21.15.161:0/214023539 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3edc00e040 con 0x561bdbb6c0f0 2024-01-17T22:59:49.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.799+0000 7f3eee753000 10 client.4773 fetch_fsmap learned FSMap version 15 2024-01-17T22:59:49.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.799+0000 7f3eee753000 1 -- 172.21.15.161:0/214023539 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x561bdb672cc0 con 0x561bdbb6c0f0 2024-01-17T22:59:49.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.803+0000 7f3ed1600640 1 -- 172.21.15.161:0/214023539 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561bdbb29bc0 con 0x561bdbb6c0f0 2024-01-17T22:59:49.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.803+0000 7f3ed1600640 1 -- 172.21.15.161:0/214023539 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 15) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f3edc024030 con 0x561bdbb6c0f0 2024-01-17T22:59:49.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.803+0000 7f3eee753000 10 client.4773 fetch_fsmap finished waiting for FSMap version 15 2024-01-17T22:59:49.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.803+0000 7f3eee753000 10 client.4773 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-17T22:59:49.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.803+0000 7f3eee753000 20 client.4773 populate_metadata read hostname 'smithi161' 2024-01-17T22:59:49.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.803+0000 7f3eee753000 1 --2- 172.21.15.161:0/214023539 >> [v2:172.21.15.161:6834/1671527613,v1:172.21.15.161:6835/1671527613] conn(0x561bdbbd7890 0x561bdbb86220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.803+0000 7f3eee753000 4 client.4773 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-17T22:59:49.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.803+0000 7f3eee753000 1 -- 172.21.15.161:0/214023539 --> [v2:172.21.15.161:6834/1671527613,v1:172.21.15.161:6835/1671527613] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561bdb92d4f0 con 0x561bdbbd7890 2024-01-17T22:59:49.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.803+0000 7f3ee3e00640 1 --2- 172.21.15.161:0/214023539 >> [v2:172.21.15.161:6834/1671527613,v1:172.21.15.161:6835/1671527613] conn(0x561bdbbd7890 0x561bdbb86220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.807+0000 7f3ed1600640 10 client.4773 ms_handle_connect on v2:172.21.15.161:6834/1671527613 2024-01-17T22:59:49.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.807+0000 7f3ee3e00640 1 --2- 172.21.15.161:0/214023539 >> [v2:172.21.15.161:6834/1671527613,v1:172.21.15.161:6835/1671527613] conn(0x561bdbbd7890 0x561bdbb86220 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e3f9f09e4c6423a7 server_cookie=d3a865565a8bf81a in_seq=0 out_seq=0 2024-01-17T22:59:49.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3ed1600640 1 -- 172.21.15.161:0/214023539 <== mds.2 v2:172.21.15.161:6834/1671527613 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x561bdb92d4f0 con 0x561bdbbd7890 2024-01-17T22:59:49.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3ed1600640 10 client.4773 handle_command_reply: tid=0 2024-01-17T22:59:49.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eee753000 1 client.4773 shutdown 2024-01-17T22:59:49.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eee753000 1 -- 172.21.15.161:0/214023539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb6c0f0 msgr2=0x561bdbb85770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:49.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eee753000 1 --2- 172.21.15.161:0/214023539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb6c0f0 0x561bdbb85770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3edc007220 tx=0x7f3edc004ac0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eee753000 1 -- 172.21.15.161:0/214023539 shutdown_connections 2024-01-17T22:59:49.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eee753000 1 --2- 172.21.15.161:0/214023539 >> [v2:172.21.15.161:6834/1671527613,v1:172.21.15.161:6835/1671527613] conn(0x561bdbbd7890 0x561bdbb86220 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eee753000 1 --2- 172.21.15.161:0/214023539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bdbb6b7d0 0x561bdbbcdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eee753000 1 --2- 172.21.15.161:0/214023539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561bdbb6c0f0 0x561bdbb85770 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3ed1600640 0 client.4773 ms_handle_reset on v2:172.21.15.161:6834/1671527613 2024-01-17T22:59:49.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eee753000 1 --2- 172.21.15.161:0/214023539 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561bdbb30730 0x561bdbbcd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eee753000 1 -- 172.21.15.161:0/214023539 >> 172.21.15.161:0/214023539 conn(0x561bdbb67580 msgr2=0x561bdbb66ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:49.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eee753000 1 -- 172.21.15.161:0/214023539 shutdown_connections 2024-01-17T22:59:49.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eee753000 1 -- 172.21.15.161:0/214023539 wait complete. 2024-01-17T22:59:49.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eee753000 20 client.4773 trim_cache size 0 max 16384 2024-01-17T22:59:49.828 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-01-17T22:59:49.828 INFO:teuthology.orchestra.run.smithi161.stdout: "cluster_fsid": "58c3361f-c527-4d53-a987-e30062ef8beb", 2024-01-17T22:59:49.828 INFO:teuthology.orchestra.run.smithi161.stdout: "whoami": 2, 2024-01-17T22:59:49.828 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 4260, 2024-01-17T22:59:49.828 INFO:teuthology.orchestra.run.smithi161.stdout: "want_state": "up:active", 2024-01-17T22:59:49.828 INFO:teuthology.orchestra.run.smithi161.stdout: "state": "up:active", 2024-01-17T22:59:49.828 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs", 2024-01-17T22:59:49.828 INFO:teuthology.orchestra.run.smithi161.stdout: "rank_uptime": 18.560552273999999, 2024-01-17T22:59:49.828 INFO:teuthology.orchestra.run.smithi161.stdout: "mdsmap_epoch": 15, 2024-01-17T22:59:49.828 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch": 28, 2024-01-17T22:59:49.828 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch_barrier": 28, 2024-01-17T22:59:49.829 INFO:teuthology.orchestra.run.smithi161.stdout: "uptime": 85.226792817000003 2024-01-17T22:59:49.829 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-01-17T22:59:49.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eeb200640 1 -- 172.21.15.161:0/2923013946 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3ebc066890 msgr2=0x7f3ebc068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:49.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eeb200640 1 --2- 172.21.15.161:0/2923013946 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3ebc066890 0x7f3ebc068d50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40b2000 tx=0x7f3ed4009040 comp rx=0 tx=0).stop 2024-01-17T22:59:49.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eeb200640 1 -- 172.21.15.161:0/2923013946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee406f7d0 msgr2=0x7f3ee414dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:49.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eeb200640 1 --2- 172.21.15.161:0/2923013946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee406f7d0 0x7f3ee414dfa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00c430 tx=0x7f3ecc00c8f0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eeb200640 1 -- 172.21.15.161:0/2923013946 shutdown_connections 2024-01-17T22:59:49.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eeb200640 1 --2- 172.21.15.161:0/2923013946 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3ebc066890 0x7f3ebc068d50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eeb200640 1 --2- 172.21.15.161:0/2923013946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ee40c6060 0x7f3ee414e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eeb200640 1 --2- 172.21.15.161:0/2923013946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee406f7d0 0x7f3ee414dfa0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eeb200640 1 --2- 172.21.15.161:0/2923013946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ee406f3f0 0x7f3ee41f2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eeb200640 1 -- 172.21.15.161:0/2923013946 >> 172.21.15.161:0/2923013946 conn(0x7f3ee40c8160 msgr2=0x7f3ee4164110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:49.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eeb200640 1 -- 172.21.15.161:0/2923013946 shutdown_connections 2024-01-17T22:59:49.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.827+0000 7f3eeb200640 1 -- 172.21.15.161:0/2923013946 wait complete. 2024-01-17T22:59:49.848 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-01-17T22:59:49.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.987+0000 7f0be7e00640 1 Processor -- start 2024-01-17T22:59:49.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.987+0000 7f0be7e00640 1 -- start start 2024-01-17T22:59:49.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.987+0000 7f0be7e00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0be006f1f0 0x7f0be00c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.987+0000 7f0be7e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0be00c2a00 0x7f0be0159920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:49.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.987+0000 7f0be7e00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be015db50 con 0x7f0be0153bb0 2024-01-17T22:59:49.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.987+0000 7f0be7e00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be015ccf0 con 0x7f0be006f1f0 2024-01-17T22:59:49.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.987+0000 7f0be7e00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be015cf40 con 0x7f0be00c2a00 2024-01-17T22:59:49.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.987+0000 7f0be4a00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0be006f1f0 0x7f0be00c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.991+0000 7f0be5e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0be00c2a00 0x7f0be0159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:49.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.991+0000 7f0be4a00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0be006f1f0 0x7f0be00c24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:38062/0 (socket says 172.21.15.161:38062) 2024-01-17T22:59:49.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.991+0000 7f0be4a00640 1 -- 172.21.15.161:0/2484378240 learned_addr learned my addr 172.21.15.161:0/2484378240 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:49.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.995+0000 7f0be5e00640 1 -- 172.21.15.161:0/2484378240 >> v2:172.21.15.190:3300/0 conn(0x7f0be006f1f0 msgr2=0x7f0be00c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:49.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.995+0000 7f0be5e00640 1 --2- 172.21.15.161:0/2484378240 >> v2:172.21.15.190:3300/0 conn(0x7f0be006f1f0 0x7f0be00c24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:49.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.995+0000 7f0be5e00640 1 -- 172.21.15.161:0/2484378240 >> v1:172.21.15.190:6789/0 conn(0x7f0be0153bb0 legacy=0x7f0be006df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:49.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:49.995+0000 7f0be5e00640 1 -- 172.21.15.161:0/2484378240 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be015d220 con 0x7f0be00c2a00 2024-01-17T22:59:50.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.007+0000 7f0be5e00640 1 --2- 172.21.15.161:0/2484378240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0be00c2a00 0x7f0be0159920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009d90 tx=0x7f0bd801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b23a3de3528a7b8 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:50.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.015+0000 7f0bdfe00640 1 -- 172.21.15.161:0/2484378240 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd80a59e0 con 0x7f0be00c2a00 2024-01-17T22:59:50.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.015+0000 7f0bdfe00640 1 -- 172.21.15.161:0/2484378240 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd80a5b40 con 0x7f0be00c2a00 2024-01-17T22:59:50.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.015+0000 7f0bdfe00640 1 -- 172.21.15.161:0/2484378240 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd80ad440 con 0x7f0be00c2a00 2024-01-17T22:59:50.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.019+0000 7f0be7e00640 1 -- 172.21.15.161:0/2484378240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0be00c2a00 msgr2=0x7f0be0159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:50.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.019+0000 7f0be7e00640 1 --2- 172.21.15.161:0/2484378240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0be00c2a00 0x7f0be0159920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009d90 tx=0x7f0bd801c920 comp rx=0 tx=0).stop 2024-01-17T22:59:50.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.019+0000 7f0be7e00640 1 -- 172.21.15.161:0/2484378240 shutdown_connections 2024-01-17T22:59:50.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.019+0000 7f0be7e00640 1 --2- 172.21.15.161:0/2484378240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0be00c2a00 0x7f0be0159920 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.019+0000 7f0be7e00640 1 --2- 172.21.15.161:0/2484378240 >> v2:172.21.15.190:3300/0 conn(0x7f0be006f1f0 0x7f0be00c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.019+0000 7f0be7e00640 1 -- 172.21.15.161:0/2484378240 >> 172.21.15.161:0/2484378240 conn(0x7f0be006fc50 msgr2=0x7f0be0070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:50.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.019+0000 7f0be7e00640 1 -- 172.21.15.161:0/2484378240 shutdown_connections 2024-01-17T22:59:50.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.019+0000 7f0be7e00640 1 -- 172.21.15.161:0/2484378240 wait complete. 2024-01-17T22:59:50.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.019+0000 7f0be7e00640 1 Processor -- start 2024-01-17T22:59:50.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.019+0000 7f0be7e00640 1 -- start start 2024-01-17T22:59:50.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.019+0000 7f0be7e00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0be006f1f0 0x7f0be00cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.019+0000 7f0be7e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0be00c2a00 0x7f0be00cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.019+0000 7f0be7e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be0153bb0 0x7f0be00cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.019+0000 7f0be7e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be00cbf30 con 0x7f0be0153bb0 2024-01-17T22:59:50.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.019+0000 7f0be7e00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be014cf60 con 0x7f0be006f1f0 2024-01-17T22:59:50.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.019+0000 7f0be7e00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be014c440 con 0x7f0be00c2a00 2024-01-17T22:59:50.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.023+0000 7f0be5e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be0153bb0 0x7f0be00cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.023+0000 7f0be5e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be0153bb0 0x7f0be00cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49808/0 (socket says 172.21.15.161:49808) 2024-01-17T22:59:50.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.023+0000 7f0be5e00640 1 -- 172.21.15.161:0/333825812 learned_addr learned my addr 172.21.15.161:0/333825812 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:50.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.023+0000 7f0be5400640 1 --2- 172.21.15.161:0/333825812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0be006f1f0 0x7f0be00cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.023+0000 7f0be4a00640 1 --2- 172.21.15.161:0/333825812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0be00c2a00 0x7f0be00cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.027+0000 7f0be5e00640 1 -- 172.21.15.161:0/333825812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0be00c2a00 msgr2=0x7f0be00cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:50.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.027+0000 7f0be5e00640 1 --2- 172.21.15.161:0/333825812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0be00c2a00 0x7f0be00cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.027+0000 7f0be5e00640 1 -- 172.21.15.161:0/333825812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0be006f1f0 msgr2=0x7f0be00cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:50.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.027+0000 7f0be5e00640 1 --2- 172.21.15.161:0/333825812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0be006f1f0 0x7f0be00cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.027+0000 7f0be5e00640 1 -- 172.21.15.161:0/333825812 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd8009a70 con 0x7f0be0153bb0 2024-01-17T22:59:50.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.027+0000 7f0be5e00640 1 --2- 172.21.15.161:0/333825812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be0153bb0 0x7f0be00cca90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0bd801a550 tx=0x7f0bd80196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:50.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.031+0000 7f0bdd600640 1 -- 172.21.15.161:0/333825812 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd80aece0 con 0x7f0be0153bb0 2024-01-17T22:59:50.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.031+0000 7f0bdd600640 1 -- 172.21.15.161:0/333825812 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd80aee40 con 0x7f0be0153bb0 2024-01-17T22:59:50.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.031+0000 7f0bdd600640 1 -- 172.21.15.161:0/333825812 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd80b7650 con 0x7f0be0153bb0 2024-01-17T22:59:50.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.031+0000 7f0be7e00640 1 -- 172.21.15.161:0/333825812 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be014c1a0 con 0x7f0be0153bb0 2024-01-17T22:59:50.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.031+0000 7f0be7e00640 1 -- 172.21.15.161:0/333825812 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be00cad30 con 0x7f0be0153bb0 2024-01-17T22:59:50.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.035+0000 7f0beb37e000 1 Processor -- start 2024-01-17T22:59:50.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.035+0000 7f0beb37e000 1 -- start start 2024-01-17T22:59:50.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.035+0000 7f0beb37e000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759ddf730 0x55c759ddfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.035+0000 7f0beb37e000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1a7d0 0x55c759e1abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.035+0000 7f0beb37e000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759e1b0f0 0x55c759e25a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.035+0000 7f0beb37e000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c759c35d70 con 0x55c759ddf730 2024-01-17T22:59:50.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.035+0000 7f0beb37e000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c759c31ba0 con 0x55c759e1a7d0 2024-01-17T22:59:50.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.035+0000 7f0beb37e000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c759c2f0d0 con 0x55c759e1b0f0 2024-01-17T22:59:50.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.043+0000 7f0be5400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1a7d0 0x55c759e1abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.043+0000 7f0be4a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759e1b0f0 0x55c759e25a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.043+0000 7f0be5400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1a7d0 0x55c759e1abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:38074/0 (socket says 172.21.15.161:38074) 2024-01-17T22:59:50.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.043+0000 7f0be5400640 1 -- 172.21.15.161:0/2590480774 learned_addr learned my addr 172.21.15.161:0/2590480774 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:50.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.047+0000 7f0be5400640 1 -- 172.21.15.161:0/2590480774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759e1b0f0 msgr2=0x55c759e25a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:50.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.047+0000 7f0be5400640 1 --2- 172.21.15.161:0/2590480774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759e1b0f0 0x55c759e25a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.047+0000 7f0be5400640 1 -- 172.21.15.161:0/2590480774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759ddf730 msgr2=0x55c759ddfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:50.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.047+0000 7f0be5400640 1 --2- 172.21.15.161:0/2590480774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759ddf730 0x55c759ddfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.047+0000 7f0be5400640 1 -- 172.21.15.161:0/2590480774 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c759921890 con 0x55c759e1a7d0 2024-01-17T22:59:50.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.051+0000 7f0bdd600640 1 -- 172.21.15.161:0/333825812 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f0bd80b4050 con 0x7f0be0153bb0 2024-01-17T22:59:50.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.055+0000 7f0be5400640 1 --2- 172.21.15.161:0/2590480774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1a7d0 0x55c759e1abb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00016c0 tx=0x7f0bd0000bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d1ed4243179662b server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:50.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.055+0000 7f0bdd600640 1 --2- 172.21.15.161:0/333825812 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0bb80668c0 0x7f0bb8068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.055+0000 7f0be4a00640 1 --2- 172.21.15.161:0/333825812 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0bb80668c0 0x7f0bb8068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.055+0000 7f0be4a00640 1 --2- 172.21.15.161:0/333825812 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0bb80668c0 0x7f0bb8068d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009530 tx=0x7f0bc8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:50.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.055+0000 7f0bdd600640 1 -- 172.21.15.161:0/333825812 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f0bd80efa10 con 0x7f0be0153bb0 2024-01-17T22:59:50.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.063+0000 7f0bd6000640 1 -- 172.21.15.161:0/2590480774 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00050d0 con 0x55c759e1a7d0 2024-01-17T22:59:50.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.063+0000 7f0bd6000640 1 -- 172.21.15.161:0/2590480774 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd0005230 con 0x55c759e1a7d0 2024-01-17T22:59:50.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.063+0000 7f0bd6000640 1 -- 172.21.15.161:0/2590480774 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd000f7b0 con 0x55c759e1a7d0 2024-01-17T22:59:50.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.063+0000 7f0beb37e000 1 -- 172.21.15.161:0/2590480774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1a7d0 msgr2=0x55c759e1abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:50.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.063+0000 7f0beb37e000 1 --2- 172.21.15.161:0/2590480774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1a7d0 0x55c759e1abb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00016c0 tx=0x7f0bd0000bd0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.063+0000 7f0beb37e000 1 -- 172.21.15.161:0/2590480774 shutdown_connections 2024-01-17T22:59:50.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.063+0000 7f0beb37e000 1 --2- 172.21.15.161:0/2590480774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1a7d0 0x55c759e1abb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.063+0000 7f0beb37e000 1 --2- 172.21.15.161:0/2590480774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759e1b0f0 0x55c759e25a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.063+0000 7f0beb37e000 1 --2- 172.21.15.161:0/2590480774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759ddf730 0x55c759ddfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.063+0000 7f0beb37e000 1 -- 172.21.15.161:0/2590480774 >> 172.21.15.161:0/2590480774 conn(0x55c759e16580 msgr2=0x55c759e18970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:50.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.063+0000 7f0beb37e000 1 -- 172.21.15.161:0/2590480774 shutdown_connections 2024-01-17T22:59:50.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.063+0000 7f0beb37e000 1 -- 172.21.15.161:0/2590480774 wait complete. 2024-01-17T22:59:50.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.067+0000 7f0beb37e000 1 -- start start 2024-01-17T22:59:50.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.067+0000 7f0beb37e000 1 Processor -- start 2024-01-17T22:59:50.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.067+0000 7f0beb37e000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759ddf730 0x55c759e14d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.067+0000 7f0beb37e000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759e1a7d0 0x55c759e15240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.067+0000 7f0beb37e000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1b0f0 0x55c759e21950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.067+0000 7f0beb37e000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c759c2a9c0 con 0x55c759ddf730 2024-01-17T22:59:50.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.067+0000 7f0beb37e000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c759be2040 con 0x55c759e1b0f0 2024-01-17T22:59:50.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.067+0000 7f0beb37e000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c759be7ee0 con 0x55c759e1a7d0 2024-01-17T22:59:50.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.067+0000 7f0beb37e000 10 client.0 _ll_register_callbacks cb 0x55c759be51b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-17T22:59:50.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.067+0000 7f0be5400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759ddf730 0x55c759e14d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.067+0000 7f0be5400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759ddf730 0x55c759e14d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49830/0 (socket says 172.21.15.161:49830) 2024-01-17T22:59:50.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.067+0000 7f0be5400640 1 -- 172.21.15.161:0/1168723353 learned_addr learned my addr 172.21.15.161:0/1168723353 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:50.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.067+0000 7f0be4a00640 1 --2- 172.21.15.161:0/1168723353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759e1a7d0 0x55c759e15240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.071+0000 7f0be5e00640 1 --2- 172.21.15.161:0/1168723353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1b0f0 0x55c759e21950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.071+0000 7f0be5400640 1 -- 172.21.15.161:0/1168723353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759e1a7d0 msgr2=0x55c759e15240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:50.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.071+0000 7f0be5400640 1 --2- 172.21.15.161:0/1168723353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759e1a7d0 0x55c759e15240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.071+0000 7f0be5400640 1 -- 172.21.15.161:0/1168723353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1b0f0 msgr2=0x55c759e21950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:50.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.071+0000 7f0be5400640 1 --2- 172.21.15.161:0/1168723353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1b0f0 0x55c759e21950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.071+0000 7f0be5400640 1 -- 172.21.15.161:0/1168723353 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be015db50 con 0x55c759ddf730 2024-01-17T22:59:50.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.075+0000 7f0be5400640 1 --2- 172.21.15.161:0/1168723353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759ddf730 0x55c759e14d00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0015040 tx=0x7f0bd0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84094214677fa8c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:50.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.075+0000 7f0bcea00640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2024-01-17T22:59:50.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.079+0000 7f0bcea00640 1 -- 172.21.15.161:0/1168723353 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0007b20 con 0x55c759ddf730 2024-01-17T22:59:50.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.079+0000 7f0bcea00640 1 -- 172.21.15.161:0/1168723353 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f0bd0001340 con 0x55c759ddf730 2024-01-17T22:59:50.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.079+0000 7f0beb37e000 1 -- 172.21.15.161:0/1168723353 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c759bb0e30 con 0x55c759ddf730 2024-01-17T22:59:50.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.079+0000 7f0bcea00640 1 -- 172.21.15.161:0/1168723353 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bd0003600 con 0x55c759ddf730 2024-01-17T22:59:50.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.079+0000 7f0beb37e000 10 client.4779 fetch_fsmap learned FSMap version 15 2024-01-17T22:59:50.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.079+0000 7f0beb37e000 1 -- 172.21.15.161:0/1168723353 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55c759bea5e0 con 0x55c759ddf730 2024-01-17T22:59:50.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.083+0000 7f0bcea00640 1 -- 172.21.15.161:0/1168723353 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c759bb0e30 con 0x55c759ddf730 2024-01-17T22:59:50.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.083+0000 7f0bcea00640 1 -- 172.21.15.161:0/1168723353 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 15) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f0bd0012070 con 0x55c759ddf730 2024-01-17T22:59:50.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.083+0000 7f0beb37e000 10 client.4779 fetch_fsmap finished waiting for FSMap version 15 2024-01-17T22:59:50.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.083+0000 7f0beb37e000 10 client.4779 resolve_mds: resolved name 'e' to daemon mds.e 2024-01-17T22:59:50.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.083+0000 7f0beb37e000 20 client.4779 populate_metadata read hostname 'smithi161' 2024-01-17T22:59:50.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.083+0000 7f0beb37e000 1 --2- 172.21.15.161:0/1168723353 >> [v2:172.21.15.161:6836/409686078,v1:172.21.15.161:6837/409686078] conn(0x55c759e22690 0x55c759e22a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.083+0000 7f0beb37e000 4 client.4779 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-17T22:59:50.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.083+0000 7f0beb37e000 1 -- 172.21.15.161:0/1168723353 --> [v2:172.21.15.161:6836/409686078,v1:172.21.15.161:6837/409686078] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c759be7870 con 0x55c759e22690 2024-01-17T22:59:50.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.083+0000 7f0be4a00640 1 --2- 172.21.15.161:0/1168723353 >> [v2:172.21.15.161:6836/409686078,v1:172.21.15.161:6837/409686078] conn(0x55c759e22690 0x55c759e22a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.131+0000 7f0be4a00640 1 --2- 172.21.15.161:0/1168723353 >> [v2:172.21.15.161:6836/409686078,v1:172.21.15.161:6837/409686078] conn(0x55c759e22690 0x55c759e22a70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d73344b270fca054 server_cookie=d585353562bf2d79 in_seq=0 out_seq=0 2024-01-17T22:59:50.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.131+0000 7f0bcea00640 10 client.4779 ms_handle_connect on v2:172.21.15.161:6836/409686078 2024-01-17T22:59:50.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.239+0000 7f0bcea00640 1 -- 172.21.15.161:0/1168723353 <== mds.1 v2:172.21.15.161:6836/409686078 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c759be7870 con 0x55c759e22690 2024-01-17T22:59:50.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.239+0000 7f0bcea00640 10 client.4779 handle_command_reply: tid=0 2024-01-17T22:59:50.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.239+0000 7f0beb37e000 1 client.4779 shutdown 2024-01-17T22:59:50.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.239+0000 7f0beb37e000 1 -- 172.21.15.161:0/1168723353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759ddf730 msgr2=0x55c759e14d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:50.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.239+0000 7f0beb37e000 1 --2- 172.21.15.161:0/1168723353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759ddf730 0x55c759e14d00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0015040 tx=0x7f0bd0007f90 comp rx=0 tx=0).stop 2024-01-17T22:59:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.239+0000 7f0beb37e000 1 -- 172.21.15.161:0/1168723353 shutdown_connections 2024-01-17T22:59:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.239+0000 7f0beb37e000 1 --2- 172.21.15.161:0/1168723353 >> [v2:172.21.15.161:6836/409686078,v1:172.21.15.161:6837/409686078] conn(0x55c759e22690 0x55c759e22a70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.239+0000 7f0beb37e000 1 --2- 172.21.15.161:0/1168723353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1b0f0 0x55c759e21950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.239+0000 7f0beb37e000 1 --2- 172.21.15.161:0/1168723353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759e1a7d0 0x55c759e15240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.239+0000 7f0bcea00640 0 client.4779 ms_handle_reset on v2:172.21.15.161:6836/409686078 2024-01-17T22:59:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.239+0000 7f0beb37e000 1 --2- 172.21.15.161:0/1168723353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759ddf730 0x55c759e14d00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.239+0000 7f0beb37e000 1 -- 172.21.15.161:0/1168723353 >> 172.21.15.161:0/1168723353 conn(0x55c759e16580 msgr2=0x55c759e15d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.243+0000 7f0beb37e000 1 -- 172.21.15.161:0/1168723353 shutdown_connections 2024-01-17T22:59:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.243+0000 7f0beb37e000 1 -- 172.21.15.161:0/1168723353 wait complete. 2024-01-17T22:59:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.243+0000 7f0beb37e000 20 client.4779 trim_cache size 0 max 16384 2024-01-17T22:59:50.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.259+0000 7f0beb37e000 1 Processor -- start 2024-01-17T22:59:50.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.259+0000 7f0beb37e000 1 -- start start 2024-01-17T22:59:50.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.259+0000 7f0beb37e000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759ddf730 0x55c759e2d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.259+0000 7f0beb37e000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1a7d0 0x55c759e18970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.259+0000 7f0beb37e000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759e1b0f0 0x55c759e18eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.259+0000 7f0beb37e000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7598e2940 con 0x55c759e1b0f0 2024-01-17T22:59:50.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.259+0000 7f0beb37e000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c759c21a40 con 0x55c759e1a7d0 2024-01-17T22:59:50.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.259+0000 7f0beb37e000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c759c333f0 con 0x55c759ddf730 2024-01-17T22:59:50.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.259+0000 7f0be5e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759e1b0f0 0x55c759e18eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.259+0000 7f0be5e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759e1b0f0 0x55c759e18eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49844/0 (socket says 172.21.15.161:49844) 2024-01-17T22:59:50.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.259+0000 7f0be5e00640 1 -- 172.21.15.161:0/24401827 learned_addr learned my addr 172.21.15.161:0/24401827 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:50.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.259+0000 7f0be4a00640 1 --2- 172.21.15.161:0/24401827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1a7d0 0x55c759e18970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.259+0000 7f0be5400640 1 --2- 172.21.15.161:0/24401827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759ddf730 0x55c759e2d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.263+0000 7f0be5e00640 1 -- 172.21.15.161:0/24401827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759ddf730 msgr2=0x55c759e2d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:50.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.263+0000 7f0be5e00640 1 --2- 172.21.15.161:0/24401827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759ddf730 0x55c759e2d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.263+0000 7f0be5e00640 1 -- 172.21.15.161:0/24401827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1a7d0 msgr2=0x55c759e18970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:50.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.263+0000 7f0be5e00640 1 --2- 172.21.15.161:0/24401827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1a7d0 0x55c759e18970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.263+0000 7f0be5e00640 1 -- 172.21.15.161:0/24401827 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c759bd08e0 con 0x55c759e1b0f0 2024-01-17T22:59:50.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.263+0000 7f0be5e00640 1 --2- 172.21.15.161:0/24401827 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759e1b0f0 0x55c759e18eb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80efbd0 tx=0x7f0bd80ebe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e964bc0683596eeb server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:50.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.267+0000 7f0bd5600640 1 -- 172.21.15.161:0/24401827 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd80f7c60 con 0x55c759e1b0f0 2024-01-17T22:59:50.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.267+0000 7f0bd5600640 1 -- 172.21.15.161:0/24401827 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd8107100 con 0x55c759e1b0f0 2024-01-17T22:59:50.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.267+0000 7f0bd5600640 1 -- 172.21.15.161:0/24401827 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8107270 con 0x55c759e1b0f0 2024-01-17T22:59:50.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.267+0000 7f0beb37e000 1 -- 172.21.15.161:0/24401827 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759e1b0f0 msgr2=0x55c759e18eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:50.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.267+0000 7f0beb37e000 1 --2- 172.21.15.161:0/24401827 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759e1b0f0 0x55c759e18eb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80efbd0 tx=0x7f0bd80ebe80 comp rx=0 tx=0).stop 2024-01-17T22:59:50.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.267+0000 7f0beb37e000 1 -- 172.21.15.161:0/24401827 shutdown_connections 2024-01-17T22:59:50.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.267+0000 7f0beb37e000 1 --2- 172.21.15.161:0/24401827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1a7d0 0x55c759e18970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.267+0000 7f0beb37e000 1 --2- 172.21.15.161:0/24401827 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759e1b0f0 0x55c759e18eb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.267+0000 7f0beb37e000 1 --2- 172.21.15.161:0/24401827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759ddf730 0x55c759e2d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.267+0000 7f0beb37e000 1 -- 172.21.15.161:0/24401827 >> 172.21.15.161:0/24401827 conn(0x55c759e16580 msgr2=0x55c759e2d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:50.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.267+0000 7f0beb37e000 1 -- 172.21.15.161:0/24401827 shutdown_connections 2024-01-17T22:59:50.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.267+0000 7f0beb37e000 1 -- 172.21.15.161:0/24401827 wait complete. 2024-01-17T22:59:50.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.267+0000 7f0beb37e000 1 -- start start 2024-01-17T22:59:50.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.271+0000 7f0beb37e000 1 Processor -- start 2024-01-17T22:59:50.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.271+0000 7f0beb37e000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759ddf730 0x55c759e80060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.271+0000 7f0beb37e000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1a7d0 0x55c759e805a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.271+0000 7f0beb37e000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759e1b0f0 0x55c759ddd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.271+0000 7f0beb37e000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c759c27dc0 con 0x55c759e1b0f0 2024-01-17T22:59:50.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.271+0000 7f0beb37e000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c759bf1eb0 con 0x55c759e1a7d0 2024-01-17T22:59:50.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.271+0000 7f0beb37e000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c759c24cc0 con 0x55c759ddf730 2024-01-17T22:59:50.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.271+0000 7f0beb37e000 10 client.0 _ll_register_callbacks cb 0x55c759c57a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-17T22:59:50.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.271+0000 7f0be5e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759e1b0f0 0x55c759ddd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.271+0000 7f0be5e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759e1b0f0 0x55c759ddd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49846/0 (socket says 172.21.15.161:49846) 2024-01-17T22:59:50.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.271+0000 7f0be5e00640 1 -- 172.21.15.161:0/1662169422 learned_addr learned my addr 172.21.15.161:0/1662169422 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:50.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.271+0000 7f0be5400640 1 --2- 172.21.15.161:0/1662169422 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759ddf730 0x55c759e80060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.271+0000 7f0be4a00640 1 --2- 172.21.15.161:0/1662169422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1a7d0 0x55c759e805a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.275+0000 7f0be5e00640 1 -- 172.21.15.161:0/1662169422 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759ddf730 msgr2=0x55c759e80060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:50.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.275+0000 7f0be5e00640 1 --2- 172.21.15.161:0/1662169422 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759ddf730 0x55c759e80060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.275+0000 7f0be5e00640 1 -- 172.21.15.161:0/1662169422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1a7d0 msgr2=0x55c759e805a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:50.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.275+0000 7f0be5e00640 1 --2- 172.21.15.161:0/1662169422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1a7d0 0x55c759e805a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.275+0000 7f0be5e00640 1 -- 172.21.15.161:0/1662169422 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be00cad30 con 0x55c759e1b0f0 2024-01-17T22:59:50.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.275+0000 7f0be5e00640 1 --2- 172.21.15.161:0/1662169422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759e1b0f0 0x55c759ddd5f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0bd801cbe0 tx=0x7f0bd811cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca37aa217029b219 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:50.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.275+0000 7f0bcea00640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2024-01-17T22:59:50.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.279+0000 7f0bcea00640 1 -- 172.21.15.161:0/1662169422 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd80f7c60 con 0x55c759e1b0f0 2024-01-17T22:59:50.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.279+0000 7f0beb37e000 1 -- 172.21.15.161:0/1662169422 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c759bdc4f0 con 0x55c759e1b0f0 2024-01-17T22:59:50.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.279+0000 7f0bcea00640 1 -- 172.21.15.161:0/1662169422 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f0bd80f77d0 con 0x55c759e1b0f0 2024-01-17T22:59:50.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.283+0000 7f0bcea00640 1 -- 172.21.15.161:0/1662169422 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bd80f7990 con 0x55c759e1b0f0 2024-01-17T22:59:50.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.283+0000 7f0beb37e000 10 client.4785 fetch_fsmap learned FSMap version 15 2024-01-17T22:59:50.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.283+0000 7f0beb37e000 1 -- 172.21.15.161:0/1662169422 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55c759921cc0 con 0x55c759e1b0f0 2024-01-17T22:59:50.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.287+0000 7f0bcea00640 1 -- 172.21.15.161:0/1662169422 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c759bdc4f0 con 0x55c759e1b0f0 2024-01-17T22:59:50.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.287+0000 7f0bcea00640 1 -- 172.21.15.161:0/1662169422 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 15) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f0bd810ed10 con 0x55c759e1b0f0 2024-01-17T22:59:50.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.287+0000 7f0beb37e000 10 client.4785 fetch_fsmap finished waiting for FSMap version 15 2024-01-17T22:59:50.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.287+0000 7f0beb37e000 10 client.4785 resolve_mds: resolved name 'e' to daemon mds.e 2024-01-17T22:59:50.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.287+0000 7f0beb37e000 20 client.4785 populate_metadata read hostname 'smithi161' 2024-01-17T22:59:50.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.287+0000 7f0beb37e000 1 --2- 172.21.15.161:0/1662169422 >> [v2:172.21.15.161:6836/409686078,v1:172.21.15.161:6837/409686078] conn(0x55c759dddef0 0x55c759dde2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.287+0000 7f0beb37e000 4 client.4785 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-17T22:59:50.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.287+0000 7f0beb37e000 1 -- 172.21.15.161:0/1662169422 --> [v2:172.21.15.161:6836/409686078,v1:172.21.15.161:6837/409686078] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c759c29310 con 0x55c759dddef0 2024-01-17T22:59:50.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.287+0000 7f0be5400640 1 --2- 172.21.15.161:0/1662169422 >> [v2:172.21.15.161:6836/409686078,v1:172.21.15.161:6837/409686078] conn(0x55c759dddef0 0x55c759dde2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.291+0000 7f0be5400640 1 --2- 172.21.15.161:0/1662169422 >> [v2:172.21.15.161:6836/409686078,v1:172.21.15.161:6837/409686078] conn(0x55c759dddef0 0x55c759dde2d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=44f9bdec3c61f791 server_cookie=12a60c97dc71c0b8 in_seq=0 out_seq=0 2024-01-17T22:59:50.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.291+0000 7f0bcea00640 10 client.4785 ms_handle_connect on v2:172.21.15.161:6836/409686078 2024-01-17T22:59:50.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.307+0000 7f0bcea00640 1 -- 172.21.15.161:0/1662169422 <== mds.1 v2:172.21.15.161:6836/409686078 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55c759c29310 con 0x55c759dddef0 2024-01-17T22:59:50.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.307+0000 7f0bcea00640 10 client.4785 handle_command_reply: tid=0 2024-01-17T22:59:50.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.307+0000 7f0beb37e000 1 client.4785 shutdown 2024-01-17T22:59:50.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.307+0000 7f0beb37e000 1 -- 172.21.15.161:0/1662169422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759e1b0f0 msgr2=0x55c759ddd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:50.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.307+0000 7f0beb37e000 1 --2- 172.21.15.161:0/1662169422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759e1b0f0 0x55c759ddd5f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0bd801cbe0 tx=0x7f0bd811cfa0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.307+0000 7f0beb37e000 1 -- 172.21.15.161:0/1662169422 shutdown_connections 2024-01-17T22:59:50.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.307+0000 7f0beb37e000 1 --2- 172.21.15.161:0/1662169422 >> [v2:172.21.15.161:6836/409686078,v1:172.21.15.161:6837/409686078] conn(0x55c759dddef0 0x55c759dde2d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.307+0000 7f0beb37e000 1 --2- 172.21.15.161:0/1662169422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c759e1a7d0 0x55c759e805a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.307+0000 7f0beb37e000 1 --2- 172.21.15.161:0/1662169422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c759e1b0f0 0x55c759ddd5f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.307+0000 7f0bcea00640 0 client.4785 ms_handle_reset on v2:172.21.15.161:6836/409686078 2024-01-17T22:59:50.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.307+0000 7f0beb37e000 1 --2- 172.21.15.161:0/1662169422 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c759ddf730 0x55c759e80060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.307+0000 7f0beb37e000 1 -- 172.21.15.161:0/1662169422 >> 172.21.15.161:0/1662169422 conn(0x55c759e16580 msgr2=0x55c759e23510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:50.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.307+0000 7f0beb37e000 1 -- 172.21.15.161:0/1662169422 shutdown_connections 2024-01-17T22:59:50.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.307+0000 7f0beb37e000 1 -- 172.21.15.161:0/1662169422 wait complete. 2024-01-17T22:59:50.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.307+0000 7f0beb37e000 20 client.4785 trim_cache size 0 max 16384 2024-01-17T22:59:50.309 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-01-17T22:59:50.309 INFO:teuthology.orchestra.run.smithi161.stdout: "cluster_fsid": "58c3361f-c527-4d53-a987-e30062ef8beb", 2024-01-17T22:59:50.309 INFO:teuthology.orchestra.run.smithi161.stdout: "whoami": 1, 2024-01-17T22:59:50.309 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 4263, 2024-01-17T22:59:50.309 INFO:teuthology.orchestra.run.smithi161.stdout: "want_state": "up:active", 2024-01-17T22:59:50.309 INFO:teuthology.orchestra.run.smithi161.stdout: "state": "up:active", 2024-01-17T22:59:50.309 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs", 2024-01-17T22:59:50.309 INFO:teuthology.orchestra.run.smithi161.stdout: "rank_uptime": 25.643836442000001, 2024-01-17T22:59:50.309 INFO:teuthology.orchestra.run.smithi161.stdout: "mdsmap_epoch": 15, 2024-01-17T22:59:50.309 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch": 28, 2024-01-17T22:59:50.309 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch_barrier": 28, 2024-01-17T22:59:50.309 INFO:teuthology.orchestra.run.smithi161.stdout: "uptime": 85.668093009000003 2024-01-17T22:59:50.309 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-01-17T22:59:50.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.311+0000 7f0be7e00640 1 -- 172.21.15.161:0/333825812 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0bb80668c0 msgr2=0x7f0bb8068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:50.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.311+0000 7f0be7e00640 1 --2- 172.21.15.161:0/333825812 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0bb80668c0 0x7f0bb8068d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009530 tx=0x7f0bc8008040 comp rx=0 tx=0).stop 2024-01-17T22:59:50.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.311+0000 7f0be7e00640 1 -- 172.21.15.161:0/333825812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be0153bb0 msgr2=0x7f0be00cca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:50.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.311+0000 7f0be7e00640 1 --2- 172.21.15.161:0/333825812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be0153bb0 0x7f0be00cca90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0bd801a550 tx=0x7f0bd80196c0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.311+0000 7f0be7e00640 1 -- 172.21.15.161:0/333825812 shutdown_connections 2024-01-17T22:59:50.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.311+0000 7f0be7e00640 1 --2- 172.21.15.161:0/333825812 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0bb80668c0 0x7f0bb8068d80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.311+0000 7f0be7e00640 1 --2- 172.21.15.161:0/333825812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be0153bb0 0x7f0be00cca90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.311+0000 7f0be7e00640 1 --2- 172.21.15.161:0/333825812 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0be00c2a00 0x7f0be00cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.311+0000 7f0be7e00640 1 --2- 172.21.15.161:0/333825812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0be006f1f0 0x7f0be00cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.311+0000 7f0be7e00640 1 -- 172.21.15.161:0/333825812 >> 172.21.15.161:0/333825812 conn(0x7f0be006fc50 msgr2=0x7f0be00c7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:50.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.311+0000 7f0be7e00640 1 -- 172.21.15.161:0/333825812 shutdown_connections 2024-01-17T22:59:50.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.311+0000 7f0be7e00640 1 -- 172.21.15.161:0/333825812 wait complete. 2024-01-17T22:59:50.330 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-01-17T22:59:50.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.471+0000 7f0989200640 1 Processor -- start 2024-01-17T22:59:50.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.471+0000 7f0989200640 1 -- start start 2024-01-17T22:59:50.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.471+0000 7f0989200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f09841519e0 0x7f098406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.471+0000 7f0989200640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f098406d890 0x7f09840c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.471+0000 7f0989200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09840c8b40 0x7f09840c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.471+0000 7f0989200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09840c94f0 con 0x7f09841519e0 2024-01-17T22:59:50.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.471+0000 7f0989200640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0984151dc0 con 0x7f098406d890 2024-01-17T22:59:50.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.471+0000 7f0989200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0984157730 con 0x7f09840c8b40 2024-01-17T22:59:50.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.475+0000 7f0981e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f09841519e0 0x7f098406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.475+0000 7f0981400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f098406d890 0x7f09840c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.475+0000 7f0981e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f09841519e0 0x7f098406df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49860/0 (socket says 172.21.15.161:49860) 2024-01-17T22:59:50.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.475+0000 7f0981e00640 1 -- 172.21.15.161:0/2981866700 learned_addr learned my addr 172.21.15.161:0/2981866700 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:50.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.475+0000 7f0982800640 1 --2- 172.21.15.161:0/2981866700 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09840c8b40 0x7f09840c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.475+0000 7f0981e00640 1 -- 172.21.15.161:0/2981866700 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09840c8b40 msgr2=0x7f09840c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:50.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.475+0000 7f0981e00640 1 --2- 172.21.15.161:0/2981866700 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09840c8b40 0x7f09840c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.475+0000 7f0981e00640 1 -- 172.21.15.161:0/2981866700 >> v2:172.21.15.190:3300/0 conn(0x7f098406d890 msgr2=0x7f09840c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:50.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.475+0000 7f0981e00640 1 --2- 172.21.15.161:0/2981866700 >> v2:172.21.15.190:3300/0 conn(0x7f098406d890 0x7f09840c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.475+0000 7f0981e00640 1 -- 172.21.15.161:0/2981866700 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098406dcb0 con 0x7f09841519e0 2024-01-17T22:59:50.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.479+0000 7f0981e00640 1 --2- 172.21.15.161:0/2981866700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09841519e0 0x7f098406df50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f098406b7a0 tx=0x7f097401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0d1d7f31e5e581 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:50.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.483+0000 7f0980a00640 1 -- 172.21.15.161:0/2981866700 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09740a89b0 con 0x7f09841519e0 2024-01-17T22:59:50.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.483+0000 7f0980a00640 1 -- 172.21.15.161:0/2981866700 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09740a8b10 con 0x7f09841519e0 2024-01-17T22:59:50.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.483+0000 7f0980a00640 1 -- 172.21.15.161:0/2981866700 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09740a8ea0 con 0x7f09841519e0 2024-01-17T22:59:50.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.483+0000 7f0989200640 1 -- 172.21.15.161:0/2981866700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09841519e0 msgr2=0x7f098406df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:50.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.483+0000 7f0989200640 1 --2- 172.21.15.161:0/2981866700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09841519e0 0x7f098406df50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f098406b7a0 tx=0x7f097401ecf0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.483+0000 7f0989200640 1 -- 172.21.15.161:0/2981866700 shutdown_connections 2024-01-17T22:59:50.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.483+0000 7f0989200640 1 --2- 172.21.15.161:0/2981866700 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09840c8b40 0x7f09840c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.483+0000 7f0989200640 1 --2- 172.21.15.161:0/2981866700 >> v2:172.21.15.190:3300/0 conn(0x7f098406d890 0x7f09840c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.483+0000 7f0989200640 1 --2- 172.21.15.161:0/2981866700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09841519e0 0x7f098406df50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.483+0000 7f0989200640 1 -- 172.21.15.161:0/2981866700 >> 172.21.15.161:0/2981866700 conn(0x7f098406fd30 msgr2=0x7f0984070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:50.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.487+0000 7f0989200640 1 -- 172.21.15.161:0/2981866700 shutdown_connections 2024-01-17T22:59:50.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.487+0000 7f0989200640 1 -- 172.21.15.161:0/2981866700 wait complete. 2024-01-17T22:59:50.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.487+0000 7f0989200640 1 Processor -- start 2024-01-17T22:59:50.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.487+0000 7f0989200640 1 -- start start 2024-01-17T22:59:50.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.487+0000 7f0989200640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f098406d890 0x7f098414b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.487+0000 7f0989200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09840c8b40 0x7f098414b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.487+0000 7f0989200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09841519e0 0x7f0984146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.487+0000 7f0989200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0984149440 con 0x7f09841519e0 2024-01-17T22:59:50.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.487+0000 7f0989200640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09840cbba0 con 0x7f098406d890 2024-01-17T22:59:50.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.487+0000 7f0989200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09841efe50 con 0x7f09840c8b40 2024-01-17T22:59:50.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.487+0000 7f0982800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09841519e0 0x7f0984146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.491+0000 7f0982800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09841519e0 0x7f0984146fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49868/0 (socket says 172.21.15.161:49868) 2024-01-17T22:59:50.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.491+0000 7f0982800640 1 -- 172.21.15.161:0/2710254616 learned_addr learned my addr 172.21.15.161:0/2710254616 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:50.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.491+0000 7f0981e00640 1 --2- 172.21.15.161:0/2710254616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f098406d890 0x7f098414b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.491+0000 7f0981400640 1 --2- 172.21.15.161:0/2710254616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09840c8b40 0x7f098414b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.491+0000 7f0982800640 1 -- 172.21.15.161:0/2710254616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09840c8b40 msgr2=0x7f098414b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:50.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.491+0000 7f0982800640 1 --2- 172.21.15.161:0/2710254616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09840c8b40 0x7f098414b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.491+0000 7f0982800640 1 -- 172.21.15.161:0/2710254616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f098406d890 msgr2=0x7f098414b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:50.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.491+0000 7f0982800640 1 --2- 172.21.15.161:0/2710254616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f098406d890 0x7f098414b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.491+0000 7f0982800640 1 -- 172.21.15.161:0/2710254616 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09740094d0 con 0x7f09841519e0 2024-01-17T22:59:50.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.495+0000 7f0982800640 1 --2- 172.21.15.161:0/2710254616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09841519e0 0x7f0984146fc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f097c00efc0 tx=0x7f097c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:50.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.499+0000 7f097a000640 1 -- 172.21.15.161:0/2710254616 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c014480 con 0x7f09841519e0 2024-01-17T22:59:50.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.499+0000 7f097a000640 1 -- 172.21.15.161:0/2710254616 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c00f040 con 0x7f09841519e0 2024-01-17T22:59:50.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.499+0000 7f097a000640 1 -- 172.21.15.161:0/2710254616 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c014820 con 0x7f09841519e0 2024-01-17T22:59:50.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.499+0000 7f0989200640 1 -- 172.21.15.161:0/2710254616 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0984149f70 con 0x7f09841519e0 2024-01-17T22:59:50.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.499+0000 7f0989200640 1 -- 172.21.15.161:0/2710254616 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098414a530 con 0x7f09841519e0 2024-01-17T22:59:50.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.503+0000 7f098c733000 1 Processor -- start 2024-01-17T22:59:50.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.503+0000 7f098c733000 1 -- start start 2024-01-17T22:59:50.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.503+0000 7f098c733000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78bd730 0x5590b78bdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.503+0000 7f098c733000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78f87d0 0x5590b78f8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.503+0000 7f098c733000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78f90f0 0x5590b7903a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.503+0000 7f098c733000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590b7713d70 con 0x5590b78bd730 2024-01-17T22:59:50.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.503+0000 7f098c733000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590b770fba0 con 0x5590b78f87d0 2024-01-17T22:59:50.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.503+0000 7f098c733000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590b770d0d0 con 0x5590b78f90f0 2024-01-17T22:59:50.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.507+0000 7f0981e00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78f87d0 0x5590b78f8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.507+0000 7f0981400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78f90f0 0x5590b7903a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.507+0000 7f0981400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78bd730 0x5590b78bdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.507+0000 7f0981e00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78f87d0 0x5590b78f8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:38114/0 (socket says 172.21.15.161:38114) 2024-01-17T22:59:50.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.507+0000 7f0981e00640 1 -- 172.21.15.161:0/2792679720 learned_addr learned my addr 172.21.15.161:0/2792679720 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:50.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.515+0000 7f0981e00640 1 -- 172.21.15.161:0/2792679720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78f90f0 msgr2=0x5590b7903a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:50.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.515+0000 7f0981e00640 1 --2- 172.21.15.161:0/2792679720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78f90f0 0x5590b7903a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.515+0000 7f0981e00640 1 -- 172.21.15.161:0/2792679720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78bd730 msgr2=0x5590b78bdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:50.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.515+0000 7f0981e00640 1 --2- 172.21.15.161:0/2792679720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78bd730 0x5590b78bdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.515+0000 7f0981e00640 1 -- 172.21.15.161:0/2792679720 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590b73ff890 con 0x5590b78f87d0 2024-01-17T22:59:50.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.519+0000 7f0981e00640 1 --2- 172.21.15.161:0/2792679720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78f87d0 0x5590b78f8bb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f097401d3a0 tx=0x7f0974004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ce8f12d6ec15524 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:50.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.523+0000 7f097a000640 1 -- 172.21.15.161:0/2710254616 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f097c014980 con 0x7f09841519e0 2024-01-17T22:59:50.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.523+0000 7f097a000640 1 --2- 172.21.15.161:0/2710254616 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f095c066890 0x7f095c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.523+0000 7f0981400640 1 --2- 172.21.15.161:0/2710254616 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f095c066890 0x7f095c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.523+0000 7f0981400640 1 --2- 172.21.15.161:0/2710254616 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f095c066890 0x7f095c068d50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f096c009e60 tx=0x7f096c004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:50.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.523+0000 7f097a000640 1 -- 172.21.15.161:0/2710254616 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f097c055e20 con 0x7f09841519e0 2024-01-17T22:59:50.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.527+0000 7f0972a00640 1 -- 172.21.15.161:0/2792679720 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09740b0440 con 0x5590b78f87d0 2024-01-17T22:59:50.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.527+0000 7f0972a00640 1 -- 172.21.15.161:0/2792679720 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09740b05a0 con 0x5590b78f87d0 2024-01-17T22:59:50.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.527+0000 7f0972a00640 1 -- 172.21.15.161:0/2792679720 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09740b0950 con 0x5590b78f87d0 2024-01-17T22:59:50.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f098c733000 1 -- 172.21.15.161:0/2792679720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78f87d0 msgr2=0x5590b78f8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:50.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f098c733000 1 --2- 172.21.15.161:0/2792679720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78f87d0 0x5590b78f8bb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f097401d3a0 tx=0x7f0974004740 comp rx=0 tx=0).stop 2024-01-17T22:59:50.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f098c733000 1 -- 172.21.15.161:0/2792679720 shutdown_connections 2024-01-17T22:59:50.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f098c733000 1 --2- 172.21.15.161:0/2792679720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78f87d0 0x5590b78f8bb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f098c733000 1 --2- 172.21.15.161:0/2792679720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78f90f0 0x5590b7903a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f098c733000 1 --2- 172.21.15.161:0/2792679720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78bd730 0x5590b78bdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f098c733000 1 -- 172.21.15.161:0/2792679720 >> 172.21.15.161:0/2792679720 conn(0x5590b78f4580 msgr2=0x5590b78f6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:50.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f098c733000 1 -- 172.21.15.161:0/2792679720 shutdown_connections 2024-01-17T22:59:50.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f098c733000 1 -- 172.21.15.161:0/2792679720 wait complete. 2024-01-17T22:59:50.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f098c733000 1 -- start start 2024-01-17T22:59:50.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f098c733000 1 Processor -- start 2024-01-17T22:59:50.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f098c733000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78bd730 0x5590b78f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f098c733000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 0x5590b78f3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f098c733000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78f90f0 0x5590b78ff950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f098c733000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590b77089c0 con 0x5590b78f87d0 2024-01-17T22:59:50.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f098c733000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590b76c0040 con 0x5590b78bd730 2024-01-17T22:59:50.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f098c733000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590b76c5ee0 con 0x5590b78f90f0 2024-01-17T22:59:50.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f098c733000 10 client.0 _ll_register_callbacks cb 0x5590b76c31b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-17T22:59:50.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.531+0000 7f0981400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 0x5590b78f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.535+0000 7f0981400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 0x5590b78f3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49880/0 (socket says 172.21.15.161:49880) 2024-01-17T22:59:50.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.535+0000 7f0981400640 1 -- 172.21.15.161:0/3029900223 learned_addr learned my addr 172.21.15.161:0/3029900223 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:50.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.535+0000 7f0982800640 1 --2- 172.21.15.161:0/3029900223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78f90f0 0x5590b78ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.535+0000 7f0981e00640 1 --2- 172.21.15.161:0/3029900223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78bd730 0x5590b78f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.535+0000 7f0981400640 1 -- 172.21.15.161:0/3029900223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78f90f0 msgr2=0x5590b78ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:50.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.535+0000 7f0981400640 1 --2- 172.21.15.161:0/3029900223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78f90f0 0x5590b78ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.535+0000 7f0981400640 1 -- 172.21.15.161:0/3029900223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78bd730 msgr2=0x5590b78f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:50.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.535+0000 7f0981400640 1 --2- 172.21.15.161:0/3029900223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78bd730 0x5590b78f2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.535+0000 7f0981400640 1 -- 172.21.15.161:0/3029900223 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098406dcb0 con 0x5590b78f87d0 2024-01-17T22:59:50.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.539+0000 7f0981400640 1 --2- 172.21.15.161:0/3029900223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 0x5590b78f3240 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f096c016de0 tx=0x7f096c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634a9d57e216efe2 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:50.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.539+0000 7f096b400640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2024-01-17T22:59:50.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.543+0000 7f096b400640 1 -- 172.21.15.161:0/3029900223 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c016e10 con 0x5590b78f87d0 2024-01-17T22:59:50.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.543+0000 7f096b400640 1 -- 172.21.15.161:0/3029900223 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f096c013e10 con 0x5590b78f87d0 2024-01-17T22:59:50.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.543+0000 7f098c733000 1 -- 172.21.15.161:0/3029900223 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5590b768ee30 con 0x5590b78f87d0 2024-01-17T22:59:50.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.543+0000 7f096b400640 1 -- 172.21.15.161:0/3029900223 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f096c015dd0 con 0x5590b78f87d0 2024-01-17T22:59:50.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.543+0000 7f098c733000 10 client.4794 fetch_fsmap learned FSMap version 15 2024-01-17T22:59:50.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.543+0000 7f098c733000 1 -- 172.21.15.161:0/3029900223 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5590b76c85e0 con 0x5590b78f87d0 2024-01-17T22:59:50.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.547+0000 7f096b400640 1 -- 172.21.15.161:0/3029900223 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5590b768ee30 con 0x5590b78f87d0 2024-01-17T22:59:50.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.547+0000 7f096b400640 1 -- 172.21.15.161:0/3029900223 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 15) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f096c01e040 con 0x5590b78f87d0 2024-01-17T22:59:50.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.547+0000 7f098c733000 10 client.4794 fetch_fsmap finished waiting for FSMap version 15 2024-01-17T22:59:50.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.547+0000 7f098c733000 10 client.4794 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-17T22:59:50.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.547+0000 7f098c733000 20 client.4794 populate_metadata read hostname 'smithi161' 2024-01-17T22:59:50.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.547+0000 7f098c733000 1 --2- 172.21.15.161:0/3029900223 >> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] conn(0x5590b7900690 0x5590b7900a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.547+0000 7f098c733000 4 client.4794 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-17T22:59:50.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.547+0000 7f098c733000 1 -- 172.21.15.161:0/3029900223 --> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5590b76c5870 con 0x5590b7900690 2024-01-17T22:59:50.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.551+0000 7f0981e00640 1 --2- 172.21.15.161:0/3029900223 >> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] conn(0x5590b7900690 0x5590b7900a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.559+0000 7f0981e00640 1 --2- 172.21.15.161:0/3029900223 >> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] conn(0x5590b7900690 0x5590b7900a70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6691ed08d27b8f69 server_cookie=82612c3ee9bd16d8 in_seq=0 out_seq=0 2024-01-17T22:59:50.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.559+0000 7f096b400640 10 client.4794 ms_handle_connect on v2:172.21.15.190:6836/561131647 2024-01-17T22:59:50.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.591+0000 7f096b400640 1 -- 172.21.15.161:0/3029900223 <== mds.0 v2:172.21.15.190:6836/561131647 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5590b76c5870 con 0x5590b7900690 2024-01-17T22:59:50.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.591+0000 7f096b400640 10 client.4794 handle_command_reply: tid=0 2024-01-17T22:59:50.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.591+0000 7f098c733000 1 client.4794 shutdown 2024-01-17T22:59:50.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.591+0000 7f098c733000 1 -- 172.21.15.161:0/3029900223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 msgr2=0x5590b78f3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:50.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.591+0000 7f098c733000 1 --2- 172.21.15.161:0/3029900223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 0x5590b78f3240 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f096c016de0 tx=0x7f096c0046d0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.591+0000 7f098c733000 1 -- 172.21.15.161:0/3029900223 shutdown_connections 2024-01-17T22:59:50.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.591+0000 7f098c733000 1 --2- 172.21.15.161:0/3029900223 >> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] conn(0x5590b7900690 0x5590b7900a70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.591+0000 7f098c733000 1 --2- 172.21.15.161:0/3029900223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78f90f0 0x5590b78ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.591+0000 7f098c733000 1 --2- 172.21.15.161:0/3029900223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 0x5590b78f3240 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.591+0000 7f098c733000 1 --2- 172.21.15.161:0/3029900223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78bd730 0x5590b78f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.591+0000 7f096b400640 0 client.4794 ms_handle_reset on v2:172.21.15.190:6836/561131647 2024-01-17T22:59:50.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.591+0000 7f098c733000 1 -- 172.21.15.161:0/3029900223 >> 172.21.15.161:0/3029900223 conn(0x5590b78f4580 msgr2=0x5590b78f3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:50.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.591+0000 7f098c733000 1 -- 172.21.15.161:0/3029900223 shutdown_connections 2024-01-17T22:59:50.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.591+0000 7f098c733000 1 -- 172.21.15.161:0/3029900223 wait complete. 2024-01-17T22:59:50.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.591+0000 7f098c733000 20 client.4794 trim_cache size 0 max 16384 2024-01-17T22:59:50.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.607+0000 7f098c733000 1 Processor -- start 2024-01-17T22:59:50.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.607+0000 7f098c733000 1 -- start start 2024-01-17T22:59:50.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.607+0000 7f098c733000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78bd730 0x5590b7901ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.607+0000 7f098c733000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 0x5590b790b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.607+0000 7f098c733000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78f90f0 0x5590b790b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.607+0000 7f098c733000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590b73c0940 con 0x5590b78f87d0 2024-01-17T22:59:50.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.607+0000 7f098c733000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590b77081d0 con 0x5590b78bd730 2024-01-17T22:59:50.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.607+0000 7f098c733000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590b770f150 con 0x5590b78f90f0 2024-01-17T22:59:50.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.607+0000 7f0981400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 0x5590b790b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.611+0000 7f0981400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 0x5590b790b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49882/0 (socket says 172.21.15.161:49882) 2024-01-17T22:59:50.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.611+0000 7f0981400640 1 -- 172.21.15.161:0/2044194113 learned_addr learned my addr 172.21.15.161:0/2044194113 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:50.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.611+0000 7f0981e00640 1 --2- 172.21.15.161:0/2044194113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78bd730 0x5590b7901ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.611+0000 7f0982800640 1 --2- 172.21.15.161:0/2044194113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78f90f0 0x5590b790b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.611+0000 7f0981400640 1 -- 172.21.15.161:0/2044194113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78f90f0 msgr2=0x5590b790b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:50.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.611+0000 7f0981400640 1 --2- 172.21.15.161:0/2044194113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78f90f0 0x5590b790b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.611+0000 7f0981400640 1 -- 172.21.15.161:0/2044194113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78bd730 msgr2=0x5590b7901ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:50.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.611+0000 7f0981400640 1 --2- 172.21.15.161:0/2044194113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78bd730 0x5590b7901ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.611+0000 7f0981400640 1 -- 172.21.15.161:0/2044194113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590b76ae8e0 con 0x5590b78f87d0 2024-01-17T22:59:50.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.615+0000 7f0981400640 1 --2- 172.21.15.161:0/2044194113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 0x5590b790b250 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f096c004710 tx=0x7f096c024070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47a163d84ae9c2e server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:50.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f0972000640 1 -- 172.21.15.161:0/2044194113 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c015dc0 con 0x5590b78f87d0 2024-01-17T22:59:50.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f0972000640 1 -- 172.21.15.161:0/2044194113 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c026070 con 0x5590b78f87d0 2024-01-17T22:59:50.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f0972000640 1 -- 172.21.15.161:0/2044194113 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c013c60 con 0x5590b78f87d0 2024-01-17T22:59:50.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f098c733000 1 -- 172.21.15.161:0/2044194113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 msgr2=0x5590b790b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:50.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f098c733000 1 --2- 172.21.15.161:0/2044194113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 0x5590b790b250 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f096c004710 tx=0x7f096c024070 comp rx=0 tx=0).stop 2024-01-17T22:59:50.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f098c733000 1 -- 172.21.15.161:0/2044194113 shutdown_connections 2024-01-17T22:59:50.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f098c733000 1 --2- 172.21.15.161:0/2044194113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78f90f0 0x5590b790b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f098c733000 1 --2- 172.21.15.161:0/2044194113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 0x5590b790b250 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f098c733000 1 --2- 172.21.15.161:0/2044194113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78bd730 0x5590b7901ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f098c733000 1 -- 172.21.15.161:0/2044194113 >> 172.21.15.161:0/2044194113 conn(0x5590b78f4580 msgr2=0x5590b78f7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:50.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f098c733000 1 -- 172.21.15.161:0/2044194113 shutdown_connections 2024-01-17T22:59:50.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f098c733000 1 -- 172.21.15.161:0/2044194113 wait complete. 2024-01-17T22:59:50.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f098c733000 1 -- start start 2024-01-17T22:59:50.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f098c733000 1 Processor -- start 2024-01-17T22:59:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f098c733000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78bd730 0x5590b78bb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f098c733000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 0x5590b78bbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f098c733000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78f90f0 0x5590b78bc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f098c733000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590b77105f0 con 0x5590b78f87d0 2024-01-17T22:59:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f098c733000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590b74001b0 con 0x5590b78f90f0 2024-01-17T22:59:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f098c733000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590b77057c0 con 0x5590b78bd730 2024-01-17T22:59:50.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.619+0000 7f098c733000 10 client.0 _ll_register_callbacks cb 0x5590b7735a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-17T22:59:50.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.623+0000 7f0981400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 0x5590b78bbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.623+0000 7f0981400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 0x5590b78bbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49898/0 (socket says 172.21.15.161:49898) 2024-01-17T22:59:50.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.623+0000 7f0981400640 1 -- 172.21.15.161:0/2125058133 learned_addr learned my addr 172.21.15.161:0/2125058133 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:50.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.623+0000 7f0981e00640 1 --2- 172.21.15.161:0/2125058133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78bd730 0x5590b78bb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.623+0000 7f0982800640 1 --2- 172.21.15.161:0/2125058133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78f90f0 0x5590b78bc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.623+0000 7f0981400640 1 -- 172.21.15.161:0/2125058133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78bd730 msgr2=0x5590b78bb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:50.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.623+0000 7f0981400640 1 --2- 172.21.15.161:0/2125058133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78bd730 0x5590b78bb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.623+0000 7f0981400640 1 -- 172.21.15.161:0/2125058133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78f90f0 msgr2=0x5590b78bc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:50.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.623+0000 7f0981400640 1 --2- 172.21.15.161:0/2125058133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78f90f0 0x5590b78bc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.623+0000 7f0981400640 1 -- 172.21.15.161:0/2125058133 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590b76c85e0 con 0x5590b78f87d0 2024-01-17T22:59:50.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.627+0000 7f0981400640 1 --2- 172.21.15.161:0/2125058133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 0x5590b78bbf20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f096c016010 tx=0x7f096c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1ade457383bb1 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:50.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.627+0000 7f096b400640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2024-01-17T22:59:50.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.631+0000 7f096b400640 1 -- 172.21.15.161:0/2125058133 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c004040 con 0x5590b78f87d0 2024-01-17T22:59:50.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.631+0000 7f096b400640 1 -- 172.21.15.161:0/2125058133 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f096c0041a0 con 0x5590b78f87d0 2024-01-17T22:59:50.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.631+0000 7f098c733000 1 -- 172.21.15.161:0/2125058133 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5590b76ba4f0 con 0x5590b78f87d0 2024-01-17T22:59:50.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.631+0000 7f096b400640 1 -- 172.21.15.161:0/2125058133 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f096c004360 con 0x5590b78f87d0 2024-01-17T22:59:50.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.631+0000 7f098c733000 10 client.4800 fetch_fsmap learned FSMap version 15 2024-01-17T22:59:50.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.631+0000 7f098c733000 1 -- 172.21.15.161:0/2125058133 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5590b73ffcc0 con 0x5590b78f87d0 2024-01-17T22:59:50.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.635+0000 7f096b400640 1 -- 172.21.15.161:0/2125058133 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5590b76ba4f0 con 0x5590b78f87d0 2024-01-17T22:59:50.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.635+0000 7f096b400640 1 -- 172.21.15.161:0/2125058133 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 15) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f096c01e040 con 0x5590b78f87d0 2024-01-17T22:59:50.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.635+0000 7f098c733000 10 client.4800 fetch_fsmap finished waiting for FSMap version 15 2024-01-17T22:59:50.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.635+0000 7f098c733000 10 client.4800 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-17T22:59:50.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.635+0000 7f098c733000 20 client.4800 populate_metadata read hostname 'smithi161' 2024-01-17T22:59:50.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.635+0000 7f098c733000 1 --2- 172.21.15.161:0/2125058133 >> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] conn(0x5590b7963ca0 0x5590b7966090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:50.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.635+0000 7f098c733000 4 client.4800 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-17T22:59:50.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.635+0000 7f098c733000 1 -- 172.21.15.161:0/2125058133 --> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5590b7707310 con 0x5590b7963ca0 2024-01-17T22:59:50.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.639+0000 7f0981e00640 1 --2- 172.21.15.161:0/2125058133 >> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] conn(0x5590b7963ca0 0x5590b7966090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:50.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.647+0000 7f0981e00640 1 --2- 172.21.15.161:0/2125058133 >> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] conn(0x5590b7963ca0 0x5590b7966090 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe93f892cefceac3 server_cookie=d3ccd41a89c248e7 in_seq=0 out_seq=0 2024-01-17T22:59:50.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.647+0000 7f096b400640 10 client.4800 ms_handle_connect on v2:172.21.15.190:6836/561131647 2024-01-17T22:59:50.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f096b400640 1 -- 172.21.15.161:0/2125058133 <== mds.0 v2:172.21.15.190:6836/561131647 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5590b7707310 con 0x5590b7963ca0 2024-01-17T22:59:50.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f096b400640 10 client.4800 handle_command_reply: tid=0 2024-01-17T22:59:50.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f098c733000 1 client.4800 shutdown 2024-01-17T22:59:50.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f098c733000 1 -- 172.21.15.161:0/2125058133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 msgr2=0x5590b78bbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:50.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f098c733000 1 --2- 172.21.15.161:0/2125058133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 0x5590b78bbf20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f096c016010 tx=0x7f096c01a000 comp rx=0 tx=0).stop 2024-01-17T22:59:50.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f098c733000 1 -- 172.21.15.161:0/2125058133 shutdown_connections 2024-01-17T22:59:50.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f098c733000 1 --2- 172.21.15.161:0/2125058133 >> [v2:172.21.15.190:6836/561131647,v1:172.21.15.190:6837/561131647] conn(0x5590b7963ca0 0x5590b7966090 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f098c733000 1 --2- 172.21.15.161:0/2125058133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590b78f90f0 0x5590b78bc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f098c733000 1 --2- 172.21.15.161:0/2125058133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5590b78f87d0 0x5590b78bbf20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f098c733000 1 --2- 172.21.15.161:0/2125058133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5590b78bd730 0x5590b78bb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f096b400640 0 client.4800 ms_handle_reset on v2:172.21.15.190:6836/561131647 2024-01-17T22:59:50.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f098c733000 1 -- 172.21.15.161:0/2125058133 >> 172.21.15.161:0/2125058133 conn(0x5590b78f4580 msgr2=0x5590b78f7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:50.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f098c733000 1 -- 172.21.15.161:0/2125058133 shutdown_connections 2024-01-17T22:59:50.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f098c733000 1 -- 172.21.15.161:0/2125058133 wait complete. 2024-01-17T22:59:50.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f098c733000 20 client.4800 trim_cache size 0 max 16384 2024-01-17T22:59:50.655 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-01-17T22:59:50.655 INFO:teuthology.orchestra.run.smithi161.stdout: "cluster_fsid": "58c3361f-c527-4d53-a987-e30062ef8beb", 2024-01-17T22:59:50.655 INFO:teuthology.orchestra.run.smithi161.stdout: "whoami": 0, 2024-01-17T22:59:50.655 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 4269, 2024-01-17T22:59:50.655 INFO:teuthology.orchestra.run.smithi161.stdout: "want_state": "up:active", 2024-01-17T22:59:50.655 INFO:teuthology.orchestra.run.smithi161.stdout: "state": "up:active", 2024-01-17T22:59:50.655 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs", 2024-01-17T22:59:50.655 INFO:teuthology.orchestra.run.smithi161.stdout: "rank_uptime": 60.409433886999999, 2024-01-17T22:59:50.655 INFO:teuthology.orchestra.run.smithi161.stdout: "mdsmap_epoch": 15, 2024-01-17T22:59:50.655 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch": 28, 2024-01-17T22:59:50.655 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch_barrier": 28, 2024-01-17T22:59:50.655 INFO:teuthology.orchestra.run.smithi161.stdout: "uptime": 84.938850606000003 2024-01-17T22:59:50.655 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-01-17T22:59:50.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f0989200640 1 -- 172.21.15.161:0/2710254616 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f095c066890 msgr2=0x7f095c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:50.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f0989200640 1 --2- 172.21.15.161:0/2710254616 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f095c066890 0x7f095c068d50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f096c009e60 tx=0x7f096c004740 comp rx=0 tx=0).stop 2024-01-17T22:59:50.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f0989200640 1 -- 172.21.15.161:0/2710254616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09841519e0 msgr2=0x7f0984146fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:50.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f0989200640 1 --2- 172.21.15.161:0/2710254616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09841519e0 0x7f0984146fc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f097c00efc0 tx=0x7f097c00c490 comp rx=0 tx=0).stop 2024-01-17T22:59:50.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f0989200640 1 -- 172.21.15.161:0/2710254616 shutdown_connections 2024-01-17T22:59:50.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f0989200640 1 --2- 172.21.15.161:0/2710254616 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f095c066890 0x7f095c068d50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f0989200640 1 --2- 172.21.15.161:0/2710254616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09841519e0 0x7f0984146fc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f0989200640 1 --2- 172.21.15.161:0/2710254616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09840c8b40 0x7f098414b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f0989200640 1 --2- 172.21.15.161:0/2710254616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f098406d890 0x7f098414b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:50.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f0989200640 1 -- 172.21.15.161:0/2710254616 >> 172.21.15.161:0/2710254616 conn(0x7f098406fd30 msgr2=0x7f09840cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:50.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f0989200640 1 -- 172.21.15.161:0/2710254616 shutdown_connections 2024-01-17T22:59:50.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:50.655+0000 7f0989200640 1 -- 172.21.15.161:0/2710254616 wait complete. 2024-01-17T22:59:50.675 INFO:teuthology.run_tasks:Running task kclient... 2024-01-17T22:59:50.687 INFO:tasks.kclient:Mounting kernel clients... 2024-01-17T22:59:50.687 INFO:tasks.kclient:config is {'client.0': {}} 2024-01-17T22:59:50.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:50.688 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-01-17T22:59:50.697 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-01-17T22:59:50.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:50.697 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-17T22:59:50.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:50.760 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2024-01-17T22:59:50.998 INFO:tasks.kclient:client.0 config is {} 2024-01-17T22:59:50.999 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-17T22:59:50.999 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-17T22:59:50.999 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-17T22:59:51.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.139+0000 7fc58f800640 1 Processor -- start 2024-01-17T22:59:51.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.139+0000 7fc58f800640 1 -- start start 2024-01-17T22:59:51.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.139+0000 7fc58f800640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc588072300 0x7fc588072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:51.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.139+0000 7fc58f800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc588157bc0 0x7fc588157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:51.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.139+0000 7fc58f800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58815b9c0 con 0x7fc5881517a0 2024-01-17T22:59:51.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.139+0000 7fc58f800640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc588158530 con 0x7fc588072300 2024-01-17T22:59:51.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.139+0000 7fc58f800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58815ae40 con 0x7fc588157bc0 2024-01-17T22:59:51.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.207+0000 7fc58d800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc588157bc0 0x7fc588157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:51.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.211+0000 7fc58d800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc588157bc0 0x7fc588157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:50862/0 (socket says 172.21.15.161:50862) 2024-01-17T22:59:51.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.211+0000 7fc58d800640 1 -- 172.21.15.161:0/1364376775 learned_addr learned my addr 172.21.15.161:0/1364376775 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:51.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.211+0000 7fc587e00640 1 --2- 172.21.15.161:0/1364376775 >> v2:172.21.15.190:3300/0 conn(0x7fc588072300 0x7fc588072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:51.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.215+0000 7fc58d800640 1 -- 172.21.15.161:0/1364376775 >> v2:172.21.15.190:3300/0 conn(0x7fc588072300 msgr2=0x7fc588072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:51.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.215+0000 7fc58d800640 1 --2- 172.21.15.161:0/1364376775 >> v2:172.21.15.190:3300/0 conn(0x7fc588072300 0x7fc588072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:51.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.215+0000 7fc58d800640 1 -- 172.21.15.161:0/1364376775 >> v1:172.21.15.190:6789/0 conn(0x7fc5881517a0 legacy=0x7fc58806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:51.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.215+0000 7fc58d800640 1 -- 172.21.15.161:0/1364376775 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58815b120 con 0x7fc588157bc0 2024-01-17T22:59:51.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.223+0000 7fc58d800640 1 --2- 172.21.15.161:0/1364376775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc588157bc0 0x7fc588157ff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc580009e50 tx=0x7fc58001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89be5a2db92db27c server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:51.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.231+0000 7fc587400640 1 -- 172.21.15.161:0/1364376775 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800a58a0 con 0x7fc588157bc0 2024-01-17T22:59:51.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.231+0000 7fc587400640 1 -- 172.21.15.161:0/1364376775 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5800a5a00 con 0x7fc588157bc0 2024-01-17T22:59:51.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.231+0000 7fc587400640 1 -- 172.21.15.161:0/1364376775 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800a5d90 con 0x7fc588157bc0 2024-01-17T22:59:51.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.231+0000 7fc58f800640 1 -- 172.21.15.161:0/1364376775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc588157bc0 msgr2=0x7fc588157ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:51.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.231+0000 7fc58f800640 1 --2- 172.21.15.161:0/1364376775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc588157bc0 0x7fc588157ff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc580009e50 tx=0x7fc58001c9e0 comp rx=0 tx=0).stop 2024-01-17T22:59:51.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.231+0000 7fc58f800640 1 -- 172.21.15.161:0/1364376775 shutdown_connections 2024-01-17T22:59:51.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.231+0000 7fc58f800640 1 --2- 172.21.15.161:0/1364376775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc588157bc0 0x7fc588157ff0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:51.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.231+0000 7fc58f800640 1 --2- 172.21.15.161:0/1364376775 >> v2:172.21.15.190:3300/0 conn(0x7fc588072300 0x7fc588072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:51.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.231+0000 7fc58f800640 1 -- 172.21.15.161:0/1364376775 >> 172.21.15.161:0/1364376775 conn(0x7fc5880cb070 msgr2=0x7fc5880cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:51.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.231+0000 7fc58f800640 1 -- 172.21.15.161:0/1364376775 shutdown_connections 2024-01-17T22:59:51.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.231+0000 7fc58f800640 1 -- 172.21.15.161:0/1364376775 wait complete. 2024-01-17T22:59:51.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.235+0000 7fc58f800640 1 Processor -- start 2024-01-17T22:59:51.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.235+0000 7fc58f800640 1 -- start start 2024-01-17T22:59:51.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.235+0000 7fc58f800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc588072300 0x7fc588158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:51.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.235+0000 7fc58f800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5881517a0 0x7fc5880c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:51.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.235+0000 7fc58f800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc588157bc0 0x7fc5880ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:51.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.235+0000 7fc58f800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58815a140 con 0x7fc588157bc0 2024-01-17T22:59:51.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.235+0000 7fc58f800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5881f5480 con 0x7fc5881517a0 2024-01-17T22:59:51.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.235+0000 7fc58f800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58814f360 con 0x7fc588072300 2024-01-17T22:59:51.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.235+0000 7fc58d800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc588157bc0 0x7fc5880ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:51.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.235+0000 7fc58d800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc588157bc0 0x7fc5880ca530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49912/0 (socket says 172.21.15.161:49912) 2024-01-17T22:59:51.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.235+0000 7fc58d800640 1 -- 172.21.15.161:0/4109618062 learned_addr learned my addr 172.21.15.161:0/4109618062 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-17T22:59:51.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.235+0000 7fc58ce00640 1 --2- 172.21.15.161:0/4109618062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc588072300 0x7fc588158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:51.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.235+0000 7fc587e00640 1 --2- 172.21.15.161:0/4109618062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5881517a0 0x7fc5880c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:51.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.239+0000 7fc58d800640 1 -- 172.21.15.161:0/4109618062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc588072300 msgr2=0x7fc588158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:51.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.239+0000 7fc58d800640 1 --2- 172.21.15.161:0/4109618062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc588072300 0x7fc588158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:51.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.239+0000 7fc58d800640 1 -- 172.21.15.161:0/4109618062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5881517a0 msgr2=0x7fc5880c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:51.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.239+0000 7fc58d800640 1 --2- 172.21.15.161:0/4109618062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5881517a0 0x7fc5880c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:51.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.239+0000 7fc58d800640 1 -- 172.21.15.161:0/4109618062 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc580009b30 con 0x7fc588157bc0 2024-01-17T22:59:51.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.243+0000 7fc58d800640 1 --2- 172.21.15.161:0/4109618062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc588157bc0 0x7fc5880ca530 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc58001a610 tx=0x7fc580019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:51.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.247+0000 7fc584c00640 1 -- 172.21.15.161:0/4109618062 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800b8670 con 0x7fc588157bc0 2024-01-17T22:59:51.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.247+0000 7fc584c00640 1 -- 172.21.15.161:0/4109618062 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5800b87d0 con 0x7fc588157bc0 2024-01-17T22:59:51.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.247+0000 7fc584c00640 1 -- 172.21.15.161:0/4109618062 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800b8b80 con 0x7fc588157bc0 2024-01-17T22:59:51.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.247+0000 7fc58f800640 1 -- 172.21.15.161:0/4109618062 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5881f5690 con 0x7fc588157bc0 2024-01-17T22:59:51.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.247+0000 7fc58f800640 1 -- 172.21.15.161:0/4109618062 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5881f5c50 con 0x7fc588157bc0 2024-01-17T22:59:51.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.247+0000 7fc58f800640 1 -- 172.21.15.161:0/4109618062 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5880746a0 con 0x7fc588157bc0 2024-01-17T22:59:51.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.483+0000 7fc584c00640 1 -- 172.21.15.161:0/4109618062 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fc5800b8ce0 con 0x7fc588157bc0 2024-01-17T22:59:51.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.483+0000 7fc584c00640 1 --2- 172.21.15.161:0/4109618062 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc560066870 0x7fc560068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:51.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.487+0000 7fc58ce00640 1 --2- 172.21.15.161:0/4109618062 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc560066870 0x7fc560068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:51.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.487+0000 7fc58ce00640 1 --2- 172.21.15.161:0/4109618062 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc560066870 0x7fc560068d30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc578001770 tx=0x7fc578009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:51.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.495+0000 7fc584c00640 1 -- 172.21.15.161:0/4109618062 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fc5800f1200 con 0x7fc588157bc0 2024-01-17T22:59:51.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.495+0000 7fc584c00640 1 -- 172.21.15.161:0/4109618062 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fc5800ed540 con 0x7fc588157bc0 2024-01-17T22:59:51.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.683+0000 7fc58f800640 1 -- 172.21.15.161:0/4109618062 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc58806ea40 con 0x7fc588157bc0 2024-01-17T22:59:51.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.687+0000 7fc584c00640 1 -- 172.21.15.161:0/4109618062 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc5800f0b60 con 0x7fc588157bc0 2024-01-17T22:59:51.687 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-17T22:59:51.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.691+0000 7fc58f800640 1 -- 172.21.15.161:0/4109618062 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc560066870 msgr2=0x7fc560068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:51.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.691+0000 7fc58f800640 1 --2- 172.21.15.161:0/4109618062 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc560066870 0x7fc560068d30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc578001770 tx=0x7fc578009040 comp rx=0 tx=0).stop 2024-01-17T22:59:51.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.691+0000 7fc58f800640 1 -- 172.21.15.161:0/4109618062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc588157bc0 msgr2=0x7fc5880ca530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:51.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.691+0000 7fc58f800640 1 --2- 172.21.15.161:0/4109618062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc588157bc0 0x7fc5880ca530 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc58001a610 tx=0x7fc580019780 comp rx=0 tx=0).stop 2024-01-17T22:59:51.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.691+0000 7fc58f800640 1 -- 172.21.15.161:0/4109618062 shutdown_connections 2024-01-17T22:59:51.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.691+0000 7fc58f800640 1 --2- 172.21.15.161:0/4109618062 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc560066870 0x7fc560068d30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:51.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.691+0000 7fc58f800640 1 --2- 172.21.15.161:0/4109618062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5881517a0 0x7fc5880c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:51.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.691+0000 7fc58f800640 1 --2- 172.21.15.161:0/4109618062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc588157bc0 0x7fc5880ca530 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:51.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.691+0000 7fc58f800640 1 --2- 172.21.15.161:0/4109618062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc588072300 0x7fc588158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:51.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.691+0000 7fc58f800640 1 -- 172.21.15.161:0/4109618062 >> 172.21.15.161:0/4109618062 conn(0x7fc5880cb070 msgr2=0x7fc588071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:51.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.691+0000 7fc58f800640 1 -- 172.21.15.161:0/4109618062 shutdown_connections 2024-01-17T22:59:51.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-17T22:59:51.691+0000 7fc58f800640 1 -- 172.21.15.161:0/4109618062 wait complete. 2024-01-17T22:59:51.708 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-17T22:59:51.708 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-17T22:59:51.708 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2024-01-17T22:59:51.709 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-17T22:59:51.709 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-17T22:59:51.709 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-17T22:59:51.709 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-17T22:59:51.709 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-17T22:59:51.709 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-17T22:59:51.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:51.709 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2024-01-17T22:59:51.718 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-17T22:59:51.719 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-17T22:59:51.719 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2024-01-17T22:59:51.719 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-01-17T22:59:51.719 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2024-01-17T22:59:51.719 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-01-17T22:59:51.719 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-17T22:59:51.719 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2024-01-17T22:59:51.719 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2024-01-17T22:59:51.719 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-17T22:59:51.719 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2024-01-17T22:59:51.719 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2024-01-17T22:59:51.719 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-17T22:59:51.719 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2024-01-17T22:59:51.719 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-17T22:59:51.719 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2024-01-17T22:59:51.720 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-17T22:59:51.720 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 35036sec preferred_lft 35036sec 2024-01-17T22:59:51.720 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2024-01-17T22:59:51.720 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-01-17T22:59:51.720 INFO:teuthology.orchestra.run.smithi161.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-17T22:59:51.720 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 02:42:29:ee:21:87 brd ff:ff:ff:ff:ff:ff 2024-01-17T22:59:51.720 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-17T22:59:51.720 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-01-17T22:59:51.720 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-17T22:59:51.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:51.720 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-01-17T22:59:51.720 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-01-17T22:59:51.721 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add name ceph-brx type bridge 2024-01-17T22:59:51.721 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr flush dev ceph-brx 2024-01-17T22:59:51.721 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set ceph-brx up 2024-01-17T22:59:51.721 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-17T22:59:51.721 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-01-17T22:59:51.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:51.834 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-17T22:59:51.853 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-01-17T22:59:51.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:51.855 DEBUG:teuthology.orchestra.run.smithi161:> route 2024-01-17T22:59:51.906 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2024-01-17T22:59:51.906 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-17T22:59:51.906 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-17T22:59:51.906 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-17T22:59:51.906 INFO:teuthology.orchestra.run.smithi161.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-17T22:59:51.906 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-17T22:59:51.907 INFO:teuthology.orchestra.run.smithi161.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-17T22:59:51.907 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-17T22:59:51.907 INFO:teuthology.orchestra.run.smithi161.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-17T22:59:51.907 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-17T22:59:51.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:51.907 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-01-17T22:59:51.907 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-01-17T22:59:51.907 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-17T22:59:51.907 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-17T22:59:51.907 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-17T22:59:51.907 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-01-17T22:59:51.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:51.996 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-01-17T22:59:52.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:52.005 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2024-01-17T22:59:52.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:52.056 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-01-17T22:59:52.056 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-01-17T22:59:52.056 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-17T22:59:52.056 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-17T22:59:52.057 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-01-17T22:59:52.141 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-17T22:59:52.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:52.141 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-01-17T22:59:52.141 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-01-17T22:59:52.141 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-17T22:59:52.141 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-17T22:59:52.141 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-17T22:59:52.142 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-17T22:59:52.142 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-17T22:59:52.142 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-01-17T22:59:52.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:52.276 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-01-17T22:59:52.276 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-01-17T22:59:52.276 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2024-01-17T22:59:52.276 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.0 master ceph-brx 2024-01-17T22:59:52.277 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-01-17T22:59:52.314 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-17T22:59:52.314 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-17T22:59:52.368 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-17T22:59:52.368 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-17T22:59:52.368 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-17T22:59:52.420 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-01-17T22:59:52.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:52.420 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-17T22:59:52.508 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-17T22:59:52.508 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-17T22:59:53.282 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-17T22:59:53.282 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-17T22:59:53.282 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.161:3300,172.21.15.190:3300,172.21.15.190:3301" 2024-01-17T22:59:53.282 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with new device syntax: 0@58c3361f-c527-4d53-a987-e30062ef8beb.cephfs=/ 2024-01-17T22:59:53.282 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.161:3300/172.21.15.190:3300/172.21.15.190:3301" will pass to kernel 2024-01-17T22:59:53.286 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-17T22:59:53.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:53.286 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-17T22:59:53.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:53.306 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-17T22:59:53.370 INFO:teuthology.orchestra.run.smithi161.stdout:client4806 2024-01-17T22:59:53.371 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T22:59:53.371 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-17T22:59:53.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:53.421 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-17T22:59:53.489 INFO:teuthology.orchestra.run.smithi161.stdout:client4806 2024-01-17T22:59:53.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:53.490 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-17T22:59:53.552 INFO:teuthology.orchestra.run.smithi161.stdout:client4806 2024-01-17T22:59:53.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T22:59:53.553 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/58c3361f-c527-4d53-a987-e30062ef8beb.client4806/status') 2024-01-17T22:59:53.614 INFO:teuthology.orchestra.run.smithi161.stdout:instance: client.4806 (3)192.168.0.1:0/551542985 2024-01-17T22:59:53.615 INFO:teuthology.orchestra.run.smithi161.stdout:blocklisted: false 2024-01-17T22:59:53.615 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2024-01-17T22:59:53.615 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2024-01-17T22:59:53.615 INFO:teuthology.orchestra.run.smithi161.stderr:68 bytes copied, 4.8853e-05 s, 1.4 MB/s 2024-01-17T22:59:53.617 INFO:teuthology.run_tasks:Running task workunit... 2024-01-17T22:59:53.629 INFO:tasks.workunit:Pulling workunits from ref 1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 2024-01-17T22:59:53.629 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-01-17T22:59:53.629 INFO:tasks.workunit:timeout=6h 2024-01-17T22:59:53.629 INFO:tasks.workunit:cleanup=True 2024-01-17T22:59:53.630 DEBUG:teuthology.orchestra.run.smithi161:> stat -- /home/ubuntu/cephtest/mnt.0 2024-01-17T22:59:53.668 INFO:teuthology.orchestra.run.smithi161.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-01-17T22:59:53.668 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-01-17T22:59:53.668 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-01-17T22:59:53.668 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T22:59:53.668 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-01-17T22:59:53.669 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-01-17 22:58:50.561226944 +0000 2024-01-17T22:59:53.669 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-01-17 22:59:05.772663488 +0000 2024-01-17T22:59:53.669 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-01-17 22:58:50.561226944 +0000 2024-01-17T22:59:53.669 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-01-17T22:59:53.669 DEBUG:teuthology.orchestra.run.smithi161:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-01-17T22:59:54.489 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 2024-01-17T22:59:54.499 INFO:tasks.workunit.client.0.smithi161.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-01-17T23:00:00.482 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:00:00.486 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:00:30.770 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:00:30.775 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:01:00.918 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:01:00.924 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:01:13.529 INFO:tasks.workunit.client.0.smithi161.stderr:Updating files: 68% (8339/12176) Updating files: 69% (8402/12176) Updating files: 70% (8524/12176) Updating files: 71% (8645/12176) Updating files: 72% (8767/12176) Updating files: 73% (8889/12176) Updating files: 74% (9011/12176) Updating files: 75% (9132/12176) Updating files: 76% (9254/12176) Updating files: 77% (9376/12176) Updating files: 78% (9498/12176) Updating files: 79% (9620/12176) Updating files: 80% (9741/12176) Updating files: 81% (9863/12176) Updating files: 82% (9985/12176) Updating files: 83% (10107/12176) Updating files: 84% (10228/12176) Updating files: 85% (10350/12176) Updating files: 86% (10472/12176) Updating files: 87% (10594/12176) Updating files: 88% (10715/12176) Updating files: 89% (10837/12176) Updating files: 90% (10959/12176) Updating files: 91% (11081/12176) Updating files: 92% (11202/12176) Updating files: 93% (11324/12176) Updating files: 94% (11446/12176) Updating files: 95% (11568/12176) Updating files: 96% (11689/12176) Updating files: 97% (11811/12176) Updating files: 98% (11933/12176) Updating files: 99% (12055/12176) Updating files: 100% (12176/12176) Updating files: 100% (12176/12176), done. 2024-01-17T23:01:13.936 INFO:tasks.workunit.client.0.smithi161.stderr:Note: switching to '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4'. 2024-01-17T23:01:13.936 INFO:tasks.workunit.client.0.smithi161.stderr: 2024-01-17T23:01:13.936 INFO:tasks.workunit.client.0.smithi161.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-01-17T23:01:13.936 INFO:tasks.workunit.client.0.smithi161.stderr:changes and commit them, and you can discard any commits you make in this 2024-01-17T23:01:13.936 INFO:tasks.workunit.client.0.smithi161.stderr:state without impacting any branches by switching back to a branch. 2024-01-17T23:01:13.936 INFO:tasks.workunit.client.0.smithi161.stderr: 2024-01-17T23:01:13.936 INFO:tasks.workunit.client.0.smithi161.stderr:If you want to create a new branch to retain commits you create, you may 2024-01-17T23:01:13.936 INFO:tasks.workunit.client.0.smithi161.stderr:do so (now or later) by using -c with the switch command. Example: 2024-01-17T23:01:13.936 INFO:tasks.workunit.client.0.smithi161.stderr: 2024-01-17T23:01:13.936 INFO:tasks.workunit.client.0.smithi161.stderr: git switch -c 2024-01-17T23:01:13.936 INFO:tasks.workunit.client.0.smithi161.stderr: 2024-01-17T23:01:13.937 INFO:tasks.workunit.client.0.smithi161.stderr:Or undo this operation with: 2024-01-17T23:01:13.937 INFO:tasks.workunit.client.0.smithi161.stderr: 2024-01-17T23:01:13.937 INFO:tasks.workunit.client.0.smithi161.stderr: git switch - 2024-01-17T23:01:13.937 INFO:tasks.workunit.client.0.smithi161.stderr: 2024-01-17T23:01:13.937 INFO:tasks.workunit.client.0.smithi161.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-01-17T23:01:13.937 INFO:tasks.workunit.client.0.smithi161.stderr: 2024-01-17T23:01:13.937 INFO:tasks.workunit.client.0.smithi161.stderr:HEAD is now at 1ec1182e55b Merge pull request #53678 from cbodley/wip-qa-rgw-upgrade-reef 2024-01-17T23:01:13.939 DEBUG:teuthology.orchestra.run.smithi161:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-01-17T23:01:13.948 INFO:tasks.workunit.client.0.smithi161.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-01-17T23:01:13.951 INFO:tasks.workunit.client.0.smithi161.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-17T23:01:13.951 INFO:tasks.workunit.client.0.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-01-17T23:01:14.839 INFO:tasks.workunit.client.0.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-01-17T23:01:14.921 INFO:tasks.workunit.client.0.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-01-17T23:01:14.978 INFO:tasks.workunit.client.0.smithi161.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-17T23:01:14.980 INFO:tasks.workunit.client.0.smithi161.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-17T23:01:14.981 INFO:tasks.workunit.client.0.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-01-17T23:01:15.033 INFO:tasks.workunit.client.0.smithi161.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-17T23:01:15.038 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-17T23:01:15.039 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-01-17T23:01:15.089 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-01-17T23:01:15.090 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-01-17T23:01:15.090 DEBUG:teuthology.orchestra.run.smithi161:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-01-17T23:01:15.384 INFO:tasks.workunit.client.0.smithi161.stderr:+ mkdir -p fsstress 2024-01-17T23:01:15.441 INFO:tasks.workunit.client.0.smithi161.stderr:+ pushd fsstress 2024-01-17T23:01:15.442 INFO:tasks.workunit.client.0.smithi161.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-01-17T23:01:15.442 INFO:tasks.workunit.client.0.smithi161.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-01-17T23:01:16.153 INFO:tasks.workunit.client.0.smithi161.stderr:+ tar xzf ltp-full.tgz 2024-01-17T23:01:31.098 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:01:31.102 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:02:01.146 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:02:01.150 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:02:31.286 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:02:31.290 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:03:01.333 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:03:01.337 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:03:31.447 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:03:31.452 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:04:01.510 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:04:01.515 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:04:31.566 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:04:31.570 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:05:01.884 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:05:01.888 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:05:31.938 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:05:31.942 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:06:02.012 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:06:02.016 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:06:32.325 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:06:32.329 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:07:02.393 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:07:02.398 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:07:07.378 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:09:30.737 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:07:07.440 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:09:30.800 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:07:07.577 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:09:30.853 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:07:07.604 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:09:30.880 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:07:07.690 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:09:30.967 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:07:07.736 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:09:31.012 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:07:07.862 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:09:31.221 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:07:08.222 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:09:31.498 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:07:08.318 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:09:31.594 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:07:32.657 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:07:32.661 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:07:50.114 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:10:13.473 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:07:50.126 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:10:13.485 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:07:50.167 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:10:13.442 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:07:50.169 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:10:13.445 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:07:50.180 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:10:13.455 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:07:50.185 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:10:13.461 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:07:50.190 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:10:13.550 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:07:50.274 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:10:13.550 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:07:50.407 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:10:13.683 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:08:02.716 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:08:02.720 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:08:32.835 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:08:32.839 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:09:02.940 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:09:02.944 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:09:33.255 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:09:33.259 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:10:03.318 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:10:03.323 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:10:33.439 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:10:33.443 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:11:03.689 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:11:03.694 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:11:17.426 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:13:40.785 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:11:17.462 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:13:40.738 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:11:17.465 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:13:40.742 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:11:17.472 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:13:40.748 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:11:17.475 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:13:40.834 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:11:17.546 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:13:40.822 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:11:17.562 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:13:40.921 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:11:17.698 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:13:40.974 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:11:17.724 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:13:41.001 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:11:33.750 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:11:33.755 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:12:03.874 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:12:03.878 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:12:33.962 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:12:33.967 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:13:04.070 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:13:04.074 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:13:34.215 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:13:34.219 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:14:04.336 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:14:04.340 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:14:34.702 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:14:34.706 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:14:45.326 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:17:08.685 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:14:45.331 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:17:08.690 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:14:45.402 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:17:08.678 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:14:45.406 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:17:08.681 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:14:45.411 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:17:08.688 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:14:45.442 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:17:08.801 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:14:45.462 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:17:08.739 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:14:45.572 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:17:08.849 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:14:45.611 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:17:08.887 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:15:04.770 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:15:04.774 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:15:28.723 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:17:52.082 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:15:28.726 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:17:52.085 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:15:28.752 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:17:52.111 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:15:28.818 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:17:52.095 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:15:28.825 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:17:52.103 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:15:28.865 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:17:52.142 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:15:28.873 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:17:52.150 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:15:28.874 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:17:52.152 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:15:29.006 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:17:52.282 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:15:34.827 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:15:34.831 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:16:04.983 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:16:04.987 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:16:35.098 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:16:35.103 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:17:05.150 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:17:05.154 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:17:35.430 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:17:35.434 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:18:05.485 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:18:05.489 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:18:35.562 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:18:35.566 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:19:05.811 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:19:05.815 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:19:35.876 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:19:35.880 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:20:05.936 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:20:05.940 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:20:36.119 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:20:36.123 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:21:06.467 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:21:06.471 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:21:36.580 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:21:36.585 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:21:39.852 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:24:03.210 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:21:39.858 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:24:03.216 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:21:39.903 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:24:03.180 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:21:39.903 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:24:03.180 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:21:39.909 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:24:03.187 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:21:39.916 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:24:03.192 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:21:40.009 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:24:03.367 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:21:40.124 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:24:03.402 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:21:40.137 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:24:03.414 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:22:06.685 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:22:06.689 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:22:34.912 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:24:58.270 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:22:34.960 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:24:58.318 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:22:34.998 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:24:58.356 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:22:35.032 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:24:58.309 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:22:35.038 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:24:58.316 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:22:35.043 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:24:58.320 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:22:35.055 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:24:58.332 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:22:35.104 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:24:58.381 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:22:35.121 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:24:58.398 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:22:36.782 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:22:36.786 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:23:06.904 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:23:06.908 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:23:37.035 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:23:37.039 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:23:50.208 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:26:13.565 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:50.211 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:26:13.569 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:50.249 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:26:13.607 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:50.288 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:26:13.565 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:50.302 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:26:13.579 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:50.329 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:26:13.606 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:50.335 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:26:13.613 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:50.380 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:26:13.657 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:50.411 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:26:13.689 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:24:07.097 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:24:07.101 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:24:37.221 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:24:37.225 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:25:05.608 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:27:28.965 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:25:05.616 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:27:28.973 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:25:05.643 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:27:28.919 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:25:05.643 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:27:28.920 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:25:05.648 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:27:28.925 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:25:05.653 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:27:28.930 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:25:05.667 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:27:29.025 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:25:05.720 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:27:28.998 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:25:05.723 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:27:29.000 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:25:07.357 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:25:07.361 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:25:37.438 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:25:37.442 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:26:07.826 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:26:07.831 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:26:37.948 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:26:37.953 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:27:08.175 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:27:08.179 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:27:38.455 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:27:38.460 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:28:08.505 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:28:08.510 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:28:33.465 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:30:56.821 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:28:33.469 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:30:56.826 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:28:33.511 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:30:56.788 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:28:33.513 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:30:56.789 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:28:33.522 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:30:56.799 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:28:33.539 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:30:56.815 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:28:33.560 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:30:56.916 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:28:33.672 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:30:56.950 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:28:33.728 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:30:57.004 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:28:38.619 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:28:38.623 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:29:08.747 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:29:08.751 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:29:38.880 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:29:38.887 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:29:46.612 INFO:tasks.workunit.client.0.smithi161.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-01-17T23:29:48.536 INFO:tasks.workunit.client.0.smithi161.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-01-17T23:29:48.536 INFO:tasks.workunit.client.0.smithi161.stderr:+ make 2024-01-17T23:29:51.846 INFO:tasks.workunit.client.0.smithi161.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-01-17T23:29:53.190 INFO:tasks.workunit.client.0.smithi161.stderr:++ readlink -f fsstress 2024-01-17T23:29:53.191 INFO:tasks.workunit.client.0.smithi161.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-01-17T23:29:53.191 INFO:tasks.workunit.client.0.smithi161.stderr:+ popd 2024-01-17T23:29:53.192 INFO:tasks.workunit.client.0.smithi161.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-01-17T23:29:53.192 INFO:tasks.workunit.client.0.smithi161.stderr:+ popd 2024-01-17T23:29:53.193 INFO:tasks.workunit.client.0.smithi161.stdout:~/cephtest/mnt.0/client.0/tmp 2024-01-17T23:29:53.193 INFO:tasks.workunit.client.0.smithi161.stderr:++ mktemp -d -p . 2024-01-17T23:29:53.235 INFO:tasks.workunit.client.0.smithi161.stderr:+ T=./tmp.qsQmKch1e7 2024-01-17T23:29:53.236 INFO:tasks.workunit.client.0.smithi161.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.qsQmKch1e7 -l 1 -n 1000 -p 10 -v 2024-01-17T23:29:53.291 INFO:tasks.workunit.client.0.smithi161.stdout:seed = 1705776023 2024-01-17T23:29:53.484 INFO:tasks.workunit.client.0.smithi161.stdout:0/0: chown . 6 1 2024-01-17T23:29:53.484 INFO:tasks.workunit.client.0.smithi161.stdout:0/1: readlink - no filename 2024-01-17T23:29:53.484 INFO:tasks.workunit.client.0.smithi161.stdout:0/2: rmdir - no directory 2024-01-17T23:29:53.553 INFO:tasks.workunit.client.0.smithi161.stdout:0/3: creat f0 x:0 0 0 2024-01-17T23:29:53.553 INFO:tasks.workunit.client.0.smithi161.stdout:1/0: dwrite - no filename 2024-01-17T23:29:53.553 INFO:tasks.workunit.client.0.smithi161.stdout:1/1: dread - no filename 2024-01-17T23:29:53.611 INFO:tasks.workunit.client.0.smithi161.stdout:0/4: link f0 f1 0 2024-01-17T23:29:53.611 INFO:tasks.workunit.client.0.smithi161.stdout:0/5: fdatasync f1 0 2024-01-17T23:29:53.661 INFO:tasks.workunit.client.0.smithi161.stdout:1/2: symlink l0 0 2024-01-17T23:29:53.661 INFO:tasks.workunit.client.0.smithi161.stdout:1/3: dwrite - no filename 2024-01-17T23:29:53.661 INFO:tasks.workunit.client.0.smithi161.stdout:1/4: write - no filename 2024-01-17T23:29:53.661 INFO:tasks.workunit.client.0.smithi161.stdout:1/5: stat l0 0 2024-01-17T23:29:53.661 INFO:tasks.workunit.client.0.smithi161.stdout:2/0: dwrite - no filename 2024-01-17T23:29:53.870 INFO:tasks.workunit.client.0.smithi161.stdout:0/6: link f0 f2 0 2024-01-17T23:29:53.870 INFO:tasks.workunit.client.0.smithi161.stdout:3/0: dread - no filename 2024-01-17T23:29:53.870 INFO:tasks.workunit.client.0.smithi161.stdout:3/1: getdents . 0 2024-01-17T23:29:53.870 INFO:tasks.workunit.client.0.smithi161.stdout:3/2: rename - no filename 2024-01-17T23:29:53.871 INFO:tasks.workunit.client.0.smithi161.stdout:3/3: rename - no filename 2024-01-17T23:29:53.871 INFO:tasks.workunit.client.0.smithi161.stdout:3/4: dread - no filename 2024-01-17T23:29:53.907 INFO:tasks.workunit.client.0.smithi161.stdout:1/6: mkdir d1 0 2024-01-17T23:29:53.907 INFO:tasks.workunit.client.0.smithi161.stdout:1/7: fsync - no filename 2024-01-17T23:29:53.907 INFO:tasks.workunit.client.0.smithi161.stdout:1/8: dread - no filename 2024-01-17T23:29:53.908 INFO:tasks.workunit.client.0.smithi161.stdout:2/1: mknod c0 0 2024-01-17T23:29:53.908 INFO:tasks.workunit.client.0.smithi161.stdout:2/2: read - no filename 2024-01-17T23:29:53.908 INFO:tasks.workunit.client.0.smithi161.stdout:1/9: readlink l0 0 2024-01-17T23:29:53.908 INFO:tasks.workunit.client.0.smithi161.stdout:2/3: chown c0 6808435 1 2024-01-17T23:29:54.160 INFO:tasks.workunit.client.0.smithi161.stdout:0/7: mknod c3 0 2024-01-17T23:29:54.160 INFO:tasks.workunit.client.0.smithi161.stdout:0/8: dread - f1 zero size 2024-01-17T23:29:54.160 INFO:tasks.workunit.client.0.smithi161.stdout:3/5: mkdir d0 0 2024-01-17T23:29:54.160 INFO:tasks.workunit.client.0.smithi161.stdout:3/6: write - no filename 2024-01-17T23:29:54.179 INFO:tasks.workunit.client.0.smithi161.stdout:2/4: symlink l1 0 2024-01-17T23:29:54.179 INFO:tasks.workunit.client.0.smithi161.stdout:2/5: readlink l1 0 2024-01-17T23:29:54.179 INFO:tasks.workunit.client.0.smithi161.stdout:2/6: fdatasync - no filename 2024-01-17T23:29:54.179 INFO:tasks.workunit.client.0.smithi161.stdout:2/7: rmdir - no directory 2024-01-17T23:29:54.179 INFO:tasks.workunit.client.0.smithi161.stdout:2/8: dwrite - no filename 2024-01-17T23:29:54.179 INFO:tasks.workunit.client.0.smithi161.stdout:2/9: write - no filename 2024-01-17T23:29:54.179 INFO:tasks.workunit.client.0.smithi161.stdout:2/10: fsync - no filename 2024-01-17T23:29:54.179 INFO:tasks.workunit.client.0.smithi161.stdout:2/11: write - no filename 2024-01-17T23:30:08.984 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:30:08.989 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:30:34.847 INFO:tasks.workunit.client.0.smithi161.stdout:0/9: symlink l4 0 2024-01-17T23:30:34.847 INFO:tasks.workunit.client.0.smithi161.stdout:0/10: write f2 [381534,97182] 0 2024-01-17T23:30:34.862 INFO:tasks.workunit.client.0.smithi161.stdout:0/11: dread f1 [0,4194304] 0 2024-01-17T23:30:34.982 INFO:tasks.workunit.client.0.smithi161.stdout:4/0: creat f0 x:0 0 0 2024-01-17T23:30:34.982 INFO:tasks.workunit.client.0.smithi161.stdout:4/1: write f0 [294353,94567] 0 2024-01-17T23:30:34.984 INFO:tasks.workunit.client.0.smithi161.stdout:4/2: write f0 [14079,96731] 0 2024-01-17T23:30:35.048 INFO:tasks.workunit.client.0.smithi161.stdout:4/3: dwrite f0 [0,4194304] 0 2024-01-17T23:30:35.055 INFO:tasks.workunit.client.0.smithi161.stdout:2/12: mknod c2 0 2024-01-17T23:30:35.055 INFO:tasks.workunit.client.0.smithi161.stdout:2/13: dread - no filename 2024-01-17T23:30:35.055 INFO:tasks.workunit.client.0.smithi161.stdout:2/14: fdatasync - no filename 2024-01-17T23:30:35.070 INFO:tasks.workunit.client.0.smithi161.stdout:4/4: dread f0 [0,4194304] 0 2024-01-17T23:30:35.392 INFO:tasks.workunit.client.0.smithi161.stdout:0/12: mkdir d5 0 2024-01-17T23:30:35.662 INFO:tasks.workunit.client.0.smithi161.stdout:2/15: symlink l3 0 2024-01-17T23:30:35.840 INFO:tasks.workunit.client.0.smithi161.stdout:0/13: creat d5/f6 x:0 0 0 2024-01-17T23:30:35.840 INFO:tasks.workunit.client.0.smithi161.stdout:0/14: write d5/f6 [109955,96186] 0 2024-01-17T23:30:35.917 INFO:tasks.workunit.client.0.smithi161.stdout:2/16: unlink l3 0 2024-01-17T23:30:35.917 INFO:tasks.workunit.client.0.smithi161.stdout:2/17: chown l1 6 1 2024-01-17T23:30:35.917 INFO:tasks.workunit.client.0.smithi161.stdout:2/18: dwrite - no filename 2024-01-17T23:30:35.917 INFO:tasks.workunit.client.0.smithi161.stdout:2/19: fsync - no filename 2024-01-17T23:30:35.917 INFO:tasks.workunit.client.0.smithi161.stdout:2/20: fdatasync - no filename 2024-01-17T23:30:36.091 INFO:tasks.workunit.client.0.smithi161.stdout:0/15: link f0 d5/f7 0 2024-01-17T23:30:36.295 INFO:tasks.workunit.client.0.smithi161.stdout:2/21: link l1 l4 0 2024-01-17T23:30:36.295 INFO:tasks.workunit.client.0.smithi161.stdout:2/22: truncate - no filename 2024-01-17T23:30:36.585 INFO:tasks.workunit.client.0.smithi161.stdout:0/16: mkdir d5/d8 0 2024-01-17T23:30:36.588 INFO:tasks.workunit.client.0.smithi161.stdout:0/17: dread d5/f7 [0,4194304] 0 2024-01-17T23:30:36.616 INFO:tasks.workunit.client.0.smithi161.stdout:0/18: dwrite f1 [0,4194304] 0 2024-01-17T23:30:36.645 INFO:tasks.workunit.client.0.smithi161.stdout:0/19: dwrite f2 [0,4194304] 0 2024-01-17T23:30:36.778 INFO:tasks.workunit.client.0.smithi161.stdout:2/23: symlink l5 0 2024-01-17T23:30:37.460 INFO:tasks.workunit.client.0.smithi161.stdout:0/20: creat d5/d8/f9 x:0 0 0 2024-01-17T23:30:37.474 INFO:tasks.workunit.client.0.smithi161.stdout:0/21: dread d5/f7 [0,4194304] 0 2024-01-17T23:30:37.497 INFO:tasks.workunit.client.0.smithi161.stdout:0/22: dwrite f0 [0,4194304] 0 2024-01-17T23:30:39.099 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:30:39.102 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:30:39.210 INFO:tasks.workunit.client.0.smithi161.stdout:1/10: sync 2024-01-17T23:30:39.210 INFO:tasks.workunit.client.0.smithi161.stdout:1/11: readlink l0 0 2024-01-17T23:30:39.210 INFO:tasks.workunit.client.0.smithi161.stdout:1/12: read - no filename 2024-01-17T23:30:39.210 INFO:tasks.workunit.client.0.smithi161.stdout:1/13: dwrite - no filename 2024-01-17T23:30:39.210 INFO:tasks.workunit.client.0.smithi161.stdout:1/14: chown d1 10503 1 2024-01-17T23:30:39.276 INFO:tasks.workunit.client.0.smithi161.stdout:4/5: getdents . 0 2024-01-17T23:30:39.611 INFO:tasks.workunit.client.0.smithi161.stdout:2/24: getdents . 0 2024-01-17T23:30:39.612 INFO:tasks.workunit.client.0.smithi161.stdout:2/25: dwrite - no filename 2024-01-17T23:30:39.615 INFO:tasks.workunit.client.0.smithi161.stdout:0/23: symlink d5/la 0 2024-01-17T23:30:39.615 INFO:tasks.workunit.client.0.smithi161.stdout:0/24: creat d5/fb x:0 0 0 2024-01-17T23:30:39.615 INFO:tasks.workunit.client.0.smithi161.stdout:0/25: fdatasync d5/f7 0 2024-01-17T23:30:39.615 INFO:tasks.workunit.client.0.smithi161.stdout:4/6: symlink l1 0 2024-01-17T23:30:39.615 INFO:tasks.workunit.client.0.smithi161.stdout:1/15: creat d1/f2 x:0 0 0 2024-01-17T23:30:39.615 INFO:tasks.workunit.client.0.smithi161.stdout:4/7: readlink l1 0 2024-01-17T23:30:39.660 INFO:tasks.workunit.client.0.smithi161.stdout:1/16: dwrite d1/f2 [0,4194304] 0 2024-01-17T23:30:39.671 INFO:tasks.workunit.client.0.smithi161.stdout:1/17: dread d1/f2 [0,4194304] 0 2024-01-17T23:30:39.679 INFO:tasks.workunit.client.0.smithi161.stdout:1/18: dread d1/f2 [0,4194304] 0 2024-01-17T23:30:39.679 INFO:tasks.workunit.client.0.smithi161.stdout:1/19: creat d1/f3 x:0 0 0 2024-01-17T23:30:39.710 INFO:tasks.workunit.client.0.smithi161.stdout:1/20: dwrite d1/f3 [0,4194304] 0 2024-01-17T23:30:39.740 INFO:tasks.workunit.client.0.smithi161.stdout:2/26: mknod c6 0 2024-01-17T23:30:39.740 INFO:tasks.workunit.client.0.smithi161.stdout:2/27: write - no filename 2024-01-17T23:30:39.740 INFO:tasks.workunit.client.0.smithi161.stdout:2/28: dread - no filename 2024-01-17T23:30:39.951 INFO:tasks.workunit.client.0.smithi161.stdout:0/26: mknod d5/cc 0 2024-01-17T23:30:39.951 INFO:tasks.workunit.client.0.smithi161.stdout:4/8: stat f0 0 2024-01-17T23:30:39.951 INFO:tasks.workunit.client.0.smithi161.stdout:0/27: write f0 [5016286,117673] 0 2024-01-17T23:30:39.985 INFO:tasks.workunit.client.0.smithi161.stdout:4/9: dwrite f0 [0,4194304] 0 2024-01-17T23:30:40.009 INFO:tasks.workunit.client.0.smithi161.stdout:4/10: write f0 [1016304,51113] 0 2024-01-17T23:30:40.017 INFO:tasks.workunit.client.0.smithi161.stdout:4/11: fdatasync f0 0 2024-01-17T23:30:40.067 INFO:tasks.workunit.client.0.smithi161.stdout:4/12: dwrite f0 [0,4194304] 0 2024-01-17T23:30:40.115 INFO:tasks.workunit.client.0.smithi161.stdout:4/13: dwrite f0 [0,4194304] 0 2024-01-17T23:30:40.133 INFO:tasks.workunit.client.0.smithi161.stdout:4/14: dread f0 [0,4194304] 0 2024-01-17T23:30:40.148 INFO:tasks.workunit.client.0.smithi161.stdout:4/15: write f0 [754036,44567] 0 2024-01-17T23:30:40.154 INFO:tasks.workunit.client.0.smithi161.stdout:4/16: fdatasync f0 0 2024-01-17T23:30:40.215 INFO:tasks.workunit.client.0.smithi161.stdout:5/0: dwrite - no filename 2024-01-17T23:30:40.666 INFO:tasks.workunit.client.0.smithi161.stdout:0/28: symlink d5/ld 0 2024-01-17T23:30:40.704 INFO:tasks.workunit.client.0.smithi161.stdout:0/29: dwrite d5/f7 [4194304,4194304] 0 2024-01-17T23:30:40.932 INFO:tasks.workunit.client.0.smithi161.stdout:6/0: fdatasync - no filename 2024-01-17T23:30:40.932 INFO:tasks.workunit.client.0.smithi161.stdout:6/1: dwrite - no filename 2024-01-17T23:30:40.933 INFO:tasks.workunit.client.0.smithi161.stdout:6/2: readlink - no filename 2024-01-17T23:30:40.933 INFO:tasks.workunit.client.0.smithi161.stdout:6/3: fsync - no filename 2024-01-17T23:30:40.933 INFO:tasks.workunit.client.0.smithi161.stdout:6/4: readlink - no filename 2024-01-17T23:30:40.933 INFO:tasks.workunit.client.0.smithi161.stdout:6/5: dread - no filename 2024-01-17T23:30:40.933 INFO:tasks.workunit.client.0.smithi161.stdout:6/6: fdatasync - no filename 2024-01-17T23:30:40.933 INFO:tasks.workunit.client.0.smithi161.stdout:6/7: link - no file 2024-01-17T23:30:40.933 INFO:tasks.workunit.client.0.smithi161.stdout:6/8: rename - no filename 2024-01-17T23:30:40.933 INFO:tasks.workunit.client.0.smithi161.stdout:6/9: chown . 51808 1 2024-01-17T23:30:40.933 INFO:tasks.workunit.client.0.smithi161.stdout:6/10: rmdir - no directory 2024-01-17T23:30:40.933 INFO:tasks.workunit.client.0.smithi161.stdout:6/11: dwrite - no filename 2024-01-17T23:30:41.125 INFO:tasks.workunit.client.0.smithi161.stdout:5/1: symlink l0 0 2024-01-17T23:30:41.125 INFO:tasks.workunit.client.0.smithi161.stdout:5/2: fsync - no filename 2024-01-17T23:30:41.145 INFO:tasks.workunit.client.0.smithi161.stdout:0/30: rename l4 to d5/le 0 2024-01-17T23:30:41.172 INFO:tasks.workunit.client.0.smithi161.stdout:0/31: dwrite d5/d8/f9 [0,4194304] 0 2024-01-17T23:30:41.186 INFO:tasks.workunit.client.0.smithi161.stdout:0/32: write f0 [1634227,103969] 0 2024-01-17T23:30:41.186 INFO:tasks.workunit.client.0.smithi161.stdout:0/33: write d5/fb [213717,43834] 0 2024-01-17T23:30:41.223 INFO:tasks.workunit.client.0.smithi161.stdout:3/7: sync 2024-01-17T23:30:41.223 INFO:tasks.workunit.client.0.smithi161.stdout:3/8: write - no filename 2024-01-17T23:30:41.223 INFO:tasks.workunit.client.0.smithi161.stdout:3/9: dread - no filename 2024-01-17T23:30:41.224 INFO:tasks.workunit.client.0.smithi161.stdout:3/10: write - no filename 2024-01-17T23:30:41.224 INFO:tasks.workunit.client.0.smithi161.stdout:3/11: dread - no filename 2024-01-17T23:30:41.224 INFO:tasks.workunit.client.0.smithi161.stdout:3/12: getdents d0 0 2024-01-17T23:30:41.475 INFO:tasks.workunit.client.0.smithi161.stdout:5/3: rename l0 to l1 0 2024-01-17T23:30:41.573 INFO:tasks.workunit.client.0.smithi161.stdout:2/29: link l1 l7 0 2024-01-17T23:30:41.779 INFO:tasks.workunit.client.0.smithi161.stdout:0/34: link d5/ld d5/lf 0 2024-01-17T23:30:41.946 INFO:tasks.workunit.client.0.smithi161.stdout:7/0: creat f0 x:0 0 0 2024-01-17T23:30:42.076 INFO:tasks.workunit.client.0.smithi161.stdout:3/13: mknod d0/c1 0 2024-01-17T23:30:42.077 INFO:tasks.workunit.client.0.smithi161.stdout:4/17: sync 2024-01-17T23:30:42.077 INFO:tasks.workunit.client.0.smithi161.stdout:1/21: sync 2024-01-17T23:30:42.077 INFO:tasks.workunit.client.0.smithi161.stdout:1/22: fsync d1/f3 0 2024-01-17T23:30:42.077 INFO:tasks.workunit.client.0.smithi161.stdout:4/18: write f0 [3887282,63784] 0 2024-01-17T23:30:42.083 INFO:tasks.workunit.client.0.smithi161.stdout:4/19: fsync f0 0 2024-01-17T23:30:42.083 INFO:tasks.workunit.client.0.smithi161.stdout:4/20: fdatasync f0 0 2024-01-17T23:30:42.084 INFO:tasks.workunit.client.0.smithi161.stdout:4/21: chown f0 326548 1 2024-01-17T23:30:42.084 INFO:tasks.workunit.client.0.smithi161.stdout:4/22: write f0 [4748875,84156] 0 2024-01-17T23:30:42.254 INFO:tasks.workunit.client.0.smithi161.stdout:5/4: symlink l2 0 2024-01-17T23:30:42.268 INFO:tasks.workunit.client.0.smithi161.stdout:0/35: rename d5/ld to d5/d8/l10 0 2024-01-17T23:30:42.269 INFO:tasks.workunit.client.0.smithi161.stdout:9/0: write - no filename 2024-01-17T23:30:42.269 INFO:tasks.workunit.client.0.smithi161.stdout:9/1: dread - no filename 2024-01-17T23:30:42.269 INFO:tasks.workunit.client.0.smithi161.stdout:9/2: link - no file 2024-01-17T23:30:42.269 INFO:tasks.workunit.client.0.smithi161.stdout:9/3: read - no filename 2024-01-17T23:30:42.269 INFO:tasks.workunit.client.0.smithi161.stdout:9/4: rmdir - no directory 2024-01-17T23:30:42.269 INFO:tasks.workunit.client.0.smithi161.stdout:9/5: rename - no filename 2024-01-17T23:30:42.269 INFO:tasks.workunit.client.0.smithi161.stdout:8/0: creat f0 x:0 0 0 2024-01-17T23:30:42.397 INFO:tasks.workunit.client.0.smithi161.stdout:7/1: mknod c1 0 2024-01-17T23:30:42.397 INFO:tasks.workunit.client.0.smithi161.stdout:7/2: creat f2 x:0 0 0 2024-01-17T23:30:42.411 INFO:tasks.workunit.client.0.smithi161.stdout:6/12: sync 2024-01-17T23:30:42.411 INFO:tasks.workunit.client.0.smithi161.stdout:6/13: dread - no filename 2024-01-17T23:30:42.705 INFO:tasks.workunit.client.0.smithi161.stdout:3/14: link d0/c1 d0/c2 0 2024-01-17T23:30:42.863 INFO:tasks.workunit.client.0.smithi161.stdout:4/23: getdents . 0 2024-01-17T23:30:42.900 INFO:tasks.workunit.client.0.smithi161.stdout:5/5: creat f3 x:0 0 0 2024-01-17T23:30:42.900 INFO:tasks.workunit.client.0.smithi161.stdout:5/6: creat f4 x:0 0 0 2024-01-17T23:30:42.900 INFO:tasks.workunit.client.0.smithi161.stdout:5/7: chown l1 2 1 2024-01-17T23:30:42.900 INFO:tasks.workunit.client.0.smithi161.stdout:5/8: dread - f4 zero size 2024-01-17T23:30:42.900 INFO:tasks.workunit.client.0.smithi161.stdout:5/9: fdatasync f3 0 2024-01-17T23:30:42.901 INFO:tasks.workunit.client.0.smithi161.stdout:2/30: mkdir d8 0 2024-01-17T23:30:42.905 INFO:tasks.workunit.client.0.smithi161.stdout:4/24: dwrite f0 [4194304,4194304] 0 2024-01-17T23:30:42.905 INFO:tasks.workunit.client.0.smithi161.stdout:4/25: chown l1 2 1 2024-01-17T23:30:42.909 INFO:tasks.workunit.client.0.smithi161.stdout:9/6: mkdir d0 0 2024-01-17T23:30:42.909 INFO:tasks.workunit.client.0.smithi161.stdout:9/7: readlink - no filename 2024-01-17T23:30:42.909 INFO:tasks.workunit.client.0.smithi161.stdout:9/8: fdatasync - no filename 2024-01-17T23:30:42.910 INFO:tasks.workunit.client.0.smithi161.stdout:9/9: dwrite - no filename 2024-01-17T23:30:42.910 INFO:tasks.workunit.client.0.smithi161.stdout:8/1: mkdir d1 0 2024-01-17T23:30:42.910 INFO:tasks.workunit.client.0.smithi161.stdout:9/10: rename d0 to d0/d1 22 2024-01-17T23:30:42.911 INFO:tasks.workunit.client.0.smithi161.stdout:7/3: rename f0 to f3 0 2024-01-17T23:30:42.911 INFO:tasks.workunit.client.0.smithi161.stdout:7/4: dread - f3 zero size 2024-01-17T23:30:42.912 INFO:tasks.workunit.client.0.smithi161.stdout:7/5: write f2 [1039428,122620] 0 2024-01-17T23:30:42.912 INFO:tasks.workunit.client.0.smithi161.stdout:6/14: mknod c0 0 2024-01-17T23:30:42.912 INFO:tasks.workunit.client.0.smithi161.stdout:6/15: chown c0 11532 1 2024-01-17T23:30:42.932 INFO:tasks.workunit.client.0.smithi161.stdout:7/6: dread f2 [0,4194304] 0 2024-01-17T23:30:43.267 INFO:tasks.workunit.client.0.smithi161.stdout:3/15: rename d0/c2 to d0/c3 0 2024-01-17T23:30:43.268 INFO:tasks.workunit.client.0.smithi161.stdout:3/16: fsync - no filename 2024-01-17T23:30:43.268 INFO:tasks.workunit.client.0.smithi161.stdout:3/17: dread - no filename 2024-01-17T23:30:43.268 INFO:tasks.workunit.client.0.smithi161.stdout:3/18: write - no filename 2024-01-17T23:30:43.268 INFO:tasks.workunit.client.0.smithi161.stdout:3/19: chown d0/c1 669468874 1 2024-01-17T23:30:43.284 INFO:tasks.workunit.client.0.smithi161.stdout:1/23: getdents d1 0 2024-01-17T23:30:43.304 INFO:tasks.workunit.client.0.smithi161.stdout:5/10: unlink l1 0 2024-01-17T23:30:43.344 INFO:tasks.workunit.client.0.smithi161.stdout:2/31: symlink d8/l9 0 2024-01-17T23:30:43.555 INFO:tasks.workunit.client.0.smithi161.stdout:8/2: creat d1/f2 x:0 0 0 2024-01-17T23:30:43.556 INFO:tasks.workunit.client.0.smithi161.stdout:8/3: truncate d1/f2 1004740 0 2024-01-17T23:30:43.704 INFO:tasks.workunit.client.0.smithi161.stdout:6/16: unlink c0 0 2024-01-17T23:30:43.704 INFO:tasks.workunit.client.0.smithi161.stdout:6/17: fdatasync - no filename 2024-01-17T23:30:43.704 INFO:tasks.workunit.client.0.smithi161.stdout:6/18: truncate - no filename 2024-01-17T23:30:43.705 INFO:tasks.workunit.client.0.smithi161.stdout:6/19: write - no filename 2024-01-17T23:30:43.705 INFO:tasks.workunit.client.0.smithi161.stdout:6/20: truncate - no filename 2024-01-17T23:30:44.024 INFO:tasks.workunit.client.0.smithi161.stdout:0/36: rmdir d5/d8 39 2024-01-17T23:30:44.242 INFO:tasks.workunit.client.0.smithi161.stdout:3/20: unlink d0/c1 0 2024-01-17T23:30:44.380 INFO:tasks.workunit.client.0.smithi161.stdout:1/24: creat d1/f4 x:0 0 0 2024-01-17T23:30:44.400 INFO:tasks.workunit.client.0.smithi161.stdout:1/25: dread d1/f3 [0,4194304] 0 2024-01-17T23:30:44.500 INFO:tasks.workunit.client.0.smithi161.stdout:5/11: link f4 f5 0 2024-01-17T23:30:44.500 INFO:tasks.workunit.client.0.smithi161.stdout:5/12: truncate f3 916884 0 2024-01-17T23:30:44.500 INFO:tasks.workunit.client.0.smithi161.stdout:5/13: truncate f5 82470 0 2024-01-17T23:30:44.501 INFO:tasks.workunit.client.0.smithi161.stdout:5/14: write f3 [682052,43064] 0 2024-01-17T23:30:44.501 INFO:tasks.workunit.client.0.smithi161.stdout:5/15: chown f4 6486 1 2024-01-17T23:30:44.502 INFO:tasks.workunit.client.0.smithi161.stdout:5/16: dread f5 [0,4194304] 0 2024-01-17T23:30:44.547 INFO:tasks.workunit.client.0.smithi161.stdout:2/32: mkdir d8/da 0 2024-01-17T23:30:44.547 INFO:tasks.workunit.client.0.smithi161.stdout:2/33: dwrite - no filename 2024-01-17T23:30:44.812 INFO:tasks.workunit.client.0.smithi161.stdout:6/21: symlink l1 0 2024-01-17T23:30:44.899 INFO:tasks.workunit.client.0.smithi161.stdout:0/37: mkdir d5/d8/d11 0 2024-01-17T23:30:44.899 INFO:tasks.workunit.client.0.smithi161.stdout:0/38: fsync d5/fb 0 2024-01-17T23:30:44.899 INFO:tasks.workunit.client.0.smithi161.stdout:0/39: fsync d5/fb 0 2024-01-17T23:30:45.046 INFO:tasks.workunit.client.0.smithi161.stdout:3/21: creat d0/f4 x:0 0 0 2024-01-17T23:30:45.114 INFO:tasks.workunit.client.0.smithi161.stdout:1/26: symlink d1/l5 0 2024-01-17T23:30:45.114 INFO:tasks.workunit.client.0.smithi161.stdout:1/27: dread - d1/f4 zero size 2024-01-17T23:30:45.115 INFO:tasks.workunit.client.0.smithi161.stdout:1/28: chown d1/f2 27 1 2024-01-17T23:30:45.449 INFO:tasks.workunit.client.0.smithi161.stdout:2/34: creat d8/fb x:0 0 0 2024-01-17T23:30:45.449 INFO:tasks.workunit.client.0.smithi161.stdout:2/35: creat d8/fc x:0 0 0 2024-01-17T23:30:45.449 INFO:tasks.workunit.client.0.smithi161.stdout:2/36: chown d8/da 529 1 2024-01-17T23:30:45.449 INFO:tasks.workunit.client.0.smithi161.stdout:2/37: write d8/fc [748374,38992] 0 2024-01-17T23:30:45.564 INFO:tasks.workunit.client.0.smithi161.stdout:6/22: symlink l2 0 2024-01-17T23:30:45.564 INFO:tasks.workunit.client.0.smithi161.stdout:6/23: write - no filename 2024-01-17T23:30:45.795 INFO:tasks.workunit.client.0.smithi161.stdout:0/40: mkdir d5/d8/d11/d12 0 2024-01-17T23:30:45.796 INFO:tasks.workunit.client.0.smithi161.stdout:3/22: mkdir d0/d5 0 2024-01-17T23:30:46.109 INFO:tasks.workunit.client.0.smithi161.stdout:2/38: rename d8/l9 to d8/da/ld 0 2024-01-17T23:30:46.268 INFO:tasks.workunit.client.0.smithi161.stdout:8/4: rmdir d1 39 2024-01-17T23:30:46.526 INFO:tasks.workunit.client.0.smithi161.stdout:4/26: truncate f0 1768043 0 2024-01-17T23:30:46.848 INFO:tasks.workunit.client.0.smithi161.stdout:2/39: symlink d8/le 0 2024-01-17T23:30:46.849 INFO:tasks.workunit.client.0.smithi161.stdout:2/40: dread - d8/fb zero size 2024-01-17T23:30:47.025 INFO:tasks.workunit.client.0.smithi161.stdout:5/17: fsync f4 0 2024-01-17T23:30:47.025 INFO:tasks.workunit.client.0.smithi161.stdout:8/5: rmdir d1 39 2024-01-17T23:30:47.052 INFO:tasks.workunit.client.0.smithi161.stdout:5/18: dwrite f5 [0,4194304] 0 2024-01-17T23:30:47.075 INFO:tasks.workunit.client.0.smithi161.stdout:5/19: dread f5 [0,4194304] 0 2024-01-17T23:30:47.198 INFO:tasks.workunit.client.0.smithi161.stdout:2/41: mknod d8/cf 0 2024-01-17T23:30:47.198 INFO:tasks.workunit.client.0.smithi161.stdout:2/42: truncate d8/fb 784494 0 2024-01-17T23:30:47.200 INFO:tasks.workunit.client.0.smithi161.stdout:2/43: dread d8/fb [0,4194304] 0 2024-01-17T23:30:47.424 INFO:tasks.workunit.client.0.smithi161.stdout:8/6: getdents d1 0 2024-01-17T23:30:47.424 INFO:tasks.workunit.client.0.smithi161.stdout:1/29: rmdir d1 39 2024-01-17T23:30:47.700 INFO:tasks.workunit.client.0.smithi161.stdout:5/20: symlink l6 0 2024-01-17T23:30:47.712 INFO:tasks.workunit.client.0.smithi161.stdout:5/21: write f4 [4105303,86214] 0 2024-01-17T23:30:47.715 INFO:tasks.workunit.client.0.smithi161.stdout:5/22: creat f7 x:0 0 0 2024-01-17T23:30:47.770 INFO:tasks.workunit.client.0.smithi161.stdout:2/44: readlink l5 0 2024-01-17T23:30:48.132 INFO:tasks.workunit.client.0.smithi161.stdout:1/30: symlink d1/l6 0 2024-01-17T23:30:48.132 INFO:tasks.workunit.client.0.smithi161.stdout:6/24: getdents . 0 2024-01-17T23:30:48.132 INFO:tasks.workunit.client.0.smithi161.stdout:6/25: fsync - no filename 2024-01-17T23:30:48.132 INFO:tasks.workunit.client.0.smithi161.stdout:6/26: dread - no filename 2024-01-17T23:30:48.132 INFO:tasks.workunit.client.0.smithi161.stdout:6/27: dread - no filename 2024-01-17T23:30:48.132 INFO:tasks.workunit.client.0.smithi161.stdout:6/28: fsync - no filename 2024-01-17T23:30:48.132 INFO:tasks.workunit.client.0.smithi161.stdout:6/29: chown l1 216999 1 2024-01-17T23:30:48.140 INFO:tasks.workunit.client.0.smithi161.stdout:1/31: dread d1/f2 [0,4194304] 0 2024-01-17T23:30:48.141 INFO:tasks.workunit.client.0.smithi161.stdout:1/32: truncate d1/f4 459596 0 2024-01-17T23:30:48.178 INFO:tasks.workunit.client.0.smithi161.stdout:8/7: mkdir d1/d3 0 2024-01-17T23:30:48.295 INFO:tasks.workunit.client.0.smithi161.stdout:3/23: getdents d0 0 2024-01-17T23:30:48.588 INFO:tasks.workunit.client.0.smithi161.stdout:6/30: symlink l3 0 2024-01-17T23:30:48.588 INFO:tasks.workunit.client.0.smithi161.stdout:6/31: dwrite - no filename 2024-01-17T23:30:48.588 INFO:tasks.workunit.client.0.smithi161.stdout:6/32: truncate - no filename 2024-01-17T23:30:48.588 INFO:tasks.workunit.client.0.smithi161.stdout:6/33: truncate - no filename 2024-01-17T23:30:48.588 INFO:tasks.workunit.client.0.smithi161.stdout:6/34: chown l3 356998 1 2024-01-17T23:30:48.799 INFO:tasks.workunit.client.0.smithi161.stdout:4/27: write f0 [1187222,28661] 0 2024-01-17T23:30:48.799 INFO:tasks.workunit.client.0.smithi161.stdout:4/28: getdents . 0 2024-01-17T23:30:48.799 INFO:tasks.workunit.client.0.smithi161.stdout:4/29: chown l1 2802507 1 2024-01-17T23:30:48.799 INFO:tasks.workunit.client.0.smithi161.stdout:1/33: truncate d1/f3 3159249 0 2024-01-17T23:30:48.800 INFO:tasks.workunit.client.0.smithi161.stdout:1/34: read d1/f4 [72139,40479] 0 2024-01-17T23:30:48.832 INFO:tasks.workunit.client.0.smithi161.stdout:1/35: dwrite d1/f4 [0,4194304] 0 2024-01-17T23:30:48.832 INFO:tasks.workunit.client.0.smithi161.stdout:1/36: stat d1/l5 0 2024-01-17T23:30:48.888 INFO:tasks.workunit.client.0.smithi161.stdout:7/7: sync 2024-01-17T23:30:48.888 INFO:tasks.workunit.client.0.smithi161.stdout:9/11: sync 2024-01-17T23:30:48.888 INFO:tasks.workunit.client.0.smithi161.stdout:9/12: truncate - no filename 2024-01-17T23:30:48.888 INFO:tasks.workunit.client.0.smithi161.stdout:9/13: write - no filename 2024-01-17T23:30:48.888 INFO:tasks.workunit.client.0.smithi161.stdout:9/14: rename d0 to d0/d2 22 2024-01-17T23:30:48.888 INFO:tasks.workunit.client.0.smithi161.stdout:9/15: readlink - no filename 2024-01-17T23:30:48.888 INFO:tasks.workunit.client.0.smithi161.stdout:9/16: readlink - no filename 2024-01-17T23:30:48.888 INFO:tasks.workunit.client.0.smithi161.stdout:9/17: dwrite - no filename 2024-01-17T23:30:48.888 INFO:tasks.workunit.client.0.smithi161.stdout:9/18: rename d0 to d0/d3 22 2024-01-17T23:30:48.888 INFO:tasks.workunit.client.0.smithi161.stdout:9/19: dwrite - no filename 2024-01-17T23:30:48.888 INFO:tasks.workunit.client.0.smithi161.stdout:9/20: readlink - no filename 2024-01-17T23:30:49.040 INFO:tasks.workunit.client.0.smithi161.stdout:0/41: creat d5/f13 x:0 0 0 2024-01-17T23:30:49.047 INFO:tasks.workunit.client.0.smithi161.stdout:0/42: dread f1 [0,4194304] 0 2024-01-17T23:30:49.671 INFO:tasks.workunit.client.0.smithi161.stdout:2/45: unlink c2 0 2024-01-17T23:30:49.671 INFO:tasks.workunit.client.0.smithi161.stdout:2/46: truncate d8/fb 925649 0 2024-01-17T23:30:49.673 INFO:tasks.workunit.client.0.smithi161.stdout:2/47: dread d8/fb [0,4194304] 0 2024-01-17T23:30:49.699 INFO:tasks.workunit.client.0.smithi161.stdout:2/48: dwrite d8/fb [0,4194304] 0 2024-01-17T23:30:49.703 INFO:tasks.workunit.client.0.smithi161.stdout:2/49: dread d8/fc [0,4194304] 0 2024-01-17T23:30:49.950 INFO:tasks.workunit.client.0.smithi161.stdout:4/30: link l1 l2 0 2024-01-17T23:30:49.951 INFO:tasks.workunit.client.0.smithi161.stdout:4/31: write f0 [1909240,92652] 0 2024-01-17T23:30:49.957 INFO:tasks.workunit.client.0.smithi161.stdout:4/32: fsync f0 0 2024-01-17T23:30:49.957 INFO:tasks.workunit.client.0.smithi161.stdout:4/33: write f0 [772491,69749] 0 2024-01-17T23:30:50.226 INFO:tasks.workunit.client.0.smithi161.stdout:7/8: rename f3 to f4 0 2024-01-17T23:30:50.226 INFO:tasks.workunit.client.0.smithi161.stdout:7/9: creat f5 x:0 0 0 2024-01-17T23:30:50.226 INFO:tasks.workunit.client.0.smithi161.stdout:7/10: readlink - no filename 2024-01-17T23:30:50.329 INFO:tasks.workunit.client.0.smithi161.stdout:9/21: creat d0/f4 x:0 0 0 2024-01-17T23:30:50.329 INFO:tasks.workunit.client.0.smithi161.stdout:9/22: chown d0/f4 10 1 2024-01-17T23:30:50.329 INFO:tasks.workunit.client.0.smithi161.stdout:9/23: read - d0/f4 zero size 2024-01-17T23:30:50.410 INFO:tasks.workunit.client.0.smithi161.stdout:0/43: truncate f2 2779314 0 2024-01-17T23:30:50.411 INFO:tasks.workunit.client.0.smithi161.stdout:0/44: write d5/fb [583824,8015] 0 2024-01-17T23:30:50.411 INFO:tasks.workunit.client.0.smithi161.stdout:0/45: chown d5/d8/f9 2933756 1 2024-01-17T23:30:50.464 INFO:tasks.workunit.client.0.smithi161.stdout:6/35: symlink l4 0 2024-01-17T23:30:50.826 INFO:tasks.workunit.client.0.smithi161.stdout:5/23: truncate f5 2085957 0 2024-01-17T23:30:50.853 INFO:tasks.workunit.client.0.smithi161.stdout:1/37: dwrite d1/f3 [0,4194304] 0 2024-01-17T23:30:50.868 INFO:tasks.workunit.client.0.smithi161.stdout:2/50: rename d8/fb to d8/da/f10 0 2024-01-17T23:30:50.916 INFO:tasks.workunit.client.0.smithi161.stdout:4/34: mknod c3 0 2024-01-17T23:30:51.167 INFO:tasks.workunit.client.0.smithi161.stdout:3/24: chown d0/c3 14097 1 2024-01-17T23:30:51.247 INFO:tasks.workunit.client.0.smithi161.stdout:7/11: symlink l6 0 2024-01-17T23:30:51.288 INFO:tasks.workunit.client.0.smithi161.stdout:7/12: dwrite f5 [0,4194304] 0 2024-01-17T23:30:51.363 INFO:tasks.workunit.client.0.smithi161.stdout:9/24: mknod d0/c5 0 2024-01-17T23:30:51.363 INFO:tasks.workunit.client.0.smithi161.stdout:9/25: creat d0/f6 x:0 0 0 2024-01-17T23:30:51.768 INFO:tasks.workunit.client.0.smithi161.stdout:5/24: rename f7 to f8 0 2024-01-17T23:30:51.818 INFO:tasks.workunit.client.0.smithi161.stdout:1/38: symlink d1/l7 0 2024-01-17T23:30:51.829 INFO:tasks.workunit.client.0.smithi161.stdout:1/39: write d1/f2 [2035078,92040] 0 2024-01-17T23:30:51.844 INFO:tasks.workunit.client.0.smithi161.stdout:1/40: write d1/f4 [2935432,116684] 0 2024-01-17T23:30:52.058 INFO:tasks.workunit.client.0.smithi161.stdout:2/51: rename c6 to d8/c11 0 2024-01-17T23:30:52.137 INFO:tasks.workunit.client.0.smithi161.stdout:4/35: creat f4 x:0 0 0 2024-01-17T23:30:52.156 INFO:tasks.workunit.client.0.smithi161.stdout:4/36: dread f0 [0,4194304] 0 2024-01-17T23:30:52.235 INFO:tasks.workunit.client.0.smithi161.stdout:3/25: truncate d0/f4 906819 0 2024-01-17T23:30:52.237 INFO:tasks.workunit.client.0.smithi161.stdout:3/26: read d0/f4 [841401,22097] 0 2024-01-17T23:30:52.270 INFO:tasks.workunit.client.0.smithi161.stdout:3/27: dwrite d0/f4 [0,4194304] 0 2024-01-17T23:30:52.486 INFO:tasks.workunit.client.0.smithi161.stdout:7/13: unlink f5 0 2024-01-17T23:30:52.486 INFO:tasks.workunit.client.0.smithi161.stdout:7/14: fsync f2 0 2024-01-17T23:30:52.486 INFO:tasks.workunit.client.0.smithi161.stdout:7/15: dread - f4 zero size 2024-01-17T23:30:52.486 INFO:tasks.workunit.client.0.smithi161.stdout:7/16: chown c1 445968 1 2024-01-17T23:30:52.486 INFO:tasks.workunit.client.0.smithi161.stdout:7/17: chown f4 7191040 1 2024-01-17T23:30:52.486 INFO:tasks.workunit.client.0.smithi161.stdout:7/18: write f4 [778543,10416] 0 2024-01-17T23:30:52.486 INFO:tasks.workunit.client.0.smithi161.stdout:7/19: write f4 [1335164,20066] 0 2024-01-17T23:30:52.645 INFO:tasks.workunit.client.0.smithi161.stdout:9/26: mknod d0/c7 0 2024-01-17T23:30:52.645 INFO:tasks.workunit.client.0.smithi161.stdout:9/27: truncate d0/f6 707282 0 2024-01-17T23:30:52.745 INFO:tasks.workunit.client.0.smithi161.stdout:6/36: mkdir d5 0 2024-01-17T23:30:52.745 INFO:tasks.workunit.client.0.smithi161.stdout:6/37: dwrite - no filename 2024-01-17T23:30:52.799 INFO:tasks.workunit.client.0.smithi161.stdout:0/46: dread f0 [0,4194304] 0 2024-01-17T23:30:52.811 INFO:tasks.workunit.client.0.smithi161.stdout:0/47: dread d5/fb [0,4194304] 0 2024-01-17T23:30:53.106 INFO:tasks.workunit.client.0.smithi161.stdout:8/8: sync 2024-01-17T23:30:53.106 INFO:tasks.workunit.client.0.smithi161.stdout:1/41: mkdir d1/d8 0 2024-01-17T23:30:53.106 INFO:tasks.workunit.client.0.smithi161.stdout:8/9: dread - f0 zero size 2024-01-17T23:30:53.138 INFO:tasks.workunit.client.0.smithi161.stdout:1/42: dwrite d1/f2 [0,4194304] 0 2024-01-17T23:30:53.187 INFO:tasks.workunit.client.0.smithi161.stdout:2/52: mkdir d8/d12 0 2024-01-17T23:30:53.187 INFO:tasks.workunit.client.0.smithi161.stdout:2/53: chown d8/da 22 1 2024-01-17T23:30:53.464 INFO:tasks.workunit.client.0.smithi161.stdout:4/37: mknod c5 0 2024-01-17T23:30:53.464 INFO:tasks.workunit.client.0.smithi161.stdout:4/38: fdatasync f0 0 2024-01-17T23:30:53.464 INFO:tasks.workunit.client.0.smithi161.stdout:4/39: chown l2 763367 1 2024-01-17T23:30:53.680 INFO:tasks.workunit.client.0.smithi161.stdout:3/28: stat d0/d5 0 2024-01-17T23:30:53.680 INFO:tasks.workunit.client.0.smithi161.stdout:3/29: getdents d0/d5 0 2024-01-17T23:30:53.874 INFO:tasks.workunit.client.0.smithi161.stdout:7/20: symlink l7 0 2024-01-17T23:30:53.904 INFO:tasks.workunit.client.0.smithi161.stdout:7/21: dwrite f4 [0,4194304] 0 2024-01-17T23:30:53.983 INFO:tasks.workunit.client.0.smithi161.stdout:9/28: mkdir d0/d8 0 2024-01-17T23:30:53.983 INFO:tasks.workunit.client.0.smithi161.stdout:6/38: unlink l3 0 2024-01-17T23:30:53.983 INFO:tasks.workunit.client.0.smithi161.stdout:6/39: stat l4 0 2024-01-17T23:30:53.983 INFO:tasks.workunit.client.0.smithi161.stdout:9/29: truncate d0/f4 36830 0 2024-01-17T23:30:53.983 INFO:tasks.workunit.client.0.smithi161.stdout:9/30: chown d0/f4 30564881 1 2024-01-17T23:30:54.010 INFO:tasks.workunit.client.0.smithi161.stdout:9/31: dwrite d0/f4 [0,4194304] 0 2024-01-17T23:30:54.144 INFO:tasks.workunit.client.0.smithi161.stdout:8/10: creat d1/d3/f4 x:0 0 0 2024-01-17T23:30:54.564 INFO:tasks.workunit.client.0.smithi161.stdout:4/40: mknod c6 0 2024-01-17T23:30:54.565 INFO:tasks.workunit.client.0.smithi161.stdout:4/41: creat f7 x:0 0 0 2024-01-17T23:30:54.784 INFO:tasks.workunit.client.0.smithi161.stdout:3/30: creat d0/f6 x:0 0 0 2024-01-17T23:30:55.004 INFO:tasks.workunit.client.0.smithi161.stdout:7/22: rename f2 to f8 0 2024-01-17T23:30:55.004 INFO:tasks.workunit.client.0.smithi161.stdout:6/40: rmdir d5 0 2024-01-17T23:30:55.353 INFO:tasks.workunit.client.0.smithi161.stdout:9/32: link d0/f4 d0/d8/f9 0 2024-01-17T23:30:55.353 INFO:tasks.workunit.client.0.smithi161.stdout:9/33: chown d0/f6 13201569 1 2024-01-17T23:30:55.459 INFO:tasks.workunit.client.0.smithi161.stdout:0/48: getdents d5 0 2024-01-17T23:30:55.459 INFO:tasks.workunit.client.0.smithi161.stdout:0/49: chown d5 1564769 1 2024-01-17T23:30:55.459 INFO:tasks.workunit.client.0.smithi161.stdout:0/50: write d5/f7 [2121222,21240] 0 2024-01-17T23:30:55.539 INFO:tasks.workunit.client.0.smithi161.stdout:8/11: creat d1/f5 x:0 0 0 2024-01-17T23:30:55.563 INFO:tasks.workunit.client.0.smithi161.stdout:8/12: dwrite d1/f2 [0,4194304] 0 2024-01-17T23:30:55.589 INFO:tasks.workunit.client.0.smithi161.stdout:8/13: dwrite d1/f2 [0,4194304] 0 2024-01-17T23:30:55.589 INFO:tasks.workunit.client.0.smithi161.stdout:8/14: stat d1/f2 0 2024-01-17T23:30:55.589 INFO:tasks.workunit.client.0.smithi161.stdout:8/15: dread - d1/f5 zero size 2024-01-17T23:30:55.740 INFO:tasks.workunit.client.0.smithi161.stdout:1/43: getdents d1 0 2024-01-17T23:30:55.768 INFO:tasks.workunit.client.0.smithi161.stdout:1/44: dwrite d1/f2 [4194304,4194304] 0 2024-01-17T23:30:55.769 INFO:tasks.workunit.client.0.smithi161.stdout:1/45: fdatasync d1/f2 0 2024-01-17T23:30:56.004 INFO:tasks.workunit.client.0.smithi161.stdout:3/31: creat d0/f7 x:0 0 0 2024-01-17T23:30:56.004 INFO:tasks.workunit.client.0.smithi161.stdout:3/32: read - d0/f7 zero size 2024-01-17T23:30:56.139 INFO:tasks.workunit.client.0.smithi161.stdout:7/23: mknod c9 0 2024-01-17T23:30:56.267 INFO:tasks.workunit.client.0.smithi161.stdout:9/34: mknod d0/ca 0 2024-01-17T23:30:56.412 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:33:19.768 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:30:56.417 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:33:19.773 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:30:56.477 INFO:tasks.workunit.client.0.smithi161.stdout:0/51: symlink d5/l14 0 2024-01-17T23:30:56.482 INFO:tasks.workunit.client.0.smithi161.stdout:0/52: fsync f1 0 2024-01-17T23:30:56.486 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:33:19.843 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:30:56.547 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:33:19.825 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:30:56.550 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:33:19.827 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:30:56.553 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:33:19.830 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:30:56.554 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:33:19.830 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:30:56.668 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:33:19.944 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:30:56.669 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:33:19.946 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:30:56.713 INFO:tasks.workunit.client.0.smithi161.stdout:8/16: mkdir d1/d3/d6 0 2024-01-17T23:30:56.907 INFO:tasks.workunit.client.0.smithi161.stdout:1/46: rename l0 to d1/d8/l9 0 2024-01-17T23:30:57.117 INFO:tasks.workunit.client.0.smithi161.stdout:6/41: mkdir d6 0 2024-01-17T23:30:57.201 INFO:tasks.workunit.client.0.smithi161.stdout:3/33: creat d0/d5/f8 x:0 0 0 2024-01-17T23:30:57.201 INFO:tasks.workunit.client.0.smithi161.stdout:7/24: mkdir da 0 2024-01-17T23:30:57.457 INFO:tasks.workunit.client.0.smithi161.stdout:0/53: chown d5/fb 0 1 2024-01-17T23:30:57.458 INFO:tasks.workunit.client.0.smithi161.stdout:0/54: truncate f0 3459890 0 2024-01-17T23:30:57.570 INFO:tasks.workunit.client.0.smithi161.stdout:8/17: mknod d1/c7 0 2024-01-17T23:30:57.570 INFO:tasks.workunit.client.0.smithi161.stdout:8/18: write f0 [907741,52628] 0 2024-01-17T23:30:57.570 INFO:tasks.workunit.client.0.smithi161.stdout:8/19: write d1/f5 [352640,91157] 0 2024-01-17T23:30:57.594 INFO:tasks.workunit.client.0.smithi161.stdout:8/20: dwrite d1/f2 [0,4194304] 0 2024-01-17T23:30:58.019 INFO:tasks.workunit.client.0.smithi161.stdout:4/42: getdents . 0 2024-01-17T23:30:58.049 INFO:tasks.workunit.client.0.smithi161.stdout:2/54: link d8/c11 d8/c13 0 2024-01-17T23:30:58.050 INFO:tasks.workunit.client.0.smithi161.stdout:2/55: write d8/fc [1438387,6842] 0 2024-01-17T23:30:58.291 INFO:tasks.workunit.client.0.smithi161.stdout:1/47: rmdir d1 39 2024-01-17T23:30:58.291 INFO:tasks.workunit.client.0.smithi161.stdout:6/42: mkdir d6/d7 0 2024-01-17T23:30:58.662 INFO:tasks.workunit.client.0.smithi161.stdout:7/25: mkdir da/db 0 2024-01-17T23:30:58.792 INFO:tasks.workunit.client.0.smithi161.stdout:9/35: rmdir d0 39 2024-01-17T23:30:58.941 INFO:tasks.workunit.client.0.smithi161.stdout:8/21: mknod d1/c8 0 2024-01-17T23:30:59.029 INFO:tasks.workunit.client.0.smithi161.stdout:4/43: creat f8 x:0 0 0 2024-01-17T23:30:59.511 INFO:tasks.workunit.client.0.smithi161.stdout:1/48: getdents d1/d8 0 2024-01-17T23:30:59.511 INFO:tasks.workunit.client.0.smithi161.stdout:1/49: fsync d1/f4 0 2024-01-17T23:30:59.547 INFO:tasks.workunit.client.0.smithi161.stdout:6/43: creat d6/d7/f8 x:0 0 0 2024-01-17T23:30:59.547 INFO:tasks.workunit.client.0.smithi161.stdout:3/34: mkdir d0/d5/d9 0 2024-01-17T23:30:59.574 INFO:tasks.workunit.client.0.smithi161.stdout:6/44: dwrite d6/d7/f8 [0,4194304] 0 2024-01-17T23:30:59.696 INFO:tasks.workunit.client.0.smithi161.stdout:7/26: creat da/fc x:0 0 0 2024-01-17T23:30:59.696 INFO:tasks.workunit.client.0.smithi161.stdout:7/27: chown f4 0 1 2024-01-17T23:30:59.696 INFO:tasks.workunit.client.0.smithi161.stdout:7/28: creat da/fd x:0 0 0 2024-01-17T23:30:59.696 INFO:tasks.workunit.client.0.smithi161.stdout:7/29: write da/fd [747182,64082] 0 2024-01-17T23:30:59.696 INFO:tasks.workunit.client.0.smithi161.stdout:7/30: fsync f8 0 2024-01-17T23:30:59.702 INFO:tasks.workunit.client.0.smithi161.stdout:7/31: read f8 [463109,31731] 0 2024-01-17T23:30:59.702 INFO:tasks.workunit.client.0.smithi161.stdout:7/32: write da/fc [301699,55850] 0 2024-01-17T23:30:59.703 INFO:tasks.workunit.client.0.smithi161.stdout:7/33: rename da/db to da/db/de 22 2024-01-17T23:30:59.822 INFO:tasks.workunit.client.0.smithi161.stdout:9/36: link d0/ca d0/d8/cb 0 2024-01-17T23:30:59.895 INFO:tasks.workunit.client.0.smithi161.stdout:5/25: truncate f4 850022 0 2024-01-17T23:30:59.922 INFO:tasks.workunit.client.0.smithi161.stdout:5/26: dwrite f8 [0,4194304] 0 2024-01-17T23:30:59.971 INFO:tasks.workunit.client.0.smithi161.stdout:0/55: truncate d5/d8/f9 381505 0 2024-01-17T23:31:00.215 INFO:tasks.workunit.client.0.smithi161.stdout:8/22: link f0 d1/d3/f9 0 2024-01-17T23:31:00.215 INFO:tasks.workunit.client.0.smithi161.stdout:8/23: stat d1/d3 0 2024-01-17T23:31:00.215 INFO:tasks.workunit.client.0.smithi161.stdout:4/44: write f4 [140657,123097] 0 2024-01-17T23:31:00.487 INFO:tasks.workunit.client.0.smithi161.stdout:3/35: creat d0/d5/fa x:0 0 0 2024-01-17T23:31:00.487 INFO:tasks.workunit.client.0.smithi161.stdout:3/36: fsync d0/f6 0 2024-01-17T23:31:00.519 INFO:tasks.workunit.client.0.smithi161.stdout:3/37: dwrite d0/d5/fa [0,4194304] 0 2024-01-17T23:31:00.520 INFO:tasks.workunit.client.0.smithi161.stdout:3/38: write d0/d5/f8 [279675,91157] 0 2024-01-17T23:31:00.520 INFO:tasks.workunit.client.0.smithi161.stdout:3/39: write d0/f7 [291733,8893] 0 2024-01-17T23:31:00.520 INFO:tasks.workunit.client.0.smithi161.stdout:3/40: read - d0/f6 zero size 2024-01-17T23:31:00.554 INFO:tasks.workunit.client.0.smithi161.stdout:3/41: dwrite d0/f7 [0,4194304] 0 2024-01-17T23:31:00.555 INFO:tasks.workunit.client.0.smithi161.stdout:3/42: getdents d0/d5/d9 0 2024-01-17T23:31:00.956 INFO:tasks.workunit.client.0.smithi161.stdout:2/56: rmdir d8 39 2024-01-17T23:31:00.956 INFO:tasks.workunit.client.0.smithi161.stdout:6/45: mkdir d6/d9 0 2024-01-17T23:31:01.026 INFO:tasks.workunit.client.0.smithi161.stdout:7/34: symlink da/lf 0 2024-01-17T23:31:01.026 INFO:tasks.workunit.client.0.smithi161.stdout:7/35: write da/fc [377681,116680] 0 2024-01-17T23:31:01.157 INFO:tasks.workunit.client.0.smithi161.stdout:9/37: mkdir d0/d8/dc 0 2024-01-17T23:31:01.182 INFO:tasks.workunit.client.0.smithi161.stdout:9/38: dwrite d0/f4 [0,4194304] 0 2024-01-17T23:31:01.182 INFO:tasks.workunit.client.0.smithi161.stdout:9/39: chown d0/d8/dc 25819461 1 2024-01-17T23:31:01.182 INFO:tasks.workunit.client.0.smithi161.stdout:9/40: fdatasync d0/f6 0 2024-01-17T23:31:01.450 INFO:tasks.workunit.client.0.smithi161.stdout:5/27: unlink l6 0 2024-01-17T23:31:01.545 INFO:tasks.workunit.client.0.smithi161.stdout:0/56: rmdir d5/d8/d11 39 2024-01-17T23:31:01.697 INFO:tasks.workunit.client.0.smithi161.stdout:8/24: rmdir d1/d3/d6 0 2024-01-17T23:31:02.175 INFO:tasks.workunit.client.0.smithi161.stdout:3/43: symlink d0/d5/d9/lb 0 2024-01-17T23:31:02.175 INFO:tasks.workunit.client.0.smithi161.stdout:3/44: truncate d0/f6 665407 0 2024-01-17T23:31:02.304 INFO:tasks.workunit.client.0.smithi161.stdout:6/46: creat d6/fa x:0 0 0 2024-01-17T23:31:02.637 INFO:tasks.workunit.client.0.smithi161.stdout:1/50: write d1/f3 [3973390,23822] 0 2024-01-17T23:31:02.637 INFO:tasks.workunit.client.0.smithi161.stdout:1/51: write d1/f4 [5150247,56493] 0 2024-01-17T23:31:02.792 INFO:tasks.workunit.client.0.smithi161.stdout:7/36: link l7 da/db/l10 0 2024-01-17T23:31:03.986 INFO:tasks.workunit.client.0.smithi161.stdout:5/28: dread f4 [0,4194304] 0 2024-01-17T23:31:03.986 INFO:tasks.workunit.client.0.smithi161.stdout:5/29: creat f9 x:0 0 0 2024-01-17T23:31:04.048 INFO:tasks.workunit.client.0.smithi161.stdout:0/57: symlink d5/d8/d11/l15 0 2024-01-17T23:31:04.207 INFO:tasks.workunit.client.0.smithi161.stdout:4/45: mkdir d9 0 2024-01-17T23:31:04.961 INFO:tasks.workunit.client.0.smithi161.stdout:7/37: creat da/db/f11 x:0 0 0 2024-01-17T23:31:05.144 INFO:tasks.workunit.client.0.smithi161.stdout:0/58: mknod d5/d8/d11/c16 0 2024-01-17T23:31:05.144 INFO:tasks.workunit.client.0.smithi161.stdout:0/59: chown d5/d8/d11/d12 34386773 1 2024-01-17T23:31:05.443 INFO:tasks.workunit.client.0.smithi161.stdout:3/45: mknod d0/d5/cc 0 2024-01-17T23:31:05.453 INFO:tasks.workunit.client.0.smithi161.stdout:3/46: dread d0/d5/f8 [0,4194304] 0 2024-01-17T23:31:05.453 INFO:tasks.workunit.client.0.smithi161.stdout:3/47: write d0/d5/fa [5188807,55302] 0 2024-01-17T23:31:05.622 INFO:tasks.workunit.client.0.smithi161.stdout:6/47: rename l2 to d6/d7/lb 0 2024-01-17T23:31:05.623 INFO:tasks.workunit.client.0.smithi161.stdout:7/38: mknod da/c12 0 2024-01-17T23:31:05.623 INFO:tasks.workunit.client.0.smithi161.stdout:7/39: creat da/db/f13 x:0 0 0 2024-01-17T23:31:05.623 INFO:tasks.workunit.client.0.smithi161.stdout:7/40: read - da/db/f13 zero size 2024-01-17T23:31:05.642 INFO:tasks.workunit.client.0.smithi161.stdout:6/48: dread d6/d7/f8 [0,4194304] 0 2024-01-17T23:31:06.504 INFO:tasks.workunit.client.0.smithi161.stdout:7/41: mkdir da/d14 0 2024-01-17T23:31:06.510 INFO:tasks.workunit.client.0.smithi161.stdout:7/42: dread f8 [0,4194304] 0 2024-01-17T23:31:06.510 INFO:tasks.workunit.client.0.smithi161.stdout:7/43: creat da/f15 x:0 0 0 2024-01-17T23:31:06.513 INFO:tasks.workunit.client.0.smithi161.stdout:7/44: dread da/fc [0,4194304] 0 2024-01-17T23:31:06.514 INFO:tasks.workunit.client.0.smithi161.stdout:7/45: chown da/f15 748 1 2024-01-17T23:31:06.514 INFO:tasks.workunit.client.0.smithi161.stdout:7/46: read - da/db/f13 zero size 2024-01-17T23:31:06.520 INFO:tasks.workunit.client.0.smithi161.stdout:6/49: mkdir d6/d7/dc 0 2024-01-17T23:31:06.539 INFO:tasks.workunit.client.0.smithi161.stdout:6/50: write d6/d7/f8 [3477982,2231] 0 2024-01-17T23:31:06.539 INFO:tasks.workunit.client.0.smithi161.stdout:6/51: read d6/d7/f8 [3206769,43406] 0 2024-01-17T23:31:06.539 INFO:tasks.workunit.client.0.smithi161.stdout:6/52: stat d6/fa 0 2024-01-17T23:31:06.759 INFO:tasks.workunit.client.0.smithi161.stdout:5/30: dwrite f5 [0,4194304] 0 2024-01-17T23:31:06.776 INFO:tasks.workunit.client.0.smithi161.stdout:8/25: mknod d1/ca 0 2024-01-17T23:31:06.776 INFO:tasks.workunit.client.0.smithi161.stdout:8/26: fsync d1/f5 0 2024-01-17T23:31:06.785 INFO:tasks.workunit.client.0.smithi161.stdout:5/31: dwrite f8 [0,4194304] 0 2024-01-17T23:31:06.808 INFO:tasks.workunit.client.0.smithi161.stdout:5/32: dwrite f9 [0,4194304] 0 2024-01-17T23:31:06.821 INFO:tasks.workunit.client.0.smithi161.stdout:5/33: dread f5 [0,4194304] 0 2024-01-17T23:31:06.821 INFO:tasks.workunit.client.0.smithi161.stdout:5/34: write f3 [213789,50898] 0 2024-01-17T23:31:06.932 INFO:tasks.workunit.client.0.smithi161.stdout:0/60: dwrite d5/d8/f9 [0,4194304] 0 2024-01-17T23:31:06.937 INFO:tasks.workunit.client.0.smithi161.stdout:0/61: dread f0 [0,4194304] 0 2024-01-17T23:31:07.016 INFO:tasks.workunit.client.0.smithi161.stdout:7/47: rename l7 to da/l16 0 2024-01-17T23:31:07.236 INFO:tasks.workunit.client.0.smithi161.stdout:6/53: creat d6/d9/fd x:0 0 0 2024-01-17T23:31:07.273 INFO:tasks.workunit.client.0.smithi161.stdout:6/54: dwrite d6/d7/f8 [0,4194304] 0 2024-01-17T23:31:07.657 INFO:tasks.workunit.client.0.smithi161.stdout:9/41: link d0/c5 d0/cd 0 2024-01-17T23:31:07.715 INFO:tasks.workunit.client.0.smithi161.stdout:8/27: mknod d1/d3/cb 0 2024-01-17T23:31:07.715 INFO:tasks.workunit.client.0.smithi161.stdout:1/52: rename d1/l7 to d1/la 0 2024-01-17T23:31:08.276 INFO:tasks.workunit.client.0.smithi161.stdout:0/62: rmdir d5/d8/d11 39 2024-01-17T23:31:08.279 INFO:tasks.workunit.client.0.smithi161.stdout:2/57: sync 2024-01-17T23:31:08.279 INFO:tasks.workunit.client.0.smithi161.stdout:2/58: fdatasync d8/da/f10 0 2024-01-17T23:31:08.279 INFO:tasks.workunit.client.0.smithi161.stdout:2/59: readlink l5 0 2024-01-17T23:31:08.358 INFO:tasks.workunit.client.0.smithi161.stdout:7/48: mknod da/d14/c17 0 2024-01-17T23:31:08.662 INFO:tasks.workunit.client.0.smithi161.stdout:4/46: sync 2024-01-17T23:31:08.662 INFO:tasks.workunit.client.0.smithi161.stdout:9/42: creat d0/d8/dc/fe x:0 0 0 2024-01-17T23:31:08.964 INFO:tasks.workunit.client.0.smithi161.stdout:3/48: rmdir d0 39 2024-01-17T23:31:08.991 INFO:tasks.workunit.client.0.smithi161.stdout:3/49: dwrite d0/d5/f8 [0,4194304] 0 2024-01-17T23:31:09.135 INFO:tasks.workunit.client.0.smithi161.stdout:8/28: rename d1/d3/f4 to d1/fc 0 2024-01-17T23:31:09.287 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:31:09.290 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:31:09.293 INFO:tasks.workunit.client.0.smithi161.stdout:1/53: truncate d1/f3 1658146 0 2024-01-17T23:31:09.378 INFO:tasks.workunit.client.0.smithi161.stdout:5/35: truncate f4 3694559 0 2024-01-17T23:31:09.378 INFO:tasks.workunit.client.0.smithi161.stdout:5/36: creat fa x:0 0 0 2024-01-17T23:31:09.378 INFO:tasks.workunit.client.0.smithi161.stdout:5/37: creat fb x:0 0 0 2024-01-17T23:31:09.378 INFO:tasks.workunit.client.0.smithi161.stdout:5/38: creat fc x:0 0 0 2024-01-17T23:31:09.395 INFO:tasks.workunit.client.0.smithi161.stdout:5/39: write f8 [1385825,54606] 0 2024-01-17T23:31:09.479 INFO:tasks.workunit.client.0.smithi161.stdout:2/60: truncate d8/fc 1161116 0 2024-01-17T23:31:09.480 INFO:tasks.workunit.client.0.smithi161.stdout:2/61: chown d8/le 474949 1 2024-01-17T23:31:09.480 INFO:tasks.workunit.client.0.smithi161.stdout:2/62: readlink d8/le 0 2024-01-17T23:31:09.480 INFO:tasks.workunit.client.0.smithi161.stdout:0/63: write d5/f6 [501035,69543] 0 2024-01-17T23:31:09.521 INFO:tasks.workunit.client.0.smithi161.stdout:7/49: creat da/d14/f18 x:0 0 0 2024-01-17T23:31:09.521 INFO:tasks.workunit.client.0.smithi161.stdout:7/50: dread - da/db/f11 zero size 2024-01-17T23:31:09.524 INFO:tasks.workunit.client.0.smithi161.stdout:7/51: dread da/fc [0,4194304] 0 2024-01-17T23:31:09.567 INFO:tasks.workunit.client.0.smithi161.stdout:6/55: rmdir d6/d7 39 2024-01-17T23:31:09.649 INFO:tasks.workunit.client.0.smithi161.stdout:4/47: readlink l2 0 2024-01-17T23:31:09.816 INFO:tasks.workunit.client.0.smithi161.stdout:9/43: link d0/cd d0/d8/cf 0 2024-01-17T23:31:09.832 INFO:tasks.workunit.client.0.smithi161.stdout:9/44: write d0/d8/f9 [140994,97429] 0 2024-01-17T23:31:10.682 INFO:tasks.workunit.client.0.smithi161.stdout:3/50: unlink d0/d5/d9/lb 0 2024-01-17T23:31:10.704 INFO:tasks.workunit.client.0.smithi161.stdout:3/51: write d0/f4 [3509149,65792] 0 2024-01-17T23:31:10.704 INFO:tasks.workunit.client.0.smithi161.stdout:3/52: write d0/f4 [1500695,65758] 0 2024-01-17T23:31:10.724 INFO:tasks.workunit.client.0.smithi161.stdout:3/53: dread d0/f7 [0,4194304] 0 2024-01-17T23:31:10.776 INFO:tasks.workunit.client.0.smithi161.stdout:3/54: dwrite d0/f4 [0,4194304] 0 2024-01-17T23:31:10.851 INFO:tasks.workunit.client.0.smithi161.stdout:8/29: symlink d1/d3/ld 0 2024-01-17T23:31:11.024 INFO:tasks.workunit.client.0.smithi161.stdout:1/54: symlink d1/d8/lb 0 2024-01-17T23:31:11.421 INFO:tasks.workunit.client.0.smithi161.stdout:5/40: mkdir dd 0 2024-01-17T23:31:11.655 INFO:tasks.workunit.client.0.smithi161.stdout:2/63: creat d8/f14 x:0 0 0 2024-01-17T23:31:11.783 INFO:tasks.workunit.client.0.smithi161.stdout:0/64: symlink d5/d8/l17 0 2024-01-17T23:31:11.868 INFO:tasks.workunit.client.0.smithi161.stdout:7/52: mknod da/db/c19 0 2024-01-17T23:31:11.893 INFO:tasks.workunit.client.0.smithi161.stdout:7/53: dwrite da/f15 [0,4194304] 0 2024-01-17T23:31:12.282 INFO:tasks.workunit.client.0.smithi161.stdout:4/48: rename f8 to d9/fa 0 2024-01-17T23:31:12.562 INFO:tasks.workunit.client.0.smithi161.stdout:9/45: rename d0/d8/f9 to d0/d8/f10 0 2024-01-17T23:31:12.989 INFO:tasks.workunit.client.0.smithi161.stdout:3/55: rmdir d0/d5 39 2024-01-17T23:31:13.010 INFO:tasks.workunit.client.0.smithi161.stdout:3/56: dread d0/f4 [0,4194304] 0 2024-01-17T23:31:13.024 INFO:tasks.workunit.client.0.smithi161.stdout:3/57: dread d0/f4 [0,4194304] 0 2024-01-17T23:31:13.062 INFO:tasks.workunit.client.0.smithi161.stdout:8/30: rmdir d1 39 2024-01-17T23:31:13.343 INFO:tasks.workunit.client.0.smithi161.stdout:2/64: symlink d8/l15 0 2024-01-17T23:31:13.366 INFO:tasks.workunit.client.0.smithi161.stdout:2/65: dread d8/da/f10 [0,4194304] 0 2024-01-17T23:31:13.366 INFO:tasks.workunit.client.0.smithi161.stdout:2/66: chown d8 239611095 1 2024-01-17T23:31:13.568 INFO:tasks.workunit.client.0.smithi161.stdout:0/65: link c3 d5/d8/d11/c18 0 2024-01-17T23:31:13.598 INFO:tasks.workunit.client.0.smithi161.stdout:0/66: dwrite d5/fb [0,4194304] 0 2024-01-17T23:31:13.699 INFO:tasks.workunit.client.0.smithi161.stdout:7/54: symlink da/db/l1a 0 2024-01-17T23:31:13.724 INFO:tasks.workunit.client.0.smithi161.stdout:7/55: dwrite f8 [0,4194304] 0 2024-01-17T23:31:13.936 INFO:tasks.workunit.client.0.smithi161.stdout:4/49: fsync f7 0 2024-01-17T23:31:14.050 INFO:tasks.workunit.client.0.smithi161.stdout:9/46: unlink d0/f6 0 2024-01-17T23:31:14.307 INFO:tasks.workunit.client.0.smithi161.stdout:5/41: unlink fa 0 2024-01-17T23:31:14.512 INFO:tasks.workunit.client.0.smithi161.stdout:2/67: mknod d8/da/c16 0 2024-01-17T23:31:14.512 INFO:tasks.workunit.client.0.smithi161.stdout:2/68: getdents d8/d12 0 2024-01-17T23:31:14.512 INFO:tasks.workunit.client.0.smithi161.stdout:2/69: dread - d8/f14 zero size 2024-01-17T23:31:14.517 INFO:tasks.workunit.client.0.smithi161.stdout:6/56: sync 2024-01-17T23:31:14.678 INFO:tasks.workunit.client.0.smithi161.stdout:0/67: getdents d5 0 2024-01-17T23:31:14.827 INFO:tasks.workunit.client.0.smithi161.stdout:1/55: write d1/f3 [627586,108217] 0 2024-01-17T23:31:15.193 INFO:tasks.workunit.client.0.smithi161.stdout:4/50: dread f0 [0,4194304] 0 2024-01-17T23:31:15.365 INFO:tasks.workunit.client.0.smithi161.stdout:5/42: unlink f9 0 2024-01-17T23:31:15.573 INFO:tasks.workunit.client.0.smithi161.stdout:8/31: rename d1/c8 to d1/ce 0 2024-01-17T23:31:15.573 INFO:tasks.workunit.client.0.smithi161.stdout:8/32: chown d1/ca 28 1 2024-01-17T23:31:15.581 INFO:tasks.workunit.client.0.smithi161.stdout:8/33: dread d1/d3/f9 [0,4194304] 0 2024-01-17T23:31:15.868 INFO:tasks.workunit.client.0.smithi161.stdout:6/57: truncate d6/d7/f8 3630858 0 2024-01-17T23:31:16.015 INFO:tasks.workunit.client.0.smithi161.stdout:1/56: unlink d1/f4 0 2024-01-17T23:31:16.015 INFO:tasks.workunit.client.0.smithi161.stdout:1/57: stat d1/f3 0 2024-01-17T23:31:16.096 INFO:tasks.workunit.client.0.smithi161.stdout:7/56: rmdir da/db 39 2024-01-17T23:31:16.117 INFO:tasks.workunit.client.0.smithi161.stdout:7/57: read f8 [3719719,52193] 0 2024-01-17T23:31:16.219 INFO:tasks.workunit.client.0.smithi161.stdout:4/51: rename d9/fa to d9/fb 0 2024-01-17T23:31:16.229 INFO:tasks.workunit.client.0.smithi161.stdout:4/52: dread f0 [0,4194304] 0 2024-01-17T23:31:16.367 INFO:tasks.workunit.client.0.smithi161.stdout:5/43: unlink f5 0 2024-01-17T23:31:16.367 INFO:tasks.workunit.client.0.smithi161.stdout:8/34: mkdir d1/df 0 2024-01-17T23:31:16.395 INFO:tasks.workunit.client.0.smithi161.stdout:8/35: dwrite f0 [0,4194304] 0 2024-01-17T23:31:16.395 INFO:tasks.workunit.client.0.smithi161.stdout:8/36: fdatasync d1/f5 0 2024-01-17T23:31:16.395 INFO:tasks.workunit.client.0.smithi161.stdout:8/37: creat d1/d3/f10 x:0 0 0 2024-01-17T23:31:16.395 INFO:tasks.workunit.client.0.smithi161.stdout:8/38: chown d1/d3/f9 6176 1 2024-01-17T23:31:16.413 INFO:tasks.workunit.client.0.smithi161.stdout:8/39: dread f0 [0,4194304] 0 2024-01-17T23:31:16.413 INFO:tasks.workunit.client.0.smithi161.stdout:8/40: rename d1/d3 to d1/d3/d11 22 2024-01-17T23:31:16.413 INFO:tasks.workunit.client.0.smithi161.stdout:8/41: creat d1/d3/f12 x:0 0 0 2024-01-17T23:31:16.413 INFO:tasks.workunit.client.0.smithi161.stdout:8/42: fdatasync d1/d3/f9 0 2024-01-17T23:31:16.654 INFO:tasks.workunit.client.0.smithi161.stdout:6/58: creat d6/d7/fe x:0 0 0 2024-01-17T23:31:16.654 INFO:tasks.workunit.client.0.smithi161.stdout:6/59: dread - d6/d7/fe zero size 2024-01-17T23:31:16.735 INFO:tasks.workunit.client.0.smithi161.stdout:0/68: creat d5/d8/f19 x:0 0 0 2024-01-17T23:31:16.771 INFO:tasks.workunit.client.0.smithi161.stdout:0/69: dwrite d5/f7 [0,4194304] 0 2024-01-17T23:31:16.771 INFO:tasks.workunit.client.0.smithi161.stdout:0/70: creat d5/d8/f1a x:0 0 0 2024-01-17T23:31:16.771 INFO:tasks.workunit.client.0.smithi161.stdout:0/71: read - d5/d8/f1a zero size 2024-01-17T23:31:16.771 INFO:tasks.workunit.client.0.smithi161.stdout:0/72: getdents d5 0 2024-01-17T23:31:16.989 INFO:tasks.workunit.client.0.smithi161.stdout:3/58: truncate d0/f4 649499 0 2024-01-17T23:31:16.989 INFO:tasks.workunit.client.0.smithi161.stdout:3/59: truncate d0/d5/fa 5960618 0 2024-01-17T23:31:16.989 INFO:tasks.workunit.client.0.smithi161.stdout:7/58: symlink da/l1b 0 2024-01-17T23:31:16.989 INFO:tasks.workunit.client.0.smithi161.stdout:7/59: readlink da/lf 0 2024-01-17T23:31:16.989 INFO:tasks.workunit.client.0.smithi161.stdout:4/53: creat d9/fc x:0 0 0 2024-01-17T23:31:16.989 INFO:tasks.workunit.client.0.smithi161.stdout:4/54: fdatasync d9/fc 0 2024-01-17T23:31:16.990 INFO:tasks.workunit.client.0.smithi161.stdout:4/55: dread - d9/fb zero size 2024-01-17T23:31:16.990 INFO:tasks.workunit.client.0.smithi161.stdout:4/56: creat d9/fd x:0 0 0 2024-01-17T23:31:17.025 INFO:tasks.workunit.client.0.smithi161.stdout:7/60: dwrite da/fd [0,4194304] 0 2024-01-17T23:31:17.236 INFO:tasks.workunit.client.0.smithi161.stdout:2/70: write d8/fc [561724,92951] 0 2024-01-17T23:31:17.433 INFO:tasks.workunit.client.0.smithi161.stdout:5/44: dwrite f4 [0,4194304] 0 2024-01-17T23:31:18.022 INFO:tasks.workunit.client.0.smithi161.stdout:8/43: unlink d1/fc 0 2024-01-17T23:31:18.079 INFO:tasks.workunit.client.0.smithi161.stdout:1/58: rmdir d1 39 2024-01-17T23:31:18.079 INFO:tasks.workunit.client.0.smithi161.stdout:1/59: readlink d1/la 0 2024-01-17T23:31:18.436 INFO:tasks.workunit.client.0.smithi161.stdout:9/47: sync 2024-01-17T23:31:18.706 INFO:tasks.workunit.client.0.smithi161.stdout:4/57: mkdir d9/de 0 2024-01-17T23:31:18.706 INFO:tasks.workunit.client.0.smithi161.stdout:4/58: creat d9/ff x:0 0 0 2024-01-17T23:31:18.706 INFO:tasks.workunit.client.0.smithi161.stdout:4/59: fdatasync d9/fc 0 2024-01-17T23:31:18.706 INFO:tasks.workunit.client.0.smithi161.stdout:4/60: write f7 [1014400,9178] 0 2024-01-17T23:31:18.706 INFO:tasks.workunit.client.0.smithi161.stdout:4/61: creat d9/f10 x:0 0 0 2024-01-17T23:31:19.257 INFO:tasks.workunit.client.0.smithi161.stdout:2/71: symlink d8/l17 0 2024-01-17T23:31:19.257 INFO:tasks.workunit.client.0.smithi161.stdout:2/72: creat d8/f18 x:0 0 0 2024-01-17T23:31:19.597 INFO:tasks.workunit.client.0.smithi161.stdout:5/45: symlink dd/le 0 2024-01-17T23:31:19.597 INFO:tasks.workunit.client.0.smithi161.stdout:5/46: readlink dd/le 0 2024-01-17T23:31:19.622 INFO:tasks.workunit.client.0.smithi161.stdout:5/47: dwrite fc [0,4194304] 0 2024-01-17T23:31:19.622 INFO:tasks.workunit.client.0.smithi161.stdout:5/48: chown dd 392848294 1 2024-01-17T23:31:19.628 INFO:tasks.workunit.client.0.smithi161.stdout:6/60: getdents d6/d7 0 2024-01-17T23:31:19.658 INFO:tasks.workunit.client.0.smithi161.stdout:6/61: dwrite d6/d7/fe [0,4194304] 0 2024-01-17T23:31:19.829 INFO:tasks.workunit.client.0.smithi161.stdout:0/73: sync 2024-01-17T23:31:19.857 INFO:tasks.workunit.client.0.smithi161.stdout:0/74: dwrite d5/d8/f9 [0,4194304] 0 2024-01-17T23:31:19.860 INFO:tasks.workunit.client.0.smithi161.stdout:0/75: write d5/f6 [414475,122401] 0 2024-01-17T23:31:19.873 INFO:tasks.workunit.client.0.smithi161.stdout:0/76: dread f2 [0,4194304] 0 2024-01-17T23:31:19.887 INFO:tasks.workunit.client.0.smithi161.stdout:0/77: dread d5/fb [0,4194304] 0 2024-01-17T23:31:20.070 INFO:tasks.workunit.client.0.smithi161.stdout:9/48: mknod d0/d8/dc/c11 0 2024-01-17T23:31:20.561 INFO:tasks.workunit.client.0.smithi161.stdout:4/62: creat d9/de/f11 x:0 0 0 2024-01-17T23:31:20.561 INFO:tasks.workunit.client.0.smithi161.stdout:4/63: fsync f0 0 2024-01-17T23:31:20.561 INFO:tasks.workunit.client.0.smithi161.stdout:4/64: dread - d9/fd zero size 2024-01-17T23:31:20.561 INFO:tasks.workunit.client.0.smithi161.stdout:4/65: dread - d9/de/f11 zero size 2024-01-17T23:31:20.561 INFO:tasks.workunit.client.0.smithi161.stdout:4/66: write d9/fb [353919,34240] 0 2024-01-17T23:31:20.561 INFO:tasks.workunit.client.0.smithi161.stdout:4/67: read - d9/f10 zero size 2024-01-17T23:31:20.561 INFO:tasks.workunit.client.0.smithi161.stdout:4/68: fsync f4 0 2024-01-17T23:31:20.593 INFO:tasks.workunit.client.0.smithi161.stdout:4/69: dwrite d9/de/f11 [0,4194304] 0 2024-01-17T23:31:20.593 INFO:tasks.workunit.client.0.smithi161.stdout:4/70: fsync f0 0 2024-01-17T23:31:20.958 INFO:tasks.workunit.client.0.smithi161.stdout:2/73: symlink d8/da/l19 0 2024-01-17T23:31:21.017 INFO:tasks.workunit.client.0.smithi161.stdout:7/61: sync 2024-01-17T23:31:21.200 INFO:tasks.workunit.client.0.smithi161.stdout:5/49: creat dd/ff x:0 0 0 2024-01-17T23:31:21.228 INFO:tasks.workunit.client.0.smithi161.stdout:5/50: dread fc [0,4194304] 0 2024-01-17T23:31:21.662 INFO:tasks.workunit.client.0.smithi161.stdout:8/44: getdents d1 0 2024-01-17T23:31:21.687 INFO:tasks.workunit.client.0.smithi161.stdout:8/45: dwrite d1/d3/f12 [0,4194304] 0 2024-01-17T23:31:21.688 INFO:tasks.workunit.client.0.smithi161.stdout:8/46: write d1/f5 [425583,55420] 0 2024-01-17T23:31:21.688 INFO:tasks.workunit.client.0.smithi161.stdout:8/47: fsync f0 0 2024-01-17T23:31:21.703 INFO:tasks.workunit.client.0.smithi161.stdout:8/48: dread f0 [0,4194304] 0 2024-01-17T23:31:21.715 INFO:tasks.workunit.client.0.smithi161.stdout:8/49: dread d1/d3/f9 [0,4194304] 0 2024-01-17T23:31:21.753 INFO:tasks.workunit.client.0.smithi161.stdout:0/78: symlink d5/d8/d11/d12/l1b 0 2024-01-17T23:31:21.753 INFO:tasks.workunit.client.0.smithi161.stdout:0/79: read - d5/d8/f1a zero size 2024-01-17T23:31:21.753 INFO:tasks.workunit.client.0.smithi161.stdout:0/80: fsync d5/f13 0 2024-01-17T23:31:21.784 INFO:tasks.workunit.client.0.smithi161.stdout:1/60: dwrite d1/f2 [4194304,4194304] 0 2024-01-17T23:31:21.787 INFO:tasks.workunit.client.0.smithi161.stdout:0/81: dwrite f2 [4194304,4194304] 0 2024-01-17T23:31:21.793 INFO:tasks.workunit.client.0.smithi161.stdout:1/61: dread d1/f3 [0,4194304] 0 2024-01-17T23:31:22.294 INFO:tasks.workunit.client.0.smithi161.stdout:2/74: mkdir d8/da/d1a 0 2024-01-17T23:31:22.294 INFO:tasks.workunit.client.0.smithi161.stdout:2/75: fsync d8/f14 0 2024-01-17T23:31:22.441 INFO:tasks.workunit.client.0.smithi161.stdout:7/62: symlink da/db/l1c 0 2024-01-17T23:31:22.464 INFO:tasks.workunit.client.0.smithi161.stdout:6/62: dread d6/d7/f8 [0,4194304] 0 2024-01-17T23:31:22.900 INFO:tasks.workunit.client.0.smithi161.stdout:0/82: mknod d5/d8/c1c 0 2024-01-17T23:31:22.900 INFO:tasks.workunit.client.0.smithi161.stdout:8/50: mkdir d1/df/d13 0 2024-01-17T23:31:22.900 INFO:tasks.workunit.client.0.smithi161.stdout:8/51: readlink d1/d3/ld 0 2024-01-17T23:31:22.900 INFO:tasks.workunit.client.0.smithi161.stdout:8/52: truncate d1/d3/f10 602375 0 2024-01-17T23:31:23.007 INFO:tasks.workunit.client.0.smithi161.stdout:1/62: creat d1/d8/fc x:0 0 0 2024-01-17T23:31:23.007 INFO:tasks.workunit.client.0.smithi161.stdout:1/63: creat d1/d8/fd x:0 0 0 2024-01-17T23:31:23.153 INFO:tasks.workunit.client.0.smithi161.stdout:4/71: getdents d9 0 2024-01-17T23:31:23.230 INFO:tasks.workunit.client.0.smithi161.stdout:2/76: symlink d8/da/d1a/l1b 0 2024-01-17T23:31:23.231 INFO:tasks.workunit.client.0.smithi161.stdout:5/51: write fc [4456272,86914] 0 2024-01-17T23:31:23.487 INFO:tasks.workunit.client.0.smithi161.stdout:6/63: mknod d6/d7/dc/cf 0 2024-01-17T23:31:23.934 INFO:tasks.workunit.client.0.smithi161.stdout:0/83: link d5/d8/f19 d5/d8/d11/d12/f1d 0 2024-01-17T23:31:24.321 INFO:tasks.workunit.client.0.smithi161.stdout:3/60: symlink d0/ld 0 2024-01-17T23:31:24.346 INFO:tasks.workunit.client.0.smithi161.stdout:8/53: truncate d1/f2 3168464 0 2024-01-17T23:31:24.347 INFO:tasks.workunit.client.0.smithi161.stdout:1/64: creat d1/fe x:0 0 0 2024-01-17T23:31:24.347 INFO:tasks.workunit.client.0.smithi161.stdout:1/65: creat d1/ff x:0 0 0 2024-01-17T23:31:24.347 INFO:tasks.workunit.client.0.smithi161.stdout:1/66: dread - d1/d8/fd zero size 2024-01-17T23:31:24.522 INFO:tasks.workunit.client.0.smithi161.stdout:5/52: mknod dd/c10 0 2024-01-17T23:31:24.553 INFO:tasks.workunit.client.0.smithi161.stdout:5/53: dwrite f3 [0,4194304] 0 2024-01-17T23:31:24.554 INFO:tasks.workunit.client.0.smithi161.stdout:5/54: write f8 [365919,72985] 0 2024-01-17T23:31:24.648 INFO:tasks.workunit.client.0.smithi161.stdout:7/63: mknod da/c1d 0 2024-01-17T23:31:24.730 INFO:tasks.workunit.client.0.smithi161.stdout:6/64: mknod d6/d7/dc/c10 0 2024-01-17T23:31:24.754 INFO:tasks.workunit.client.0.smithi161.stdout:6/65: dwrite d6/d9/fd [0,4194304] 0 2024-01-17T23:31:24.754 INFO:tasks.workunit.client.0.smithi161.stdout:6/66: fdatasync d6/d9/fd 0 2024-01-17T23:31:24.924 INFO:tasks.workunit.client.0.smithi161.stdout:9/49: mknod d0/c12 0 2024-01-17T23:31:24.924 INFO:tasks.workunit.client.0.smithi161.stdout:0/84: getdents d5/d8/d11 0 2024-01-17T23:31:24.924 INFO:tasks.workunit.client.0.smithi161.stdout:0/85: fdatasync f0 0 2024-01-17T23:31:24.924 INFO:tasks.workunit.client.0.smithi161.stdout:9/50: write d0/d8/dc/fe [42643,94807] 0 2024-01-17T23:31:24.953 INFO:tasks.workunit.client.0.smithi161.stdout:0/86: dwrite d5/f7 [4194304,4194304] 0 2024-01-17T23:31:24.953 INFO:tasks.workunit.client.0.smithi161.stdout:0/87: fdatasync d5/d8/f9 0 2024-01-17T23:31:25.207 INFO:tasks.workunit.client.0.smithi161.stdout:4/72: getdents d9/de 0 2024-01-17T23:31:25.207 INFO:tasks.workunit.client.0.smithi161.stdout:4/73: fsync d9/ff 0 2024-01-17T23:31:25.237 INFO:tasks.workunit.client.0.smithi161.stdout:4/74: dwrite f7 [0,4194304] 0 2024-01-17T23:31:25.603 INFO:tasks.workunit.client.0.smithi161.stdout:1/67: mkdir d1/d8/d10 0 2024-01-17T23:31:25.603 INFO:tasks.workunit.client.0.smithi161.stdout:2/77: rename d8/da/d1a to d8/d1c 0 2024-01-17T23:31:25.794 INFO:tasks.workunit.client.0.smithi161.stdout:5/55: link dd/ff dd/f11 0 2024-01-17T23:31:25.817 INFO:tasks.workunit.client.0.smithi161.stdout:5/56: dread f8 [0,4194304] 0 2024-01-17T23:31:25.823 INFO:tasks.workunit.client.0.smithi161.stdout:5/57: fsync fc 0 2024-01-17T23:31:25.823 INFO:tasks.workunit.client.0.smithi161.stdout:5/58: dread - dd/ff zero size 2024-01-17T23:31:25.823 INFO:tasks.workunit.client.0.smithi161.stdout:5/59: stat f3 0 2024-01-17T23:31:25.910 INFO:tasks.workunit.client.0.smithi161.stdout:7/64: mkdir da/d1e 0 2024-01-17T23:31:26.087 INFO:tasks.workunit.client.0.smithi161.stdout:6/67: truncate d6/d7/fe 3730411 0 2024-01-17T23:31:26.087 INFO:tasks.workunit.client.0.smithi161.stdout:6/68: creat d6/d9/f11 x:0 0 0 2024-01-17T23:31:26.361 INFO:tasks.workunit.client.0.smithi161.stdout:9/51: mknod d0/c13 0 2024-01-17T23:31:26.361 INFO:tasks.workunit.client.0.smithi161.stdout:9/52: chown d0/d8/dc/c11 296200045 1 2024-01-17T23:31:26.544 INFO:tasks.workunit.client.0.smithi161.stdout:4/75: mkdir d9/d12 0 2024-01-17T23:31:26.544 INFO:tasks.workunit.client.0.smithi161.stdout:4/76: fsync f0 0 2024-01-17T23:31:26.689 INFO:tasks.workunit.client.0.smithi161.stdout:1/68: mkdir d1/d11 0 2024-01-17T23:31:26.828 INFO:tasks.workunit.client.0.smithi161.stdout:2/78: unlink d8/fc 0 2024-01-17T23:31:26.999 INFO:tasks.workunit.client.0.smithi161.stdout:7/65: symlink da/db/l1f 0 2024-01-17T23:31:26.999 INFO:tasks.workunit.client.0.smithi161.stdout:7/66: readlink da/l1b 0 2024-01-17T23:31:27.181 INFO:tasks.workunit.client.0.smithi161.stdout:6/69: mknod d6/d7/c12 0 2024-01-17T23:31:27.314 INFO:tasks.workunit.client.0.smithi161.stdout:9/53: rmdir d0 39 2024-01-17T23:31:27.314 INFO:tasks.workunit.client.0.smithi161.stdout:9/54: fsync d0/d8/f10 0 2024-01-17T23:31:27.367 INFO:tasks.workunit.client.0.smithi161.stdout:4/77: rmdir d9/de 39 2024-01-17T23:31:27.489 INFO:tasks.workunit.client.0.smithi161.stdout:1/69: rmdir d1/d8/d10 0 2024-01-17T23:31:27.638 INFO:tasks.workunit.client.0.smithi161.stdout:3/61: write d0/d5/fa [2883089,7645] 0 2024-01-17T23:31:27.638 INFO:tasks.workunit.client.0.smithi161.stdout:3/62: truncate d0/f4 805057 0 2024-01-17T23:31:27.650 INFO:tasks.workunit.client.0.smithi161.stdout:3/63: dread d0/d5/fa [4194304,4194304] 0 2024-01-17T23:31:27.650 INFO:tasks.workunit.client.0.smithi161.stdout:3/64: truncate d0/f4 1715242 0 2024-01-17T23:31:27.679 INFO:tasks.workunit.client.0.smithi161.stdout:3/65: dwrite d0/f4 [0,4194304] 0 2024-01-17T23:31:27.679 INFO:tasks.workunit.client.0.smithi161.stdout:3/66: fdatasync d0/f4 0 2024-01-17T23:31:27.679 INFO:tasks.workunit.client.0.smithi161.stdout:3/67: stat d0/d5 0 2024-01-17T23:31:27.891 INFO:tasks.workunit.client.0.smithi161.stdout:7/67: mkdir da/d20 0 2024-01-17T23:31:27.925 INFO:tasks.workunit.client.0.smithi161.stdout:2/79: rmdir d8/d1c 39 2024-01-17T23:31:27.925 INFO:tasks.workunit.client.0.smithi161.stdout:6/70: mkdir d6/d9/d13 0 2024-01-17T23:31:28.030 INFO:tasks.workunit.client.0.smithi161.stdout:4/78: creat d9/f13 x:0 0 0 2024-01-17T23:31:28.030 INFO:tasks.workunit.client.0.smithi161.stdout:4/79: dread - d9/f10 zero size 2024-01-17T23:31:28.064 INFO:tasks.workunit.client.0.smithi161.stdout:4/80: dwrite d9/de/f11 [0,4194304] 0 2024-01-17T23:31:28.229 INFO:tasks.workunit.client.0.smithi161.stdout:1/70: creat d1/d11/f12 x:0 0 0 2024-01-17T23:31:28.229 INFO:tasks.workunit.client.0.smithi161.stdout:1/71: chown d1/d8 3 1 2024-01-17T23:31:28.441 INFO:tasks.workunit.client.0.smithi161.stdout:3/68: creat d0/d5/fe x:0 0 0 2024-01-17T23:31:28.442 INFO:tasks.workunit.client.0.smithi161.stdout:7/68: symlink da/l21 0 2024-01-17T23:31:28.481 INFO:tasks.workunit.client.0.smithi161.stdout:7/69: dwrite da/fd [0,4194304] 0 2024-01-17T23:31:28.572 INFO:tasks.workunit.client.0.smithi161.stdout:2/80: rmdir d8/da 39 2024-01-17T23:31:28.635 INFO:tasks.workunit.client.0.smithi161.stdout:9/55: getdents d0/d8/dc 0 2024-01-17T23:31:28.833 INFO:tasks.workunit.client.0.smithi161.stdout:6/71: dwrite d6/d7/fe [0,4194304] 0 2024-01-17T23:31:29.114 INFO:tasks.workunit.client.0.smithi161.stdout:4/81: unlink d9/de/f11 0 2024-01-17T23:31:29.114 INFO:tasks.workunit.client.0.smithi161.stdout:4/82: stat d9/ff 0 2024-01-17T23:31:29.114 INFO:tasks.workunit.client.0.smithi161.stdout:4/83: read f4 [143255,90503] 0 2024-01-17T23:31:29.510 INFO:tasks.workunit.client.0.smithi161.stdout:3/69: rmdir d0 39 2024-01-17T23:31:29.510 INFO:tasks.workunit.client.0.smithi161.stdout:0/88: rename d5/f7 to d5/d8/d11/d12/f1e 0 2024-01-17T23:31:29.641 INFO:tasks.workunit.client.0.smithi161.stdout:7/70: read f4 [3796496,46590] 0 2024-01-17T23:31:29.641 INFO:tasks.workunit.client.0.smithi161.stdout:7/71: chown da/lf 24009568 1 2024-01-17T23:31:29.746 INFO:tasks.workunit.client.0.smithi161.stdout:2/81: unlink d8/l15 0 2024-01-17T23:31:29.770 INFO:tasks.workunit.client.0.smithi161.stdout:2/82: dwrite d8/f14 [0,4194304] 0 2024-01-17T23:31:29.787 INFO:tasks.workunit.client.0.smithi161.stdout:2/83: write d8/da/f10 [3581553,106838] 0 2024-01-17T23:31:30.057 INFO:tasks.workunit.client.0.smithi161.stdout:9/56: rmdir d0 39 2024-01-17T23:31:30.058 INFO:tasks.workunit.client.0.smithi161.stdout:4/84: link f7 d9/de/f14 0 2024-01-17T23:31:30.405 INFO:tasks.workunit.client.0.smithi161.stdout:3/70: creat d0/ff x:0 0 0 2024-01-17T23:31:30.771 INFO:tasks.workunit.client.0.smithi161.stdout:2/84: link d8/c13 d8/d1c/c1d 0 2024-01-17T23:31:30.913 INFO:tasks.workunit.client.0.smithi161.stdout:9/57: rename d0/d8/dc to d0/d8/d14 0 2024-01-17T23:31:30.913 INFO:tasks.workunit.client.0.smithi161.stdout:9/58: write d0/f4 [2597070,110427] 0 2024-01-17T23:31:30.948 INFO:tasks.workunit.client.0.smithi161.stdout:9/59: dwrite d0/d8/f10 [0,4194304] 0 2024-01-17T23:31:31.093 INFO:tasks.workunit.client.0.smithi161.stdout:3/71: creat d0/f10 x:0 0 0 2024-01-17T23:31:31.093 INFO:tasks.workunit.client.0.smithi161.stdout:3/72: fsync d0/f7 0 2024-01-17T23:31:31.277 INFO:tasks.workunit.client.0.smithi161.stdout:7/72: getdents da/d14 0 2024-01-17T23:31:31.473 INFO:tasks.workunit.client.0.smithi161.stdout:1/72: rmdir d1/d11 39 2024-01-17T23:31:31.473 INFO:tasks.workunit.client.0.smithi161.stdout:1/73: fdatasync d1/ff 0 2024-01-17T23:31:31.628 INFO:tasks.workunit.client.0.smithi161.stdout:3/73: link d0/d5/cc d0/d5/d9/c11 0 2024-01-17T23:31:31.628 INFO:tasks.workunit.client.0.smithi161.stdout:3/74: fdatasync d0/f7 0 2024-01-17T23:31:31.628 INFO:tasks.workunit.client.0.smithi161.stdout:3/75: dread - d0/f10 zero size 2024-01-17T23:31:32.015 INFO:tasks.workunit.client.0.smithi161.stdout:8/54: unlink d1/f5 0 2024-01-17T23:31:32.016 INFO:tasks.workunit.client.0.smithi161.stdout:7/73: symlink da/d14/l22 0 2024-01-17T23:31:32.016 INFO:tasks.workunit.client.0.smithi161.stdout:7/74: dread - da/db/f11 zero size 2024-01-17T23:31:32.016 INFO:tasks.workunit.client.0.smithi161.stdout:7/75: readlink da/db/l1f 0 2024-01-17T23:31:32.108 INFO:tasks.workunit.client.0.smithi161.stdout:1/74: link d1/d8/fd d1/d8/f13 0 2024-01-17T23:31:32.108 INFO:tasks.workunit.client.0.smithi161.stdout:1/75: chown d1/la 3481035 1 2024-01-17T23:31:32.304 INFO:tasks.workunit.client.0.smithi161.stdout:3/76: creat d0/f12 x:0 0 0 2024-01-17T23:31:32.304 INFO:tasks.workunit.client.0.smithi161.stdout:3/77: write d0/ff [939497,4379] 0 2024-01-17T23:31:32.304 INFO:tasks.workunit.client.0.smithi161.stdout:3/78: stat d0/d5 0 2024-01-17T23:31:32.304 INFO:tasks.workunit.client.0.smithi161.stdout:3/79: dread - d0/f12 zero size 2024-01-17T23:31:32.304 INFO:tasks.workunit.client.0.smithi161.stdout:3/80: fdatasync d0/f6 0 2024-01-17T23:31:32.304 INFO:tasks.workunit.client.0.smithi161.stdout:3/81: fsync d0/f7 0 2024-01-17T23:31:32.577 INFO:tasks.workunit.client.0.smithi161.stdout:0/89: fsync d5/d8/d11/d12/f1e 0 2024-01-17T23:31:32.659 INFO:tasks.workunit.client.0.smithi161.stdout:1/76: symlink d1/d8/l14 0 2024-01-17T23:31:32.659 INFO:tasks.workunit.client.0.smithi161.stdout:1/77: creat d1/f15 x:0 0 0 2024-01-17T23:31:32.659 INFO:tasks.workunit.client.0.smithi161.stdout:1/78: write d1/d8/fc [805226,70313] 0 2024-01-17T23:31:32.846 INFO:tasks.workunit.client.0.smithi161.stdout:3/82: unlink d0/ff 0 2024-01-17T23:31:32.846 INFO:tasks.workunit.client.0.smithi161.stdout:3/83: write d0/d5/f8 [4423280,113003] 0 2024-01-17T23:31:32.846 INFO:tasks.workunit.client.0.smithi161.stdout:3/84: write d0/f7 [4900543,52804] 0 2024-01-17T23:31:33.117 INFO:tasks.workunit.client.0.smithi161.stdout:1/79: symlink d1/l16 0 2024-01-17T23:31:33.117 INFO:tasks.workunit.client.0.smithi161.stdout:1/80: stat d1/l5 0 2024-01-17T23:31:33.117 INFO:tasks.workunit.client.0.smithi161.stdout:1/81: write d1/f15 [744276,31191] 0 2024-01-17T23:31:33.299 INFO:tasks.workunit.client.0.smithi161.stdout:8/55: truncate d1/d3/f10 1382532 0 2024-01-17T23:31:33.317 INFO:tasks.workunit.client.0.smithi161.stdout:8/56: write f0 [1309111,73320] 0 2024-01-17T23:31:33.331 INFO:tasks.workunit.client.0.smithi161.stdout:8/57: dread d1/d3/f12 [0,4194304] 0 2024-01-17T23:31:33.388 INFO:tasks.workunit.client.0.smithi161.stdout:3/85: creat d0/d5/d9/f13 x:0 0 0 2024-01-17T23:31:33.404 INFO:tasks.workunit.client.0.smithi161.stdout:3/86: dread d0/f7 [0,4194304] 0 2024-01-17T23:31:33.468 INFO:tasks.workunit.client.0.smithi161.stdout:1/82: symlink d1/l17 0 2024-01-17T23:31:33.494 INFO:tasks.workunit.client.0.smithi161.stdout:1/83: dwrite d1/d8/fd [0,4194304] 0 2024-01-17T23:31:33.494 INFO:tasks.workunit.client.0.smithi161.stdout:1/84: creat d1/f18 x:0 0 0 2024-01-17T23:31:34.388 INFO:tasks.workunit.client.0.smithi161.stdout:1/85: read d1/f2 [6939197,71493] 0 2024-01-17T23:31:34.502 INFO:tasks.workunit.client.0.smithi161.stdout:3/87: mknod d0/d5/c14 0 2024-01-17T23:31:34.916 INFO:tasks.workunit.client.0.smithi161.stdout:1/86: symlink d1/d8/l19 0 2024-01-17T23:31:34.917 INFO:tasks.workunit.client.0.smithi161.stdout:1/87: chown d1/d8/l14 16609349 1 2024-01-17T23:31:35.114 INFO:tasks.workunit.client.0.smithi161.stdout:9/60: truncate d0/d8/f10 13313 0 2024-01-17T23:31:35.116 INFO:tasks.workunit.client.0.smithi161.stdout:6/72: sync 2024-01-17T23:31:35.131 INFO:tasks.workunit.client.0.smithi161.stdout:0/90: rmdir d5 39 2024-01-17T23:31:35.131 INFO:tasks.workunit.client.0.smithi161.stdout:0/91: creat d5/d8/f1f x:0 0 0 2024-01-17T23:31:35.438 INFO:tasks.workunit.client.0.smithi161.stdout:1/88: link d1/l17 d1/d11/l1a 0 2024-01-17T23:31:35.438 INFO:tasks.workunit.client.0.smithi161.stdout:1/89: creat d1/d8/f1b x:0 0 0 2024-01-17T23:31:35.467 INFO:tasks.workunit.client.0.smithi161.stdout:6/73: link d6/d7/dc/cf d6/d7/dc/c14 0 2024-01-17T23:31:35.468 INFO:tasks.workunit.client.0.smithi161.stdout:6/74: chown d6/d7/c12 0 1 2024-01-17T23:31:35.468 INFO:tasks.workunit.client.0.smithi161.stdout:6/75: getdents d6/d9/d13 0 2024-01-17T23:31:35.495 INFO:tasks.workunit.client.0.smithi161.stdout:6/76: dwrite d6/fa [0,4194304] 0 2024-01-17T23:31:35.521 INFO:tasks.workunit.client.0.smithi161.stdout:6/77: write d6/fa [1850805,117566] 0 2024-01-17T23:31:35.521 INFO:tasks.workunit.client.0.smithi161.stdout:6/78: creat d6/d9/f15 x:0 0 0 2024-01-17T23:31:35.521 INFO:tasks.workunit.client.0.smithi161.stdout:6/79: stat d6/d9/fd 0 2024-01-17T23:31:35.535 INFO:tasks.workunit.client.0.smithi161.stdout:6/80: dread d6/d7/fe [0,4194304] 0 2024-01-17T23:31:35.553 INFO:tasks.workunit.client.0.smithi161.stdout:6/81: dread d6/fa [0,4194304] 0 2024-01-17T23:31:35.641 INFO:tasks.workunit.client.0.smithi161.stdout:0/92: mkdir d5/d8/d11/d20 0 2024-01-17T23:31:35.881 INFO:tasks.workunit.client.0.smithi161.stdout:5/60: rename f3 to dd/f12 0 2024-01-17T23:31:35.885 INFO:tasks.workunit.client.0.smithi161.stdout:5/61: write dd/f11 [736549,85649] 0 2024-01-17T23:31:35.940 INFO:tasks.workunit.client.0.smithi161.stdout:1/90: mkdir d1/d8/d1c 0 2024-01-17T23:31:36.428 INFO:tasks.workunit.client.0.smithi161.stdout:0/93: mkdir d5/d8/d11/d21 0 2024-01-17T23:31:36.575 INFO:tasks.workunit.client.0.smithi161.stdout:5/62: dread f4 [0,4194304] 0 2024-01-17T23:31:36.576 INFO:tasks.workunit.client.0.smithi161.stdout:5/63: stat fc 0 2024-01-17T23:31:36.576 INFO:tasks.workunit.client.0.smithi161.stdout:5/64: creat dd/f13 x:0 0 0 2024-01-17T23:31:36.592 INFO:tasks.workunit.client.0.smithi161.stdout:5/65: dread dd/f12 [0,4194304] 0 2024-01-17T23:31:36.592 INFO:tasks.workunit.client.0.smithi161.stdout:5/66: creat dd/f14 x:0 0 0 2024-01-17T23:31:36.600 INFO:tasks.workunit.client.0.smithi161.stdout:5/67: dread dd/f12 [0,4194304] 0 2024-01-17T23:31:36.632 INFO:tasks.workunit.client.0.smithi161.stdout:1/91: symlink d1/d8/l1d 0 2024-01-17T23:31:36.632 INFO:tasks.workunit.client.0.smithi161.stdout:1/92: readlink d1/d8/l9 0 2024-01-17T23:31:36.662 INFO:tasks.workunit.client.0.smithi161.stdout:1/93: dwrite d1/d8/f13 [0,4194304] 0 2024-01-17T23:31:36.692 INFO:tasks.workunit.client.0.smithi161.stdout:1/94: dwrite d1/f18 [0,4194304] 0 2024-01-17T23:31:36.809 INFO:tasks.workunit.client.0.smithi161.stdout:6/82: unlink d6/d9/f15 0 2024-01-17T23:31:36.810 INFO:tasks.workunit.client.0.smithi161.stdout:6/83: dread - d6/d9/f11 zero size 2024-01-17T23:31:36.810 INFO:tasks.workunit.client.0.smithi161.stdout:0/94: link d5/d8/l10 d5/d8/d11/l22 0 2024-01-17T23:31:36.810 INFO:tasks.workunit.client.0.smithi161.stdout:6/84: readlink d6/d7/lb 0 2024-01-17T23:31:36.810 INFO:tasks.workunit.client.0.smithi161.stdout:6/85: dread - d6/d9/f11 zero size 2024-01-17T23:31:36.837 INFO:tasks.workunit.client.0.smithi161.stdout:0/95: dwrite d5/f6 [0,4194304] 0 2024-01-17T23:31:36.967 INFO:tasks.workunit.client.0.smithi161.stdout:4/85: rmdir d9/d12 0 2024-01-17T23:31:36.968 INFO:tasks.workunit.client.0.smithi161.stdout:4/86: truncate d9/f13 805474 0 2024-01-17T23:31:37.246 INFO:tasks.workunit.client.0.smithi161.stdout:5/68: mkdir dd/d15 0 2024-01-17T23:31:37.246 INFO:tasks.workunit.client.0.smithi161.stdout:1/95: mkdir d1/d8/d1e 0 2024-01-17T23:31:37.246 INFO:tasks.workunit.client.0.smithi161.stdout:6/86: mkdir d6/d7/d16 0 2024-01-17T23:31:37.252 INFO:tasks.workunit.client.0.smithi161.stdout:1/96: dread d1/f15 [0,4194304] 0 2024-01-17T23:31:37.273 INFO:tasks.workunit.client.0.smithi161.stdout:5/69: dwrite dd/f13 [0,4194304] 0 2024-01-17T23:31:37.295 INFO:tasks.workunit.client.0.smithi161.stdout:1/97: dwrite d1/d8/f1b [0,4194304] 0 2024-01-17T23:31:37.312 INFO:tasks.workunit.client.0.smithi161.stdout:1/98: dread d1/d8/f1b [0,4194304] 0 2024-01-17T23:31:37.353 INFO:tasks.workunit.client.0.smithi161.stdout:0/96: truncate f1 838324 0 2024-01-17T23:31:37.616 INFO:tasks.workunit.client.0.smithi161.stdout:4/87: chown c5 363196 1 2024-01-17T23:31:37.618 INFO:tasks.workunit.client.0.smithi161.stdout:6/87: link d6/d7/dc/cf d6/d9/d13/c17 0 2024-01-17T23:31:37.618 INFO:tasks.workunit.client.0.smithi161.stdout:6/88: chown l4 1005872919 1 2024-01-17T23:31:37.618 INFO:tasks.workunit.client.0.smithi161.stdout:6/89: chown d6/d7/f8 809 1 2024-01-17T23:31:37.645 INFO:tasks.workunit.client.0.smithi161.stdout:4/88: dwrite f4 [0,4194304] 0 2024-01-17T23:31:38.508 INFO:tasks.workunit.client.0.smithi161.stdout:2/85: rename d8/d12 to d8/d1c/d1e 0 2024-01-17T23:31:38.772 INFO:tasks.workunit.client.0.smithi161.stdout:6/90: creat d6/d7/d16/f18 x:0 0 0 2024-01-17T23:31:38.781 INFO:tasks.workunit.client.0.smithi161.stdout:6/91: dread d6/d7/fe [0,4194304] 0 2024-01-17T23:31:39.047 INFO:tasks.workunit.client.0.smithi161.stdout:4/89: creat d9/f15 x:0 0 0 2024-01-17T23:31:39.052 INFO:tasks.workunit.client.0.smithi161.stdout:4/90: dread d9/fb [0,4194304] 0 2024-01-17T23:31:39.191 INFO:tasks.workunit.client.0.smithi161.stdout:9/61: rename d0/d8/d14/c11 to d0/d8/c15 0 2024-01-17T23:31:39.325 INFO:tasks.workunit.client.0.smithi161.stdout:2/86: creat d8/d1c/f1f x:0 0 0 2024-01-17T23:31:39.429 INFO:tasks.workunit.client.0.smithi161.stdout:6/92: creat d6/d7/dc/f19 x:0 0 0 2024-01-17T23:31:39.626 INFO:tasks.workunit.client.0.smithi161.stdout:5/70: rename dd/le to dd/d15/l16 0 2024-01-17T23:31:39.628 INFO:tasks.workunit.client.0.smithi161.stdout:4/91: dread d9/f13 [0,4194304] 0 2024-01-17T23:31:39.628 INFO:tasks.workunit.client.0.smithi161.stdout:7/76: sync 2024-01-17T23:31:39.629 INFO:tasks.workunit.client.0.smithi161.stdout:8/58: sync 2024-01-17T23:31:39.633 INFO:tasks.workunit.client.0.smithi161.stdout:5/71: read dd/ff [278281,77858] 0 2024-01-17T23:31:39.821 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:31:39.825 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:31:39.838 INFO:tasks.workunit.client.0.smithi161.stdout:6/93: mkdir d6/d9/d1a 0 2024-01-17T23:31:39.838 INFO:tasks.workunit.client.0.smithi161.stdout:6/94: fdatasync d6/d7/fe 0 2024-01-17T23:31:40.216 INFO:tasks.workunit.client.0.smithi161.stdout:4/92: mkdir d9/d16 0 2024-01-17T23:31:40.243 INFO:tasks.workunit.client.0.smithi161.stdout:4/93: dwrite d9/f15 [0,4194304] 0 2024-01-17T23:31:40.276 INFO:tasks.workunit.client.0.smithi161.stdout:7/77: rmdir da 39 2024-01-17T23:31:40.457 INFO:tasks.workunit.client.0.smithi161.stdout:0/97: rename d5/d8/d11/d12/f1e to d5/d8/d11/f23 0 2024-01-17T23:31:40.789 INFO:tasks.workunit.client.0.smithi161.stdout:4/94: rmdir d9/d16 0 2024-01-17T23:31:40.942 INFO:tasks.workunit.client.0.smithi161.stdout:7/78: mknod da/d20/c23 0 2024-01-17T23:31:40.942 INFO:tasks.workunit.client.0.smithi161.stdout:7/79: read da/fc [493210,94092] 0 2024-01-17T23:31:41.141 INFO:tasks.workunit.client.0.smithi161.stdout:0/98: link d5/cc d5/d8/d11/d20/c24 0 2024-01-17T23:31:41.141 INFO:tasks.workunit.client.0.smithi161.stdout:3/88: unlink d0/f7 0 2024-01-17T23:31:41.267 INFO:tasks.workunit.client.0.smithi161.stdout:2/87: rename d8/da/ld to d8/d1c/d1e/l20 0 2024-01-17T23:31:41.267 INFO:tasks.workunit.client.0.smithi161.stdout:5/72: rename dd to dd/d17 22 2024-01-17T23:31:41.477 INFO:tasks.workunit.client.0.smithi161.stdout:7/80: creat da/d14/f24 x:0 0 0 2024-01-17T23:31:41.477 INFO:tasks.workunit.client.0.smithi161.stdout:7/81: fdatasync da/d14/f24 0 2024-01-17T23:31:41.501 INFO:tasks.workunit.client.0.smithi161.stdout:7/82: write da/f15 [1999443,85228] 0 2024-01-17T23:31:41.501 INFO:tasks.workunit.client.0.smithi161.stdout:7/83: chown da/l21 39 1 2024-01-17T23:31:41.686 INFO:tasks.workunit.client.0.smithi161.stdout:3/89: rmdir d0/d5 39 2024-01-17T23:31:41.706 INFO:tasks.workunit.client.0.smithi161.stdout:3/90: dread d0/d5/f8 [0,4194304] 0 2024-01-17T23:31:42.094 INFO:tasks.workunit.client.0.smithi161.stdout:2/88: link d8/da/c16 d8/c21 0 2024-01-17T23:31:42.094 INFO:tasks.workunit.client.0.smithi161.stdout:5/73: symlink dd/d15/l18 0 2024-01-17T23:31:42.108 INFO:tasks.workunit.client.0.smithi161.stdout:5/74: dread f8 [0,4194304] 0 2024-01-17T23:31:42.108 INFO:tasks.workunit.client.0.smithi161.stdout:5/75: write f8 [1217922,16741] 0 2024-01-17T23:31:42.132 INFO:tasks.workunit.client.0.smithi161.stdout:5/76: dwrite fc [0,4194304] 0 2024-01-17T23:31:42.156 INFO:tasks.workunit.client.0.smithi161.stdout:5/77: dread f8 [0,4194304] 0 2024-01-17T23:31:42.156 INFO:tasks.workunit.client.0.smithi161.stdout:5/78: read - fb zero size 2024-01-17T23:31:42.156 INFO:tasks.workunit.client.0.smithi161.stdout:5/79: write dd/f14 [904654,46041] 0 2024-01-17T23:31:42.286 INFO:tasks.workunit.client.0.smithi161.stdout:7/84: dwrite da/d14/f18 [0,4194304] 0 2024-01-17T23:31:42.321 INFO:tasks.workunit.client.0.smithi161.stdout:7/85: dwrite da/d14/f18 [0,4194304] 0 2024-01-17T23:31:42.480 INFO:tasks.workunit.client.0.smithi161.stdout:2/89: symlink d8/d1c/d1e/l22 0 2024-01-17T23:31:43.020 INFO:tasks.workunit.client.0.smithi161.stdout:5/80: getdents dd 0 2024-01-17T23:31:43.117 INFO:tasks.workunit.client.0.smithi161.stdout:7/86: link da/c12 da/d14/c25 0 2024-01-17T23:31:43.697 INFO:tasks.workunit.client.0.smithi161.stdout:5/81: link f8 dd/d15/f19 0 2024-01-17T23:31:43.717 INFO:tasks.workunit.client.0.smithi161.stdout:5/82: dread fc [0,4194304] 0 2024-01-17T23:31:43.717 INFO:tasks.workunit.client.0.smithi161.stdout:5/83: read dd/d15/f19 [3397160,97158] 0 2024-01-17T23:31:43.742 INFO:tasks.workunit.client.0.smithi161.stdout:7/87: creat da/f26 x:0 0 0 2024-01-17T23:31:43.742 INFO:tasks.workunit.client.0.smithi161.stdout:3/91: mknod d0/d5/c15 0 2024-01-17T23:31:43.856 INFO:tasks.workunit.client.0.smithi161.stdout:1/99: sync 2024-01-17T23:31:43.856 INFO:tasks.workunit.client.0.smithi161.stdout:1/100: stat d1/d8/d1c 0 2024-01-17T23:31:43.870 INFO:tasks.workunit.client.0.smithi161.stdout:1/101: read d1/f2 [779558,87528] 0 2024-01-17T23:31:43.935 INFO:tasks.workunit.client.0.smithi161.stdout:5/84: mkdir dd/d15/d1a 0 2024-01-17T23:31:44.067 INFO:tasks.workunit.client.0.smithi161.stdout:2/90: getdents d8 0 2024-01-17T23:31:44.117 INFO:tasks.workunit.client.0.smithi161.stdout:7/88: link da/l16 da/d1e/l27 0 2024-01-17T23:31:44.117 INFO:tasks.workunit.client.0.smithi161.stdout:7/89: readlink l6 0 2024-01-17T23:31:44.264 INFO:tasks.workunit.client.0.smithi161.stdout:3/92: mkdir d0/d5/d9/d16 0 2024-01-17T23:31:44.558 INFO:tasks.workunit.client.0.smithi161.stdout:1/102: mkdir d1/d8/d1f 0 2024-01-17T23:31:44.641 INFO:tasks.workunit.client.0.smithi161.stdout:2/91: getdents d8/d1c/d1e 0 2024-01-17T23:31:44.852 INFO:tasks.workunit.client.0.smithi161.stdout:9/62: symlink d0/l16 0 2024-01-17T23:31:44.963 INFO:tasks.workunit.client.0.smithi161.stdout:7/90: mkdir da/d20/d28 0 2024-01-17T23:31:44.963 INFO:tasks.workunit.client.0.smithi161.stdout:7/91: truncate da/db/f11 251823 0 2024-01-17T23:31:45.067 INFO:tasks.workunit.client.0.smithi161.stdout:3/93: mkdir d0/d5/d9/d17 0 2024-01-17T23:31:45.067 INFO:tasks.workunit.client.0.smithi161.stdout:3/94: chown d0/ld 45410 1 2024-01-17T23:31:45.222 INFO:tasks.workunit.client.0.smithi161.stdout:1/103: mkdir d1/d20 0 2024-01-17T23:31:45.375 INFO:tasks.workunit.client.0.smithi161.stdout:2/92: mkdir d8/d1c/d1e/d23 0 2024-01-17T23:31:45.375 INFO:tasks.workunit.client.0.smithi161.stdout:2/93: creat d8/d1c/f24 x:0 0 0 2024-01-17T23:31:45.376 INFO:tasks.workunit.client.0.smithi161.stdout:2/94: dread - d8/f18 zero size 2024-01-17T23:31:45.474 INFO:tasks.workunit.client.0.smithi161.stdout:0/99: creat d5/f25 x:0 0 0 2024-01-17T23:31:45.474 INFO:tasks.workunit.client.0.smithi161.stdout:0/100: dread - d5/f13 zero size 2024-01-17T23:31:45.543 INFO:tasks.workunit.client.0.smithi161.stdout:9/63: getdents d0/d8 0 2024-01-17T23:31:45.546 INFO:tasks.workunit.client.0.smithi161.stdout:9/64: dread d0/d8/d14/fe [0,4194304] 0 2024-01-17T23:31:45.888 INFO:tasks.workunit.client.0.smithi161.stdout:7/92: rename da to da/d14/d29 22 2024-01-17T23:31:46.002 INFO:tasks.workunit.client.0.smithi161.stdout:3/95: creat d0/d5/d9/d17/f18 x:0 0 0 2024-01-17T23:31:46.002 INFO:tasks.workunit.client.0.smithi161.stdout:3/96: dread - d0/d5/d9/d17/f18 zero size 2024-01-17T23:31:46.020 INFO:tasks.workunit.client.0.smithi161.stdout:3/97: write d0/d5/f8 [3041262,29661] 0 2024-01-17T23:31:46.136 INFO:tasks.workunit.client.0.smithi161.stdout:1/104: creat d1/d8/d1e/f21 x:0 0 0 2024-01-17T23:31:46.516 INFO:tasks.workunit.client.0.smithi161.stdout:2/95: truncate d8/f14 2163957 0 2024-01-17T23:31:46.516 INFO:tasks.workunit.client.0.smithi161.stdout:0/101: symlink d5/d8/d11/d12/l26 0 2024-01-17T23:31:46.517 INFO:tasks.workunit.client.0.smithi161.stdout:2/96: creat d8/d1c/f25 x:0 0 0 2024-01-17T23:31:47.026 INFO:tasks.workunit.client.0.smithi161.stdout:8/59: sync 2024-01-17T23:31:47.026 INFO:tasks.workunit.client.0.smithi161.stdout:4/95: sync 2024-01-17T23:31:47.026 INFO:tasks.workunit.client.0.smithi161.stdout:6/95: sync 2024-01-17T23:31:47.026 INFO:tasks.workunit.client.0.smithi161.stdout:4/96: write d9/de/f14 [5220779,33252] 0 2024-01-17T23:31:47.026 INFO:tasks.workunit.client.0.smithi161.stdout:4/97: chown d9/f10 0 1 2024-01-17T23:31:47.027 INFO:tasks.workunit.client.0.smithi161.stdout:4/98: write d9/f13 [1797560,60753] 0 2024-01-17T23:31:47.223 INFO:tasks.workunit.client.0.smithi161.stdout:7/93: creat da/db/f2a x:0 0 0 2024-01-17T23:31:47.515 INFO:tasks.workunit.client.0.smithi161.stdout:1/105: link d1/d8/fc d1/d11/f22 0 2024-01-17T23:31:47.810 INFO:tasks.workunit.client.0.smithi161.stdout:0/102: truncate d5/f6 2995831 0 2024-01-17T23:31:47.810 INFO:tasks.workunit.client.0.smithi161.stdout:0/103: write d5/d8/f1f [498412,15220] 0 2024-01-17T23:31:47.810 INFO:tasks.workunit.client.0.smithi161.stdout:5/85: truncate fc 253483 0 2024-01-17T23:31:47.972 INFO:tasks.workunit.client.0.smithi161.stdout:8/60: link d1/d3/f10 d1/df/f14 0 2024-01-17T23:31:47.973 INFO:tasks.workunit.client.0.smithi161.stdout:8/61: chown d1/d3/f10 985761 1 2024-01-17T23:31:47.973 INFO:tasks.workunit.client.0.smithi161.stdout:6/96: symlink d6/d9/d1a/l1b 0 2024-01-17T23:31:47.973 INFO:tasks.workunit.client.0.smithi161.stdout:4/99: stat l1 0 2024-01-17T23:31:47.973 INFO:tasks.workunit.client.0.smithi161.stdout:4/100: chown d9/ff 0 1 2024-01-17T23:31:47.974 INFO:tasks.workunit.client.0.smithi161.stdout:4/101: chown d9/fb 128814 1 2024-01-17T23:31:47.974 INFO:tasks.workunit.client.0.smithi161.stdout:2/97: truncate d8/da/f10 772595 0 2024-01-17T23:31:47.985 INFO:tasks.workunit.client.0.smithi161.stdout:6/97: dread d6/d7/f8 [0,4194304] 0 2024-01-17T23:31:47.985 INFO:tasks.workunit.client.0.smithi161.stdout:6/98: write d6/d7/d16/f18 [921177,35270] 0 2024-01-17T23:31:47.985 INFO:tasks.workunit.client.0.smithi161.stdout:6/99: fdatasync d6/d9/f11 0 2024-01-17T23:31:48.040 INFO:tasks.workunit.client.0.smithi161.stdout:7/94: mkdir da/d20/d28/d2b 0 2024-01-17T23:31:48.205 INFO:tasks.workunit.client.0.smithi161.stdout:1/106: creat d1/f23 x:0 0 0 2024-01-17T23:31:48.693 INFO:tasks.workunit.client.0.smithi161.stdout:8/62: dread d1/df/f14 [0,4194304] 0 2024-01-17T23:31:48.709 INFO:tasks.workunit.client.0.smithi161.stdout:8/63: dread f0 [0,4194304] 0 2024-01-17T23:31:49.130 INFO:tasks.workunit.client.0.smithi161.stdout:7/95: link da/db/f11 da/f2c 0 2024-01-17T23:31:49.202 INFO:tasks.workunit.client.0.smithi161.stdout:1/107: symlink d1/d20/l24 0 2024-01-17T23:31:49.203 INFO:tasks.workunit.client.0.smithi161.stdout:1/108: dread - d1/f23 zero size 2024-01-17T23:31:49.207 INFO:tasks.workunit.client.0.smithi161.stdout:1/109: read d1/d8/fc [95456,126948] 0 2024-01-17T23:31:49.207 INFO:tasks.workunit.client.0.smithi161.stdout:1/110: chown d1/d8/fc 80 1 2024-01-17T23:31:49.207 INFO:tasks.workunit.client.0.smithi161.stdout:1/111: fsync d1/ff 0 2024-01-17T23:31:49.207 INFO:tasks.workunit.client.0.smithi161.stdout:1/112: write d1/d8/fc [280655,15507] 0 2024-01-17T23:31:49.246 INFO:tasks.workunit.client.0.smithi161.stdout:1/113: dwrite d1/d8/fd [0,4194304] 0 2024-01-17T23:31:49.246 INFO:tasks.workunit.client.0.smithi161.stdout:1/114: write d1/f23 [17417,115336] 0 2024-01-17T23:31:49.487 INFO:tasks.workunit.client.0.smithi161.stdout:4/102: getdents d9/de 0 2024-01-17T23:31:49.633 INFO:tasks.workunit.client.0.smithi161.stdout:7/96: link da/d14/c25 da/d20/d28/d2b/c2d 0 2024-01-17T23:31:49.633 INFO:tasks.workunit.client.0.smithi161.stdout:7/97: fsync da/d14/f24 0 2024-01-17T23:31:49.653 INFO:tasks.workunit.client.0.smithi161.stdout:7/98: dread da/d14/f18 [0,4194304] 0 2024-01-17T23:31:49.901 INFO:tasks.workunit.client.0.smithi161.stdout:1/115: rename d1/d8/fd to d1/d8/d1f/f25 0 2024-01-17T23:31:49.901 INFO:tasks.workunit.client.0.smithi161.stdout:1/116: write d1/fe [97636,60918] 0 2024-01-17T23:31:50.221 INFO:tasks.workunit.client.0.smithi161.stdout:7/99: creat da/d1e/f2e x:0 0 0 2024-01-17T23:31:50.422 INFO:tasks.workunit.client.0.smithi161.stdout:4/103: rename l2 to d9/l17 0 2024-01-17T23:31:50.422 INFO:tasks.workunit.client.0.smithi161.stdout:4/104: getdents d9/de 0 2024-01-17T23:31:50.732 INFO:tasks.workunit.client.0.smithi161.stdout:9/65: sync 2024-01-17T23:31:50.732 INFO:tasks.workunit.client.0.smithi161.stdout:3/98: sync 2024-01-17T23:31:51.095 INFO:tasks.workunit.client.0.smithi161.stdout:2/98: dwrite d8/da/f10 [0,4194304] 0 2024-01-17T23:31:51.095 INFO:tasks.workunit.client.0.smithi161.stdout:2/99: chown d8/d1c/f25 49451 1 2024-01-17T23:31:51.095 INFO:tasks.workunit.client.0.smithi161.stdout:2/100: dread - d8/d1c/f24 zero size 2024-01-17T23:31:51.406 INFO:tasks.workunit.client.0.smithi161.stdout:7/100: creat da/d20/f2f x:0 0 0 2024-01-17T23:31:51.437 INFO:tasks.workunit.client.0.smithi161.stdout:7/101: dwrite da/f26 [0,4194304] 0 2024-01-17T23:31:51.476 INFO:tasks.workunit.client.0.smithi161.stdout:7/102: dwrite da/f15 [0,4194304] 0 2024-01-17T23:31:51.478 INFO:tasks.workunit.client.0.smithi161.stdout:7/103: dread da/db/f11 [0,4194304] 0 2024-01-17T23:31:51.478 INFO:tasks.workunit.client.0.smithi161.stdout:7/104: write da/fd [4304345,69305] 0 2024-01-17T23:31:51.489 INFO:tasks.workunit.client.0.smithi161.stdout:7/105: dread da/f26 [0,4194304] 0 2024-01-17T23:31:51.558 INFO:tasks.workunit.client.0.smithi161.stdout:0/104: mknod d5/d8/c27 0 2024-01-17T23:31:51.558 INFO:tasks.workunit.client.0.smithi161.stdout:4/105: symlink d9/l18 0 2024-01-17T23:31:51.591 INFO:tasks.workunit.client.0.smithi161.stdout:0/105: dwrite d5/fb [0,4194304] 0 2024-01-17T23:31:51.592 INFO:tasks.workunit.client.0.smithi161.stdout:0/106: dread - d5/d8/d11/d12/f1d zero size 2024-01-17T23:31:51.875 INFO:tasks.workunit.client.0.smithi161.stdout:6/100: rmdir d6/d9/d1a 39 2024-01-17T23:31:51.875 INFO:tasks.workunit.client.0.smithi161.stdout:9/66: rmdir d0/d8/d14 39 2024-01-17T23:31:51.904 INFO:tasks.workunit.client.0.smithi161.stdout:9/67: dwrite d0/d8/f10 [0,4194304] 0 2024-01-17T23:31:51.905 INFO:tasks.workunit.client.0.smithi161.stdout:6/101: dwrite d6/d7/dc/f19 [0,4194304] 0 2024-01-17T23:31:52.289 INFO:tasks.workunit.client.0.smithi161.stdout:8/64: dwrite d1/f2 [0,4194304] 0 2024-01-17T23:31:52.304 INFO:tasks.workunit.client.0.smithi161.stdout:8/65: dread f0 [0,4194304] 0 2024-01-17T23:31:52.367 INFO:tasks.workunit.client.0.smithi161.stdout:4/106: rmdir d9/de 39 2024-01-17T23:31:52.397 INFO:tasks.workunit.client.0.smithi161.stdout:4/107: dwrite d9/de/f14 [0,4194304] 0 2024-01-17T23:31:52.635 INFO:tasks.workunit.client.0.smithi161.stdout:0/107: read f2 [271782,99512] 0 2024-01-17T23:31:52.664 INFO:tasks.workunit.client.0.smithi161.stdout:0/108: dwrite d5/fb [0,4194304] 0 2024-01-17T23:31:52.780 INFO:tasks.workunit.client.0.smithi161.stdout:5/86: unlink fc 0 2024-01-17T23:31:53.238 INFO:tasks.workunit.client.0.smithi161.stdout:2/101: dread d8/f14 [0,4194304] 0 2024-01-17T23:31:53.238 INFO:tasks.workunit.client.0.smithi161.stdout:2/102: write d8/d1c/f24 [40855,121178] 0 2024-01-17T23:31:53.504 INFO:tasks.workunit.client.0.smithi161.stdout:3/99: creat d0/d5/f19 x:0 0 0 2024-01-17T23:31:53.504 INFO:tasks.workunit.client.0.smithi161.stdout:3/100: chown d0/d5/c15 7 1 2024-01-17T23:31:53.529 INFO:tasks.workunit.client.0.smithi161.stdout:3/101: dwrite d0/d5/d9/f13 [0,4194304] 0 2024-01-17T23:31:53.656 INFO:tasks.workunit.client.0.smithi161.stdout:8/66: link f0 d1/df/f15 0 2024-01-17T23:31:53.671 INFO:tasks.workunit.client.0.smithi161.stdout:8/67: dread d1/df/f15 [0,4194304] 0 2024-01-17T23:31:53.776 INFO:tasks.workunit.client.0.smithi161.stdout:4/108: creat d9/de/f19 x:0 0 0 2024-01-17T23:31:54.023 INFO:tasks.workunit.client.0.smithi161.stdout:0/109: creat d5/d8/d11/d12/f28 x:0 0 0 2024-01-17T23:31:54.031 INFO:tasks.workunit.client.0.smithi161.stdout:5/87: rename dd/f13 to dd/d15/f1b 0 2024-01-17T23:31:54.066 INFO:tasks.workunit.client.0.smithi161.stdout:5/88: dwrite fb [0,4194304] 0 2024-01-17T23:31:54.089 INFO:tasks.workunit.client.0.smithi161.stdout:5/89: write fb [3110278,51413] 0 2024-01-17T23:31:54.089 INFO:tasks.workunit.client.0.smithi161.stdout:5/90: fdatasync dd/f12 0 2024-01-17T23:31:54.089 INFO:tasks.workunit.client.0.smithi161.stdout:5/91: stat dd/d15/f1b 0 2024-01-17T23:31:54.123 INFO:tasks.workunit.client.0.smithi161.stdout:2/103: symlink d8/d1c/d1e/d23/l26 0 2024-01-17T23:31:54.555 INFO:tasks.workunit.client.0.smithi161.stdout:8/68: mkdir d1/df/d16 0 2024-01-17T23:31:54.556 INFO:tasks.workunit.client.0.smithi161.stdout:8/69: write d1/d3/f9 [1058010,16169] 0 2024-01-17T23:31:54.991 INFO:tasks.workunit.client.0.smithi161.stdout:5/92: rename f4 to dd/d15/f1c 0 2024-01-17T23:31:54.991 INFO:tasks.workunit.client.0.smithi161.stdout:2/104: creat d8/da/f27 x:0 0 0 2024-01-17T23:31:54.993 INFO:tasks.workunit.client.0.smithi161.stdout:7/106: truncate da/f26 279371 0 2024-01-17T23:31:55.036 INFO:tasks.workunit.client.0.smithi161.stdout:1/117: sync 2024-01-17T23:31:55.434 INFO:tasks.workunit.client.0.smithi161.stdout:9/68: rmdir d0 39 2024-01-17T23:31:55.751 INFO:tasks.workunit.client.0.smithi161.stdout:4/109: getdents d9 0 2024-01-17T23:31:55.883 INFO:tasks.workunit.client.0.smithi161.stdout:5/93: creat dd/d15/f1d x:0 0 0 2024-01-17T23:31:55.898 INFO:tasks.workunit.client.0.smithi161.stdout:5/94: read dd/f12 [2445905,99655] 0 2024-01-17T23:31:56.195 INFO:tasks.workunit.client.0.smithi161.stdout:7/107: symlink da/db/l30 0 2024-01-17T23:31:56.195 INFO:tasks.workunit.client.0.smithi161.stdout:7/108: creat da/d20/f31 x:0 0 0 2024-01-17T23:31:56.195 INFO:tasks.workunit.client.0.smithi161.stdout:7/109: fsync da/fd 0 2024-01-17T23:31:56.220 INFO:tasks.workunit.client.0.smithi161.stdout:7/110: dwrite da/fc [0,4194304] 0 2024-01-17T23:31:56.240 INFO:tasks.workunit.client.0.smithi161.stdout:1/118: mkdir d1/d20/d26 0 2024-01-17T23:31:56.246 INFO:tasks.workunit.client.0.smithi161.stdout:1/119: dread d1/f15 [0,4194304] 0 2024-01-17T23:31:56.246 INFO:tasks.workunit.client.0.smithi161.stdout:1/120: chown d1/d8/lb 320838058 1 2024-01-17T23:31:56.788 INFO:tasks.workunit.client.0.smithi161.stdout:0/110: dwrite f1 [0,4194304] 0 2024-01-17T23:31:56.820 INFO:tasks.workunit.client.0.smithi161.stdout:0/111: dwrite d5/fb [0,4194304] 0 2024-01-17T23:31:56.855 INFO:tasks.workunit.client.0.smithi161.stdout:9/69: truncate d0/d8/f10 85839 0 2024-01-17T23:31:56.973 INFO:tasks.workunit.client.0.smithi161.stdout:4/110: unlink l1 0 2024-01-17T23:31:56.973 INFO:tasks.workunit.client.0.smithi161.stdout:4/111: creat d9/de/f1a x:0 0 0 2024-01-17T23:31:57.003 INFO:tasks.workunit.client.0.smithi161.stdout:4/112: dwrite d9/de/f14 [0,4194304] 0 2024-01-17T23:31:57.048 INFO:tasks.workunit.client.0.smithi161.stdout:5/95: mknod dd/c1e 0 2024-01-17T23:31:57.048 INFO:tasks.workunit.client.0.smithi161.stdout:5/96: truncate dd/f11 993523 0 2024-01-17T23:31:57.437 INFO:tasks.workunit.client.0.smithi161.stdout:7/111: rmdir da/d20/d28/d2b 39 2024-01-17T23:31:57.437 INFO:tasks.workunit.client.0.smithi161.stdout:6/102: sync 2024-01-17T23:31:57.437 INFO:tasks.workunit.client.0.smithi161.stdout:6/103: chown l4 885700 1 2024-01-17T23:31:57.636 INFO:tasks.workunit.client.0.smithi161.stdout:1/121: mknod d1/d20/d26/c27 0 2024-01-17T23:31:57.665 INFO:tasks.workunit.client.0.smithi161.stdout:1/122: dwrite d1/d8/f13 [0,4194304] 0 2024-01-17T23:31:57.665 INFO:tasks.workunit.client.0.smithi161.stdout:1/123: dread - d1/d11/f12 zero size 2024-01-17T23:31:57.665 INFO:tasks.workunit.client.0.smithi161.stdout:1/124: write d1/d11/f22 [334395,118437] 0 2024-01-17T23:31:57.792 INFO:tasks.workunit.client.0.smithi161.stdout:3/102: rmdir d0/d5 39 2024-01-17T23:31:57.793 INFO:tasks.workunit.client.0.smithi161.stdout:3/103: read - d0/f10 zero size 2024-01-17T23:31:57.819 INFO:tasks.workunit.client.0.smithi161.stdout:3/104: write d0/f4 [733652,89061] 0 2024-01-17T23:31:57.819 INFO:tasks.workunit.client.0.smithi161.stdout:3/105: write d0/d5/f8 [2016479,120785] 0 2024-01-17T23:31:57.843 INFO:tasks.workunit.client.0.smithi161.stdout:3/106: dwrite d0/f10 [0,4194304] 0 2024-01-17T23:31:57.843 INFO:tasks.workunit.client.0.smithi161.stdout:3/107: dread - d0/d5/d9/d17/f18 zero size 2024-01-17T23:31:57.843 INFO:tasks.workunit.client.0.smithi161.stdout:3/108: fsync d0/d5/d9/d17/f18 0 2024-01-17T23:31:57.946 INFO:tasks.workunit.client.0.smithi161.stdout:8/70: sync 2024-01-17T23:31:58.168 INFO:tasks.workunit.client.0.smithi161.stdout:9/70: rename d0/c13 to d0/d8/c17 0 2024-01-17T23:31:58.218 INFO:tasks.workunit.client.0.smithi161.stdout:9/71: dwrite d0/d8/d14/fe [0,4194304] 0 2024-01-17T23:31:58.237 INFO:tasks.workunit.client.0.smithi161.stdout:9/72: dread d0/d8/d14/fe [0,4194304] 0 2024-01-17T23:31:58.341 INFO:tasks.workunit.client.0.smithi161.stdout:4/113: unlink d9/f15 0 2024-01-17T23:31:58.341 INFO:tasks.workunit.client.0.smithi161.stdout:0/112: creat d5/d8/f29 x:0 0 0 2024-01-17T23:31:58.341 INFO:tasks.workunit.client.0.smithi161.stdout:4/114: dread - d9/de/f19 zero size 2024-01-17T23:31:58.341 INFO:tasks.workunit.client.0.smithi161.stdout:4/115: dread - d9/de/f1a zero size 2024-01-17T23:31:58.404 INFO:tasks.workunit.client.0.smithi161.stdout:5/97: mknod dd/c1f 0 2024-01-17T23:31:58.412 INFO:tasks.workunit.client.0.smithi161.stdout:5/98: dread dd/f14 [0,4194304] 0 2024-01-17T23:31:58.519 INFO:tasks.workunit.client.0.smithi161.stdout:6/104: rmdir d6/d9 39 2024-01-17T23:31:58.519 INFO:tasks.workunit.client.0.smithi161.stdout:7/112: creat da/d14/f32 x:0 0 0 2024-01-17T23:32:00.315 INFO:tasks.workunit.client.0.smithi161.stdout:5/99: write dd/ff [1065237,30714] 0 2024-01-17T23:32:00.322 INFO:tasks.workunit.client.0.smithi161.stdout:5/100: fdatasync dd/f11 0 2024-01-17T23:32:00.472 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:34:23.829 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:32:00.478 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:34:23.834 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:32:00.483 INFO:tasks.workunit.client.0.smithi161.stdout:6/105: creat d6/d9/d13/f1c x:0 0 0 2024-01-17T23:32:00.517 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:34:23.794 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:32:00.518 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:34:23.795 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:32:00.520 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:34:23.876 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:32:00.523 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:34:23.799 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:32:00.525 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:34:23.801 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:32:00.565 INFO:tasks.workunit.client.0.smithi161.stdout:7/113: link da/c1d da/d20/d28/c33 0 2024-01-17T23:32:00.576 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:34:23.853 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:32:00.604 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:34:23.880 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:32:00.658 INFO:tasks.workunit.client.0.smithi161.stdout:1/125: rmdir d1/d8/d1e 39 2024-01-17T23:32:00.684 INFO:tasks.workunit.client.0.smithi161.stdout:1/126: dwrite d1/d8/f1b [0,4194304] 0 2024-01-17T23:32:00.776 INFO:tasks.workunit.client.0.smithi161.stdout:8/71: truncate d1/df/f14 2087326 0 2024-01-17T23:32:01.070 INFO:tasks.workunit.client.0.smithi161.stdout:0/113: truncate d5/d8/d11/f23 3628698 0 2024-01-17T23:32:01.088 INFO:tasks.workunit.client.0.smithi161.stdout:0/114: write d5/fb [1815399,49086] 0 2024-01-17T23:32:01.448 INFO:tasks.workunit.client.0.smithi161.stdout:6/106: mkdir d6/d7/dc/d1d 0 2024-01-17T23:32:01.448 INFO:tasks.workunit.client.0.smithi161.stdout:6/107: getdents d6/d7/dc/d1d 0 2024-01-17T23:32:01.588 INFO:tasks.workunit.client.0.smithi161.stdout:7/114: mkdir da/d34 0 2024-01-17T23:32:01.589 INFO:tasks.workunit.client.0.smithi161.stdout:7/115: readlink da/db/l30 0 2024-01-17T23:32:01.610 INFO:tasks.workunit.client.0.smithi161.stdout:7/116: write da/f15 [808328,44243] 0 2024-01-17T23:32:01.610 INFO:tasks.workunit.client.0.smithi161.stdout:7/117: write da/f2c [625007,45756] 0 2024-01-17T23:32:01.639 INFO:tasks.workunit.client.0.smithi161.stdout:7/118: dwrite da/fc [0,4194304] 0 2024-01-17T23:32:01.640 INFO:tasks.workunit.client.0.smithi161.stdout:7/119: chown da 69949 1 2024-01-17T23:32:01.640 INFO:tasks.workunit.client.0.smithi161.stdout:7/120: chown da/d1e/l27 2 1 2024-01-17T23:32:01.717 INFO:tasks.workunit.client.0.smithi161.stdout:8/72: symlink d1/df/d16/l17 0 2024-01-17T23:32:01.717 INFO:tasks.workunit.client.0.smithi161.stdout:8/73: write d1/d3/f9 [639279,64621] 0 2024-01-17T23:32:01.840 INFO:tasks.workunit.client.0.smithi161.stdout:0/115: mkdir d5/d8/d11/d12/d2a 0 2024-01-17T23:32:01.840 INFO:tasks.workunit.client.0.smithi161.stdout:0/116: fdatasync d5/d8/d11/d12/f28 0 2024-01-17T23:32:01.860 INFO:tasks.workunit.client.0.smithi161.stdout:0/117: dread d5/d8/f9 [0,4194304] 0 2024-01-17T23:32:01.887 INFO:tasks.workunit.client.0.smithi161.stdout:6/108: mknod d6/d7/d16/c1e 0 2024-01-17T23:32:01.970 INFO:tasks.workunit.client.0.smithi161.stdout:2/105: mkdir d8/d28 0 2024-01-17T23:32:02.462 INFO:tasks.workunit.client.0.smithi161.stdout:6/109: truncate d6/d7/f8 1187896 0 2024-01-17T23:32:02.462 INFO:tasks.workunit.client.0.smithi161.stdout:6/110: readlink l4 0 2024-01-17T23:32:02.627 INFO:tasks.workunit.client.0.smithi161.stdout:2/106: symlink d8/d1c/l29 0 2024-01-17T23:32:03.029 INFO:tasks.workunit.client.0.smithi161.stdout:2/107: creat d8/d1c/d1e/f2a x:0 0 0 2024-01-17T23:32:03.030 INFO:tasks.workunit.client.0.smithi161.stdout:2/108: stat d8/d1c/d1e 0 2024-01-17T23:32:03.033 INFO:tasks.workunit.client.0.smithi161.stdout:2/109: read d8/d1c/f24 [18661,116854] 0 2024-01-17T23:32:03.033 INFO:tasks.workunit.client.0.smithi161.stdout:2/110: chown d8/da 1 1 2024-01-17T23:32:03.245 INFO:tasks.workunit.client.0.smithi161.stdout:2/111: symlink d8/d28/l2b 0 2024-01-17T23:32:03.393 INFO:tasks.workunit.client.0.smithi161.stdout:7/121: unlink da/d20/f31 0 2024-01-17T23:32:03.393 INFO:tasks.workunit.client.0.smithi161.stdout:7/122: getdents da/d34 0 2024-01-17T23:32:03.428 INFO:tasks.workunit.client.0.smithi161.stdout:7/123: dwrite da/d20/f2f [0,4194304] 0 2024-01-17T23:32:03.428 INFO:tasks.workunit.client.0.smithi161.stdout:7/124: fdatasync da/f26 0 2024-01-17T23:32:03.446 INFO:tasks.workunit.client.0.smithi161.stdout:7/125: write da/d14/f18 [2251463,102433] 0 2024-01-17T23:32:03.543 INFO:tasks.workunit.client.0.smithi161.stdout:9/73: truncate d0/f4 1026977 0 2024-01-17T23:32:03.543 INFO:tasks.workunit.client.0.smithi161.stdout:9/74: chown d0/f4 7 1 2024-01-17T23:32:03.561 INFO:tasks.workunit.client.0.smithi161.stdout:0/118: dread d5/d8/d11/f23 [0,4194304] 0 2024-01-17T23:32:03.588 INFO:tasks.workunit.client.0.smithi161.stdout:0/119: dwrite d5/f13 [0,4194304] 0 2024-01-17T23:32:03.595 INFO:tasks.workunit.client.0.smithi161.stdout:0/120: dread f1 [0,4194304] 0 2024-01-17T23:32:03.935 INFO:tasks.workunit.client.0.smithi161.stdout:9/75: mkdir d0/d8/d14/d18 0 2024-01-17T23:32:03.957 INFO:tasks.workunit.client.0.smithi161.stdout:9/76: write d0/d8/d14/fe [1032536,38538] 0 2024-01-17T23:32:04.133 INFO:tasks.workunit.client.0.smithi161.stdout:2/112: rename l7 to d8/d1c/d1e/l2c 0 2024-01-17T23:32:04.153 INFO:tasks.workunit.client.0.smithi161.stdout:6/111: getdents d6/d7/dc 0 2024-01-17T23:32:04.167 INFO:tasks.workunit.client.0.smithi161.stdout:6/112: dread d6/fa [0,4194304] 0 2024-01-17T23:32:04.167 INFO:tasks.workunit.client.0.smithi161.stdout:6/113: fsync d6/fa 0 2024-01-17T23:32:04.351 INFO:tasks.workunit.client.0.smithi161.stdout:0/121: mkdir d5/d8/d11/d20/d2b 0 2024-01-17T23:32:04.519 INFO:tasks.workunit.client.0.smithi161.stdout:7/126: mkdir da/d14/d35 0 2024-01-17T23:32:04.664 INFO:tasks.workunit.client.0.smithi161.stdout:9/77: symlink d0/l19 0 2024-01-17T23:32:04.768 INFO:tasks.workunit.client.0.smithi161.stdout:2/113: mkdir d8/da/d2d 0 2024-01-17T23:32:04.900 INFO:tasks.workunit.client.0.smithi161.stdout:6/114: mkdir d6/d7/d16/d1f 0 2024-01-17T23:32:04.900 INFO:tasks.workunit.client.0.smithi161.stdout:6/115: rename d6/d7/d16 to d6/d7/d16/d20 22 2024-01-17T23:32:04.900 INFO:tasks.workunit.client.0.smithi161.stdout:6/116: creat d6/d7/d16/f21 x:0 0 0 2024-01-17T23:32:04.900 INFO:tasks.workunit.client.0.smithi161.stdout:6/117: chown d6/d7/c12 4007853 1 2024-01-17T23:32:04.903 INFO:tasks.workunit.client.0.smithi161.stdout:3/109: sync 2024-01-17T23:32:04.921 INFO:tasks.workunit.client.0.smithi161.stdout:6/118: read d6/d7/dc/f19 [3069224,129591] 0 2024-01-17T23:32:04.921 INFO:tasks.workunit.client.0.smithi161.stdout:6/119: creat d6/d9/d13/f22 x:0 0 0 2024-01-17T23:32:04.981 INFO:tasks.workunit.client.0.smithi161.stdout:0/122: mknod d5/d8/d11/c2c 0 2024-01-17T23:32:04.981 INFO:tasks.workunit.client.0.smithi161.stdout:0/123: chown d5/d8/l10 15 1 2024-01-17T23:32:05.069 INFO:tasks.workunit.client.0.smithi161.stdout:7/127: getdents da/d20/d28 0 2024-01-17T23:32:05.087 INFO:tasks.workunit.client.0.smithi161.stdout:7/128: dread da/f15 [0,4194304] 0 2024-01-17T23:32:05.196 INFO:tasks.workunit.client.0.smithi161.stdout:9/78: creat d0/d8/f1a x:0 0 0 2024-01-17T23:32:05.744 INFO:tasks.workunit.client.0.smithi161.stdout:6/120: unlink d6/d7/d16/c1e 0 2024-01-17T23:32:05.998 INFO:tasks.workunit.client.0.smithi161.stdout:7/129: getdents da/d20/d28/d2b 0 2024-01-17T23:32:06.011 INFO:tasks.workunit.client.0.smithi161.stdout:7/130: dread da/fc [0,4194304] 0 2024-01-17T23:32:06.015 INFO:tasks.workunit.client.0.smithi161.stdout:7/131: dread da/db/f11 [0,4194304] 0 2024-01-17T23:32:06.483 INFO:tasks.workunit.client.0.smithi161.stdout:3/110: mknod d0/d5/c1a 0 2024-01-17T23:32:06.483 INFO:tasks.workunit.client.0.smithi161.stdout:4/116: rmdir d9 39 2024-01-17T23:32:06.483 INFO:tasks.workunit.client.0.smithi161.stdout:6/121: rename d6/d7/dc/cf to d6/d9/d1a/c23 0 2024-01-17T23:32:06.483 INFO:tasks.workunit.client.0.smithi161.stdout:6/122: readlink d6/d7/lb 0 2024-01-17T23:32:06.483 INFO:tasks.workunit.client.0.smithi161.stdout:6/123: dread - d6/d9/f11 zero size 2024-01-17T23:32:06.522 INFO:tasks.workunit.client.0.smithi161.stdout:6/124: dwrite d6/d7/fe [0,4194304] 0 2024-01-17T23:32:06.608 INFO:tasks.workunit.client.0.smithi161.stdout:1/127: sync 2024-01-17T23:32:06.619 INFO:tasks.workunit.client.0.smithi161.stdout:5/101: sync 2024-01-17T23:32:06.620 INFO:tasks.workunit.client.0.smithi161.stdout:8/74: sync 2024-01-17T23:32:06.620 INFO:tasks.workunit.client.0.smithi161.stdout:8/75: chown d1/ce 34 1 2024-01-17T23:32:06.620 INFO:tasks.workunit.client.0.smithi161.stdout:1/128: fdatasync d1/fe 0 2024-01-17T23:32:06.620 INFO:tasks.workunit.client.0.smithi161.stdout:8/76: chown d1/df/f15 10299 1 2024-01-17T23:32:06.620 INFO:tasks.workunit.client.0.smithi161.stdout:1/129: fdatasync d1/f2 0 2024-01-17T23:32:06.620 INFO:tasks.workunit.client.0.smithi161.stdout:1/130: dread - d1/ff zero size 2024-01-17T23:32:06.620 INFO:tasks.workunit.client.0.smithi161.stdout:8/77: creat d1/d3/f18 x:0 0 0 2024-01-17T23:32:06.620 INFO:tasks.workunit.client.0.smithi161.stdout:1/131: stat d1/d11/f12 0 2024-01-17T23:32:06.620 INFO:tasks.workunit.client.0.smithi161.stdout:1/132: write d1/d8/d1f/f25 [5203157,58401] 0 2024-01-17T23:32:06.638 INFO:tasks.workunit.client.0.smithi161.stdout:5/102: dwrite dd/d15/f1b [0,4194304] 0 2024-01-17T23:32:06.685 INFO:tasks.workunit.client.0.smithi161.stdout:5/103: dwrite dd/f12 [0,4194304] 0 2024-01-17T23:32:06.685 INFO:tasks.workunit.client.0.smithi161.stdout:5/104: chown dd/ff 2 1 2024-01-17T23:32:06.686 INFO:tasks.workunit.client.0.smithi161.stdout:5/105: write dd/f11 [2053414,83657] 0 2024-01-17T23:32:06.868 INFO:tasks.workunit.client.0.smithi161.stdout:7/132: rmdir da 39 2024-01-17T23:32:06.868 INFO:tasks.workunit.client.0.smithi161.stdout:7/133: creat da/d1e/f36 x:0 0 0 2024-01-17T23:32:06.871 INFO:tasks.workunit.client.0.smithi161.stdout:4/117: read - d9/de/f1a zero size 2024-01-17T23:32:06.892 INFO:tasks.workunit.client.0.smithi161.stdout:7/134: write da/d20/f2f [3459865,10709] 0 2024-01-17T23:32:06.945 INFO:tasks.workunit.client.0.smithi161.stdout:7/135: dwrite da/d14/f18 [0,4194304] 0 2024-01-17T23:32:06.945 INFO:tasks.workunit.client.0.smithi161.stdout:3/111: mknod d0/d5/d9/d17/c1b 0 2024-01-17T23:32:06.959 INFO:tasks.workunit.client.0.smithi161.stdout:6/125: rename d6/d7/dc/c10 to d6/d7/dc/d1d/c24 0 2024-01-17T23:32:06.975 INFO:tasks.workunit.client.0.smithi161.stdout:6/126: dread d6/fa [0,4194304] 0 2024-01-17T23:32:06.975 INFO:tasks.workunit.client.0.smithi161.stdout:6/127: chown d6/d9/f11 4010 1 2024-01-17T23:32:06.983 INFO:tasks.workunit.client.0.smithi161.stdout:8/78: unlink d1/df/d16/l17 0 2024-01-17T23:32:07.225 INFO:tasks.workunit.client.0.smithi161.stdout:1/133: creat d1/d8/d1f/f28 x:0 0 0 2024-01-17T23:32:07.225 INFO:tasks.workunit.client.0.smithi161.stdout:5/106: mkdir dd/d15/d1a/d20 0 2024-01-17T23:32:07.244 INFO:tasks.workunit.client.0.smithi161.stdout:5/107: dread dd/f12 [0,4194304] 0 2024-01-17T23:32:07.244 INFO:tasks.workunit.client.0.smithi161.stdout:5/108: fsync dd/d15/f1c 0 2024-01-17T23:32:07.244 INFO:tasks.workunit.client.0.smithi161.stdout:5/109: creat dd/d15/f21 x:0 0 0 2024-01-17T23:32:07.259 INFO:tasks.workunit.client.0.smithi161.stdout:5/110: write dd/d15/f1b [1963414,62813] 0 2024-01-17T23:32:07.259 INFO:tasks.workunit.client.0.smithi161.stdout:5/111: stat dd 0 2024-01-17T23:32:07.259 INFO:tasks.workunit.client.0.smithi161.stdout:5/112: truncate dd/d15/f21 372267 0 2024-01-17T23:32:07.259 INFO:tasks.workunit.client.0.smithi161.stdout:5/113: chown l2 510 1 2024-01-17T23:32:07.259 INFO:tasks.workunit.client.0.smithi161.stdout:5/114: chown dd/d15/d1a 1584603 1 2024-01-17T23:32:07.261 INFO:tasks.workunit.client.0.smithi161.stdout:5/115: dread dd/d15/f21 [0,4194304] 0 2024-01-17T23:32:07.261 INFO:tasks.workunit.client.0.smithi161.stdout:5/116: truncate dd/d15/f21 613757 0 2024-01-17T23:32:07.467 INFO:tasks.workunit.client.0.smithi161.stdout:7/136: mknod da/d1e/c37 0 2024-01-17T23:32:07.497 INFO:tasks.workunit.client.0.smithi161.stdout:7/137: dwrite da/d1e/f2e [0,4194304] 0 2024-01-17T23:32:07.610 INFO:tasks.workunit.client.0.smithi161.stdout:3/112: rename d0/d5/f8 to d0/d5/d9/d17/f1c 0 2024-01-17T23:32:07.610 INFO:tasks.workunit.client.0.smithi161.stdout:3/113: readlink d0/ld 0 2024-01-17T23:32:07.718 INFO:tasks.workunit.client.0.smithi161.stdout:6/128: symlink d6/d7/dc/l25 0 2024-01-17T23:32:07.718 INFO:tasks.workunit.client.0.smithi161.stdout:6/129: write d6/fa [2150752,80109] 0 2024-01-17T23:32:07.718 INFO:tasks.workunit.client.0.smithi161.stdout:6/130: write d6/d9/d13/f22 [416462,61368] 0 2024-01-17T23:32:07.771 INFO:tasks.workunit.client.0.smithi161.stdout:0/124: truncate d5/f13 3479089 0 2024-01-17T23:32:07.771 INFO:tasks.workunit.client.0.smithi161.stdout:0/125: fdatasync d5/fb 0 2024-01-17T23:32:07.811 INFO:tasks.workunit.client.0.smithi161.stdout:0/126: dwrite d5/d8/d11/d12/f28 [0,4194304] 0 2024-01-17T23:32:07.819 INFO:tasks.workunit.client.0.smithi161.stdout:0/127: write d5/d8/d11/f23 [2095977,104970] 0 2024-01-17T23:32:07.986 INFO:tasks.workunit.client.0.smithi161.stdout:8/79: mkdir d1/d3/d19 0 2024-01-17T23:32:07.986 INFO:tasks.workunit.client.0.smithi161.stdout:1/134: symlink d1/d8/d1f/l29 0 2024-01-17T23:32:07.986 INFO:tasks.workunit.client.0.smithi161.stdout:1/135: fdatasync d1/d8/f1b 0 2024-01-17T23:32:07.999 INFO:tasks.workunit.client.0.smithi161.stdout:8/80: dread d1/f2 [0,4194304] 0 2024-01-17T23:32:08.336 INFO:tasks.workunit.client.0.smithi161.stdout:4/118: mkdir d9/d1b 0 2024-01-17T23:32:08.582 INFO:tasks.workunit.client.0.smithi161.stdout:7/138: mknod da/d1e/c38 0 2024-01-17T23:32:08.697 INFO:tasks.workunit.client.0.smithi161.stdout:2/114: write d8/f14 [3049007,46052] 0 2024-01-17T23:32:08.780 INFO:tasks.workunit.client.0.smithi161.stdout:3/114: creat d0/d5/f1d x:0 0 0 2024-01-17T23:32:08.795 INFO:tasks.workunit.client.0.smithi161.stdout:3/115: write d0/d5/d9/f13 [2890337,45725] 0 2024-01-17T23:32:08.825 INFO:tasks.workunit.client.0.smithi161.stdout:3/116: dwrite d0/d5/d9/d17/f1c [0,4194304] 0 2024-01-17T23:32:08.852 INFO:tasks.workunit.client.0.smithi161.stdout:3/117: dwrite d0/d5/f19 [0,4194304] 0 2024-01-17T23:32:08.852 INFO:tasks.workunit.client.0.smithi161.stdout:3/118: stat d0/c3 0 2024-01-17T23:32:09.017 INFO:tasks.workunit.client.0.smithi161.stdout:6/131: mknod d6/d9/d1a/c26 0 2024-01-17T23:32:09.041 INFO:tasks.workunit.client.0.smithi161.stdout:6/132: dwrite d6/d7/d16/f21 [0,4194304] 0 2024-01-17T23:32:09.604 INFO:tasks.workunit.client.0.smithi161.stdout:0/128: mkdir d5/d8/d11/d20/d2d 0 2024-01-17T23:32:09.604 INFO:tasks.workunit.client.0.smithi161.stdout:1/136: creat d1/d8/d1e/f2a x:0 0 0 2024-01-17T23:32:09.699 INFO:tasks.workunit.client.0.smithi161.stdout:8/81: symlink d1/df/l1a 0 2024-01-17T23:32:09.734 INFO:tasks.workunit.client.0.smithi161.stdout:8/82: dwrite d1/d3/f18 [0,4194304] 0 2024-01-17T23:32:09.986 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:32:09.990 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:32:10.074 INFO:tasks.workunit.client.0.smithi161.stdout:9/79: write d0/f4 [1951121,922] 0 2024-01-17T23:32:10.074 INFO:tasks.workunit.client.0.smithi161.stdout:4/119: mknod d9/d1b/c1c 0 2024-01-17T23:32:10.803 INFO:tasks.workunit.client.0.smithi161.stdout:7/139: creat da/d20/d28/f39 x:0 0 0 2024-01-17T23:32:11.636 INFO:tasks.workunit.client.0.smithi161.stdout:3/119: rename d0/d5/d9/d16 to d0/d5/d9/d1e 0 2024-01-17T23:32:11.636 INFO:tasks.workunit.client.0.smithi161.stdout:3/120: write d0/d5/f1d [29989,61873] 0 2024-01-17T23:32:12.112 INFO:tasks.workunit.client.0.smithi161.stdout:1/137: symlink d1/l2b 0 2024-01-17T23:32:12.112 INFO:tasks.workunit.client.0.smithi161.stdout:1/138: readlink d1/l6 0 2024-01-17T23:32:12.533 INFO:tasks.workunit.client.0.smithi161.stdout:8/83: rename d1/d3/f10 to d1/df/d13/f1b 0 2024-01-17T23:32:12.533 INFO:tasks.workunit.client.0.smithi161.stdout:8/84: chown d1/df/d13/f1b 862 1 2024-01-17T23:32:12.585 INFO:tasks.workunit.client.0.smithi161.stdout:9/80: stat d0/c5 0 2024-01-17T23:32:12.892 INFO:tasks.workunit.client.0.smithi161.stdout:4/120: creat d9/de/f1d x:0 0 0 2024-01-17T23:32:12.892 INFO:tasks.workunit.client.0.smithi161.stdout:4/121: chown f4 15 1 2024-01-17T23:32:12.892 INFO:tasks.workunit.client.0.smithi161.stdout:5/117: truncate dd/d15/f1c 776981 0 2024-01-17T23:32:12.912 INFO:tasks.workunit.client.0.smithi161.stdout:4/122: dread f7 [0,4194304] 0 2024-01-17T23:32:12.925 INFO:tasks.workunit.client.0.smithi161.stdout:4/123: dread d9/de/f14 [0,4194304] 0 2024-01-17T23:32:12.925 INFO:tasks.workunit.client.0.smithi161.stdout:4/124: dread - d9/de/f1a zero size 2024-01-17T23:32:13.436 INFO:tasks.workunit.client.0.smithi161.stdout:1/139: mknod d1/d11/c2c 0 2024-01-17T23:32:13.706 INFO:tasks.workunit.client.0.smithi161.stdout:9/81: creat d0/d8/d14/f1b x:0 0 0 2024-01-17T23:32:13.949 INFO:tasks.workunit.client.0.smithi161.stdout:4/125: dread - d9/ff zero size 2024-01-17T23:32:14.061 INFO:tasks.workunit.client.0.smithi161.stdout:3/121: link d0/f4 d0/f1f 0 2024-01-17T23:32:14.210 INFO:tasks.workunit.client.0.smithi161.stdout:1/140: mkdir d1/d2d 0 2024-01-17T23:32:14.210 INFO:tasks.workunit.client.0.smithi161.stdout:1/141: fsync d1/d8/d1f/f25 0 2024-01-17T23:32:14.275 INFO:tasks.workunit.client.0.smithi161.stdout:9/82: creat d0/d8/f1c x:0 0 0 2024-01-17T23:32:14.664 INFO:tasks.workunit.client.0.smithi161.stdout:4/126: mkdir d9/de/d1e 0 2024-01-17T23:32:14.664 INFO:tasks.workunit.client.0.smithi161.stdout:5/118: truncate dd/d15/f1b 4097453 0 2024-01-17T23:32:14.664 INFO:tasks.workunit.client.0.smithi161.stdout:5/119: write f8 [5197532,23329] 0 2024-01-17T23:32:14.664 INFO:tasks.workunit.client.0.smithi161.stdout:5/120: creat dd/d15/f22 x:0 0 0 2024-01-17T23:32:14.664 INFO:tasks.workunit.client.0.smithi161.stdout:5/121: creat dd/d15/f23 x:0 0 0 2024-01-17T23:32:14.664 INFO:tasks.workunit.client.0.smithi161.stdout:5/122: write fb [1737293,50819] 0 2024-01-17T23:32:14.838 INFO:tasks.workunit.client.0.smithi161.stdout:3/122: symlink d0/d5/d9/d1e/l20 0 2024-01-17T23:32:15.014 INFO:tasks.workunit.client.0.smithi161.stdout:1/142: link d1/f2 d1/d20/f2e 0 2024-01-17T23:32:15.014 INFO:tasks.workunit.client.0.smithi161.stdout:9/83: stat d0/d8/cb 0 2024-01-17T23:32:15.145 INFO:tasks.workunit.client.0.smithi161.stdout:4/127: dwrite d9/f13 [0,4194304] 0 2024-01-17T23:32:15.533 INFO:tasks.workunit.client.0.smithi161.stdout:5/123: creat dd/f24 x:0 0 0 2024-01-17T23:32:15.534 INFO:tasks.workunit.client.0.smithi161.stdout:5/124: read dd/d15/f19 [121799,88967] 0 2024-01-17T23:32:15.534 INFO:tasks.workunit.client.0.smithi161.stdout:5/125: write dd/d15/f21 [1241883,88774] 0 2024-01-17T23:32:15.886 INFO:tasks.workunit.client.0.smithi161.stdout:1/143: creat d1/d20/d26/f2f x:0 0 0 2024-01-17T23:32:15.886 INFO:tasks.workunit.client.0.smithi161.stdout:1/144: read - d1/d8/d1e/f2a zero size 2024-01-17T23:32:15.917 INFO:tasks.workunit.client.0.smithi161.stdout:1/145: dwrite d1/d20/f2e [4194304,4194304] 0 2024-01-17T23:32:15.944 INFO:tasks.workunit.client.0.smithi161.stdout:1/146: dwrite d1/d8/f1b [0,4194304] 0 2024-01-17T23:32:15.945 INFO:tasks.workunit.client.0.smithi161.stdout:1/147: dread - d1/ff zero size 2024-01-17T23:32:15.945 INFO:tasks.workunit.client.0.smithi161.stdout:1/148: read - d1/ff zero size 2024-01-17T23:32:16.105 INFO:tasks.workunit.client.0.smithi161.stdout:9/84: rename d0/d8/f1c to d0/d8/d14/d18/f1d 0 2024-01-17T23:32:16.106 INFO:tasks.workunit.client.0.smithi161.stdout:9/85: truncate d0/d8/d14/d18/f1d 486220 0 2024-01-17T23:32:16.106 INFO:tasks.workunit.client.0.smithi161.stdout:9/86: read - d0/d8/f1a zero size 2024-01-17T23:32:16.106 INFO:tasks.workunit.client.0.smithi161.stdout:9/87: write d0/d8/d14/f1b [658106,110420] 0 2024-01-17T23:32:16.271 INFO:tasks.workunit.client.0.smithi161.stdout:4/128: mkdir d9/de/d1e/d1f 0 2024-01-17T23:32:16.272 INFO:tasks.workunit.client.0.smithi161.stdout:4/129: stat d9/f13 0 2024-01-17T23:32:16.272 INFO:tasks.workunit.client.0.smithi161.stdout:4/130: chown d9/de/d1e 3926 1 2024-01-17T23:32:16.632 INFO:tasks.workunit.client.0.smithi161.stdout:5/126: creat dd/d15/d1a/f25 x:0 0 0 2024-01-17T23:32:16.987 INFO:tasks.workunit.client.0.smithi161.stdout:1/149: mkdir d1/d20/d26/d30 0 2024-01-17T23:32:17.015 INFO:tasks.workunit.client.0.smithi161.stdout:1/150: dwrite d1/d8/d1f/f28 [0,4194304] 0 2024-01-17T23:32:17.016 INFO:tasks.workunit.client.0.smithi161.stdout:1/151: write d1/ff [296322,80650] 0 2024-01-17T23:32:17.016 INFO:tasks.workunit.client.0.smithi161.stdout:1/152: write d1/d20/d26/f2f [781264,84646] 0 2024-01-17T23:32:17.103 INFO:tasks.workunit.client.0.smithi161.stdout:9/88: symlink d0/d8/d14/d18/l1e 0 2024-01-17T23:32:17.130 INFO:tasks.workunit.client.0.smithi161.stdout:9/89: dwrite d0/d8/f1a [0,4194304] 0 2024-01-17T23:32:17.166 INFO:tasks.workunit.client.0.smithi161.stdout:9/90: dwrite d0/d8/d14/f1b [0,4194304] 0 2024-01-17T23:32:17.179 INFO:tasks.workunit.client.0.smithi161.stdout:9/91: write d0/d8/f1a [1600339,14909] 0 2024-01-17T23:32:17.196 INFO:tasks.workunit.client.0.smithi161.stdout:4/131: symlink d9/de/d1e/l20 0 2024-01-17T23:32:17.847 INFO:tasks.workunit.client.0.smithi161.stdout:2/115: rename d8/d28 to d8/d2e 0 2024-01-17T23:32:18.197 INFO:tasks.workunit.client.0.smithi161.stdout:9/92: rename d0/d8/f1a to d0/d8/f1f 0 2024-01-17T23:32:18.427 INFO:tasks.workunit.client.0.smithi161.stdout:4/132: link d9/de/f14 d9/de/d1e/f21 0 2024-01-17T23:32:18.427 INFO:tasks.workunit.client.0.smithi161.stdout:4/133: chown d9/de 18 1 2024-01-17T23:32:18.997 INFO:tasks.workunit.client.0.smithi161.stdout:9/93: mkdir d0/d8/d14/d18/d20 0 2024-01-17T23:32:18.998 INFO:tasks.workunit.client.0.smithi161.stdout:9/94: fdatasync d0/d8/f10 0 2024-01-17T23:32:18.998 INFO:tasks.workunit.client.0.smithi161.stdout:9/95: stat d0/d8/d14/f1b 0 2024-01-17T23:32:19.221 INFO:tasks.workunit.client.0.smithi161.stdout:4/134: fsync d9/fb 0 2024-01-17T23:32:19.221 INFO:tasks.workunit.client.0.smithi161.stdout:4/135: truncate d9/fb 1423525 0 2024-01-17T23:32:19.246 INFO:tasks.workunit.client.0.smithi161.stdout:4/136: write d9/f13 [2276295,41961] 0 2024-01-17T23:32:19.377 INFO:tasks.workunit.client.0.smithi161.stdout:4/137: chown d9/f10 1 1 2024-01-17T23:32:19.782 INFO:tasks.workunit.client.0.smithi161.stdout:8/85: mkdir d1/d1c 0 2024-01-17T23:32:19.782 INFO:tasks.workunit.client.0.smithi161.stdout:8/86: chown d1/ca 27 1 2024-01-17T23:32:19.783 INFO:tasks.workunit.client.0.smithi161.stdout:0/129: unlink d5/d8/l17 0 2024-01-17T23:32:19.783 INFO:tasks.workunit.client.0.smithi161.stdout:0/130: readlink d5/d8/l10 0 2024-01-17T23:32:19.799 INFO:tasks.workunit.client.0.smithi161.stdout:6/133: creat d6/f27 x:0 0 0 2024-01-17T23:32:19.799 INFO:tasks.workunit.client.0.smithi161.stdout:6/134: fdatasync d6/d7/dc/f19 0 2024-01-17T23:32:19.800 INFO:tasks.workunit.client.0.smithi161.stdout:6/135: readlink d6/d7/dc/l25 0 2024-01-17T23:32:19.800 INFO:tasks.workunit.client.0.smithi161.stdout:6/136: creat d6/d9/d13/f28 x:0 0 0 2024-01-17T23:32:20.024 INFO:tasks.workunit.client.0.smithi161.stdout:4/138: rmdir d9/de/d1e/d1f 0 2024-01-17T23:32:20.140 INFO:tasks.workunit.client.0.smithi161.stdout:8/87: mkdir d1/d3/d19/d1d 0 2024-01-17T23:32:20.262 INFO:tasks.workunit.client.0.smithi161.stdout:0/131: unlink d5/f6 0 2024-01-17T23:32:20.262 INFO:tasks.workunit.client.0.smithi161.stdout:0/132: getdents d5/d8/d11/d21 0 2024-01-17T23:32:20.262 INFO:tasks.workunit.client.0.smithi161.stdout:0/133: write f1 [1033777,105724] 0 2024-01-17T23:32:20.457 INFO:tasks.workunit.client.0.smithi161.stdout:6/137: mknod d6/d7/dc/d1d/c29 0 2024-01-17T23:32:20.458 INFO:tasks.workunit.client.0.smithi161.stdout:6/138: rename d6 to d6/d7/d2a 22 2024-01-17T23:32:20.601 INFO:tasks.workunit.client.0.smithi161.stdout:4/139: rename d9/d1b/c1c to d9/d1b/c22 0 2024-01-17T23:32:20.800 INFO:tasks.workunit.client.0.smithi161.stdout:8/88: truncate d1/df/f15 1348637 0 2024-01-17T23:32:20.800 INFO:tasks.workunit.client.0.smithi161.stdout:8/89: chown d1/d3/ld 14289789 1 2024-01-17T23:32:21.030 INFO:tasks.workunit.client.0.smithi161.stdout:0/134: mkdir d5/d2e 0 2024-01-17T23:32:21.060 INFO:tasks.workunit.client.0.smithi161.stdout:0/135: dwrite d5/d8/d11/d12/f1d [0,4194304] 0 2024-01-17T23:32:21.078 INFO:tasks.workunit.client.0.smithi161.stdout:0/136: write d5/d8/f9 [3003238,32301] 0 2024-01-17T23:32:21.107 INFO:tasks.workunit.client.0.smithi161.stdout:0/137: dwrite d5/d8/f1f [0,4194304] 0 2024-01-17T23:32:21.120 INFO:tasks.workunit.client.0.smithi161.stdout:0/138: dread d5/d8/d11/f23 [0,4194304] 0 2024-01-17T23:32:21.120 INFO:tasks.workunit.client.0.smithi161.stdout:0/139: truncate d5/d8/f1a 213562 0 2024-01-17T23:32:21.121 INFO:tasks.workunit.client.0.smithi161.stdout:0/140: fdatasync f1 0 2024-01-17T23:32:21.121 INFO:tasks.workunit.client.0.smithi161.stdout:0/141: readlink d5/d8/d11/l22 0 2024-01-17T23:32:21.121 INFO:tasks.workunit.client.0.smithi161.stdout:0/142: fdatasync f1 0 2024-01-17T23:32:21.191 INFO:tasks.workunit.client.0.smithi161.stdout:6/139: rmdir d6/d7/d16/d1f 0 2024-01-17T23:32:21.191 INFO:tasks.workunit.client.0.smithi161.stdout:6/140: write d6/fa [1964992,68214] 0 2024-01-17T23:32:21.319 INFO:tasks.workunit.client.0.smithi161.stdout:4/140: creat d9/f23 x:0 0 0 2024-01-17T23:32:21.763 INFO:tasks.workunit.client.0.smithi161.stdout:9/96: dwrite d0/d8/d14/f1b [4194304,4194304] 0 2024-01-17T23:32:21.764 INFO:tasks.workunit.client.0.smithi161.stdout:9/97: chown d0/l16 1 1 2024-01-17T23:32:21.792 INFO:tasks.workunit.client.0.smithi161.stdout:9/98: dwrite d0/d8/d14/d18/f1d [0,4194304] 0 2024-01-17T23:32:21.793 INFO:tasks.workunit.client.0.smithi161.stdout:9/99: stat d0/d8/cb 0 2024-01-17T23:32:21.793 INFO:tasks.workunit.client.0.smithi161.stdout:9/100: chown d0/l19 13207763 1 2024-01-17T23:32:22.247 INFO:tasks.workunit.client.0.smithi161.stdout:0/143: creat d5/d8/d11/d20/f2f x:0 0 0 2024-01-17T23:32:22.466 INFO:tasks.workunit.client.0.smithi161.stdout:4/141: truncate d9/de/d1e/f21 2692390 0 2024-01-17T23:32:22.589 INFO:tasks.workunit.client.0.smithi161.stdout:7/140: sync 2024-01-17T23:32:22.940 INFO:tasks.workunit.client.0.smithi161.stdout:9/101: mknod d0/d8/d14/d18/d20/c21 0 2024-01-17T23:32:22.948 INFO:tasks.workunit.client.0.smithi161.stdout:9/102: dread d0/f4 [0,4194304] 0 2024-01-17T23:32:23.076 INFO:tasks.workunit.client.0.smithi161.stdout:0/144: rename c3 to d5/d8/c30 0 2024-01-17T23:32:23.076 INFO:tasks.workunit.client.0.smithi161.stdout:0/145: write d5/d8/d11/d12/f28 [4243685,41184] 0 2024-01-17T23:32:23.076 INFO:tasks.workunit.client.0.smithi161.stdout:0/146: chown d5/d8/d11/l15 350 1 2024-01-17T23:32:24.621 INFO:tasks.workunit.client.0.smithi161.stdout:3/123: rename d0/d5/cc to d0/d5/c21 0 2024-01-17T23:32:24.622 INFO:tasks.workunit.client.0.smithi161.stdout:7/141: rename da/d1e/f36 to da/d14/d35/f3a 0 2024-01-17T23:32:24.622 INFO:tasks.workunit.client.0.smithi161.stdout:7/142: chown da/d1e 13042157 1 2024-01-17T23:32:24.622 INFO:tasks.workunit.client.0.smithi161.stdout:0/147: creat d5/d2e/f31 x:0 0 0 2024-01-17T23:32:24.629 INFO:tasks.workunit.client.0.smithi161.stdout:0/148: dread f2 [0,4194304] 0 2024-01-17T23:32:24.656 INFO:tasks.workunit.client.0.smithi161.stdout:0/149: dwrite d5/d8/f1f [0,4194304] 0 2024-01-17T23:32:24.688 INFO:tasks.workunit.client.0.smithi161.stdout:0/150: dwrite d5/d8/f29 [0,4194304] 0 2024-01-17T23:32:24.689 INFO:tasks.workunit.client.0.smithi161.stdout:0/151: truncate d5/d2e/f31 257216 0 2024-01-17T23:32:24.706 INFO:tasks.workunit.client.0.smithi161.stdout:0/152: write d5/d8/d11/d12/f28 [1931116,57091] 0 2024-01-17T23:32:24.706 INFO:tasks.workunit.client.0.smithi161.stdout:0/153: write d5/d8/f9 [632950,91824] 0 2024-01-17T23:32:24.829 INFO:tasks.workunit.client.0.smithi161.stdout:4/142: getdents d9/de 0 2024-01-17T23:32:24.830 INFO:tasks.workunit.client.0.smithi161.stdout:1/153: mkdir d1/d31 0 2024-01-17T23:32:24.830 INFO:tasks.workunit.client.0.smithi161.stdout:1/154: chown d1/f15 39492 1 2024-01-17T23:32:24.830 INFO:tasks.workunit.client.0.smithi161.stdout:4/143: fdatasync d9/fb 0 2024-01-17T23:32:24.854 INFO:tasks.workunit.client.0.smithi161.stdout:1/155: dwrite d1/d8/d1f/f28 [4194304,4194304] 0 2024-01-17T23:32:24.859 INFO:tasks.workunit.client.0.smithi161.stdout:1/156: dread d1/ff [0,4194304] 0 2024-01-17T23:32:25.064 INFO:tasks.workunit.client.0.smithi161.stdout:3/124: mknod d0/d5/d9/c22 0 2024-01-17T23:32:25.088 INFO:tasks.workunit.client.0.smithi161.stdout:3/125: dwrite d0/d5/fe [0,4194304] 0 2024-01-17T23:32:25.088 INFO:tasks.workunit.client.0.smithi161.stdout:3/126: chown d0 331 1 2024-01-17T23:32:25.142 INFO:tasks.workunit.client.0.smithi161.stdout:7/143: mkdir da/d20/d3b 0 2024-01-17T23:32:25.142 INFO:tasks.workunit.client.0.smithi161.stdout:7/144: chown da/d20/d28/d2b 10395709 1 2024-01-17T23:32:25.478 INFO:tasks.workunit.client.0.smithi161.stdout:0/154: creat d5/f32 x:0 0 0 2024-01-17T23:32:25.517 INFO:tasks.workunit.client.0.smithi161.stdout:0/155: dwrite d5/f13 [0,4194304] 0 2024-01-17T23:32:25.588 INFO:tasks.workunit.client.0.smithi161.stdout:8/90: write d1/df/d13/f1b [2637417,60903] 0 2024-01-17T23:32:25.702 INFO:tasks.workunit.client.0.smithi161.stdout:1/157: mkdir d1/d20/d26/d32 0 2024-01-17T23:32:26.162 INFO:tasks.workunit.client.0.smithi161.stdout:7/145: mknod da/d20/c3c 0 2024-01-17T23:32:26.330 INFO:tasks.workunit.client.0.smithi161.stdout:0/156: write d5/d8/f1a [404623,39778] 0 2024-01-17T23:32:26.330 INFO:tasks.workunit.client.0.smithi161.stdout:0/157: write f0 [3731346,119299] 0 2024-01-17T23:32:26.614 INFO:tasks.workunit.client.0.smithi161.stdout:1/158: symlink d1/d11/l33 0 2024-01-17T23:32:26.614 INFO:tasks.workunit.client.0.smithi161.stdout:8/91: truncate d1/d3/f12 3931367 0 2024-01-17T23:32:26.614 INFO:tasks.workunit.client.0.smithi161.stdout:8/92: chown d1/d3 27791 1 2024-01-17T23:32:26.733 INFO:tasks.workunit.client.0.smithi161.stdout:3/127: link d0/d5/d9/d1e/l20 d0/d5/l23 0 2024-01-17T23:32:27.302 INFO:tasks.workunit.client.0.smithi161.stdout:7/146: mkdir da/d20/d3b/d3d 0 2024-01-17T23:32:27.303 INFO:tasks.workunit.client.0.smithi161.stdout:7/147: creat da/d20/d28/f3e x:0 0 0 2024-01-17T23:32:27.379 INFO:tasks.workunit.client.0.smithi161.stdout:4/144: dread d9/de/d1e/f21 [0,4194304] 0 2024-01-17T23:32:27.926 INFO:tasks.workunit.client.0.smithi161.stdout:5/127: sync 2024-01-17T23:32:28.122 INFO:tasks.workunit.client.0.smithi161.stdout:2/116: sync 2024-01-17T23:32:28.122 INFO:tasks.workunit.client.0.smithi161.stdout:2/117: chown d8/le 27 1 2024-01-17T23:32:28.122 INFO:tasks.workunit.client.0.smithi161.stdout:2/118: truncate d8/d1c/d1e/f2a 453014 0 2024-01-17T23:32:28.237 INFO:tasks.workunit.client.0.smithi161.stdout:1/159: rename d1/f15 to d1/d8/d1e/f34 0 2024-01-17T23:32:28.352 INFO:tasks.workunit.client.0.smithi161.stdout:3/128: truncate d0/d5/fa 3406551 0 2024-01-17T23:32:28.353 INFO:tasks.workunit.client.0.smithi161.stdout:3/129: stat d0/d5/d9/f13 0 2024-01-17T23:32:28.353 INFO:tasks.workunit.client.0.smithi161.stdout:3/130: readlink d0/d5/d9/d1e/l20 0 2024-01-17T23:32:28.353 INFO:tasks.workunit.client.0.smithi161.stdout:3/131: chown d0/d5/c14 591545121 1 2024-01-17T23:32:28.650 INFO:tasks.workunit.client.0.smithi161.stdout:7/148: unlink da/fd 0 2024-01-17T23:32:28.678 INFO:tasks.workunit.client.0.smithi161.stdout:7/149: dwrite da/f26 [0,4194304] 0 2024-01-17T23:32:28.768 INFO:tasks.workunit.client.0.smithi161.stdout:4/145: mkdir d9/d1b/d24 0 2024-01-17T23:32:28.768 INFO:tasks.workunit.client.0.smithi161.stdout:4/146: truncate d9/de/f1a 707725 0 2024-01-17T23:32:28.884 INFO:tasks.workunit.client.0.smithi161.stdout:5/128: symlink dd/d15/d1a/d20/l26 0 2024-01-17T23:32:29.187 INFO:tasks.workunit.client.0.smithi161.stdout:1/160: symlink d1/d20/d26/d30/l35 0 2024-01-17T23:32:29.188 INFO:tasks.workunit.client.0.smithi161.stdout:1/161: stat d1/d8/f1b 0 2024-01-17T23:32:29.435 INFO:tasks.workunit.client.0.smithi161.stdout:3/132: mknod d0/d5/d9/c24 0 2024-01-17T23:32:29.456 INFO:tasks.workunit.client.0.smithi161.stdout:3/133: dread d0/f10 [0,4194304] 0 2024-01-17T23:32:29.471 INFO:tasks.workunit.client.0.smithi161.stdout:3/134: write d0/d5/fe [918560,32019] 0 2024-01-17T23:32:29.471 INFO:tasks.workunit.client.0.smithi161.stdout:3/135: fdatasync d0/f4 0 2024-01-17T23:32:29.506 INFO:tasks.workunit.client.0.smithi161.stdout:7/150: mknod da/d20/c3f 0 2024-01-17T23:32:29.506 INFO:tasks.workunit.client.0.smithi161.stdout:7/151: truncate da/d14/f32 771210 0 2024-01-17T23:32:29.506 INFO:tasks.workunit.client.0.smithi161.stdout:7/152: truncate da/db/f11 1291957 0 2024-01-17T23:32:29.506 INFO:tasks.workunit.client.0.smithi161.stdout:7/153: chown da/db/f2a 427 1 2024-01-17T23:32:29.506 INFO:tasks.workunit.client.0.smithi161.stdout:7/154: write da/f2c [1793073,102041] 0 2024-01-17T23:32:29.506 INFO:tasks.workunit.client.0.smithi161.stdout:7/155: read - da/db/f2a zero size 2024-01-17T23:32:29.506 INFO:tasks.workunit.client.0.smithi161.stdout:7/156: chown da/d20/d28/d2b 10323 1 2024-01-17T23:32:29.635 INFO:tasks.workunit.client.0.smithi161.stdout:4/147: mkdir d9/d1b/d24/d25 0 2024-01-17T23:32:29.635 INFO:tasks.workunit.client.0.smithi161.stdout:4/148: write d9/f13 [1716412,99840] 0 2024-01-17T23:32:29.822 INFO:tasks.workunit.client.0.smithi161.stdout:6/141: creat d6/d7/f2b x:0 0 0 2024-01-17T23:32:29.847 INFO:tasks.workunit.client.0.smithi161.stdout:6/142: dwrite d6/d7/d16/f18 [0,4194304] 0 2024-01-17T23:32:30.026 INFO:tasks.workunit.client.0.smithi161.stdout:2/119: mknod d8/d1c/d1e/c2f 0 2024-01-17T23:32:30.026 INFO:tasks.workunit.client.0.smithi161.stdout:1/162: creat d1/d20/d26/d30/f36 x:0 0 0 2024-01-17T23:32:30.026 INFO:tasks.workunit.client.0.smithi161.stdout:1/163: stat d1/d8/l1d 0 2024-01-17T23:32:30.026 INFO:tasks.workunit.client.0.smithi161.stdout:1/164: fsync d1/d8/d1f/f25 0 2024-01-17T23:32:30.026 INFO:tasks.workunit.client.0.smithi161.stdout:2/120: write d8/d1c/f1f [463651,75153] 0 2024-01-17T23:32:30.062 INFO:tasks.workunit.client.0.smithi161.stdout:2/121: dwrite d8/f18 [0,4194304] 0 2024-01-17T23:32:30.093 INFO:tasks.workunit.client.0.smithi161.stdout:2/122: dwrite d8/d1c/f24 [0,4194304] 0 2024-01-17T23:32:30.527 INFO:tasks.workunit.client.0.smithi161.stdout:7/157: rename f4 to da/d20/d3b/d3d/f40 0 2024-01-17T23:32:30.554 INFO:tasks.workunit.client.0.smithi161.stdout:7/158: dwrite da/fc [0,4194304] 0 2024-01-17T23:32:31.086 INFO:tasks.workunit.client.0.smithi161.stdout:1/165: unlink d1/d11/l1a 0 2024-01-17T23:32:32.526 INFO:tasks.workunit.client.0.smithi161.stdout:6/143: truncate d6/d7/f8 1964158 0 2024-01-17T23:32:33.250 INFO:tasks.workunit.client.0.smithi161.stdout:5/129: write dd/d15/f1b [4508256,25157] 0 2024-01-17T23:32:33.257 INFO:tasks.workunit.client.0.smithi161.stdout:5/130: dread f8 [4194304,4194304] 0 2024-01-17T23:32:33.280 INFO:tasks.workunit.client.0.smithi161.stdout:8/93: sync 2024-01-17T23:32:33.280 INFO:tasks.workunit.client.0.smithi161.stdout:0/158: sync 2024-01-17T23:32:33.280 INFO:tasks.workunit.client.0.smithi161.stdout:9/103: sync 2024-01-17T23:32:33.280 INFO:tasks.workunit.client.0.smithi161.stdout:0/159: chown d5/f25 0 1 2024-01-17T23:32:33.281 INFO:tasks.workunit.client.0.smithi161.stdout:9/104: fdatasync d0/d8/f1f 0 2024-01-17T23:32:33.303 INFO:tasks.workunit.client.0.smithi161.stdout:9/105: write d0/d8/d14/f1b [2975905,94229] 0 2024-01-17T23:32:33.313 INFO:tasks.workunit.client.0.smithi161.stdout:3/136: dwrite d0/d5/f1d [0,4194304] 0 2024-01-17T23:32:33.485 INFO:tasks.workunit.client.0.smithi161.stdout:4/149: write d9/fc [237403,8908] 0 2024-01-17T23:32:33.573 INFO:tasks.workunit.client.0.smithi161.stdout:8/94: mkdir d1/df/d1e 0 2024-01-17T23:32:33.745 INFO:tasks.workunit.client.0.smithi161.stdout:0/160: creat d5/d8/d11/d20/d2b/f33 x:0 0 0 2024-01-17T23:32:33.773 INFO:tasks.workunit.client.0.smithi161.stdout:0/161: dwrite d5/d8/d11/d12/f1d [0,4194304] 0 2024-01-17T23:32:33.773 INFO:tasks.workunit.client.0.smithi161.stdout:0/162: stat d5/d8/f19 0 2024-01-17T23:32:33.774 INFO:tasks.workunit.client.0.smithi161.stdout:0/163: chown d5/d8/d11/d12/f1d 533317636 1 2024-01-17T23:32:34.196 INFO:tasks.workunit.client.0.smithi161.stdout:4/150: unlink d9/de/d1e/f21 0 2024-01-17T23:32:34.196 INFO:tasks.workunit.client.0.smithi161.stdout:9/106: mknod d0/d8/d14/d18/c22 0 2024-01-17T23:32:34.196 INFO:tasks.workunit.client.0.smithi161.stdout:4/151: write d9/fc [607774,15735] 0 2024-01-17T23:32:34.196 INFO:tasks.workunit.client.0.smithi161.stdout:9/107: write d0/d8/d14/fe [1886693,101746] 0 2024-01-17T23:32:34.317 INFO:tasks.workunit.client.0.smithi161.stdout:8/95: link d1/ca d1/df/d16/c1f 0 2024-01-17T23:32:34.661 INFO:tasks.workunit.client.0.smithi161.stdout:9/108: rmdir d0/d8/d14 39 2024-01-17T23:32:34.686 INFO:tasks.workunit.client.0.smithi161.stdout:9/109: dwrite d0/f4 [0,4194304] 0 2024-01-17T23:32:34.706 INFO:tasks.workunit.client.0.smithi161.stdout:4/152: write d9/de/f14 [1983080,84407] 0 2024-01-17T23:32:34.733 INFO:tasks.workunit.client.0.smithi161.stdout:4/153: dwrite d9/de/f1d [0,4194304] 0 2024-01-17T23:32:34.900 INFO:tasks.workunit.client.0.smithi161.stdout:7/159: truncate da/d14/f32 1085955 0 2024-01-17T23:32:35.101 INFO:tasks.workunit.client.0.smithi161.stdout:2/123: sync 2024-01-17T23:32:35.399 INFO:tasks.workunit.client.0.smithi161.stdout:7/160: mkdir da/d14/d35/d41 0 2024-01-17T23:32:35.400 INFO:tasks.workunit.client.0.smithi161.stdout:4/154: mknod d9/de/c26 0 2024-01-17T23:32:35.400 INFO:tasks.workunit.client.0.smithi161.stdout:7/161: write da/d14/f24 [440040,18491] 0 2024-01-17T23:32:35.431 INFO:tasks.workunit.client.0.smithi161.stdout:7/162: dwrite f8 [0,4194304] 0 2024-01-17T23:32:35.431 INFO:tasks.workunit.client.0.smithi161.stdout:7/163: write da/f15 [2261829,19764] 0 2024-01-17T23:32:35.463 INFO:tasks.workunit.client.0.smithi161.stdout:7/164: dwrite da/d14/f24 [0,4194304] 0 2024-01-17T23:32:35.482 INFO:tasks.workunit.client.0.smithi161.stdout:7/165: write da/d14/f24 [1903462,70029] 0 2024-01-17T23:32:35.482 INFO:tasks.workunit.client.0.smithi161.stdout:7/166: stat da/d14/f18 0 2024-01-17T23:32:35.558 INFO:tasks.workunit.client.0.smithi161.stdout:2/124: mknod d8/d1c/c30 0 2024-01-17T23:32:35.582 INFO:tasks.workunit.client.0.smithi161.stdout:2/125: dwrite d8/f14 [0,4194304] 0 2024-01-17T23:32:35.685 INFO:tasks.workunit.client.0.smithi161.stdout:6/144: fsync d6/d7/f8 0 2024-01-17T23:32:35.794 INFO:tasks.workunit.client.0.smithi161.stdout:7/167: stat da/d20/d28/c33 0 2024-01-17T23:32:35.794 INFO:tasks.workunit.client.0.smithi161.stdout:7/168: creat da/d20/d28/f42 x:0 0 0 2024-01-17T23:32:35.929 INFO:tasks.workunit.client.0.smithi161.stdout:4/155: mkdir d9/d27 0 2024-01-17T23:32:36.088 INFO:tasks.workunit.client.0.smithi161.stdout:2/126: creat d8/d1c/f31 x:0 0 0 2024-01-17T23:32:36.088 INFO:tasks.workunit.client.0.smithi161.stdout:6/145: creat d6/d7/dc/f2c x:0 0 0 2024-01-17T23:32:36.088 INFO:tasks.workunit.client.0.smithi161.stdout:2/127: write d8/da/f27 [1041888,80076] 0 2024-01-17T23:32:36.102 INFO:tasks.workunit.client.0.smithi161.stdout:6/146: write d6/d7/fe [2991607,61726] 0 2024-01-17T23:32:36.106 INFO:tasks.workunit.client.0.smithi161.stdout:6/147: dread d6/d9/d13/f22 [0,4194304] 0 2024-01-17T23:32:36.106 INFO:tasks.workunit.client.0.smithi161.stdout:6/148: dread - d6/d9/d13/f1c zero size 2024-01-17T23:32:36.283 INFO:tasks.workunit.client.0.smithi161.stdout:1/166: creat d1/d20/f37 x:0 0 0 2024-01-17T23:32:36.284 INFO:tasks.workunit.client.0.smithi161.stdout:1/167: write d1/ff [465643,45605] 0 2024-01-17T23:32:37.162 INFO:tasks.workunit.client.0.smithi161.stdout:2/128: mknod d8/d1c/d1e/d23/c32 0 2024-01-17T23:32:37.293 INFO:tasks.workunit.client.0.smithi161.stdout:6/149: symlink d6/d9/l2d 0 2024-01-17T23:32:37.711 INFO:tasks.workunit.client.0.smithi161.stdout:2/129: creat d8/da/d2d/f33 x:0 0 0 2024-01-17T23:32:37.740 INFO:tasks.workunit.client.0.smithi161.stdout:2/130: dwrite d8/f18 [0,4194304] 0 2024-01-17T23:32:37.764 INFO:tasks.workunit.client.0.smithi161.stdout:2/131: dwrite d8/d1c/f1f [0,4194304] 0 2024-01-17T23:32:38.103 INFO:tasks.workunit.client.0.smithi161.stdout:8/96: dwrite d1/df/f15 [0,4194304] 0 2024-01-17T23:32:38.388 INFO:tasks.workunit.client.0.smithi161.stdout:2/132: mkdir d8/da/d2d/d34 0 2024-01-17T23:32:38.421 INFO:tasks.workunit.client.0.smithi161.stdout:2/133: dwrite d8/da/f10 [0,4194304] 0 2024-01-17T23:32:38.640 INFO:tasks.workunit.client.0.smithi161.stdout:8/97: mkdir d1/df/d20 0 2024-01-17T23:32:38.670 INFO:tasks.workunit.client.0.smithi161.stdout:8/98: dwrite d1/d3/f18 [0,4194304] 0 2024-01-17T23:32:38.708 INFO:tasks.workunit.client.0.smithi161.stdout:8/99: dwrite d1/df/f14 [0,4194304] 0 2024-01-17T23:32:38.779 INFO:tasks.workunit.client.0.smithi161.stdout:2/134: stat d8/d1c/d1e/l20 0 2024-01-17T23:32:38.779 INFO:tasks.workunit.client.0.smithi161.stdout:9/110: truncate d0/d8/d14/fe 2297248 0 2024-01-17T23:32:38.792 INFO:tasks.workunit.client.0.smithi161.stdout:2/135: dread d8/f18 [0,4194304] 0 2024-01-17T23:32:38.792 INFO:tasks.workunit.client.0.smithi161.stdout:2/136: chown d8/da/l19 52420 1 2024-01-17T23:32:38.794 INFO:tasks.workunit.client.0.smithi161.stdout:9/111: dread d0/f4 [0,4194304] 0 2024-01-17T23:32:39.063 INFO:tasks.workunit.client.0.smithi161.stdout:4/156: getdents d9 0 2024-01-17T23:32:39.067 INFO:tasks.workunit.client.0.smithi161.stdout:4/157: dread d9/fc [0,4194304] 0 2024-01-17T23:32:39.079 INFO:tasks.workunit.client.0.smithi161.stdout:4/158: dread f7 [0,4194304] 0 2024-01-17T23:32:39.340 INFO:tasks.workunit.client.0.smithi161.stdout:8/100: creat d1/d3/d19/f21 x:0 0 0 2024-01-17T23:32:39.432 INFO:tasks.workunit.client.0.smithi161.stdout:9/112: truncate d0/d8/d14/d18/f1d 3360651 0 2024-01-17T23:32:39.648 INFO:tasks.workunit.client.0.smithi161.stdout:0/164: rename d5/d8/d11 to d5/d34 0 2024-01-17T23:32:39.782 INFO:tasks.workunit.client.0.smithi161.stdout:4/159: mknod d9/de/d1e/c28 0 2024-01-17T23:32:39.783 INFO:tasks.workunit.client.0.smithi161.stdout:4/160: fsync f4 0 2024-01-17T23:32:39.783 INFO:tasks.workunit.client.0.smithi161.stdout:4/161: chown d9/f13 0 1 2024-01-17T23:32:39.926 INFO:tasks.workunit.client.0.smithi161.stdout:8/101: mkdir d1/d22 0 2024-01-17T23:32:40.105 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:32:40.109 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:32:40.279 INFO:tasks.workunit.client.0.smithi161.stdout:0/165: mkdir d5/d34/d12/d2a/d35 0 2024-01-17T23:32:40.279 INFO:tasks.workunit.client.0.smithi161.stdout:0/166: stat d5/d8/f29 0 2024-01-17T23:32:40.280 INFO:tasks.workunit.client.0.smithi161.stdout:3/137: symlink d0/d5/l25 0 2024-01-17T23:32:40.280 INFO:tasks.workunit.client.0.smithi161.stdout:3/138: dread - d0/f12 zero size 2024-01-17T23:32:40.280 INFO:tasks.workunit.client.0.smithi161.stdout:3/139: dread - d0/f12 zero size 2024-01-17T23:32:40.448 INFO:tasks.workunit.client.0.smithi161.stdout:5/131: unlink fb 0 2024-01-17T23:32:40.448 INFO:tasks.workunit.client.0.smithi161.stdout:5/132: truncate dd/d15/f22 715241 0 2024-01-17T23:32:40.448 INFO:tasks.workunit.client.0.smithi161.stdout:5/133: write f8 [2226470,42976] 0 2024-01-17T23:32:40.456 INFO:tasks.workunit.client.0.smithi161.stdout:5/134: dread dd/d15/f21 [0,4194304] 0 2024-01-17T23:32:40.570 INFO:tasks.workunit.client.0.smithi161.stdout:0/167: symlink d5/d34/d20/d2d/l36 0 2024-01-17T23:32:40.571 INFO:tasks.workunit.client.0.smithi161.stdout:0/168: chown d5/le 401 1 2024-01-17T23:32:40.571 INFO:tasks.workunit.client.0.smithi161.stdout:0/169: write d5/d2e/f31 [1054637,101384] 0 2024-01-17T23:32:40.677 INFO:tasks.workunit.client.0.smithi161.stdout:3/140: creat d0/d5/f26 x:0 0 0 2024-01-17T23:32:40.824 INFO:tasks.workunit.client.0.smithi161.stdout:5/135: link dd/f24 dd/d15/d1a/f27 0 2024-01-17T23:32:40.824 INFO:tasks.workunit.client.0.smithi161.stdout:5/136: write dd/d15/f23 [80574,130303] 0 2024-01-17T23:32:40.824 INFO:tasks.workunit.client.0.smithi161.stdout:5/137: creat dd/d15/d1a/f28 x:0 0 0 2024-01-17T23:32:40.835 INFO:tasks.workunit.client.0.smithi161.stdout:5/138: dread dd/ff [0,4194304] 0 2024-01-17T23:32:40.835 INFO:tasks.workunit.client.0.smithi161.stdout:5/139: write dd/d15/f23 [279686,34805] 0 2024-01-17T23:32:40.835 INFO:tasks.workunit.client.0.smithi161.stdout:5/140: write dd/d15/f1d [761109,30036] 0 2024-01-17T23:32:40.867 INFO:tasks.workunit.client.0.smithi161.stdout:7/169: rename da/d1e to da/d20/d28/d43 0 2024-01-17T23:32:41.016 INFO:tasks.workunit.client.0.smithi161.stdout:0/170: creat d5/d34/d12/f37 x:0 0 0 2024-01-17T23:32:41.111 INFO:tasks.workunit.client.0.smithi161.stdout:3/141: symlink d0/d5/d9/d1e/l27 0 2024-01-17T23:32:41.111 INFO:tasks.workunit.client.0.smithi161.stdout:3/142: chown d0/d5/d9/c11 153 1 2024-01-17T23:32:41.213 INFO:tasks.workunit.client.0.smithi161.stdout:1/168: creat d1/f38 x:0 0 0 2024-01-17T23:32:41.237 INFO:tasks.workunit.client.0.smithi161.stdout:1/169: dwrite d1/d8/fc [0,4194304] 0 2024-01-17T23:32:41.427 INFO:tasks.workunit.client.0.smithi161.stdout:5/141: mknod dd/d15/d1a/c29 0 2024-01-17T23:32:41.459 INFO:tasks.workunit.client.0.smithi161.stdout:5/142: dwrite dd/ff [0,4194304] 0 2024-01-17T23:32:41.611 INFO:tasks.workunit.client.0.smithi161.stdout:7/170: mkdir da/d20/d3b/d44 0 2024-01-17T23:32:41.611 INFO:tasks.workunit.client.0.smithi161.stdout:7/171: fsync da/f2c 0 2024-01-17T23:32:41.743 INFO:tasks.workunit.client.0.smithi161.stdout:2/137: rename d8/d1c/d1e/d23 to d8/da/d2d/d34/d35 0 2024-01-17T23:32:41.743 INFO:tasks.workunit.client.0.smithi161.stdout:2/138: write d8/d1c/f25 [65173,126607] 0 2024-01-17T23:32:41.743 INFO:tasks.workunit.client.0.smithi161.stdout:2/139: fsync d8/f18 0 2024-01-17T23:32:41.748 INFO:tasks.workunit.client.0.smithi161.stdout:2/140: dread d8/da/f27 [0,4194304] 0 2024-01-17T23:32:41.836 INFO:tasks.workunit.client.0.smithi161.stdout:0/171: creat d5/d34/d12/d2a/f38 x:0 0 0 2024-01-17T23:32:41.879 INFO:tasks.workunit.client.0.smithi161.stdout:0/172: dwrite d5/d8/f9 [0,4194304] 0 2024-01-17T23:32:43.438 INFO:tasks.workunit.client.0.smithi161.stdout:7/172: creat da/d20/d28/d2b/f45 x:0 0 0 2024-01-17T23:32:43.439 INFO:tasks.workunit.client.0.smithi161.stdout:7/173: truncate da/db/f13 811459 0 2024-01-17T23:32:43.736 INFO:tasks.workunit.client.0.smithi161.stdout:0/173: symlink d5/d34/d12/d2a/l39 0 2024-01-17T23:32:43.736 INFO:tasks.workunit.client.0.smithi161.stdout:0/174: fdatasync d5/d34/d12/f1d 0 2024-01-17T23:32:43.905 INFO:tasks.workunit.client.0.smithi161.stdout:4/162: getdents d9/de/d1e 0 2024-01-17T23:32:43.905 INFO:tasks.workunit.client.0.smithi161.stdout:3/143: link d0/d5/c14 d0/d5/c28 0 2024-01-17T23:32:43.914 INFO:tasks.workunit.client.0.smithi161.stdout:4/163: dread f0 [0,4194304] 0 2024-01-17T23:32:43.914 INFO:tasks.workunit.client.0.smithi161.stdout:4/164: chown d9/fb 25869718 1 2024-01-17T23:32:43.914 INFO:tasks.workunit.client.0.smithi161.stdout:4/165: chown d9/de/c26 1045 1 2024-01-17T23:32:44.026 INFO:tasks.workunit.client.0.smithi161.stdout:1/170: getdents d1/d8/d1f 0 2024-01-17T23:32:44.026 INFO:tasks.workunit.client.0.smithi161.stdout:1/171: dread - d1/d20/f37 zero size 2024-01-17T23:32:44.026 INFO:tasks.workunit.client.0.smithi161.stdout:1/172: write d1/f3 [1325780,63738] 0 2024-01-17T23:32:44.145 INFO:tasks.workunit.client.0.smithi161.stdout:7/174: symlink da/d20/d3b/d44/l46 0 2024-01-17T23:32:44.145 INFO:tasks.workunit.client.0.smithi161.stdout:7/175: fdatasync da/f26 0 2024-01-17T23:32:44.671 INFO:tasks.workunit.client.0.smithi161.stdout:4/166: symlink d9/de/d1e/l29 0 2024-01-17T23:32:44.672 INFO:tasks.workunit.client.0.smithi161.stdout:3/144: creat d0/f29 x:0 0 0 2024-01-17T23:32:44.672 INFO:tasks.workunit.client.0.smithi161.stdout:3/145: chown d0/d5/c14 0 1 2024-01-17T23:32:44.713 INFO:tasks.workunit.client.0.smithi161.stdout:7/176: mknod da/d20/d28/d43/c47 0 2024-01-17T23:32:44.713 INFO:tasks.workunit.client.0.smithi161.stdout:1/173: creat d1/d8/d1c/f39 x:0 0 0 2024-01-17T23:32:44.713 INFO:tasks.workunit.client.0.smithi161.stdout:7/177: fsync f8 0 2024-01-17T23:32:44.713 INFO:tasks.workunit.client.0.smithi161.stdout:1/174: creat d1/f3a x:0 0 0 2024-01-17T23:32:44.723 INFO:tasks.workunit.client.0.smithi161.stdout:1/175: dread d1/d20/f2e [0,4194304] 0 2024-01-17T23:32:44.756 INFO:tasks.workunit.client.0.smithi161.stdout:1/176: dwrite d1/f18 [0,4194304] 0 2024-01-17T23:32:45.193 INFO:tasks.workunit.client.0.smithi161.stdout:6/150: sync 2024-01-17T23:32:45.193 INFO:tasks.workunit.client.0.smithi161.stdout:6/151: dread - d6/d7/dc/f2c zero size 2024-01-17T23:32:45.193 INFO:tasks.workunit.client.0.smithi161.stdout:6/152: fsync d6/d7/fe 0 2024-01-17T23:32:45.262 INFO:tasks.workunit.client.0.smithi161.stdout:9/113: link d0/c5 d0/d8/c23 0 2024-01-17T23:32:45.443 INFO:tasks.workunit.client.0.smithi161.stdout:4/167: symlink d9/de/d1e/l2a 0 2024-01-17T23:32:45.448 INFO:tasks.workunit.client.0.smithi161.stdout:4/168: read d9/fb [238622,32367] 0 2024-01-17T23:32:45.612 INFO:tasks.workunit.client.0.smithi161.stdout:7/178: link f8 da/d20/d3b/f48 0 2024-01-17T23:32:45.636 INFO:tasks.workunit.client.0.smithi161.stdout:7/179: write f8 [1915146,114765] 0 2024-01-17T23:32:45.921 INFO:tasks.workunit.client.0.smithi161.stdout:6/153: creat d6/d7/dc/d1d/f2e x:0 0 0 2024-01-17T23:32:45.922 INFO:tasks.workunit.client.0.smithi161.stdout:6/154: fdatasync d6/d9/d13/f28 0 2024-01-17T23:32:46.126 INFO:tasks.workunit.client.0.smithi161.stdout:4/169: dread d9/de/f1a [0,4194304] 0 2024-01-17T23:32:46.368 INFO:tasks.workunit.client.0.smithi161.stdout:7/180: symlink da/d14/l49 0 2024-01-17T23:32:46.589 INFO:tasks.workunit.client.0.smithi161.stdout:7/181: unlink da/db/l10 0 2024-01-17T23:32:46.604 INFO:tasks.workunit.client.0.smithi161.stdout:7/182: write da/fc [2275288,934] 0 2024-01-17T23:32:46.935 INFO:tasks.workunit.client.0.smithi161.stdout:7/183: mkdir da/d34/d4a 0 2024-01-17T23:32:47.394 INFO:tasks.workunit.client.0.smithi161.stdout:5/143: sync 2024-01-17T23:32:47.417 INFO:tasks.workunit.client.0.smithi161.stdout:5/144: dwrite dd/d15/f21 [0,4194304] 0 2024-01-17T23:32:48.267 INFO:tasks.workunit.client.0.smithi161.stdout:5/145: mknod dd/d15/d1a/c2a 0 2024-01-17T23:32:48.641 INFO:tasks.workunit.client.0.smithi161.stdout:4/170: unlink c3 0 2024-01-17T23:32:48.642 INFO:tasks.workunit.client.0.smithi161.stdout:8/102: rename d1/ca to d1/d3/d19/c23 0 2024-01-17T23:32:48.642 INFO:tasks.workunit.client.0.smithi161.stdout:4/171: stat d9/f10 0 2024-01-17T23:32:48.773 INFO:tasks.workunit.client.0.smithi161.stdout:5/146: symlink dd/d15/d1a/l2b 0 2024-01-17T23:32:49.031 INFO:tasks.workunit.client.0.smithi161.stdout:2/141: rename d8/c21 to d8/da/c36 0 2024-01-17T23:32:49.031 INFO:tasks.workunit.client.0.smithi161.stdout:2/142: chown d8/da/c36 0 1 2024-01-17T23:32:49.455 INFO:tasks.workunit.client.0.smithi161.stdout:2/143: creat d8/f37 x:0 0 0 2024-01-17T23:32:49.458 INFO:tasks.workunit.client.0.smithi161.stdout:0/175: sync 2024-01-17T23:32:49.458 INFO:tasks.workunit.client.0.smithi161.stdout:3/146: sync 2024-01-17T23:32:49.458 INFO:tasks.workunit.client.0.smithi161.stdout:3/147: write d0/f1f [1447051,78368] 0 2024-01-17T23:32:49.458 INFO:tasks.workunit.client.0.smithi161.stdout:3/148: fsync d0/f10 0 2024-01-17T23:32:49.483 INFO:tasks.workunit.client.0.smithi161.stdout:2/144: dwrite d8/d1c/f1f [0,4194304] 0 2024-01-17T23:32:49.508 INFO:tasks.workunit.client.0.smithi161.stdout:2/145: dwrite d8/d1c/f25 [0,4194304] 0 2024-01-17T23:32:49.662 INFO:tasks.workunit.client.0.smithi161.stdout:8/103: creat d1/d3/f24 x:0 0 0 2024-01-17T23:32:49.662 INFO:tasks.workunit.client.0.smithi161.stdout:8/104: fdatasync f0 0 2024-01-17T23:32:49.713 INFO:tasks.workunit.client.0.smithi161.stdout:4/172: dwrite d9/de/f1a [0,4194304] 0 2024-01-17T23:32:49.713 INFO:tasks.workunit.client.0.smithi161.stdout:4/173: write d9/fc [1073580,35484] 0 2024-01-17T23:32:49.849 INFO:tasks.workunit.client.0.smithi161.stdout:0/176: unlink d5/d8/f1a 0 2024-01-17T23:32:50.075 INFO:tasks.workunit.client.0.smithi161.stdout:5/147: sync 2024-01-17T23:32:50.075 INFO:tasks.workunit.client.0.smithi161.stdout:5/148: truncate dd/d15/d1a/f28 376880 0 2024-01-17T23:32:50.127 INFO:tasks.workunit.client.0.smithi161.stdout:5/149: dwrite dd/ff [0,4194304] 0 2024-01-17T23:32:50.152 INFO:tasks.workunit.client.0.smithi161.stdout:5/150: dwrite dd/ff [0,4194304] 0 2024-01-17T23:32:50.152 INFO:tasks.workunit.client.0.smithi161.stdout:5/151: write dd/d15/f23 [684455,62178] 0 2024-01-17T23:32:50.153 INFO:tasks.workunit.client.0.smithi161.stdout:5/152: stat dd/c1e 0 2024-01-17T23:32:50.153 INFO:tasks.workunit.client.0.smithi161.stdout:5/153: chown dd/f12 23 1 2024-01-17T23:32:50.198 INFO:tasks.workunit.client.0.smithi161.stdout:5/154: dwrite dd/d15/d1a/f27 [0,4194304] 0 2024-01-17T23:32:50.271 INFO:tasks.workunit.client.0.smithi161.stdout:4/174: rmdir d9/de/d1e 39 2024-01-17T23:32:50.275 INFO:tasks.workunit.client.0.smithi161.stdout:4/175: dread d9/fb [0,4194304] 0 2024-01-17T23:32:50.514 INFO:tasks.workunit.client.0.smithi161.stdout:1/177: rename d1/d8/d1e to d1/d2d/d3b 0 2024-01-17T23:32:50.514 INFO:tasks.workunit.client.0.smithi161.stdout:1/178: stat d1/d20/d26/d32 0 2024-01-17T23:32:50.533 INFO:tasks.workunit.client.0.smithi161.stdout:1/179: dread d1/d8/d1f/f25 [0,4194304] 0 2024-01-17T23:32:50.541 INFO:tasks.workunit.client.0.smithi161.stdout:2/146: dwrite d8/d1c/d1e/f2a [0,4194304] 0 2024-01-17T23:32:50.541 INFO:tasks.workunit.client.0.smithi161.stdout:2/147: dread - d8/d1c/f31 zero size 2024-01-17T23:32:50.553 INFO:tasks.workunit.client.0.smithi161.stdout:1/180: dread d1/d8/d1f/f28 [4194304,4194304] 0 2024-01-17T23:32:50.573 INFO:tasks.workunit.client.0.smithi161.stdout:2/148: write d8/d1c/f25 [4132440,120280] 0 2024-01-17T23:32:50.573 INFO:tasks.workunit.client.0.smithi161.stdout:2/149: write d8/da/f27 [1106208,22831] 0 2024-01-17T23:32:50.585 INFO:tasks.workunit.client.0.smithi161.stdout:1/181: dwrite d1/d2d/d3b/f34 [0,4194304] 0 2024-01-17T23:32:50.589 INFO:tasks.workunit.client.0.smithi161.stdout:2/150: dread d8/f14 [0,4194304] 0 2024-01-17T23:32:50.606 INFO:tasks.workunit.client.0.smithi161.stdout:2/151: dread d8/da/f10 [0,4194304] 0 2024-01-17T23:32:50.649 INFO:tasks.workunit.client.0.smithi161.stdout:2/152: dwrite d8/d1c/f25 [0,4194304] 0 2024-01-17T23:32:50.649 INFO:tasks.workunit.client.0.smithi161.stdout:2/153: dread - d8/f37 zero size 2024-01-17T23:32:50.664 INFO:tasks.workunit.client.0.smithi161.stdout:5/155: symlink dd/d15/d1a/l2c 0 2024-01-17T23:32:50.666 INFO:tasks.workunit.client.0.smithi161.stdout:5/156: dread dd/d15/d1a/f28 [0,4194304] 0 2024-01-17T23:32:50.666 INFO:tasks.workunit.client.0.smithi161.stdout:5/157: chown dd/d15/d1a/d20/l26 759428341 1 2024-01-17T23:32:50.670 INFO:tasks.workunit.client.0.smithi161.stdout:2/154: write d8/d1c/d1e/f2a [3436017,108990] 0 2024-01-17T23:32:50.823 INFO:tasks.workunit.client.0.smithi161.stdout:4/176: creat d9/de/f2b x:0 0 0 2024-01-17T23:32:50.825 INFO:tasks.workunit.client.0.smithi161.stdout:4/177: write d9/fc [43315,74865] 0 2024-01-17T23:32:50.825 INFO:tasks.workunit.client.0.smithi161.stdout:4/178: creat d9/de/f2c x:0 0 0 2024-01-17T23:32:50.991 INFO:tasks.workunit.client.0.smithi161.stdout:0/177: getdents d5/d2e 0 2024-01-17T23:32:50.991 INFO:tasks.workunit.client.0.smithi161.stdout:9/114: rename d0/d8/c15 to d0/c24 0 2024-01-17T23:32:50.991 INFO:tasks.workunit.client.0.smithi161.stdout:9/115: readlink d0/d8/d14/d18/l1e 0 2024-01-17T23:32:50.991 INFO:tasks.workunit.client.0.smithi161.stdout:9/116: fsync d0/d8/d14/d18/f1d 0 2024-01-17T23:32:51.190 INFO:tasks.workunit.client.0.smithi161.stdout:1/182: truncate d1/ff 177908 0 2024-01-17T23:32:51.295 INFO:tasks.workunit.client.0.smithi161.stdout:2/155: truncate d8/da/f10 3366949 0 2024-01-17T23:32:51.530 INFO:tasks.workunit.client.0.smithi161.stdout:4/179: symlink d9/de/d1e/l2d 0 2024-01-17T23:32:51.627 INFO:tasks.workunit.client.0.smithi161.stdout:0/178: mkdir d5/d3a 0 2024-01-17T23:32:51.627 INFO:tasks.workunit.client.0.smithi161.stdout:0/179: fdatasync d5/f32 0 2024-01-17T23:32:51.627 INFO:tasks.workunit.client.0.smithi161.stdout:0/180: write f0 [2434568,34864] 0 2024-01-17T23:32:51.780 INFO:tasks.workunit.client.0.smithi161.stdout:6/155: rename d6/d7/dc/f2c to d6/f2f 0 2024-01-17T23:32:51.780 INFO:tasks.workunit.client.0.smithi161.stdout:6/156: chown d6/d9/d1a/l1b 227 1 2024-01-17T23:32:52.408 INFO:tasks.workunit.client.0.smithi161.stdout:1/183: mknod d1/d20/d26/d32/c3c 0 2024-01-17T23:32:52.408 INFO:tasks.workunit.client.0.smithi161.stdout:9/117: truncate d0/d8/d14/fe 570364 0 2024-01-17T23:32:52.408 INFO:tasks.workunit.client.0.smithi161.stdout:2/156: creat d8/d1c/d1e/f38 x:0 0 0 2024-01-17T23:32:52.412 INFO:tasks.workunit.client.0.smithi161.stdout:4/180: link d9/de/f1d d9/d1b/d24/f2e 0 2024-01-17T23:32:52.412 INFO:tasks.workunit.client.0.smithi161.stdout:4/181: dread - d9/f10 zero size 2024-01-17T23:32:52.412 INFO:tasks.workunit.client.0.smithi161.stdout:0/181: creat d5/d34/d21/f3b x:0 0 0 2024-01-17T23:32:52.412 INFO:tasks.workunit.client.0.smithi161.stdout:0/182: write f2 [3911390,20422] 0 2024-01-17T23:32:52.413 INFO:tasks.workunit.client.0.smithi161.stdout:0/183: stat d5/d2e 0 2024-01-17T23:32:52.421 INFO:tasks.workunit.client.0.smithi161.stdout:1/184: write d1/d11/f22 [1289249,63764] 0 2024-01-17T23:32:52.562 INFO:tasks.workunit.client.0.smithi161.stdout:7/184: rename da/d14/d35/f3a to da/d20/d3b/f4b 0 2024-01-17T23:32:52.627 INFO:tasks.workunit.client.0.smithi161.stdout:6/157: rmdir d6/d9 39 2024-01-17T23:32:52.656 INFO:tasks.workunit.client.0.smithi161.stdout:6/158: dwrite d6/d7/d16/f21 [0,4194304] 0 2024-01-17T23:32:52.656 INFO:tasks.workunit.client.0.smithi161.stdout:6/159: dread - d6/d9/d13/f1c zero size 2024-01-17T23:32:53.057 INFO:tasks.workunit.client.0.smithi161.stdout:9/118: creat d0/d8/d14/f25 x:0 0 0 2024-01-17T23:32:53.110 INFO:tasks.workunit.client.0.smithi161.stdout:9/119: dwrite d0/d8/d14/f1b [0,4194304] 0 2024-01-17T23:32:53.110 INFO:tasks.workunit.client.0.smithi161.stdout:9/120: fdatasync d0/d8/d14/f25 0 2024-01-17T23:32:53.322 INFO:tasks.workunit.client.0.smithi161.stdout:4/182: truncate d9/d1b/d24/f2e 1209950 0 2024-01-17T23:32:53.472 INFO:tasks.workunit.client.0.smithi161.stdout:0/184: creat d5/d8/f3c x:0 0 0 2024-01-17T23:32:53.472 INFO:tasks.workunit.client.0.smithi161.stdout:0/185: dread - d5/d34/d20/f2f zero size 2024-01-17T23:32:53.486 INFO:tasks.workunit.client.0.smithi161.stdout:0/186: read d5/d8/f29 [3191803,123110] 0 2024-01-17T23:32:53.486 INFO:tasks.workunit.client.0.smithi161.stdout:0/187: write d5/d34/d21/f3b [392945,74887] 0 2024-01-17T23:32:53.487 INFO:tasks.workunit.client.0.smithi161.stdout:0/188: creat d5/d34/d21/f3d x:0 0 0 2024-01-17T23:32:53.520 INFO:tasks.workunit.client.0.smithi161.stdout:0/189: dwrite d5/d8/f19 [0,4194304] 0 2024-01-17T23:32:53.690 INFO:tasks.workunit.client.0.smithi161.stdout:1/185: link d1/d8/d1f/l29 d1/d2d/l3d 0 2024-01-17T23:32:53.690 INFO:tasks.workunit.client.0.smithi161.stdout:1/186: dread - d1/d20/f37 zero size 2024-01-17T23:32:54.201 INFO:tasks.workunit.client.0.smithi161.stdout:3/149: rename d0/d5/d9/c24 to d0/d5/d9/d17/c2a 0 2024-01-17T23:32:54.207 INFO:tasks.workunit.client.0.smithi161.stdout:6/160: symlink d6/d7/d16/l30 0 2024-01-17T23:32:54.216 INFO:tasks.workunit.client.0.smithi161.stdout:3/150: dread d0/f4 [0,4194304] 0 2024-01-17T23:32:56.047 INFO:tasks.workunit.client.0.smithi161.stdout:0/190: mknod d5/d34/d12/d2a/c3e 0 2024-01-17T23:32:56.307 INFO:tasks.workunit.client.0.smithi161.stdout:8/105: rename d1/df/d1e to d1/d3/d19/d1d/d25 0 2024-01-17T23:32:56.330 INFO:tasks.workunit.client.0.smithi161.stdout:8/106: write d1/df/f15 [3119048,51876] 0 2024-01-17T23:32:56.422 INFO:tasks.workunit.client.0.smithi161.stdout:2/157: rmdir d8/d2e 39 2024-01-17T23:32:56.422 INFO:tasks.workunit.client.0.smithi161.stdout:2/158: write d8/da/d2d/f33 [869963,230] 0 2024-01-17T23:32:56.455 INFO:tasks.workunit.client.0.smithi161.stdout:2/159: dwrite d8/d1c/d1e/f2a [0,4194304] 0 2024-01-17T23:32:56.747 INFO:tasks.workunit.client.0.smithi161.stdout:9/121: rmdir d0/d8/d14 39 2024-01-17T23:32:56.857 INFO:tasks.workunit.client.0.smithi161.stdout:0/191: mknod d5/d3a/c3f 0 2024-01-17T23:32:57.302 INFO:tasks.workunit.client.0.smithi161.stdout:5/158: rename dd/d15/d1a/d20 to dd/d2d 0 2024-01-17T23:32:57.333 INFO:tasks.workunit.client.0.smithi161.stdout:5/159: dwrite dd/d15/f19 [0,4194304] 0 2024-01-17T23:32:57.337 INFO:tasks.workunit.client.0.smithi161.stdout:5/160: dread dd/d15/f1d [0,4194304] 0 2024-01-17T23:32:57.338 INFO:tasks.workunit.client.0.smithi161.stdout:5/161: fdatasync dd/d15/f21 0 2024-01-17T23:32:57.338 INFO:tasks.workunit.client.0.smithi161.stdout:5/162: chown dd/d15/d1a/l2b 18259 1 2024-01-17T23:32:57.475 INFO:tasks.workunit.client.0.smithi161.stdout:3/151: mknod d0/c2b 0 2024-01-17T23:32:57.713 INFO:tasks.workunit.client.0.smithi161.stdout:2/160: symlink d8/da/d2d/d34/l39 0 2024-01-17T23:32:57.826 INFO:tasks.workunit.client.0.smithi161.stdout:0/192: truncate d5/d34/d12/f28 3970667 0 2024-01-17T23:32:57.826 INFO:tasks.workunit.client.0.smithi161.stdout:0/193: write f0 [2881282,23559] 0 2024-01-17T23:32:57.863 INFO:tasks.workunit.client.0.smithi161.stdout:0/194: dwrite d5/d8/f1f [4194304,4194304] 0 2024-01-17T23:32:57.897 INFO:tasks.workunit.client.0.smithi161.stdout:0/195: dwrite d5/fb [0,4194304] 0 2024-01-17T23:32:57.897 INFO:tasks.workunit.client.0.smithi161.stdout:0/196: dread - d5/d34/d12/f37 zero size 2024-01-17T23:32:57.923 INFO:tasks.workunit.client.0.smithi161.stdout:0/197: dwrite d5/d34/d12/f37 [0,4194304] 0 2024-01-17T23:32:58.065 INFO:tasks.workunit.client.0.smithi161.stdout:7/185: rename da/d20/d3b/d44 to da/d34/d4a/d4c 0 2024-01-17T23:32:58.089 INFO:tasks.workunit.client.0.smithi161.stdout:4/183: sync 2024-01-17T23:32:58.089 INFO:tasks.workunit.client.0.smithi161.stdout:4/184: truncate d9/de/f2b 255952 0 2024-01-17T23:32:58.090 INFO:tasks.workunit.client.0.smithi161.stdout:4/185: chown d9/d1b/c22 6754 1 2024-01-17T23:32:58.297 INFO:tasks.workunit.client.0.smithi161.stdout:3/152: unlink d0/d5/l23 0 2024-01-17T23:32:58.301 INFO:tasks.workunit.client.0.smithi161.stdout:2/161: mkdir d8/da/d2d/d34/d35/d3a 0 2024-01-17T23:32:58.301 INFO:tasks.workunit.client.0.smithi161.stdout:2/162: write d8/d1c/f24 [5002487,15019] 0 2024-01-17T23:32:58.325 INFO:tasks.workunit.client.0.smithi161.stdout:3/153: dwrite d0/f12 [0,4194304] 0 2024-01-17T23:32:58.441 INFO:tasks.workunit.client.0.smithi161.stdout:1/187: sync 2024-01-17T23:32:58.610 INFO:tasks.workunit.client.0.smithi161.stdout:6/161: sync 2024-01-17T23:32:58.610 INFO:tasks.workunit.client.0.smithi161.stdout:6/162: chown d6/d7/c12 1585 1 2024-01-17T23:32:58.610 INFO:tasks.workunit.client.0.smithi161.stdout:6/163: truncate d6/d9/d13/f1c 303894 0 2024-01-17T23:32:59.236 INFO:tasks.workunit.client.0.smithi161.stdout:8/107: rename d1/df/d16/c1f to d1/df/d20/c26 0 2024-01-17T23:32:59.421 INFO:tasks.workunit.client.0.smithi161.stdout:7/186: unlink da/d14/l22 0 2024-01-17T23:32:59.421 INFO:tasks.workunit.client.0.smithi161.stdout:7/187: write da/d20/d28/d2b/f45 [683242,65383] 0 2024-01-17T23:32:59.421 INFO:tasks.workunit.client.0.smithi161.stdout:7/188: dread - da/d20/d28/f39 zero size 2024-01-17T23:32:59.543 INFO:tasks.workunit.client.0.smithi161.stdout:4/186: creat d9/d1b/d24/d25/f2f x:0 0 0 2024-01-17T23:32:59.574 INFO:tasks.workunit.client.0.smithi161.stdout:4/187: dwrite d9/ff [0,4194304] 0 2024-01-17T23:32:59.592 INFO:tasks.workunit.client.0.smithi161.stdout:4/188: dread f4 [0,4194304] 0 2024-01-17T23:32:59.592 INFO:tasks.workunit.client.0.smithi161.stdout:4/189: truncate d9/fb 1909608 0 2024-01-17T23:32:59.799 INFO:tasks.workunit.client.0.smithi161.stdout:2/163: rmdir d8/d1c 39 2024-01-17T23:32:59.810 INFO:tasks.workunit.client.0.smithi161.stdout:2/164: read d8/f18 [3447934,26662] 0 2024-01-17T23:33:00.248 INFO:tasks.workunit.client.0.smithi161.stdout:1/188: mkdir d1/d8/d1c/d3e 0 2024-01-17T23:33:00.248 INFO:tasks.workunit.client.0.smithi161.stdout:9/122: write d0/d8/d14/fe [189985,83358] 0 2024-01-17T23:33:00.248 INFO:tasks.workunit.client.0.smithi161.stdout:6/164: mkdir d6/d9/d31 0 2024-01-17T23:33:00.296 INFO:tasks.workunit.client.0.smithi161.stdout:1/189: dwrite d1/f3a [0,4194304] 0 2024-01-17T23:33:00.296 INFO:tasks.workunit.client.0.smithi161.stdout:1/190: creat d1/d20/d26/d30/f3f x:0 0 0 2024-01-17T23:33:00.438 INFO:tasks.workunit.client.0.smithi161.stdout:8/108: creat d1/d3/d19/d1d/f27 x:0 0 0 2024-01-17T23:33:00.464 INFO:tasks.workunit.client.0.smithi161.stdout:8/109: dread d1/df/f15 [0,4194304] 0 2024-01-17T23:33:00.464 INFO:tasks.workunit.client.0.smithi161.stdout:8/110: write d1/d3/f9 [4958773,101939] 0 2024-01-17T23:33:00.708 INFO:tasks.workunit.client.0.smithi161.stdout:7/189: rename da/d34/d4a/d4c/l46 to da/d34/l4d 0 2024-01-17T23:33:00.999 INFO:tasks.workunit.client.0.smithi161.stdout:4/190: dread d9/d1b/d24/f2e [0,4194304] 0 2024-01-17T23:33:01.178 INFO:tasks.workunit.client.0.smithi161.stdout:2/165: rmdir d8/d1c 39 2024-01-17T23:33:01.178 INFO:tasks.workunit.client.0.smithi161.stdout:3/154: symlink d0/l2c 0 2024-01-17T23:33:01.183 INFO:tasks.workunit.client.0.smithi161.stdout:2/166: write d8/da/f27 [763712,86158] 0 2024-01-17T23:33:01.518 INFO:tasks.workunit.client.0.smithi161.stdout:9/123: rmdir d0/d8/d14/d18/d20 39 2024-01-17T23:33:01.518 INFO:tasks.workunit.client.0.smithi161.stdout:6/165: symlink d6/d9/d31/l32 0 2024-01-17T23:33:02.001 INFO:tasks.workunit.client.0.smithi161.stdout:8/111: mknod d1/d22/c28 0 2024-01-17T23:33:02.001 INFO:tasks.workunit.client.0.smithi161.stdout:8/112: chown d1/d3/d19/d1d/f27 1756 1 2024-01-17T23:33:02.001 INFO:tasks.workunit.client.0.smithi161.stdout:8/113: read - d1/d3/f24 zero size 2024-01-17T23:33:02.629 INFO:tasks.workunit.client.0.smithi161.stdout:9/124: creat d0/d8/d14/d18/d20/f26 x:0 0 0 2024-01-17T23:33:02.777 INFO:tasks.workunit.client.0.smithi161.stdout:7/190: unlink da/c12 0 2024-01-17T23:33:02.899 INFO:tasks.workunit.client.0.smithi161.stdout:1/191: symlink d1/l40 0 2024-01-17T23:33:03.879 INFO:tasks.workunit.client.0.smithi161.stdout:8/114: mknod d1/df/c29 0 2024-01-17T23:33:03.879 INFO:tasks.workunit.client.0.smithi161.stdout:8/115: dread - d1/d3/d19/f21 zero size 2024-01-17T23:33:04.006 INFO:tasks.workunit.client.0.smithi161.stdout:7/191: creat da/d34/d4a/d4c/f4e x:0 0 0 2024-01-17T23:33:04.164 INFO:tasks.workunit.client.0.smithi161.stdout:1/192: mkdir d1/d20/d26/d30/d41 0 2024-01-17T23:33:04.187 INFO:tasks.workunit.client.0.smithi161.stdout:1/193: write d1/d20/f2e [6313699,66461] 0 2024-01-17T23:33:04.207 INFO:tasks.workunit.client.0.smithi161.stdout:1/194: dread d1/f3a [0,4194304] 0 2024-01-17T23:33:04.207 INFO:tasks.workunit.client.0.smithi161.stdout:1/195: write d1/d20/d26/f2f [1820956,91206] 0 2024-01-17T23:33:04.285 INFO:tasks.workunit.client.0.smithi161.stdout:8/116: mkdir d1/df/d20/d2a 0 2024-01-17T23:33:04.452 INFO:tasks.workunit.client.0.smithi161.stdout:7/192: dread da/d14/f32 [0,4194304] 0 2024-01-17T23:33:04.468 INFO:tasks.workunit.client.0.smithi161.stdout:7/193: dread da/d20/f2f [0,4194304] 0 2024-01-17T23:33:04.569 INFO:tasks.workunit.client.0.smithi161.stdout:1/196: rename d1/l6 to d1/l42 0 2024-01-17T23:33:04.656 INFO:tasks.workunit.client.0.smithi161.stdout:8/117: creat d1/d1c/f2b x:0 0 0 2024-01-17T23:33:04.923 INFO:tasks.workunit.client.0.smithi161.stdout:7/194: link da/fc da/d34/f4f 0 2024-01-17T23:33:04.965 INFO:tasks.workunit.client.0.smithi161.stdout:4/191: rmdir d9/de 39 2024-01-17T23:33:04.965 INFO:tasks.workunit.client.0.smithi161.stdout:1/197: mknod d1/d8/d1f/c43 0 2024-01-17T23:33:04.966 INFO:tasks.workunit.client.0.smithi161.stdout:1/198: fsync d1/d20/f37 0 2024-01-17T23:33:05.215 INFO:tasks.workunit.client.0.smithi161.stdout:8/118: creat d1/d22/f2c x:0 0 0 2024-01-17T23:33:05.216 INFO:tasks.workunit.client.0.smithi161.stdout:5/163: creat dd/d15/f2e x:0 0 0 2024-01-17T23:33:05.216 INFO:tasks.workunit.client.0.smithi161.stdout:5/164: stat dd/d15/f2e 0 2024-01-17T23:33:05.218 INFO:tasks.workunit.client.0.smithi161.stdout:3/155: rmdir d0/d5/d9/d1e 39 2024-01-17T23:33:05.326 INFO:tasks.workunit.client.0.smithi161.stdout:0/198: unlink d5/f13 0 2024-01-17T23:33:05.357 INFO:tasks.workunit.client.0.smithi161.stdout:0/199: dwrite d5/d8/f3c [0,4194304] 0 2024-01-17T23:33:05.563 INFO:tasks.workunit.client.0.smithi161.stdout:7/195: mknod da/d20/d3b/d3d/c50 0 2024-01-17T23:33:05.773 INFO:tasks.workunit.client.0.smithi161.stdout:1/199: mkdir d1/d20/d26/d30/d44 0 2024-01-17T23:33:05.818 INFO:tasks.workunit.client.0.smithi161.stdout:1/200: dwrite d1/d11/f12 [0,4194304] 0 2024-01-17T23:33:05.836 INFO:tasks.workunit.client.0.smithi161.stdout:1/201: dread d1/f18 [0,4194304] 0 2024-01-17T23:33:05.877 INFO:tasks.workunit.client.0.smithi161.stdout:5/165: mknod dd/d2d/c2f 0 2024-01-17T23:33:05.878 INFO:tasks.workunit.client.0.smithi161.stdout:5/166: stat dd/d15/d1a 0 2024-01-17T23:33:05.878 INFO:tasks.workunit.client.0.smithi161.stdout:5/167: creat dd/d15/f30 x:0 0 0 2024-01-17T23:33:05.878 INFO:tasks.workunit.client.0.smithi161.stdout:5/168: fdatasync dd/d15/d1a/f28 0 2024-01-17T23:33:06.259 INFO:tasks.workunit.client.0.smithi161.stdout:0/200: rmdir d5/d2e 39 2024-01-17T23:33:06.271 INFO:tasks.workunit.client.0.smithi161.stdout:0/201: dread d5/d8/f3c [0,4194304] 0 2024-01-17T23:33:06.398 INFO:tasks.workunit.client.0.smithi161.stdout:7/196: creat da/f51 x:0 0 0 2024-01-17T23:33:07.403 INFO:tasks.workunit.client.0.smithi161.stdout:7/197: creat da/d34/f52 x:0 0 0 2024-01-17T23:33:07.415 INFO:tasks.workunit.client.0.smithi161.stdout:7/198: dread da/d20/d28/d43/f2e [0,4194304] 0 2024-01-17T23:33:07.798 INFO:tasks.workunit.client.0.smithi161.stdout:7/199: truncate da/f26 881197 0 2024-01-17T23:33:07.823 INFO:tasks.workunit.client.0.smithi161.stdout:7/200: dwrite da/d20/d28/f3e [0,4194304] 0 2024-01-17T23:33:07.823 INFO:tasks.workunit.client.0.smithi161.stdout:7/201: chown da/f26 250643 1 2024-01-17T23:33:08.313 INFO:tasks.workunit.client.0.smithi161.stdout:4/192: creat d9/de/f30 x:0 0 0 2024-01-17T23:33:08.313 INFO:tasks.workunit.client.0.smithi161.stdout:4/193: truncate d9/d1b/d24/d25/f2f 317708 0 2024-01-17T23:33:08.324 INFO:tasks.workunit.client.0.smithi161.stdout:4/194: dread d9/de/f14 [0,4194304] 0 2024-01-17T23:33:08.472 INFO:tasks.workunit.client.0.smithi161.stdout:7/202: symlink da/d34/l53 0 2024-01-17T23:33:08.707 INFO:tasks.workunit.client.0.smithi161.stdout:1/202: getdents d1/d20/d26/d30 0 2024-01-17T23:33:08.708 INFO:tasks.workunit.client.0.smithi161.stdout:4/195: dread d9/de/f2b [0,4194304] 0 2024-01-17T23:33:08.895 INFO:tasks.workunit.client.0.smithi161.stdout:2/167: unlink d8/c11 0 2024-01-17T23:33:09.064 INFO:tasks.workunit.client.0.smithi161.stdout:1/203: symlink d1/d20/d26/l45 0 2024-01-17T23:33:09.064 INFO:tasks.workunit.client.0.smithi161.stdout:1/204: write d1/d8/d1c/f39 [590676,113124] 0 2024-01-17T23:33:09.269 INFO:tasks.workunit.client.0.smithi161.stdout:2/168: truncate d8/d1c/f25 3472637 0 2024-01-17T23:33:09.467 INFO:tasks.workunit.client.0.smithi161.stdout:1/205: link d1/d11/c2c d1/d2d/c46 0 2024-01-17T23:33:09.627 INFO:tasks.workunit.client.0.smithi161.stdout:2/169: mknod d8/da/d2d/c3b 0 2024-01-17T23:33:09.788 INFO:tasks.workunit.client.0.smithi161.stdout:1/206: rename d1/d20/d26/l45 to d1/d8/d1f/l47 0 2024-01-17T23:33:09.804 INFO:tasks.workunit.client.0.smithi161.stdout:1/207: dread d1/d8/d1c/f39 [0,4194304] 0 2024-01-17T23:33:09.842 INFO:tasks.workunit.client.0.smithi161.stdout:1/208: dwrite d1/f38 [0,4194304] 0 2024-01-17T23:33:09.876 INFO:tasks.workunit.client.0.smithi161.stdout:1/209: dwrite d1/d2d/d3b/f2a [0,4194304] 0 2024-01-17T23:33:09.884 INFO:tasks.workunit.client.0.smithi161.stdout:2/170: stat d8/da/c16 0 2024-01-17T23:33:10.061 INFO:tasks.workunit.client.0.smithi161.stdout:0/202: unlink d5/d34/l22 0 2024-01-17T23:33:10.061 INFO:tasks.workunit.client.0.smithi161.stdout:5/169: rename dd/d2d to dd/d31 0 2024-01-17T23:33:10.061 INFO:tasks.workunit.client.0.smithi161.stdout:0/203: rename d5/d34 to d5/d34/d21/d40 22 2024-01-17T23:33:10.061 INFO:tasks.workunit.client.0.smithi161.stdout:0/204: stat d5/d2e 0 2024-01-17T23:33:10.061 INFO:tasks.workunit.client.0.smithi161.stdout:0/205: dread - d5/d34/d21/f3d zero size 2024-01-17T23:33:10.061 INFO:tasks.workunit.client.0.smithi161.stdout:0/206: write d5/d8/f9 [5213739,129] 0 2024-01-17T23:33:10.062 INFO:tasks.workunit.client.0.smithi161.stdout:0/207: fdatasync d5/d34/d12/f1d 0 2024-01-17T23:33:10.062 INFO:tasks.workunit.client.0.smithi161.stdout:0/208: chown d5/d34/d12/d2a 874779740 1 2024-01-17T23:33:10.065 INFO:tasks.workunit.client.0.smithi161.stdout:5/170: write dd/f14 [275540,18140] 0 2024-01-17T23:33:10.157 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:33:10.162 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:33:10.222 INFO:tasks.workunit.client.0.smithi161.stdout:9/125: symlink d0/l27 0 2024-01-17T23:33:10.236 INFO:tasks.workunit.client.0.smithi161.stdout:6/166: sync 2024-01-17T23:33:10.236 INFO:tasks.workunit.client.0.smithi161.stdout:6/167: fdatasync d6/d9/f11 0 2024-01-17T23:33:10.250 INFO:tasks.workunit.client.0.smithi161.stdout:6/168: dread d6/fa [0,4194304] 0 2024-01-17T23:33:10.704 INFO:tasks.workunit.client.0.smithi161.stdout:7/203: dwrite da/d14/f32 [0,4194304] 0 2024-01-17T23:33:11.198 INFO:tasks.workunit.client.0.smithi161.stdout:0/209: getdents d5/d34/d12/d2a 0 2024-01-17T23:33:11.198 INFO:tasks.workunit.client.0.smithi161.stdout:0/210: chown d5/d34/d20/f2f 15155 1 2024-01-17T23:33:11.421 INFO:tasks.workunit.client.0.smithi161.stdout:9/126: creat d0/d8/f28 x:0 0 0 2024-01-17T23:33:11.421 INFO:tasks.workunit.client.0.smithi161.stdout:9/127: chown d0/d8/d14/f1b 3994923 1 2024-01-17T23:33:11.432 INFO:tasks.workunit.client.0.smithi161.stdout:9/128: write d0/d8/d14/d18/f1d [2110396,94167] 0 2024-01-17T23:33:11.432 INFO:tasks.workunit.client.0.smithi161.stdout:9/129: readlink d0/l19 0 2024-01-17T23:33:11.455 INFO:tasks.workunit.client.0.smithi161.stdout:9/130: dwrite d0/d8/d14/f25 [0,4194304] 0 2024-01-17T23:33:11.535 INFO:tasks.workunit.client.0.smithi161.stdout:3/156: sync 2024-01-17T23:33:11.536 INFO:tasks.workunit.client.0.smithi161.stdout:8/119: sync 2024-01-17T23:33:11.536 INFO:tasks.workunit.client.0.smithi161.stdout:6/169: truncate d6/d9/fd 2778264 0 2024-01-17T23:33:11.804 INFO:tasks.workunit.client.0.smithi161.stdout:4/196: creat d9/f31 x:0 0 0 2024-01-17T23:33:11.805 INFO:tasks.workunit.client.0.smithi161.stdout:4/197: fdatasync d9/de/f19 0 2024-01-17T23:33:11.805 INFO:tasks.workunit.client.0.smithi161.stdout:4/198: fsync d9/fc 0 2024-01-17T23:33:11.836 INFO:tasks.workunit.client.0.smithi161.stdout:2/171: dwrite d8/d1c/f25 [0,4194304] 0 2024-01-17T23:33:11.838 INFO:tasks.workunit.client.0.smithi161.stdout:4/199: dwrite d9/f31 [0,4194304] 0 2024-01-17T23:33:11.838 INFO:tasks.workunit.client.0.smithi161.stdout:4/200: fsync d9/f23 0 2024-01-17T23:33:11.838 INFO:tasks.workunit.client.0.smithi161.stdout:4/201: truncate d9/de/f30 571408 0 2024-01-17T23:33:11.838 INFO:tasks.workunit.client.0.smithi161.stdout:4/202: readlink d9/de/d1e/l2a 0 2024-01-17T23:33:12.014 INFO:tasks.workunit.client.0.smithi161.stdout:0/211: symlink d5/l41 0 2024-01-17T23:33:12.014 INFO:tasks.workunit.client.0.smithi161.stdout:0/212: stat d5/la 0 2024-01-17T23:33:12.025 INFO:tasks.workunit.client.0.smithi161.stdout:5/171: getdents dd/d15/d1a 0 2024-01-17T23:33:12.029 INFO:tasks.workunit.client.0.smithi161.stdout:9/131: creat d0/d8/d14/f29 x:0 0 0 2024-01-17T23:33:12.049 INFO:tasks.workunit.client.0.smithi161.stdout:5/172: write dd/ff [1798579,110900] 0 2024-01-17T23:33:12.051 INFO:tasks.workunit.client.0.smithi161.stdout:0/213: dwrite d5/d34/d12/f1d [4194304,4194304] 0 2024-01-17T23:33:12.055 INFO:tasks.workunit.client.0.smithi161.stdout:5/173: fdatasync dd/f14 0 2024-01-17T23:33:12.072 INFO:tasks.workunit.client.0.smithi161.stdout:0/214: dread d5/d8/f9 [0,4194304] 0 2024-01-17T23:33:12.092 INFO:tasks.workunit.client.0.smithi161.stdout:8/120: creat d1/df/d16/f2d x:0 0 0 2024-01-17T23:33:12.115 INFO:tasks.workunit.client.0.smithi161.stdout:0/215: dwrite d5/d34/d20/d2b/f33 [0,4194304] 0 2024-01-17T23:33:12.231 INFO:tasks.workunit.client.0.smithi161.stdout:3/157: mkdir d0/d5/d9/d17/d2d 0 2024-01-17T23:33:12.870 INFO:tasks.workunit.client.0.smithi161.stdout:7/204: mkdir da/d14/d35/d54 0 2024-01-17T23:33:12.870 INFO:tasks.workunit.client.0.smithi161.stdout:9/132: rename d0/d8/d14/d18/d20/f26 to d0/f2a 0 2024-01-17T23:33:12.870 INFO:tasks.workunit.client.0.smithi161.stdout:8/121: rename d1 to d1/d3/d19/d2e 22 2024-01-17T23:33:13.053 INFO:tasks.workunit.client.0.smithi161.stdout:5/174: unlink dd/c10 0 2024-01-17T23:33:13.564 INFO:tasks.workunit.client.0.smithi161.stdout:1/210: sync 2024-01-17T23:33:13.564 INFO:tasks.workunit.client.0.smithi161.stdout:1/211: creat d1/d8/d1c/f48 x:0 0 0 2024-01-17T23:33:14.054 INFO:tasks.workunit.client.0.smithi161.stdout:3/158: truncate d0/f1f 1706522 0 2024-01-17T23:33:14.687 INFO:tasks.workunit.client.0.smithi161.stdout:6/170: getdents d6/d9/d13 0 2024-01-17T23:33:14.824 INFO:tasks.workunit.client.0.smithi161.stdout:4/203: getdents d9/d1b/d24/d25 0 2024-01-17T23:33:14.824 INFO:tasks.workunit.client.0.smithi161.stdout:4/204: dread - d9/de/f19 zero size 2024-01-17T23:33:14.824 INFO:tasks.workunit.client.0.smithi161.stdout:4/205: fsync d9/de/f2c 0 2024-01-17T23:33:14.860 INFO:tasks.workunit.client.0.smithi161.stdout:4/206: dwrite d9/f10 [0,4194304] 0 2024-01-17T23:33:14.869 INFO:tasks.workunit.client.0.smithi161.stdout:4/207: dread f0 [0,4194304] 0 2024-01-17T23:33:15.060 INFO:tasks.workunit.client.0.smithi161.stdout:9/133: mknod d0/d8/c2b 0 2024-01-17T23:33:15.060 INFO:tasks.workunit.client.0.smithi161.stdout:9/134: write d0/d8/d14/d18/f1d [745487,97205] 0 2024-01-17T23:33:15.520 INFO:tasks.workunit.client.0.smithi161.stdout:8/122: mkdir d1/d22/d2f 0 2024-01-17T23:33:15.520 INFO:tasks.workunit.client.0.smithi161.stdout:8/123: truncate d1/d3/d19/d1d/f27 792396 0 2024-01-17T23:33:15.749 INFO:tasks.workunit.client.0.smithi161.stdout:1/212: creat d1/d8/d1f/f49 x:0 0 0 2024-01-17T23:33:15.752 INFO:tasks.workunit.client.0.smithi161.stdout:1/213: dread d1/fe [0,4194304] 0 2024-01-17T23:33:15.774 INFO:tasks.workunit.client.0.smithi161.stdout:1/214: dwrite d1/d2d/d3b/f2a [0,4194304] 0 2024-01-17T23:33:15.774 INFO:tasks.workunit.client.0.smithi161.stdout:1/215: read d1/f23 [106040,37670] 0 2024-01-17T23:33:15.933 INFO:tasks.workunit.client.0.smithi161.stdout:3/159: creat d0/f2e x:0 0 0 2024-01-17T23:33:16.144 INFO:tasks.workunit.client.0.smithi161.stdout:6/171: symlink d6/d7/dc/l33 0 2024-01-17T23:33:16.526 INFO:tasks.workunit.client.0.smithi161.stdout:0/216: sync 2024-01-17T23:33:16.526 INFO:tasks.workunit.client.0.smithi161.stdout:4/208: creat d9/de/d1e/f32 x:0 0 0 2024-01-17T23:33:16.539 INFO:tasks.workunit.client.0.smithi161.stdout:2/172: rename l4 to d8/d2e/l3c 0 2024-01-17T23:33:16.548 INFO:tasks.workunit.client.0.smithi161.stdout:0/217: write d5/d8/f1f [3069197,93616] 0 2024-01-17T23:33:16.572 INFO:tasks.workunit.client.0.smithi161.stdout:4/209: dwrite d9/de/d1e/f32 [0,4194304] 0 2024-01-17T23:33:16.572 INFO:tasks.workunit.client.0.smithi161.stdout:4/210: creat d9/de/f33 x:0 0 0 2024-01-17T23:33:16.572 INFO:tasks.workunit.client.0.smithi161.stdout:4/211: creat d9/f34 x:0 0 0 2024-01-17T23:33:16.587 INFO:tasks.workunit.client.0.smithi161.stdout:0/218: dwrite d5/d34/d12/f37 [0,4194304] 0 2024-01-17T23:33:16.595 INFO:tasks.workunit.client.0.smithi161.stdout:0/219: dread f1 [0,4194304] 0 2024-01-17T23:33:16.644 INFO:tasks.workunit.client.0.smithi161.stdout:0/220: dwrite d5/d34/d21/f3d [0,4194304] 0 2024-01-17T23:33:16.688 INFO:tasks.workunit.client.0.smithi161.stdout:9/135: truncate d0/d8/f1f 3466912 0 2024-01-17T23:33:16.688 INFO:tasks.workunit.client.0.smithi161.stdout:9/136: fdatasync d0/d8/d14/f1b 0 2024-01-17T23:33:16.781 INFO:tasks.workunit.client.0.smithi161.stdout:8/124: symlink d1/d3/l30 0 2024-01-17T23:33:16.804 INFO:tasks.workunit.client.0.smithi161.stdout:8/125: write d1/df/f14 [2286442,113373] 0 2024-01-17T23:33:16.804 INFO:tasks.workunit.client.0.smithi161.stdout:8/126: write d1/df/d13/f1b [168039,39460] 0 2024-01-17T23:33:16.842 INFO:tasks.workunit.client.0.smithi161.stdout:8/127: dwrite f0 [4194304,4194304] 0 2024-01-17T23:33:16.988 INFO:tasks.workunit.client.0.smithi161.stdout:1/216: rmdir d1/d11 39 2024-01-17T23:33:17.013 INFO:tasks.workunit.client.0.smithi161.stdout:1/217: dwrite d1/d8/f13 [0,4194304] 0 2024-01-17T23:33:17.013 INFO:tasks.workunit.client.0.smithi161.stdout:1/218: write d1/f38 [4597615,10] 0 2024-01-17T23:33:17.013 INFO:tasks.workunit.client.0.smithi161.stdout:1/219: dread - d1/d20/f37 zero size 2024-01-17T23:33:17.327 INFO:tasks.workunit.client.0.smithi161.stdout:6/172: link d6/d7/dc/c14 d6/d9/d31/c34 0 2024-01-17T23:33:17.329 INFO:tasks.workunit.client.0.smithi161.stdout:6/173: write d6/d9/d13/f22 [42414,12925] 0 2024-01-17T23:33:17.329 INFO:tasks.workunit.client.0.smithi161.stdout:6/174: stat d6/d9/d13/f1c 0 2024-01-17T23:33:17.472 INFO:tasks.workunit.client.0.smithi161.stdout:7/205: write da/f26 [663384,12278] 0 2024-01-17T23:33:17.499 INFO:tasks.workunit.client.0.smithi161.stdout:7/206: dwrite da/d20/d3b/f4b [0,4194304] 0 2024-01-17T23:33:17.535 INFO:tasks.workunit.client.0.smithi161.stdout:7/207: dwrite da/f15 [0,4194304] 0 2024-01-17T23:33:17.535 INFO:tasks.workunit.client.0.smithi161.stdout:7/208: readlink da/db/l1f 0 2024-01-17T23:33:17.535 INFO:tasks.workunit.client.0.smithi161.stdout:7/209: read - da/db/f2a zero size 2024-01-17T23:33:17.948 INFO:tasks.workunit.client.0.smithi161.stdout:5/175: dwrite dd/d15/f1c [0,4194304] 0 2024-01-17T23:33:17.986 INFO:tasks.workunit.client.0.smithi161.stdout:5/176: dwrite dd/f11 [0,4194304] 0 2024-01-17T23:33:18.007 INFO:tasks.workunit.client.0.smithi161.stdout:5/177: dread dd/ff [0,4194304] 0 2024-01-17T23:33:18.007 INFO:tasks.workunit.client.0.smithi161.stdout:5/178: truncate dd/d15/d1a/f25 526341 0 2024-01-17T23:33:18.007 INFO:tasks.workunit.client.0.smithi161.stdout:5/179: readlink dd/d15/d1a/l2c 0 2024-01-17T23:33:18.913 INFO:tasks.workunit.client.0.smithi161.stdout:9/137: getdents d0/d8/d14/d18 0 2024-01-17T23:33:18.941 INFO:tasks.workunit.client.0.smithi161.stdout:9/138: dwrite d0/f4 [0,4194304] 0 2024-01-17T23:33:18.941 INFO:tasks.workunit.client.0.smithi161.stdout:9/139: stat d0/d8/d14/f29 0 2024-01-17T23:33:18.941 INFO:tasks.workunit.client.0.smithi161.stdout:9/140: write d0/d8/d14/d18/f1d [3135075,43917] 0 2024-01-17T23:33:19.021 INFO:tasks.workunit.client.0.smithi161.stdout:8/128: creat d1/df/f31 x:0 0 0 2024-01-17T23:33:19.021 INFO:tasks.workunit.client.0.smithi161.stdout:8/129: write f0 [3414859,31897] 0 2024-01-17T23:33:19.041 INFO:tasks.workunit.client.0.smithi161.stdout:8/130: write d1/d3/f18 [3530043,57521] 0 2024-01-17T23:33:19.041 INFO:tasks.workunit.client.0.smithi161.stdout:8/131: chown f0 4383 1 2024-01-17T23:33:19.041 INFO:tasks.workunit.client.0.smithi161.stdout:8/132: readlink d1/d3/ld 0 2024-01-17T23:33:19.066 INFO:tasks.workunit.client.0.smithi161.stdout:8/133: dread d1/d3/f9 [0,4194304] 0 2024-01-17T23:33:19.066 INFO:tasks.workunit.client.0.smithi161.stdout:8/134: dread - d1/d3/f24 zero size 2024-01-17T23:33:19.374 INFO:tasks.workunit.client.0.smithi161.stdout:1/220: creat d1/d20/d26/d32/f4a x:0 0 0 2024-01-17T23:33:19.374 INFO:tasks.workunit.client.0.smithi161.stdout:1/221: chown d1/d2d 61705 1 2024-01-17T23:33:19.375 INFO:tasks.workunit.client.0.smithi161.stdout:3/160: symlink d0/d5/l2f 0 2024-01-17T23:33:19.375 INFO:tasks.workunit.client.0.smithi161.stdout:1/222: truncate d1/d2d/d3b/f21 1010875 0 2024-01-17T23:33:19.404 INFO:tasks.workunit.client.0.smithi161.stdout:3/161: dwrite d0/f10 [0,4194304] 0 2024-01-17T23:33:19.506 INFO:tasks.workunit.client.0.smithi161.stdout:6/175: creat d6/d9/d13/f35 x:0 0 0 2024-01-17T23:33:19.521 INFO:tasks.workunit.client.0.smithi161.stdout:6/176: dread d6/d7/d16/f21 [0,4194304] 0 2024-01-17T23:33:19.521 INFO:tasks.workunit.client.0.smithi161.stdout:6/177: creat d6/d7/d16/f36 x:0 0 0 2024-01-17T23:33:19.521 INFO:tasks.workunit.client.0.smithi161.stdout:6/178: read d6/d7/dc/f19 [2234029,48918] 0 2024-01-17T23:33:19.521 INFO:tasks.workunit.client.0.smithi161.stdout:6/179: creat d6/d9/d13/f37 x:0 0 0 2024-01-17T23:33:19.521 INFO:tasks.workunit.client.0.smithi161.stdout:6/180: creat d6/d7/d16/f38 x:0 0 0 2024-01-17T23:33:19.616 INFO:tasks.workunit.client.0.smithi161.stdout:2/173: creat d8/d1c/d1e/f3d x:0 0 0 2024-01-17T23:33:20.070 INFO:tasks.workunit.client.0.smithi161.stdout:7/210: creat da/d20/d3b/f55 x:0 0 0 2024-01-17T23:33:20.514 INFO:tasks.workunit.client.0.smithi161.stdout:5/180: truncate dd/f12 3867090 0 2024-01-17T23:33:20.514 INFO:tasks.workunit.client.0.smithi161.stdout:5/181: fsync dd/d15/f19 0 2024-01-17T23:33:20.543 INFO:tasks.workunit.client.0.smithi161.stdout:5/182: dwrite dd/d15/f19 [0,4194304] 0 2024-01-17T23:33:20.705 INFO:tasks.workunit.client.0.smithi161.stdout:9/141: link d0/d8/d14/f1b d0/f2c 0 2024-01-17T23:33:20.705 INFO:tasks.workunit.client.0.smithi161.stdout:9/142: chown d0/c24 3 1 2024-01-17T23:33:20.706 INFO:tasks.workunit.client.0.smithi161.stdout:9/143: write d0/d8/d14/fe [148551,54801] 0 2024-01-17T23:33:20.992 INFO:tasks.workunit.client.0.smithi161.stdout:8/135: mkdir d1/df/d20/d32 0 2024-01-17T23:33:20.992 INFO:tasks.workunit.client.0.smithi161.stdout:8/136: chown d1/df/d13 5878210 1 2024-01-17T23:33:21.032 INFO:tasks.workunit.client.0.smithi161.stdout:0/221: sync 2024-01-17T23:33:21.065 INFO:tasks.workunit.client.0.smithi161.stdout:0/222: dwrite d5/fb [0,4194304] 0 2024-01-17T23:33:21.065 INFO:tasks.workunit.client.0.smithi161.stdout:0/223: chown d5/d34/d20/d2b/f33 63337 1 2024-01-17T23:33:21.229 INFO:tasks.workunit.client.0.smithi161.stdout:1/223: mkdir d1/d8/d1f/d4b 0 2024-01-17T23:33:23.239 INFO:tasks.workunit.client.0.smithi161.stdout:5/183: creat dd/d31/f32 x:0 0 0 2024-01-17T23:33:23.476 INFO:tasks.workunit.client.0.smithi161.stdout:4/212: dwrite d9/fd [0,4194304] 0 2024-01-17T23:33:23.476 INFO:tasks.workunit.client.0.smithi161.stdout:4/213: creat d9/de/d1e/f35 x:0 0 0 2024-01-17T23:33:23.500 INFO:tasks.workunit.client.0.smithi161.stdout:4/214: write d9/f10 [2514149,121403] 0 2024-01-17T23:33:23.500 INFO:tasks.workunit.client.0.smithi161.stdout:4/215: creat d9/de/d1e/f36 x:0 0 0 2024-01-17T23:33:23.501 INFO:tasks.workunit.client.0.smithi161.stdout:4/216: chown d9/d1b/d24/d25 62 1 2024-01-17T23:33:23.530 INFO:tasks.workunit.client.0.smithi161.stdout:4/217: dwrite d9/ff [0,4194304] 0 2024-01-17T23:33:23.530 INFO:tasks.workunit.client.0.smithi161.stdout:4/218: write d9/fc [94426,33836] 0 2024-01-17T23:33:23.741 INFO:tasks.workunit.client.0.smithi161.stdout:8/137: unlink d1/df/d20/c26 0 2024-01-17T23:33:23.751 INFO:tasks.workunit.client.0.smithi161.stdout:8/138: dread d1/f2 [0,4194304] 0 2024-01-17T23:33:23.777 INFO:tasks.workunit.client.0.smithi161.stdout:8/139: dwrite d1/df/f31 [0,4194304] 0 2024-01-17T23:33:23.777 INFO:tasks.workunit.client.0.smithi161.stdout:8/140: chown d1/df/f15 33271807 1 2024-01-17T23:33:23.777 INFO:tasks.workunit.client.0.smithi161.stdout:8/141: write d1/d1c/f2b [417527,72626] 0 2024-01-17T23:33:23.871 INFO:tasks.workunit.client.0.smithi161.stdout:0/224: creat d5/d34/d12/d2a/d35/f42 x:0 0 0 2024-01-17T23:33:23.871 INFO:tasks.workunit.client.0.smithi161.stdout:0/225: readlink d5/lf 0 2024-01-17T23:33:24.200 INFO:tasks.workunit.client.0.smithi161.stdout:5/184: mkdir dd/d15/d33 0 2024-01-17T23:33:24.201 INFO:tasks.workunit.client.0.smithi161.stdout:5/185: write dd/d15/d1a/f28 [856441,38983] 0 2024-01-17T23:33:24.969 INFO:tasks.workunit.client.0.smithi161.stdout:8/142: mknod d1/d22/d2f/c33 0 2024-01-17T23:33:24.969 INFO:tasks.workunit.client.0.smithi161.stdout:8/143: chown d1/d3/d19/d1d/d25 166726779 1 2024-01-17T23:33:25.000 INFO:tasks.workunit.client.0.smithi161.stdout:8/144: dwrite d1/d3/d19/f21 [0,4194304] 0 2024-01-17T23:33:25.010 INFO:tasks.workunit.client.0.smithi161.stdout:8/145: read d1/f2 [3297628,8032] 0 2024-01-17T23:33:25.010 INFO:tasks.workunit.client.0.smithi161.stdout:8/146: write d1/df/f15 [9331086,90400] 0 2024-01-17T23:33:25.010 INFO:tasks.workunit.client.0.smithi161.stdout:8/147: readlink d1/df/l1a 0 2024-01-17T23:33:25.081 INFO:tasks.workunit.client.0.smithi161.stdout:0/226: creat d5/d3a/f43 x:0 0 0 2024-01-17T23:33:25.432 INFO:tasks.workunit.client.0.smithi161.stdout:8/148: getdents d1/df/d13 0 2024-01-17T23:33:25.646 INFO:tasks.workunit.client.0.smithi161.stdout:0/227: creat d5/d34/d20/d2b/f44 x:0 0 0 2024-01-17T23:33:25.646 INFO:tasks.workunit.client.0.smithi161.stdout:0/228: write d5/d34/d20/f2f [52995,25927] 0 2024-01-17T23:33:25.797 INFO:tasks.workunit.client.0.smithi161.stdout:0/229: rmdir d5/d34/d12/d2a 39 2024-01-17T23:33:25.970 INFO:tasks.workunit.client.0.smithi161.stdout:7/211: dwrite da/db/f13 [0,4194304] 0 2024-01-17T23:33:26.510 INFO:tasks.workunit.client.0.smithi161.stdout:5/186: getdents dd/d31 0 2024-01-17T23:33:26.516 INFO:tasks.workunit.client.0.smithi161.stdout:4/219: write d9/d1b/d24/f2e [941252,65611] 0 2024-01-17T23:33:26.527 INFO:tasks.workunit.client.0.smithi161.stdout:2/174: dwrite d8/f14 [4194304,4194304] 0 2024-01-17T23:33:26.711 INFO:tasks.workunit.client.0.smithi161.stdout:8/149: link d1/df/f15 d1/df/d20/d2a/f34 0 2024-01-17T23:33:26.712 INFO:tasks.workunit.client.0.smithi161.stdout:8/150: write d1/df/f14 [4094299,1086] 0 2024-01-17T23:33:26.712 INFO:tasks.workunit.client.0.smithi161.stdout:8/151: chown d1/df/f15 1970361 1 2024-01-17T23:33:26.713 INFO:tasks.workunit.client.0.smithi161.stdout:0/230: link f2 d5/d34/f45 0 2024-01-17T23:33:26.713 INFO:tasks.workunit.client.0.smithi161.stdout:7/212: symlink da/db/l56 0 2024-01-17T23:33:26.713 INFO:tasks.workunit.client.0.smithi161.stdout:0/231: fsync d5/f32 0 2024-01-17T23:33:26.713 INFO:tasks.workunit.client.0.smithi161.stdout:0/232: write d5/d3a/f43 [78492,20233] 0 2024-01-17T23:33:26.713 INFO:tasks.workunit.client.0.smithi161.stdout:7/213: write da/db/f2a [940523,118879] 0 2024-01-17T23:33:26.734 INFO:tasks.workunit.client.0.smithi161.stdout:0/233: write d5/fb [4160094,45928] 0 2024-01-17T23:33:26.734 INFO:tasks.workunit.client.0.smithi161.stdout:0/234: chown d5/d34/c16 29371701 1 2024-01-17T23:33:26.750 INFO:tasks.workunit.client.0.smithi161.stdout:0/235: dread d5/d3a/f43 [0,4194304] 0 2024-01-17T23:33:26.759 INFO:tasks.workunit.client.0.smithi161.stdout:0/236: write d5/d8/f3c [3212591,87369] 0 2024-01-17T23:33:27.121 INFO:tasks.workunit.client.0.smithi161.stdout:5/187: mkdir dd/d15/d1a/d34 0 2024-01-17T23:33:27.121 INFO:tasks.workunit.client.0.smithi161.stdout:6/181: unlink d6/d9/fd 0 2024-01-17T23:33:27.121 INFO:tasks.workunit.client.0.smithi161.stdout:4/220: rename d9/l17 to d9/d1b/l37 0 2024-01-17T23:33:28.049 INFO:tasks.workunit.client.0.smithi161.stdout:8/152: link d1/d3/f18 d1/d1c/f35 0 2024-01-17T23:33:28.049 INFO:tasks.workunit.client.0.smithi161.stdout:8/153: creat d1/d3/d19/d1d/f36 x:0 0 0 2024-01-17T23:33:28.049 INFO:tasks.workunit.client.0.smithi161.stdout:8/154: fdatasync d1/d3/d19/d1d/f27 0 2024-01-17T23:33:28.340 INFO:tasks.workunit.client.0.smithi161.stdout:7/214: symlink da/d20/d28/d43/l57 0 2024-01-17T23:33:28.341 INFO:tasks.workunit.client.0.smithi161.stdout:7/215: stat l6 0 2024-01-17T23:33:28.490 INFO:tasks.workunit.client.0.smithi161.stdout:0/237: mknod d5/d2e/c46 0 2024-01-17T23:33:28.527 INFO:tasks.workunit.client.0.smithi161.stdout:4/221: mkdir d9/de/d1e/d38 0 2024-01-17T23:33:28.555 INFO:tasks.workunit.client.0.smithi161.stdout:4/222: dwrite d9/f34 [0,4194304] 0 2024-01-17T23:33:28.574 INFO:tasks.workunit.client.0.smithi161.stdout:1/224: sync 2024-01-17T23:33:28.574 INFO:tasks.workunit.client.0.smithi161.stdout:9/144: sync 2024-01-17T23:33:28.574 INFO:tasks.workunit.client.0.smithi161.stdout:3/162: sync 2024-01-17T23:33:28.574 INFO:tasks.workunit.client.0.smithi161.stdout:9/145: write d0/d8/d14/f29 [26662,99277] 0 2024-01-17T23:33:28.574 INFO:tasks.workunit.client.0.smithi161.stdout:9/146: chown d0/l19 864816 1 2024-01-17T23:33:28.627 INFO:tasks.workunit.client.0.smithi161.stdout:5/188: symlink dd/d15/l35 0 2024-01-17T23:33:28.627 INFO:tasks.workunit.client.0.smithi161.stdout:5/189: readlink dd/d15/d1a/l2b 0 2024-01-17T23:33:28.628 INFO:tasks.workunit.client.0.smithi161.stdout:5/190: getdents dd/d15/d1a/d34 0 2024-01-17T23:33:28.628 INFO:tasks.workunit.client.0.smithi161.stdout:5/191: write dd/f14 [974619,82717] 0 2024-01-17T23:33:28.628 INFO:tasks.workunit.client.0.smithi161.stdout:5/192: getdents dd/d15/d33 0 2024-01-17T23:33:28.771 INFO:tasks.workunit.client.0.smithi161.stdout:6/182: symlink d6/d7/d16/l39 0 2024-01-17T23:33:28.771 INFO:tasks.workunit.client.0.smithi161.stdout:6/183: creat d6/d9/d13/f3a x:0 0 0 2024-01-17T23:33:28.771 INFO:tasks.workunit.client.0.smithi161.stdout:6/184: read - d6/d9/d13/f35 zero size 2024-01-17T23:33:29.520 INFO:tasks.workunit.client.0.smithi161.stdout:8/155: mkdir d1/d3/d37 0 2024-01-17T23:33:29.520 INFO:tasks.workunit.client.0.smithi161.stdout:7/216: symlink da/l58 0 2024-01-17T23:33:29.520 INFO:tasks.workunit.client.0.smithi161.stdout:8/156: chown d1/d3/f9 121896 1 2024-01-17T23:33:29.520 INFO:tasks.workunit.client.0.smithi161.stdout:7/217: fsync da/db/f2a 0 2024-01-17T23:33:29.520 INFO:tasks.workunit.client.0.smithi161.stdout:8/157: chown d1/d3/d19/f21 14812674 1 2024-01-17T23:33:29.520 INFO:tasks.workunit.client.0.smithi161.stdout:8/158: fsync d1/d3/d19/d1d/f27 0 2024-01-17T23:33:29.520 INFO:tasks.workunit.client.0.smithi161.stdout:7/218: write da/d34/f4f [691804,107942] 0 2024-01-17T23:33:29.524 INFO:tasks.workunit.client.0.smithi161.stdout:8/159: write d1/d1c/f2b [340947,100971] 0 2024-01-17T23:33:29.576 INFO:tasks.workunit.client.0.smithi161.stdout:2/175: sync 2024-01-17T23:33:30.254 INFO:tasks.workunit.client.0.smithi161.stdout:4/223: symlink d9/l39 0 2024-01-17T23:33:30.402 INFO:tasks.workunit.client.0.smithi161.stdout:1/225: symlink d1/l4c 0 2024-01-17T23:33:30.402 INFO:tasks.workunit.client.0.smithi161.stdout:1/226: getdents d1/d31 0 2024-01-17T23:33:30.441 INFO:tasks.workunit.client.0.smithi161.stdout:1/227: dwrite d1/d8/d1c/f48 [0,4194304] 0 2024-01-17T23:33:30.545 INFO:tasks.workunit.client.0.smithi161.stdout:3/163: symlink d0/d5/d9/d17/d2d/l30 0 2024-01-17T23:33:30.658 INFO:tasks.workunit.client.0.smithi161.stdout:9/147: mknod d0/d8/c2d 0 2024-01-17T23:33:31.088 INFO:tasks.workunit.client.0.smithi161.stdout:6/185: rename d6/d9/d31/c34 to d6/d7/dc/c3b 0 2024-01-17T23:33:31.460 INFO:tasks.workunit.client.0.smithi161.stdout:4/224: mkdir d9/d27/d3a 0 2024-01-17T23:33:31.736 INFO:tasks.workunit.client.0.smithi161.stdout:1/228: mknod d1/d8/c4d 0 2024-01-17T23:33:32.149 INFO:tasks.workunit.client.0.smithi161.stdout:7/219: rename da/d34/d4a/d4c/f4e to da/d20/d28/d43/f59 0 2024-01-17T23:33:32.150 INFO:tasks.workunit.client.0.smithi161.stdout:7/220: chown c9 192583 1 2024-01-17T23:33:32.248 INFO:tasks.workunit.client.0.smithi161.stdout:6/186: mkdir d6/d7/dc/d3c 0 2024-01-17T23:33:32.413 INFO:tasks.workunit.client.0.smithi161.stdout:4/225: creat d9/d1b/f3b x:0 0 0 2024-01-17T23:33:32.447 INFO:tasks.workunit.client.0.smithi161.stdout:4/226: dwrite d9/de/f1d [0,4194304] 0 2024-01-17T23:33:32.486 INFO:tasks.workunit.client.0.smithi161.stdout:4/227: dwrite d9/fd [0,4194304] 0 2024-01-17T23:33:32.486 INFO:tasks.workunit.client.0.smithi161.stdout:4/228: getdents d9/d1b/d24/d25 0 2024-01-17T23:33:32.654 INFO:tasks.workunit.client.0.smithi161.stdout:3/164: symlink d0/d5/l31 0 2024-01-17T23:33:32.654 INFO:tasks.workunit.client.0.smithi161.stdout:1/229: mkdir d1/d31/d4e 0 2024-01-17T23:33:33.152 INFO:tasks.workunit.client.0.smithi161.stdout:4/229: symlink d9/d27/l3c 0 2024-01-17T23:33:33.433 INFO:tasks.workunit.client.0.smithi161.stdout:3/165: mkdir d0/d5/d9/d17/d32 0 2024-01-17T23:33:33.461 INFO:tasks.workunit.client.0.smithi161.stdout:3/166: dwrite d0/d5/f26 [0,4194304] 0 2024-01-17T23:33:33.515 INFO:tasks.workunit.client.0.smithi161.stdout:0/238: sync 2024-01-17T23:33:33.515 INFO:tasks.workunit.client.0.smithi161.stdout:0/239: write d5/d34/d12/d2a/d35/f42 [787020,39334] 0 2024-01-17T23:33:33.599 INFO:tasks.workunit.client.0.smithi161.stdout:5/193: sync 2024-01-17T23:33:33.680 INFO:tasks.workunit.client.0.smithi161.stdout:4/230: symlink d9/d27/d3a/l3d 0 2024-01-17T23:33:33.938 INFO:tasks.workunit.client.0.smithi161.stdout:1/230: truncate d1/ff 1054571 0 2024-01-17T23:33:34.288 INFO:tasks.workunit.client.0.smithi161.stdout:0/240: creat d5/d34/f47 x:0 0 0 2024-01-17T23:33:34.530 INFO:tasks.workunit.client.0.smithi161.stdout:5/194: link dd/d15/f1c dd/d15/d1a/d34/f36 0 2024-01-17T23:33:34.530 INFO:tasks.workunit.client.0.smithi161.stdout:5/195: chown dd/ff 121718680 1 2024-01-17T23:33:34.603 INFO:tasks.workunit.client.0.smithi161.stdout:4/231: symlink d9/d1b/l3e 0 2024-01-17T23:33:34.603 INFO:tasks.workunit.client.0.smithi161.stdout:4/232: fsync d9/de/d1e/f36 0 2024-01-17T23:33:34.604 INFO:tasks.workunit.client.0.smithi161.stdout:4/233: write d9/de/f14 [745429,49725] 0 2024-01-17T23:33:34.604 INFO:tasks.workunit.client.0.smithi161.stdout:4/234: fsync f4 0 2024-01-17T23:33:34.608 INFO:tasks.workunit.client.0.smithi161.stdout:1/231: symlink d1/d31/l4f 0 2024-01-17T23:33:34.608 INFO:tasks.workunit.client.0.smithi161.stdout:1/232: chown d1/d8/d1c 20478 1 2024-01-17T23:33:34.617 INFO:tasks.workunit.client.0.smithi161.stdout:1/233: dread d1/d8/fc [0,4194304] 0 2024-01-17T23:33:34.625 INFO:tasks.workunit.client.0.smithi161.stdout:1/234: dread d1/d11/f22 [0,4194304] 0 2024-01-17T23:33:34.696 INFO:tasks.workunit.client.0.smithi161.stdout:0/241: symlink d5/d34/l48 0 2024-01-17T23:33:34.890 INFO:tasks.workunit.client.0.smithi161.stdout:9/148: write d0/d8/f1f [676696,14136] 0 2024-01-17T23:33:34.890 INFO:tasks.workunit.client.0.smithi161.stdout:9/149: truncate d0/d8/d14/f25 4711780 0 2024-01-17T23:33:35.093 INFO:tasks.workunit.client.0.smithi161.stdout:5/196: symlink dd/l37 0 2024-01-17T23:33:35.093 INFO:tasks.workunit.client.0.smithi161.stdout:5/197: fsync dd/d15/f30 0 2024-01-17T23:33:35.215 INFO:tasks.workunit.client.0.smithi161.stdout:6/187: getdents d6/d7/dc 0 2024-01-17T23:33:35.243 INFO:tasks.workunit.client.0.smithi161.stdout:6/188: dwrite d6/d7/d16/f18 [4194304,4194304] 0 2024-01-17T23:33:35.734 INFO:tasks.workunit.client.0.smithi161.stdout:1/235: symlink d1/d20/d26/d32/l50 0 2024-01-17T23:33:35.734 INFO:tasks.workunit.client.0.smithi161.stdout:1/236: fsync d1/d11/f12 0 2024-01-17T23:33:35.770 INFO:tasks.workunit.client.0.smithi161.stdout:0/242: mkdir d5/d3a/d49 0 2024-01-17T23:33:35.781 INFO:tasks.workunit.client.0.smithi161.stdout:0/243: dread d5/fb [0,4194304] 0 2024-01-17T23:33:35.830 INFO:tasks.workunit.client.0.smithi161.stdout:9/150: symlink d0/d8/d14/d18/l2e 0 2024-01-17T23:33:36.369 INFO:tasks.workunit.client.0.smithi161.stdout:6/189: creat d6/f3d x:0 0 0 2024-01-17T23:33:36.369 INFO:tasks.workunit.client.0.smithi161.stdout:5/198: creat dd/d31/f38 x:0 0 0 2024-01-17T23:33:36.369 INFO:tasks.workunit.client.0.smithi161.stdout:5/199: dread - dd/d15/f2e zero size 2024-01-17T23:33:36.425 INFO:tasks.workunit.client.0.smithi161.stdout:8/160: rename d1/df/f15 to d1/d3/f38 0 2024-01-17T23:33:36.425 INFO:tasks.workunit.client.0.smithi161.stdout:8/161: fdatasync d1/df/d13/f1b 0 2024-01-17T23:33:36.557 INFO:tasks.workunit.client.0.smithi161.stdout:1/237: creat d1/d20/f51 x:0 0 0 2024-01-17T23:33:36.558 INFO:tasks.workunit.client.0.smithi161.stdout:1/238: chown d1/d11/c2c 23247762 1 2024-01-17T23:33:36.594 INFO:tasks.workunit.client.0.smithi161.stdout:1/239: dwrite d1/f38 [4194304,4194304] 0 2024-01-17T23:33:36.684 INFO:tasks.workunit.client.0.smithi161.stdout:0/244: symlink d5/d34/d12/l4a 0 2024-01-17T23:33:36.845 INFO:tasks.workunit.client.0.smithi161.stdout:9/151: link d0/l19 d0/d8/d14/d18/d20/l2f 0 2024-01-17T23:33:36.891 INFO:tasks.workunit.client.0.smithi161.stdout:6/190: creat d6/d9/d1a/f3e x:0 0 0 2024-01-17T23:33:36.891 INFO:tasks.workunit.client.0.smithi161.stdout:3/167: write d0/f1f [2233543,81889] 0 2024-01-17T23:33:36.891 INFO:tasks.workunit.client.0.smithi161.stdout:3/168: truncate d0/f2e 684324 0 2024-01-17T23:33:36.892 INFO:tasks.workunit.client.0.smithi161.stdout:3/169: fdatasync d0/d5/f26 0 2024-01-17T23:33:36.925 INFO:tasks.workunit.client.0.smithi161.stdout:6/191: dwrite d6/d7/dc/d1d/f2e [0,4194304] 0 2024-01-17T23:33:36.925 INFO:tasks.workunit.client.0.smithi161.stdout:6/192: dread - d6/d9/d13/f28 zero size 2024-01-17T23:33:36.925 INFO:tasks.workunit.client.0.smithi161.stdout:6/193: write d6/d9/d13/f3a [802636,70484] 0 2024-01-17T23:33:36.925 INFO:tasks.workunit.client.0.smithi161.stdout:6/194: chown d6 33791247 1 2024-01-17T23:33:36.927 INFO:tasks.workunit.client.0.smithi161.stdout:6/195: read d6/d9/d13/f3a [40082,2788] 0 2024-01-17T23:33:36.927 INFO:tasks.workunit.client.0.smithi161.stdout:6/196: creat d6/d9/d1a/f3f x:0 0 0 2024-01-17T23:33:37.029 INFO:tasks.workunit.client.0.smithi161.stdout:2/176: rename d8/d1c/f24 to d8/da/d2d/d34/d35/f3e 0 2024-01-17T23:33:37.579 INFO:tasks.workunit.client.0.smithi161.stdout:1/240: creat d1/d20/d26/d30/d44/f52 x:0 0 0 2024-01-17T23:33:37.579 INFO:tasks.workunit.client.0.smithi161.stdout:1/241: creat d1/d8/d1c/f53 x:0 0 0 2024-01-17T23:33:37.579 INFO:tasks.workunit.client.0.smithi161.stdout:1/242: truncate d1/f18 5202686 0 2024-01-17T23:33:38.439 INFO:tasks.workunit.client.0.smithi161.stdout:4/235: write d9/fb [2874887,7997] 0 2024-01-17T23:33:38.439 INFO:tasks.workunit.client.0.smithi161.stdout:4/236: readlink d9/d1b/l3e 0 2024-01-17T23:33:38.471 INFO:tasks.workunit.client.0.smithi161.stdout:4/237: dwrite d9/de/f30 [0,4194304] 0 2024-01-17T23:33:38.471 INFO:tasks.workunit.client.0.smithi161.stdout:4/238: write d9/f10 [3271854,22297] 0 2024-01-17T23:33:39.895 INFO:tasks.workunit.client.0.smithi161.stdout:2/177: unlink d8/da/d2d/d34/d35/f3e 0 2024-01-17T23:33:39.949 INFO:tasks.workunit.client.0.smithi161.stdout:8/162: dwrite d1/d3/f38 [0,4194304] 0 2024-01-17T23:33:39.949 INFO:tasks.workunit.client.0.smithi161.stdout:8/163: fsync d1/d3/d19/f21 0 2024-01-17T23:33:39.949 INFO:tasks.workunit.client.0.smithi161.stdout:8/164: readlink d1/d3/l30 0 2024-01-17T23:33:40.154 INFO:tasks.workunit.client.0.smithi161.stdout:8/165: creat d1/d3/d19/d1d/d25/f39 x:0 0 0 2024-01-17T23:33:40.169 INFO:tasks.workunit.client.0.smithi161.stdout:8/166: dread d1/df/f31 [0,4194304] 0 2024-01-17T23:33:40.169 INFO:tasks.workunit.client.0.smithi161.stdout:8/167: write d1/d1c/f35 [4724082,102066] 0 2024-01-17T23:33:40.213 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:33:40.217 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:33:40.398 INFO:tasks.workunit.client.0.smithi161.stdout:4/239: symlink d9/l3f 0 2024-01-17T23:33:40.398 INFO:tasks.workunit.client.0.smithi161.stdout:4/240: creat d9/de/d1e/f40 x:0 0 0 2024-01-17T23:33:40.401 INFO:tasks.workunit.client.0.smithi161.stdout:0/245: sync 2024-01-17T23:33:40.412 INFO:tasks.workunit.client.0.smithi161.stdout:4/241: dread d9/de/f1d [0,4194304] 0 2024-01-17T23:33:40.727 INFO:tasks.workunit.client.0.smithi161.stdout:7/221: rename da/d20 to da/d34/d5a 0 2024-01-17T23:33:40.727 INFO:tasks.workunit.client.0.smithi161.stdout:7/222: readlink da/db/l1a 0 2024-01-17T23:33:40.727 INFO:tasks.workunit.client.0.smithi161.stdout:5/200: rename dd to dd/d15/d33/d39 22 2024-01-17T23:33:40.727 INFO:tasks.workunit.client.0.smithi161.stdout:5/201: chown dd 2118 1 2024-01-17T23:33:40.946 INFO:tasks.workunit.client.0.smithi161.stdout:0/246: truncate d5/d34/f45 941558 0 2024-01-17T23:33:40.946 INFO:tasks.workunit.client.0.smithi161.stdout:9/152: rename d0/d8/d14/fe to d0/f30 0 2024-01-17T23:33:40.947 INFO:tasks.workunit.client.0.smithi161.stdout:0/247: write d5/fb [739426,62866] 0 2024-01-17T23:33:40.947 INFO:tasks.workunit.client.0.smithi161.stdout:7/223: creat da/d34/d5a/d28/d43/f5b x:0 0 0 2024-01-17T23:33:40.998 INFO:tasks.workunit.client.0.smithi161.stdout:5/202: dread dd/d15/f22 [0,4194304] 0 2024-01-17T23:33:41.022 INFO:tasks.workunit.client.0.smithi161.stdout:5/203: dwrite dd/d15/f1c [0,4194304] 0 2024-01-17T23:33:41.514 INFO:tasks.workunit.client.0.smithi161.stdout:3/170: rename d0/d5/fe to d0/d5/d9/d17/f33 0 2024-01-17T23:33:41.637 INFO:tasks.workunit.client.0.smithi161.stdout:9/153: mkdir d0/d8/d31 0 2024-01-17T23:33:41.707 INFO:tasks.workunit.client.0.smithi161.stdout:1/243: mkdir d1/d8/d54 0 2024-01-17T23:33:41.730 INFO:tasks.workunit.client.0.smithi161.stdout:1/244: dread d1/f38 [4194304,4194304] 0 2024-01-17T23:33:41.731 INFO:tasks.workunit.client.0.smithi161.stdout:1/245: write d1/d20/f37 [594476,122146] 0 2024-01-17T23:33:41.751 INFO:tasks.workunit.client.0.smithi161.stdout:1/246: dread d1/d8/d1f/f28 [0,4194304] 0 2024-01-17T23:33:41.775 INFO:tasks.workunit.client.0.smithi161.stdout:1/247: read d1/d2d/d3b/f2a [769409,117403] 0 2024-01-17T23:33:41.779 INFO:tasks.workunit.client.0.smithi161.stdout:1/248: dread d1/f23 [0,4194304] 0 2024-01-17T23:33:42.010 INFO:tasks.workunit.client.0.smithi161.stdout:4/242: getdents d9 0 2024-01-17T23:33:42.011 INFO:tasks.workunit.client.0.smithi161.stdout:8/168: rename d1/d3/d19/c23 to d1/d3/d19/c3a 0 2024-01-17T23:33:42.042 INFO:tasks.workunit.client.0.smithi161.stdout:0/248: dwrite d5/d34/f45 [0,4194304] 0 2024-01-17T23:33:42.042 INFO:tasks.workunit.client.0.smithi161.stdout:0/249: write d5/d34/d12/d2a/d35/f42 [1773186,116320] 0 2024-01-17T23:33:42.049 INFO:tasks.workunit.client.0.smithi161.stdout:8/169: dread d1/d3/f38 [4194304,4194304] 0 2024-01-17T23:33:42.049 INFO:tasks.workunit.client.0.smithi161.stdout:8/170: fdatasync d1/d3/d19/d1d/f36 0 2024-01-17T23:33:42.218 INFO:tasks.workunit.client.0.smithi161.stdout:7/224: unlink da/d34/d5a/d28/f39 0 2024-01-17T23:33:42.218 INFO:tasks.workunit.client.0.smithi161.stdout:7/225: write da/db/f11 [2018222,6814] 0 2024-01-17T23:33:42.378 INFO:tasks.workunit.client.0.smithi161.stdout:6/197: creat d6/d7/f40 x:0 0 0 2024-01-17T23:33:42.686 INFO:tasks.workunit.client.0.smithi161.stdout:9/154: symlink d0/l32 0 2024-01-17T23:33:42.946 INFO:tasks.workunit.client.0.smithi161.stdout:1/249: mknod d1/d31/d4e/c55 0 2024-01-17T23:33:42.946 INFO:tasks.workunit.client.0.smithi161.stdout:4/243: creat d9/de/f41 x:0 0 0 2024-01-17T23:33:42.973 INFO:tasks.workunit.client.0.smithi161.stdout:4/244: write d9/f34 [2133274,2415] 0 2024-01-17T23:33:42.999 INFO:tasks.workunit.client.0.smithi161.stdout:4/245: dwrite d9/fb [0,4194304] 0 2024-01-17T23:33:42.999 INFO:tasks.workunit.client.0.smithi161.stdout:4/246: chown d9/l3f 9 1 2024-01-17T23:33:43.870 INFO:tasks.workunit.client.0.smithi161.stdout:0/250: mknod d5/d34/d12/d2a/d35/c4b 0 2024-01-17T23:33:43.870 INFO:tasks.workunit.client.0.smithi161.stdout:0/251: chown d5/d34/d12/d2a/d35/c4b 34178 1 2024-01-17T23:33:43.894 INFO:tasks.workunit.client.0.smithi161.stdout:0/252: dwrite d5/d34/f47 [0,4194304] 0 2024-01-17T23:33:43.920 INFO:tasks.workunit.client.0.smithi161.stdout:0/253: dread d5/d34/d12/f1d [4194304,4194304] 0 2024-01-17T23:33:43.920 INFO:tasks.workunit.client.0.smithi161.stdout:0/254: fdatasync f1 0 2024-01-17T23:33:44.061 INFO:tasks.workunit.client.0.smithi161.stdout:7/226: creat da/d34/d4a/f5c x:0 0 0 2024-01-17T23:33:44.061 INFO:tasks.workunit.client.0.smithi161.stdout:7/227: write da/f26 [1875121,96294] 0 2024-01-17T23:33:44.076 INFO:tasks.workunit.client.0.smithi161.stdout:7/228: read da/d34/d5a/d28/f3e [726696,12774] 0 2024-01-17T23:33:44.076 INFO:tasks.workunit.client.0.smithi161.stdout:7/229: chown da/f15 675 1 2024-01-17T23:33:44.381 INFO:tasks.workunit.client.0.smithi161.stdout:6/198: mkdir d6/d7/dc/d3c/d41 0 2024-01-17T23:33:44.553 INFO:tasks.workunit.client.0.smithi161.stdout:3/171: symlink d0/d5/l34 0 2024-01-17T23:33:44.621 INFO:tasks.workunit.client.0.smithi161.stdout:9/155: unlink d0/d8/d14/d18/d20/l2f 0 2024-01-17T23:33:44.621 INFO:tasks.workunit.client.0.smithi161.stdout:9/156: dread - d0/f2a zero size 2024-01-17T23:33:44.868 INFO:tasks.workunit.client.0.smithi161.stdout:1/250: creat d1/d8/f56 x:0 0 0 2024-01-17T23:33:44.869 INFO:tasks.workunit.client.0.smithi161.stdout:1/251: stat d1/l40 0 2024-01-17T23:33:44.907 INFO:tasks.workunit.client.0.smithi161.stdout:1/252: dwrite d1/d8/d1f/f49 [0,4194304] 0 2024-01-17T23:33:44.977 INFO:tasks.workunit.client.0.smithi161.stdout:2/178: rename d8/c13 to d8/d1c/c3f 0 2024-01-17T23:33:44.990 INFO:tasks.workunit.client.0.smithi161.stdout:2/179: write d8/da/f10 [1020638,49176] 0 2024-01-17T23:33:45.632 INFO:tasks.workunit.client.0.smithi161.stdout:7/230: getdents da/d34/d5a/d28/d43 0 2024-01-17T23:33:45.778 INFO:tasks.workunit.client.0.smithi161.stdout:5/204: rmdir dd/d15/d33 0 2024-01-17T23:33:45.796 INFO:tasks.workunit.client.0.smithi161.stdout:5/205: dread dd/f11 [0,4194304] 0 2024-01-17T23:33:45.921 INFO:tasks.workunit.client.0.smithi161.stdout:6/199: symlink d6/d9/d13/l42 0 2024-01-17T23:33:45.957 INFO:tasks.workunit.client.0.smithi161.stdout:6/200: dwrite d6/d9/d1a/f3f [0,4194304] 0 2024-01-17T23:33:46.035 INFO:tasks.workunit.client.0.smithi161.stdout:3/172: symlink d0/d5/d9/d17/l35 0 2024-01-17T23:33:46.252 INFO:tasks.workunit.client.0.smithi161.stdout:9/157: creat d0/f33 x:0 0 0 2024-01-17T23:33:46.253 INFO:tasks.workunit.client.0.smithi161.stdout:9/158: write d0/d8/d14/f29 [340913,49072] 0 2024-01-17T23:33:46.556 INFO:tasks.workunit.client.0.smithi161.stdout:1/253: mknod d1/d20/d26/d32/c57 0 2024-01-17T23:33:46.557 INFO:tasks.workunit.client.0.smithi161.stdout:1/254: chown d1/d11/l33 6971982 1 2024-01-17T23:33:46.557 INFO:tasks.workunit.client.0.smithi161.stdout:1/255: chown d1/d8/d1c 14 1 2024-01-17T23:33:46.692 INFO:tasks.workunit.client.0.smithi161.stdout:8/171: rename d1/d22/f2c to d1/d3/d19/d1d/d25/f3b 0 2024-01-17T23:33:46.885 INFO:tasks.workunit.client.0.smithi161.stdout:2/180: link d8/d1c/d1e/l2c d8/d1c/l40 0 2024-01-17T23:33:47.031 INFO:tasks.workunit.client.0.smithi161.stdout:7/231: symlink da/d34/d5a/d28/l5d 0 2024-01-17T23:33:47.251 INFO:tasks.workunit.client.0.smithi161.stdout:5/206: mknod dd/c3a 0 2024-01-17T23:33:47.772 INFO:tasks.workunit.client.0.smithi161.stdout:6/201: mkdir d6/d7/dc/d43 0 2024-01-17T23:33:47.772 INFO:tasks.workunit.client.0.smithi161.stdout:6/202: chown d6/d7/d16/f36 0 1 2024-01-17T23:33:47.773 INFO:tasks.workunit.client.0.smithi161.stdout:3/173: truncate d0/d5/f1d 2452880 0 2024-01-17T23:33:48.026 INFO:tasks.workunit.client.0.smithi161.stdout:9/159: getdents d0/d8/d14 0 2024-01-17T23:33:48.026 INFO:tasks.workunit.client.0.smithi161.stdout:9/160: readlink d0/l16 0 2024-01-17T23:33:48.026 INFO:tasks.workunit.client.0.smithi161.stdout:9/161: fdatasync d0/d8/d14/f29 0 2024-01-17T23:33:48.049 INFO:tasks.workunit.client.0.smithi161.stdout:9/162: dwrite d0/f33 [0,4194304] 0 2024-01-17T23:33:48.049 INFO:tasks.workunit.client.0.smithi161.stdout:9/163: write d0/f30 [840407,33480] 0 2024-01-17T23:33:48.229 INFO:tasks.workunit.client.0.smithi161.stdout:0/255: rename d5/le to d5/d3a/d49/l4c 0 2024-01-17T23:33:48.582 INFO:tasks.workunit.client.0.smithi161.stdout:8/172: creat d1/df/d20/d2a/f3c x:0 0 0 2024-01-17T23:33:48.621 INFO:tasks.workunit.client.0.smithi161.stdout:2/181: dread d8/d1c/d1e/f2a [0,4194304] 0 2024-01-17T23:33:49.197 INFO:tasks.workunit.client.0.smithi161.stdout:4/247: rmdir d9/de/d1e 39 2024-01-17T23:33:49.212 INFO:tasks.workunit.client.0.smithi161.stdout:4/248: dread d9/f34 [0,4194304] 0 2024-01-17T23:33:49.212 INFO:tasks.workunit.client.0.smithi161.stdout:4/249: write d9/de/d1e/f36 [422016,78508] 0 2024-01-17T23:33:49.342 INFO:tasks.workunit.client.0.smithi161.stdout:5/207: getdents dd/d15/d1a/d34 0 2024-01-17T23:33:49.535 INFO:tasks.workunit.client.0.smithi161.stdout:6/203: mknod d6/d9/c44 0 2024-01-17T23:33:49.653 INFO:tasks.workunit.client.0.smithi161.stdout:3/174: creat d0/d5/d9/d17/f36 x:0 0 0 2024-01-17T23:33:49.653 INFO:tasks.workunit.client.0.smithi161.stdout:3/175: fsync d0/f2e 0 2024-01-17T23:33:49.653 INFO:tasks.workunit.client.0.smithi161.stdout:3/176: creat d0/d5/d9/d17/f37 x:0 0 0 2024-01-17T23:33:49.653 INFO:tasks.workunit.client.0.smithi161.stdout:3/177: write d0/d5/d9/d17/f1c [4488882,25169] 0 2024-01-17T23:33:50.332 INFO:tasks.workunit.client.0.smithi161.stdout:0/256: symlink d5/d34/d12/l4d 0 2024-01-17T23:33:50.759 INFO:tasks.workunit.client.0.smithi161.stdout:2/182: readlink d8/d1c/d1e/l22 0 2024-01-17T23:33:50.942 INFO:tasks.workunit.client.0.smithi161.stdout:4/250: symlink d9/de/l42 0 2024-01-17T23:33:51.010 INFO:tasks.workunit.client.0.smithi161.stdout:5/208: link dd/c1e dd/c3b 0 2024-01-17T23:33:51.153 INFO:tasks.workunit.client.0.smithi161.stdout:6/204: rmdir d6/d7/dc/d3c/d41 0 2024-01-17T23:33:51.541 INFO:tasks.workunit.client.0.smithi161.stdout:9/164: getdents d0 0 2024-01-17T23:33:51.647 INFO:tasks.workunit.client.0.smithi161.stdout:3/178: dwrite d0/d5/f1d [0,4194304] 0 2024-01-17T23:33:51.648 INFO:tasks.workunit.client.0.smithi161.stdout:3/179: chown d0/d5/d9/d17/d32 20992943 1 2024-01-17T23:33:51.655 INFO:tasks.workunit.client.0.smithi161.stdout:3/180: dread d0/d5/d9/f13 [0,4194304] 0 2024-01-17T23:33:51.760 INFO:tasks.workunit.client.0.smithi161.stdout:0/257: symlink d5/d34/d12/l4e 0 2024-01-17T23:33:51.760 INFO:tasks.workunit.client.0.smithi161.stdout:0/258: chown d5/d34/f23 7756 1 2024-01-17T23:33:51.964 INFO:tasks.workunit.client.0.smithi161.stdout:2/183: mknod d8/da/d2d/c41 0 2024-01-17T23:33:51.965 INFO:tasks.workunit.client.0.smithi161.stdout:4/251: unlink d9/de/f14 0 2024-01-17T23:33:51.965 INFO:tasks.workunit.client.0.smithi161.stdout:2/184: fsync d8/da/f27 0 2024-01-17T23:33:52.001 INFO:tasks.workunit.client.0.smithi161.stdout:2/185: dwrite d8/d1c/f1f [4194304,4194304] 0 2024-01-17T23:33:52.236 INFO:tasks.workunit.client.0.smithi161.stdout:6/205: symlink d6/d9/d1a/l45 0 2024-01-17T23:33:52.236 INFO:tasks.workunit.client.0.smithi161.stdout:6/206: creat d6/d7/d16/f46 x:0 0 0 2024-01-17T23:33:52.236 INFO:tasks.workunit.client.0.smithi161.stdout:6/207: write d6/d9/f11 [801710,48416] 0 2024-01-17T23:33:52.262 INFO:tasks.workunit.client.0.smithi161.stdout:6/208: dwrite d6/d7/d16/f18 [0,4194304] 0 2024-01-17T23:33:52.598 INFO:tasks.workunit.client.0.smithi161.stdout:3/181: mkdir d0/d5/d9/d38 0 2024-01-17T23:33:52.598 INFO:tasks.workunit.client.0.smithi161.stdout:3/182: fsync d0/f4 0 2024-01-17T23:33:52.598 INFO:tasks.workunit.client.0.smithi161.stdout:3/183: chown d0/d5/d9/d1e/l20 14390440 1 2024-01-17T23:33:52.598 INFO:tasks.workunit.client.0.smithi161.stdout:3/184: fdatasync d0/f29 0 2024-01-17T23:33:53.282 INFO:tasks.workunit.client.0.smithi161.stdout:0/259: creat d5/d34/d12/f4f x:0 0 0 2024-01-17T23:33:53.282 INFO:tasks.workunit.client.0.smithi161.stdout:0/260: write d5/f25 [617642,46453] 0 2024-01-17T23:33:53.282 INFO:tasks.workunit.client.0.smithi161.stdout:0/261: write d5/d34/d12/d2a/f38 [326238,97472] 0 2024-01-17T23:33:53.628 INFO:tasks.workunit.client.0.smithi161.stdout:4/252: creat d9/d1b/d24/f43 x:0 0 0 2024-01-17T23:33:53.628 INFO:tasks.workunit.client.0.smithi161.stdout:4/253: chown d9/de/f1d 1811 1 2024-01-17T23:33:54.122 INFO:tasks.workunit.client.0.smithi161.stdout:6/209: stat d6/d7/dc/c14 0 2024-01-17T23:33:54.153 INFO:tasks.workunit.client.0.smithi161.stdout:6/210: dwrite d6/d7/fe [0,4194304] 0 2024-01-17T23:33:54.190 INFO:tasks.workunit.client.0.smithi161.stdout:6/211: dwrite d6/d7/dc/f19 [0,4194304] 0 2024-01-17T23:33:54.607 INFO:tasks.workunit.client.0.smithi161.stdout:0/262: symlink d5/d34/d12/d2a/d35/l50 0 2024-01-17T23:33:54.760 INFO:tasks.workunit.client.0.smithi161.stdout:4/254: symlink d9/d1b/d24/d25/l44 0 2024-01-17T23:33:54.760 INFO:tasks.workunit.client.0.smithi161.stdout:4/255: chown d9/de/d1e/l20 0 1 2024-01-17T23:33:54.760 INFO:tasks.workunit.client.0.smithi161.stdout:4/256: fsync d9/f34 0 2024-01-17T23:33:55.480 INFO:tasks.workunit.client.0.smithi161.stdout:4/257: creat d9/de/f45 x:0 0 0 2024-01-17T23:33:55.482 INFO:tasks.workunit.client.0.smithi161.stdout:1/256: rename d1/f3 to d1/d20/d26/d30/f58 0 2024-01-17T23:33:55.499 INFO:tasks.workunit.client.0.smithi161.stdout:5/209: truncate dd/d15/d1a/d34/f36 3389900 0 2024-01-17T23:33:55.546 INFO:tasks.workunit.client.0.smithi161.stdout:2/186: dwrite d8/da/d2d/f33 [0,4194304] 0 2024-01-17T23:33:55.908 INFO:tasks.workunit.client.0.smithi161.stdout:7/232: rename da/db/c19 to da/d14/d35/c5e 0 2024-01-17T23:33:55.908 INFO:tasks.workunit.client.0.smithi161.stdout:7/233: dread - da/d34/d5a/d3b/f55 zero size 2024-01-17T23:33:55.936 INFO:tasks.workunit.client.0.smithi161.stdout:7/234: dwrite da/d34/d5a/f2f [4194304,4194304] 0 2024-01-17T23:33:55.936 INFO:tasks.workunit.client.0.smithi161.stdout:7/235: write da/d34/d5a/d3b/f55 [57198,45148] 0 2024-01-17T23:33:56.081 INFO:tasks.workunit.client.0.smithi161.stdout:1/257: mknod d1/d8/d1c/c59 0 2024-01-17T23:33:56.081 INFO:tasks.workunit.client.0.smithi161.stdout:1/258: readlink d1/l42 0 2024-01-17T23:33:56.583 INFO:tasks.workunit.client.0.smithi161.stdout:4/258: rmdir d9/d1b 39 2024-01-17T23:33:56.584 INFO:tasks.workunit.client.0.smithi161.stdout:4/259: readlink d9/de/d1e/l2d 0 2024-01-17T23:33:56.738 INFO:tasks.workunit.client.0.smithi161.stdout:8/173: rename d1/df/d20/d32 to d1/d3d 0 2024-01-17T23:33:57.158 INFO:tasks.workunit.client.0.smithi161.stdout:9/165: sync 2024-01-17T23:33:57.158 INFO:tasks.workunit.client.0.smithi161.stdout:3/185: sync 2024-01-17T23:33:57.158 INFO:tasks.workunit.client.0.smithi161.stdout:9/166: stat d0/d8/d14/d18/l1e 0 2024-01-17T23:33:57.171 INFO:tasks.workunit.client.0.smithi161.stdout:5/210: dread dd/d15/f1c [0,4194304] 0 2024-01-17T23:33:57.200 INFO:tasks.workunit.client.0.smithi161.stdout:3/186: dwrite d0/d5/f26 [0,4194304] 0 2024-01-17T23:33:57.200 INFO:tasks.workunit.client.0.smithi161.stdout:3/187: truncate d0/d5/d9/d17/f37 715956 0 2024-01-17T23:33:57.201 INFO:tasks.workunit.client.0.smithi161.stdout:3/188: write d0/f4 [686108,72744] 0 2024-01-17T23:33:57.518 INFO:tasks.workunit.client.0.smithi161.stdout:1/259: creat d1/d8/f5a x:0 0 0 2024-01-17T23:33:57.753 INFO:tasks.workunit.client.0.smithi161.stdout:2/187: mknod d8/d1c/d1e/c42 0 2024-01-17T23:33:57.754 INFO:tasks.workunit.client.0.smithi161.stdout:4/260: symlink d9/de/d1e/l46 0 2024-01-17T23:33:57.782 INFO:tasks.workunit.client.0.smithi161.stdout:2/188: dwrite d8/da/d2d/f33 [0,4194304] 0 2024-01-17T23:33:58.135 INFO:tasks.workunit.client.0.smithi161.stdout:9/167: mknod d0/c34 0 2024-01-17T23:33:58.279 INFO:tasks.workunit.client.0.smithi161.stdout:5/211: stat dd/c3b 0 2024-01-17T23:33:58.351 INFO:tasks.workunit.client.0.smithi161.stdout:3/189: rmdir d0/d5 39 2024-01-17T23:33:58.614 INFO:tasks.workunit.client.0.smithi161.stdout:1/260: mkdir d1/d2d/d3b/d5b 0 2024-01-17T23:33:58.622 INFO:tasks.workunit.client.0.smithi161.stdout:1/261: write d1/d20/d26/f2f [1816396,21933] 0 2024-01-17T23:33:58.623 INFO:tasks.workunit.client.0.smithi161.stdout:1/262: stat d1/d8/d1f/f25 0 2024-01-17T23:33:58.951 INFO:tasks.workunit.client.0.smithi161.stdout:7/236: sync 2024-01-17T23:33:58.951 INFO:tasks.workunit.client.0.smithi161.stdout:7/237: write da/d34/d5a/d28/d43/f59 [185898,27808] 0 2024-01-17T23:33:58.951 INFO:tasks.workunit.client.0.smithi161.stdout:7/238: chown da/lf 4930 1 2024-01-17T23:33:59.219 INFO:tasks.workunit.client.0.smithi161.stdout:2/189: symlink d8/d1c/l43 0 2024-01-17T23:33:59.219 INFO:tasks.workunit.client.0.smithi161.stdout:2/190: chown d8/d1c 5 1 2024-01-17T23:33:59.661 INFO:tasks.workunit.client.0.smithi161.stdout:6/212: rename d6/d9 to d6/d7/dc/d3c/d47 0 2024-01-17T23:33:59.662 INFO:tasks.workunit.client.0.smithi161.stdout:5/212: mkdir dd/d31/d3c 0 2024-01-17T23:33:59.662 INFO:tasks.workunit.client.0.smithi161.stdout:5/213: chown dd/f24 1 1 2024-01-17T23:33:59.665 INFO:tasks.workunit.client.0.smithi161.stdout:5/214: write dd/d15/f1d [362461,29025] 0 2024-01-17T23:33:59.665 INFO:tasks.workunit.client.0.smithi161.stdout:5/215: readlink dd/d15/l35 0 2024-01-17T23:33:59.665 INFO:tasks.workunit.client.0.smithi161.stdout:5/216: read - dd/d15/f2e zero size 2024-01-17T23:33:59.903 INFO:tasks.workunit.client.0.smithi161.stdout:3/190: creat d0/d5/d9/d1e/f39 x:0 0 0 2024-01-17T23:33:59.979 INFO:tasks.workunit.client.0.smithi161.stdout:1/263: creat d1/d20/f5c x:0 0 0 2024-01-17T23:33:59.979 INFO:tasks.workunit.client.0.smithi161.stdout:1/264: creat d1/d8/d1c/f5d x:0 0 0 2024-01-17T23:33:59.979 INFO:tasks.workunit.client.0.smithi161.stdout:1/265: fdatasync d1/d20/d26/d30/d44/f52 0 2024-01-17T23:33:59.980 INFO:tasks.workunit.client.0.smithi161.stdout:1/266: chown d1/d31/d4e/c55 55309792 1 2024-01-17T23:33:59.980 INFO:tasks.workunit.client.0.smithi161.stdout:1/267: readlink d1/l42 0 2024-01-17T23:34:00.249 INFO:tasks.workunit.client.0.smithi161.stdout:7/239: creat da/f5f x:0 0 0 2024-01-17T23:34:00.643 INFO:tasks.workunit.client.0.smithi161.stdout:0/263: rename d5/d8/c27 to d5/d34/c51 0 2024-01-17T23:34:00.668 INFO:tasks.workunit.client.0.smithi161.stdout:0/264: dwrite d5/d34/d21/f3d [0,4194304] 0 2024-01-17T23:34:00.669 INFO:tasks.workunit.client.0.smithi161.stdout:0/265: chown d5/d34/c51 116835 1 2024-01-17T23:34:00.908 INFO:tasks.workunit.client.0.smithi161.stdout:5/217: mknod dd/d15/c3d 0 2024-01-17T23:34:00.998 INFO:tasks.workunit.client.0.smithi161.stdout:1/268: link d1/d8/l14 d1/d20/d26/d30/l5e 0 2024-01-17T23:34:00.998 INFO:tasks.workunit.client.0.smithi161.stdout:1/269: truncate d1/d20/d26/d32/f4a 444232 0 2024-01-17T23:34:01.276 INFO:tasks.workunit.client.0.smithi161.stdout:9/168: rename d0/c12 to d0/d8/d14/c35 0 2024-01-17T23:34:01.279 INFO:tasks.workunit.client.0.smithi161.stdout:4/261: sync 2024-01-17T23:34:01.279 INFO:tasks.workunit.client.0.smithi161.stdout:8/174: sync 2024-01-17T23:34:01.279 INFO:tasks.workunit.client.0.smithi161.stdout:8/175: stat d1/df/d20/d2a/f34 0 2024-01-17T23:34:01.279 INFO:tasks.workunit.client.0.smithi161.stdout:8/176: fsync d1/df/d20/d2a/f34 0 2024-01-17T23:34:01.279 INFO:tasks.workunit.client.0.smithi161.stdout:8/177: fsync d1/d3/f9 0 2024-01-17T23:34:01.289 INFO:tasks.workunit.client.0.smithi161.stdout:4/262: dread d9/de/d1e/f32 [0,4194304] 0 2024-01-17T23:34:01.421 INFO:tasks.workunit.client.0.smithi161.stdout:0/266: mknod d5/d34/c52 0 2024-01-17T23:34:01.449 INFO:tasks.workunit.client.0.smithi161.stdout:0/267: dwrite d5/f32 [0,4194304] 0 2024-01-17T23:34:01.484 INFO:tasks.workunit.client.0.smithi161.stdout:0/268: dwrite d5/d34/d20/d2b/f33 [0,4194304] 0 2024-01-17T23:34:01.484 INFO:tasks.workunit.client.0.smithi161.stdout:0/269: stat d5/d8/f9 0 2024-01-17T23:34:01.484 INFO:tasks.workunit.client.0.smithi161.stdout:0/270: write d5/d34/d20/d2b/f33 [4633942,3254] 0 2024-01-17T23:34:01.699 INFO:tasks.workunit.client.0.smithi161.stdout:1/270: creat d1/d20/d26/d30/f5f x:0 0 0 2024-01-17T23:34:01.807 INFO:tasks.workunit.client.0.smithi161.stdout:9/169: mknod d0/d8/d14/d18/c36 0 2024-01-17T23:34:01.807 INFO:tasks.workunit.client.0.smithi161.stdout:9/170: fdatasync d0/d8/f28 0 2024-01-17T23:34:01.808 INFO:tasks.workunit.client.0.smithi161.stdout:9/171: creat d0/d8/d14/d18/d20/f37 x:0 0 0 2024-01-17T23:34:01.961 INFO:tasks.workunit.client.0.smithi161.stdout:6/213: rename d6/d7/dc/d3c/d47/d1a/c23 to d6/d7/dc/d43/c48 0 2024-01-17T23:34:01.962 INFO:tasks.workunit.client.0.smithi161.stdout:3/191: rename d0/d5 to d0/d5/d9/d17/d32/d3a 22 2024-01-17T23:34:01.974 INFO:tasks.workunit.client.0.smithi161.stdout:6/214: dread d6/fa [0,4194304] 0 2024-01-17T23:34:02.098 INFO:tasks.workunit.client.0.smithi161.stdout:8/178: creat d1/df/d20/f3e x:0 0 0 2024-01-17T23:34:02.164 INFO:tasks.workunit.client.0.smithi161.stdout:4/263: getdents d9/d27 0 2024-01-17T23:34:02.181 INFO:tasks.workunit.client.0.smithi161.stdout:2/191: sync 2024-01-17T23:34:02.226 INFO:tasks.workunit.client.0.smithi161.stdout:2/192: dwrite d8/d1c/f25 [4194304,4194304] 0 2024-01-17T23:34:02.544 INFO:tasks.workunit.client.0.smithi161.stdout:0/271: symlink d5/d34/d20/d2d/l53 0 2024-01-17T23:34:02.935 INFO:tasks.workunit.client.0.smithi161.stdout:3/192: truncate d0/d5/d9/d17/f37 275564 0 2024-01-17T23:34:02.935 INFO:tasks.workunit.client.0.smithi161.stdout:7/240: rename da/d34/d5a/d28/d43/l57 to da/d34/d4a/l60 0 2024-01-17T23:34:02.935 INFO:tasks.workunit.client.0.smithi161.stdout:3/193: chown d0/d5/f26 1382797 1 2024-01-17T23:34:02.935 INFO:tasks.workunit.client.0.smithi161.stdout:3/194: chown d0/c3 17629846 1 2024-01-17T23:34:02.935 INFO:tasks.workunit.client.0.smithi161.stdout:7/241: chown da/d34/d5a/d3b/d3d 8666 1 2024-01-17T23:34:02.935 INFO:tasks.workunit.client.0.smithi161.stdout:3/195: write d0/f1f [1674447,17075] 0 2024-01-17T23:34:03.144 INFO:tasks.workunit.client.0.smithi161.stdout:6/215: creat d6/d7/dc/d3c/d47/f49 x:0 0 0 2024-01-17T23:34:03.349 INFO:tasks.workunit.client.0.smithi161.stdout:8/179: link d1/df/d20/d2a/f34 d1/d22/d2f/f3f 0 2024-01-17T23:34:03.350 INFO:tasks.workunit.client.0.smithi161.stdout:8/180: truncate d1/df/f14 4197079 0 2024-01-17T23:34:03.985 INFO:tasks.workunit.client.0.smithi161.stdout:5/218: dwrite dd/f12 [0,4194304] 0 2024-01-17T23:34:03.985 INFO:tasks.workunit.client.0.smithi161.stdout:5/219: fsync dd/f14 0 2024-01-17T23:34:03.991 INFO:tasks.workunit.client.0.smithi161.stdout:5/220: dread dd/d15/f23 [0,4194304] 0 2024-01-17T23:34:04.592 INFO:tasks.workunit.client.0.smithi161.stdout:0/272: truncate d5/d34/d12/f1d 7342202 0 2024-01-17T23:34:04.593 INFO:tasks.workunit.client.0.smithi161.stdout:0/273: dread - d5/d34/d20/d2b/f44 zero size 2024-01-17T23:34:04.593 INFO:tasks.workunit.client.0.smithi161.stdout:0/274: creat d5/d3a/f54 x:0 0 0 2024-01-17T23:34:04.593 INFO:tasks.workunit.client.0.smithi161.stdout:1/271: rename d1/d8/c4d to d1/d20/d26/c60 0 2024-01-17T23:34:04.607 INFO:tasks.workunit.client.0.smithi161.stdout:0/275: write d5/d34/d12/f37 [2059539,34626] 0 2024-01-17T23:34:04.615 INFO:tasks.workunit.client.0.smithi161.stdout:0/276: dread d5/d2e/f31 [0,4194304] 0 2024-01-17T23:34:04.615 INFO:tasks.workunit.client.0.smithi161.stdout:0/277: stat d5/d2e/c46 0 2024-01-17T23:34:04.706 INFO:tasks.workunit.client.0.smithi161.stdout:7/242: creat da/d34/d5a/d3b/f61 x:0 0 0 2024-01-17T23:34:04.706 INFO:tasks.workunit.client.0.smithi161.stdout:7/243: write da/d34/d5a/d28/d43/f5b [930141,32250] 0 2024-01-17T23:34:04.706 INFO:tasks.workunit.client.0.smithi161.stdout:3/196: mkdir d0/d5/d9/d1e/d3b 0 2024-01-17T23:34:04.715 INFO:tasks.workunit.client.0.smithi161.stdout:6/216: creat d6/d7/dc/d3c/f4a x:0 0 0 2024-01-17T23:34:04.935 INFO:tasks.workunit.client.0.smithi161.stdout:5/221: symlink dd/d31/d3c/l3e 0 2024-01-17T23:34:05.322 INFO:tasks.workunit.client.0.smithi161.stdout:9/172: rename d0/d8/cf to d0/d8/d31/c38 0 2024-01-17T23:34:05.604 INFO:tasks.workunit.client.0.smithi161.stdout:1/272: mknod d1/d20/d26/d30/d44/c61 0 2024-01-17T23:34:05.842 INFO:tasks.workunit.client.0.smithi161.stdout:0/278: truncate f1 5189934 0 2024-01-17T23:34:06.196 INFO:tasks.workunit.client.0.smithi161.stdout:3/197: mknod d0/d5/d9/d1e/d3b/c3c 0 2024-01-17T23:34:06.430 INFO:tasks.workunit.client.0.smithi161.stdout:5/222: mknod dd/d31/d3c/c3f 0 2024-01-17T23:34:06.572 INFO:tasks.workunit.client.0.smithi161.stdout:2/193: unlink d8/da/c36 0 2024-01-17T23:34:06.682 INFO:tasks.workunit.client.0.smithi161.stdout:8/181: rename d1/d3/f24 to d1/d3d/f40 0 2024-01-17T23:34:06.682 INFO:tasks.workunit.client.0.smithi161.stdout:8/182: chown d1/d3/d19/d1d 47565619 1 2024-01-17T23:34:07.379 INFO:tasks.workunit.client.0.smithi161.stdout:5/223: unlink dd/d15/d1a/d34/f36 0 2024-01-17T23:34:07.796 INFO:tasks.workunit.client.0.smithi161.stdout:2/194: creat d8/d1c/d1e/f44 x:0 0 0 2024-01-17T23:34:07.796 INFO:tasks.workunit.client.0.smithi161.stdout:2/195: dread - d8/d1c/d1e/f3d zero size 2024-01-17T23:34:07.810 INFO:tasks.workunit.client.0.smithi161.stdout:2/196: write d8/f14 [208221,18920] 0 2024-01-17T23:34:07.810 INFO:tasks.workunit.client.0.smithi161.stdout:2/197: dread - d8/d1c/d1e/f44 zero size 2024-01-17T23:34:07.815 INFO:tasks.workunit.client.0.smithi161.stdout:2/198: dread d8/da/f27 [0,4194304] 0 2024-01-17T23:34:07.876 INFO:tasks.workunit.client.0.smithi161.stdout:8/183: link d1/d3/d19/f21 d1/d3d/f41 0 2024-01-17T23:34:07.898 INFO:tasks.workunit.client.0.smithi161.stdout:8/184: dread d1/df/d20/d2a/f34 [0,4194304] 0 2024-01-17T23:34:08.066 INFO:tasks.workunit.client.0.smithi161.stdout:3/198: symlink d0/l3d 0 2024-01-17T23:34:08.167 INFO:tasks.workunit.client.0.smithi161.stdout:5/224: mknod dd/d31/d3c/c40 0 2024-01-17T23:34:08.476 INFO:tasks.workunit.client.0.smithi161.stdout:2/199: mkdir d8/da/d2d/d34/d45 0 2024-01-17T23:34:08.476 INFO:tasks.workunit.client.0.smithi161.stdout:2/200: stat d8/d1c/l29 0 2024-01-17T23:34:08.476 INFO:tasks.workunit.client.0.smithi161.stdout:2/201: stat d8/d1c/d1e/f2a 0 2024-01-17T23:34:08.804 INFO:tasks.workunit.client.0.smithi161.stdout:3/199: link d0/d5/c28 d0/d5/d9/d17/c3e 0 2024-01-17T23:34:08.804 INFO:tasks.workunit.client.0.smithi161.stdout:3/200: fdatasync d0/d5/f1d 0 2024-01-17T23:34:09.182 INFO:tasks.workunit.client.0.smithi161.stdout:2/202: read d8/f18 [3006945,37198] 0 2024-01-17T23:34:09.439 INFO:tasks.workunit.client.0.smithi161.stdout:8/185: rmdir d1/d1c 39 2024-01-17T23:34:09.497 INFO:tasks.workunit.client.0.smithi161.stdout:3/201: symlink d0/d5/d9/d1e/l3f 0 2024-01-17T23:34:09.878 INFO:tasks.workunit.client.0.smithi161.stdout:2/203: symlink d8/d1c/l46 0 2024-01-17T23:34:09.885 INFO:tasks.workunit.client.0.smithi161.stdout:4/264: sync 2024-01-17T23:34:09.969 INFO:tasks.workunit.client.0.smithi161.stdout:8/186: creat d1/d3d/f42 x:0 0 0 2024-01-17T23:34:09.969 INFO:tasks.workunit.client.0.smithi161.stdout:8/187: dread - d1/d3/d19/d1d/f36 zero size 2024-01-17T23:34:09.985 INFO:tasks.workunit.client.0.smithi161.stdout:8/188: dread d1/d3/f9 [0,4194304] 0 2024-01-17T23:34:09.985 INFO:tasks.workunit.client.0.smithi161.stdout:8/189: truncate d1/d3d/f42 418874 0 2024-01-17T23:34:10.023 INFO:tasks.workunit.client.0.smithi161.stdout:8/190: dwrite d1/f2 [0,4194304] 0 2024-01-17T23:34:10.073 INFO:tasks.workunit.client.0.smithi161.stdout:8/191: dwrite d1/d22/d2f/f3f [4194304,4194304] 0 2024-01-17T23:34:10.074 INFO:tasks.workunit.client.0.smithi161.stdout:8/192: chown d1/d3d/f41 52498 1 2024-01-17T23:34:10.096 INFO:tasks.workunit.client.0.smithi161.stdout:8/193: dwrite d1/f2 [4194304,4194304] 0 2024-01-17T23:34:10.236 INFO:tasks.workunit.client.0.smithi161.stdout:2/204: symlink d8/da/d2d/d34/d35/d3a/l47 0 2024-01-17T23:34:10.352 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:34:10.356 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:34:11.030 INFO:tasks.workunit.client.0.smithi161.stdout:8/194: truncate d1/df/f31 1853000 0 2024-01-17T23:34:11.050 INFO:tasks.workunit.client.0.smithi161.stdout:8/195: write d1/d3/f9 [4153744,90531] 0 2024-01-17T23:34:11.058 INFO:tasks.workunit.client.0.smithi161.stdout:7/244: creat da/f62 x:0 0 0 2024-01-17T23:34:11.062 INFO:tasks.workunit.client.0.smithi161.stdout:1/273: write d1/d20/d26/d30/f58 [789944,51486] 0 2024-01-17T23:34:11.062 INFO:tasks.workunit.client.0.smithi161.stdout:1/274: stat d1/d8/l1d 0 2024-01-17T23:34:11.062 INFO:tasks.workunit.client.0.smithi161.stdout:6/217: creat d6/d7/dc/f4b x:0 0 0 2024-01-17T23:34:11.088 INFO:tasks.workunit.client.0.smithi161.stdout:6/218: dwrite d6/f3d [0,4194304] 0 2024-01-17T23:34:11.538 INFO:tasks.workunit.client.0.smithi161.stdout:8/196: truncate d1/d3/f18 1066648 0 2024-01-17T23:34:11.632 INFO:tasks.workunit.client.0.smithi161.stdout:7/245: truncate da/d34/d5a/d28/d43/f5b 695556 0 2024-01-17T23:34:11.650 INFO:tasks.workunit.client.0.smithi161.stdout:7/246: write da/d34/d5a/d3b/f4b [3233517,124155] 0 2024-01-17T23:34:11.650 INFO:tasks.workunit.client.0.smithi161.stdout:7/247: fdatasync da/d14/f32 0 2024-01-17T23:34:11.654 INFO:tasks.workunit.client.0.smithi161.stdout:7/248: dread da/d34/d5a/d3b/f55 [0,4194304] 0 2024-01-17T23:34:11.654 INFO:tasks.workunit.client.0.smithi161.stdout:7/249: write da/f51 [473308,63537] 0 2024-01-17T23:34:11.666 INFO:tasks.workunit.client.0.smithi161.stdout:5/225: write dd/d15/f22 [1232500,7523] 0 2024-01-17T23:34:11.693 INFO:tasks.workunit.client.0.smithi161.stdout:5/226: dwrite dd/d31/f38 [0,4194304] 0 2024-01-17T23:34:12.235 INFO:tasks.workunit.client.0.smithi161.stdout:8/197: creat d1/d22/d2f/f43 x:0 0 0 2024-01-17T23:34:12.321 INFO:tasks.workunit.client.0.smithi161.stdout:3/202: write d0/d5/fa [3631262,99686] 0 2024-01-17T23:34:12.341 INFO:tasks.workunit.client.0.smithi161.stdout:3/203: dread d0/d5/fa [0,4194304] 0 2024-01-17T23:34:12.341 INFO:tasks.workunit.client.0.smithi161.stdout:3/204: chown d0/d5/d9/d1e/l20 5 1 2024-01-17T23:34:12.341 INFO:tasks.workunit.client.0.smithi161.stdout:3/205: dread - d0/d5/d9/d1e/f39 zero size 2024-01-17T23:34:12.622 INFO:tasks.workunit.client.0.smithi161.stdout:2/205: rmdir d8/da/d2d 39 2024-01-17T23:34:12.622 INFO:tasks.workunit.client.0.smithi161.stdout:7/250: symlink da/d34/d5a/d28/d2b/l63 0 2024-01-17T23:34:12.622 INFO:tasks.workunit.client.0.smithi161.stdout:2/206: rename d8/da/d2d/d34 to d8/da/d2d/d34/d48 22 2024-01-17T23:34:12.622 INFO:tasks.workunit.client.0.smithi161.stdout:2/207: chown d8/d1c/d1e/c42 2096 1 2024-01-17T23:34:12.622 INFO:tasks.workunit.client.0.smithi161.stdout:7/251: fsync da/db/f2a 0 2024-01-17T23:34:12.623 INFO:tasks.workunit.client.0.smithi161.stdout:2/208: chown d8/da/d2d/d34/l39 559955 1 2024-01-17T23:34:12.651 INFO:tasks.workunit.client.0.smithi161.stdout:2/209: dwrite d8/d1c/d1e/f44 [0,4194304] 0 2024-01-17T23:34:12.957 INFO:tasks.workunit.client.0.smithi161.stdout:5/227: creat dd/d15/d1a/f41 x:0 0 0 2024-01-17T23:34:12.957 INFO:tasks.workunit.client.0.smithi161.stdout:5/228: dread - dd/d31/f32 zero size 2024-01-17T23:34:13.021 INFO:tasks.workunit.client.0.smithi161.stdout:8/198: getdents d1/d3d 0 2024-01-17T23:34:13.021 INFO:tasks.workunit.client.0.smithi161.stdout:8/199: stat d1/df/c29 0 2024-01-17T23:34:13.023 INFO:tasks.workunit.client.0.smithi161.stdout:3/206: symlink d0/d5/d9/d17/d2d/l40 0 2024-01-17T23:34:13.023 INFO:tasks.workunit.client.0.smithi161.stdout:3/207: chown d0/d5/f1d 527107 1 2024-01-17T23:34:13.127 INFO:tasks.workunit.client.0.smithi161.stdout:7/252: link da/c1d da/db/c64 0 2024-01-17T23:34:13.127 INFO:tasks.workunit.client.0.smithi161.stdout:7/253: read da/f26 [759021,95806] 0 2024-01-17T23:34:13.556 INFO:tasks.workunit.client.0.smithi161.stdout:2/210: creat d8/d1c/f49 x:0 0 0 2024-01-17T23:34:13.556 INFO:tasks.workunit.client.0.smithi161.stdout:2/211: fdatasync d8/d1c/f1f 0 2024-01-17T23:34:13.591 INFO:tasks.workunit.client.0.smithi161.stdout:2/212: dwrite d8/d1c/f25 [4194304,4194304] 0 2024-01-17T23:34:13.591 INFO:tasks.workunit.client.0.smithi161.stdout:2/213: truncate d8/d1c/f25 9036854 0 2024-01-17T23:34:13.620 INFO:tasks.workunit.client.0.smithi161.stdout:2/214: dwrite d8/da/d2d/f33 [0,4194304] 0 2024-01-17T23:34:13.689 INFO:tasks.workunit.client.0.smithi161.stdout:5/229: mkdir dd/d15/d1a/d42 0 2024-01-17T23:34:13.829 INFO:tasks.workunit.client.0.smithi161.stdout:0/279: sync 2024-01-17T23:34:13.829 INFO:tasks.workunit.client.0.smithi161.stdout:4/265: sync 2024-01-17T23:34:13.829 INFO:tasks.workunit.client.0.smithi161.stdout:9/173: sync 2024-01-17T23:34:13.829 INFO:tasks.workunit.client.0.smithi161.stdout:9/174: write d0/f2c [9419346,70977] 0 2024-01-17T23:34:13.829 INFO:tasks.workunit.client.0.smithi161.stdout:9/175: chown d0/c24 203203 1 2024-01-17T23:34:13.829 INFO:tasks.workunit.client.0.smithi161.stdout:4/266: write d9/de/d1e/f32 [4662735,100498] 0 2024-01-17T23:34:13.829 INFO:tasks.workunit.client.0.smithi161.stdout:4/267: chown d9/de/f2c 1751363 1 2024-01-17T23:34:13.829 INFO:tasks.workunit.client.0.smithi161.stdout:9/176: write d0/f2a [727591,70614] 0 2024-01-17T23:34:13.857 INFO:tasks.workunit.client.0.smithi161.stdout:0/280: dwrite d5/d34/d12/f37 [0,4194304] 0 2024-01-17T23:34:14.014 INFO:tasks.workunit.client.0.smithi161.stdout:3/208: symlink d0/d5/d9/d1e/d3b/l41 0 2024-01-17T23:34:14.329 INFO:tasks.workunit.client.0.smithi161.stdout:7/254: creat da/d34/d5a/d28/f65 x:0 0 0 2024-01-17T23:34:14.633 INFO:tasks.workunit.client.0.smithi161.stdout:2/215: rmdir d8/da/d2d/d34/d45 0 2024-01-17T23:34:14.634 INFO:tasks.workunit.client.0.smithi161.stdout:2/216: rename d8/da/d2d to d8/da/d2d/d34/d35/d3a/d4a 22 2024-01-17T23:34:14.634 INFO:tasks.workunit.client.0.smithi161.stdout:2/217: write d8/d1c/d1e/f3d [135573,35844] 0 2024-01-17T23:34:14.634 INFO:tasks.workunit.client.0.smithi161.stdout:2/218: truncate d8/d1c/d1e/f3d 807940 0 2024-01-17T23:34:15.188 INFO:tasks.workunit.client.0.smithi161.stdout:4/268: rmdir d9 39 2024-01-17T23:34:15.188 INFO:tasks.workunit.client.0.smithi161.stdout:4/269: write d9/de/f41 [108208,129574] 0 2024-01-17T23:34:15.188 INFO:tasks.workunit.client.0.smithi161.stdout:4/270: getdents d9/de/d1e/d38 0 2024-01-17T23:34:15.261 INFO:tasks.workunit.client.0.smithi161.stdout:9/177: mkdir d0/d39 0 2024-01-17T23:34:15.401 INFO:tasks.workunit.client.0.smithi161.stdout:0/281: symlink d5/d3a/l55 0 2024-01-17T23:34:15.401 INFO:tasks.workunit.client.0.smithi161.stdout:0/282: creat d5/d34/d20/d2b/f56 x:0 0 0 2024-01-17T23:34:15.662 INFO:tasks.workunit.client.0.smithi161.stdout:8/200: rmdir d1/d3/d19/d1d 39 2024-01-17T23:34:15.949 INFO:tasks.workunit.client.0.smithi161.stdout:7/255: dread da/d14/f24 [0,4194304] 0 2024-01-17T23:34:16.445 INFO:tasks.workunit.client.0.smithi161.stdout:1/275: creat d1/f62 x:0 0 0 2024-01-17T23:34:16.585 INFO:tasks.workunit.client.0.smithi161.stdout:9/178: creat d0/f3a x:0 0 0 2024-01-17T23:34:16.590 INFO:tasks.workunit.client.0.smithi161.stdout:9/179: read d0/f2a [407395,28896] 0 2024-01-17T23:34:16.933 INFO:tasks.workunit.client.0.smithi161.stdout:0/283: symlink d5/d3a/d49/l57 0 2024-01-17T23:34:17.147 INFO:tasks.workunit.client.0.smithi161.stdout:3/209: truncate d0/d5/d9/d17/f37 640226 0 2024-01-17T23:34:17.246 INFO:tasks.workunit.client.0.smithi161.stdout:7/256: symlink da/d34/l66 0 2024-01-17T23:34:17.446 INFO:tasks.workunit.client.0.smithi161.stdout:1/276: rename d1/d8/d1f/c43 to d1/d8/d1f/d4b/c63 0 2024-01-17T23:34:17.458 INFO:tasks.workunit.client.0.smithi161.stdout:1/277: dread d1/d20/f2e [0,4194304] 0 2024-01-17T23:34:17.543 INFO:tasks.workunit.client.0.smithi161.stdout:9/180: link d0/l32 d0/d8/d14/l3b 0 2024-01-17T23:34:17.623 INFO:tasks.workunit.client.0.smithi161.stdout:3/210: creat d0/d5/d9/d1e/d3b/f42 x:0 0 0 2024-01-17T23:34:17.711 INFO:tasks.workunit.client.0.smithi161.stdout:7/257: mknod da/d14/d35/c67 0 2024-01-17T23:34:17.756 INFO:tasks.workunit.client.0.smithi161.stdout:7/258: dwrite da/d34/d5a/d3b/f55 [0,4194304] 0 2024-01-17T23:34:18.092 INFO:tasks.workunit.client.0.smithi161.stdout:0/284: rename d5/d34/d12/f28 to d5/d2e/f58 0 2024-01-17T23:34:18.092 INFO:tasks.workunit.client.0.smithi161.stdout:0/285: readlink d5/d3a/d49/l57 0 2024-01-17T23:34:18.129 INFO:tasks.workunit.client.0.smithi161.stdout:0/286: dwrite d5/d34/d12/d2a/f38 [0,4194304] 0 2024-01-17T23:34:18.186 INFO:tasks.workunit.client.0.smithi161.stdout:1/278: mkdir d1/d64 0 2024-01-17T23:34:18.187 INFO:tasks.workunit.client.0.smithi161.stdout:1/279: fsync d1/d20/d26/d30/f58 0 2024-01-17T23:34:18.187 INFO:tasks.workunit.client.0.smithi161.stdout:1/280: fsync d1/d20/d26/d30/f5f 0 2024-01-17T23:34:18.216 INFO:tasks.workunit.client.0.smithi161.stdout:1/281: dwrite d1/d8/f56 [0,4194304] 0 2024-01-17T23:34:18.216 INFO:tasks.workunit.client.0.smithi161.stdout:1/282: fdatasync d1/f18 0 2024-01-17T23:34:18.295 INFO:tasks.workunit.client.0.smithi161.stdout:9/181: unlink d0/l27 0 2024-01-17T23:34:18.295 INFO:tasks.workunit.client.0.smithi161.stdout:9/182: chown d0/c5 0 1 2024-01-17T23:34:18.431 INFO:tasks.workunit.client.0.smithi161.stdout:3/211: rmdir d0/d5/d9/d17/d2d 39 2024-01-17T23:34:18.749 INFO:tasks.workunit.client.0.smithi161.stdout:7/259: mkdir da/d34/d5a/d68 0 2024-01-17T23:34:18.798 INFO:tasks.workunit.client.0.smithi161.stdout:7/260: dwrite da/f51 [0,4194304] 0 2024-01-17T23:34:19.237 INFO:tasks.workunit.client.0.smithi161.stdout:1/283: mknod d1/c65 0 2024-01-17T23:34:19.509 INFO:tasks.workunit.client.0.smithi161.stdout:9/183: symlink d0/d8/d14/l3c 0 2024-01-17T23:34:19.592 INFO:tasks.workunit.client.0.smithi161.stdout:3/212: symlink d0/d5/d9/d17/d2d/l43 0 2024-01-17T23:34:20.136 INFO:tasks.workunit.client.0.smithi161.stdout:0/287: truncate d5/d34/d12/f1d 5448470 0 2024-01-17T23:34:20.137 INFO:tasks.workunit.client.0.smithi161.stdout:1/284: truncate d1/d11/f22 255830 0 2024-01-17T23:34:20.158 INFO:tasks.workunit.client.0.smithi161.stdout:2/219: write d8/d1c/d1e/f2a [3424634,45123] 0 2024-01-17T23:34:20.164 INFO:tasks.workunit.client.0.smithi161.stdout:0/288: read d5/d34/d20/d2b/f33 [1530059,53320] 0 2024-01-17T23:34:20.364 INFO:tasks.workunit.client.0.smithi161.stdout:5/230: sync 2024-01-17T23:34:20.364 INFO:tasks.workunit.client.0.smithi161.stdout:6/219: sync 2024-01-17T23:34:20.364 INFO:tasks.workunit.client.0.smithi161.stdout:6/220: stat d6/d7/d16/l30 0 2024-01-17T23:34:20.365 INFO:tasks.workunit.client.0.smithi161.stdout:5/231: fdatasync dd/d15/f1b 0 2024-01-17T23:34:20.365 INFO:tasks.workunit.client.0.smithi161.stdout:6/221: truncate d6/f27 357939 0 2024-01-17T23:34:20.365 INFO:tasks.workunit.client.0.smithi161.stdout:6/222: write d6/f2f [136205,22143] 0 2024-01-17T23:34:20.365 INFO:tasks.workunit.client.0.smithi161.stdout:6/223: dread - d6/d7/dc/d3c/d47/d1a/f3e zero size 2024-01-17T23:34:20.365 INFO:tasks.workunit.client.0.smithi161.stdout:6/224: stat d6/f3d 0 2024-01-17T23:34:20.385 INFO:tasks.workunit.client.0.smithi161.stdout:5/232: write dd/f11 [3931129,59148] 0 2024-01-17T23:34:20.385 INFO:tasks.workunit.client.0.smithi161.stdout:5/233: readlink dd/d15/l16 0 2024-01-17T23:34:20.392 INFO:tasks.workunit.client.0.smithi161.stdout:4/271: sync 2024-01-17T23:34:20.532 INFO:tasks.workunit.client.0.smithi161.stdout:3/213: mknod d0/d5/d9/d38/c44 0 2024-01-17T23:34:21.311 INFO:tasks.workunit.client.0.smithi161.stdout:6/225: symlink d6/d7/dc/d3c/d47/d1a/l4c 0 2024-01-17T23:34:21.451 INFO:tasks.workunit.client.0.smithi161.stdout:5/234: rename dd/d15/d1a/f27 to dd/d15/d1a/f43 0 2024-01-17T23:34:21.451 INFO:tasks.workunit.client.0.smithi161.stdout:5/235: dread - dd/d15/d1a/f41 zero size 2024-01-17T23:34:21.467 INFO:tasks.workunit.client.0.smithi161.stdout:4/272: creat d9/d1b/d24/d25/f47 x:0 0 0 2024-01-17T23:34:21.467 INFO:tasks.workunit.client.0.smithi161.stdout:4/273: chown d9/l3f 43968415 1 2024-01-17T23:34:21.467 INFO:tasks.workunit.client.0.smithi161.stdout:4/274: stat d9/de/f41 0 2024-01-17T23:34:21.467 INFO:tasks.workunit.client.0.smithi161.stdout:4/275: getdents d9/d27 0 2024-01-17T23:34:21.478 INFO:tasks.workunit.client.0.smithi161.stdout:4/276: write d9/de/d1e/f32 [3413673,5768] 0 2024-01-17T23:34:21.502 INFO:tasks.workunit.client.0.smithi161.stdout:4/277: write d9/de/f1a [42422,86477] 0 2024-01-17T23:34:21.503 INFO:tasks.workunit.client.0.smithi161.stdout:4/278: truncate d9/f13 4443341 0 2024-01-17T23:34:21.586 INFO:tasks.workunit.client.0.smithi161.stdout:3/214: mknod d0/d5/d9/d17/c45 0 2024-01-17T23:34:21.876 INFO:tasks.workunit.client.0.smithi161.stdout:6/226: rename d6/d7/f40 to d6/d7/d16/f4d 0 2024-01-17T23:34:21.876 INFO:tasks.workunit.client.0.smithi161.stdout:6/227: truncate d6/d7/dc/d3c/d47/f11 958772 0 2024-01-17T23:34:22.190 INFO:tasks.workunit.client.0.smithi161.stdout:5/236: mkdir dd/d15/d1a/d42/d44 0 2024-01-17T23:34:22.323 INFO:tasks.workunit.client.0.smithi161.stdout:4/279: creat d9/de/d1e/d38/f48 x:0 0 0 2024-01-17T23:34:22.324 INFO:tasks.workunit.client.0.smithi161.stdout:4/280: creat d9/de/d1e/d38/f49 x:0 0 0 2024-01-17T23:34:22.324 INFO:tasks.workunit.client.0.smithi161.stdout:4/281: chown d9/fb 265354 1 2024-01-17T23:34:22.533 INFO:tasks.workunit.client.0.smithi161.stdout:3/215: link d0/d5/c21 d0/d5/d9/d17/c46 0 2024-01-17T23:34:22.771 INFO:tasks.workunit.client.0.smithi161.stdout:6/228: creat d6/d7/dc/d3c/d47/d31/f4e x:0 0 0 2024-01-17T23:34:22.772 INFO:tasks.workunit.client.0.smithi161.stdout:5/237: mknod dd/d15/d1a/d42/c45 0 2024-01-17T23:34:22.786 INFO:tasks.workunit.client.0.smithi161.stdout:6/229: write d6/f3d [58475,45788] 0 2024-01-17T23:34:22.786 INFO:tasks.workunit.client.0.smithi161.stdout:6/230: chown l4 13241305 1 2024-01-17T23:34:22.813 INFO:tasks.workunit.client.0.smithi161.stdout:6/231: dwrite d6/d7/d16/f4d [0,4194304] 0 2024-01-17T23:34:22.966 INFO:tasks.workunit.client.0.smithi161.stdout:4/282: creat d9/d27/d3a/f4a x:0 0 0 2024-01-17T23:34:22.966 INFO:tasks.workunit.client.0.smithi161.stdout:4/283: readlink d9/d1b/d24/d25/l44 0 2024-01-17T23:34:23.023 INFO:tasks.workunit.client.0.smithi161.stdout:3/216: stat d0/d5/c28 0 2024-01-17T23:34:23.023 INFO:tasks.workunit.client.0.smithi161.stdout:3/217: dread - d0/d5/d9/d17/f18 zero size 2024-01-17T23:34:23.133 INFO:tasks.workunit.client.0.smithi161.stdout:5/238: rmdir dd/d15/d1a/d42/d44 0 2024-01-17T23:34:23.735 INFO:tasks.workunit.client.0.smithi161.stdout:6/232: truncate d6/d7/dc/d3c/d47/d13/f1c 864424 0 2024-01-17T23:34:23.838 INFO:tasks.workunit.client.0.smithi161.stdout:4/284: chown c6 235208616 1 2024-01-17T23:34:23.877 INFO:tasks.workunit.client.0.smithi161.stdout:4/285: dwrite d9/de/f41 [0,4194304] 0 2024-01-17T23:34:23.913 INFO:tasks.workunit.client.0.smithi161.stdout:3/218: symlink d0/d5/d9/d17/d32/l47 0 2024-01-17T23:34:23.913 INFO:tasks.workunit.client.0.smithi161.stdout:3/219: chown d0/d5/d9/d1e/l20 412946019 1 2024-01-17T23:34:23.913 INFO:tasks.workunit.client.0.smithi161.stdout:3/220: truncate d0/d5/d9/d1e/d3b/f42 1000132 0 2024-01-17T23:34:23.915 INFO:tasks.workunit.client.0.smithi161.stdout:3/221: dread d0/f6 [0,4194304] 0 2024-01-17T23:34:23.998 INFO:tasks.workunit.client.0.smithi161.stdout:5/239: creat dd/d15/d1a/d42/f46 x:0 0 0 2024-01-17T23:34:24.016 INFO:tasks.workunit.client.0.smithi161.stdout:5/240: dread dd/f24 [0,4194304] 0 2024-01-17T23:34:24.017 INFO:tasks.workunit.client.0.smithi161.stdout:5/241: stat dd/d15/d1a/l2b 0 2024-01-17T23:34:24.743 INFO:tasks.workunit.client.0.smithi161.stdout:4/286: mknod d9/de/c4b 0 2024-01-17T23:34:24.743 INFO:tasks.workunit.client.0.smithi161.stdout:4/287: rename d9/de/d1e to d9/de/d1e/d4c 22 2024-01-17T23:34:24.821 INFO:tasks.workunit.client.0.smithi161.stdout:3/222: mknod d0/d5/d9/d1e/c48 0 2024-01-17T23:34:24.821 INFO:tasks.workunit.client.0.smithi161.stdout:3/223: fsync d0/f6 0 2024-01-17T23:34:24.853 INFO:tasks.workunit.client.0.smithi161.stdout:3/224: dwrite d0/d5/fa [0,4194304] 0 2024-01-17T23:34:24.853 INFO:tasks.workunit.client.0.smithi161.stdout:3/225: readlink d0/d5/l25 0 2024-01-17T23:34:24.915 INFO:tasks.workunit.client.0.smithi161.stdout:5/242: getdents dd 0 2024-01-17T23:34:24.990 INFO:tasks.workunit.client.0.smithi161.stdout:2/220: mkdir d8/d4b 0 2024-01-17T23:34:24.990 INFO:tasks.workunit.client.0.smithi161.stdout:2/221: readlink d8/d1c/l43 0 2024-01-17T23:34:25.120 INFO:tasks.workunit.client.0.smithi161.stdout:7/261: write da/d34/d5a/d3b/d3d/f40 [3973600,47466] 0 2024-01-17T23:34:25.120 INFO:tasks.workunit.client.0.smithi161.stdout:7/262: chown da/d34/d5a/d3b/f61 864376567 1 2024-01-17T23:34:25.120 INFO:tasks.workunit.client.0.smithi161.stdout:7/263: chown da/d14/d35/c67 29 1 2024-01-17T23:34:25.412 INFO:tasks.workunit.client.0.smithi161.stdout:8/201: rmdir d1/d3 39 2024-01-17T23:34:25.412 INFO:tasks.workunit.client.0.smithi161.stdout:8/202: write d1/d3/d19/d1d/f36 [268324,39073] 0 2024-01-17T23:34:25.414 INFO:tasks.workunit.client.0.smithi161.stdout:9/184: sync 2024-01-17T23:34:25.427 INFO:tasks.workunit.client.0.smithi161.stdout:9/185: write d0/d8/f10 [1022829,11500] 0 2024-01-17T23:34:25.428 INFO:tasks.workunit.client.0.smithi161.stdout:9/186: chown d0/f3a 0 1 2024-01-17T23:34:25.428 INFO:tasks.workunit.client.0.smithi161.stdout:9/187: write d0/f2a [376021,12389] 0 2024-01-17T23:34:25.428 INFO:tasks.workunit.client.0.smithi161.stdout:9/188: read d0/f4 [1183148,97560] 0 2024-01-17T23:34:26.186 INFO:tasks.workunit.client.0.smithi161.stdout:3/226: creat d0/d5/d9/d38/f49 x:0 0 0 2024-01-17T23:34:26.186 INFO:tasks.workunit.client.0.smithi161.stdout:3/227: chown d0/d5/d9/d17/d2d/l30 28 1 2024-01-17T23:34:26.186 INFO:tasks.workunit.client.0.smithi161.stdout:3/228: read - d0/f29 zero size 2024-01-17T23:34:26.186 INFO:tasks.workunit.client.0.smithi161.stdout:3/229: write d0/d5/d9/d38/f49 [719860,70311] 0 2024-01-17T23:34:26.186 INFO:tasks.workunit.client.0.smithi161.stdout:3/230: read - d0/f29 zero size 2024-01-17T23:34:26.273 INFO:tasks.workunit.client.0.smithi161.stdout:6/233: rmdir d6/d7/d16 39 2024-01-17T23:34:26.474 INFO:tasks.workunit.client.0.smithi161.stdout:5/243: rename dd/d15/d1a/c29 to dd/d31/c47 0 2024-01-17T23:34:26.474 INFO:tasks.workunit.client.0.smithi161.stdout:2/222: creat d8/da/d2d/d34/f4c x:0 0 0 2024-01-17T23:34:26.716 INFO:tasks.workunit.client.0.smithi161.stdout:7/264: unlink da/d14/f24 0 2024-01-17T23:34:26.716 INFO:tasks.workunit.client.0.smithi161.stdout:7/265: write da/db/f11 [3069345,30496] 0 2024-01-17T23:34:26.716 INFO:tasks.workunit.client.0.smithi161.stdout:7/266: write da/d34/d5a/d28/f3e [2845274,104377] 0 2024-01-17T23:34:26.726 INFO:tasks.workunit.client.0.smithi161.stdout:7/267: dread da/d34/d5a/d28/d43/f2e [0,4194304] 0 2024-01-17T23:34:26.726 INFO:tasks.workunit.client.0.smithi161.stdout:7/268: chown da/l16 6485 1 2024-01-17T23:34:26.726 INFO:tasks.workunit.client.0.smithi161.stdout:7/269: readlink da/l16 0 2024-01-17T23:34:26.726 INFO:tasks.workunit.client.0.smithi161.stdout:7/270: dread - da/d34/d5a/d3b/f61 zero size 2024-01-17T23:34:27.129 INFO:tasks.workunit.client.0.smithi161.stdout:3/231: creat d0/d5/d9/d17/d32/f4a x:0 0 0 2024-01-17T23:34:27.160 INFO:tasks.workunit.client.0.smithi161.stdout:3/232: dwrite d0/d5/d9/d17/f1c [0,4194304] 0 2024-01-17T23:34:27.277 INFO:tasks.workunit.client.0.smithi161.stdout:6/234: truncate d6/d7/dc/f19 809984 0 2024-01-17T23:34:27.415 INFO:tasks.workunit.client.0.smithi161.stdout:5/244: creat dd/f48 x:0 0 0 2024-01-17T23:34:27.430 INFO:tasks.workunit.client.0.smithi161.stdout:5/245: dread dd/f11 [0,4194304] 0 2024-01-17T23:34:27.447 INFO:tasks.workunit.client.0.smithi161.stdout:5/246: dread dd/f24 [0,4194304] 0 2024-01-17T23:34:27.462 INFO:tasks.workunit.client.0.smithi161.stdout:5/247: dread dd/d15/d1a/f43 [0,4194304] 0 2024-01-17T23:34:27.587 INFO:tasks.workunit.client.0.smithi161.stdout:2/223: rename d8/d1c/c1d to d8/d4b/c4d 0 2024-01-17T23:34:27.626 INFO:tasks.workunit.client.0.smithi161.stdout:2/224: dwrite d8/da/f27 [0,4194304] 0 2024-01-17T23:34:27.626 INFO:tasks.workunit.client.0.smithi161.stdout:2/225: truncate d8/da/d2d/d34/f4c 744649 0 2024-01-17T23:34:28.185 INFO:tasks.workunit.client.0.smithi161.stdout:5/248: symlink dd/d31/d3c/l49 0 2024-01-17T23:34:28.538 INFO:tasks.workunit.client.0.smithi161.stdout:6/235: rmdir d6/d7 39 2024-01-17T23:34:28.538 INFO:tasks.workunit.client.0.smithi161.stdout:2/226: mknod d8/da/d2d/d34/d35/c4e 0 2024-01-17T23:34:28.538 INFO:tasks.workunit.client.0.smithi161.stdout:6/236: creat d6/d7/dc/f4f x:0 0 0 2024-01-17T23:34:28.602 INFO:tasks.workunit.client.0.smithi161.stdout:3/233: symlink d0/l4b 0 2024-01-17T23:34:28.673 INFO:tasks.workunit.client.0.smithi161.stdout:5/249: rename dd/d15/d1a/f41 to dd/f4a 0 2024-01-17T23:34:28.702 INFO:tasks.workunit.client.0.smithi161.stdout:5/250: dwrite dd/d15/f22 [0,4194304] 0 2024-01-17T23:34:28.730 INFO:tasks.workunit.client.0.smithi161.stdout:5/251: dwrite dd/f24 [0,4194304] 0 2024-01-17T23:34:28.765 INFO:tasks.workunit.client.0.smithi161.stdout:5/252: dwrite dd/d15/f21 [0,4194304] 0 2024-01-17T23:34:28.793 INFO:tasks.workunit.client.0.smithi161.stdout:2/227: getdents d8/da 0 2024-01-17T23:34:29.013 INFO:tasks.workunit.client.0.smithi161.stdout:6/237: mknod d6/d7/dc/d1d/c50 0 2024-01-17T23:34:29.456 INFO:tasks.workunit.client.0.smithi161.stdout:5/253: truncate dd/f12 327376 0 2024-01-17T23:34:29.456 INFO:tasks.workunit.client.0.smithi161.stdout:5/254: write dd/f48 [300309,66735] 0 2024-01-17T23:34:29.456 INFO:tasks.workunit.client.0.smithi161.stdout:5/255: write dd/d15/d1a/d42/f46 [6924,38814] 0 2024-01-17T23:34:29.456 INFO:tasks.workunit.client.0.smithi161.stdout:5/256: chown dd/d15/l35 7809 1 2024-01-17T23:34:29.620 INFO:tasks.workunit.client.0.smithi161.stdout:2/228: creat d8/f4f x:0 0 0 2024-01-17T23:34:29.942 INFO:tasks.workunit.client.0.smithi161.stdout:6/238: unlink d6/d7/dc/d3c/d47/d13/f3a 0 2024-01-17T23:34:30.301 INFO:tasks.workunit.client.0.smithi161.stdout:2/229: mknod d8/d4b/c50 0 2024-01-17T23:34:30.852 INFO:tasks.workunit.client.0.smithi161.stdout:6/239: creat d6/f51 x:0 0 0 2024-01-17T23:34:30.852 INFO:tasks.workunit.client.0.smithi161.stdout:6/240: readlink d6/d7/dc/d3c/d47/d1a/l1b 0 2024-01-17T23:34:30.852 INFO:tasks.workunit.client.0.smithi161.stdout:6/241: write d6/f2f [955050,52496] 0 2024-01-17T23:34:31.102 INFO:tasks.workunit.client.0.smithi161.stdout:0/289: creat d5/f59 x:0 0 0 2024-01-17T23:34:31.144 INFO:tasks.workunit.client.0.smithi161.stdout:9/189: creat d0/f3d x:0 0 0 2024-01-17T23:34:31.145 INFO:tasks.workunit.client.0.smithi161.stdout:8/203: write d1/d1c/f2b [897351,124526] 0 2024-01-17T23:34:31.145 INFO:tasks.workunit.client.0.smithi161.stdout:9/190: write d0/f3d [156654,90754] 0 2024-01-17T23:34:31.332 INFO:tasks.workunit.client.0.smithi161.stdout:6/242: mknod d6/d7/dc/d3c/c52 0 2024-01-17T23:34:31.400 INFO:tasks.workunit.client.0.smithi161.stdout:0/290: getdents d5/d2e 0 2024-01-17T23:34:31.552 INFO:tasks.workunit.client.0.smithi161.stdout:8/204: mknod d1/df/d20/c44 0 2024-01-17T23:34:31.552 INFO:tasks.workunit.client.0.smithi161.stdout:8/205: chown d1/d3/l30 48842 1 2024-01-17T23:34:31.553 INFO:tasks.workunit.client.0.smithi161.stdout:8/206: dread d1/d3d/f42 [0,4194304] 0 2024-01-17T23:34:31.832 INFO:tasks.workunit.client.0.smithi161.stdout:9/191: mknod d0/d8/d14/d18/c3e 0 2024-01-17T23:34:31.832 INFO:tasks.workunit.client.0.smithi161.stdout:0/291: creat d5/d34/d20/f5a x:0 0 0 2024-01-17T23:34:31.832 INFO:tasks.workunit.client.0.smithi161.stdout:0/292: chown d5/d34/d12/l1b 5929691 1 2024-01-17T23:34:32.213 INFO:tasks.workunit.client.0.smithi161.stdout:8/207: symlink d1/d1c/l45 0 2024-01-17T23:34:32.213 INFO:tasks.workunit.client.0.smithi161.stdout:8/208: stat d1/d1c/f2b 0 2024-01-17T23:34:32.213 INFO:tasks.workunit.client.0.smithi161.stdout:8/209: write d1/d3d/f40 [914822,37796] 0 2024-01-17T23:34:32.631 INFO:tasks.workunit.client.0.smithi161.stdout:9/192: link d0/f2c d0/d8/d14/f3f 0 2024-01-17T23:34:32.711 INFO:tasks.workunit.client.0.smithi161.stdout:0/293: unlink d5/l14 0 2024-01-17T23:34:32.876 INFO:tasks.workunit.client.0.smithi161.stdout:1/285: unlink d1/f62 0 2024-01-17T23:34:32.876 INFO:tasks.workunit.client.0.smithi161.stdout:1/286: truncate d1/d8/f1b 4357967 0 2024-01-17T23:34:32.881 INFO:tasks.workunit.client.0.smithi161.stdout:1/287: dread d1/d8/d1c/f39 [0,4194304] 0 2024-01-17T23:34:32.881 INFO:tasks.workunit.client.0.smithi161.stdout:1/288: chown d1/d20/d26/c60 21198517 1 2024-01-17T23:34:33.172 INFO:tasks.workunit.client.0.smithi161.stdout:8/210: mkdir d1/df/d46 0 2024-01-17T23:34:33.301 INFO:tasks.workunit.client.0.smithi161.stdout:2/230: creat d8/da/d2d/f51 x:0 0 0 2024-01-17T23:34:33.322 INFO:tasks.workunit.client.0.smithi161.stdout:2/231: dread d8/d1c/f1f [0,4194304] 0 2024-01-17T23:34:33.530 INFO:tasks.workunit.client.0.smithi161.stdout:0/294: unlink d5/d34/d12/d2a/d35/f42 0 2024-01-17T23:34:33.530 INFO:tasks.workunit.client.0.smithi161.stdout:0/295: write d5/d34/d21/f3b [547513,5392] 0 2024-01-17T23:34:33.599 INFO:tasks.workunit.client.0.smithi161.stdout:1/289: mknod d1/d11/c66 0 2024-01-17T23:34:33.656 INFO:tasks.workunit.client.0.smithi161.stdout:5/257: rmdir dd 39 2024-01-17T23:34:33.656 INFO:tasks.workunit.client.0.smithi161.stdout:5/258: truncate dd/d15/f23 1229926 0 2024-01-17T23:34:33.678 INFO:tasks.workunit.client.0.smithi161.stdout:5/259: write dd/d15/d1a/f43 [241611,101444] 0 2024-01-17T23:34:33.678 INFO:tasks.workunit.client.0.smithi161.stdout:5/260: dread - dd/f4a zero size 2024-01-17T23:34:33.782 INFO:tasks.workunit.client.0.smithi161.stdout:8/211: mknod d1/df/d46/c47 0 2024-01-17T23:34:33.807 INFO:tasks.workunit.client.0.smithi161.stdout:8/212: dwrite d1/d3d/f42 [0,4194304] 0 2024-01-17T23:34:33.807 INFO:tasks.workunit.client.0.smithi161.stdout:8/213: read - d1/d22/d2f/f43 zero size 2024-01-17T23:34:33.807 INFO:tasks.workunit.client.0.smithi161.stdout:8/214: creat d1/d22/f48 x:0 0 0 2024-01-17T23:34:33.834 INFO:tasks.workunit.client.0.smithi161.stdout:8/215: dwrite f0 [8388608,4194304] 0 2024-01-17T23:34:33.855 INFO:tasks.workunit.client.0.smithi161.stdout:9/193: getdents d0/d8/d14/d18/d20 0 2024-01-17T23:34:34.212 INFO:tasks.workunit.client.0.smithi161.stdout:1/290: unlink d1/l17 0 2024-01-17T23:34:34.352 INFO:tasks.workunit.client.0.smithi161.stdout:5/261: creat dd/d31/d3c/f4b x:0 0 0 2024-01-17T23:34:34.802 INFO:tasks.workunit.client.0.smithi161.stdout:9/194: mknod d0/d8/d14/c40 0 2024-01-17T23:34:34.808 INFO:tasks.workunit.client.0.smithi161.stdout:8/216: dread d1/d3/f18 [0,4194304] 0 2024-01-17T23:34:34.848 INFO:tasks.workunit.client.0.smithi161.stdout:8/217: dwrite d1/d3/f38 [4194304,4194304] 0 2024-01-17T23:34:34.941 INFO:tasks.workunit.client.0.smithi161.stdout:6/243: getdents d6 0 2024-01-17T23:34:35.157 INFO:tasks.workunit.client.0.smithi161.stdout:0/296: getdents d5/d3a 0 2024-01-17T23:34:35.639 INFO:tasks.workunit.client.0.smithi161.stdout:7/271: mkdir da/d34/d69 0 2024-01-17T23:34:36.552 INFO:tasks.workunit.client.0.smithi161.stdout:5/262: link dd/d15/f22 dd/d31/d3c/f4c 0 2024-01-17T23:34:36.552 INFO:tasks.workunit.client.0.smithi161.stdout:9/195: creat d0/d8/d14/f41 x:0 0 0 2024-01-17T23:34:36.553 INFO:tasks.workunit.client.0.smithi161.stdout:9/196: fsync d0/f2c 0 2024-01-17T23:34:36.594 INFO:tasks.workunit.client.0.smithi161.stdout:9/197: dwrite d0/f2a [0,4194304] 0 2024-01-17T23:34:36.594 INFO:tasks.workunit.client.0.smithi161.stdout:9/198: write d0/d8/f10 [108323,33205] 0 2024-01-17T23:34:36.612 INFO:tasks.workunit.client.0.smithi161.stdout:9/199: dread d0/d8/d14/f3f [0,4194304] 0 2024-01-17T23:34:36.885 INFO:tasks.workunit.client.0.smithi161.stdout:4/288: sync 2024-01-17T23:34:37.385 INFO:tasks.workunit.client.0.smithi161.stdout:0/297: creat d5/d3a/d49/f5b x:0 0 0 2024-01-17T23:34:37.433 INFO:tasks.workunit.client.0.smithi161.stdout:7/272: dread da/fc [0,4194304] 0 2024-01-17T23:34:37.461 INFO:tasks.workunit.client.0.smithi161.stdout:7/273: dwrite da/f15 [0,4194304] 0 2024-01-17T23:34:37.462 INFO:tasks.workunit.client.0.smithi161.stdout:7/274: fdatasync da/db/f13 0 2024-01-17T23:34:37.871 INFO:tasks.workunit.client.0.smithi161.stdout:9/200: link d0/d8/d14/d18/l1e d0/d8/d14/d18/d20/l42 0 2024-01-17T23:34:37.871 INFO:tasks.workunit.client.0.smithi161.stdout:9/201: chown d0/c34 776310 1 2024-01-17T23:34:37.871 INFO:tasks.workunit.client.0.smithi161.stdout:9/202: write d0/d8/d14/f29 [753124,45370] 0 2024-01-17T23:34:37.871 INFO:tasks.workunit.client.0.smithi161.stdout:9/203: write d0/d8/d14/d18/d20/f37 [311419,36367] 0 2024-01-17T23:34:37.890 INFO:tasks.workunit.client.0.smithi161.stdout:9/204: read d0/f2a [4193724,39894] 0 2024-01-17T23:34:38.102 INFO:tasks.workunit.client.0.smithi161.stdout:2/232: rename d8/da/d2d to d8/da/d52 0 2024-01-17T23:34:38.126 INFO:tasks.workunit.client.0.smithi161.stdout:2/233: write d8/da/d52/f33 [2072080,84548] 0 2024-01-17T23:34:38.325 INFO:tasks.workunit.client.0.smithi161.stdout:0/298: mknod d5/d3a/c5c 0 2024-01-17T23:34:38.845 INFO:tasks.workunit.client.0.smithi161.stdout:2/234: creat d8/da/d52/f53 x:0 0 0 2024-01-17T23:34:39.011 INFO:tasks.workunit.client.0.smithi161.stdout:0/299: dread d5/d8/f19 [4194304,4194304] 0 2024-01-17T23:34:39.011 INFO:tasks.workunit.client.0.smithi161.stdout:0/300: creat d5/d34/d12/d2a/d35/f5d x:0 0 0 2024-01-17T23:34:39.018 INFO:tasks.workunit.client.0.smithi161.stdout:0/301: write d5/d2e/f31 [33985,56454] 0 2024-01-17T23:34:39.490 INFO:tasks.workunit.client.0.smithi161.stdout:0/302: symlink d5/d3a/d49/l5e 0 2024-01-17T23:34:39.491 INFO:tasks.workunit.client.0.smithi161.stdout:0/303: dread - d5/f59 zero size 2024-01-17T23:34:39.518 INFO:tasks.workunit.client.0.smithi161.stdout:0/304: dwrite d5/d34/d20/f5a [0,4194304] 0 2024-01-17T23:34:39.520 INFO:tasks.workunit.client.0.smithi161.stdout:0/305: read d5/d3a/f43 [76169,107171] 0 2024-01-17T23:34:39.529 INFO:tasks.workunit.client.0.smithi161.stdout:0/306: dread d5/d2e/f58 [0,4194304] 0 2024-01-17T23:34:39.730 INFO:tasks.workunit.client.0.smithi161.stdout:3/234: rename d0/c3 to d0/d5/c4c 0 2024-01-17T23:34:39.730 INFO:tasks.workunit.client.0.smithi161.stdout:6/244: rename d6/d7 to d6/d7/dc/d1d/d53 22 2024-01-17T23:34:39.730 INFO:tasks.workunit.client.0.smithi161.stdout:3/235: chown d0/d5/d9/d1e/c48 3647167 1 2024-01-17T23:34:39.730 INFO:tasks.workunit.client.0.smithi161.stdout:6/245: write d6/d7/dc/d3c/d47/f49 [971109,45074] 0 2024-01-17T23:34:39.743 INFO:tasks.workunit.client.0.smithi161.stdout:3/236: dread d0/d5/d9/d38/f49 [0,4194304] 0 2024-01-17T23:34:39.743 INFO:tasks.workunit.client.0.smithi161.stdout:3/237: write d0/d5/d9/d17/f33 [3419549,93527] 0 2024-01-17T23:34:39.773 INFO:tasks.workunit.client.0.smithi161.stdout:6/246: dwrite d6/d7/dc/d3c/f4a [0,4194304] 0 2024-01-17T23:34:39.773 INFO:tasks.workunit.client.0.smithi161.stdout:3/238: write d0/f12 [3913866,109903] 0 2024-01-17T23:34:39.774 INFO:tasks.workunit.client.0.smithi161.stdout:3/239: write d0/f10 [5027018,15495] 0 2024-01-17T23:34:39.774 INFO:tasks.workunit.client.0.smithi161.stdout:3/240: readlink d0/d5/d9/d1e/d3b/l41 0 2024-01-17T23:34:39.774 INFO:tasks.workunit.client.0.smithi161.stdout:3/241: fdatasync d0/d5/d9/d1e/d3b/f42 0 2024-01-17T23:34:39.928 INFO:tasks.workunit.client.0.smithi161.stdout:8/218: write d1/d3/f18 [653537,38566] 0 2024-01-17T23:34:39.944 INFO:tasks.workunit.client.0.smithi161.stdout:2/235: creat d8/f54 x:0 0 0 2024-01-17T23:34:39.944 INFO:tasks.workunit.client.0.smithi161.stdout:2/236: read d8/f18 [94785,129207] 0 2024-01-17T23:34:39.993 INFO:tasks.workunit.client.0.smithi161.stdout:4/289: write d9/fb [2822839,114925] 0 2024-01-17T23:34:39.993 INFO:tasks.workunit.client.0.smithi161.stdout:4/290: dread - d9/de/f19 zero size 2024-01-17T23:34:40.403 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:34:40.407 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:34:40.484 INFO:tasks.workunit.client.0.smithi161.stdout:7/275: sync 2024-01-17T23:34:40.484 INFO:tasks.workunit.client.0.smithi161.stdout:1/291: sync 2024-01-17T23:34:40.484 INFO:tasks.workunit.client.0.smithi161.stdout:7/276: creat da/d34/d5a/d3b/f6a x:0 0 0 2024-01-17T23:34:40.484 INFO:tasks.workunit.client.0.smithi161.stdout:7/277: read - da/d34/d5a/d28/f65 zero size 2024-01-17T23:34:40.518 INFO:tasks.workunit.client.0.smithi161.stdout:7/278: dwrite da/f51 [0,4194304] 0 2024-01-17T23:34:40.518 INFO:tasks.workunit.client.0.smithi161.stdout:7/279: stat da/f2c 0 2024-01-17T23:34:40.542 INFO:tasks.workunit.client.0.smithi161.stdout:0/307: symlink d5/d34/d20/l5f 0 2024-01-17T23:34:40.571 INFO:tasks.workunit.client.0.smithi161.stdout:7/280: dwrite da/d34/d4a/f5c [0,4194304] 0 2024-01-17T23:34:40.572 INFO:tasks.workunit.client.0.smithi161.stdout:7/281: write da/f51 [4533824,103269] 0 2024-01-17T23:34:40.585 INFO:tasks.workunit.client.0.smithi161.stdout:0/308: dwrite d5/d2e/f31 [0,4194304] 0 2024-01-17T23:34:40.604 INFO:tasks.workunit.client.0.smithi161.stdout:5/263: rename dd/d31/d3c/c3f to dd/d31/c4d 0 2024-01-17T23:34:40.999 INFO:tasks.workunit.client.0.smithi161.stdout:6/247: mknod d6/d7/dc/d3c/d47/d31/c54 0 2024-01-17T23:34:41.231 INFO:tasks.workunit.client.0.smithi161.stdout:3/242: link d0/d5/l31 d0/d5/d9/d38/l4d 0 2024-01-17T23:34:41.574 INFO:tasks.workunit.client.0.smithi161.stdout:2/237: symlink d8/da/d52/d34/d35/l55 0 2024-01-17T23:34:41.693 INFO:tasks.workunit.client.0.smithi161.stdout:4/291: symlink d9/l4d 0 2024-01-17T23:34:41.694 INFO:tasks.workunit.client.0.smithi161.stdout:4/292: fdatasync f0 0 2024-01-17T23:34:41.694 INFO:tasks.workunit.client.0.smithi161.stdout:4/293: getdents d9/d27 0 2024-01-17T23:34:41.875 INFO:tasks.workunit.client.0.smithi161.stdout:1/292: mkdir d1/d8/d67 0 2024-01-17T23:34:42.827 INFO:tasks.workunit.client.0.smithi161.stdout:9/205: rename d0/f3d to d0/d39/f43 0 2024-01-17T23:34:42.828 INFO:tasks.workunit.client.0.smithi161.stdout:9/206: chown d0/f4 0 1 2024-01-17T23:34:42.828 INFO:tasks.workunit.client.0.smithi161.stdout:9/207: creat d0/d8/d14/f44 x:0 0 0 2024-01-17T23:34:42.863 INFO:tasks.workunit.client.0.smithi161.stdout:5/264: mkdir dd/d15/d4e 0 2024-01-17T23:34:42.863 INFO:tasks.workunit.client.0.smithi161.stdout:5/265: chown dd/d15/c3d 237 1 2024-01-17T23:34:42.989 INFO:tasks.workunit.client.0.smithi161.stdout:6/248: mkdir d6/d7/d16/d55 0 2024-01-17T23:34:43.060 INFO:tasks.workunit.client.0.smithi161.stdout:3/243: dread d0/d5/fa [0,4194304] 0 2024-01-17T23:34:43.060 INFO:tasks.workunit.client.0.smithi161.stdout:3/244: chown d0/d5 8029295 1 2024-01-17T23:34:43.090 INFO:tasks.workunit.client.0.smithi161.stdout:3/245: dwrite d0/f2e [0,4194304] 0 2024-01-17T23:34:43.252 INFO:tasks.workunit.client.0.smithi161.stdout:8/219: truncate d1/d3/f9 4574735 0 2024-01-17T23:34:43.351 INFO:tasks.workunit.client.0.smithi161.stdout:2/238: truncate d8/da/d52/f33 959068 0 2024-01-17T23:34:43.619 INFO:tasks.workunit.client.0.smithi161.stdout:1/293: truncate d1/f3a 823476 0 2024-01-17T23:34:43.619 INFO:tasks.workunit.client.0.smithi161.stdout:1/294: write d1/d20/d26/d30/f36 [25314,19358] 0 2024-01-17T23:34:43.619 INFO:tasks.workunit.client.0.smithi161.stdout:1/295: chown d1/d8/f1b 2830 1 2024-01-17T23:34:43.768 INFO:tasks.workunit.client.0.smithi161.stdout:0/309: getdents d5/d34/d20/d2b 0 2024-01-17T23:34:43.768 INFO:tasks.workunit.client.0.smithi161.stdout:0/310: chown d5/f59 7 1 2024-01-17T23:34:44.155 INFO:tasks.workunit.client.0.smithi161.stdout:9/208: creat d0/d8/d14/d18/d20/f45 x:0 0 0 2024-01-17T23:34:44.228 INFO:tasks.workunit.client.0.smithi161.stdout:5/266: mkdir dd/d15/d4e/d4f 0 2024-01-17T23:34:44.725 INFO:tasks.workunit.client.0.smithi161.stdout:7/282: dwrite da/d14/f18 [4194304,4194304] 0 2024-01-17T23:34:44.725 INFO:tasks.workunit.client.0.smithi161.stdout:7/283: write da/f62 [980291,73965] 0 2024-01-17T23:34:44.725 INFO:tasks.workunit.client.0.smithi161.stdout:7/284: chown da/db 7188769 1 2024-01-17T23:34:44.890 INFO:tasks.workunit.client.0.smithi161.stdout:6/249: symlink d6/d7/dc/d1d/l56 0 2024-01-17T23:34:44.890 INFO:tasks.workunit.client.0.smithi161.stdout:6/250: creat d6/d7/dc/d3c/d47/d31/f57 x:0 0 0 2024-01-17T23:34:45.425 INFO:tasks.workunit.client.0.smithi161.stdout:3/246: rename d0/d5/d9/d17/d2d/l40 to d0/d5/d9/d38/l4e 0 2024-01-17T23:34:45.436 INFO:tasks.workunit.client.0.smithi161.stdout:3/247: dread d0/d5/fa [0,4194304] 0 2024-01-17T23:34:45.489 INFO:tasks.workunit.client.0.smithi161.stdout:3/248: dwrite d0/f1f [0,4194304] 0 2024-01-17T23:34:45.570 INFO:tasks.workunit.client.0.smithi161.stdout:8/220: mknod d1/d22/c49 0 2024-01-17T23:34:46.109 INFO:tasks.workunit.client.0.smithi161.stdout:0/311: link d5/d34/l48 d5/d34/d20/d2d/l60 0 2024-01-17T23:34:46.137 INFO:tasks.workunit.client.0.smithi161.stdout:0/312: dwrite d5/d8/f3c [0,4194304] 0 2024-01-17T23:34:46.160 INFO:tasks.workunit.client.0.smithi161.stdout:9/209: getdents d0/d8/d14/d18 0 2024-01-17T23:34:46.294 INFO:tasks.workunit.client.0.smithi161.stdout:5/267: truncate dd/d15/f19 483255 0 2024-01-17T23:34:46.499 INFO:tasks.workunit.client.0.smithi161.stdout:7/285: unlink da/d34/d5a/d28/d43/c37 0 2024-01-17T23:34:46.500 INFO:tasks.workunit.client.0.smithi161.stdout:4/294: truncate d9/fb 2413400 0 2024-01-17T23:34:46.539 INFO:tasks.workunit.client.0.smithi161.stdout:4/295: dwrite d9/d1b/d24/f43 [0,4194304] 0 2024-01-17T23:34:46.539 INFO:tasks.workunit.client.0.smithi161.stdout:4/296: write f0 [2809363,3245] 0 2024-01-17T23:34:47.328 INFO:tasks.workunit.client.0.smithi161.stdout:3/249: mkdir d0/d5/d9/d38/d4f 0 2024-01-17T23:34:47.328 INFO:tasks.workunit.client.0.smithi161.stdout:3/250: fdatasync d0/d5/f19 0 2024-01-17T23:34:47.592 INFO:tasks.workunit.client.0.smithi161.stdout:8/221: rename d1/ce to d1/df/d20/c4a 0 2024-01-17T23:34:47.916 INFO:tasks.workunit.client.0.smithi161.stdout:1/296: rmdir d1/d20/d26/d30 39 2024-01-17T23:34:47.916 INFO:tasks.workunit.client.0.smithi161.stdout:1/297: stat d1/f23 0 2024-01-17T23:34:48.017 INFO:tasks.workunit.client.0.smithi161.stdout:0/313: dread f0 [0,4194304] 0 2024-01-17T23:34:48.107 INFO:tasks.workunit.client.0.smithi161.stdout:9/210: link d0/d8/cb d0/d8/d14/d18/c46 0 2024-01-17T23:34:48.426 INFO:tasks.workunit.client.0.smithi161.stdout:5/268: creat dd/f50 x:0 0 0 2024-01-17T23:34:48.579 INFO:tasks.workunit.client.0.smithi161.stdout:7/286: truncate da/d34/d5a/d3b/f55 406399 0 2024-01-17T23:34:48.579 INFO:tasks.workunit.client.0.smithi161.stdout:7/287: chown da/d34/l53 2525436 1 2024-01-17T23:34:48.953 INFO:tasks.workunit.client.0.smithi161.stdout:4/297: mkdir d9/de/d1e/d4e 0 2024-01-17T23:34:49.276 INFO:tasks.workunit.client.0.smithi161.stdout:8/222: mkdir d1/d3/d19/d1d/d25/d4b 0 2024-01-17T23:34:49.276 INFO:tasks.workunit.client.0.smithi161.stdout:3/251: mkdir d0/d5/d9/d38/d4f/d50 0 2024-01-17T23:34:49.277 INFO:tasks.workunit.client.0.smithi161.stdout:8/223: creat d1/df/d20/f4c x:0 0 0 2024-01-17T23:34:49.277 INFO:tasks.workunit.client.0.smithi161.stdout:8/224: chown d1/d3/f18 2514 1 2024-01-17T23:34:49.327 INFO:tasks.workunit.client.0.smithi161.stdout:3/252: dwrite d0/f10 [0,4194304] 0 2024-01-17T23:34:49.423 INFO:tasks.workunit.client.0.smithi161.stdout:1/298: rmdir d1/d20/d26/d30/d44 39 2024-01-17T23:34:49.460 INFO:tasks.workunit.client.0.smithi161.stdout:1/299: write d1/f38 [2008217,34946] 0 2024-01-17T23:34:49.461 INFO:tasks.workunit.client.0.smithi161.stdout:6/251: dwrite d6/d7/dc/d3c/d47/d13/f1c [0,4194304] 0 2024-01-17T23:34:49.879 INFO:tasks.workunit.client.0.smithi161.stdout:0/314: getdents d5/d34/d12 0 2024-01-17T23:34:49.879 INFO:tasks.workunit.client.0.smithi161.stdout:0/315: readlink d5/d34/d12/l26 0 2024-01-17T23:34:49.888 INFO:tasks.workunit.client.0.smithi161.stdout:0/316: dread d5/d2e/f58 [0,4194304] 0 2024-01-17T23:34:49.914 INFO:tasks.workunit.client.0.smithi161.stdout:0/317: dwrite d5/d34/d12/f37 [0,4194304] 0 2024-01-17T23:34:50.008 INFO:tasks.workunit.client.0.smithi161.stdout:9/211: fdatasync d0/d8/d14/d18/d20/f45 0 2024-01-17T23:34:50.078 INFO:tasks.workunit.client.0.smithi161.stdout:5/269: truncate dd/d15/f23 1610375 0 2024-01-17T23:34:50.351 INFO:tasks.workunit.client.0.smithi161.stdout:7/288: creat da/d34/d5a/d68/f6b x:0 0 0 2024-01-17T23:34:50.555 INFO:tasks.workunit.client.0.smithi161.stdout:4/298: rmdir d9/de/d1e/d4e 0 2024-01-17T23:34:50.787 INFO:tasks.workunit.client.0.smithi161.stdout:8/225: rmdir d1/df 39 2024-01-17T23:34:50.873 INFO:tasks.workunit.client.0.smithi161.stdout:2/239: rmdir d8/da/d52 39 2024-01-17T23:34:50.996 INFO:tasks.workunit.client.0.smithi161.stdout:3/253: truncate d0/d5/d9/d17/f33 3606861 0 2024-01-17T23:34:51.270 INFO:tasks.workunit.client.0.smithi161.stdout:1/300: rename d1/d20/d26/f2f to d1/d20/d26/f68 0 2024-01-17T23:34:51.270 INFO:tasks.workunit.client.0.smithi161.stdout:1/301: creat d1/d8/d1c/f69 x:0 0 0 2024-01-17T23:34:51.284 INFO:tasks.workunit.client.0.smithi161.stdout:1/302: dread d1/d20/f2e [4194304,4194304] 0 2024-01-17T23:34:51.307 INFO:tasks.workunit.client.0.smithi161.stdout:1/303: dread d1/d8/f13 [0,4194304] 0 2024-01-17T23:34:51.307 INFO:tasks.workunit.client.0.smithi161.stdout:1/304: chown d1/d11/f12 0 1 2024-01-17T23:34:51.308 INFO:tasks.workunit.client.0.smithi161.stdout:1/305: stat d1/l5 0 2024-01-17T23:34:51.308 INFO:tasks.workunit.client.0.smithi161.stdout:1/306: write d1/f23 [312067,9899] 0 2024-01-17T23:34:51.308 INFO:tasks.workunit.client.0.smithi161.stdout:1/307: dread - d1/d20/d26/d30/f5f zero size 2024-01-17T23:34:51.384 INFO:tasks.workunit.client.0.smithi161.stdout:6/252: mkdir d6/d58 0 2024-01-17T23:34:51.423 INFO:tasks.workunit.client.0.smithi161.stdout:6/253: dwrite d6/d7/dc/d3c/d47/d13/f22 [0,4194304] 0 2024-01-17T23:34:51.570 INFO:tasks.workunit.client.0.smithi161.stdout:0/318: symlink d5/d2e/l61 0 2024-01-17T23:34:51.595 INFO:tasks.workunit.client.0.smithi161.stdout:0/319: dwrite d5/f32 [0,4194304] 0 2024-01-17T23:34:51.839 INFO:tasks.workunit.client.0.smithi161.stdout:9/212: creat d0/d39/f47 x:0 0 0 2024-01-17T23:34:51.851 INFO:tasks.workunit.client.0.smithi161.stdout:5/270: truncate dd/f48 136107 0 2024-01-17T23:34:51.851 INFO:tasks.workunit.client.0.smithi161.stdout:5/271: write dd/d15/f1b [5534954,52130] 0 2024-01-17T23:34:51.852 INFO:tasks.workunit.client.0.smithi161.stdout:5/272: chown dd/d15/d1a/c2a 10591681 1 2024-01-17T23:34:51.852 INFO:tasks.workunit.client.0.smithi161.stdout:5/273: chown dd/d15/f1d 7 1 2024-01-17T23:34:52.277 INFO:tasks.workunit.client.0.smithi161.stdout:4/299: symlink d9/l4f 0 2024-01-17T23:34:52.444 INFO:tasks.workunit.client.0.smithi161.stdout:2/240: mknod d8/da/d52/d34/d35/d3a/c56 0 2024-01-17T23:34:52.659 INFO:tasks.workunit.client.0.smithi161.stdout:3/254: creat d0/d5/d9/d38/d4f/d50/f51 x:0 0 0 2024-01-17T23:34:52.659 INFO:tasks.workunit.client.0.smithi161.stdout:3/255: dread - d0/d5/d9/d17/f36 zero size 2024-01-17T23:34:52.895 INFO:tasks.workunit.client.0.smithi161.stdout:1/308: mknod d1/d31/d4e/c6a 0 2024-01-17T23:34:53.581 INFO:tasks.workunit.client.0.smithi161.stdout:0/320: symlink d5/d34/d20/l62 0 2024-01-17T23:34:54.005 INFO:tasks.workunit.client.0.smithi161.stdout:5/274: dread dd/f12 [0,4194304] 0 2024-01-17T23:34:54.036 INFO:tasks.workunit.client.0.smithi161.stdout:5/275: dwrite dd/f11 [0,4194304] 0 2024-01-17T23:34:54.129 INFO:tasks.workunit.client.0.smithi161.stdout:4/300: mknod d9/de/d1e/c50 0 2024-01-17T23:34:54.369 INFO:tasks.workunit.client.0.smithi161.stdout:3/256: mkdir d0/d5/d9/d1e/d3b/d52 0 2024-01-17T23:34:54.369 INFO:tasks.workunit.client.0.smithi161.stdout:2/241: mkdir d8/d1c/d57 0 2024-01-17T23:34:54.380 INFO:tasks.workunit.client.0.smithi161.stdout:2/242: dread d8/f14 [4194304,4194304] 0 2024-01-17T23:34:54.380 INFO:tasks.workunit.client.0.smithi161.stdout:2/243: truncate d8/da/d52/f51 200151 0 2024-01-17T23:34:54.381 INFO:tasks.workunit.client.0.smithi161.stdout:2/244: chown d8/d1c/f25 16452893 1 2024-01-17T23:34:54.402 INFO:tasks.workunit.client.0.smithi161.stdout:1/309: rename d1/d20/d26/c60 to d1/d8/d1c/c6b 0 2024-01-17T23:34:54.682 INFO:tasks.workunit.client.0.smithi161.stdout:7/289: dread da/d34/d5a/d3b/f55 [0,4194304] 0 2024-01-17T23:34:54.708 INFO:tasks.workunit.client.0.smithi161.stdout:7/290: dwrite da/d34/d5a/d28/f3e [0,4194304] 0 2024-01-17T23:34:54.708 INFO:tasks.workunit.client.0.smithi161.stdout:7/291: chown da/d34/d5a/d28/d43/f59 373650552 1 2024-01-17T23:34:54.751 INFO:tasks.workunit.client.0.smithi161.stdout:5/276: mkdir dd/d15/d51 0 2024-01-17T23:34:55.039 INFO:tasks.workunit.client.0.smithi161.stdout:2/245: creat d8/da/f58 x:0 0 0 2024-01-17T23:34:55.195 INFO:tasks.workunit.client.0.smithi161.stdout:1/310: rmdir d1/d20/d26/d30/d44 39 2024-01-17T23:34:55.195 INFO:tasks.workunit.client.0.smithi161.stdout:1/311: read - d1/d20/f51 zero size 2024-01-17T23:34:55.413 INFO:tasks.workunit.client.0.smithi161.stdout:7/292: creat da/f6c x:0 0 0 2024-01-17T23:34:55.413 INFO:tasks.workunit.client.0.smithi161.stdout:7/293: chown da/d34/d5a/d28/d43/l27 4620861 1 2024-01-17T23:34:56.242 INFO:tasks.workunit.client.0.smithi161.stdout:2/246: truncate d8/d1c/f25 801572 0 2024-01-17T23:34:56.242 INFO:tasks.workunit.client.0.smithi161.stdout:2/247: fsync d8/da/f27 0 2024-01-17T23:34:56.270 INFO:tasks.workunit.client.0.smithi161.stdout:8/226: dwrite d1/d3/f9 [0,4194304] 0 2024-01-17T23:34:56.271 INFO:tasks.workunit.client.0.smithi161.stdout:8/227: chown d1/df/d20/f4c 34025 1 2024-01-17T23:34:56.271 INFO:tasks.workunit.client.0.smithi161.stdout:8/228: stat d1/d1c 0 2024-01-17T23:34:56.348 INFO:tasks.workunit.client.0.smithi161.stdout:1/312: rename d1/d31/l4f to d1/d11/l6c 0 2024-01-17T23:34:56.348 INFO:tasks.workunit.client.0.smithi161.stdout:1/313: readlink d1/d2d/l3d 0 2024-01-17T23:34:56.385 INFO:tasks.workunit.client.0.smithi161.stdout:3/257: rmdir d0/d5/d9/d38/d4f/d50 39 2024-01-17T23:34:56.385 INFO:tasks.workunit.client.0.smithi161.stdout:3/258: fsync d0/d5/d9/d1e/d3b/f42 0 2024-01-17T23:34:56.385 INFO:tasks.workunit.client.0.smithi161.stdout:3/259: stat d0/d5/d9/d17/c3e 0 2024-01-17T23:34:56.889 INFO:tasks.workunit.client.0.smithi161.stdout:6/254: write d6/d7/dc/f19 [1233680,128970] 0 2024-01-17T23:34:57.224 INFO:tasks.workunit.client.0.smithi161.stdout:0/321: rmdir d5/d2e 39 2024-01-17T23:34:57.613 INFO:tasks.workunit.client.0.smithi161.stdout:2/248: creat d8/d1c/d1e/f59 x:0 0 0 2024-01-17T23:34:57.613 INFO:tasks.workunit.client.0.smithi161.stdout:2/249: dread - d8/da/f58 zero size 2024-01-17T23:34:58.244 INFO:tasks.workunit.client.0.smithi161.stdout:6/255: mkdir d6/d7/dc/d3c/d47/d1a/d59 0 2024-01-17T23:34:58.310 INFO:tasks.workunit.client.0.smithi161.stdout:0/322: symlink d5/d34/d12/l63 0 2024-01-17T23:34:58.425 INFO:tasks.workunit.client.0.smithi161.stdout:2/250: symlink d8/da/d52/l5a 0 2024-01-17T23:34:58.449 INFO:tasks.workunit.client.0.smithi161.stdout:2/251: dwrite d8/d1c/f1f [4194304,4194304] 0 2024-01-17T23:34:58.449 INFO:tasks.workunit.client.0.smithi161.stdout:2/252: chown d8/d1c/l1b 290 1 2024-01-17T23:34:58.506 INFO:tasks.workunit.client.0.smithi161.stdout:4/301: dwrite d9/f13 [0,4194304] 0 2024-01-17T23:34:58.546 INFO:tasks.workunit.client.0.smithi161.stdout:4/302: dwrite d9/d1b/d24/f2e [0,4194304] 0 2024-01-17T23:34:58.547 INFO:tasks.workunit.client.0.smithi161.stdout:4/303: write d9/d1b/d24/d25/f47 [285096,121930] 0 2024-01-17T23:34:58.636 INFO:tasks.workunit.client.0.smithi161.stdout:6/256: symlink d6/d7/dc/d3c/d47/d1a/l5a 0 2024-01-17T23:34:58.637 INFO:tasks.workunit.client.0.smithi161.stdout:6/257: chown d6/d7/dc/d3c/d47/d1a/l4c 10676 1 2024-01-17T23:34:59.003 INFO:tasks.workunit.client.0.smithi161.stdout:0/323: mkdir d5/d34/d20/d2b/d64 0 2024-01-17T23:34:59.004 INFO:tasks.workunit.client.0.smithi161.stdout:3/260: creat d0/d5/d9/f53 x:0 0 0 2024-01-17T23:34:59.004 INFO:tasks.workunit.client.0.smithi161.stdout:3/261: fdatasync d0/f12 0 2024-01-17T23:34:59.053 INFO:tasks.workunit.client.0.smithi161.stdout:9/213: rename d0/d8/f1f to d0/d8/f48 0 2024-01-17T23:34:59.053 INFO:tasks.workunit.client.0.smithi161.stdout:9/214: dread - d0/d39/f47 zero size 2024-01-17T23:34:59.075 INFO:tasks.workunit.client.0.smithi161.stdout:5/277: truncate dd/f11 1057696 0 2024-01-17T23:34:59.428 INFO:tasks.workunit.client.0.smithi161.stdout:6/258: creat d6/d7/dc/f5b x:0 0 0 2024-01-17T23:34:59.457 INFO:tasks.workunit.client.0.smithi161.stdout:6/259: dwrite d6/d7/dc/d3c/d47/f49 [0,4194304] 0 2024-01-17T23:34:59.458 INFO:tasks.workunit.client.0.smithi161.stdout:6/260: readlink d6/d7/dc/d1d/l56 0 2024-01-17T23:34:59.612 INFO:tasks.workunit.client.0.smithi161.stdout:3/262: mknod d0/d5/d9/d38/d4f/d50/c54 0 2024-01-17T23:34:59.612 INFO:tasks.workunit.client.0.smithi161.stdout:3/263: chown d0/d5/l25 28 1 2024-01-17T23:34:59.780 INFO:tasks.workunit.client.0.smithi161.stdout:9/215: mkdir d0/d39/d49 0 2024-01-17T23:34:59.937 INFO:tasks.workunit.client.0.smithi161.stdout:5/278: mkdir dd/d15/d4e/d52 0 2024-01-17T23:34:59.971 INFO:tasks.workunit.client.0.smithi161.stdout:5/279: dwrite dd/d31/d3c/f4c [0,4194304] 0 2024-01-17T23:34:59.971 INFO:tasks.workunit.client.0.smithi161.stdout:5/280: write dd/d31/d3c/f4b [249016,80184] 0 2024-01-17T23:34:59.990 INFO:tasks.workunit.client.0.smithi161.stdout:2/253: fsync d8/d1c/d1e/f59 0 2024-01-17T23:34:59.990 INFO:tasks.workunit.client.0.smithi161.stdout:2/254: chown d8/da/d52/d34/d35/d3a/c56 1833362931 1 2024-01-17T23:35:00.139 INFO:tasks.workunit.client.0.smithi161.stdout:4/304: rmdir d9/de/d1e/d38 39 2024-01-17T23:35:00.319 INFO:tasks.workunit.client.0.smithi161.stdout:6/261: mknod d6/d7/dc/d3c/d47/d13/c5c 0 2024-01-17T23:35:00.344 INFO:tasks.workunit.client.0.smithi161.stdout:1/314: dwrite d1/ff [0,4194304] 0 2024-01-17T23:35:00.570 INFO:tasks.workunit.client.0.smithi161.stdout:3/264: rename d0/f10 to d0/d5/d9/f55 0 2024-01-17T23:35:00.570 INFO:tasks.workunit.client.0.smithi161.stdout:9/216: link d0/d8/d14/l3c d0/d39/l4a 0 2024-01-17T23:35:00.571 INFO:tasks.workunit.client.0.smithi161.stdout:3/265: stat d0/d5/c28 0 2024-01-17T23:35:00.571 INFO:tasks.workunit.client.0.smithi161.stdout:9/217: write d0/f2a [4045057,66722] 0 2024-01-17T23:35:00.583 INFO:tasks.workunit.client.0.smithi161.stdout:9/218: dread d0/f33 [0,4194304] 0 2024-01-17T23:35:00.584 INFO:tasks.workunit.client.0.smithi161.stdout:9/219: chown d0/l16 58006 1 2024-01-17T23:35:00.599 INFO:tasks.workunit.client.0.smithi161.stdout:3/266: dwrite d0/d5/f26 [0,4194304] 0 2024-01-17T23:35:01.082 INFO:tasks.workunit.client.0.smithi161.stdout:2/255: mkdir d8/d1c/d5b 0 2024-01-17T23:35:01.082 INFO:tasks.workunit.client.0.smithi161.stdout:4/305: rmdir d9/d1b/d24 39 2024-01-17T23:35:01.082 INFO:tasks.workunit.client.0.smithi161.stdout:4/306: chown d9/de/d1e/l46 203860 1 2024-01-17T23:35:01.082 INFO:tasks.workunit.client.0.smithi161.stdout:4/307: read - d9/de/f19 zero size 2024-01-17T23:35:01.085 INFO:tasks.workunit.client.0.smithi161.stdout:2/256: dread d8/d1c/d1e/f3d [0,4194304] 0 2024-01-17T23:35:01.521 INFO:tasks.workunit.client.0.smithi161.stdout:1/315: mknod d1/d8/d54/c6d 0 2024-01-17T23:35:01.521 INFO:tasks.workunit.client.0.smithi161.stdout:5/281: rename dd/f4a to dd/d15/d4e/d52/f53 0 2024-01-17T23:35:01.521 INFO:tasks.workunit.client.0.smithi161.stdout:1/316: fsync d1/d20/f5c 0 2024-01-17T23:35:01.521 INFO:tasks.workunit.client.0.smithi161.stdout:1/317: truncate d1/d20/d26/f68 2783778 0 2024-01-17T23:35:01.545 INFO:tasks.workunit.client.0.smithi161.stdout:1/318: dwrite d1/d20/d26/d30/f58 [0,4194304] 0 2024-01-17T23:35:01.571 INFO:tasks.workunit.client.0.smithi161.stdout:1/319: dwrite d1/d8/d1c/f69 [0,4194304] 0 2024-01-17T23:35:01.587 INFO:tasks.workunit.client.0.smithi161.stdout:1/320: read d1/f18 [3951625,94529] 0 2024-01-17T23:35:01.616 INFO:tasks.workunit.client.0.smithi161.stdout:1/321: dwrite d1/d8/d1c/f48 [0,4194304] 0 2024-01-17T23:35:01.975 INFO:tasks.workunit.client.0.smithi161.stdout:3/267: getdents d0/d5/d9/d17/d2d 0 2024-01-17T23:35:02.054 INFO:tasks.workunit.client.0.smithi161.stdout:7/294: sync 2024-01-17T23:35:02.054 INFO:tasks.workunit.client.0.smithi161.stdout:8/229: sync 2024-01-17T23:35:02.054 INFO:tasks.workunit.client.0.smithi161.stdout:7/295: readlink da/db/l30 0 2024-01-17T23:35:02.054 INFO:tasks.workunit.client.0.smithi161.stdout:7/296: readlink da/d34/d4a/l60 0 2024-01-17T23:35:02.054 INFO:tasks.workunit.client.0.smithi161.stdout:8/230: fdatasync d1/df/f31 0 2024-01-17T23:35:02.054 INFO:tasks.workunit.client.0.smithi161.stdout:7/297: truncate da/d34/d4a/f5c 4504914 0 2024-01-17T23:35:02.054 INFO:tasks.workunit.client.0.smithi161.stdout:8/231: fsync d1/d3/d19/f21 0 2024-01-17T23:35:02.054 INFO:tasks.workunit.client.0.smithi161.stdout:7/298: dread - da/f5f zero size 2024-01-17T23:35:02.055 INFO:tasks.workunit.client.0.smithi161.stdout:7/299: dread - da/d34/d5a/d3b/f6a zero size 2024-01-17T23:35:02.055 INFO:tasks.workunit.client.0.smithi161.stdout:7/300: write da/d34/d5a/d3b/f48 [3281379,55483] 0 2024-01-17T23:35:02.081 INFO:tasks.workunit.client.0.smithi161.stdout:7/301: dwrite da/db/f11 [0,4194304] 0 2024-01-17T23:35:02.402 INFO:tasks.workunit.client.0.smithi161.stdout:5/282: unlink dd/d31/d3c/l49 0 2024-01-17T23:35:02.402 INFO:tasks.workunit.client.0.smithi161.stdout:5/283: chown dd/d15/d4e/d52 1 1 2024-01-17T23:35:02.417 INFO:tasks.workunit.client.0.smithi161.stdout:0/324: write d5/d8/f3c [1849850,4210] 0 2024-01-17T23:35:03.093 INFO:tasks.workunit.client.0.smithi161.stdout:6/262: rename d6/d7/d16 to d6/d7/dc/d3c/d47/d31/d5d 0 2024-01-17T23:35:03.093 INFO:tasks.workunit.client.0.smithi161.stdout:6/263: fdatasync d6/d7/dc/d3c/d47/d31/d5d/f46 0 2024-01-17T23:35:03.093 INFO:tasks.workunit.client.0.smithi161.stdout:6/264: creat d6/d7/dc/d1d/f5e x:0 0 0 2024-01-17T23:35:03.093 INFO:tasks.workunit.client.0.smithi161.stdout:6/265: write d6/d7/dc/d3c/d47/d31/f4e [73032,102559] 0 2024-01-17T23:35:03.093 INFO:tasks.workunit.client.0.smithi161.stdout:6/266: chown d6/d7/dc/d3c/d47/d1a/d59 781 1 2024-01-17T23:35:03.093 INFO:tasks.workunit.client.0.smithi161.stdout:1/322: truncate d1/d8/d1f/f25 379984 0 2024-01-17T23:35:03.093 INFO:tasks.workunit.client.0.smithi161.stdout:1/323: chown d1/d2d/l3d 1606 1 2024-01-17T23:35:03.560 INFO:tasks.workunit.client.0.smithi161.stdout:8/232: truncate d1/d3d/f42 3760275 0 2024-01-17T23:35:03.586 INFO:tasks.workunit.client.0.smithi161.stdout:8/233: dwrite d1/d3/d19/d1d/d25/f3b [0,4194304] 0 2024-01-17T23:35:04.238 INFO:tasks.workunit.client.0.smithi161.stdout:2/257: symlink d8/d2e/l5c 0 2024-01-17T23:35:04.364 INFO:tasks.workunit.client.0.smithi161.stdout:5/284: mkdir dd/d15/d4e/d4f/d54 0 2024-01-17T23:35:04.364 INFO:tasks.workunit.client.0.smithi161.stdout:5/285: fsync dd/d15/d1a/f43 0 2024-01-17T23:35:04.584 INFO:tasks.workunit.client.0.smithi161.stdout:9/220: rename d0/d39/l4a to d0/d39/d49/l4b 0 2024-01-17T23:35:05.023 INFO:tasks.workunit.client.0.smithi161.stdout:4/308: mkdir d9/d51 0 2024-01-17T23:35:05.023 INFO:tasks.workunit.client.0.smithi161.stdout:4/309: chown f7 5777 1 2024-01-17T23:35:05.418 INFO:tasks.workunit.client.0.smithi161.stdout:2/258: truncate d8/f18 159335 0 2024-01-17T23:35:05.577 INFO:tasks.workunit.client.0.smithi161.stdout:5/286: stat dd/d15/f19 0 2024-01-17T23:35:05.782 INFO:tasks.workunit.client.0.smithi161.stdout:7/302: rename da/f51 to da/d34/d5a/d3b/f6d 0 2024-01-17T23:35:05.782 INFO:tasks.workunit.client.0.smithi161.stdout:7/303: stat da/d34/d5a 0 2024-01-17T23:35:05.782 INFO:tasks.workunit.client.0.smithi161.stdout:7/304: chown da/d34/d5a/d28/f65 143654239 1 2024-01-17T23:35:05.794 INFO:tasks.workunit.client.0.smithi161.stdout:7/305: dread da/d34/d5a/d3b/f4b [0,4194304] 0 2024-01-17T23:35:05.794 INFO:tasks.workunit.client.0.smithi161.stdout:7/306: creat da/d34/d4a/d4c/f6e x:0 0 0 2024-01-17T23:35:06.060 INFO:tasks.workunit.client.0.smithi161.stdout:4/310: truncate f0 134674 0 2024-01-17T23:35:06.061 INFO:tasks.workunit.client.0.smithi161.stdout:4/311: truncate d9/f23 941668 0 2024-01-17T23:35:06.575 INFO:tasks.workunit.client.0.smithi161.stdout:7/307: symlink da/d34/d5a/d28/d2b/l6f 0 2024-01-17T23:35:06.575 INFO:tasks.workunit.client.0.smithi161.stdout:7/308: write da/d34/f52 [358467,11727] 0 2024-01-17T23:35:06.575 INFO:tasks.workunit.client.0.smithi161.stdout:7/309: write f8 [1678427,116980] 0 2024-01-17T23:35:06.575 INFO:tasks.workunit.client.0.smithi161.stdout:7/310: chown da/lf 0 1 2024-01-17T23:35:06.575 INFO:tasks.workunit.client.0.smithi161.stdout:7/311: chown da 258372295 1 2024-01-17T23:35:06.649 INFO:tasks.workunit.client.0.smithi161.stdout:9/221: symlink d0/d8/d14/d18/l4c 0 2024-01-17T23:35:06.649 INFO:tasks.workunit.client.0.smithi161.stdout:9/222: fdatasync d0/d8/d14/f3f 0 2024-01-17T23:35:06.649 INFO:tasks.workunit.client.0.smithi161.stdout:9/223: stat d0/d8/f10 0 2024-01-17T23:35:06.889 INFO:tasks.workunit.client.0.smithi161.stdout:6/267: rmdir d6/d7/dc/d3c/d47/d31/d5d 39 2024-01-17T23:35:07.102 INFO:tasks.workunit.client.0.smithi161.stdout:4/312: mkdir d9/d1b/d52 0 2024-01-17T23:35:07.104 INFO:tasks.workunit.client.0.smithi161.stdout:4/313: write d9/f23 [672166,83764] 0 2024-01-17T23:35:07.195 INFO:tasks.workunit.client.0.smithi161.stdout:3/268: dwrite d0/d5/d9/d17/f37 [0,4194304] 0 2024-01-17T23:35:07.432 INFO:tasks.workunit.client.0.smithi161.stdout:9/224: creat d0/d8/d31/f4d x:0 0 0 2024-01-17T23:35:07.529 INFO:tasks.workunit.client.0.smithi161.stdout:6/268: mknod d6/d58/c5f 0 2024-01-17T23:35:07.529 INFO:tasks.workunit.client.0.smithi161.stdout:6/269: getdents d6/d7/dc/d3c/d47/d31/d5d/d55 0 2024-01-17T23:35:07.547 INFO:tasks.workunit.client.0.smithi161.stdout:6/270: write d6/d7/dc/d3c/d47/d31/d5d/f18 [2078386,130726] 0 2024-01-17T23:35:07.923 INFO:tasks.workunit.client.0.smithi161.stdout:8/234: rmdir d1 39 2024-01-17T23:35:07.923 INFO:tasks.workunit.client.0.smithi161.stdout:8/235: truncate d1/d1c/f35 1463497 0 2024-01-17T23:35:08.281 INFO:tasks.workunit.client.0.smithi161.stdout:3/269: mkdir d0/d5/d9/d38/d4f/d56 0 2024-01-17T23:35:08.360 INFO:tasks.workunit.client.0.smithi161.stdout:9/225: mknod d0/d8/d14/d18/d20/c4e 0 2024-01-17T23:35:08.396 INFO:tasks.workunit.client.0.smithi161.stdout:9/226: dwrite d0/d8/f10 [0,4194304] 0 2024-01-17T23:35:08.422 INFO:tasks.workunit.client.0.smithi161.stdout:9/227: dwrite d0/f4 [0,4194304] 0 2024-01-17T23:35:08.422 INFO:tasks.workunit.client.0.smithi161.stdout:9/228: creat d0/d8/d14/d18/d20/f4f x:0 0 0 2024-01-17T23:35:08.422 INFO:tasks.workunit.client.0.smithi161.stdout:9/229: fdatasync d0/d8/d14/d18/d20/f4f 0 2024-01-17T23:35:08.929 INFO:tasks.workunit.client.0.smithi161.stdout:1/324: dwrite d1/d8/fc [0,4194304] 0 2024-01-17T23:35:09.083 INFO:tasks.workunit.client.0.smithi161.stdout:6/271: creat d6/d7/dc/d43/f60 x:0 0 0 2024-01-17T23:35:09.215 INFO:tasks.workunit.client.0.smithi161.stdout:8/236: creat d1/d3/d19/d1d/d25/f4d x:0 0 0 2024-01-17T23:35:09.677 INFO:tasks.workunit.client.0.smithi161.stdout:0/325: rename d5/cc to d5/c65 0 2024-01-17T23:35:09.677 INFO:tasks.workunit.client.0.smithi161.stdout:0/326: chown d5/d34/d12/d2a/d35/f5d 6 1 2024-01-17T23:35:09.677 INFO:tasks.workunit.client.0.smithi161.stdout:0/327: chown d5/d34/d12/f37 643 1 2024-01-17T23:35:09.951 INFO:tasks.workunit.client.0.smithi161.stdout:8/237: creat d1/f4e x:0 0 0 2024-01-17T23:35:09.963 INFO:tasks.workunit.client.0.smithi161.stdout:8/238: dread d1/f2 [0,4194304] 0 2024-01-17T23:35:10.019 INFO:tasks.workunit.client.0.smithi161.stdout:4/314: dread f0 [0,4194304] 0 2024-01-17T23:35:10.020 INFO:tasks.workunit.client.0.smithi161.stdout:4/315: readlink d9/de/d1e/l46 0 2024-01-17T23:35:10.020 INFO:tasks.workunit.client.0.smithi161.stdout:4/316: fdatasync d9/de/d1e/f36 0 2024-01-17T23:35:10.026 INFO:tasks.workunit.client.0.smithi161.stdout:0/328: dread d5/d8/f3c [0,4194304] 0 2024-01-17T23:35:10.026 INFO:tasks.workunit.client.0.smithi161.stdout:0/329: chown d5/d3a 6880 1 2024-01-17T23:35:10.026 INFO:tasks.workunit.client.0.smithi161.stdout:0/330: chown d5/d34/d12/l4a 555 1 2024-01-17T23:35:10.026 INFO:tasks.workunit.client.0.smithi161.stdout:0/331: chown d5/d34/d20/c24 127 1 2024-01-17T23:35:10.209 INFO:tasks.workunit.client.0.smithi161.stdout:8/239: link d1/d3/l30 d1/d3/d19/d1d/d25/l4f 0 2024-01-17T23:35:10.232 INFO:tasks.workunit.client.0.smithi161.stdout:2/259: write d8/da/d52/f33 [569878,125507] 0 2024-01-17T23:35:10.452 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:35:10.456 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:35:10.551 INFO:tasks.workunit.client.0.smithi161.stdout:4/317: mkdir d9/d1b/d53 0 2024-01-17T23:35:10.551 INFO:tasks.workunit.client.0.smithi161.stdout:4/318: chown d9/d27/d3a/l3d 168821011 1 2024-01-17T23:35:10.551 INFO:tasks.workunit.client.0.smithi161.stdout:4/319: chown d9 19928 1 2024-01-17T23:35:10.551 INFO:tasks.workunit.client.0.smithi161.stdout:0/332: stat d5/d34/l48 0 2024-01-17T23:35:10.603 INFO:tasks.workunit.client.0.smithi161.stdout:8/240: mknod d1/df/d46/c50 0 2024-01-17T23:35:10.603 INFO:tasks.workunit.client.0.smithi161.stdout:8/241: fsync d1/f2 0 2024-01-17T23:35:11.001 INFO:tasks.workunit.client.0.smithi161.stdout:4/320: link d9/de/d1e/f40 d9/d51/f54 0 2024-01-17T23:35:11.285 INFO:tasks.workunit.client.0.smithi161.stdout:8/242: mkdir d1/d3d/d51 0 2024-01-17T23:35:11.471 INFO:tasks.workunit.client.0.smithi161.stdout:2/260: mknod d8/d1c/d1e/c5d 0 2024-01-17T23:35:12.144 INFO:tasks.workunit.client.0.smithi161.stdout:4/321: write d9/f13 [4182886,66138] 0 2024-01-17T23:35:12.390 INFO:tasks.workunit.client.0.smithi161.stdout:7/312: truncate da/d34/d4a/f5c 1018896 0 2024-01-17T23:35:12.390 INFO:tasks.workunit.client.0.smithi161.stdout:7/313: chown da/d34/l53 4 1 2024-01-17T23:35:12.390 INFO:tasks.workunit.client.0.smithi161.stdout:7/314: fdatasync da/d34/d5a/d3b/f55 0 2024-01-17T23:35:12.481 INFO:tasks.workunit.client.0.smithi161.stdout:8/243: creat d1/df/d13/f52 x:0 0 0 2024-01-17T23:35:12.526 INFO:tasks.workunit.client.0.smithi161.stdout:2/261: dread d8/da/d52/f51 [0,4194304] 0 2024-01-17T23:35:12.679 INFO:tasks.workunit.client.0.smithi161.stdout:4/322: symlink d9/d1b/d53/l55 0 2024-01-17T23:35:13.062 INFO:tasks.workunit.client.0.smithi161.stdout:8/244: mkdir d1/df/d20/d2a/d53 0 2024-01-17T23:35:13.089 INFO:tasks.workunit.client.0.smithi161.stdout:8/245: dwrite d1/f4e [0,4194304] 0 2024-01-17T23:35:13.090 INFO:tasks.workunit.client.0.smithi161.stdout:8/246: write d1/d3d/f40 [1991625,60035] 0 2024-01-17T23:35:13.335 INFO:tasks.workunit.client.0.smithi161.stdout:4/323: mkdir d9/d27/d3a/d56 0 2024-01-17T23:35:13.335 INFO:tasks.workunit.client.0.smithi161.stdout:4/324: stat d9/f31 0 2024-01-17T23:35:13.335 INFO:tasks.workunit.client.0.smithi161.stdout:4/325: chown c5 13574 1 2024-01-17T23:35:13.356 INFO:tasks.workunit.client.0.smithi161.stdout:4/326: write d9/de/f30 [3160401,110857] 0 2024-01-17T23:35:13.397 INFO:tasks.workunit.client.0.smithi161.stdout:6/272: dwrite d6/d7/dc/d3c/d47/f11 [0,4194304] 0 2024-01-17T23:35:13.423 INFO:tasks.workunit.client.0.smithi161.stdout:6/273: dwrite d6/d7/dc/d3c/d47/f49 [0,4194304] 0 2024-01-17T23:35:14.067 INFO:tasks.workunit.client.0.smithi161.stdout:8/247: mknod d1/df/d20/c54 0 2024-01-17T23:35:14.068 INFO:tasks.workunit.client.0.smithi161.stdout:8/248: read d1/d3d/f40 [1547696,71314] 0 2024-01-17T23:35:14.315 INFO:tasks.workunit.client.0.smithi161.stdout:4/327: symlink d9/de/d1e/d38/l57 0 2024-01-17T23:35:14.630 INFO:tasks.workunit.client.0.smithi161.stdout:6/274: creat d6/d7/dc/d3c/d47/d13/f61 x:0 0 0 2024-01-17T23:35:14.644 INFO:tasks.workunit.client.0.smithi161.stdout:6/275: dread d6/d7/dc/d3c/d47/f49 [0,4194304] 0 2024-01-17T23:35:14.737 INFO:tasks.workunit.client.0.smithi161.stdout:4/328: mkdir d9/de/d1e/d58 0 2024-01-17T23:35:14.828 INFO:tasks.workunit.client.0.smithi161.stdout:3/270: creat d0/d5/f57 x:0 0 0 2024-01-17T23:35:14.836 INFO:tasks.workunit.client.0.smithi161.stdout:3/271: dread d0/d5/d9/f13 [0,4194304] 0 2024-01-17T23:35:14.912 INFO:tasks.workunit.client.0.smithi161.stdout:6/276: rename d6/d7/dc/d3c/d47/d1a/f3f to d6/d7/dc/d3c/d47/d1a/f62 0 2024-01-17T23:35:14.912 INFO:tasks.workunit.client.0.smithi161.stdout:6/277: dread - d6/d7/dc/d3c/d47/d31/d5d/f36 zero size 2024-01-17T23:35:14.912 INFO:tasks.workunit.client.0.smithi161.stdout:6/278: read - d6/d7/dc/d3c/d47/d31/f57 zero size 2024-01-17T23:35:14.912 INFO:tasks.workunit.client.0.smithi161.stdout:6/279: readlink d6/d7/dc/d1d/l56 0 2024-01-17T23:35:15.252 INFO:tasks.workunit.client.0.smithi161.stdout:3/272: mknod d0/d5/d9/d17/d2d/c58 0 2024-01-17T23:35:15.253 INFO:tasks.workunit.client.0.smithi161.stdout:3/273: truncate d0/d5/d9/d17/f18 899928 0 2024-01-17T23:35:15.368 INFO:tasks.workunit.client.0.smithi161.stdout:6/280: creat d6/d7/dc/f63 x:0 0 0 2024-01-17T23:35:15.368 INFO:tasks.workunit.client.0.smithi161.stdout:6/281: chown d6/d7/dc/f63 505 1 2024-01-17T23:35:15.369 INFO:tasks.workunit.client.0.smithi161.stdout:6/282: getdents d6/d7/dc/d3c/d47/d1a/d59 0 2024-01-17T23:35:15.664 INFO:tasks.workunit.client.0.smithi161.stdout:5/287: rename dd/f14 to dd/f55 0 2024-01-17T23:35:15.664 INFO:tasks.workunit.client.0.smithi161.stdout:5/288: write dd/f24 [3507039,17074] 0 2024-01-17T23:35:15.877 INFO:tasks.workunit.client.0.smithi161.stdout:9/230: rename d0/d8/d14/d18/d20/f37 to d0/f50 0 2024-01-17T23:35:15.877 INFO:tasks.workunit.client.0.smithi161.stdout:9/231: chown d0/f4 176215 1 2024-01-17T23:35:15.877 INFO:tasks.workunit.client.0.smithi161.stdout:9/232: dread - d0/d8/d14/d18/d20/f45 zero size 2024-01-17T23:35:15.880 INFO:tasks.workunit.client.0.smithi161.stdout:7/315: write da/d34/d5a/d28/d43/f5b [273027,129089] 0 2024-01-17T23:35:15.901 INFO:tasks.workunit.client.0.smithi161.stdout:8/249: rmdir d1/df/d20/d2a 39 2024-01-17T23:35:15.901 INFO:tasks.workunit.client.0.smithi161.stdout:8/250: fsync d1/d3/d19/d1d/f36 0 2024-01-17T23:35:16.969 INFO:tasks.workunit.client.0.smithi161.stdout:1/325: rename d1/d11/l6c to d1/d64/l6e 0 2024-01-17T23:35:16.969 INFO:tasks.workunit.client.0.smithi161.stdout:9/233: write d0/d8/d14/d18/f1d [3568381,1490] 0 2024-01-17T23:35:16.969 INFO:tasks.workunit.client.0.smithi161.stdout:3/274: rmdir d0/d5/d9/d38 39 2024-01-17T23:35:17.528 INFO:tasks.workunit.client.0.smithi161.stdout:1/326: rmdir d1/d2d/d3b 39 2024-01-17T23:35:17.603 INFO:tasks.workunit.client.0.smithi161.stdout:9/234: rmdir d0/d8 39 2024-01-17T23:35:17.604 INFO:tasks.workunit.client.0.smithi161.stdout:9/235: truncate d0/d8/d14/f44 244671 0 2024-01-17T23:35:17.696 INFO:tasks.workunit.client.0.smithi161.stdout:2/262: rename d8/d1c/l46 to d8/d1c/d1e/l5e 0 2024-01-17T23:35:17.819 INFO:tasks.workunit.client.0.smithi161.stdout:4/329: sync 2024-01-17T23:35:17.819 INFO:tasks.workunit.client.0.smithi161.stdout:0/333: sync 2024-01-17T23:35:17.819 INFO:tasks.workunit.client.0.smithi161.stdout:0/334: readlink d5/d34/d12/l4e 0 2024-01-17T23:35:17.820 INFO:tasks.workunit.client.0.smithi161.stdout:4/330: write d9/de/f33 [488119,98663] 0 2024-01-17T23:35:17.926 INFO:tasks.workunit.client.0.smithi161.stdout:7/316: rmdir da 39 2024-01-17T23:35:17.926 INFO:tasks.workunit.client.0.smithi161.stdout:7/317: creat da/d34/d4a/d4c/f70 x:0 0 0 2024-01-17T23:35:17.932 INFO:tasks.workunit.client.0.smithi161.stdout:7/318: dread da/f26 [0,4194304] 0 2024-01-17T23:35:17.932 INFO:tasks.workunit.client.0.smithi161.stdout:7/319: fsync da/d34/d5a/f2f 0 2024-01-17T23:35:17.932 INFO:tasks.workunit.client.0.smithi161.stdout:7/320: fsync da/f62 0 2024-01-17T23:35:18.028 INFO:tasks.workunit.client.0.smithi161.stdout:1/327: creat d1/d2d/f6f x:0 0 0 2024-01-17T23:35:18.184 INFO:tasks.workunit.client.0.smithi161.stdout:3/275: rename d0/d5/c21 to d0/d5/d9/d38/d4f/d50/c59 0 2024-01-17T23:35:18.314 INFO:tasks.workunit.client.0.smithi161.stdout:0/335: creat d5/d34/d12/f66 x:0 0 0 2024-01-17T23:35:18.340 INFO:tasks.workunit.client.0.smithi161.stdout:0/336: write d5/d34/d21/f3d [590096,50031] 0 2024-01-17T23:35:18.599 INFO:tasks.workunit.client.0.smithi161.stdout:8/251: mkdir d1/d55 0 2024-01-17T23:35:18.792 INFO:tasks.workunit.client.0.smithi161.stdout:6/283: rmdir d6/d7/dc 39 2024-01-17T23:35:18.817 INFO:tasks.workunit.client.0.smithi161.stdout:6/284: dwrite d6/d7/dc/d3c/d47/d31/f4e [0,4194304] 0 2024-01-17T23:35:18.818 INFO:tasks.workunit.client.0.smithi161.stdout:6/285: write d6/d7/dc/f4b [557829,110763] 0 2024-01-17T23:35:18.837 INFO:tasks.workunit.client.0.smithi161.stdout:6/286: write d6/d7/dc/d3c/f4a [608828,114971] 0 2024-01-17T23:35:18.919 INFO:tasks.workunit.client.0.smithi161.stdout:1/328: symlink d1/d64/l70 0 2024-01-17T23:35:19.082 INFO:tasks.workunit.client.0.smithi161.stdout:9/236: rename d0/d39/f47 to d0/f51 0 2024-01-17T23:35:19.124 INFO:tasks.workunit.client.0.smithi161.stdout:3/276: mkdir d0/d5/d9/d1e/d5a 0 2024-01-17T23:35:19.124 INFO:tasks.workunit.client.0.smithi161.stdout:3/277: write d0/d5/d9/d1e/f39 [365635,75616] 0 2024-01-17T23:35:19.389 INFO:tasks.workunit.client.0.smithi161.stdout:5/289: sync 2024-01-17T23:35:19.390 INFO:tasks.workunit.client.0.smithi161.stdout:5/290: getdents dd/d15/d4e/d4f/d54 0 2024-01-17T23:35:19.464 INFO:tasks.workunit.client.0.smithi161.stdout:0/337: mkdir d5/d34/d21/d67 0 2024-01-17T23:35:19.493 INFO:tasks.workunit.client.0.smithi161.stdout:0/338: dwrite d5/d34/d20/f2f [0,4194304] 0 2024-01-17T23:35:19.493 INFO:tasks.workunit.client.0.smithi161.stdout:0/339: dread - d5/d3a/d49/f5b zero size 2024-01-17T23:35:19.603 INFO:tasks.workunit.client.0.smithi161.stdout:8/252: truncate d1/d3d/f40 1624911 0 2024-01-17T23:35:19.921 INFO:tasks.workunit.client.0.smithi161.stdout:6/287: truncate d6/d7/dc/d3c/d47/d13/f22 229215 0 2024-01-17T23:35:19.921 INFO:tasks.workunit.client.0.smithi161.stdout:6/288: chown d6/d7/dc/d3c/d47/l2d 754 1 2024-01-17T23:35:19.922 INFO:tasks.workunit.client.0.smithi161.stdout:6/289: creat d6/d7/dc/d43/f64 x:0 0 0 2024-01-17T23:35:19.922 INFO:tasks.workunit.client.0.smithi161.stdout:6/290: stat d6/d7/dc/d3c/d47/d31/c54 0 2024-01-17T23:35:20.084 INFO:tasks.workunit.client.0.smithi161.stdout:7/321: mknod da/d14/c71 0 2024-01-17T23:35:20.084 INFO:tasks.workunit.client.0.smithi161.stdout:7/322: dread - da/d34/d5a/d3b/f6a zero size 2024-01-17T23:35:20.084 INFO:tasks.workunit.client.0.smithi161.stdout:7/323: stat da/d34/d5a/d3b/d3d/c50 0 2024-01-17T23:35:20.084 INFO:tasks.workunit.client.0.smithi161.stdout:7/324: chown da/d34/d5a/d28/d43/f2e 4225 1 2024-01-17T23:35:20.371 INFO:tasks.workunit.client.0.smithi161.stdout:1/329: creat d1/d8/d1f/d4b/f71 x:0 0 0 2024-01-17T23:35:20.576 INFO:tasks.workunit.client.0.smithi161.stdout:9/237: rename d0/f33 to d0/d8/d31/f52 0 2024-01-17T23:35:20.576 INFO:tasks.workunit.client.0.smithi161.stdout:3/278: mknod d0/d5/d9/d17/d2d/c5b 0 2024-01-17T23:35:20.595 INFO:tasks.workunit.client.0.smithi161.stdout:3/279: dread d0/f2e [0,4194304] 0 2024-01-17T23:35:20.606 INFO:tasks.workunit.client.0.smithi161.stdout:3/280: dread d0/f12 [0,4194304] 0 2024-01-17T23:35:20.808 INFO:tasks.workunit.client.0.smithi161.stdout:0/340: mkdir d5/d8/d68 0 2024-01-17T23:35:20.882 INFO:tasks.workunit.client.0.smithi161.stdout:2/263: dwrite d8/da/d52/d34/f4c [0,4194304] 0 2024-01-17T23:35:20.882 INFO:tasks.workunit.client.0.smithi161.stdout:2/264: dread - d8/d1c/d1e/f59 zero size 2024-01-17T23:35:20.935 INFO:tasks.workunit.client.0.smithi161.stdout:8/253: read d1/d3/f18 [308419,64883] 0 2024-01-17T23:35:20.954 INFO:tasks.workunit.client.0.smithi161.stdout:4/331: write f7 [554331,122230] 0 2024-01-17T23:35:21.212 INFO:tasks.workunit.client.0.smithi161.stdout:6/291: creat d6/f65 x:0 0 0 2024-01-17T23:35:21.212 INFO:tasks.workunit.client.0.smithi161.stdout:6/292: write d6/d7/dc/f5b [503041,46483] 0 2024-01-17T23:35:21.313 INFO:tasks.workunit.client.0.smithi161.stdout:7/325: mknod da/d34/d5a/d28/c72 0 2024-01-17T23:35:21.650 INFO:tasks.workunit.client.0.smithi161.stdout:1/330: dread d1/d8/f13 [0,4194304] 0 2024-01-17T23:35:21.650 INFO:tasks.workunit.client.0.smithi161.stdout:1/331: readlink d1/d8/l1d 0 2024-01-17T23:35:21.688 INFO:tasks.workunit.client.0.smithi161.stdout:1/332: dwrite d1/d8/d1f/f49 [0,4194304] 0 2024-01-17T23:35:21.879 INFO:tasks.workunit.client.0.smithi161.stdout:5/291: rename dd/d15/d4e/d4f/d54 to dd/d31/d56 0 2024-01-17T23:35:21.879 INFO:tasks.workunit.client.0.smithi161.stdout:5/292: stat dd/d15/f19 0 2024-01-17T23:35:21.949 INFO:tasks.workunit.client.0.smithi161.stdout:9/238: mknod d0/d39/d49/c53 0 2024-01-17T23:35:22.313 INFO:tasks.workunit.client.0.smithi161.stdout:3/281: mkdir d0/d5/d9/d17/d5c 0 2024-01-17T23:35:22.313 INFO:tasks.workunit.client.0.smithi161.stdout:0/341: creat d5/d34/d20/d2b/f69 x:0 0 0 2024-01-17T23:35:22.313 INFO:tasks.workunit.client.0.smithi161.stdout:3/282: chown d0/d5/d9/d17 883129 1 2024-01-17T23:35:22.338 INFO:tasks.workunit.client.0.smithi161.stdout:3/283: dwrite d0/d5/d9/f53 [0,4194304] 0 2024-01-17T23:35:22.534 INFO:tasks.workunit.client.0.smithi161.stdout:2/265: symlink d8/da/l5f 0 2024-01-17T23:35:22.567 INFO:tasks.workunit.client.0.smithi161.stdout:2/266: dwrite d8/d1c/d1e/f38 [0,4194304] 0 2024-01-17T23:35:22.567 INFO:tasks.workunit.client.0.smithi161.stdout:2/267: write d8/da/f10 [4272871,52033] 0 2024-01-17T23:35:22.579 INFO:tasks.workunit.client.0.smithi161.stdout:2/268: dread d8/da/f27 [0,4194304] 0 2024-01-17T23:35:22.630 INFO:tasks.workunit.client.0.smithi161.stdout:8/254: mkdir d1/df/d20/d2a/d56 0 2024-01-17T23:35:22.701 INFO:tasks.workunit.client.0.smithi161.stdout:4/332: creat d9/d1b/d52/f59 x:0 0 0 2024-01-17T23:35:22.701 INFO:tasks.workunit.client.0.smithi161.stdout:4/333: stat d9/de/d1e 0 2024-01-17T23:35:22.735 INFO:tasks.workunit.client.0.smithi161.stdout:4/334: dwrite d9/de/f1a [4194304,4194304] 0 2024-01-17T23:35:22.765 INFO:tasks.workunit.client.0.smithi161.stdout:4/335: dwrite d9/de/d1e/d38/f49 [0,4194304] 0 2024-01-17T23:35:23.528 INFO:tasks.workunit.client.0.smithi161.stdout:7/326: creat da/d14/d35/d41/f73 x:0 0 0 2024-01-17T23:35:23.542 INFO:tasks.workunit.client.0.smithi161.stdout:7/327: read da/db/f11 [1808722,8568] 0 2024-01-17T23:35:23.836 INFO:tasks.workunit.client.0.smithi161.stdout:1/333: mkdir d1/d11/d72 0 2024-01-17T23:35:23.836 INFO:tasks.workunit.client.0.smithi161.stdout:1/334: chown d1/d8/f56 11 1 2024-01-17T23:35:23.836 INFO:tasks.workunit.client.0.smithi161.stdout:1/335: stat d1/d31/d4e/c55 0 2024-01-17T23:35:23.836 INFO:tasks.workunit.client.0.smithi161.stdout:1/336: truncate d1/d20/d26/d30/d44/f52 279542 0 2024-01-17T23:35:24.034 INFO:tasks.workunit.client.0.smithi161.stdout:6/293: rename d6/d7/dc/d3c/d47/d1a/l5a to d6/d7/l66 0 2024-01-17T23:35:24.112 INFO:tasks.workunit.client.0.smithi161.stdout:5/293: creat dd/d15/d1a/f57 x:0 0 0 2024-01-17T23:35:24.115 INFO:tasks.workunit.client.0.smithi161.stdout:5/294: dread dd/d15/f1d [0,4194304] 0 2024-01-17T23:35:24.116 INFO:tasks.workunit.client.0.smithi161.stdout:5/295: chown dd/c3b 0 1 2024-01-17T23:35:24.297 INFO:tasks.workunit.client.0.smithi161.stdout:0/342: mknod d5/d34/d12/d2a/c6a 0 2024-01-17T23:35:24.297 INFO:tasks.workunit.client.0.smithi161.stdout:0/343: chown d5/l41 134288223 1 2024-01-17T23:35:24.324 INFO:tasks.workunit.client.0.smithi161.stdout:0/344: dwrite d5/d34/d20/f2f [0,4194304] 0 2024-01-17T23:35:24.595 INFO:tasks.workunit.client.0.smithi161.stdout:3/284: truncate d0/d5/fa 2016719 0 2024-01-17T23:35:25.390 INFO:tasks.workunit.client.0.smithi161.stdout:4/336: mknod d9/d27/d3a/d56/c5a 0 2024-01-17T23:35:25.390 INFO:tasks.workunit.client.0.smithi161.stdout:4/337: read - d9/d1b/f3b zero size 2024-01-17T23:35:25.686 INFO:tasks.workunit.client.0.smithi161.stdout:7/328: unlink da/d34/d5a/d28/d43/c38 0 2024-01-17T23:35:25.785 INFO:tasks.workunit.client.0.smithi161.stdout:1/337: creat d1/d20/f73 x:0 0 0 2024-01-17T23:35:26.071 INFO:tasks.workunit.client.0.smithi161.stdout:8/255: getdents d1/df/d20/d2a 0 2024-01-17T23:35:26.092 INFO:tasks.workunit.client.0.smithi161.stdout:5/296: dread dd/d15/f21 [0,4194304] 0 2024-01-17T23:35:26.092 INFO:tasks.workunit.client.0.smithi161.stdout:5/297: creat dd/d15/d1a/d42/f58 x:0 0 0 2024-01-17T23:35:26.092 INFO:tasks.workunit.client.0.smithi161.stdout:5/298: fsync dd/d15/d1a/f25 0 2024-01-17T23:35:26.282 INFO:tasks.workunit.client.0.smithi161.stdout:0/345: mkdir d5/d8/d68/d6b 0 2024-01-17T23:35:26.282 INFO:tasks.workunit.client.0.smithi161.stdout:0/346: chown d5/d34/d12/d2a/l39 16466634 1 2024-01-17T23:35:26.282 INFO:tasks.workunit.client.0.smithi161.stdout:0/347: chown d5/d34/d20/c24 149361 1 2024-01-17T23:35:26.870 INFO:tasks.workunit.client.0.smithi161.stdout:4/338: truncate d9/de/f2b 12130 0 2024-01-17T23:35:26.942 INFO:tasks.workunit.client.0.smithi161.stdout:1/338: rmdir d1/d20/d26/d30 39 2024-01-17T23:35:27.005 INFO:tasks.workunit.client.0.smithi161.stdout:2/269: rename d8/da/d52/d34/f4c to d8/da/d52/d34/d35/d3a/f60 0 2024-01-17T23:35:27.409 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:37:50.765 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:35:27.412 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:37:50.768 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:35:27.434 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:37:50.710 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:35:27.441 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:37:50.718 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:35:27.443 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:37:50.719 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:35:27.453 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:37:50.729 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:35:27.453 INFO:tasks.workunit.client.0.smithi161.stdout:8/256: mknod d1/df/d20/d2a/c57 0 2024-01-17T23:35:27.509 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:37:50.864 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:35:27.602 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:37:50.877 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:35:27.609 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:37:50.885 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:35:27.680 INFO:tasks.workunit.client.0.smithi161.stdout:5/299: unlink dd/d15/f1d 0 2024-01-17T23:35:27.793 INFO:tasks.workunit.client.0.smithi161.stdout:0/348: creat d5/d34/d20/d2b/d64/f6c x:0 0 0 2024-01-17T23:35:27.998 INFO:tasks.workunit.client.0.smithi161.stdout:9/239: write d0/d8/d14/f25 [5547159,74400] 0 2024-01-17T23:35:28.069 INFO:tasks.workunit.client.0.smithi161.stdout:4/339: mkdir d9/d1b/d24/d25/d5b 0 2024-01-17T23:35:28.096 INFO:tasks.workunit.client.0.smithi161.stdout:4/340: dwrite f7 [0,4194304] 0 2024-01-17T23:35:28.096 INFO:tasks.workunit.client.0.smithi161.stdout:4/341: fdatasync f4 0 2024-01-17T23:35:28.096 INFO:tasks.workunit.client.0.smithi161.stdout:4/342: write d9/de/f19 [395197,95670] 0 2024-01-17T23:35:28.097 INFO:tasks.workunit.client.0.smithi161.stdout:4/343: write d9/de/f30 [4103446,17003] 0 2024-01-17T23:35:28.097 INFO:tasks.workunit.client.0.smithi161.stdout:4/344: chown d9/d27/d3a/d56/c5a 67992415 1 2024-01-17T23:35:28.097 INFO:tasks.workunit.client.0.smithi161.stdout:4/345: fdatasync d9/de/f2c 0 2024-01-17T23:35:28.112 INFO:tasks.workunit.client.0.smithi161.stdout:4/346: write d9/d1b/d24/f2e [831704,32227] 0 2024-01-17T23:35:28.112 INFO:tasks.workunit.client.0.smithi161.stdout:4/347: truncate d9/d27/d3a/f4a 69671 0 2024-01-17T23:35:28.148 INFO:tasks.workunit.client.0.smithi161.stdout:1/339: getdents d1/d11 0 2024-01-17T23:35:28.547 INFO:tasks.workunit.client.0.smithi161.stdout:9/240: symlink d0/d8/d31/l54 0 2024-01-17T23:35:28.764 INFO:tasks.workunit.client.0.smithi161.stdout:4/348: mknod d9/de/d1e/d38/c5c 0 2024-01-17T23:35:28.841 INFO:tasks.workunit.client.0.smithi161.stdout:1/340: rename d1/d8/d1c/f5d to d1/d31/d4e/f74 0 2024-01-17T23:35:28.841 INFO:tasks.workunit.client.0.smithi161.stdout:1/341: chown d1/d8/fc 3 1 2024-01-17T23:35:29.299 INFO:tasks.workunit.client.0.smithi161.stdout:6/294: creat d6/d7/dc/d3c/f67 x:0 0 0 2024-01-17T23:35:29.604 INFO:tasks.workunit.client.0.smithi161.stdout:1/342: creat d1/d11/f75 x:0 0 0 2024-01-17T23:35:29.604 INFO:tasks.workunit.client.0.smithi161.stdout:1/343: creat d1/d11/f76 x:0 0 0 2024-01-17T23:35:29.858 INFO:tasks.workunit.client.0.smithi161.stdout:4/349: truncate d9/fb 911908 0 2024-01-17T23:35:30.024 INFO:tasks.workunit.client.0.smithi161.stdout:1/344: creat d1/d20/d26/d30/f77 x:0 0 0 2024-01-17T23:35:30.025 INFO:tasks.workunit.client.0.smithi161.stdout:1/345: chown d1/d20/d26/c27 21996059 1 2024-01-17T23:35:30.131 INFO:tasks.workunit.client.0.smithi161.stdout:9/241: rename d0/d39/f43 to d0/d8/d14/d18/f55 0 2024-01-17T23:35:30.541 INFO:tasks.workunit.client.0.smithi161.stdout:4/350: symlink d9/de/d1e/l5d 0 2024-01-17T23:35:30.585 INFO:tasks.workunit.client.0.smithi161.stdout:3/285: unlink d0/f29 0 2024-01-17T23:35:30.933 INFO:tasks.workunit.client.0.smithi161.stdout:6/295: rename d6/d7/dc/d3c/d47/d31/f57 to d6/f68 0 2024-01-17T23:35:30.933 INFO:tasks.workunit.client.0.smithi161.stdout:9/242: mkdir d0/d8/d14/d56 0 2024-01-17T23:35:31.148 INFO:tasks.workunit.client.0.smithi161.stdout:3/286: link d0/d5/d9/f55 d0/d5/d9/d1e/d3b/d52/f5d 0 2024-01-17T23:35:31.183 INFO:tasks.workunit.client.0.smithi161.stdout:4/351: dwrite d9/d27/d3a/f4a [0,4194304] 0 2024-01-17T23:35:31.202 INFO:tasks.workunit.client.0.smithi161.stdout:4/352: dread d9/f31 [0,4194304] 0 2024-01-17T23:35:31.202 INFO:tasks.workunit.client.0.smithi161.stdout:4/353: stat d9/de/c4b 0 2024-01-17T23:35:31.230 INFO:tasks.workunit.client.0.smithi161.stdout:2/270: dwrite d8/f18 [0,4194304] 0 2024-01-17T23:35:31.242 INFO:tasks.workunit.client.0.smithi161.stdout:2/271: write d8/da/f27 [2523355,7308] 0 2024-01-17T23:35:31.242 INFO:tasks.workunit.client.0.smithi161.stdout:2/272: chown d8/da/d52/d34/d35/l55 677874762 1 2024-01-17T23:35:31.243 INFO:tasks.workunit.client.0.smithi161.stdout:2/273: write d8/f54 [832329,14488] 0 2024-01-17T23:35:31.575 INFO:tasks.workunit.client.0.smithi161.stdout:9/243: creat d0/d39/d49/f57 x:0 0 0 2024-01-17T23:35:31.626 INFO:tasks.workunit.client.0.smithi161.stdout:5/300: dwrite dd/d31/d3c/f4c [0,4194304] 0 2024-01-17T23:35:31.626 INFO:tasks.workunit.client.0.smithi161.stdout:5/301: creat dd/d15/d1a/f59 x:0 0 0 2024-01-17T23:35:31.626 INFO:tasks.workunit.client.0.smithi161.stdout:5/302: fsync dd/d31/f38 0 2024-01-17T23:35:31.626 INFO:tasks.workunit.client.0.smithi161.stdout:5/303: write dd/d15/d1a/f57 [595886,77306] 0 2024-01-17T23:35:31.626 INFO:tasks.workunit.client.0.smithi161.stdout:5/304: read - dd/d15/f2e zero size 2024-01-17T23:35:31.828 INFO:tasks.workunit.client.0.smithi161.stdout:3/287: link d0/d5/d9/c11 d0/d5/d9/d1e/d3b/d52/c5e 0 2024-01-17T23:35:32.099 INFO:tasks.workunit.client.0.smithi161.stdout:4/354: mknod d9/d27/d3a/c5e 0 2024-01-17T23:35:32.657 INFO:tasks.workunit.client.0.smithi161.stdout:5/305: truncate dd/d15/d1a/f43 814551 0 2024-01-17T23:35:32.659 INFO:tasks.workunit.client.0.smithi161.stdout:5/306: dread dd/d15/d1a/f25 [0,4194304] 0 2024-01-17T23:35:33.028 INFO:tasks.workunit.client.0.smithi161.stdout:3/288: rename d0/d5/f26 to d0/d5/d9/d1e/f5f 0 2024-01-17T23:35:33.029 INFO:tasks.workunit.client.0.smithi161.stdout:4/355: creat d9/d27/d3a/d56/f5f x:0 0 0 2024-01-17T23:35:33.029 INFO:tasks.workunit.client.0.smithi161.stdout:4/356: fsync d9/d1b/d52/f59 0 2024-01-17T23:35:33.085 INFO:tasks.workunit.client.0.smithi161.stdout:2/274: mknod d8/d1c/d1e/c61 0 2024-01-17T23:35:33.093 INFO:tasks.workunit.client.0.smithi161.stdout:2/275: fsync d8/f54 0 2024-01-17T23:35:33.335 INFO:tasks.workunit.client.0.smithi161.stdout:9/244: rmdir d0/d8/d31 39 2024-01-17T23:35:33.513 INFO:tasks.workunit.client.0.smithi161.stdout:5/307: symlink dd/d31/d3c/l5a 0 2024-01-17T23:35:33.519 INFO:tasks.workunit.client.0.smithi161.stdout:5/308: dread f8 [0,4194304] 0 2024-01-17T23:35:33.519 INFO:tasks.workunit.client.0.smithi161.stdout:5/309: creat dd/d31/d3c/f5b x:0 0 0 2024-01-17T23:35:33.733 INFO:tasks.workunit.client.0.smithi161.stdout:3/289: unlink d0/d5/d9/d17/d32/l47 0 2024-01-17T23:35:34.019 INFO:tasks.workunit.client.0.smithi161.stdout:2/276: getdents d8/d1c 0 2024-01-17T23:35:34.019 INFO:tasks.workunit.client.0.smithi161.stdout:2/277: fsync d8/da/d52/f53 0 2024-01-17T23:35:34.490 INFO:tasks.workunit.client.0.smithi161.stdout:7/329: sync 2024-01-17T23:35:34.490 INFO:tasks.workunit.client.0.smithi161.stdout:8/257: sync 2024-01-17T23:35:34.490 INFO:tasks.workunit.client.0.smithi161.stdout:7/330: write da/d34/d5a/d28/f65 [864160,77430] 0 2024-01-17T23:35:34.500 INFO:tasks.workunit.client.0.smithi161.stdout:7/331: dread da/f2c [0,4194304] 0 2024-01-17T23:35:34.531 INFO:tasks.workunit.client.0.smithi161.stdout:5/310: symlink dd/d15/d51/l5c 0 2024-01-17T23:35:34.641 INFO:tasks.workunit.client.0.smithi161.stdout:3/290: creat d0/d5/d9/d1e/d3b/d52/f60 x:0 0 0 2024-01-17T23:35:34.641 INFO:tasks.workunit.client.0.smithi161.stdout:3/291: readlink d0/l4b 0 2024-01-17T23:35:34.756 INFO:tasks.workunit.client.0.smithi161.stdout:2/278: rename l5 to d8/d4b/l62 0 2024-01-17T23:35:34.920 INFO:tasks.workunit.client.0.smithi161.stdout:7/332: mknod da/d14/d35/d54/c74 0 2024-01-17T23:35:35.218 INFO:tasks.workunit.client.0.smithi161.stdout:3/292: truncate d0/f4 4546074 0 2024-01-17T23:35:35.245 INFO:tasks.workunit.client.0.smithi161.stdout:3/293: dwrite d0/d5/d9/d1e/d3b/f42 [0,4194304] 0 2024-01-17T23:35:35.255 INFO:tasks.workunit.client.0.smithi161.stdout:3/294: dread d0/f12 [0,4194304] 0 2024-01-17T23:35:35.265 INFO:tasks.workunit.client.0.smithi161.stdout:3/295: dread d0/d5/f19 [0,4194304] 0 2024-01-17T23:35:35.292 INFO:tasks.workunit.client.0.smithi161.stdout:3/296: dwrite d0/d5/d9/f53 [0,4194304] 0 2024-01-17T23:35:35.293 INFO:tasks.workunit.client.0.smithi161.stdout:3/297: stat d0/d5/d9/d17/f18 0 2024-01-17T23:35:35.311 INFO:tasks.workunit.client.0.smithi161.stdout:2/279: creat d8/d2e/f63 x:0 0 0 2024-01-17T23:35:35.311 INFO:tasks.workunit.client.0.smithi161.stdout:3/298: dread d0/d5/d9/d17/f37 [0,4194304] 0 2024-01-17T23:35:35.474 INFO:tasks.workunit.client.0.smithi161.stdout:7/333: creat da/d34/d5a/f75 x:0 0 0 2024-01-17T23:35:35.757 INFO:tasks.workunit.client.0.smithi161.stdout:2/280: symlink d8/d1c/d5b/l64 0 2024-01-17T23:35:35.958 INFO:tasks.workunit.client.0.smithi161.stdout:3/299: symlink d0/d5/d9/d1e/d3b/l61 0 2024-01-17T23:35:36.028 INFO:tasks.workunit.client.0.smithi161.stdout:6/296: dwrite d6/d7/dc/d3c/d47/d13/f22 [0,4194304] 0 2024-01-17T23:35:36.389 INFO:tasks.workunit.client.0.smithi161.stdout:8/258: creat d1/f58 x:0 0 0 2024-01-17T23:35:36.389 INFO:tasks.workunit.client.0.smithi161.stdout:8/259: truncate d1/f58 414632 0 2024-01-17T23:35:36.410 INFO:tasks.workunit.client.0.smithi161.stdout:8/260: dread f0 [0,4194304] 0 2024-01-17T23:35:36.410 INFO:tasks.workunit.client.0.smithi161.stdout:8/261: readlink d1/d3/d19/d1d/d25/l4f 0 2024-01-17T23:35:36.410 INFO:tasks.workunit.client.0.smithi161.stdout:8/262: stat d1/d22/d2f/f43 0 2024-01-17T23:35:36.535 INFO:tasks.workunit.client.0.smithi161.stdout:4/357: getdents d9/d27/d3a/d56 0 2024-01-17T23:35:36.653 INFO:tasks.workunit.client.0.smithi161.stdout:3/300: creat d0/d5/d9/d38/d4f/f62 x:0 0 0 2024-01-17T23:35:37.122 INFO:tasks.workunit.client.0.smithi161.stdout:0/349: unlink d5/fb 0 2024-01-17T23:35:37.226 INFO:tasks.workunit.client.0.smithi161.stdout:6/297: symlink d6/d7/dc/d3c/d47/d31/l69 0 2024-01-17T23:35:37.538 INFO:tasks.workunit.client.0.smithi161.stdout:4/358: mkdir d9/de/d1e/d58/d60 0 2024-01-17T23:35:37.559 INFO:tasks.workunit.client.0.smithi161.stdout:4/359: write d9/de/f41 [2497672,8039] 0 2024-01-17T23:35:38.155 INFO:tasks.workunit.client.0.smithi161.stdout:0/350: truncate d5/d8/f9 473624 0 2024-01-17T23:35:38.339 INFO:tasks.workunit.client.0.smithi161.stdout:6/298: link d6/d7/dc/d3c/d47/f11 d6/d7/dc/d3c/d47/d1a/f6a 0 2024-01-17T23:35:38.339 INFO:tasks.workunit.client.0.smithi161.stdout:6/299: write d6/d7/dc/d43/f60 [612362,105647] 0 2024-01-17T23:35:38.509 INFO:tasks.workunit.client.0.smithi161.stdout:4/360: symlink d9/d1b/d24/d25/l61 0 2024-01-17T23:35:38.532 INFO:tasks.workunit.client.0.smithi161.stdout:4/361: dwrite d9/d27/d3a/f4a [0,4194304] 0 2024-01-17T23:35:38.560 INFO:tasks.workunit.client.0.smithi161.stdout:4/362: dwrite d9/de/d1e/f35 [0,4194304] 0 2024-01-17T23:35:38.560 INFO:tasks.workunit.client.0.smithi161.stdout:4/363: fsync d9/d1b/d24/f2e 0 2024-01-17T23:35:38.560 INFO:tasks.workunit.client.0.smithi161.stdout:4/364: stat d9/f10 0 2024-01-17T23:35:38.565 INFO:tasks.workunit.client.0.smithi161.stdout:4/365: dread d9/f23 [0,4194304] 0 2024-01-17T23:35:38.639 INFO:tasks.workunit.client.0.smithi161.stdout:5/311: write dd/d15/f23 [1219740,18715] 0 2024-01-17T23:35:38.640 INFO:tasks.workunit.client.0.smithi161.stdout:5/312: fsync dd/d15/d1a/f25 0 2024-01-17T23:35:38.749 INFO:tasks.workunit.client.0.smithi161.stdout:0/351: rename d5/la to d5/d8/d68/l6d 0 2024-01-17T23:35:38.897 INFO:tasks.workunit.client.0.smithi161.stdout:6/300: link d6/d7/dc/d3c/d47/d31/d5d/f38 d6/d7/dc/d3c/d47/d31/d5d/d55/f6b 0 2024-01-17T23:35:39.168 INFO:tasks.workunit.client.0.smithi161.stdout:4/366: symlink d9/d1b/d52/l62 0 2024-01-17T23:35:39.168 INFO:tasks.workunit.client.0.smithi161.stdout:4/367: chown d9/de/f2b 196301760 1 2024-01-17T23:35:39.168 INFO:tasks.workunit.client.0.smithi161.stdout:4/368: truncate d9/de/f30 5010375 0 2024-01-17T23:35:39.169 INFO:tasks.workunit.client.0.smithi161.stdout:4/369: chown d9/de/d1e/d58/d60 136229671 1 2024-01-17T23:35:39.169 INFO:tasks.workunit.client.0.smithi161.stdout:4/370: chown d9/d51 6 1 2024-01-17T23:35:39.180 INFO:tasks.workunit.client.0.smithi161.stdout:7/334: getdents da/d34/d5a 0 2024-01-17T23:35:39.364 INFO:tasks.workunit.client.0.smithi161.stdout:0/352: mknod d5/d34/d20/d2d/c6e 0 2024-01-17T23:35:39.364 INFO:tasks.workunit.client.0.smithi161.stdout:0/353: write d5/d34/d20/d2b/f69 [900769,56033] 0 2024-01-17T23:35:39.365 INFO:tasks.workunit.client.0.smithi161.stdout:0/354: creat d5/d34/d12/f6f x:0 0 0 2024-01-17T23:35:39.365 INFO:tasks.workunit.client.0.smithi161.stdout:0/355: chown d5/d34/d20/d2b 15519845 1 2024-01-17T23:35:39.373 INFO:tasks.workunit.client.0.smithi161.stdout:5/313: dread dd/ff [0,4194304] 0 2024-01-17T23:35:39.373 INFO:tasks.workunit.client.0.smithi161.stdout:5/314: fsync dd/f55 0 2024-01-17T23:35:39.381 INFO:tasks.workunit.client.0.smithi161.stdout:0/356: dread d5/d34/d20/d2b/f33 [0,4194304] 0 2024-01-17T23:35:39.381 INFO:tasks.workunit.client.0.smithi161.stdout:0/357: chown d5/d8/f1f 3 1 2024-01-17T23:35:39.381 INFO:tasks.workunit.client.0.smithi161.stdout:0/358: creat d5/d3a/d49/f70 x:0 0 0 2024-01-17T23:35:39.486 INFO:tasks.workunit.client.0.smithi161.stdout:6/301: link d6/d7/dc/d43/f60 d6/d7/dc/d3c/d47/f6c 0 2024-01-17T23:35:39.498 INFO:tasks.workunit.client.0.smithi161.stdout:6/302: dread d6/d7/fe [0,4194304] 0 2024-01-17T23:35:39.622 INFO:tasks.workunit.client.0.smithi161.stdout:4/371: symlink d9/d1b/d24/l63 0 2024-01-17T23:35:39.741 INFO:tasks.workunit.client.0.smithi161.stdout:7/335: symlink da/d34/d4a/d4c/l76 0 2024-01-17T23:35:40.175 INFO:tasks.workunit.client.0.smithi161.stdout:5/315: mkdir dd/d15/d1a/d5d 0 2024-01-17T23:35:40.175 INFO:tasks.workunit.client.0.smithi161.stdout:5/316: readlink dd/l37 0 2024-01-17T23:35:40.571 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:35:40.575 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:35:40.588 INFO:tasks.workunit.client.0.smithi161.stdout:0/359: mknod d5/d34/d21/c71 0 2024-01-17T23:35:40.588 INFO:tasks.workunit.client.0.smithi161.stdout:0/360: chown d5/d34/d20/d2b/f33 46 1 2024-01-17T23:35:40.662 INFO:tasks.workunit.client.0.smithi161.stdout:6/303: symlink d6/d7/dc/d3c/d47/d13/l6d 0 2024-01-17T23:35:40.662 INFO:tasks.workunit.client.0.smithi161.stdout:6/304: creat d6/d7/dc/d3c/d47/d13/f6e x:0 0 0 2024-01-17T23:35:40.688 INFO:tasks.workunit.client.0.smithi161.stdout:6/305: dwrite d6/d7/dc/f4f [0,4194304] 0 2024-01-17T23:35:40.768 INFO:tasks.workunit.client.0.smithi161.stdout:8/263: unlink d1/df/l1a 0 2024-01-17T23:35:41.199 INFO:tasks.workunit.client.0.smithi161.stdout:5/317: mknod dd/d31/c5e 0 2024-01-17T23:35:41.355 INFO:tasks.workunit.client.0.smithi161.stdout:0/361: creat d5/f72 x:0 0 0 2024-01-17T23:35:41.494 INFO:tasks.workunit.client.0.smithi161.stdout:9/245: sync 2024-01-17T23:35:41.494 INFO:tasks.workunit.client.0.smithi161.stdout:1/346: sync 2024-01-17T23:35:41.507 INFO:tasks.workunit.client.0.smithi161.stdout:9/246: write d0/d8/f10 [4126175,92885] 0 2024-01-17T23:35:41.514 INFO:tasks.workunit.client.0.smithi161.stdout:9/247: fsync d0/f4 0 2024-01-17T23:35:41.520 INFO:tasks.workunit.client.0.smithi161.stdout:1/347: dread d1/ff [0,4194304] 0 2024-01-17T23:35:41.620 INFO:tasks.workunit.client.0.smithi161.stdout:4/372: unlink d9/d1b/d24/d25/l44 0 2024-01-17T23:35:41.620 INFO:tasks.workunit.client.0.smithi161.stdout:4/373: fdatasync d9/de/d1e/d38/f49 0 2024-01-17T23:35:42.087 INFO:tasks.workunit.client.0.smithi161.stdout:6/306: rename d6/d7/dc/d3c/d47/d31/d5d/f4d to d6/d7/dc/d3c/d47/d13/f6f 0 2024-01-17T23:35:42.087 INFO:tasks.workunit.client.0.smithi161.stdout:6/307: chown d6/d7/dc/d1d 1 1 2024-01-17T23:35:42.087 INFO:tasks.workunit.client.0.smithi161.stdout:6/308: fdatasync d6/d7/dc/d1d/f5e 0 2024-01-17T23:35:42.123 INFO:tasks.workunit.client.0.smithi161.stdout:6/309: dwrite d6/f68 [0,4194304] 0 2024-01-17T23:35:42.134 INFO:tasks.workunit.client.0.smithi161.stdout:8/264: getdents d1/d3/d19/d1d 0 2024-01-17T23:35:42.143 INFO:tasks.workunit.client.0.smithi161.stdout:8/265: dread d1/df/f31 [0,4194304] 0 2024-01-17T23:35:42.153 INFO:tasks.workunit.client.0.smithi161.stdout:6/310: dwrite d6/d7/dc/d3c/d47/d31/d5d/f36 [0,4194304] 0 2024-01-17T23:35:42.153 INFO:tasks.workunit.client.0.smithi161.stdout:6/311: chown d6/d7/dc/d3c/d47/d1a/f62 163165 1 2024-01-17T23:35:42.171 INFO:tasks.workunit.client.0.smithi161.stdout:6/312: read d6/f68 [3687229,10587] 0 2024-01-17T23:35:42.171 INFO:tasks.workunit.client.0.smithi161.stdout:6/313: truncate d6/d7/dc/f4b 943998 0 2024-01-17T23:35:42.172 INFO:tasks.workunit.client.0.smithi161.stdout:8/266: dwrite d1/d3/d19/d1d/f27 [0,4194304] 0 2024-01-17T23:35:42.267 INFO:tasks.workunit.client.0.smithi161.stdout:5/318: creat dd/d15/d4e/f5f x:0 0 0 2024-01-17T23:35:42.440 INFO:tasks.workunit.client.0.smithi161.stdout:0/362: link d5/d8/c30 d5/d34/d20/d2d/c73 0 2024-01-17T23:35:42.459 INFO:tasks.workunit.client.0.smithi161.stdout:0/363: dread d5/d34/d20/d2b/f33 [0,4194304] 0 2024-01-17T23:35:42.459 INFO:tasks.workunit.client.0.smithi161.stdout:0/364: readlink d5/d34/d20/l5f 0 2024-01-17T23:35:42.485 INFO:tasks.workunit.client.0.smithi161.stdout:0/365: dread d5/d34/d21/f3d [0,4194304] 0 2024-01-17T23:35:42.600 INFO:tasks.workunit.client.0.smithi161.stdout:9/248: mkdir d0/d8/d31/d58 0 2024-01-17T23:35:43.212 INFO:tasks.workunit.client.0.smithi161.stdout:1/348: rename d1/d20/d26/d32/f4a to d1/d2d/f78 0 2024-01-17T23:35:43.247 INFO:tasks.workunit.client.0.smithi161.stdout:1/349: dwrite d1/d20/f73 [0,4194304] 0 2024-01-17T23:35:43.670 INFO:tasks.workunit.client.0.smithi161.stdout:6/314: symlink d6/d7/dc/l70 0 2024-01-17T23:35:44.131 INFO:tasks.workunit.client.0.smithi161.stdout:8/267: link d1/d3/f9 d1/df/d46/f59 0 2024-01-17T23:35:44.144 INFO:tasks.workunit.client.0.smithi161.stdout:0/366: truncate d5/d34/d12/d2a/f38 2590001 0 2024-01-17T23:35:44.144 INFO:tasks.workunit.client.0.smithi161.stdout:5/319: truncate dd/d15/f1c 4381766 0 2024-01-17T23:35:44.144 INFO:tasks.workunit.client.0.smithi161.stdout:0/367: chown d5/d34/d12/f37 1327901 1 2024-01-17T23:35:44.576 INFO:tasks.workunit.client.0.smithi161.stdout:9/249: rmdir d0/d8/d14 39 2024-01-17T23:35:44.600 INFO:tasks.workunit.client.0.smithi161.stdout:9/250: dwrite d0/f2c [4194304,4194304] 0 2024-01-17T23:35:45.088 INFO:tasks.workunit.client.0.smithi161.stdout:1/350: rename d1/d64/l6e to d1/d20/d26/d30/l79 0 2024-01-17T23:35:45.116 INFO:tasks.workunit.client.0.smithi161.stdout:1/351: dwrite d1/d20/d26/d30/f77 [0,4194304] 0 2024-01-17T23:35:45.249 INFO:tasks.workunit.client.0.smithi161.stdout:2/281: rmdir d8/d4b 39 2024-01-17T23:35:45.389 INFO:tasks.workunit.client.0.smithi161.stdout:8/268: mknod d1/d3/c5a 0 2024-01-17T23:35:45.652 INFO:tasks.workunit.client.0.smithi161.stdout:0/368: symlink d5/d8/d68/d6b/l74 0 2024-01-17T23:35:45.925 INFO:tasks.workunit.client.0.smithi161.stdout:3/301: sync 2024-01-17T23:35:45.925 INFO:tasks.workunit.client.0.smithi161.stdout:3/302: chown d0/d5/d9/d1e/l3f 5039288 1 2024-01-17T23:35:45.936 INFO:tasks.workunit.client.0.smithi161.stdout:3/303: dread d0/f12 [0,4194304] 0 2024-01-17T23:35:46.140 INFO:tasks.workunit.client.0.smithi161.stdout:7/336: write da/d34/d5a/d28/d43/f5b [1408268,129505] 0 2024-01-17T23:35:46.498 INFO:tasks.workunit.client.0.smithi161.stdout:2/282: rename d8/d1c/d1e/f59 to d8/da/d52/f65 0 2024-01-17T23:35:47.118 INFO:tasks.workunit.client.0.smithi161.stdout:3/304: symlink d0/d5/d9/d17/d2d/l63 0 2024-01-17T23:35:47.324 INFO:tasks.workunit.client.0.smithi161.stdout:7/337: unlink da/d34/d5a/d3b/f6a 0 2024-01-17T23:35:47.324 INFO:tasks.workunit.client.0.smithi161.stdout:4/374: rmdir d9/d1b/d24/d25 39 2024-01-17T23:35:47.345 INFO:tasks.workunit.client.0.smithi161.stdout:7/338: dread da/f15 [0,4194304] 0 2024-01-17T23:35:47.345 INFO:tasks.workunit.client.0.smithi161.stdout:7/339: chown da/db/l1c 90046 1 2024-01-17T23:35:47.345 INFO:tasks.workunit.client.0.smithi161.stdout:7/340: chown da/f26 17368 1 2024-01-17T23:35:47.345 INFO:tasks.workunit.client.0.smithi161.stdout:7/341: write da/d34/d5a/d3b/f48 [4384013,32216] 0 2024-01-17T23:35:47.345 INFO:tasks.workunit.client.0.smithi161.stdout:7/342: fsync da/d34/d5a/d28/d43/f59 0 2024-01-17T23:35:47.414 INFO:tasks.workunit.client.0.smithi161.stdout:1/352: read d1/d2d/d3b/f21 [159799,125756] 0 2024-01-17T23:35:47.596 INFO:tasks.workunit.client.0.smithi161.stdout:2/283: chown d8/cf 32254 1 2024-01-17T23:35:47.608 INFO:tasks.workunit.client.0.smithi161.stdout:2/284: write d8/f14 [7135642,128002] 0 2024-01-17T23:35:47.608 INFO:tasks.workunit.client.0.smithi161.stdout:2/285: write d8/da/d52/f33 [603343,35342] 0 2024-01-17T23:35:48.357 INFO:tasks.workunit.client.0.smithi161.stdout:7/343: symlink da/d14/d35/d41/l77 0 2024-01-17T23:35:48.357 INFO:tasks.workunit.client.0.smithi161.stdout:7/344: write f8 [350520,26764] 0 2024-01-17T23:35:48.373 INFO:tasks.workunit.client.0.smithi161.stdout:1/353: rename d1/d20/d26/d30/d44/f52 to d1/d8/d1c/f7a 0 2024-01-17T23:35:48.373 INFO:tasks.workunit.client.0.smithi161.stdout:1/354: getdents d1/d8/d67 0 2024-01-17T23:35:48.386 INFO:tasks.workunit.client.0.smithi161.stdout:1/355: dread d1/d8/d1f/f28 [0,4194304] 0 2024-01-17T23:35:48.386 INFO:tasks.workunit.client.0.smithi161.stdout:1/356: dread - d1/d20/f51 zero size 2024-01-17T23:35:48.387 INFO:tasks.workunit.client.0.smithi161.stdout:1/357: readlink d1/l4c 0 2024-01-17T23:35:49.052 INFO:tasks.workunit.client.0.smithi161.stdout:7/345: creat da/d34/d5a/d28/d43/f78 x:0 0 0 2024-01-17T23:35:49.052 INFO:tasks.workunit.client.0.smithi161.stdout:7/346: chown da/d34/d5a/d3b/f61 1509630 1 2024-01-17T23:35:49.285 INFO:tasks.workunit.client.0.smithi161.stdout:7/347: creat da/d34/d5a/d28/d2b/f79 x:0 0 0 2024-01-17T23:35:49.288 INFO:tasks.workunit.client.0.smithi161.stdout:7/348: write da/d34/d5a/d28/d43/f5b [905718,103878] 0 2024-01-17T23:35:49.288 INFO:tasks.workunit.client.0.smithi161.stdout:7/349: fdatasync da/d34/d5a/d28/f3e 0 2024-01-17T23:35:49.317 INFO:tasks.workunit.client.0.smithi161.stdout:7/350: dwrite da/d34/d5a/d28/d2b/f45 [0,4194304] 0 2024-01-17T23:35:49.355 INFO:tasks.workunit.client.0.smithi161.stdout:7/351: dwrite da/d14/f32 [0,4194304] 0 2024-01-17T23:35:49.355 INFO:tasks.workunit.client.0.smithi161.stdout:7/352: dread - da/d34/d5a/d68/f6b zero size 2024-01-17T23:35:49.401 INFO:tasks.workunit.client.0.smithi161.stdout:4/375: unlink f0 0 2024-01-17T23:35:49.434 INFO:tasks.workunit.client.0.smithi161.stdout:4/376: dwrite d9/f31 [0,4194304] 0 2024-01-17T23:35:49.440 INFO:tasks.workunit.client.0.smithi161.stdout:4/377: dread d9/de/f19 [0,4194304] 0 2024-01-17T23:35:49.455 INFO:tasks.workunit.client.0.smithi161.stdout:4/378: dread d9/f34 [0,4194304] 0 2024-01-17T23:35:49.456 INFO:tasks.workunit.client.0.smithi161.stdout:4/379: write d9/de/d1e/f36 [870959,128210] 0 2024-01-17T23:35:49.476 INFO:tasks.workunit.client.0.smithi161.stdout:4/380: write f7 [3337525,75768] 0 2024-01-17T23:35:49.557 INFO:tasks.workunit.client.0.smithi161.stdout:5/320: unlink f8 0 2024-01-17T23:35:49.919 INFO:tasks.workunit.client.0.smithi161.stdout:7/353: mkdir da/db/d7a 0 2024-01-17T23:35:50.105 INFO:tasks.workunit.client.0.smithi161.stdout:4/381: mkdir d9/d51/d64 0 2024-01-17T23:35:50.664 INFO:tasks.workunit.client.0.smithi161.stdout:9/251: unlink d0/c24 0 2024-01-17T23:35:50.692 INFO:tasks.workunit.client.0.smithi161.stdout:9/252: dwrite d0/d8/d14/d18/f55 [0,4194304] 0 2024-01-17T23:35:50.702 INFO:tasks.workunit.client.0.smithi161.stdout:9/253: dread d0/d8/f10 [0,4194304] 0 2024-01-17T23:35:50.890 INFO:tasks.workunit.client.0.smithi161.stdout:8/269: write d1/df/f14 [165723,59015] 0 2024-01-17T23:35:50.918 INFO:tasks.workunit.client.0.smithi161.stdout:8/270: dwrite d1/d22/f48 [0,4194304] 0 2024-01-17T23:35:50.918 INFO:tasks.workunit.client.0.smithi161.stdout:8/271: dread - d1/d3/d19/d1d/d25/f4d zero size 2024-01-17T23:35:50.919 INFO:tasks.workunit.client.0.smithi161.stdout:8/272: write d1/d3/d19/d1d/f36 [564216,75663] 0 2024-01-17T23:35:51.038 INFO:tasks.workunit.client.0.smithi161.stdout:5/321: rmdir dd/d15/d4e 39 2024-01-17T23:35:51.399 INFO:tasks.workunit.client.0.smithi161.stdout:9/254: creat d0/d39/f59 x:0 0 0 2024-01-17T23:35:51.657 INFO:tasks.workunit.client.0.smithi161.stdout:8/273: creat d1/d3/f5b x:0 0 0 2024-01-17T23:35:52.144 INFO:tasks.workunit.client.0.smithi161.stdout:3/305: creat d0/d5/d9/f64 x:0 0 0 2024-01-17T23:35:52.144 INFO:tasks.workunit.client.0.smithi161.stdout:8/274: truncate d1/d3/d19/d1d/d25/f3b 3297877 0 2024-01-17T23:35:52.144 INFO:tasks.workunit.client.0.smithi161.stdout:8/275: chown d1/d3/c5a 1466 1 2024-01-17T23:35:52.490 INFO:tasks.workunit.client.0.smithi161.stdout:9/255: rmdir d0/d39/d49 39 2024-01-17T23:35:52.490 INFO:tasks.workunit.client.0.smithi161.stdout:9/256: chown d0/d8/d31 258384966 1 2024-01-17T23:35:52.507 INFO:tasks.workunit.client.0.smithi161.stdout:9/257: dread d0/d8/d14/d18/f55 [0,4194304] 0 2024-01-17T23:35:52.592 INFO:tasks.workunit.client.0.smithi161.stdout:3/306: mknod d0/d5/d9/d38/c65 0 2024-01-17T23:35:52.785 INFO:tasks.workunit.client.0.smithi161.stdout:8/276: mknod d1/d55/c5c 0 2024-01-17T23:35:53.294 INFO:tasks.workunit.client.0.smithi161.stdout:3/307: mknod d0/d5/d9/d1e/d3b/c66 0 2024-01-17T23:35:53.294 INFO:tasks.workunit.client.0.smithi161.stdout:3/308: creat d0/d5/d9/d1e/d3b/d52/f67 x:0 0 0 2024-01-17T23:35:53.295 INFO:tasks.workunit.client.0.smithi161.stdout:3/309: truncate d0/d5/d9/d38/d4f/f62 1026471 0 2024-01-17T23:35:53.295 INFO:tasks.workunit.client.0.smithi161.stdout:3/310: chown d0/f2e 21025 1 2024-01-17T23:35:53.310 INFO:tasks.workunit.client.0.smithi161.stdout:3/311: dread d0/f2e [0,4194304] 0 2024-01-17T23:35:53.310 INFO:tasks.workunit.client.0.smithi161.stdout:3/312: write d0/d5/d9/f55 [5405365,101793] 0 2024-01-17T23:35:53.310 INFO:tasks.workunit.client.0.smithi161.stdout:3/313: write d0/d5/d9/f13 [3202811,67267] 0 2024-01-17T23:35:53.310 INFO:tasks.workunit.client.0.smithi161.stdout:3/314: read - d0/d5/d9/d38/d4f/d50/f51 zero size 2024-01-17T23:35:53.604 INFO:tasks.workunit.client.0.smithi161.stdout:1/358: write d1/d8/f56 [4719905,88481] 0 2024-01-17T23:35:53.604 INFO:tasks.workunit.client.0.smithi161.stdout:1/359: stat d1/d11/f22 0 2024-01-17T23:35:53.627 INFO:tasks.workunit.client.0.smithi161.stdout:1/360: dwrite d1/f23 [0,4194304] 0 2024-01-17T23:35:53.627 INFO:tasks.workunit.client.0.smithi161.stdout:1/361: stat d1/d8/d1c/c59 0 2024-01-17T23:35:53.759 INFO:tasks.workunit.client.0.smithi161.stdout:3/315: mknod d0/d5/c68 0 2024-01-17T23:35:54.323 INFO:tasks.workunit.client.0.smithi161.stdout:3/316: link d0/d5/d9/d38/c65 d0/d5/d9/d38/d4f/d56/c69 0 2024-01-17T23:35:54.341 INFO:tasks.workunit.client.0.smithi161.stdout:3/317: write d0/d5/d9/d17/f37 [3493480,120333] 0 2024-01-17T23:35:54.341 INFO:tasks.workunit.client.0.smithi161.stdout:3/318: chown d0/d5/d9/d1e/d3b/f42 1 1 2024-01-17T23:35:54.595 INFO:tasks.workunit.client.0.smithi161.stdout:3/319: creat d0/d5/f6a x:0 0 0 2024-01-17T23:35:54.595 INFO:tasks.workunit.client.0.smithi161.stdout:3/320: dread - d0/d5/d9/d1e/d3b/d52/f67 zero size 2024-01-17T23:35:54.595 INFO:tasks.workunit.client.0.smithi161.stdout:3/321: creat d0/d5/d9/d17/f6b x:0 0 0 2024-01-17T23:35:54.595 INFO:tasks.workunit.client.0.smithi161.stdout:3/322: dread - d0/d5/f6a zero size 2024-01-17T23:35:54.595 INFO:tasks.workunit.client.0.smithi161.stdout:3/323: fsync d0/d5/d9/d17/f1c 0 2024-01-17T23:35:55.233 INFO:tasks.workunit.client.0.smithi161.stdout:6/315: link l1 d6/d7/l71 0 2024-01-17T23:35:55.240 INFO:tasks.workunit.client.0.smithi161.stdout:5/322: write dd/ff [139661,17140] 0 2024-01-17T23:35:55.258 INFO:tasks.workunit.client.0.smithi161.stdout:6/316: read d6/d7/dc/d3c/d47/f11 [138638,102811] 0 2024-01-17T23:35:56.887 INFO:tasks.workunit.client.0.smithi161.stdout:6/317: creat d6/d7/dc/d3c/d47/f72 x:0 0 0 2024-01-17T23:35:56.887 INFO:tasks.workunit.client.0.smithi161.stdout:6/318: chown d6/d7/f8 12895 1 2024-01-17T23:35:56.887 INFO:tasks.workunit.client.0.smithi161.stdout:6/319: fsync d6/d7/dc/d3c/d47/d1a/f62 0 2024-01-17T23:35:57.129 INFO:tasks.workunit.client.0.smithi161.stdout:0/369: sync 2024-01-17T23:35:57.129 INFO:tasks.workunit.client.0.smithi161.stdout:2/286: sync 2024-01-17T23:35:57.129 INFO:tasks.workunit.client.0.smithi161.stdout:4/382: sync 2024-01-17T23:35:57.129 INFO:tasks.workunit.client.0.smithi161.stdout:7/354: sync 2024-01-17T23:35:57.129 INFO:tasks.workunit.client.0.smithi161.stdout:4/383: chown d9/de/l42 12 1 2024-01-17T23:35:57.129 INFO:tasks.workunit.client.0.smithi161.stdout:7/355: write da/d34/d5a/d28/d43/f78 [267459,21566] 0 2024-01-17T23:35:57.190 INFO:tasks.workunit.client.0.smithi161.stdout:9/258: rename d0/ca to d0/d8/d14/c5a 0 2024-01-17T23:35:57.712 INFO:tasks.workunit.client.0.smithi161.stdout:2/287: symlink d8/d2e/l66 0 2024-01-17T23:35:57.713 INFO:tasks.workunit.client.0.smithi161.stdout:0/370: truncate d5/d34/f23 4939237 0 2024-01-17T23:35:57.713 INFO:tasks.workunit.client.0.smithi161.stdout:0/371: fdatasync d5/d34/d20/d2b/f44 0 2024-01-17T23:35:57.845 INFO:tasks.workunit.client.0.smithi161.stdout:4/384: symlink d9/de/d1e/d38/l65 0 2024-01-17T23:35:57.845 INFO:tasks.workunit.client.0.smithi161.stdout:4/385: stat d9/l4f 0 2024-01-17T23:35:57.845 INFO:tasks.workunit.client.0.smithi161.stdout:4/386: chown d9/de/d1e/c50 341 1 2024-01-17T23:35:57.940 INFO:tasks.workunit.client.0.smithi161.stdout:7/356: unlink da/d34/d5a/d28/d2b/c2d 0 2024-01-17T23:35:57.960 INFO:tasks.workunit.client.0.smithi161.stdout:5/323: write dd/d15/f21 [1014608,108515] 0 2024-01-17T23:35:57.960 INFO:tasks.workunit.client.0.smithi161.stdout:5/324: creat dd/d31/d3c/f60 x:0 0 0 2024-01-17T23:35:58.309 INFO:tasks.workunit.client.0.smithi161.stdout:3/324: rename d0/d5/d9/d38/d4f/d56/c69 to d0/d5/d9/d1e/d3b/c6c 0 2024-01-17T23:35:58.309 INFO:tasks.workunit.client.0.smithi161.stdout:3/325: fsync d0/d5/d9/d17/f36 0 2024-01-17T23:35:58.309 INFO:tasks.workunit.client.0.smithi161.stdout:9/259: unlink d0/l19 0 2024-01-17T23:35:58.343 INFO:tasks.workunit.client.0.smithi161.stdout:6/320: creat d6/d7/dc/d3c/f73 x:0 0 0 2024-01-17T23:35:58.343 INFO:tasks.workunit.client.0.smithi161.stdout:6/321: fsync d6/d7/dc/d1d/f5e 0 2024-01-17T23:35:58.385 INFO:tasks.workunit.client.0.smithi161.stdout:6/322: dwrite d6/f3d [0,4194304] 0 2024-01-17T23:35:58.385 INFO:tasks.workunit.client.0.smithi161.stdout:6/323: creat d6/d7/dc/d43/f74 x:0 0 0 2024-01-17T23:35:58.875 INFO:tasks.workunit.client.0.smithi161.stdout:0/372: dread d5/d8/f9 [0,4194304] 0 2024-01-17T23:35:59.379 INFO:tasks.workunit.client.0.smithi161.stdout:5/325: dwrite dd/d15/f22 [4194304,4194304] 0 2024-01-17T23:35:59.487 INFO:tasks.workunit.client.0.smithi161.stdout:8/277: symlink d1/d3/d19/l5d 0 2024-01-17T23:35:59.487 INFO:tasks.workunit.client.0.smithi161.stdout:4/387: rename d9/de/f1d to d9/de/d1e/f66 0 2024-01-17T23:35:59.487 INFO:tasks.workunit.client.0.smithi161.stdout:8/278: write d1/df/d20/f4c [152395,70727] 0 2024-01-17T23:35:59.609 INFO:tasks.workunit.client.0.smithi161.stdout:3/326: symlink d0/d5/d9/d1e/l6d 0 2024-01-17T23:35:59.610 INFO:tasks.workunit.client.0.smithi161.stdout:3/327: truncate d0/d5/d9/d38/f49 1511610 0 2024-01-17T23:35:59.610 INFO:tasks.workunit.client.0.smithi161.stdout:3/328: stat d0/d5/d9/d1e/d3b/l41 0 2024-01-17T23:35:59.610 INFO:tasks.workunit.client.0.smithi161.stdout:3/329: chown d0/d5/d9 6061080 1 2024-01-17T23:35:59.613 INFO:tasks.workunit.client.0.smithi161.stdout:9/260: readlink d0/d8/d14/d18/l1e 0 2024-01-17T23:35:59.613 INFO:tasks.workunit.client.0.smithi161.stdout:9/261: truncate d0/d8/f28 151657 0 2024-01-17T23:35:59.613 INFO:tasks.workunit.client.0.smithi161.stdout:9/262: write d0/f4 [3941301,102798] 0 2024-01-17T23:35:59.613 INFO:tasks.workunit.client.0.smithi161.stdout:9/263: fdatasync d0/d8/d14/f44 0 2024-01-17T23:35:59.672 INFO:tasks.workunit.client.0.smithi161.stdout:1/362: rmdir d1/d2d 39 2024-01-17T23:36:00.268 INFO:tasks.workunit.client.0.smithi161.stdout:2/288: mkdir d8/d67 0 2024-01-17T23:36:00.275 INFO:tasks.workunit.client.0.smithi161.stdout:2/289: dread d8/f54 [0,4194304] 0 2024-01-17T23:36:00.565 INFO:tasks.workunit.client.0.smithi161.stdout:0/373: unlink d5/f72 0 2024-01-17T23:36:00.565 INFO:tasks.workunit.client.0.smithi161.stdout:0/374: write d5/d34/d12/f66 [817840,112296] 0 2024-01-17T23:36:00.565 INFO:tasks.workunit.client.0.smithi161.stdout:0/375: creat d5/d34/d20/d2b/f75 x:0 0 0 2024-01-17T23:36:01.009 INFO:tasks.workunit.client.0.smithi161.stdout:3/330: mknod d0/d5/d9/d17/d2d/c6e 0 2024-01-17T23:36:01.264 INFO:tasks.workunit.client.0.smithi161.stdout:7/357: creat da/d34/d5a/d28/f7b x:0 0 0 2024-01-17T23:36:01.642 INFO:tasks.workunit.client.0.smithi161.stdout:6/324: rmdir d6/d7/dc/d1d 39 2024-01-17T23:36:01.642 INFO:tasks.workunit.client.0.smithi161.stdout:6/325: chown d6/d7/dc/d3c/d47/d31/d5d/f21 396454100 1 2024-01-17T23:36:01.642 INFO:tasks.workunit.client.0.smithi161.stdout:6/326: chown d6/fa 0 1 2024-01-17T23:36:01.659 INFO:tasks.workunit.client.0.smithi161.stdout:6/327: dread d6/d7/dc/d1d/f2e [0,4194304] 0 2024-01-17T23:36:01.660 INFO:tasks.workunit.client.0.smithi161.stdout:6/328: readlink d6/d7/dc/l70 0 2024-01-17T23:36:01.660 INFO:tasks.workunit.client.0.smithi161.stdout:6/329: creat d6/d7/dc/d3c/f75 x:0 0 0 2024-01-17T23:36:01.829 INFO:tasks.workunit.client.0.smithi161.stdout:5/326: creat dd/d15/d4e/d4f/f61 x:0 0 0 2024-01-17T23:36:01.832 INFO:tasks.workunit.client.0.smithi161.stdout:5/327: read dd/f55 [905920,109510] 0 2024-01-17T23:36:02.386 INFO:tasks.workunit.client.0.smithi161.stdout:4/388: link d9/de/l42 d9/d1b/d24/l67 0 2024-01-17T23:36:02.386 INFO:tasks.workunit.client.0.smithi161.stdout:4/389: write d9/fd [4558302,86268] 0 2024-01-17T23:36:02.409 INFO:tasks.workunit.client.0.smithi161.stdout:4/390: read d9/ff [2181605,96493] 0 2024-01-17T23:36:02.409 INFO:tasks.workunit.client.0.smithi161.stdout:4/391: chown d9/de/d1e/d38/l65 40629217 1 2024-01-17T23:36:02.665 INFO:tasks.workunit.client.0.smithi161.stdout:3/331: unlink d0/d5/d9/d1e/d3b/c6c 0 2024-01-17T23:36:02.835 INFO:tasks.workunit.client.0.smithi161.stdout:7/358: creat da/d34/d69/f7c x:0 0 0 2024-01-17T23:36:02.930 INFO:tasks.workunit.client.0.smithi161.stdout:9/264: rmdir d0/d39 39 2024-01-17T23:36:02.930 INFO:tasks.workunit.client.0.smithi161.stdout:9/265: creat d0/d8/d14/d18/d20/f5b x:0 0 0 2024-01-17T23:36:03.166 INFO:tasks.workunit.client.0.smithi161.stdout:8/279: write d1/d3/d19/d1d/d25/f3b [1218734,54333] 0 2024-01-17T23:36:03.171 INFO:tasks.workunit.client.0.smithi161.stdout:6/330: mkdir d6/d7/dc/d43/d76 0 2024-01-17T23:36:03.182 INFO:tasks.workunit.client.0.smithi161.stdout:6/331: read d6/d7/dc/d3c/d47/f49 [1679011,116955] 0 2024-01-17T23:36:03.326 INFO:tasks.workunit.client.0.smithi161.stdout:2/290: mkdir d8/d68 0 2024-01-17T23:36:03.608 INFO:tasks.workunit.client.0.smithi161.stdout:4/392: mkdir d9/d27/d68 0 2024-01-17T23:36:03.909 INFO:tasks.workunit.client.0.smithi161.stdout:1/363: write d1/f38 [2013823,119587] 0 2024-01-17T23:36:03.941 INFO:tasks.workunit.client.0.smithi161.stdout:1/364: dwrite d1/d20/f5c [0,4194304] 0 2024-01-17T23:36:04.017 INFO:tasks.workunit.client.0.smithi161.stdout:7/359: rename da/d34/d5a/d28/f65 to da/d34/f7d 0 2024-01-17T23:36:04.217 INFO:tasks.workunit.client.0.smithi161.stdout:9/266: rmdir d0 39 2024-01-17T23:36:04.388 INFO:tasks.workunit.client.0.smithi161.stdout:8/280: creat d1/d3/d19/d1d/d25/f5e x:0 0 0 2024-01-17T23:36:04.565 INFO:tasks.workunit.client.0.smithi161.stdout:0/376: write d5/d34/d12/d2a/f38 [2220486,126389] 0 2024-01-17T23:36:04.573 INFO:tasks.workunit.client.0.smithi161.stdout:0/377: dread d5/d8/f19 [4194304,4194304] 0 2024-01-17T23:36:04.645 INFO:tasks.workunit.client.0.smithi161.stdout:2/291: creat d8/da/d52/d34/f69 x:0 0 0 2024-01-17T23:36:04.722 INFO:tasks.workunit.client.0.smithi161.stdout:5/328: creat dd/d15/d51/f62 x:0 0 0 2024-01-17T23:36:05.031 INFO:tasks.workunit.client.0.smithi161.stdout:4/393: fsync d9/d1b/d24/f43 0 2024-01-17T23:36:05.032 INFO:tasks.workunit.client.0.smithi161.stdout:4/394: chown d9/de 1781 1 2024-01-17T23:36:05.055 INFO:tasks.workunit.client.0.smithi161.stdout:4/395: dwrite d9/de/f33 [0,4194304] 0 2024-01-17T23:36:05.643 INFO:tasks.workunit.client.0.smithi161.stdout:7/360: symlink da/d34/d4a/d4c/l7e 0 2024-01-17T23:36:05.643 INFO:tasks.workunit.client.0.smithi161.stdout:7/361: write da/d34/d5a/d68/f6b [395674,22139] 0 2024-01-17T23:36:05.967 INFO:tasks.workunit.client.0.smithi161.stdout:8/281: creat d1/f5f x:0 0 0 2024-01-17T23:36:05.968 INFO:tasks.workunit.client.0.smithi161.stdout:0/378: mkdir d5/d34/d21/d76 0 2024-01-17T23:36:05.968 INFO:tasks.workunit.client.0.smithi161.stdout:0/379: chown d5/d3a 221679 1 2024-01-17T23:36:05.987 INFO:tasks.workunit.client.0.smithi161.stdout:0/380: dread d5/f32 [0,4194304] 0 2024-01-17T23:36:06.016 INFO:tasks.workunit.client.0.smithi161.stdout:0/381: dwrite d5/d34/d20/d2b/f44 [0,4194304] 0 2024-01-17T23:36:06.016 INFO:tasks.workunit.client.0.smithi161.stdout:0/382: truncate d5/d34/d12/f37 4598127 0 2024-01-17T23:36:06.060 INFO:tasks.workunit.client.0.smithi161.stdout:5/329: creat dd/d15/d1a/f63 x:0 0 0 2024-01-17T23:36:06.647 INFO:tasks.workunit.client.0.smithi161.stdout:7/362: mkdir da/d34/d5a/d3b/d3d/d7f 0 2024-01-17T23:36:06.647 INFO:tasks.workunit.client.0.smithi161.stdout:8/282: truncate d1/d22/d2f/f3f 3693036 0 2024-01-17T23:36:06.697 INFO:tasks.workunit.client.0.smithi161.stdout:2/292: rename d8/da/f10 to d8/f6a 0 2024-01-17T23:36:06.697 INFO:tasks.workunit.client.0.smithi161.stdout:0/383: link d5/d8/d68/l6d d5/d3a/d49/l77 0 2024-01-17T23:36:06.697 INFO:tasks.workunit.client.0.smithi161.stdout:2/293: readlink d8/d1c/d1e/l5e 0 2024-01-17T23:36:07.059 INFO:tasks.workunit.client.0.smithi161.stdout:5/330: rmdir dd/d15/d4e/d52 39 2024-01-17T23:36:07.059 INFO:tasks.workunit.client.0.smithi161.stdout:5/331: write dd/f55 [653641,113518] 0 2024-01-17T23:36:07.085 INFO:tasks.workunit.client.0.smithi161.stdout:5/332: dwrite dd/d15/d4e/d4f/f61 [0,4194304] 0 2024-01-17T23:36:07.110 INFO:tasks.workunit.client.0.smithi161.stdout:3/332: sync 2024-01-17T23:36:07.164 INFO:tasks.workunit.client.0.smithi161.stdout:7/363: mknod da/d34/d5a/d68/c80 0 2024-01-17T23:36:07.326 INFO:tasks.workunit.client.0.smithi161.stdout:8/283: creat d1/d3/d19/d1d/d25/f60 x:0 0 0 2024-01-17T23:36:07.327 INFO:tasks.workunit.client.0.smithi161.stdout:8/284: readlink d1/d1c/l45 0 2024-01-17T23:36:07.606 INFO:tasks.workunit.client.0.smithi161.stdout:2/294: getdents d8/d4b 0 2024-01-17T23:36:07.606 INFO:tasks.workunit.client.0.smithi161.stdout:2/295: dread - d8/d1c/f31 zero size 2024-01-17T23:36:07.606 INFO:tasks.workunit.client.0.smithi161.stdout:2/296: read d8/da/d52/f33 [13257,119601] 0 2024-01-17T23:36:08.388 INFO:tasks.workunit.client.0.smithi161.stdout:3/333: creat d0/d5/d9/d1e/d3b/f6f x:0 0 0 2024-01-17T23:36:08.400 INFO:tasks.workunit.client.0.smithi161.stdout:5/333: dread dd/d15/f1b [0,4194304] 0 2024-01-17T23:36:08.476 INFO:tasks.workunit.client.0.smithi161.stdout:7/364: creat da/d14/d35/d54/f81 x:0 0 0 2024-01-17T23:36:08.672 INFO:tasks.workunit.client.0.smithi161.stdout:2/297: rename d8/da/d52/d34/d35/d3a/f60 to d8/da/d52/f6b 0 2024-01-17T23:36:08.672 INFO:tasks.workunit.client.0.smithi161.stdout:2/298: fsync d8/d1c/f25 0 2024-01-17T23:36:08.672 INFO:tasks.workunit.client.0.smithi161.stdout:2/299: readlink d8/da/l19 0 2024-01-17T23:36:09.081 INFO:tasks.workunit.client.0.smithi161.stdout:5/334: readlink dd/d15/l18 0 2024-01-17T23:36:09.195 INFO:tasks.workunit.client.0.smithi161.stdout:7/365: mkdir da/d34/d5a/d3b/d3d/d82 0 2024-01-17T23:36:09.286 INFO:tasks.workunit.client.0.smithi161.stdout:1/365: dwrite d1/d2d/d3b/f2a [0,4194304] 0 2024-01-17T23:36:09.286 INFO:tasks.workunit.client.0.smithi161.stdout:1/366: creat d1/d8/d1f/d4b/f7b x:0 0 0 2024-01-17T23:36:09.286 INFO:tasks.workunit.client.0.smithi161.stdout:1/367: stat d1/l4c 0 2024-01-17T23:36:09.376 INFO:tasks.workunit.client.0.smithi161.stdout:6/332: creat d6/d7/dc/f77 x:0 0 0 2024-01-17T23:36:09.581 INFO:tasks.workunit.client.0.smithi161.stdout:2/300: mkdir d8/d67/d6c 0 2024-01-17T23:36:09.581 INFO:tasks.workunit.client.0.smithi161.stdout:2/301: write d8/f6a [1148535,35489] 0 2024-01-17T23:36:10.437 INFO:tasks.workunit.client.0.smithi161.stdout:1/368: mknod d1/d20/d26/d32/c7c 0 2024-01-17T23:36:10.437 INFO:tasks.workunit.client.0.smithi161.stdout:6/333: symlink d6/d7/dc/d3c/d47/d31/d5d/d55/l78 0 2024-01-17T23:36:10.437 INFO:tasks.workunit.client.0.smithi161.stdout:1/369: fdatasync d1/d8/f1b 0 2024-01-17T23:36:10.437 INFO:tasks.workunit.client.0.smithi161.stdout:1/370: chown d1/l2b 1485229448 1 2024-01-17T23:36:10.442 INFO:tasks.workunit.client.0.smithi161.stdout:2/302: rename d8/d1c/d1e/f3d to d8/d68/f6d 0 2024-01-17T23:36:10.444 INFO:tasks.workunit.client.0.smithi161.stdout:7/366: symlink da/d14/l83 0 2024-01-17T23:36:10.444 INFO:tasks.workunit.client.0.smithi161.stdout:5/335: truncate dd/d15/f1c 3970229 0 2024-01-17T23:36:10.444 INFO:tasks.workunit.client.0.smithi161.stdout:7/367: stat da/db/f11 0 2024-01-17T23:36:10.444 INFO:tasks.workunit.client.0.smithi161.stdout:7/368: creat da/d34/d5a/d28/d2b/f84 x:0 0 0 2024-01-17T23:36:10.444 INFO:tasks.workunit.client.0.smithi161.stdout:7/369: chown da/d14/d35/d41/f73 687377657 1 2024-01-17T23:36:10.473 INFO:tasks.workunit.client.0.smithi161.stdout:2/303: dwrite d8/d68/f6d [0,4194304] 0 2024-01-17T23:36:10.481 INFO:tasks.workunit.client.0.smithi161.stdout:2/304: dread d8/f14 [4194304,4194304] 0 2024-01-17T23:36:10.529 INFO:tasks.workunit.client.0.smithi161.stdout:9/267: symlink d0/l5c 0 2024-01-17T23:36:10.541 INFO:tasks.workunit.client.0.smithi161.stdout:8/285: dwrite d1/df/d20/d2a/f34 [0,4194304] 0 2024-01-17T23:36:10.727 INFO:tasks.workunit.client.0.smithi161.stdout:6/334: mkdir d6/d7/dc/d43/d79 0 2024-01-17T23:36:10.819 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:36:10.822 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:36:11.055 INFO:tasks.workunit.client.0.smithi161.stdout:5/336: dread dd/d15/f23 [0,4194304] 0 2024-01-17T23:36:11.055 INFO:tasks.workunit.client.0.smithi161.stdout:5/337: readlink l2 0 2024-01-17T23:36:11.302 INFO:tasks.workunit.client.0.smithi161.stdout:7/370: creat da/d34/d5a/f85 x:0 0 0 2024-01-17T23:36:11.302 INFO:tasks.workunit.client.0.smithi161.stdout:7/371: write da/d34/d5a/d28/d2b/f79 [932617,22997] 0 2024-01-17T23:36:11.305 INFO:tasks.workunit.client.0.smithi161.stdout:7/372: dread da/d34/d5a/d28/d43/f59 [0,4194304] 0 2024-01-17T23:36:11.687 INFO:tasks.workunit.client.0.smithi161.stdout:9/268: mknod d0/d8/c5d 0 2024-01-17T23:36:11.687 INFO:tasks.workunit.client.0.smithi161.stdout:2/305: mknod d8/d2e/c6e 0 2024-01-17T23:36:11.769 INFO:tasks.workunit.client.0.smithi161.stdout:8/286: mkdir d1/d22/d2f/d61 0 2024-01-17T23:36:11.770 INFO:tasks.workunit.client.0.smithi161.stdout:8/287: readlink d1/d3/l30 0 2024-01-17T23:36:12.076 INFO:tasks.workunit.client.0.smithi161.stdout:5/338: mkdir dd/d15/d1a/d5d/d64 0 2024-01-17T23:36:12.357 INFO:tasks.workunit.client.0.smithi161.stdout:2/306: creat d8/d1c/d1e/f6f x:0 0 0 2024-01-17T23:36:12.357 INFO:tasks.workunit.client.0.smithi161.stdout:2/307: dread - d8/da/f58 zero size 2024-01-17T23:36:12.470 INFO:tasks.workunit.client.0.smithi161.stdout:9/269: symlink d0/d8/d14/d56/l5e 0 2024-01-17T23:36:12.608 INFO:tasks.workunit.client.0.smithi161.stdout:5/339: link dd/f50 dd/d15/d1a/d5d/f65 0 2024-01-17T23:36:12.728 INFO:tasks.workunit.client.0.smithi161.stdout:9/270: rename d0/d8/f28 to d0/d8/f5f 0 2024-01-17T23:36:13.219 INFO:tasks.workunit.client.0.smithi161.stdout:9/271: link d0/d8/d14/d18/d20/c21 d0/d8/d31/c60 0 2024-01-17T23:36:13.259 INFO:tasks.workunit.client.0.smithi161.stdout:9/272: dwrite d0/f3a [0,4194304] 0 2024-01-17T23:36:13.840 INFO:tasks.workunit.client.0.smithi161.stdout:5/340: fsync dd/d15/f1c 0 2024-01-17T23:36:13.840 INFO:tasks.workunit.client.0.smithi161.stdout:9/273: truncate d0/f2a 708327 0 2024-01-17T23:36:13.846 INFO:tasks.workunit.client.0.smithi161.stdout:0/384: sync 2024-01-17T23:36:13.846 INFO:tasks.workunit.client.0.smithi161.stdout:4/396: sync 2024-01-17T23:36:13.846 INFO:tasks.workunit.client.0.smithi161.stdout:0/385: stat d5/d34/d20/d2b/d64 0 2024-01-17T23:36:13.846 INFO:tasks.workunit.client.0.smithi161.stdout:3/334: sync 2024-01-17T23:36:13.846 INFO:tasks.workunit.client.0.smithi161.stdout:0/386: chown d5/d34/d20/d2d/l60 268306634 1 2024-01-17T23:36:13.853 INFO:tasks.workunit.client.0.smithi161.stdout:9/274: write d0/d8/d31/f52 [2331434,106186] 0 2024-01-17T23:36:13.861 INFO:tasks.workunit.client.0.smithi161.stdout:9/275: dread d0/d8/f48 [0,4194304] 0 2024-01-17T23:36:14.070 INFO:tasks.workunit.client.0.smithi161.stdout:1/371: write d1/d2d/d3b/f34 [2320644,110306] 0 2024-01-17T23:36:14.070 INFO:tasks.workunit.client.0.smithi161.stdout:1/372: chown d1/d11/l33 26977 1 2024-01-17T23:36:14.070 INFO:tasks.workunit.client.0.smithi161.stdout:1/373: fdatasync d1/d2d/d3b/f2a 0 2024-01-17T23:36:14.212 INFO:tasks.workunit.client.0.smithi161.stdout:5/341: creat dd/d15/d4e/f66 x:0 0 0 2024-01-17T23:36:14.212 INFO:tasks.workunit.client.0.smithi161.stdout:5/342: truncate dd/d15/d1a/d42/f58 834761 0 2024-01-17T23:36:14.212 INFO:tasks.workunit.client.0.smithi161.stdout:5/343: chown dd/d31/f38 42 1 2024-01-17T23:36:14.509 INFO:tasks.workunit.client.0.smithi161.stdout:4/397: mkdir d9/de/d69 0 2024-01-17T23:36:14.509 INFO:tasks.workunit.client.0.smithi161.stdout:4/398: write d9/d1b/d52/f59 [606195,85673] 0 2024-01-17T23:36:14.668 INFO:tasks.workunit.client.0.smithi161.stdout:0/387: rmdir d5/d34/d12/d2a/d35 39 2024-01-17T23:36:14.668 INFO:tasks.workunit.client.0.smithi161.stdout:0/388: write d5/d34/d12/f6f [972458,23554] 0 2024-01-17T23:36:14.696 INFO:tasks.workunit.client.0.smithi161.stdout:0/389: dwrite d5/d34/d20/d2b/f44 [0,4194304] 0 2024-01-17T23:36:14.819 INFO:tasks.workunit.client.0.smithi161.stdout:9/276: unlink d0/d39/d49/l4b 0 2024-01-17T23:36:14.937 INFO:tasks.workunit.client.0.smithi161.stdout:1/374: creat d1/d2d/f7d x:0 0 0 2024-01-17T23:36:15.039 INFO:tasks.workunit.client.0.smithi161.stdout:5/344: mkdir dd/d15/d1a/d5d/d64/d67 0 2024-01-17T23:36:15.737 INFO:tasks.workunit.client.0.smithi161.stdout:7/373: dwrite da/d34/d4a/f5c [0,4194304] 0 2024-01-17T23:36:15.737 INFO:tasks.workunit.client.0.smithi161.stdout:7/374: truncate da/d34/d5a/d68/f6b 1145475 0 2024-01-17T23:36:15.737 INFO:tasks.workunit.client.0.smithi161.stdout:7/375: dread - da/d34/d4a/d4c/f70 zero size 2024-01-17T23:36:15.737 INFO:tasks.workunit.client.0.smithi161.stdout:7/376: chown da/l21 5 1 2024-01-17T23:36:15.737 INFO:tasks.workunit.client.0.smithi161.stdout:7/377: dread - da/d14/d35/d41/f73 zero size 2024-01-17T23:36:15.782 INFO:tasks.workunit.client.0.smithi161.stdout:0/390: truncate d5/d8/f19 787035 0 2024-01-17T23:36:15.782 INFO:tasks.workunit.client.0.smithi161.stdout:0/391: creat d5/d34/d20/d2b/d64/f78 x:0 0 0 2024-01-17T23:36:15.782 INFO:tasks.workunit.client.0.smithi161.stdout:0/392: write d5/d34/d20/d2b/f75 [211303,68319] 0 2024-01-17T23:36:15.782 INFO:tasks.workunit.client.0.smithi161.stdout:0/393: write d5/d8/f29 [793141,70315] 0 2024-01-17T23:36:15.782 INFO:tasks.workunit.client.0.smithi161.stdout:0/394: fsync d5/d3a/d49/f70 0 2024-01-17T23:36:15.782 INFO:tasks.workunit.client.0.smithi161.stdout:6/335: rename d6/f27 to d6/d7/dc/d3c/d47/d31/d5d/d55/f7a 0 2024-01-17T23:36:15.790 INFO:tasks.workunit.client.0.smithi161.stdout:6/336: dread d6/f68 [0,4194304] 0 2024-01-17T23:36:15.807 INFO:tasks.workunit.client.0.smithi161.stdout:6/337: dread d6/d7/dc/d3c/d47/d31/d5d/f21 [0,4194304] 0 2024-01-17T23:36:15.958 INFO:tasks.workunit.client.0.smithi161.stdout:1/375: creat d1/d2d/d3b/f7e x:0 0 0 2024-01-17T23:36:15.963 INFO:tasks.workunit.client.0.smithi161.stdout:1/376: dread d1/d8/f13 [0,4194304] 0 2024-01-17T23:36:16.221 INFO:tasks.workunit.client.0.smithi161.stdout:7/378: link da/lf da/d34/d4a/l86 0 2024-01-17T23:36:16.221 INFO:tasks.workunit.client.0.smithi161.stdout:7/379: write da/d34/d5a/d68/f6b [1557593,91308] 0 2024-01-17T23:36:16.221 INFO:tasks.workunit.client.0.smithi161.stdout:7/380: write da/d34/d5a/d28/d43/f2e [4482216,79314] 0 2024-01-17T23:36:16.222 INFO:tasks.workunit.client.0.smithi161.stdout:0/395: creat d5/d34/d21/d76/f79 x:0 0 0 2024-01-17T23:36:16.223 INFO:tasks.workunit.client.0.smithi161.stdout:0/396: read - d5/d3a/d49/f5b zero size 2024-01-17T23:36:16.223 INFO:tasks.workunit.client.0.smithi161.stdout:0/397: fsync f2 0 2024-01-17T23:36:16.223 INFO:tasks.workunit.client.0.smithi161.stdout:0/398: truncate d5/d34/d20/d2b/d64/f78 176629 0 2024-01-17T23:36:16.229 INFO:tasks.workunit.client.0.smithi161.stdout:7/381: dread da/db/f11 [0,4194304] 0 2024-01-17T23:36:16.229 INFO:tasks.workunit.client.0.smithi161.stdout:7/382: creat da/d34/d5a/d3b/f87 x:0 0 0 2024-01-17T23:36:16.340 INFO:tasks.workunit.client.0.smithi161.stdout:2/308: rename d8/da/d52/d34/d35/c4e to d8/da/d52/c70 0 2024-01-17T23:36:16.358 INFO:tasks.workunit.client.0.smithi161.stdout:2/309: dread d8/d68/f6d [0,4194304] 0 2024-01-17T23:36:16.391 INFO:tasks.workunit.client.0.smithi161.stdout:2/310: dwrite d8/d1c/d1e/f44 [0,4194304] 0 2024-01-17T23:36:16.391 INFO:tasks.workunit.client.0.smithi161.stdout:2/311: write d8/f14 [3993595,77219] 0 2024-01-17T23:36:16.391 INFO:tasks.workunit.client.0.smithi161.stdout:2/312: write d8/da/f58 [29088,125918] 0 2024-01-17T23:36:16.512 INFO:tasks.workunit.client.0.smithi161.stdout:8/288: write d1/d3/f18 [548316,2775] 0 2024-01-17T23:36:16.512 INFO:tasks.workunit.client.0.smithi161.stdout:6/338: mknod d6/d7/dc/d3c/d47/d1a/d59/c7b 0 2024-01-17T23:36:16.512 INFO:tasks.workunit.client.0.smithi161.stdout:8/289: chown d1/d3/f38 11064 1 2024-01-17T23:36:16.540 INFO:tasks.workunit.client.0.smithi161.stdout:6/339: dwrite d6/d7/dc/d43/f74 [0,4194304] 0 2024-01-17T23:36:16.550 INFO:tasks.workunit.client.0.smithi161.stdout:6/340: dread d6/f3d [0,4194304] 0 2024-01-17T23:36:16.863 INFO:tasks.workunit.client.0.smithi161.stdout:1/377: link d1/d8/l1d d1/d8/d67/l7f 0 2024-01-17T23:36:16.898 INFO:tasks.workunit.client.0.smithi161.stdout:5/345: write dd/d15/f30 [251551,111980] 0 2024-01-17T23:36:17.294 INFO:tasks.workunit.client.0.smithi161.stdout:0/399: rmdir d5/d34/d21/d67 0 2024-01-17T23:36:17.436 INFO:tasks.workunit.client.0.smithi161.stdout:7/383: read da/d34/d5a/d28/d43/f78 [146,20017] 0 2024-01-17T23:36:17.537 INFO:tasks.workunit.client.0.smithi161.stdout:4/399: rename d9/d1b/c22 to d9/d27/d68/c6a 0 2024-01-17T23:36:17.770 INFO:tasks.workunit.client.0.smithi161.stdout:2/313: creat d8/da/d52/d34/d35/d3a/f71 x:0 0 0 2024-01-17T23:36:17.843 INFO:tasks.workunit.client.0.smithi161.stdout:8/290: creat d1/d3/d19/d1d/d25/f62 x:0 0 0 2024-01-17T23:36:17.843 INFO:tasks.workunit.client.0.smithi161.stdout:8/291: stat d1/d3/d19/f21 0 2024-01-17T23:36:18.273 INFO:tasks.workunit.client.0.smithi161.stdout:1/378: stat d1/d2d/d3b/f2a 0 2024-01-17T23:36:18.744 INFO:tasks.workunit.client.0.smithi161.stdout:7/384: unlink da/d34/d5a/d28/d43/f2e 0 2024-01-17T23:36:18.744 INFO:tasks.workunit.client.0.smithi161.stdout:3/335: mknod d0/c70 0 2024-01-17T23:36:18.744 INFO:tasks.workunit.client.0.smithi161.stdout:7/385: getdents da/d34/d5a/d3b/d3d/d7f 0 2024-01-17T23:36:18.762 INFO:tasks.workunit.client.0.smithi161.stdout:3/336: write d0/d5/d9/d1e/d3b/f42 [2574396,42825] 0 2024-01-17T23:36:18.762 INFO:tasks.workunit.client.0.smithi161.stdout:3/337: readlink d0/d5/l34 0 2024-01-17T23:36:18.762 INFO:tasks.workunit.client.0.smithi161.stdout:3/338: stat d0/d5/d9/d1e/d3b/d52 0 2024-01-17T23:36:18.889 INFO:tasks.workunit.client.0.smithi161.stdout:6/341: rename d6/d7/dc/d3c/f67 to d6/f7c 0 2024-01-17T23:36:18.917 INFO:tasks.workunit.client.0.smithi161.stdout:6/342: dwrite d6/d7/dc/d3c/d47/d31/d5d/f21 [0,4194304] 0 2024-01-17T23:36:18.940 INFO:tasks.workunit.client.0.smithi161.stdout:4/400: mkdir d9/de/d1e/d38/d6b 0 2024-01-17T23:36:18.942 INFO:tasks.workunit.client.0.smithi161.stdout:4/401: dread d9/d1b/d24/d25/f2f [0,4194304] 0 2024-01-17T23:36:18.959 INFO:tasks.workunit.client.0.smithi161.stdout:4/402: dread f4 [0,4194304] 0 2024-01-17T23:36:19.042 INFO:tasks.workunit.client.0.smithi161.stdout:2/314: mkdir d8/d67/d6c/d72 0 2024-01-17T23:36:19.303 INFO:tasks.workunit.client.0.smithi161.stdout:8/292: creat d1/d3/d19/d1d/d25/d4b/f63 x:0 0 0 2024-01-17T23:36:19.676 INFO:tasks.workunit.client.0.smithi161.stdout:1/379: link d1/d20/d26/c27 d1/d31/d4e/c80 0 2024-01-17T23:36:19.813 INFO:tasks.workunit.client.0.smithi161.stdout:7/386: mknod da/d14/d35/d41/c88 0 2024-01-17T23:36:19.813 INFO:tasks.workunit.client.0.smithi161.stdout:7/387: fdatasync da/db/f2a 0 2024-01-17T23:36:19.813 INFO:tasks.workunit.client.0.smithi161.stdout:7/388: write da/d34/d5a/f85 [637688,87266] 0 2024-01-17T23:36:19.814 INFO:tasks.workunit.client.0.smithi161.stdout:7/389: dread - da/d34/d5a/d28/f42 zero size 2024-01-17T23:36:20.075 INFO:tasks.workunit.client.0.smithi161.stdout:3/339: rmdir d0/d5/d9/d38/d4f/d50 39 2024-01-17T23:36:20.115 INFO:tasks.workunit.client.0.smithi161.stdout:3/340: dwrite d0/f6 [0,4194304] 0 2024-01-17T23:36:20.148 INFO:tasks.workunit.client.0.smithi161.stdout:3/341: dwrite d0/f12 [0,4194304] 0 2024-01-17T23:36:20.163 INFO:tasks.workunit.client.0.smithi161.stdout:3/342: dread d0/f2e [0,4194304] 0 2024-01-17T23:36:20.657 INFO:tasks.workunit.client.0.smithi161.stdout:4/403: creat d9/d27/f6c x:0 0 0 2024-01-17T23:36:20.657 INFO:tasks.workunit.client.0.smithi161.stdout:2/315: creat d8/d1c/d57/f73 x:0 0 0 2024-01-17T23:36:20.657 INFO:tasks.workunit.client.0.smithi161.stdout:2/316: read - d8/da/d52/d34/f69 zero size 2024-01-17T23:36:20.676 INFO:tasks.workunit.client.0.smithi161.stdout:9/277: write d0/d8/d14/f29 [802543,7696] 0 2024-01-17T23:36:20.676 INFO:tasks.workunit.client.0.smithi161.stdout:9/278: dread - d0/d8/d14/f41 zero size 2024-01-17T23:36:20.721 INFO:tasks.workunit.client.0.smithi161.stdout:8/293: getdents d1/df/d46 0 2024-01-17T23:36:20.748 INFO:tasks.workunit.client.0.smithi161.stdout:8/294: write d1/d22/d2f/f3f [3208728,93322] 0 2024-01-17T23:36:20.748 INFO:tasks.workunit.client.0.smithi161.stdout:8/295: truncate d1/d3/d19/d1d/d25/f60 246115 0 2024-01-17T23:36:20.755 INFO:tasks.workunit.client.0.smithi161.stdout:8/296: dread d1/d1c/f35 [0,4194304] 0 2024-01-17T23:36:21.412 INFO:tasks.workunit.client.0.smithi161.stdout:7/390: mkdir da/d34/d5a/d3b/d89 0 2024-01-17T23:36:21.895 INFO:tasks.workunit.client.0.smithi161.stdout:4/404: mkdir d9/d27/d68/d6d 0 2024-01-17T23:36:22.046 INFO:tasks.workunit.client.0.smithi161.stdout:9/279: symlink d0/d8/d31/d58/l61 0 2024-01-17T23:36:22.257 INFO:tasks.workunit.client.0.smithi161.stdout:0/400: dread d5/d34/f23 [4194304,4194304] 0 2024-01-17T23:36:22.454 INFO:tasks.workunit.client.0.smithi161.stdout:7/391: symlink da/d34/d4a/d4c/l8a 0 2024-01-17T23:36:22.587 INFO:tasks.workunit.client.0.smithi161.stdout:2/317: mknod d8/c74 0 2024-01-17T23:36:22.730 INFO:tasks.workunit.client.0.smithi161.stdout:4/405: rename d9/d1b/d52/l62 to d9/d1b/d24/d25/d5b/l6e 0 2024-01-17T23:36:22.745 INFO:tasks.workunit.client.0.smithi161.stdout:4/406: dread d9/f34 [0,4194304] 0 2024-01-17T23:36:22.922 INFO:tasks.workunit.client.0.smithi161.stdout:9/280: symlink d0/d8/d14/l62 0 2024-01-17T23:36:22.922 INFO:tasks.workunit.client.0.smithi161.stdout:9/281: dread - d0/d39/d49/f57 zero size 2024-01-17T23:36:22.922 INFO:tasks.workunit.client.0.smithi161.stdout:9/282: write d0/d39/f59 [443860,64945] 0 2024-01-17T23:36:23.021 INFO:tasks.workunit.client.0.smithi161.stdout:0/401: link d5/d3a/f54 d5/d34/d12/d2a/f7a 0 2024-01-17T23:36:23.021 INFO:tasks.workunit.client.0.smithi161.stdout:0/402: chown d5/d34/d20/d2b/f33 1680 1 2024-01-17T23:36:23.364 INFO:tasks.workunit.client.0.smithi161.stdout:7/392: truncate da/f15 3775955 0 2024-01-17T23:36:23.364 INFO:tasks.workunit.client.0.smithi161.stdout:7/393: fdatasync da/d34/d5a/d28/d2b/f79 0 2024-01-17T23:36:23.364 INFO:tasks.workunit.client.0.smithi161.stdout:7/394: chown da/d34/d5a/d28/d2b/l6f 866822058 1 2024-01-17T23:36:23.529 INFO:tasks.workunit.client.0.smithi161.stdout:4/407: read d9/d1b/d52/f59 [414182,74311] 0 2024-01-17T23:36:23.783 INFO:tasks.workunit.client.0.smithi161.stdout:1/380: rmdir d1/d64 39 2024-01-17T23:36:23.783 INFO:tasks.workunit.client.0.smithi161.stdout:6/343: fsync d6/f7c 0 2024-01-17T23:36:23.783 INFO:tasks.workunit.client.0.smithi161.stdout:6/344: chown d6/d7/dc/d3c/d47 748489086 1 2024-01-17T23:36:24.193 INFO:tasks.workunit.client.0.smithi161.stdout:5/346: unlink dd/d15/f21 0 2024-01-17T23:36:24.194 INFO:tasks.workunit.client.0.smithi161.stdout:0/403: symlink d5/d3a/d49/l7b 0 2024-01-17T23:36:24.764 INFO:tasks.workunit.client.0.smithi161.stdout:4/408: rename d9/de/d1e/l2a to d9/d1b/d53/l6f 0 2024-01-17T23:36:24.866 INFO:tasks.workunit.client.0.smithi161.stdout:1/381: mkdir d1/d11/d72/d81 0 2024-01-17T23:36:24.882 INFO:tasks.workunit.client.0.smithi161.stdout:1/382: write d1/d8/fc [3431873,36315] 0 2024-01-17T23:36:24.919 INFO:tasks.workunit.client.0.smithi161.stdout:6/345: stat d6/d7/l66 0 2024-01-17T23:36:25.085 INFO:tasks.workunit.client.0.smithi161.stdout:9/283: mkdir d0/d8/d14/d18/d63 0 2024-01-17T23:36:25.201 INFO:tasks.workunit.client.0.smithi161.stdout:0/404: getdents d5/d34 0 2024-01-17T23:36:25.270 INFO:tasks.workunit.client.0.smithi161.stdout:5/347: creat dd/d31/d56/f68 x:0 0 0 2024-01-17T23:36:25.326 INFO:tasks.workunit.client.0.smithi161.stdout:7/395: symlink da/d14/l8b 0 2024-01-17T23:36:25.327 INFO:tasks.workunit.client.0.smithi161.stdout:7/396: write da/db/f11 [2346335,92406] 0 2024-01-17T23:36:25.410 INFO:tasks.workunit.client.0.smithi161.stdout:4/409: creat d9/d51/d64/f70 x:0 0 0 2024-01-17T23:36:25.439 INFO:tasks.workunit.client.0.smithi161.stdout:4/410: dwrite d9/d27/f6c [0,4194304] 0 2024-01-17T23:36:25.598 INFO:tasks.workunit.client.0.smithi161.stdout:1/383: creat d1/d11/d72/d81/f82 x:0 0 0 2024-01-17T23:36:25.832 INFO:tasks.workunit.client.0.smithi161.stdout:6/346: mknod d6/d7/dc/d3c/d47/d13/c7d 0 2024-01-17T23:36:25.832 INFO:tasks.workunit.client.0.smithi161.stdout:7/397: unlink da/d14/d35/d54/f81 0 2024-01-17T23:36:25.832 INFO:tasks.workunit.client.0.smithi161.stdout:4/411: symlink d9/de/d1e/d58/l71 0 2024-01-17T23:36:25.832 INFO:tasks.workunit.client.0.smithi161.stdout:6/347: fsync d6/f3d 0 2024-01-17T23:36:25.833 INFO:tasks.workunit.client.0.smithi161.stdout:7/398: write da/d34/d5a/d3b/f87 [262434,50296] 0 2024-01-17T23:36:25.833 INFO:tasks.workunit.client.0.smithi161.stdout:7/399: dread - da/d34/d5a/d3b/f61 zero size 2024-01-17T23:36:25.882 INFO:tasks.workunit.client.0.smithi161.stdout:1/384: read d1/d20/d26/f68 [2341279,29333] 0 2024-01-17T23:36:26.125 INFO:tasks.workunit.client.0.smithi161.stdout:6/348: mknod d6/d7/dc/d3c/d47/d31/c7e 0 2024-01-17T23:36:26.125 INFO:tasks.workunit.client.0.smithi161.stdout:6/349: fdatasync d6/d7/dc/d3c/d47/d1a/f3e 0 2024-01-17T23:36:26.166 INFO:tasks.workunit.client.0.smithi161.stdout:6/350: dwrite d6/d7/dc/d43/f64 [0,4194304] 0 2024-01-17T23:36:26.188 INFO:tasks.workunit.client.0.smithi161.stdout:6/351: read d6/d7/dc/d3c/d47/d13/f1c [2704939,125165] 0 2024-01-17T23:36:26.188 INFO:tasks.workunit.client.0.smithi161.stdout:6/352: dread - d6/d7/dc/d1d/f5e zero size 2024-01-17T23:36:26.522 INFO:tasks.workunit.client.0.smithi161.stdout:7/400: mkdir da/d34/d5a/d68/d8c 0 2024-01-17T23:36:26.524 INFO:tasks.workunit.client.0.smithi161.stdout:3/343: write d0/d5/fa [3013467,4070] 0 2024-01-17T23:36:26.534 INFO:tasks.workunit.client.0.smithi161.stdout:7/401: dread da/d34/d5a/d3b/f4b [0,4194304] 0 2024-01-17T23:36:26.599 INFO:tasks.workunit.client.0.smithi161.stdout:8/297: write d1/df/d13/f1b [2317532,11500] 0 2024-01-17T23:36:26.599 INFO:tasks.workunit.client.0.smithi161.stdout:8/298: creat d1/df/d13/f64 x:0 0 0 2024-01-17T23:36:27.090 INFO:tasks.workunit.client.0.smithi161.stdout:7/402: chown da/d14/c25 55646 1 2024-01-17T23:36:27.483 INFO:tasks.workunit.client.0.smithi161.stdout:8/299: symlink d1/d3/d19/d1d/l65 0 2024-01-17T23:36:27.600 INFO:tasks.workunit.client.0.smithi161.stdout:1/385: rmdir d1/d2d/d3b/d5b 0 2024-01-17T23:36:27.600 INFO:tasks.workunit.client.0.smithi161.stdout:1/386: fsync d1/d20/d26/d30/f58 0 2024-01-17T23:36:28.108 INFO:tasks.workunit.client.0.smithi161.stdout:7/403: link da/d34/d5a/d28/d2b/f79 da/d34/d5a/d68/d8c/f8d 0 2024-01-17T23:36:28.109 INFO:tasks.workunit.client.0.smithi161.stdout:8/300: mknod d1/d55/c66 0 2024-01-17T23:36:28.109 INFO:tasks.workunit.client.0.smithi161.stdout:8/301: truncate d1/d3/d19/d1d/d25/f4d 77710 0 2024-01-17T23:36:28.109 INFO:tasks.workunit.client.0.smithi161.stdout:8/302: truncate d1/df/d20/f3e 298685 0 2024-01-17T23:36:28.117 INFO:tasks.workunit.client.0.smithi161.stdout:7/404: dread da/d34/f7d [0,4194304] 0 2024-01-17T23:36:28.117 INFO:tasks.workunit.client.0.smithi161.stdout:7/405: chown da/d34/d4a/d4c/f70 0 1 2024-01-17T23:36:28.117 INFO:tasks.workunit.client.0.smithi161.stdout:7/406: write da/f26 [400419,71296] 0 2024-01-17T23:36:28.117 INFO:tasks.workunit.client.0.smithi161.stdout:7/407: dread - da/f5f zero size 2024-01-17T23:36:28.235 INFO:tasks.workunit.client.0.smithi161.stdout:1/387: truncate d1/d20/d26/f68 255967 0 2024-01-17T23:36:28.258 INFO:tasks.workunit.client.0.smithi161.stdout:1/388: write d1/d8/d1c/f69 [3146538,111539] 0 2024-01-17T23:36:28.258 INFO:tasks.workunit.client.0.smithi161.stdout:1/389: chown d1/d2d/d3b/f7e 59882 1 2024-01-17T23:36:28.292 INFO:tasks.workunit.client.0.smithi161.stdout:1/390: dwrite d1/f23 [0,4194304] 0 2024-01-17T23:36:28.440 INFO:tasks.workunit.client.0.smithi161.stdout:5/348: mknod dd/d15/d4e/c69 0 2024-01-17T23:36:28.448 INFO:tasks.workunit.client.0.smithi161.stdout:5/349: dread dd/d15/f1b [0,4194304] 0 2024-01-17T23:36:28.548 INFO:tasks.workunit.client.0.smithi161.stdout:8/303: creat d1/d3/d19/d1d/d25/f67 x:0 0 0 2024-01-17T23:36:28.646 INFO:tasks.workunit.client.0.smithi161.stdout:7/408: mknod da/d34/d5a/d28/d43/c8e 0 2024-01-17T23:36:29.293 INFO:tasks.workunit.client.0.smithi161.stdout:8/304: link d1/d3/l30 d1/d3/d19/d1d/d25/l68 0 2024-01-17T23:36:29.326 INFO:tasks.workunit.client.0.smithi161.stdout:8/305: dwrite d1/f4e [0,4194304] 0 2024-01-17T23:36:29.582 INFO:tasks.workunit.client.0.smithi161.stdout:7/409: mkdir da/db/d7a/d8f 0 2024-01-17T23:36:29.582 INFO:tasks.workunit.client.0.smithi161.stdout:7/410: dread - da/d34/d69/f7c zero size 2024-01-17T23:36:29.691 INFO:tasks.workunit.client.0.smithi161.stdout:1/391: link d1/d2d/d3b/f21 d1/d31/d4e/f83 0 2024-01-17T23:36:29.903 INFO:tasks.workunit.client.0.smithi161.stdout:8/306: creat d1/df/f69 x:0 0 0 2024-01-17T23:36:30.053 INFO:tasks.workunit.client.0.smithi161.stdout:7/411: symlink da/d14/d35/l90 0 2024-01-17T23:36:30.053 INFO:tasks.workunit.client.0.smithi161.stdout:7/412: fdatasync da/f62 0 2024-01-17T23:36:30.053 INFO:tasks.workunit.client.0.smithi161.stdout:7/413: getdents da/d34/d5a/d3b/d3d/d7f 0 2024-01-17T23:36:30.148 INFO:tasks.workunit.client.0.smithi161.stdout:1/392: rmdir d1 39 2024-01-17T23:36:30.314 INFO:tasks.workunit.client.0.smithi161.stdout:8/307: mkdir d1/df/d20/d6a 0 2024-01-17T23:36:30.314 INFO:tasks.workunit.client.0.smithi161.stdout:8/308: fdatasync d1/df/d13/f52 0 2024-01-17T23:36:30.314 INFO:tasks.workunit.client.0.smithi161.stdout:8/309: creat d1/d3/d19/d1d/d25/d4b/f6b x:0 0 0 2024-01-17T23:36:30.599 INFO:tasks.workunit.client.0.smithi161.stdout:8/310: creat d1/df/d20/d6a/f6c x:0 0 0 2024-01-17T23:36:30.600 INFO:tasks.workunit.client.0.smithi161.stdout:8/311: dread - d1/d3/d19/d1d/d25/d4b/f6b zero size 2024-01-17T23:36:30.628 INFO:tasks.workunit.client.0.smithi161.stdout:8/312: dwrite d1/df/d20/d2a/f3c [0,4194304] 0 2024-01-17T23:36:30.628 INFO:tasks.workunit.client.0.smithi161.stdout:8/313: write d1/d3/f18 [688156,109429] 0 2024-01-17T23:36:30.628 INFO:tasks.workunit.client.0.smithi161.stdout:8/314: write d1/df/d13/f1b [2995191,39995] 0 2024-01-17T23:36:30.629 INFO:tasks.workunit.client.0.smithi161.stdout:8/315: creat d1/df/d20/d6a/f6d x:0 0 0 2024-01-17T23:36:30.629 INFO:tasks.workunit.client.0.smithi161.stdout:8/316: creat d1/df/d20/f6e x:0 0 0 2024-01-17T23:36:30.629 INFO:tasks.workunit.client.0.smithi161.stdout:8/317: write d1/d3/d19/d1d/d25/f3b [1202520,99908] 0 2024-01-17T23:36:30.629 INFO:tasks.workunit.client.0.smithi161.stdout:8/318: chown d1/df/d20/d2a/f3c 3 1 2024-01-17T23:36:30.629 INFO:tasks.workunit.client.0.smithi161.stdout:8/319: truncate d1/d3/d19/d1d/d25/d4b/f63 438062 0 2024-01-17T23:36:30.747 INFO:tasks.workunit.client.0.smithi161.stdout:3/344: mknod d0/c71 0 2024-01-17T23:36:30.747 INFO:tasks.workunit.client.0.smithi161.stdout:3/345: chown d0/d5/c15 1458 1 2024-01-17T23:36:30.775 INFO:tasks.workunit.client.0.smithi161.stdout:0/405: dwrite d5/d8/f9 [0,4194304] 0 2024-01-17T23:36:30.775 INFO:tasks.workunit.client.0.smithi161.stdout:0/406: stat d5/d8/d68/d6b 0 2024-01-17T23:36:31.149 INFO:tasks.workunit.client.0.smithi161.stdout:9/284: creat d0/f64 x:0 0 0 2024-01-17T23:36:31.149 INFO:tasks.workunit.client.0.smithi161.stdout:4/412: rename d9/fb to d9/de/d1e/d58/f72 0 2024-01-17T23:36:31.156 INFO:tasks.workunit.client.0.smithi161.stdout:4/413: dread d9/de/d1e/f36 [0,4194304] 0 2024-01-17T23:36:31.156 INFO:tasks.workunit.client.0.smithi161.stdout:4/414: write d9/f23 [1747385,93287] 0 2024-01-17T23:36:31.184 INFO:tasks.workunit.client.0.smithi161.stdout:4/415: dwrite d9/de/d1e/f36 [0,4194304] 0 2024-01-17T23:36:31.237 INFO:tasks.workunit.client.0.smithi161.stdout:2/318: mkdir d8/d1c/d75 0 2024-01-17T23:36:31.844 INFO:tasks.workunit.client.0.smithi161.stdout:8/320: symlink d1/df/l6f 0 2024-01-17T23:36:34.617 INFO:tasks.workunit.client.0.smithi161.stdout:8/321: mknod d1/d3/c70 0 2024-01-17T23:36:34.617 INFO:tasks.workunit.client.0.smithi161.stdout:8/322: write d1/d3/d19/d1d/d25/f39 [642551,125496] 0 2024-01-17T23:36:34.617 INFO:tasks.workunit.client.0.smithi161.stdout:8/323: fdatasync d1/df/d13/f1b 0 2024-01-17T23:36:34.708 INFO:tasks.workunit.client.0.smithi161.stdout:3/346: mkdir d0/d72 0 2024-01-17T23:36:34.709 INFO:tasks.workunit.client.0.smithi161.stdout:3/347: fsync d0/d5/d9/d38/d4f/d50/f51 0 2024-01-17T23:36:34.891 INFO:tasks.workunit.client.0.smithi161.stdout:6/353: rmdir d6/d7/dc/d3c/d47/d13 39 2024-01-17T23:36:34.891 INFO:tasks.workunit.client.0.smithi161.stdout:6/354: write d6/f51 [499413,81851] 0 2024-01-17T23:36:34.891 INFO:tasks.workunit.client.0.smithi161.stdout:6/355: read d6/d7/dc/d3c/d47/d13/f1c [980245,35918] 0 2024-01-17T23:36:34.897 INFO:tasks.workunit.client.0.smithi161.stdout:6/356: dread d6/d7/dc/d3c/d47/f6c [0,4194304] 0 2024-01-17T23:36:34.898 INFO:tasks.workunit.client.0.smithi161.stdout:6/357: stat d6/fa 0 2024-01-17T23:36:34.898 INFO:tasks.workunit.client.0.smithi161.stdout:6/358: chown d6/d7/dc/d3c/d47/d13/c5c 423602039 1 2024-01-17T23:36:34.898 INFO:tasks.workunit.client.0.smithi161.stdout:6/359: chown d6/d7/dc/d43/c48 5102234 1 2024-01-17T23:36:34.898 INFO:tasks.workunit.client.0.smithi161.stdout:6/360: write d6/d7/dc/d3c/d47/d31/d5d/f18 [970775,2396] 0 2024-01-17T23:36:34.898 INFO:tasks.workunit.client.0.smithi161.stdout:6/361: stat d6/d7/dc/d3c/d47/d1a/l4c 0 2024-01-17T23:36:35.083 INFO:tasks.workunit.client.0.smithi161.stdout:2/319: rmdir d8/d1c/d1e 39 2024-01-17T23:36:35.083 INFO:tasks.workunit.client.0.smithi161.stdout:2/320: chown d8/d1c/d5b 214606502 1 2024-01-17T23:36:35.365 INFO:tasks.workunit.client.0.smithi161.stdout:8/324: rmdir d1/df/d46 39 2024-01-17T23:36:35.365 INFO:tasks.workunit.client.0.smithi161.stdout:3/348: mknod d0/d5/d9/d38/d4f/d50/c73 0 2024-01-17T23:36:35.366 INFO:tasks.workunit.client.0.smithi161.stdout:9/285: creat d0/d8/d14/f65 x:0 0 0 2024-01-17T23:36:35.525 INFO:tasks.workunit.client.0.smithi161.stdout:6/362: creat d6/d7/dc/d43/d79/f7f x:0 0 0 2024-01-17T23:36:35.526 INFO:tasks.workunit.client.0.smithi161.stdout:6/363: write d6/d7/dc/d3c/f75 [715937,32521] 0 2024-01-17T23:36:35.554 INFO:tasks.workunit.client.0.smithi161.stdout:6/364: dwrite d6/d7/dc/f5b [0,4194304] 0 2024-01-17T23:36:35.717 INFO:tasks.workunit.client.0.smithi161.stdout:2/321: creat d8/da/f76 x:0 0 0 2024-01-17T23:36:35.772 INFO:tasks.workunit.client.0.smithi161.stdout:8/325: dread d1/d3d/f42 [0,4194304] 0 2024-01-17T23:36:35.801 INFO:tasks.workunit.client.0.smithi161.stdout:8/326: dwrite d1/df/d13/f64 [0,4194304] 0 2024-01-17T23:36:35.854 INFO:tasks.workunit.client.0.smithi161.stdout:3/349: creat d0/d5/d9/d38/f74 x:0 0 0 2024-01-17T23:36:36.342 INFO:tasks.workunit.client.0.smithi161.stdout:2/322: truncate d8/da/d52/f33 609601 0 2024-01-17T23:36:36.342 INFO:tasks.workunit.client.0.smithi161.stdout:2/323: write d8/da/d52/d34/f69 [289044,73287] 0 2024-01-17T23:36:36.342 INFO:tasks.workunit.client.0.smithi161.stdout:2/324: readlink d8/d1c/d1e/l22 0 2024-01-17T23:36:36.859 INFO:tasks.workunit.client.0.smithi161.stdout:3/350: rename d0/l2c to d0/d5/d9/d1e/l75 0 2024-01-17T23:36:37.216 INFO:tasks.workunit.client.0.smithi161.stdout:2/325: rename d8/d2e/l66 to d8/d1c/l77 0 2024-01-17T23:36:37.216 INFO:tasks.workunit.client.0.smithi161.stdout:2/326: chown d8/d1c/c3f 27862 1 2024-01-17T23:36:37.312 INFO:tasks.workunit.client.0.smithi161.stdout:3/351: mknod d0/d5/d9/d1e/d3b/c76 0 2024-01-17T23:36:37.312 INFO:tasks.workunit.client.0.smithi161.stdout:3/352: chown d0/d5/d9/d1e/f5f 93217240 1 2024-01-17T23:36:37.416 INFO:tasks.workunit.client.0.smithi161.stdout:2/327: mknod d8/d2e/c78 0 2024-01-17T23:36:37.417 INFO:tasks.workunit.client.0.smithi161.stdout:2/328: write d8/f6a [2664488,39877] 0 2024-01-17T23:36:37.600 INFO:tasks.workunit.client.0.smithi161.stdout:5/350: mkdir dd/d15/d6a 0 2024-01-17T23:36:37.600 INFO:tasks.workunit.client.0.smithi161.stdout:3/353: truncate d0/d5/d9/d17/f1c 4205616 0 2024-01-17T23:36:37.600 INFO:tasks.workunit.client.0.smithi161.stdout:5/351: fsync dd/d15/d1a/f43 0 2024-01-17T23:36:37.605 INFO:tasks.workunit.client.0.smithi161.stdout:5/352: dread dd/d15/f30 [0,4194304] 0 2024-01-17T23:36:37.659 INFO:tasks.workunit.client.0.smithi161.stdout:2/329: truncate d8/f18 1773444 0 2024-01-17T23:36:38.003 INFO:tasks.workunit.client.0.smithi161.stdout:3/354: creat d0/f77 x:0 0 0 2024-01-17T23:36:38.087 INFO:tasks.workunit.client.0.smithi161.stdout:5/353: creat dd/d15/d1a/f6b x:0 0 0 2024-01-17T23:36:38.087 INFO:tasks.workunit.client.0.smithi161.stdout:5/354: dread - dd/d31/d3c/f60 zero size 2024-01-17T23:36:38.102 INFO:tasks.workunit.client.0.smithi161.stdout:5/355: dread dd/d15/f22 [0,4194304] 0 2024-01-17T23:36:38.102 INFO:tasks.workunit.client.0.smithi161.stdout:5/356: chown dd/d15/f22 773464 1 2024-01-17T23:36:38.102 INFO:tasks.workunit.client.0.smithi161.stdout:5/357: chown dd/d31/f32 324015 1 2024-01-17T23:36:38.327 INFO:tasks.workunit.client.0.smithi161.stdout:2/330: mkdir d8/d1c/d5b/d79 0 2024-01-17T23:36:38.327 INFO:tasks.workunit.client.0.smithi161.stdout:2/331: chown d8/d1c/d5b/l64 39484316 1 2024-01-17T23:36:38.327 INFO:tasks.workunit.client.0.smithi161.stdout:2/332: write d8/da/d52/d34/f69 [308051,89852] 0 2024-01-17T23:36:38.328 INFO:tasks.workunit.client.0.smithi161.stdout:2/333: stat d8/d2e/c6e 0 2024-01-17T23:36:38.328 INFO:tasks.workunit.client.0.smithi161.stdout:2/334: chown d8/da/d52/d34/d35/d3a/f71 29 1 2024-01-17T23:36:38.328 INFO:tasks.workunit.client.0.smithi161.stdout:2/335: truncate d8/d1c/f25 1599391 0 2024-01-17T23:36:38.541 INFO:tasks.workunit.client.0.smithi161.stdout:5/358: mknod dd/d31/d56/c6c 0 2024-01-17T23:36:38.567 INFO:tasks.workunit.client.0.smithi161.stdout:5/359: dwrite dd/d15/d51/f62 [0,4194304] 0 2024-01-17T23:36:39.062 INFO:tasks.workunit.client.0.smithi161.stdout:0/407: symlink d5/d34/d20/l7c 0 2024-01-17T23:36:39.062 INFO:tasks.workunit.client.0.smithi161.stdout:0/408: write d5/f59 [348192,90144] 0 2024-01-17T23:36:39.221 INFO:tasks.workunit.client.0.smithi161.stdout:2/336: symlink d8/d2e/l7a 0 2024-01-17T23:36:39.805 INFO:tasks.workunit.client.0.smithi161.stdout:7/414: creat da/d34/d5a/f91 x:0 0 0 2024-01-17T23:36:40.069 INFO:tasks.workunit.client.0.smithi161.stdout:0/409: rename d5/d34/d20/d2b/f44 to d5/d8/d68/f7d 0 2024-01-17T23:36:40.087 INFO:tasks.workunit.client.0.smithi161.stdout:2/337: mknod d8/da/d52/d34/d35/d3a/c7b 0 2024-01-17T23:36:40.647 INFO:tasks.workunit.client.0.smithi161.stdout:8/327: write d1/d3d/f42 [1718654,67844] 0 2024-01-17T23:36:40.852 INFO:tasks.workunit.client.0.smithi161.stdout:1/393: mknod d1/c84 0 2024-01-17T23:36:40.852 INFO:tasks.workunit.client.0.smithi161.stdout:1/394: write d1/d20/f2e [6305616,9746] 0 2024-01-17T23:36:40.852 INFO:tasks.workunit.client.0.smithi161.stdout:1/395: write d1/d20/d26/d30/f3f [564540,125000] 0 2024-01-17T23:36:40.872 INFO:tasks.workunit.client.0.smithi161.stdout:1/396: dread d1/d8/d1c/f48 [0,4194304] 0 2024-01-17T23:36:40.873 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:36:40.878 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:36:40.900 INFO:tasks.workunit.client.0.smithi161.stdout:1/397: dwrite d1/d8/d1f/f28 [4194304,4194304] 0 2024-01-17T23:36:40.984 INFO:tasks.workunit.client.0.smithi161.stdout:9/286: write d0/d8/f5f [598560,67220] 0 2024-01-17T23:36:40.985 INFO:tasks.workunit.client.0.smithi161.stdout:9/287: readlink d0/l32 0 2024-01-17T23:36:40.985 INFO:tasks.workunit.client.0.smithi161.stdout:9/288: read d0/d8/d14/f44 [241794,5798] 0 2024-01-17T23:36:40.999 INFO:tasks.workunit.client.0.smithi161.stdout:9/289: write d0/d8/d14/f1b [6929504,4465] 0 2024-01-17T23:36:41.037 INFO:tasks.workunit.client.0.smithi161.stdout:9/290: dwrite d0/d8/d14/f1b [0,4194304] 0 2024-01-17T23:36:41.393 INFO:tasks.workunit.client.0.smithi161.stdout:2/338: link d8/f54 d8/d67/d6c/d72/f7c 0 2024-01-17T23:36:41.394 INFO:tasks.workunit.client.0.smithi161.stdout:8/328: truncate f0 3537330 0 2024-01-17T23:36:41.394 INFO:tasks.workunit.client.0.smithi161.stdout:1/398: mkdir d1/d85 0 2024-01-17T23:36:41.430 INFO:tasks.workunit.client.0.smithi161.stdout:1/399: dwrite d1/d20/d26/d30/f58 [0,4194304] 0 2024-01-17T23:36:41.430 INFO:tasks.workunit.client.0.smithi161.stdout:1/400: getdents d1/d8/d1c/d3e 0 2024-01-17T23:36:41.431 INFO:tasks.workunit.client.0.smithi161.stdout:1/401: fdatasync d1/d8/d1f/d4b/f71 0 2024-01-17T23:36:41.432 INFO:tasks.workunit.client.0.smithi161.stdout:1/402: read d1/fe [11409,112959] 0 2024-01-17T23:36:41.432 INFO:tasks.workunit.client.0.smithi161.stdout:1/403: chown d1/f23 622683 1 2024-01-17T23:36:41.644 INFO:tasks.workunit.client.0.smithi161.stdout:9/291: getdents d0/d8/d31/d58 0 2024-01-17T23:36:41.668 INFO:tasks.workunit.client.0.smithi161.stdout:9/292: dwrite d0/d8/f10 [0,4194304] 0 2024-01-17T23:36:41.668 INFO:tasks.workunit.client.0.smithi161.stdout:9/293: chown d0/d8/d14/f25 983 1 2024-01-17T23:36:41.678 INFO:tasks.workunit.client.0.smithi161.stdout:5/360: truncate dd/d15/d1a/f43 1134706 0 2024-01-17T23:36:41.678 INFO:tasks.workunit.client.0.smithi161.stdout:5/361: write dd/d15/d1a/f43 [1146862,79696] 0 2024-01-17T23:36:41.678 INFO:tasks.workunit.client.0.smithi161.stdout:5/362: dread - dd/f50 zero size 2024-01-17T23:36:41.697 INFO:tasks.workunit.client.0.smithi161.stdout:9/294: dwrite d0/f4 [0,4194304] 0 2024-01-17T23:36:41.827 INFO:tasks.workunit.client.0.smithi161.stdout:2/339: mknod d8/d1c/c7d 0 2024-01-17T23:36:42.686 INFO:tasks.workunit.client.0.smithi161.stdout:6/365: link d6/d7/dc/d1d/c24 d6/d7/dc/c80 0 2024-01-17T23:36:42.686 INFO:tasks.workunit.client.0.smithi161.stdout:6/366: truncate d6/d7/dc/d3c/f73 87007 0 2024-01-17T23:36:42.687 INFO:tasks.workunit.client.0.smithi161.stdout:1/404: link d1/d8/d1f/f28 d1/d31/d4e/f86 0 2024-01-17T23:36:42.722 INFO:tasks.workunit.client.0.smithi161.stdout:2/340: dwrite d8/d1c/f25 [0,4194304] 0 2024-01-17T23:36:42.725 INFO:tasks.workunit.client.0.smithi161.stdout:3/355: dwrite d0/d5/d9/d17/f18 [0,4194304] 0 2024-01-17T23:36:42.744 INFO:tasks.workunit.client.0.smithi161.stdout:6/367: dwrite d6/d7/dc/d43/f64 [0,4194304] 0 2024-01-17T23:36:42.744 INFO:tasks.workunit.client.0.smithi161.stdout:6/368: readlink d6/d7/l66 0 2024-01-17T23:36:42.749 INFO:tasks.workunit.client.0.smithi161.stdout:2/341: write d8/d1c/f25 [3214565,41502] 0 2024-01-17T23:36:42.765 INFO:tasks.workunit.client.0.smithi161.stdout:6/369: dread d6/d7/dc/d3c/d47/d31/d5d/f21 [0,4194304] 0 2024-01-17T23:36:42.783 INFO:tasks.workunit.client.0.smithi161.stdout:2/342: dwrite d8/d2e/f63 [0,4194304] 0 2024-01-17T23:36:42.827 INFO:tasks.workunit.client.0.smithi161.stdout:2/343: dwrite d8/f4f [0,4194304] 0 2024-01-17T23:36:43.001 INFO:tasks.workunit.client.0.smithi161.stdout:5/363: mknod dd/d15/c6d 0 2024-01-17T23:36:43.030 INFO:tasks.workunit.client.0.smithi161.stdout:5/364: dwrite dd/d15/d1a/f63 [0,4194304] 0 2024-01-17T23:36:44.642 INFO:tasks.workunit.client.0.smithi161.stdout:6/370: mkdir d6/d7/dc/d3c/d81 0 2024-01-17T23:36:44.932 INFO:tasks.workunit.client.0.smithi161.stdout:2/344: link d8/da/d52/d34/f69 d8/d68/f7e 0 2024-01-17T23:36:44.962 INFO:tasks.workunit.client.0.smithi161.stdout:2/345: dwrite d8/d1c/f31 [0,4194304] 0 2024-01-17T23:36:44.962 INFO:tasks.workunit.client.0.smithi161.stdout:2/346: truncate d8/f6a 5279980 0 2024-01-17T23:36:44.962 INFO:tasks.workunit.client.0.smithi161.stdout:2/347: dread - d8/da/d52/d34/d35/d3a/f71 zero size 2024-01-17T23:36:44.983 INFO:tasks.workunit.client.0.smithi161.stdout:2/348: dread d8/d1c/d1e/f38 [0,4194304] 0 2024-01-17T23:36:44.983 INFO:tasks.workunit.client.0.smithi161.stdout:2/349: fdatasync d8/da/f58 0 2024-01-17T23:36:44.983 INFO:tasks.workunit.client.0.smithi161.stdout:2/350: readlink d8/d1c/l29 0 2024-01-17T23:36:45.163 INFO:tasks.workunit.client.0.smithi161.stdout:4/416: sync 2024-01-17T23:36:45.163 INFO:tasks.workunit.client.0.smithi161.stdout:4/417: write f7 [4573549,69331] 0 2024-01-17T23:36:45.184 INFO:tasks.workunit.client.0.smithi161.stdout:4/418: dread d9/d1b/d24/f43 [0,4194304] 0 2024-01-17T23:36:45.485 INFO:tasks.workunit.client.0.smithi161.stdout:0/410: dwrite d5/d8/f19 [0,4194304] 0 2024-01-17T23:36:45.485 INFO:tasks.workunit.client.0.smithi161.stdout:0/411: creat d5/d3a/d49/f7e x:0 0 0 2024-01-17T23:36:45.765 INFO:tasks.workunit.client.0.smithi161.stdout:3/356: rename d0/d5/d9/d38/d4f/d50/f51 to d0/d5/d9/d1e/d3b/f78 0 2024-01-17T23:36:45.813 INFO:tasks.workunit.client.0.smithi161.stdout:6/371: creat d6/d58/f82 x:0 0 0 2024-01-17T23:36:46.520 INFO:tasks.workunit.client.0.smithi161.stdout:0/412: symlink d5/l7f 0 2024-01-17T23:36:46.520 INFO:tasks.workunit.client.0.smithi161.stdout:0/413: write d5/d34/d21/f3d [2877987,116198] 0 2024-01-17T23:36:46.541 INFO:tasks.workunit.client.0.smithi161.stdout:0/414: dread d5/d34/d12/f1d [0,4194304] 0 2024-01-17T23:36:46.541 INFO:tasks.workunit.client.0.smithi161.stdout:0/415: fsync d5/d8/f3c 0 2024-01-17T23:36:46.566 INFO:tasks.workunit.client.0.smithi161.stdout:0/416: dwrite d5/f25 [0,4194304] 0 2024-01-17T23:36:46.763 INFO:tasks.workunit.client.0.smithi161.stdout:7/415: sync 2024-01-17T23:36:47.291 INFO:tasks.workunit.client.0.smithi161.stdout:9/295: dwrite d0/d8/d14/f29 [0,4194304] 0 2024-01-17T23:36:47.318 INFO:tasks.workunit.client.0.smithi161.stdout:9/296: dwrite d0/d8/d14/d18/f1d [0,4194304] 0 2024-01-17T23:36:47.429 INFO:tasks.workunit.client.0.smithi161.stdout:6/372: rename d6/f68 to d6/d7/dc/d3c/d47/d1a/d59/f83 0 2024-01-17T23:36:47.430 INFO:tasks.workunit.client.0.smithi161.stdout:6/373: chown d6/d7/dc/d3c/d47/d1a/d59/c7b 11814 1 2024-01-17T23:36:47.430 INFO:tasks.workunit.client.0.smithi161.stdout:6/374: chown d6/d7/dc/d3c/c52 29 1 2024-01-17T23:36:47.430 INFO:tasks.workunit.client.0.smithi161.stdout:6/375: fdatasync d6/d7/dc/d3c/d47/d1a/f3e 0 2024-01-17T23:36:47.448 INFO:tasks.workunit.client.0.smithi161.stdout:6/376: write d6/d7/dc/d1d/f2e [3074676,104026] 0 2024-01-17T23:36:47.448 INFO:tasks.workunit.client.0.smithi161.stdout:6/377: write d6/d7/dc/d3c/d47/d31/d5d/f38 [54304,119226] 0 2024-01-17T23:36:47.560 INFO:tasks.workunit.client.0.smithi161.stdout:0/417: creat d5/d3a/f80 x:0 0 0 2024-01-17T23:36:47.739 INFO:tasks.workunit.client.0.smithi161.stdout:8/329: creat d1/d3/d19/d1d/f71 x:0 0 0 2024-01-17T23:36:47.746 INFO:tasks.workunit.client.0.smithi161.stdout:8/330: dread d1/d3/f18 [0,4194304] 0 2024-01-17T23:36:47.746 INFO:tasks.workunit.client.0.smithi161.stdout:8/331: fsync d1/d1c/f35 0 2024-01-17T23:36:48.643 INFO:tasks.workunit.client.0.smithi161.stdout:0/418: rename d5/d34/d20/d2b/f33 to d5/d34/d20/f81 0 2024-01-17T23:36:48.658 INFO:tasks.workunit.client.0.smithi161.stdout:0/419: dread d5/d8/f19 [0,4194304] 0 2024-01-17T23:36:48.659 INFO:tasks.workunit.client.0.smithi161.stdout:0/420: stat d5/d8/f1f 0 2024-01-17T23:36:48.668 INFO:tasks.workunit.client.0.smithi161.stdout:0/421: dread d5/d8/f3c [0,4194304] 0 2024-01-17T23:36:48.867 INFO:tasks.workunit.client.0.smithi161.stdout:8/332: read d1/d3d/f40 [130685,77163] 0 2024-01-17T23:36:49.347 INFO:tasks.workunit.client.0.smithi161.stdout:0/422: creat d5/d34/d12/d2a/d35/f82 x:0 0 0 2024-01-17T23:36:49.347 INFO:tasks.workunit.client.0.smithi161.stdout:0/423: creat d5/d34/d20/d2b/d64/f83 x:0 0 0 2024-01-17T23:36:49.347 INFO:tasks.workunit.client.0.smithi161.stdout:0/424: truncate d5/d34/d20/d2b/f75 461721 0 2024-01-17T23:36:49.347 INFO:tasks.workunit.client.0.smithi161.stdout:0/425: creat d5/d34/d21/f84 x:0 0 0 2024-01-17T23:36:49.378 INFO:tasks.workunit.client.0.smithi161.stdout:0/426: dwrite d5/d34/d20/f81 [0,4194304] 0 2024-01-17T23:36:49.417 INFO:tasks.workunit.client.0.smithi161.stdout:0/427: dwrite d5/d3a/d49/f7e [0,4194304] 0 2024-01-17T23:36:49.418 INFO:tasks.workunit.client.0.smithi161.stdout:0/428: stat d5/d34/d12/d2a/c6a 0 2024-01-17T23:36:49.429 INFO:tasks.workunit.client.0.smithi161.stdout:0/429: read d5/d34/f45 [1475624,75096] 0 2024-01-17T23:36:49.433 INFO:tasks.workunit.client.0.smithi161.stdout:0/430: write d5/d34/f45 [4134479,123327] 0 2024-01-17T23:36:49.453 INFO:tasks.workunit.client.0.smithi161.stdout:8/333: getdents d1/d22 0 2024-01-17T23:36:49.455 INFO:tasks.workunit.client.0.smithi161.stdout:8/334: dread d1/f58 [0,4194304] 0 2024-01-17T23:36:50.147 INFO:tasks.workunit.client.0.smithi161.stdout:2/351: write d8/da/d52/f51 [841528,51258] 0 2024-01-17T23:36:50.147 INFO:tasks.workunit.client.0.smithi161.stdout:2/352: stat d8/f54 0 2024-01-17T23:36:50.159 INFO:tasks.workunit.client.0.smithi161.stdout:5/365: write dd/f48 [15990,80758] 0 2024-01-17T23:36:50.159 INFO:tasks.workunit.client.0.smithi161.stdout:5/366: creat dd/d15/d51/f6e x:0 0 0 2024-01-17T23:36:50.174 INFO:tasks.workunit.client.0.smithi161.stdout:4/419: dwrite d9/de/f41 [4194304,4194304] 0 2024-01-17T23:36:50.174 INFO:tasks.workunit.client.0.smithi161.stdout:4/420: fdatasync d9/ff 0 2024-01-17T23:36:50.175 INFO:tasks.workunit.client.0.smithi161.stdout:4/421: fsync d9/d1b/d24/f43 0 2024-01-17T23:36:50.184 INFO:tasks.workunit.client.0.smithi161.stdout:5/367: dwrite dd/d31/d3c/f5b [0,4194304] 0 2024-01-17T23:36:50.428 INFO:tasks.workunit.client.0.smithi161.stdout:2/353: link d8/d1c/f49 d8/d1c/d57/f7f 0 2024-01-17T23:36:50.705 INFO:tasks.workunit.client.0.smithi161.stdout:4/422: symlink d9/d1b/d53/l73 0 2024-01-17T23:36:50.886 INFO:tasks.workunit.client.0.smithi161.stdout:5/368: symlink dd/d15/d1a/d5d/d64/l6f 0 2024-01-17T23:36:50.905 INFO:tasks.workunit.client.0.smithi161.stdout:5/369: dread dd/d31/d3c/f5b [0,4194304] 0 2024-01-17T23:36:50.907 INFO:tasks.workunit.client.0.smithi161.stdout:5/370: read dd/d15/f30 [81408,26412] 0 2024-01-17T23:36:50.908 INFO:tasks.workunit.client.0.smithi161.stdout:5/371: readlink dd/l37 0 2024-01-17T23:36:50.943 INFO:tasks.workunit.client.0.smithi161.stdout:1/405: sync 2024-01-17T23:36:50.943 INFO:tasks.workunit.client.0.smithi161.stdout:1/406: readlink d1/d2d/l3d 0 2024-01-17T23:36:50.964 INFO:tasks.workunit.client.0.smithi161.stdout:1/407: dread d1/d8/f1b [0,4194304] 0 2024-01-17T23:36:50.968 INFO:tasks.workunit.client.0.smithi161.stdout:1/408: dread d1/d8/f13 [0,4194304] 0 2024-01-17T23:36:50.968 INFO:tasks.workunit.client.0.smithi161.stdout:1/409: write d1/fe [176923,80007] 0 2024-01-17T23:36:50.968 INFO:tasks.workunit.client.0.smithi161.stdout:1/410: chown d1/d8/d1f/l47 26015688 1 2024-01-17T23:36:50.994 INFO:tasks.workunit.client.0.smithi161.stdout:1/411: dwrite d1/f2 [0,4194304] 0 2024-01-17T23:36:50.994 INFO:tasks.workunit.client.0.smithi161.stdout:1/412: fsync d1/d20/d26/d30/f77 0 2024-01-17T23:36:50.994 INFO:tasks.workunit.client.0.smithi161.stdout:1/413: fsync d1/ff 0 2024-01-17T23:36:50.994 INFO:tasks.workunit.client.0.smithi161.stdout:1/414: write d1/d20/d26/d30/f3f [908267,43107] 0 2024-01-17T23:36:50.994 INFO:tasks.workunit.client.0.smithi161.stdout:1/415: chown d1/fe 170629 1 2024-01-17T23:36:51.024 INFO:tasks.workunit.client.0.smithi161.stdout:1/416: dwrite d1/d20/f51 [0,4194304] 0 2024-01-17T23:36:51.053 INFO:tasks.workunit.client.0.smithi161.stdout:1/417: dwrite d1/d20/f51 [0,4194304] 0 2024-01-17T23:36:51.130 INFO:tasks.workunit.client.0.smithi161.stdout:8/335: getdents d1/d3/d19/d1d 0 2024-01-17T23:36:51.130 INFO:tasks.workunit.client.0.smithi161.stdout:8/336: read d1/df/f14 [1599390,8485] 0 2024-01-17T23:36:51.731 INFO:tasks.workunit.client.0.smithi161.stdout:4/423: link d9/de/d1e/l29 d9/de/d1e/d58/l74 0 2024-01-17T23:36:51.853 INFO:tasks.workunit.client.0.smithi161.stdout:5/372: rename dd/d31/f32 to dd/d15/d1a/d5d/f70 0 2024-01-17T23:36:52.744 INFO:tasks.workunit.client.0.smithi161.stdout:0/431: fsync d5/d34/d12/d2a/d35/f82 0 2024-01-17T23:36:52.770 INFO:tasks.workunit.client.0.smithi161.stdout:0/432: dwrite d5/d34/d12/d2a/d35/f82 [0,4194304] 0 2024-01-17T23:36:52.770 INFO:tasks.workunit.client.0.smithi161.stdout:0/433: fsync d5/d34/d12/f4f 0 2024-01-17T23:36:52.770 INFO:tasks.workunit.client.0.smithi161.stdout:0/434: dread - d5/d34/d21/f84 zero size 2024-01-17T23:36:52.967 INFO:tasks.workunit.client.0.smithi161.stdout:4/424: creat d9/d1b/d24/f75 x:0 0 0 2024-01-17T23:36:53.104 INFO:tasks.workunit.client.0.smithi161.stdout:5/373: creat dd/d15/d6a/f71 x:0 0 0 2024-01-17T23:36:53.104 INFO:tasks.workunit.client.0.smithi161.stdout:5/374: write dd/d15/d1a/d42/f46 [373127,41652] 0 2024-01-17T23:36:53.104 INFO:tasks.workunit.client.0.smithi161.stdout:5/375: write dd/d15/f30 [1024479,72334] 0 2024-01-17T23:36:53.105 INFO:tasks.workunit.client.0.smithi161.stdout:5/376: stat dd/d31/d56/f68 0 2024-01-17T23:36:53.105 INFO:tasks.workunit.client.0.smithi161.stdout:5/377: read - dd/f50 zero size 2024-01-17T23:36:53.105 INFO:tasks.workunit.client.0.smithi161.stdout:5/378: read - dd/d15/d1a/f59 zero size 2024-01-17T23:36:53.133 INFO:tasks.workunit.client.0.smithi161.stdout:5/379: dwrite dd/d15/d1a/f57 [0,4194304] 0 2024-01-17T23:36:53.160 INFO:tasks.workunit.client.0.smithi161.stdout:5/380: dwrite dd/d15/f23 [0,4194304] 0 2024-01-17T23:36:53.160 INFO:tasks.workunit.client.0.smithi161.stdout:5/381: chown dd/d15/d1a/f59 228442728 1 2024-01-17T23:36:53.536 INFO:tasks.workunit.client.0.smithi161.stdout:4/425: creat d9/de/d1e/d38/d6b/f76 x:0 0 0 2024-01-17T23:36:53.536 INFO:tasks.workunit.client.0.smithi161.stdout:4/426: readlink d9/l4d 0 2024-01-17T23:36:53.867 INFO:tasks.workunit.client.0.smithi161.stdout:5/382: truncate dd/d15/d1a/f63 3824009 0 2024-01-17T23:36:53.878 INFO:tasks.workunit.client.0.smithi161.stdout:5/383: dread dd/d15/f22 [0,4194304] 0 2024-01-17T23:36:53.878 INFO:tasks.workunit.client.0.smithi161.stdout:5/384: chown dd/f11 3 1 2024-01-17T23:36:54.016 INFO:tasks.workunit.client.0.smithi161.stdout:4/427: unlink f7 0 2024-01-17T23:36:54.093 INFO:tasks.workunit.client.0.smithi161.stdout:2/354: write d8/da/d52/f33 [1338090,117674] 0 2024-01-17T23:36:54.475 INFO:tasks.workunit.client.0.smithi161.stdout:4/428: symlink d9/de/l77 0 2024-01-17T23:36:54.657 INFO:tasks.workunit.client.0.smithi161.stdout:9/297: creat d0/d8/f66 x:0 0 0 2024-01-17T23:36:54.815 INFO:tasks.workunit.client.0.smithi161.stdout:5/385: symlink dd/d15/l72 0 2024-01-17T23:36:55.041 INFO:tasks.workunit.client.0.smithi161.stdout:2/355: rename d8/d1c/d5b to d8/d1c/d1e/d80 0 2024-01-17T23:36:55.305 INFO:tasks.workunit.client.0.smithi161.stdout:3/357: unlink d0/d5/d9/c11 0 2024-01-17T23:36:55.586 INFO:tasks.workunit.client.0.smithi161.stdout:4/429: rename d9/de/f41 to d9/d27/d68/d6d/f78 0 2024-01-17T23:36:55.624 INFO:tasks.workunit.client.0.smithi161.stdout:4/430: dwrite d9/d27/d68/d6d/f78 [4194304,4194304] 0 2024-01-17T23:36:55.625 INFO:tasks.workunit.client.0.smithi161.stdout:4/431: truncate d9/de/d1e/d38/f48 544089 0 2024-01-17T23:36:55.639 INFO:tasks.workunit.client.0.smithi161.stdout:2/356: creat d8/d1c/d1e/d80/d79/f81 x:0 0 0 2024-01-17T23:36:55.639 INFO:tasks.workunit.client.0.smithi161.stdout:2/357: dread - d8/d1c/d1e/d80/d79/f81 zero size 2024-01-17T23:36:55.659 INFO:tasks.workunit.client.0.smithi161.stdout:2/358: write d8/d2e/f63 [2045119,11586] 0 2024-01-17T23:36:55.659 INFO:tasks.workunit.client.0.smithi161.stdout:2/359: chown d8/d1c/d1e/f38 1024892016 1 2024-01-17T23:36:55.659 INFO:tasks.workunit.client.0.smithi161.stdout:2/360: creat d8/da/d52/d34/d35/d3a/f82 x:0 0 0 2024-01-17T23:36:55.659 INFO:tasks.workunit.client.0.smithi161.stdout:2/361: write d8/d1c/d1e/d80/d79/f81 [396499,40765] 0 2024-01-17T23:36:55.825 INFO:tasks.workunit.client.0.smithi161.stdout:3/358: unlink d0/d5/c1a 0 2024-01-17T23:36:56.013 INFO:tasks.workunit.client.0.smithi161.stdout:4/432: symlink d9/d27/d68/l79 0 2024-01-17T23:36:56.042 INFO:tasks.workunit.client.0.smithi161.stdout:4/433: dwrite d9/de/d1e/f32 [0,4194304] 0 2024-01-17T23:36:56.042 INFO:tasks.workunit.client.0.smithi161.stdout:4/434: stat d9/d27/d68/d6d 0 2024-01-17T23:36:56.042 INFO:tasks.workunit.client.0.smithi161.stdout:4/435: chown d9/d51/d64/f70 909370545 1 2024-01-17T23:36:56.062 INFO:tasks.workunit.client.0.smithi161.stdout:4/436: dread d9/f31 [0,4194304] 0 2024-01-17T23:36:56.583 INFO:tasks.workunit.client.0.smithi161.stdout:3/359: rename d0/f6 to d0/d72/f79 0 2024-01-17T23:36:56.721 INFO:tasks.workunit.client.0.smithi161.stdout:4/437: mknod d9/de/d1e/d58/c7a 0 2024-01-17T23:36:57.020 INFO:tasks.workunit.client.0.smithi161.stdout:3/360: rename d0/d5/d9/d1e/d3b/f42 to d0/d5/d9/d1e/f7a 0 2024-01-17T23:36:57.021 INFO:tasks.workunit.client.0.smithi161.stdout:3/361: chown d0/d5/d9/d1e/f39 1651497804 1 2024-01-17T23:36:57.109 INFO:tasks.workunit.client.0.smithi161.stdout:4/438: creat d9/d1b/d53/f7b x:0 0 0 2024-01-17T23:36:57.296 INFO:tasks.workunit.client.0.smithi161.stdout:3/362: creat d0/d5/d9/d1e/f7b x:0 0 0 2024-01-17T23:36:57.705 INFO:tasks.workunit.client.0.smithi161.stdout:3/363: mkdir d0/d5/d9/d38/d4f/d56/d7c 0 2024-01-17T23:36:57.705 INFO:tasks.workunit.client.0.smithi161.stdout:1/418: unlink d1/fe 0 2024-01-17T23:36:57.709 INFO:tasks.workunit.client.0.smithi161.stdout:1/419: dread d1/d8/f56 [4194304,4194304] 0 2024-01-17T23:36:57.752 INFO:tasks.workunit.client.0.smithi161.stdout:0/435: dwrite d5/d34/d12/d2a/d35/f5d [0,4194304] 0 2024-01-17T23:36:57.777 INFO:tasks.workunit.client.0.smithi161.stdout:0/436: dwrite d5/d34/d12/d2a/d35/f82 [4194304,4194304] 0 2024-01-17T23:36:57.956 INFO:tasks.workunit.client.0.smithi161.stdout:5/386: truncate dd/d15/d1a/f57 1397838 0 2024-01-17T23:36:58.016 INFO:tasks.workunit.client.0.smithi161.stdout:7/416: sync 2024-01-17T23:36:58.016 INFO:tasks.workunit.client.0.smithi161.stdout:6/378: sync 2024-01-17T23:36:58.016 INFO:tasks.workunit.client.0.smithi161.stdout:7/417: write da/d34/d5a/d68/d8c/f8d [1530903,65160] 0 2024-01-17T23:36:58.017 INFO:tasks.workunit.client.0.smithi161.stdout:7/418: chown da/d34/f52 59398071 1 2024-01-17T23:36:58.017 INFO:tasks.workunit.client.0.smithi161.stdout:7/419: truncate da/d34/d4a/d4c/f6e 150713 0 2024-01-17T23:36:58.067 INFO:tasks.workunit.client.0.smithi161.stdout:6/379: dwrite d6/d7/dc/f5b [4194304,4194304] 0 2024-01-17T23:36:58.067 INFO:tasks.workunit.client.0.smithi161.stdout:6/380: write d6/d7/dc/d3c/d47/d1a/d59/f83 [4941407,130614] 0 2024-01-17T23:36:58.067 INFO:tasks.workunit.client.0.smithi161.stdout:6/381: chown d6/d7/dc/d43/f74 643 1 2024-01-17T23:36:58.350 INFO:tasks.workunit.client.0.smithi161.stdout:3/364: link d0/f77 d0/d5/d9/d1e/d5a/f7d 0 2024-01-17T23:36:58.365 INFO:tasks.workunit.client.0.smithi161.stdout:1/420: rename d1/d8/d54/c6d to d1/d31/c87 0 2024-01-17T23:36:58.376 INFO:tasks.workunit.client.0.smithi161.stdout:3/365: dwrite d0/f77 [0,4194304] 0 2024-01-17T23:36:58.376 INFO:tasks.workunit.client.0.smithi161.stdout:3/366: dread - d0/d5/f57 zero size 2024-01-17T23:36:58.417 INFO:tasks.workunit.client.0.smithi161.stdout:3/367: dwrite d0/d5/d9/d17/d32/f4a [0,4194304] 0 2024-01-17T23:36:58.966 INFO:tasks.workunit.client.0.smithi161.stdout:7/420: getdents da 0 2024-01-17T23:36:58.967 INFO:tasks.workunit.client.0.smithi161.stdout:7/421: read - da/d34/d4a/d4c/f70 zero size 2024-01-17T23:37:00.371 INFO:tasks.workunit.client.0.smithi161.stdout:0/437: rename d5/d8/f19 to d5/d34/d20/f85 0 2024-01-17T23:37:00.372 INFO:tasks.workunit.client.0.smithi161.stdout:1/421: creat d1/d20/d26/d30/d44/f88 x:0 0 0 2024-01-17T23:37:00.381 INFO:tasks.workunit.client.0.smithi161.stdout:0/438: dread d5/d34/f23 [0,4194304] 0 2024-01-17T23:37:00.679 INFO:tasks.workunit.client.0.smithi161.stdout:3/368: creat d0/d5/d9/d38/d4f/d56/f7e x:0 0 0 2024-01-17T23:37:00.710 INFO:tasks.workunit.client.0.smithi161.stdout:3/369: dwrite d0/d5/d9/d17/f18 [0,4194304] 0 2024-01-17T23:37:00.711 INFO:tasks.workunit.client.0.smithi161.stdout:3/370: dread - d0/d5/d9/d17/f36 zero size 2024-01-17T23:37:00.800 INFO:tasks.workunit.client.0.smithi161.stdout:4/439: dwrite d9/d1b/d52/f59 [0,4194304] 0 2024-01-17T23:37:00.800 INFO:tasks.workunit.client.0.smithi161.stdout:4/440: readlink d9/de/d1e/d58/l71 0 2024-01-17T23:37:00.800 INFO:tasks.workunit.client.0.smithi161.stdout:4/441: read - d9/de/f2c zero size 2024-01-17T23:37:00.947 INFO:tasks.workunit.client.0.smithi161.stdout:6/382: getdents d6/d58 0 2024-01-17T23:37:01.164 INFO:tasks.workunit.client.0.smithi161.stdout:8/337: sync 2024-01-17T23:37:01.164 INFO:tasks.workunit.client.0.smithi161.stdout:9/298: sync 2024-01-17T23:37:01.164 INFO:tasks.workunit.client.0.smithi161.stdout:9/299: dread - d0/d8/d14/f65 zero size 2024-01-17T23:37:01.165 INFO:tasks.workunit.client.0.smithi161.stdout:8/338: dread d1/f58 [0,4194304] 0 2024-01-17T23:37:01.166 INFO:tasks.workunit.client.0.smithi161.stdout:8/339: fsync d1/d22/f48 0 2024-01-17T23:37:01.177 INFO:tasks.workunit.client.0.smithi161.stdout:9/300: write d0/d8/d14/d18/f55 [293366,100406] 0 2024-01-17T23:37:01.316 INFO:tasks.workunit.client.0.smithi161.stdout:2/362: sync 2024-01-17T23:37:01.316 INFO:tasks.workunit.client.0.smithi161.stdout:2/363: chown d8/d1c/c3f 361493 1 2024-01-17T23:37:01.316 INFO:tasks.workunit.client.0.smithi161.stdout:2/364: creat d8/d1c/d57/f83 x:0 0 0 2024-01-17T23:37:01.323 INFO:tasks.workunit.client.0.smithi161.stdout:2/365: dread d8/da/d52/f51 [0,4194304] 0 2024-01-17T23:37:01.326 INFO:tasks.workunit.client.0.smithi161.stdout:2/366: read d8/d1c/d1e/d80/d79/f81 [119033,23731] 0 2024-01-17T23:37:01.327 INFO:tasks.workunit.client.0.smithi161.stdout:2/367: write d8/da/d52/d34/d35/d3a/f82 [956785,72764] 0 2024-01-17T23:37:01.353 INFO:tasks.workunit.client.0.smithi161.stdout:2/368: write d8/f4f [1602919,18958] 0 2024-01-17T23:37:01.537 INFO:tasks.workunit.client.0.smithi161.stdout:1/422: creat d1/d11/d72/f89 x:0 0 0 2024-01-17T23:37:01.786 INFO:tasks.workunit.client.0.smithi161.stdout:3/371: mknod d0/d5/d9/d38/c7f 0 2024-01-17T23:37:01.786 INFO:tasks.workunit.client.0.smithi161.stdout:3/372: fsync d0/d5/d9/f53 0 2024-01-17T23:37:01.786 INFO:tasks.workunit.client.0.smithi161.stdout:3/373: fsync d0/d5/d9/d17/f1c 0 2024-01-17T23:37:01.786 INFO:tasks.workunit.client.0.smithi161.stdout:3/374: creat d0/d5/d9/d38/d4f/f80 x:0 0 0 2024-01-17T23:37:01.786 INFO:tasks.workunit.client.0.smithi161.stdout:3/375: stat d0/d5/f6a 0 2024-01-17T23:37:01.807 INFO:tasks.workunit.client.0.smithi161.stdout:3/376: read d0/f77 [1028976,14945] 0 2024-01-17T23:37:01.807 INFO:tasks.workunit.client.0.smithi161.stdout:3/377: dread - d0/d5/d9/d38/d4f/f80 zero size 2024-01-17T23:37:01.807 INFO:tasks.workunit.client.0.smithi161.stdout:3/378: readlink d0/d5/d9/d38/l4d 0 2024-01-17T23:37:02.193 INFO:tasks.workunit.client.0.smithi161.stdout:4/442: creat d9/d1b/d24/d25/f7c x:0 0 0 2024-01-17T23:37:02.705 INFO:tasks.workunit.client.0.smithi161.stdout:8/340: mknod d1/d1c/c72 0 2024-01-17T23:37:02.950 INFO:tasks.workunit.client.0.smithi161.stdout:2/369: mkdir d8/d2e/d84 0 2024-01-17T23:37:02.950 INFO:tasks.workunit.client.0.smithi161.stdout:2/370: write d8/d1c/f25 [2111606,63136] 0 2024-01-17T23:37:03.095 INFO:tasks.workunit.client.0.smithi161.stdout:1/423: mknod d1/d8/d1f/c8a 0 2024-01-17T23:37:03.095 INFO:tasks.workunit.client.0.smithi161.stdout:1/424: write d1/d20/d26/d30/d44/f88 [253975,67510] 0 2024-01-17T23:37:03.393 INFO:tasks.workunit.client.0.smithi161.stdout:5/387: sync 2024-01-17T23:37:03.425 INFO:tasks.workunit.client.0.smithi161.stdout:5/388: dwrite dd/d15/d1a/f25 [0,4194304] 0 2024-01-17T23:37:03.459 INFO:tasks.workunit.client.0.smithi161.stdout:5/389: dwrite dd/d15/d1a/d42/f46 [0,4194304] 0 2024-01-17T23:37:03.459 INFO:tasks.workunit.client.0.smithi161.stdout:5/390: chown dd/d15/d4e/c69 8782547 1 2024-01-17T23:37:03.459 INFO:tasks.workunit.client.0.smithi161.stdout:5/391: write dd/f11 [1138842,63305] 0 2024-01-17T23:37:03.942 INFO:tasks.workunit.client.0.smithi161.stdout:4/443: link d9/de/f2c d9/de/d1e/d38/d6b/f7d 0 2024-01-17T23:37:03.942 INFO:tasks.workunit.client.0.smithi161.stdout:6/383: truncate d6/d7/dc/d3c/d47/d1a/d59/f83 3920495 0 2024-01-17T23:37:03.953 INFO:tasks.workunit.client.0.smithi161.stdout:4/444: dread d9/de/d1e/f66 [0,4194304] 0 2024-01-17T23:37:03.983 INFO:tasks.workunit.client.0.smithi161.stdout:8/341: dread f0 [0,4194304] 0 2024-01-17T23:37:04.149 INFO:tasks.workunit.client.0.smithi161.stdout:2/371: creat d8/d4b/f85 x:0 0 0 2024-01-17T23:37:04.797 INFO:tasks.workunit.client.0.smithi161.stdout:7/422: unlink da/f5f 0 2024-01-17T23:37:04.798 INFO:tasks.workunit.client.0.smithi161.stdout:5/392: creat dd/d15/d1a/d5d/d64/f73 x:0 0 0 2024-01-17T23:37:05.180 INFO:tasks.workunit.client.0.smithi161.stdout:6/384: mknod d6/d7/dc/d3c/c84 0 2024-01-17T23:37:05.212 INFO:tasks.workunit.client.0.smithi161.stdout:0/439: dwrite d5/d34/d12/f6f [0,4194304] 0 2024-01-17T23:37:05.234 INFO:tasks.workunit.client.0.smithi161.stdout:8/342: getdents d1/d3d 0 2024-01-17T23:37:05.344 INFO:tasks.workunit.client.0.smithi161.stdout:2/372: mknod d8/d67/d6c/c86 0 2024-01-17T23:37:05.344 INFO:tasks.workunit.client.0.smithi161.stdout:2/373: stat d8/d1c/c7d 0 2024-01-17T23:37:05.932 INFO:tasks.workunit.client.0.smithi161.stdout:7/423: readlink da/d34/l53 0 2024-01-17T23:37:06.591 INFO:tasks.workunit.client.0.smithi161.stdout:9/301: write d0/d39/f59 [1072314,18634] 0 2024-01-17T23:37:06.826 INFO:tasks.workunit.client.0.smithi161.stdout:7/424: symlink da/d34/l92 0 2024-01-17T23:37:06.935 INFO:tasks.workunit.client.0.smithi161.stdout:5/393: getdents dd/d15/d51 0 2024-01-17T23:37:07.136 INFO:tasks.workunit.client.0.smithi161.stdout:8/343: rmdir d1/df/d13 39 2024-01-17T23:37:07.269 INFO:tasks.workunit.client.0.smithi161.stdout:9/302: link d0/d8/d14/d18/l4c d0/d8/d14/d18/d63/l67 0 2024-01-17T23:37:07.570 INFO:tasks.workunit.client.0.smithi161.stdout:8/344: mknod d1/df/d20/c73 0 2024-01-17T23:37:07.600 INFO:tasks.workunit.client.0.smithi161.stdout:7/425: dwrite da/f26 [0,4194304] 0 2024-01-17T23:37:07.697 INFO:tasks.workunit.client.0.smithi161.stdout:9/303: creat d0/d8/d31/f68 x:0 0 0 2024-01-17T23:37:07.706 INFO:tasks.workunit.client.0.smithi161.stdout:9/304: dread d0/d8/d14/f29 [0,4194304] 0 2024-01-17T23:37:07.997 INFO:tasks.workunit.client.0.smithi161.stdout:8/345: creat d1/d22/f74 x:0 0 0 2024-01-17T23:37:07.997 INFO:tasks.workunit.client.0.smithi161.stdout:8/346: dread - d1/d3/d19/d1d/d25/d4b/f6b zero size 2024-01-17T23:37:08.023 INFO:tasks.workunit.client.0.smithi161.stdout:8/347: dwrite d1/d3/d19/d1d/f36 [0,4194304] 0 2024-01-17T23:37:08.023 INFO:tasks.workunit.client.0.smithi161.stdout:8/348: truncate d1/d3/d19/d1d/d25/f67 460277 0 2024-01-17T23:37:08.648 INFO:tasks.workunit.client.0.smithi161.stdout:8/349: mknod d1/d3/d19/d1d/d25/d4b/c75 0 2024-01-17T23:37:08.682 INFO:tasks.workunit.client.0.smithi161.stdout:8/350: dwrite d1/f4e [0,4194304] 0 2024-01-17T23:37:08.714 INFO:tasks.workunit.client.0.smithi161.stdout:3/379: sync 2024-01-17T23:37:08.714 INFO:tasks.workunit.client.0.smithi161.stdout:3/380: write d0/d5/d9/d38/d4f/d56/f7e [966244,57160] 0 2024-01-17T23:37:09.160 INFO:tasks.workunit.client.0.smithi161.stdout:7/426: rmdir da/d14/d35 39 2024-01-17T23:37:09.160 INFO:tasks.workunit.client.0.smithi161.stdout:7/427: read - da/d34/d5a/d28/d2b/f84 zero size 2024-01-17T23:37:09.414 INFO:tasks.workunit.client.0.smithi161.stdout:1/425: write d1/d2d/d3b/f21 [1296362,21696] 0 2024-01-17T23:37:09.467 INFO:tasks.workunit.client.0.smithi161.stdout:8/351: symlink d1/d55/l76 0 2024-01-17T23:37:09.467 INFO:tasks.workunit.client.0.smithi161.stdout:8/352: fsync d1/df/f69 0 2024-01-17T23:37:09.859 INFO:tasks.workunit.client.0.smithi161.stdout:1/426: mknod d1/d20/d26/d30/c8b 0 2024-01-17T23:37:09.859 INFO:tasks.workunit.client.0.smithi161.stdout:1/427: chown d1/f38 24474 1 2024-01-17T23:37:10.230 INFO:tasks.workunit.client.0.smithi161.stdout:4/445: mknod d9/d1b/c7e 0 2024-01-17T23:37:10.230 INFO:tasks.workunit.client.0.smithi161.stdout:3/381: rename d0/d5/f6a to d0/d5/f81 0 2024-01-17T23:37:10.390 INFO:tasks.workunit.client.0.smithi161.stdout:1/428: mkdir d1/d31/d8c 0 2024-01-17T23:37:10.704 INFO:tasks.workunit.client.0.smithi161.stdout:3/382: mknod d0/d5/d9/d38/d4f/d56/d7c/c82 0 2024-01-17T23:37:10.722 INFO:tasks.workunit.client.0.smithi161.stdout:0/440: write d5/d34/d20/f2f [1528588,95381] 0 2024-01-17T23:37:10.722 INFO:tasks.workunit.client.0.smithi161.stdout:0/441: readlink d5/d34/d20/l5f 0 2024-01-17T23:37:10.722 INFO:tasks.workunit.client.0.smithi161.stdout:0/442: fdatasync d5/d34/d20/f85 0 2024-01-17T23:37:10.988 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:37:10.993 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:37:11.063 INFO:tasks.workunit.client.0.smithi161.stdout:1/429: truncate d1/f23 1889271 0 2024-01-17T23:37:11.064 INFO:tasks.workunit.client.0.smithi161.stdout:2/374: symlink d8/da/d52/l87 0 2024-01-17T23:37:11.064 INFO:tasks.workunit.client.0.smithi161.stdout:2/375: creat d8/da/d52/d34/d35/d3a/f88 x:0 0 0 2024-01-17T23:37:11.064 INFO:tasks.workunit.client.0.smithi161.stdout:2/376: chown d8/da/l5f 18 1 2024-01-17T23:37:11.064 INFO:tasks.workunit.client.0.smithi161.stdout:2/377: dread - d8/d1c/f49 zero size 2024-01-17T23:37:11.086 INFO:tasks.workunit.client.0.smithi161.stdout:1/430: write d1/d8/d1f/f28 [6088597,43104] 0 2024-01-17T23:37:11.731 INFO:tasks.workunit.client.0.smithi161.stdout:4/446: getdents d9/d1b/d53 0 2024-01-17T23:37:11.731 INFO:tasks.workunit.client.0.smithi161.stdout:4/447: chown d9/l4f 1 1 2024-01-17T23:37:11.731 INFO:tasks.workunit.client.0.smithi161.stdout:4/448: truncate d9/d1b/d24/d25/f7c 88306 0 2024-01-17T23:37:11.731 INFO:tasks.workunit.client.0.smithi161.stdout:5/394: mknod dd/c74 0 2024-01-17T23:37:11.746 INFO:tasks.workunit.client.0.smithi161.stdout:3/383: symlink d0/d5/d9/d17/d32/l83 0 2024-01-17T23:37:11.762 INFO:tasks.workunit.client.0.smithi161.stdout:8/353: dwrite d1/d3/f9 [4194304,4194304] 0 2024-01-17T23:37:11.762 INFO:tasks.workunit.client.0.smithi161.stdout:8/354: fsync d1/d3/d19/d1d/d25/f4d 0 2024-01-17T23:37:11.765 INFO:tasks.workunit.client.0.smithi161.stdout:9/305: dwrite d0/f50 [0,4194304] 0 2024-01-17T23:37:11.765 INFO:tasks.workunit.client.0.smithi161.stdout:9/306: write d0/d39/f59 [1305693,118722] 0 2024-01-17T23:37:11.765 INFO:tasks.workunit.client.0.smithi161.stdout:9/307: chown d0/d8/d31/d58 2427 1 2024-01-17T23:37:11.766 INFO:tasks.workunit.client.0.smithi161.stdout:7/428: dwrite da/d14/f18 [4194304,4194304] 0 2024-01-17T23:37:11.772 INFO:tasks.workunit.client.0.smithi161.stdout:3/384: dread d0/d5/d9/d1e/f5f [0,4194304] 0 2024-01-17T23:37:11.841 INFO:tasks.workunit.client.0.smithi161.stdout:0/443: mknod d5/d34/d20/c86 0 2024-01-17T23:37:11.841 INFO:tasks.workunit.client.0.smithi161.stdout:0/444: creat d5/d34/d21/d76/f87 x:0 0 0 2024-01-17T23:37:12.352 INFO:tasks.workunit.client.0.smithi161.stdout:1/431: rmdir d1/d8/d1f 39 2024-01-17T23:37:12.541 INFO:tasks.workunit.client.0.smithi161.stdout:5/395: link dd/l37 dd/d15/d1a/l75 0 2024-01-17T23:37:12.928 INFO:tasks.workunit.client.0.smithi161.stdout:8/355: link d1/d1c/l45 d1/d3/d19/l77 0 2024-01-17T23:37:13.353 INFO:tasks.workunit.client.0.smithi161.stdout:6/385: unlink d6/d7/dc/c80 0 2024-01-17T23:37:13.354 INFO:tasks.workunit.client.0.smithi161.stdout:9/308: rmdir d0/d8/d14/d18 39 2024-01-17T23:37:13.354 INFO:tasks.workunit.client.0.smithi161.stdout:7/429: mkdir da/d34/d5a/d28/d2b/d93 0 2024-01-17T23:37:13.354 INFO:tasks.workunit.client.0.smithi161.stdout:7/430: creat da/d34/d4a/d4c/f94 x:0 0 0 2024-01-17T23:37:13.354 INFO:tasks.workunit.client.0.smithi161.stdout:9/309: write d0/d8/d14/f65 [421749,64372] 0 2024-01-17T23:37:13.354 INFO:tasks.workunit.client.0.smithi161.stdout:7/431: read da/d34/d5a/d28/d43/f78 [211867,125272] 0 2024-01-17T23:37:13.354 INFO:tasks.workunit.client.0.smithi161.stdout:9/310: write d0/d8/d14/d18/d20/f5b [480480,11835] 0 2024-01-17T23:37:13.354 INFO:tasks.workunit.client.0.smithi161.stdout:9/311: readlink d0/d8/d31/d58/l61 0 2024-01-17T23:37:13.354 INFO:tasks.workunit.client.0.smithi161.stdout:9/312: read - d0/d8/f66 zero size 2024-01-17T23:37:13.382 INFO:tasks.workunit.client.0.smithi161.stdout:7/432: dwrite da/d34/d5a/d28/d43/f59 [0,4194304] 0 2024-01-17T23:37:13.561 INFO:tasks.workunit.client.0.smithi161.stdout:3/385: unlink d0/l3d 0 2024-01-17T23:37:13.561 INFO:tasks.workunit.client.0.smithi161.stdout:3/386: chown d0/d5/d9/f53 158658769 1 2024-01-17T23:37:13.561 INFO:tasks.workunit.client.0.smithi161.stdout:3/387: dread - d0/d5/d9/d38/d4f/f80 zero size 2024-01-17T23:37:13.575 INFO:tasks.workunit.client.0.smithi161.stdout:3/388: read d0/d5/d9/d17/f18 [4183604,5558] 0 2024-01-17T23:37:13.575 INFO:tasks.workunit.client.0.smithi161.stdout:3/389: truncate d0/d5/d9/d1e/f7b 723508 0 2024-01-17T23:37:13.575 INFO:tasks.workunit.client.0.smithi161.stdout:3/390: chown d0/d5/l25 1801 1 2024-01-17T23:37:13.603 INFO:tasks.workunit.client.0.smithi161.stdout:3/391: dwrite d0/d5/d9/d17/f18 [4194304,4194304] 0 2024-01-17T23:37:13.659 INFO:tasks.workunit.client.0.smithi161.stdout:2/378: rmdir d8/d68 39 2024-01-17T23:37:14.746 INFO:tasks.workunit.client.0.smithi161.stdout:4/449: dwrite d9/de/d1e/d38/f48 [0,4194304] 0 2024-01-17T23:37:14.843 INFO:tasks.workunit.client.0.smithi161.stdout:1/432: link d1/d8/l14 d1/d8/d1f/d4b/l8d 0 2024-01-17T23:37:15.129 INFO:tasks.workunit.client.0.smithi161.stdout:8/356: link d1/df/f14 d1/df/d20/d6a/f78 0 2024-01-17T23:37:15.134 INFO:tasks.workunit.client.0.smithi161.stdout:8/357: dread d1/df/d20/f4c [0,4194304] 0 2024-01-17T23:37:15.435 INFO:tasks.workunit.client.0.smithi161.stdout:9/313: mknod d0/d8/d31/d58/c69 0 2024-01-17T23:37:15.436 INFO:tasks.workunit.client.0.smithi161.stdout:9/314: chown d0/d8/d14/d18/c46 134831 1 2024-01-17T23:37:15.436 INFO:tasks.workunit.client.0.smithi161.stdout:9/315: chown d0/d8/d14/d18/d20/f45 4 1 2024-01-17T23:37:15.439 INFO:tasks.workunit.client.0.smithi161.stdout:9/316: dread d0/d8/d14/d18/d20/f5b [0,4194304] 0 2024-01-17T23:37:15.439 INFO:tasks.workunit.client.0.smithi161.stdout:9/317: fdatasync d0/d8/f10 0 2024-01-17T23:37:15.439 INFO:tasks.workunit.client.0.smithi161.stdout:9/318: stat d0/f3a 0 2024-01-17T23:37:15.823 INFO:tasks.workunit.client.0.smithi161.stdout:7/433: readlink da/l21 0 2024-01-17T23:37:16.152 INFO:tasks.workunit.client.0.smithi161.stdout:3/392: unlink d0/d5/d9/d1e/c48 0 2024-01-17T23:37:16.152 INFO:tasks.workunit.client.0.smithi161.stdout:3/393: fdatasync d0/f4 0 2024-01-17T23:37:16.152 INFO:tasks.workunit.client.0.smithi161.stdout:3/394: fdatasync d0/d5/d9/d1e/d3b/f6f 0 2024-01-17T23:37:17.013 INFO:tasks.workunit.client.0.smithi161.stdout:1/433: symlink d1/d8/d1f/d4b/l8e 0 2024-01-17T23:37:17.013 INFO:tasks.workunit.client.0.smithi161.stdout:1/434: chown d1/d8/d67 578130 1 2024-01-17T23:37:17.200 INFO:tasks.workunit.client.0.smithi161.stdout:5/396: getdents dd/d15/d6a 0 2024-01-17T23:37:17.291 INFO:tasks.workunit.client.0.smithi161.stdout:0/445: sync 2024-01-17T23:37:18.222 INFO:tasks.workunit.client.0.smithi161.stdout:1/435: mkdir d1/d20/d26/d30/d8f 0 2024-01-17T23:37:18.222 INFO:tasks.workunit.client.0.smithi161.stdout:5/397: mknod dd/d15/d1a/c76 0 2024-01-17T23:37:18.238 INFO:tasks.workunit.client.0.smithi161.stdout:1/436: dread d1/f38 [4194304,4194304] 0 2024-01-17T23:37:18.301 INFO:tasks.workunit.client.0.smithi161.stdout:8/358: getdents d1/d22/d2f 0 2024-01-17T23:37:18.301 INFO:tasks.workunit.client.0.smithi161.stdout:0/446: mkdir d5/d34/d20/d2b/d64/d88 0 2024-01-17T23:37:18.328 INFO:tasks.workunit.client.0.smithi161.stdout:0/447: dwrite d5/d34/f23 [4194304,4194304] 0 2024-01-17T23:37:18.356 INFO:tasks.workunit.client.0.smithi161.stdout:0/448: dwrite d5/d8/d68/f7d [0,4194304] 0 2024-01-17T23:37:18.615 INFO:tasks.workunit.client.0.smithi161.stdout:7/434: symlink da/d14/l95 0 2024-01-17T23:37:18.615 INFO:tasks.workunit.client.0.smithi161.stdout:5/398: mkdir dd/d15/d4e/d4f/d77 0 2024-01-17T23:37:18.890 INFO:tasks.workunit.client.0.smithi161.stdout:6/386: sync 2024-01-17T23:37:19.070 INFO:tasks.workunit.client.0.smithi161.stdout:0/449: getdents d5/d34/d20/d2d 0 2024-01-17T23:37:19.070 INFO:tasks.workunit.client.0.smithi161.stdout:0/450: chown d5 2095835 1 2024-01-17T23:37:19.134 INFO:tasks.workunit.client.0.smithi161.stdout:5/399: getdents dd/d15/d1a/d5d 0 2024-01-17T23:37:19.273 INFO:tasks.workunit.client.0.smithi161.stdout:2/379: dwrite d8/d1c/f25 [4194304,4194304] 0 2024-01-17T23:37:19.307 INFO:tasks.workunit.client.0.smithi161.stdout:2/380: dwrite d8/da/f76 [0,4194304] 0 2024-01-17T23:37:19.323 INFO:tasks.workunit.client.0.smithi161.stdout:2/381: dread d8/d2e/f63 [0,4194304] 0 2024-01-17T23:37:19.858 INFO:tasks.workunit.client.0.smithi161.stdout:2/382: creat d8/da/d52/d34/d35/f89 x:0 0 0 2024-01-17T23:37:19.858 INFO:tasks.workunit.client.0.smithi161.stdout:2/383: fdatasync d8/d68/f6d 0 2024-01-17T23:37:19.858 INFO:tasks.workunit.client.0.smithi161.stdout:2/384: dread - d8/d1c/d1e/f6f zero size 2024-01-17T23:37:20.240 INFO:tasks.workunit.client.0.smithi161.stdout:4/450: sync 2024-01-17T23:37:20.260 INFO:tasks.workunit.client.0.smithi161.stdout:4/451: dread d9/f10 [0,4194304] 0 2024-01-17T23:37:20.725 INFO:tasks.workunit.client.0.smithi161.stdout:9/319: rename d0/d8/d14/f1b to d0/d8/d14/d18/d63/f6a 0 2024-01-17T23:37:20.754 INFO:tasks.workunit.client.0.smithi161.stdout:9/320: dwrite d0/f50 [0,4194304] 0 2024-01-17T23:37:20.764 INFO:tasks.workunit.client.0.smithi161.stdout:0/451: rmdir d5/d34/d20/d2b/d64 39 2024-01-17T23:37:20.790 INFO:tasks.workunit.client.0.smithi161.stdout:1/437: dwrite d1/f3a [0,4194304] 0 2024-01-17T23:37:20.834 INFO:tasks.workunit.client.0.smithi161.stdout:8/359: dwrite d1/d3d/f40 [0,4194304] 0 2024-01-17T23:37:20.834 INFO:tasks.workunit.client.0.smithi161.stdout:8/360: dread - d1/d22/d2f/f43 zero size 2024-01-17T23:37:20.834 INFO:tasks.workunit.client.0.smithi161.stdout:8/361: readlink d1/d1c/l45 0 2024-01-17T23:37:21.056 INFO:tasks.workunit.client.0.smithi161.stdout:3/395: rename d0/d5/d9/d38/l4e to d0/d5/d9/d17/d2d/l84 0 2024-01-17T23:37:21.069 INFO:tasks.workunit.client.0.smithi161.stdout:3/396: dread d0/d5/fa [0,4194304] 0 2024-01-17T23:37:21.070 INFO:tasks.workunit.client.0.smithi161.stdout:5/400: dwrite dd/d15/f2e [0,4194304] 0 2024-01-17T23:37:21.109 INFO:tasks.workunit.client.0.smithi161.stdout:5/401: dwrite dd/d15/d1a/d5d/d64/f73 [0,4194304] 0 2024-01-17T23:37:21.109 INFO:tasks.workunit.client.0.smithi161.stdout:5/402: read - dd/d15/d6a/f71 zero size 2024-01-17T23:37:21.137 INFO:tasks.workunit.client.0.smithi161.stdout:5/403: dwrite dd/d31/d3c/f4c [4194304,4194304] 0 2024-01-17T23:37:21.148 INFO:tasks.workunit.client.0.smithi161.stdout:5/404: dread dd/d15/f22 [0,4194304] 0 2024-01-17T23:37:21.301 INFO:tasks.workunit.client.0.smithi161.stdout:9/321: unlink d0/d8/d14/d18/c46 0 2024-01-17T23:37:21.301 INFO:tasks.workunit.client.0.smithi161.stdout:9/322: chown d0/d8/c5d 11 1 2024-01-17T23:37:21.338 INFO:tasks.workunit.client.0.smithi161.stdout:9/323: dwrite d0/d39/d49/f57 [0,4194304] 0 2024-01-17T23:37:21.429 INFO:tasks.workunit.client.0.smithi161.stdout:0/452: mkdir d5/d8/d68/d6b/d89 0 2024-01-17T23:37:21.446 INFO:tasks.workunit.client.0.smithi161.stdout:0/453: write d5/d34/d20/f5a [2507563,117820] 0 2024-01-17T23:37:21.813 INFO:tasks.workunit.client.0.smithi161.stdout:1/438: link d1/f18 d1/d31/d8c/f90 0 2024-01-17T23:37:22.026 INFO:tasks.workunit.client.0.smithi161.stdout:4/452: link d9/d1b/c7e d9/c7f 0 2024-01-17T23:37:22.190 INFO:tasks.workunit.client.0.smithi161.stdout:8/362: link d1/d22/c49 d1/df/d13/c79 0 2024-01-17T23:37:22.354 INFO:tasks.workunit.client.0.smithi161.stdout:7/435: rename da/d34/d5a/d28/d43/c47 to da/d14/d35/c96 0 2024-01-17T23:37:22.354 INFO:tasks.workunit.client.0.smithi161.stdout:7/436: creat da/d34/d5a/d68/f97 x:0 0 0 2024-01-17T23:37:22.354 INFO:tasks.workunit.client.0.smithi161.stdout:7/437: chown da/d34/d5a/d3b/d3d 348 1 2024-01-17T23:37:22.537 INFO:tasks.workunit.client.0.smithi161.stdout:3/397: stat d0/d5/d9/d1e/l20 0 2024-01-17T23:37:22.537 INFO:tasks.workunit.client.0.smithi161.stdout:3/398: fdatasync d0/d5/d9/d1e/d3b/f78 0 2024-01-17T23:37:22.537 INFO:tasks.workunit.client.0.smithi161.stdout:3/399: dread - d0/d5/d9/d17/f36 zero size 2024-01-17T23:37:22.537 INFO:tasks.workunit.client.0.smithi161.stdout:3/400: dread - d0/d5/f57 zero size 2024-01-17T23:37:22.537 INFO:tasks.workunit.client.0.smithi161.stdout:3/401: write d0/d5/d9/d1e/d3b/d52/f67 [762289,41564] 0 2024-01-17T23:37:22.537 INFO:tasks.workunit.client.0.smithi161.stdout:3/402: stat d0/d5/d9/f13 0 2024-01-17T23:37:23.551 INFO:tasks.workunit.client.0.smithi161.stdout:9/324: link d0/l32 d0/d8/l6b 0 2024-01-17T23:37:23.621 INFO:tasks.workunit.client.0.smithi161.stdout:0/454: mkdir d5/d34/d8a 0 2024-01-17T23:37:23.791 INFO:tasks.workunit.client.0.smithi161.stdout:1/439: mknod d1/d64/c91 0 2024-01-17T23:37:23.814 INFO:tasks.workunit.client.0.smithi161.stdout:1/440: dread d1/d11/f12 [0,4194304] 0 2024-01-17T23:37:23.949 INFO:tasks.workunit.client.0.smithi161.stdout:4/453: symlink d9/de/l80 0 2024-01-17T23:37:24.033 INFO:tasks.workunit.client.0.smithi161.stdout:8/363: rmdir d1/d1c 39 2024-01-17T23:37:24.051 INFO:tasks.workunit.client.0.smithi161.stdout:8/364: chown d1/d3/d19/d1d/d25/d4b/f6b 0 1 2024-01-17T23:37:24.117 INFO:tasks.workunit.client.0.smithi161.stdout:6/387: rename d6/d7/dc/d3c/d47 to d6/d7/dc/d85 0 2024-01-17T23:37:24.117 INFO:tasks.workunit.client.0.smithi161.stdout:2/385: rename d8/da/d52/d34/d35/d3a to d8/da/d52/d34/d35/d3a/d8a 22 2024-01-17T23:37:24.117 INFO:tasks.workunit.client.0.smithi161.stdout:9/325: rename d0/d8/d31/d58 to d0/d8/d31/d58/d6c 22 2024-01-17T23:37:24.117 INFO:tasks.workunit.client.0.smithi161.stdout:9/326: chown d0/d8 2 1 2024-01-17T23:37:24.134 INFO:tasks.workunit.client.0.smithi161.stdout:6/388: dread d6/fa [0,4194304] 0 2024-01-17T23:37:25.026 INFO:tasks.workunit.client.0.smithi161.stdout:3/403: unlink d0/d5/d9/f13 0 2024-01-17T23:37:25.048 INFO:tasks.workunit.client.0.smithi161.stdout:3/404: write d0/f2e [1623080,25055] 0 2024-01-17T23:37:25.048 INFO:tasks.workunit.client.0.smithi161.stdout:3/405: chown d0/d5 109915 1 2024-01-17T23:37:25.304 INFO:tasks.workunit.client.0.smithi161.stdout:0/455: creat d5/d8/f8b x:0 0 0 2024-01-17T23:37:25.416 INFO:tasks.workunit.client.0.smithi161.stdout:1/441: link d1/d20/f73 d1/d8/d1c/d3e/f92 0 2024-01-17T23:37:25.844 INFO:tasks.workunit.client.0.smithi161.stdout:4/454: truncate d9/de/f19 116494 0 2024-01-17T23:37:25.845 INFO:tasks.workunit.client.0.smithi161.stdout:2/386: mknod d8/da/d52/d34/d35/d3a/c8b 0 2024-01-17T23:37:25.867 INFO:tasks.workunit.client.0.smithi161.stdout:2/387: dwrite d8/da/d52/f53 [0,4194304] 0 2024-01-17T23:37:25.907 INFO:tasks.workunit.client.0.smithi161.stdout:8/365: rename d1/d3/d19/d1d/d25/f5e to d1/d22/d2f/f7a 0 2024-01-17T23:37:25.907 INFO:tasks.workunit.client.0.smithi161.stdout:8/366: creat d1/df/d20/d6a/f7b x:0 0 0 2024-01-17T23:37:25.919 INFO:tasks.workunit.client.0.smithi161.stdout:6/389: creat d6/d7/dc/d43/d76/f86 x:0 0 0 2024-01-17T23:37:25.919 INFO:tasks.workunit.client.0.smithi161.stdout:6/390: stat d6/d7/dc/d3c/f4a 0 2024-01-17T23:37:26.004 INFO:tasks.workunit.client.0.smithi161.stdout:3/406: link d0/d5/d9/d38/l4d d0/d5/d9/d38/d4f/l85 0 2024-01-17T23:37:26.022 INFO:tasks.workunit.client.0.smithi161.stdout:3/407: write d0/d5/f1d [908821,34581] 0 2024-01-17T23:37:26.105 INFO:tasks.workunit.client.0.smithi161.stdout:0/456: link d5/d3a/d49/l4c d5/d34/d21/l8c 0 2024-01-17T23:37:26.227 INFO:tasks.workunit.client.0.smithi161.stdout:5/405: dwrite dd/d15/d1a/f63 [0,4194304] 0 2024-01-17T23:37:26.227 INFO:tasks.workunit.client.0.smithi161.stdout:5/406: chown dd/f50 1235 1 2024-01-17T23:37:26.228 INFO:tasks.workunit.client.0.smithi161.stdout:5/407: chown dd/d15/d6a/f71 300289283 1 2024-01-17T23:37:26.255 INFO:tasks.workunit.client.0.smithi161.stdout:1/442: creat d1/d8/d67/f93 x:0 0 0 2024-01-17T23:37:26.271 INFO:tasks.workunit.client.0.smithi161.stdout:1/443: write d1/d8/f1b [3613779,13217] 0 2024-01-17T23:37:26.305 INFO:tasks.workunit.client.0.smithi161.stdout:1/444: dwrite d1/d20/f37 [0,4194304] 0 2024-01-17T23:37:26.305 INFO:tasks.workunit.client.0.smithi161.stdout:1/445: write d1/d2d/f7d [571118,21293] 0 2024-01-17T23:37:26.306 INFO:tasks.workunit.client.0.smithi161.stdout:1/446: read - d1/d11/d72/d81/f82 zero size 2024-01-17T23:37:26.646 INFO:tasks.workunit.client.0.smithi161.stdout:4/455: symlink d9/de/d69/l81 0 2024-01-17T23:37:26.646 INFO:tasks.workunit.client.0.smithi161.stdout:4/456: fdatasync d9/de/d1e/d38/d6b/f7d 0 2024-01-17T23:37:26.646 INFO:tasks.workunit.client.0.smithi161.stdout:4/457: fsync d9/de/d1e/f32 0 2024-01-17T23:37:26.816 INFO:tasks.workunit.client.0.smithi161.stdout:2/388: mkdir d8/da/d52/d34/d35/d8c 0 2024-01-17T23:37:26.956 INFO:tasks.workunit.client.0.smithi161.stdout:9/327: rename d0/c5 to d0/d8/d14/d56/c6d 0 2024-01-17T23:37:27.184 INFO:tasks.workunit.client.0.smithi161.stdout:8/367: creat d1/df/d20/f7c x:0 0 0 2024-01-17T23:37:27.315 INFO:tasks.workunit.client.0.smithi161.stdout:6/391: creat d6/d58/f87 x:0 0 0 2024-01-17T23:37:27.315 INFO:tasks.workunit.client.0.smithi161.stdout:6/392: read - d6/d7/dc/d85/d13/f28 zero size 2024-01-17T23:37:27.570 INFO:tasks.workunit.client.0.smithi161.stdout:3/408: getdents d0/d5/d9/d38/d4f/d50 0 2024-01-17T23:37:27.887 INFO:tasks.workunit.client.0.smithi161.stdout:7/438: sync 2024-01-17T23:37:27.887 INFO:tasks.workunit.client.0.smithi161.stdout:7/439: stat da/d34/d5a/d68/c80 0 2024-01-17T23:37:27.895 INFO:tasks.workunit.client.0.smithi161.stdout:7/440: write da/d34/d5a/d68/d8c/f8d [181372,9923] 0 2024-01-17T23:37:27.914 INFO:tasks.workunit.client.0.smithi161.stdout:7/441: dread da/d14/f32 [0,4194304] 0 2024-01-17T23:37:29.028 INFO:tasks.workunit.client.0.smithi161.stdout:9/328: dread d0/f2a [0,4194304] 0 2024-01-17T23:37:29.131 INFO:tasks.workunit.client.0.smithi161.stdout:8/368: unlink d1/df/d13/f52 0 2024-01-17T23:37:29.214 INFO:tasks.workunit.client.0.smithi161.stdout:6/393: dread d6/d7/dc/f19 [0,4194304] 0 2024-01-17T23:37:29.392 INFO:tasks.workunit.client.0.smithi161.stdout:3/409: mknod d0/d5/d9/d17/c86 0 2024-01-17T23:37:29.916 INFO:tasks.workunit.client.0.smithi161.stdout:9/329: mkdir d0/d39/d49/d6e 0 2024-01-17T23:37:29.916 INFO:tasks.workunit.client.0.smithi161.stdout:9/330: fdatasync d0/f30 0 2024-01-17T23:37:30.148 INFO:tasks.workunit.client.0.smithi161.stdout:6/394: link d6/d7/dc/d85/d31/d5d/d55/l78 d6/d7/dc/d85/d31/l88 0 2024-01-17T23:37:30.148 INFO:tasks.workunit.client.0.smithi161.stdout:6/395: write d6/d7/dc/d1d/f5e [297519,23916] 0 2024-01-17T23:37:30.519 INFO:tasks.workunit.client.0.smithi161.stdout:5/408: mkdir dd/d15/d4e/d52/d78 0 2024-01-17T23:37:30.519 INFO:tasks.workunit.client.0.smithi161.stdout:5/409: chown dd/ff 10727063 1 2024-01-17T23:37:30.524 INFO:tasks.workunit.client.0.smithi161.stdout:3/410: dread d0/d5/d9/d38/f49 [0,4194304] 0 2024-01-17T23:37:30.547 INFO:tasks.workunit.client.0.smithi161.stdout:3/411: dread d0/f4 [0,4194304] 0 2024-01-17T23:37:30.547 INFO:tasks.workunit.client.0.smithi161.stdout:3/412: truncate d0/d5/d9/d1e/d3b/d52/f60 800710 0 2024-01-17T23:37:30.547 INFO:tasks.workunit.client.0.smithi161.stdout:3/413: truncate d0/d5/f19 4332697 0 2024-01-17T23:37:30.617 INFO:tasks.workunit.client.0.smithi161.stdout:7/442: link da/d34/d5a/f75 da/db/d7a/f98 0 2024-01-17T23:37:31.012 INFO:tasks.workunit.client.0.smithi161.stdout:9/331: rename d0/d8/d14/d18/d20/c21 to d0/d39/d49/c6f 0 2024-01-17T23:37:31.012 INFO:tasks.workunit.client.0.smithi161.stdout:9/332: chown d0/d39/d49/c6f 93716 1 2024-01-17T23:37:31.029 INFO:tasks.workunit.client.0.smithi161.stdout:9/333: read d0/f4 [1888619,25845] 0 2024-01-17T23:37:31.041 INFO:tasks.workunit.client.0.smithi161.stdout:6/396: truncate d6/d7/dc/d85/d1a/f62 2520091 0 2024-01-17T23:37:31.056 INFO:tasks.workunit.client.0.smithi161.stdout:9/334: dwrite d0/d8/f5f [0,4194304] 0 2024-01-17T23:37:31.083 INFO:tasks.workunit.client.0.smithi161.stdout:0/457: dwrite d5/d34/d20/d2b/d64/f78 [0,4194304] 0 2024-01-17T23:37:31.083 INFO:tasks.workunit.client.0.smithi161.stdout:0/458: fdatasync d5/d34/d12/d2a/f7a 0 2024-01-17T23:37:31.222 INFO:tasks.workunit.client.0.smithi161.stdout:3/414: link d0/d5/f81 d0/d5/d9/d1e/d5a/f87 0 2024-01-17T23:37:31.222 INFO:tasks.workunit.client.0.smithi161.stdout:3/415: read d0/f2e [3347551,96071] 0 2024-01-17T23:37:31.222 INFO:tasks.workunit.client.0.smithi161.stdout:3/416: chown d0/d5/d9/d17/f1c 26 1 2024-01-17T23:37:31.312 INFO:tasks.workunit.client.0.smithi161.stdout:7/443: truncate da/d34/d5a/d3b/f48 989601 0 2024-01-17T23:37:31.685 INFO:tasks.workunit.client.0.smithi161.stdout:6/397: truncate d6/d7/dc/d85/d31/f4e 3518228 0 2024-01-17T23:37:32.142 INFO:tasks.workunit.client.0.smithi161.stdout:2/389: mkdir d8/da/d8d 0 2024-01-17T23:37:32.142 INFO:tasks.workunit.client.0.smithi161.stdout:2/390: fdatasync d8/da/d52/d34/f69 0 2024-01-17T23:37:32.232 INFO:tasks.workunit.client.0.smithi161.stdout:0/459: mkdir d5/d34/d20/d2d/d8d 0 2024-01-17T23:37:32.357 INFO:tasks.workunit.client.0.smithi161.stdout:3/417: symlink d0/d5/d9/d38/l88 0 2024-01-17T23:37:32.357 INFO:tasks.workunit.client.0.smithi161.stdout:3/418: creat d0/d5/d9/d17/d32/f89 x:0 0 0 2024-01-17T23:37:32.375 INFO:tasks.workunit.client.0.smithi161.stdout:4/458: sync 2024-01-17T23:37:32.406 INFO:tasks.workunit.client.0.smithi161.stdout:4/459: dwrite d9/de/d1e/d38/f48 [0,4194304] 0 2024-01-17T23:37:32.744 INFO:tasks.workunit.client.0.smithi161.stdout:6/398: symlink d6/d7/dc/d3c/d81/l89 0 2024-01-17T23:37:32.770 INFO:tasks.workunit.client.0.smithi161.stdout:6/399: dwrite d6/d7/dc/d85/f49 [0,4194304] 0 2024-01-17T23:37:32.901 INFO:tasks.workunit.client.0.smithi161.stdout:1/447: dwrite d1/d2d/f78 [0,4194304] 0 2024-01-17T23:37:32.904 INFO:tasks.workunit.client.0.smithi161.stdout:1/448: dread d1/d2d/f7d [0,4194304] 0 2024-01-17T23:37:33.277 INFO:tasks.workunit.client.0.smithi161.stdout:0/460: getdents d5/d8/d68 0 2024-01-17T23:37:33.277 INFO:tasks.workunit.client.0.smithi161.stdout:0/461: stat d5/d34/d12/f4f 0 2024-01-17T23:37:33.278 INFO:tasks.workunit.client.0.smithi161.stdout:3/419: truncate d0/d5/d9/d17/f18 6994830 0 2024-01-17T23:37:33.283 INFO:tasks.workunit.client.0.smithi161.stdout:0/462: dread d5/d34/d21/f3b [0,4194304] 0 2024-01-17T23:37:33.299 INFO:tasks.workunit.client.0.smithi161.stdout:3/420: dread d0/d5/d9/d17/d32/f4a [0,4194304] 0 2024-01-17T23:37:33.315 INFO:tasks.workunit.client.0.smithi161.stdout:3/421: dread d0/f77 [0,4194304] 0 2024-01-17T23:37:33.315 INFO:tasks.workunit.client.0.smithi161.stdout:3/422: chown d0/d5/f19 100212760 1 2024-01-17T23:37:33.658 INFO:tasks.workunit.client.0.smithi161.stdout:4/460: mknod d9/d1b/d24/d25/c82 0 2024-01-17T23:37:33.658 INFO:tasks.workunit.client.0.smithi161.stdout:4/461: write d9/d51/d64/f70 [358907,34836] 0 2024-01-17T23:37:33.841 INFO:tasks.workunit.client.0.smithi161.stdout:6/400: link d6/d7/dc/d85/f49 d6/d7/dc/d43/d79/f8a 0 2024-01-17T23:37:33.841 INFO:tasks.workunit.client.0.smithi161.stdout:6/401: dread - d6/d7/dc/d85/d31/d5d/f46 zero size 2024-01-17T23:37:33.841 INFO:tasks.workunit.client.0.smithi161.stdout:6/402: fdatasync d6/d7/dc/f4f 0 2024-01-17T23:37:34.138 INFO:tasks.workunit.client.0.smithi161.stdout:1/449: mkdir d1/d8/d54/d94 0 2024-01-17T23:37:34.248 INFO:tasks.workunit.client.0.smithi161.stdout:2/391: link d8/l17 d8/d67/d6c/l8e 0 2024-01-17T23:37:34.284 INFO:tasks.workunit.client.0.smithi161.stdout:2/392: dwrite d8/da/d52/d34/d35/d3a/f88 [0,4194304] 0 2024-01-17T23:37:34.317 INFO:tasks.workunit.client.0.smithi161.stdout:2/393: dwrite d8/f54 [0,4194304] 0 2024-01-17T23:37:34.632 INFO:tasks.workunit.client.0.smithi161.stdout:3/423: mkdir d0/d5/d9/d1e/d5a/d8a 0 2024-01-17T23:37:34.661 INFO:tasks.workunit.client.0.smithi161.stdout:3/424: dwrite d0/d5/fa [0,4194304] 0 2024-01-17T23:37:34.874 INFO:tasks.workunit.client.0.smithi161.stdout:6/403: symlink d6/d7/dc/d85/d31/l8b 0 2024-01-17T23:37:34.963 INFO:tasks.workunit.client.0.smithi161.stdout:1/450: symlink d1/d20/d26/d30/d44/l95 0 2024-01-17T23:37:34.964 INFO:tasks.workunit.client.0.smithi161.stdout:1/451: fdatasync d1/d31/d4e/f74 0 2024-01-17T23:37:35.696 INFO:tasks.workunit.client.0.smithi161.stdout:2/394: rmdir d8/d1c 39 2024-01-17T23:37:35.727 INFO:tasks.workunit.client.0.smithi161.stdout:2/395: dwrite d8/f14 [4194304,4194304] 0 2024-01-17T23:37:35.746 INFO:tasks.workunit.client.0.smithi161.stdout:2/396: write d8/d1c/d1e/f38 [1540884,45444] 0 2024-01-17T23:37:35.746 INFO:tasks.workunit.client.0.smithi161.stdout:2/397: fsync d8/d68/f6d 0 2024-01-17T23:37:35.766 INFO:tasks.workunit.client.0.smithi161.stdout:2/398: dread d8/f54 [0,4194304] 0 2024-01-17T23:37:35.790 INFO:tasks.workunit.client.0.smithi161.stdout:2/399: dwrite d8/f4f [4194304,4194304] 0 2024-01-17T23:37:35.990 INFO:tasks.workunit.client.0.smithi161.stdout:6/404: link d6/d58/f82 d6/d7/dc/d3c/f8c 0 2024-01-17T23:37:35.990 INFO:tasks.workunit.client.0.smithi161.stdout:6/405: chown d6/d7/dc/d1d/f5e 20564 1 2024-01-17T23:37:36.160 INFO:tasks.workunit.client.0.smithi161.stdout:1/452: mknod d1/d20/d26/d30/d8f/c96 0 2024-01-17T23:37:36.161 INFO:tasks.workunit.client.0.smithi161.stdout:1/453: write d1/d2d/f7d [1420508,62863] 0 2024-01-17T23:37:36.193 INFO:tasks.workunit.client.0.smithi161.stdout:1/454: dwrite d1/d8/f5a [0,4194304] 0 2024-01-17T23:37:36.193 INFO:tasks.workunit.client.0.smithi161.stdout:1/455: chown d1/d8/d1f/f49 162222069 1 2024-01-17T23:37:36.193 INFO:tasks.workunit.client.0.smithi161.stdout:1/456: truncate d1/d8/d67/f93 1004005 0 2024-01-17T23:37:36.525 INFO:tasks.workunit.client.0.smithi161.stdout:8/369: sync 2024-01-17T23:37:36.859 INFO:tasks.workunit.client.0.smithi161.stdout:2/400: symlink d8/d67/d6c/l8f 0 2024-01-17T23:37:36.859 INFO:tasks.workunit.client.0.smithi161.stdout:2/401: truncate d8/d1c/d1e/d80/d79/f81 810584 0 2024-01-17T23:37:36.875 INFO:tasks.workunit.client.0.smithi161.stdout:7/444: write da/f2c [2757210,3843] 0 2024-01-17T23:37:37.112 INFO:tasks.workunit.client.0.smithi161.stdout:6/406: link d6/d58/f82 d6/d58/f8d 0 2024-01-17T23:37:37.113 INFO:tasks.workunit.client.0.smithi161.stdout:1/457: link d1/d8/d1c/f39 d1/d8/d1c/f97 0 2024-01-17T23:37:37.656 INFO:tasks.workunit.client.0.smithi161.stdout:2/402: unlink d8/d1c/d1e/l22 0 2024-01-17T23:37:38.353 INFO:tasks.workunit.client.0.smithi161.stdout:2/403: link d8/d67/d6c/d72/f7c d8/d68/f90 0 2024-01-17T23:37:38.353 INFO:tasks.workunit.client.0.smithi161.stdout:2/404: chown d8/d1c/d1e/d80/l64 0 1 2024-01-17T23:37:38.511 INFO:tasks.workunit.client.0.smithi161.stdout:2/405: symlink d8/d67/d6c/l91 0 2024-01-17T23:37:38.516 INFO:tasks.workunit.client.0.smithi161.stdout:2/406: dread d8/da/d52/d34/f69 [0,4194304] 0 2024-01-17T23:37:38.531 INFO:tasks.workunit.client.0.smithi161.stdout:2/407: dread d8/d68/f6d [0,4194304] 0 2024-01-17T23:37:38.970 INFO:tasks.workunit.client.0.smithi161.stdout:2/408: truncate d8/d1c/f31 2914462 0 2024-01-17T23:37:38.970 INFO:tasks.workunit.client.0.smithi161.stdout:4/462: write d9/de/f2b [688797,32989] 0 2024-01-17T23:37:38.973 INFO:tasks.workunit.client.0.smithi161.stdout:2/409: dread d8/d68/f7e [0,4194304] 0 2024-01-17T23:37:39.347 INFO:tasks.workunit.client.0.smithi161.stdout:5/410: rename dd/f48 to dd/d15/d1a/d5d/d64/f79 0 2024-01-17T23:37:39.356 INFO:tasks.workunit.client.0.smithi161.stdout:5/411: write dd/d15/d1a/f57 [753396,24508] 0 2024-01-17T23:37:39.369 INFO:tasks.workunit.client.0.smithi161.stdout:5/412: write dd/d15/f2e [2802256,92823] 0 2024-01-17T23:37:39.592 INFO:tasks.workunit.client.0.smithi161.stdout:2/410: symlink d8/da/d52/d34/l92 0 2024-01-17T23:37:39.724 INFO:tasks.workunit.client.0.smithi161.stdout:5/413: symlink dd/d31/d56/l7a 0 2024-01-17T23:37:39.724 INFO:tasks.workunit.client.0.smithi161.stdout:5/414: chown dd/d15/d1a/d5d/f65 273 1 2024-01-17T23:37:39.874 INFO:tasks.workunit.client.0.smithi161.stdout:0/463: rename d5/d34/d20/f5a to d5/d34/d12/d2a/d35/f8e 0 2024-01-17T23:37:40.132 INFO:tasks.workunit.client.0.smithi161.stdout:1/458: getdents d1/d20/d26/d30/d8f 0 2024-01-17T23:37:40.151 INFO:tasks.workunit.client.0.smithi161.stdout:6/407: rmdir d6/d58 39 2024-01-17T23:37:40.601 INFO:tasks.workunit.client.0.smithi161.stdout:0/464: symlink d5/d8/d68/d6b/d89/l8f 0 2024-01-17T23:37:40.601 INFO:tasks.workunit.client.0.smithi161.stdout:0/465: dread - d5/d8/f8b zero size 2024-01-17T23:37:40.618 INFO:tasks.workunit.client.0.smithi161.stdout:0/466: write d5/f32 [63527,112388] 0 2024-01-17T23:37:40.683 INFO:tasks.workunit.client.0.smithi161.stdout:1/459: creat d1/d85/f98 x:0 0 0 2024-01-17T23:37:40.717 INFO:tasks.workunit.client.0.smithi161.stdout:1/460: dwrite d1/d11/f12 [0,4194304] 0 2024-01-17T23:37:40.717 INFO:tasks.workunit.client.0.smithi161.stdout:1/461: chown d1/d8/d1c/c59 1186 1 2024-01-17T23:37:40.754 INFO:tasks.workunit.client.0.smithi161.stdout:1/462: dwrite d1/d85/f98 [0,4194304] 0 2024-01-17T23:37:40.754 INFO:tasks.workunit.client.0.smithi161.stdout:1/463: dread - d1/d31/d4e/f74 zero size 2024-01-17T23:37:40.754 INFO:tasks.workunit.client.0.smithi161.stdout:1/464: stat d1/d8/d1f/f25 0 2024-01-17T23:37:40.896 INFO:tasks.workunit.client.0.smithi161.stdout:6/408: mkdir d6/d7/dc/d85/d1a/d59/d8e 0 2024-01-17T23:37:41.019 INFO:tasks.workunit.client.0.smithi161.stdout:2/411: rename d8/f54 to d8/d1c/d57/f93 0 2024-01-17T23:37:41.019 INFO:tasks.workunit.client.0.smithi161.stdout:2/412: dread - d8/d1c/d57/f7f zero size 2024-01-17T23:37:41.127 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:37:41.131 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:37:41.166 INFO:tasks.workunit.client.0.smithi161.stdout:0/467: mkdir d5/d3a/d90 0 2024-01-17T23:37:41.491 INFO:tasks.workunit.client.0.smithi161.stdout:4/463: rmdir d9/d51 39 2024-01-17T23:37:41.548 INFO:tasks.workunit.client.0.smithi161.stdout:1/465: dread d1/d8/d1c/f7a [0,4194304] 0 2024-01-17T23:37:41.549 INFO:tasks.workunit.client.0.smithi161.stdout:1/466: creat d1/d8/d1f/d4b/f99 x:0 0 0 2024-01-17T23:37:41.923 INFO:tasks.workunit.client.0.smithi161.stdout:5/415: rename dd/d15/d4e/d52 to dd/d31/d7b 0 2024-01-17T23:37:41.923 INFO:tasks.workunit.client.0.smithi161.stdout:9/335: mknod d0/d39/c70 0 2024-01-17T23:37:41.957 INFO:tasks.workunit.client.0.smithi161.stdout:9/336: dwrite d0/d8/d14/d18/f55 [0,4194304] 0 2024-01-17T23:37:41.957 INFO:tasks.workunit.client.0.smithi161.stdout:9/337: chown d0/d8/f10 15093825 1 2024-01-17T23:37:41.957 INFO:tasks.workunit.client.0.smithi161.stdout:9/338: chown d0/d39/d49/c53 1628503 1 2024-01-17T23:37:41.957 INFO:tasks.workunit.client.0.smithi161.stdout:9/339: write d0/d8/d14/d18/d20/f45 [48459,22068] 0 2024-01-17T23:37:41.957 INFO:tasks.workunit.client.0.smithi161.stdout:9/340: readlink d0/d8/d14/d18/d20/l42 0 2024-01-17T23:37:41.989 INFO:tasks.workunit.client.0.smithi161.stdout:9/341: dwrite d0/d8/d14/f65 [0,4194304] 0 2024-01-17T23:37:41.997 INFO:tasks.workunit.client.0.smithi161.stdout:9/342: dread d0/f30 [0,4194304] 0 2024-01-17T23:37:41.997 INFO:tasks.workunit.client.0.smithi161.stdout:9/343: dread - d0/d8/d31/f68 zero size 2024-01-17T23:37:42.866 INFO:tasks.workunit.client.0.smithi161.stdout:5/416: truncate dd/d31/d3c/f4c 2597608 0 2024-01-17T23:37:42.866 INFO:tasks.workunit.client.0.smithi161.stdout:5/417: readlink dd/d15/d1a/l2b 0 2024-01-17T23:37:42.867 INFO:tasks.workunit.client.0.smithi161.stdout:9/344: unlink d0/d8/d14/f29 0 2024-01-17T23:37:42.869 INFO:tasks.workunit.client.0.smithi161.stdout:4/464: rmdir d9/de/d1e/d38/d6b 39 2024-01-17T23:37:43.419 INFO:tasks.workunit.client.0.smithi161.stdout:5/418: mkdir dd/d15/d1a/d5d/d64/d7c 0 2024-01-17T23:37:43.439 INFO:tasks.workunit.client.0.smithi161.stdout:5/419: write dd/d15/f23 [1263640,129490] 0 2024-01-17T23:37:43.678 INFO:tasks.workunit.client.0.smithi161.stdout:4/465: dread d9/de/d1e/d58/f72 [0,4194304] 0 2024-01-17T23:37:43.678 INFO:tasks.workunit.client.0.smithi161.stdout:4/466: chown d9/d1b/f3b 5633025 1 2024-01-17T23:37:43.929 INFO:tasks.workunit.client.0.smithi161.stdout:0/468: rename d5/d34/d12/f4f to d5/d34/d20/d2b/f91 0 2024-01-17T23:37:44.134 INFO:tasks.workunit.client.0.smithi161.stdout:5/420: unlink dd/d31/d3c/l3e 0 2024-01-17T23:37:44.192 INFO:tasks.workunit.client.0.smithi161.stdout:4/467: mknod d9/de/d1e/d58/d60/c83 0 2024-01-17T23:37:44.277 INFO:tasks.workunit.client.0.smithi161.stdout:0/469: symlink d5/d8/d68/l92 0 2024-01-17T23:37:44.277 INFO:tasks.workunit.client.0.smithi161.stdout:0/470: fsync d5/d34/d12/f66 0 2024-01-17T23:37:44.277 INFO:tasks.workunit.client.0.smithi161.stdout:0/471: chown d5/d3a/c5c 23869 1 2024-01-17T23:37:44.470 INFO:tasks.workunit.client.0.smithi161.stdout:5/421: mknod dd/d15/d51/c7d 0 2024-01-17T23:37:44.470 INFO:tasks.workunit.client.0.smithi161.stdout:5/422: read dd/d15/d1a/f43 [255215,111000] 0 2024-01-17T23:37:44.650 INFO:tasks.workunit.client.0.smithi161.stdout:4/468: creat d9/de/d1e/f84 x:0 0 0 2024-01-17T23:37:44.782 INFO:tasks.workunit.client.0.smithi161.stdout:0/472: mkdir d5/d34/d21/d76/d93 0 2024-01-17T23:37:44.782 INFO:tasks.workunit.client.0.smithi161.stdout:0/473: chown d5/d8/f29 44920 1 2024-01-17T23:37:44.783 INFO:tasks.workunit.client.0.smithi161.stdout:0/474: chown d5/d8/l10 4144 1 2024-01-17T23:37:44.783 INFO:tasks.workunit.client.0.smithi161.stdout:0/475: stat d5/d34/d20/f85 0 2024-01-17T23:37:44.804 INFO:tasks.workunit.client.0.smithi161.stdout:0/476: dread f0 [4194304,4194304] 0 2024-01-17T23:37:44.804 INFO:tasks.workunit.client.0.smithi161.stdout:0/477: creat d5/d34/d21/d76/f94 x:0 0 0 2024-01-17T23:37:44.948 INFO:tasks.workunit.client.0.smithi161.stdout:4/469: creat d9/d1b/d53/f85 x:0 0 0 2024-01-17T23:37:45.685 INFO:tasks.workunit.client.0.smithi161.stdout:9/345: dwrite d0/d8/d14/f65 [4194304,4194304] 0 2024-01-17T23:37:45.685 INFO:tasks.workunit.client.0.smithi161.stdout:9/346: fsync d0/d39/d49/f57 0 2024-01-17T23:37:45.686 INFO:tasks.workunit.client.0.smithi161.stdout:9/347: chown d0/d8/f66 15 1 2024-01-17T23:37:45.686 INFO:tasks.workunit.client.0.smithi161.stdout:9/348: dread - d0/d8/d31/f4d zero size 2024-01-17T23:37:45.686 INFO:tasks.workunit.client.0.smithi161.stdout:9/349: creat d0/d8/d31/f71 x:0 0 0 2024-01-17T23:37:45.686 INFO:tasks.workunit.client.0.smithi161.stdout:9/350: write d0/d8/f66 [585183,105274] 0 2024-01-17T23:37:45.694 INFO:tasks.workunit.client.0.smithi161.stdout:9/351: dread d0/d8/d14/d18/d20/f45 [0,4194304] 0 2024-01-17T23:37:45.694 INFO:tasks.workunit.client.0.smithi161.stdout:9/352: chown d0/d8/d14/l3c 1105 1 2024-01-17T23:37:45.694 INFO:tasks.workunit.client.0.smithi161.stdout:9/353: write d0/d39/f59 [1335614,18596] 0 2024-01-17T23:37:45.779 INFO:tasks.workunit.client.0.smithi161.stdout:3/425: mkdir d0/d5/d9/d8b 0 2024-01-17T23:37:45.804 INFO:tasks.workunit.client.0.smithi161.stdout:3/426: dwrite d0/d5/d9/d1e/d3b/d52/f67 [0,4194304] 0 2024-01-17T23:37:46.218 INFO:tasks.workunit.client.0.smithi161.stdout:4/470: mknod d9/d1b/d52/c86 0 2024-01-17T23:37:46.258 INFO:tasks.workunit.client.0.smithi161.stdout:4/471: dwrite d9/f10 [0,4194304] 0 2024-01-17T23:37:46.287 INFO:tasks.workunit.client.0.smithi161.stdout:4/472: dwrite d9/d1b/d24/f75 [0,4194304] 0 2024-01-17T23:37:47.517 INFO:tasks.workunit.client.0.smithi161.stdout:5/423: write dd/d15/d1a/d42/f58 [1452058,69817] 0 2024-01-17T23:37:47.517 INFO:tasks.workunit.client.0.smithi161.stdout:5/424: chown l2 116539789 1 2024-01-17T23:37:47.517 INFO:tasks.workunit.client.0.smithi161.stdout:5/425: dread - dd/d31/d3c/f60 zero size 2024-01-17T23:37:47.611 INFO:tasks.workunit.client.0.smithi161.stdout:4/473: mkdir d9/d27/d3a/d87 0 2024-01-17T23:37:47.769 INFO:tasks.workunit.client.0.smithi161.stdout:5/426: creat dd/d31/d7b/d78/f7e x:0 0 0 2024-01-17T23:37:47.769 INFO:tasks.workunit.client.0.smithi161.stdout:5/427: fdatasync dd/f24 0 2024-01-17T23:37:47.868 INFO:tasks.workunit.client.0.smithi161.stdout:7/445: sync 2024-01-17T23:37:47.868 INFO:tasks.workunit.client.0.smithi161.stdout:8/370: sync 2024-01-17T23:37:47.889 INFO:tasks.workunit.client.0.smithi161.stdout:8/371: write d1/d22/f48 [2479365,39206] 0 2024-01-17T23:37:47.891 INFO:tasks.workunit.client.0.smithi161.stdout:7/446: write da/d34/d5a/d28/d2b/f45 [421171,34328] 0 2024-01-17T23:37:47.891 INFO:tasks.workunit.client.0.smithi161.stdout:7/447: dread - da/d34/d5a/d3b/f61 zero size 2024-01-17T23:37:47.981 INFO:tasks.workunit.client.0.smithi161.stdout:6/409: mknod d6/d7/dc/d85/c8f 0 2024-01-17T23:37:48.295 INFO:tasks.workunit.client.0.smithi161.stdout:8/372: link d1/d22/d2f/c33 d1/df/d13/c7d 0 2024-01-17T23:37:48.496 INFO:tasks.workunit.client.0.smithi161.stdout:7/448: dread - da/f6c zero size 2024-01-17T23:37:48.604 INFO:tasks.workunit.client.0.smithi161.stdout:5/428: link dd/d31/d3c/f60 dd/d31/d7b/f7f 0 2024-01-17T23:37:48.865 INFO:tasks.workunit.client.0.smithi161.stdout:6/410: mkdir d6/d7/dc/d43/d76/d90 0 2024-01-17T23:37:48.865 INFO:tasks.workunit.client.0.smithi161.stdout:6/411: dread - d6/d7/dc/d85/d1a/f3e zero size 2024-01-17T23:37:48.886 INFO:tasks.workunit.client.0.smithi161.stdout:5/429: mkdir dd/d15/d6a/d80 0 2024-01-17T23:37:48.931 INFO:tasks.workunit.client.0.smithi161.stdout:0/478: dwrite d5/d34/d12/f37 [0,4194304] 0 2024-01-17T23:37:48.931 INFO:tasks.workunit.client.0.smithi161.stdout:0/479: write d5/d34/d21/f3b [857104,126426] 0 2024-01-17T23:37:49.171 INFO:tasks.workunit.client.0.smithi161.stdout:6/412: truncate d6/d7/dc/f5b 4868875 0 2024-01-17T23:37:49.189 INFO:tasks.workunit.client.0.smithi161.stdout:6/413: read d6/d7/dc/d85/d31/d5d/f36 [98219,75047] 0 2024-01-17T23:37:49.209 INFO:tasks.workunit.client.0.smithi161.stdout:6/414: dread d6/d7/dc/d85/d13/f6f [0,4194304] 0 2024-01-17T23:37:49.711 INFO:tasks.workunit.client.0.smithi161.stdout:6/415: rename d6/d7/dc/d85/d31/c7e to d6/d7/dc/d85/d31/c91 0 2024-01-17T23:37:49.712 INFO:tasks.workunit.client.0.smithi161.stdout:2/413: symlink d8/l94 0 2024-01-17T23:37:49.752 INFO:tasks.workunit.client.0.smithi161.stdout:3/427: dwrite d0/f12 [4194304,4194304] 0 2024-01-17T23:37:49.755 INFO:tasks.workunit.client.0.smithi161.stdout:6/416: dwrite d6/d7/dc/f4f [0,4194304] 0 2024-01-17T23:37:49.755 INFO:tasks.workunit.client.0.smithi161.stdout:6/417: write d6/d7/dc/d85/d13/f6e [72778,86587] 0 2024-01-17T23:37:49.852 INFO:tasks.workunit.client.0.smithi161.stdout:2/414: dread d8/d1c/d1e/d80/d79/f81 [0,4194304] 0 2024-01-17T23:37:49.852 INFO:tasks.workunit.client.0.smithi161.stdout:2/415: creat d8/d2e/f95 x:0 0 0 2024-01-17T23:37:50.036 INFO:tasks.workunit.client.0.smithi161.stdout:3/428: mknod d0/d5/d9/c8c 0 2024-01-17T23:37:50.261 INFO:tasks.workunit.client.0.smithi161.stdout:6/418: dread d6/d7/dc/d85/d1a/d59/f83 [0,4194304] 0 2024-01-17T23:37:50.289 INFO:tasks.workunit.client.0.smithi161.stdout:6/419: dwrite d6/d7/dc/d85/f6c [0,4194304] 0 2024-01-17T23:37:50.388 INFO:tasks.workunit.client.0.smithi161.stdout:2/416: creat d8/d67/d6c/d72/f96 x:0 0 0 2024-01-17T23:37:50.400 INFO:tasks.workunit.client.0.smithi161.stdout:2/417: dread d8/da/d52/f6b [0,4194304] 0 2024-01-17T23:37:50.430 INFO:tasks.workunit.client.0.smithi161.stdout:4/474: dwrite d9/de/f30 [0,4194304] 0 2024-01-17T23:37:50.430 INFO:tasks.workunit.client.0.smithi161.stdout:2/418: dwrite d8/d67/d6c/d72/f96 [0,4194304] 0 2024-01-17T23:37:50.430 INFO:tasks.workunit.client.0.smithi161.stdout:2/419: readlink d8/l17 0 2024-01-17T23:37:50.430 INFO:tasks.workunit.client.0.smithi161.stdout:4/475: stat d9/d1b/d52/f59 0 2024-01-17T23:37:50.430 INFO:tasks.workunit.client.0.smithi161.stdout:2/420: fsync d8/d4b/f85 0 2024-01-17T23:37:50.452 INFO:tasks.workunit.client.0.smithi161.stdout:4/476: dread d9/de/d1e/d38/f49 [0,4194304] 0 2024-01-17T23:37:50.466 INFO:tasks.workunit.client.0.smithi161.stdout:2/421: dwrite d8/d1c/d1e/f44 [0,4194304] 0 2024-01-17T23:37:50.485 INFO:tasks.workunit.client.0.smithi161.stdout:2/422: dread d8/d1c/f1f [4194304,4194304] 0 2024-01-17T23:37:50.522 INFO:tasks.workunit.client.0.smithi161.stdout:1/467: sync 2024-01-17T23:37:50.522 INFO:tasks.workunit.client.0.smithi161.stdout:3/429: mknod d0/d5/d9/d8b/c8d 0 2024-01-17T23:37:50.940 INFO:tasks.workunit.client.0.smithi161.stdout:6/420: creat d6/d7/dc/d85/d31/f92 x:0 0 0 2024-01-17T23:37:51.929 INFO:tasks.workunit.client.0.smithi161.stdout:8/373: dwrite d1/d3/d19/d1d/d25/d4b/f63 [0,4194304] 0 2024-01-17T23:37:51.929 INFO:tasks.workunit.client.0.smithi161.stdout:8/374: write d1/d3/d19/d1d/d25/f3b [3805831,107249] 0 2024-01-17T23:37:52.013 INFO:tasks.workunit.client.0.smithi161.stdout:1/468: unlink d1/d8/d1f/d4b/f7b 0 2024-01-17T23:37:52.013 INFO:tasks.workunit.client.0.smithi161.stdout:1/469: fdatasync d1/d20/d26/d30/d44/f88 0 2024-01-17T23:37:52.221 INFO:tasks.workunit.client.0.smithi161.stdout:6/421: creat d6/d7/dc/d43/d76/d90/f93 x:0 0 0 2024-01-17T23:37:52.221 INFO:tasks.workunit.client.0.smithi161.stdout:6/422: creat d6/d7/dc/d43/f94 x:0 0 0 2024-01-17T23:37:52.221 INFO:tasks.workunit.client.0.smithi161.stdout:6/423: fdatasync d6/d7/dc/d85/d1a/f62 0 2024-01-17T23:37:52.244 INFO:tasks.workunit.client.0.smithi161.stdout:7/449: dwrite da/d34/d4a/d4c/f6e [0,4194304] 0 2024-01-17T23:37:52.244 INFO:tasks.workunit.client.0.smithi161.stdout:7/450: read da/d34/d5a/d3b/f4b [2989376,82617] 0 2024-01-17T23:37:52.244 INFO:tasks.workunit.client.0.smithi161.stdout:7/451: chown da/d34/d5a/d28/f3e 33535673 1 2024-01-17T23:37:52.458 INFO:tasks.workunit.client.0.smithi161.stdout:4/477: rename d9/de/d1e/l5d to d9/d1b/d24/l88 0 2024-01-17T23:37:52.458 INFO:tasks.workunit.client.0.smithi161.stdout:4/478: truncate d9/de/d1e/f32 5157583 0 2024-01-17T23:37:52.458 INFO:tasks.workunit.client.0.smithi161.stdout:4/479: stat d9/de/d1e/f32 0 2024-01-17T23:37:52.889 INFO:tasks.workunit.client.0.smithi161.stdout:5/430: unlink dd/f55 0 2024-01-17T23:37:52.889 INFO:tasks.workunit.client.0.smithi161.stdout:8/375: mknod d1/d22/c7e 0 2024-01-17T23:37:52.917 INFO:tasks.workunit.client.0.smithi161.stdout:8/376: dwrite d1/df/d20/d6a/f6d [0,4194304] 0 2024-01-17T23:37:53.054 INFO:tasks.workunit.client.0.smithi161.stdout:1/470: creat d1/d20/d26/d30/d8f/f9a x:0 0 0 2024-01-17T23:37:53.125 INFO:tasks.workunit.client.0.smithi161.stdout:9/354: sync 2024-01-17T23:37:53.391 INFO:tasks.workunit.client.0.smithi161.stdout:6/424: creat d6/d7/dc/d1d/f95 x:0 0 0 2024-01-17T23:37:53.813 INFO:tasks.workunit.client.0.smithi161.stdout:7/452: creat da/d34/d5a/d3b/d3d/d82/f99 x:0 0 0 2024-01-17T23:37:53.813 INFO:tasks.workunit.client.0.smithi161.stdout:7/453: write da/d34/d69/f7c [202051,84140] 0 2024-01-17T23:37:53.900 INFO:tasks.workunit.client.0.smithi161.stdout:4/480: mkdir d9/de/d1e/d38/d89 0 2024-01-17T23:37:53.964 INFO:tasks.workunit.client.0.smithi161.stdout:5/431: dread dd/d15/f19 [0,4194304] 0 2024-01-17T23:37:54.164 INFO:tasks.workunit.client.0.smithi161.stdout:8/377: mknod d1/c7f 0 2024-01-17T23:37:54.164 INFO:tasks.workunit.client.0.smithi161.stdout:8/378: chown d1/df/d20 18066334 1 2024-01-17T23:37:54.275 INFO:tasks.workunit.client.0.smithi161.stdout:1/471: unlink d1/d20/d26/d30/l5e 0 2024-01-17T23:37:54.433 INFO:tasks.workunit.client.0.smithi161.stdout:9/355: rename d0/d8/d14/c40 to d0/d8/d14/c72 0 2024-01-17T23:37:54.433 INFO:tasks.workunit.client.0.smithi161.stdout:9/356: fdatasync d0/d8/f48 0 2024-01-17T23:37:54.434 INFO:tasks.workunit.client.0.smithi161.stdout:9/357: fdatasync d0/d8/d14/d18/d20/f45 0 2024-01-17T23:37:54.434 INFO:tasks.workunit.client.0.smithi161.stdout:9/358: fsync d0/d8/f5f 0 2024-01-17T23:37:54.507 INFO:tasks.workunit.client.0.smithi161.stdout:0/480: rmdir d5/d34/d12 39 2024-01-17T23:37:54.610 INFO:tasks.workunit.client.0.smithi161.stdout:6/425: dread d6/d7/dc/d85/d31/f4e [0,4194304] 0 2024-01-17T23:37:54.623 INFO:tasks.workunit.client.0.smithi161.stdout:6/426: dread d6/d7/dc/d85/d31/d5d/f18 [0,4194304] 0 2024-01-17T23:37:54.623 INFO:tasks.workunit.client.0.smithi161.stdout:6/427: write d6/f7c [948766,89717] 0 2024-01-17T23:37:54.623 INFO:tasks.workunit.client.0.smithi161.stdout:6/428: write d6/fa [4999923,103429] 0 2024-01-17T23:37:54.675 INFO:tasks.workunit.client.0.smithi161.stdout:7/454: symlink da/d34/d5a/d3b/d3d/l9a 0 2024-01-17T23:37:54.699 INFO:tasks.workunit.client.0.smithi161.stdout:7/455: dwrite da/d34/d5a/f75 [0,4194304] 0 2024-01-17T23:37:54.959 INFO:tasks.workunit.client.0.smithi161.stdout:5/432: rmdir dd/d31/d7b 39 2024-01-17T23:37:54.959 INFO:tasks.workunit.client.0.smithi161.stdout:4/481: creat d9/de/d69/f8a x:0 0 0 2024-01-17T23:37:54.978 INFO:tasks.workunit.client.0.smithi161.stdout:4/482: read d9/f31 [157370,57057] 0 2024-01-17T23:37:55.609 INFO:tasks.workunit.client.0.smithi161.stdout:9/359: mkdir d0/d8/d31/d73 0 2024-01-17T23:37:56.696 INFO:tasks.workunit.client.0.smithi161.stdout:5/433: getdents dd/d31/d3c 0 2024-01-17T23:37:56.708 INFO:tasks.workunit.client.0.smithi161.stdout:2/423: sync 2024-01-17T23:37:56.734 INFO:tasks.workunit.client.0.smithi161.stdout:2/424: dwrite d8/d1c/d57/f73 [0,4194304] 0 2024-01-17T23:37:56.762 INFO:tasks.workunit.client.0.smithi161.stdout:2/425: dwrite d8/da/f58 [0,4194304] 0 2024-01-17T23:37:56.781 INFO:tasks.workunit.client.0.smithi161.stdout:2/426: write d8/d67/d6c/d72/f96 [2447429,120861] 0 2024-01-17T23:37:56.811 INFO:tasks.workunit.client.0.smithi161.stdout:2/427: dwrite d8/d1c/d57/f7f [0,4194304] 0 2024-01-17T23:37:56.835 INFO:tasks.workunit.client.0.smithi161.stdout:2/428: read d8/d1c/d57/f73 [2144755,125611] 0 2024-01-17T23:37:57.670 INFO:tasks.workunit.client.0.smithi161.stdout:2/429: unlink d8/d1c/d57/f93 0 2024-01-17T23:37:58.001 INFO:tasks.workunit.client.0.smithi161.stdout:2/430: creat d8/da/d8d/f97 x:0 0 0 2024-01-17T23:37:58.021 INFO:tasks.workunit.client.0.smithi161.stdout:2/431: dread d8/d1c/d1e/f38 [0,4194304] 0 2024-01-17T23:37:58.021 INFO:tasks.workunit.client.0.smithi161.stdout:2/432: chown d8/d67 260251 1 2024-01-17T23:37:58.169 INFO:tasks.workunit.client.0.smithi161.stdout:8/379: truncate d1/d3/d19/d1d/d25/f3b 878212 0 2024-01-17T23:37:58.414 INFO:tasks.workunit.client.0.smithi161.stdout:2/433: mknod d8/d4b/c98 0 2024-01-17T23:37:58.414 INFO:tasks.workunit.client.0.smithi161.stdout:2/434: chown d8/d1c/f25 3 1 2024-01-17T23:37:58.418 INFO:tasks.workunit.client.0.smithi161.stdout:2/435: dread d8/da/d52/d34/f69 [0,4194304] 0 2024-01-17T23:37:58.627 INFO:tasks.workunit.client.0.smithi161.stdout:8/380: mknod d1/d3d/d51/c80 0 2024-01-17T23:37:58.727 INFO:tasks.workunit.client.0.smithi161.stdout:4/483: write d9/de/f19 [796344,1574] 0 2024-01-17T23:37:59.570 INFO:tasks.workunit.client.0.smithi161.stdout:8/381: mknod d1/df/d20/d6a/c81 0 2024-01-17T23:37:59.570 INFO:tasks.workunit.client.0.smithi161.stdout:5/434: rmdir dd/d31/d3c 39 2024-01-17T23:37:59.570 INFO:tasks.workunit.client.0.smithi161.stdout:4/484: write d9/d1b/d24/f43 [4449491,105850] 0 2024-01-17T23:37:59.584 INFO:tasks.workunit.client.0.smithi161.stdout:5/435: dread dd/d15/f2e [0,4194304] 0 2024-01-17T23:37:59.623 INFO:tasks.workunit.client.0.smithi161.stdout:8/382: dwrite d1/df/d20/d2a/f34 [4194304,4194304] 0 2024-01-17T23:37:59.623 INFO:tasks.workunit.client.0.smithi161.stdout:5/436: dwrite dd/d15/f23 [4194304,4194304] 0 2024-01-17T23:37:59.627 INFO:tasks.workunit.client.0.smithi161.stdout:4/485: dwrite d9/d27/f6c [4194304,4194304] 0 2024-01-17T23:37:59.627 INFO:tasks.workunit.client.0.smithi161.stdout:4/486: readlink d9/d1b/d53/l55 0 2024-01-17T23:37:59.627 INFO:tasks.workunit.client.0.smithi161.stdout:4/487: write d9/de/d1e/f40 [784570,75468] 0 2024-01-17T23:37:59.643 INFO:tasks.workunit.client.0.smithi161.stdout:9/360: dwrite d0/d8/d14/d18/d63/f6a [8388608,4194304] 0 2024-01-17T23:37:59.661 INFO:tasks.workunit.client.0.smithi161.stdout:3/430: rename d0/d5/f57 to d0/d5/d9/d17/d32/f8e 0 2024-01-17T23:37:59.662 INFO:tasks.workunit.client.0.smithi161.stdout:9/361: dread d0/d8/d14/d18/d63/f6a [8388608,4194304] 0 2024-01-17T23:37:59.672 INFO:tasks.workunit.client.0.smithi161.stdout:9/362: dread d0/d8/d31/f52 [0,4194304] 0 2024-01-17T23:37:59.672 INFO:tasks.workunit.client.0.smithi161.stdout:9/363: write d0/d8/d31/f4d [380506,48477] 0 2024-01-17T23:38:00.070 INFO:tasks.workunit.client.0.smithi161.stdout:8/383: creat d1/d3/d19/d1d/f82 x:0 0 0 2024-01-17T23:38:00.070 INFO:tasks.workunit.client.0.smithi161.stdout:4/488: mkdir d9/d27/d3a/d8b 0 2024-01-17T23:38:00.070 INFO:tasks.workunit.client.0.smithi161.stdout:8/384: read - d1/d3/d19/d1d/d25/d4b/f6b zero size 2024-01-17T23:38:00.181 INFO:tasks.workunit.client.0.smithi161.stdout:0/481: rename d5/d8/d68/l92 to d5/d8/l95 0 2024-01-17T23:38:00.182 INFO:tasks.workunit.client.0.smithi161.stdout:0/482: write d5/d34/d12/d2a/f7a [969222,45989] 0 2024-01-17T23:38:00.182 INFO:tasks.workunit.client.0.smithi161.stdout:0/483: readlink d5/d34/d20/l5f 0 2024-01-17T23:38:00.301 INFO:tasks.workunit.client.0.smithi161.stdout:3/431: symlink d0/d5/d9/d38/d4f/d50/l8f 0 2024-01-17T23:38:00.408 INFO:tasks.workunit.client.0.smithi161.stdout:9/364: unlink d0/d8/d14/d18/d63/l67 0 2024-01-17T23:38:00.891 INFO:tasks.workunit.client.0.smithi161.stdout:4/489: creat d9/d1b/d24/d25/d5b/f8c x:0 0 0 2024-01-17T23:38:01.046 INFO:tasks.workunit.client.0.smithi161.stdout:6/429: rename d6/d7/dc/d1d/c50 to d6/d7/dc/d3c/d81/c96 0 2024-01-17T23:38:01.137 INFO:tasks.workunit.client.0.smithi161.stdout:0/484: unlink d5/d34/d12/f66 0 2024-01-17T23:38:01.255 INFO:tasks.workunit.client.0.smithi161.stdout:3/432: mknod d0/d5/d9/d17/d2d/c90 0 2024-01-17T23:38:01.257 INFO:tasks.workunit.client.0.smithi161.stdout:1/472: sync 2024-01-17T23:38:01.257 INFO:tasks.workunit.client.0.smithi161.stdout:2/436: sync 2024-01-17T23:38:01.257 INFO:tasks.workunit.client.0.smithi161.stdout:2/437: read d8/da/f27 [2221472,19066] 0 2024-01-17T23:38:01.666 INFO:tasks.workunit.client.0.smithi161.stdout:4/490: link d9/d1b/d53/l6f d9/de/d1e/d58/l8d 0 2024-01-17T23:38:01.787 INFO:tasks.workunit.client.0.smithi161.stdout:8/385: rmdir d1/df/d13 39 2024-01-17T23:38:01.882 INFO:tasks.workunit.client.0.smithi161.stdout:7/456: rename da/d14/d35/l90 to da/db/d7a/l9b 0 2024-01-17T23:38:01.882 INFO:tasks.workunit.client.0.smithi161.stdout:7/457: truncate da/d34/f52 624714 0 2024-01-17T23:38:01.904 INFO:tasks.workunit.client.0.smithi161.stdout:7/458: write da/d34/d5a/d3b/f6d [2121529,80848] 0 2024-01-17T23:38:02.060 INFO:tasks.workunit.client.0.smithi161.stdout:6/430: truncate d6/f3d 602482 0 2024-01-17T23:38:02.060 INFO:tasks.workunit.client.0.smithi161.stdout:6/431: stat d6/d7/dc/d43/d79/f8a 0 2024-01-17T23:38:02.061 INFO:tasks.workunit.client.0.smithi161.stdout:6/432: dread - d6/d58/f87 zero size 2024-01-17T23:38:02.061 INFO:tasks.workunit.client.0.smithi161.stdout:0/485: mkdir d5/d2e/d96 0 2024-01-17T23:38:02.086 INFO:tasks.workunit.client.0.smithi161.stdout:0/486: dwrite d5/d34/d20/d2b/d64/f6c [0,4194304] 0 2024-01-17T23:38:02.220 INFO:tasks.workunit.client.0.smithi161.stdout:1/473: link d1/d11/c66 d1/d8/d67/c9b 0 2024-01-17T23:38:02.347 INFO:tasks.workunit.client.0.smithi161.stdout:2/438: getdents d8/da 0 2024-01-17T23:38:02.724 INFO:tasks.workunit.client.0.smithi161.stdout:4/491: creat d9/d1b/f8e x:0 0 0 2024-01-17T23:38:02.724 INFO:tasks.workunit.client.0.smithi161.stdout:4/492: chown d9/d1b/d24/d25 0 1 2024-01-17T23:38:02.755 INFO:tasks.workunit.client.0.smithi161.stdout:4/493: dwrite d9/de/d1e/f40 [0,4194304] 0 2024-01-17T23:38:02.755 INFO:tasks.workunit.client.0.smithi161.stdout:4/494: dread - d9/de/d1e/d38/d6b/f76 zero size 2024-01-17T23:38:02.755 INFO:tasks.workunit.client.0.smithi161.stdout:4/495: readlink d9/l18 0 2024-01-17T23:38:02.845 INFO:tasks.workunit.client.0.smithi161.stdout:8/386: unlink d1/c7 0 2024-01-17T23:38:02.878 INFO:tasks.workunit.client.0.smithi161.stdout:8/387: dwrite d1/df/f14 [0,4194304] 0 2024-01-17T23:38:02.878 INFO:tasks.workunit.client.0.smithi161.stdout:8/388: creat d1/d3/d19/d1d/f83 x:0 0 0 2024-01-17T23:38:03.486 INFO:tasks.workunit.client.0.smithi161.stdout:5/437: rename l2 to dd/d15/d1a/d42/l81 0 2024-01-17T23:38:03.486 INFO:tasks.workunit.client.0.smithi161.stdout:5/438: truncate dd/d15/d1a/d42/f58 1587282 0 2024-01-17T23:38:03.902 INFO:tasks.workunit.client.0.smithi161.stdout:7/459: rmdir da/d34/d5a/d28/d43 39 2024-01-17T23:38:04.355 INFO:tasks.workunit.client.0.smithi161.stdout:0/487: mkdir d5/d34/d21/d97 0 2024-01-17T23:38:04.378 INFO:tasks.workunit.client.0.smithi161.stdout:0/488: write d5/d34/d20/f81 [2048412,114384] 0 2024-01-17T23:38:04.538 INFO:tasks.workunit.client.0.smithi161.stdout:1/474: truncate d1/d8/d1f/f49 1545083 0 2024-01-17T23:38:04.915 INFO:tasks.workunit.client.0.smithi161.stdout:4/496: mkdir d9/de/d1e/d58/d60/d8f 0 2024-01-17T23:38:05.162 INFO:tasks.workunit.client.0.smithi161.stdout:8/389: symlink d1/df/d46/l84 0 2024-01-17T23:38:05.191 INFO:tasks.workunit.client.0.smithi161.stdout:8/390: dwrite d1/d3d/f41 [0,4194304] 0 2024-01-17T23:38:05.298 INFO:tasks.workunit.client.0.smithi161.stdout:9/365: rename d0/d8/f48 to d0/d8/d14/d56/f74 0 2024-01-17T23:38:05.329 INFO:tasks.workunit.client.0.smithi161.stdout:3/433: dwrite d0/d5/f19 [0,4194304] 0 2024-01-17T23:38:05.329 INFO:tasks.workunit.client.0.smithi161.stdout:3/434: write d0/d5/f81 [288006,101524] 0 2024-01-17T23:38:05.329 INFO:tasks.workunit.client.0.smithi161.stdout:3/435: truncate d0/f1f 4870480 0 2024-01-17T23:38:05.364 INFO:tasks.workunit.client.0.smithi161.stdout:3/436: dwrite d0/d5/f81 [0,4194304] 0 2024-01-17T23:38:05.484 INFO:tasks.workunit.client.0.smithi161.stdout:5/439: mknod dd/d15/d1a/c82 0 2024-01-17T23:38:06.224 INFO:tasks.workunit.client.0.smithi161.stdout:0/489: creat d5/d2e/d96/f98 x:0 0 0 2024-01-17T23:38:06.225 INFO:tasks.workunit.client.0.smithi161.stdout:0/490: chown d5/d34/d20/d2b/d64/d88 156 1 2024-01-17T23:38:06.225 INFO:tasks.workunit.client.0.smithi161.stdout:0/491: read - d5/d2e/d96/f98 zero size 2024-01-17T23:38:06.414 INFO:tasks.workunit.client.0.smithi161.stdout:1/475: creat d1/d20/d26/d30/d41/f9c x:0 0 0 2024-01-17T23:38:06.441 INFO:tasks.workunit.client.0.smithi161.stdout:1/476: dwrite d1/ff [4194304,4194304] 0 2024-01-17T23:38:06.511 INFO:tasks.workunit.client.0.smithi161.stdout:4/497: mkdir d9/d27/d3a/d8b/d90 0 2024-01-17T23:38:06.511 INFO:tasks.workunit.client.0.smithi161.stdout:4/498: read d9/de/d1e/d58/f72 [443890,36358] 0 2024-01-17T23:38:06.511 INFO:tasks.workunit.client.0.smithi161.stdout:4/499: dread - d9/d1b/f3b zero size 2024-01-17T23:38:06.511 INFO:tasks.workunit.client.0.smithi161.stdout:4/500: write d9/ff [4065009,47274] 0 2024-01-17T23:38:06.529 INFO:tasks.workunit.client.0.smithi161.stdout:4/501: dread d9/d1b/d24/f75 [0,4194304] 0 2024-01-17T23:38:06.529 INFO:tasks.workunit.client.0.smithi161.stdout:4/502: chown d9/de/c4b 24146669 1 2024-01-17T23:38:06.529 INFO:tasks.workunit.client.0.smithi161.stdout:4/503: write d9/ff [4965901,684] 0 2024-01-17T23:38:06.955 INFO:tasks.workunit.client.0.smithi161.stdout:8/391: rmdir d1/d3/d37 0 2024-01-17T23:38:06.977 INFO:tasks.workunit.client.0.smithi161.stdout:8/392: dread d1/d3/d19/f21 [0,4194304] 0 2024-01-17T23:38:06.994 INFO:tasks.workunit.client.0.smithi161.stdout:8/393: write d1/d3/d19/d1d/f27 [2059780,98233] 0 2024-01-17T23:38:07.008 INFO:tasks.workunit.client.0.smithi161.stdout:8/394: dread d1/d3d/f41 [0,4194304] 0 2024-01-17T23:38:07.182 INFO:tasks.workunit.client.0.smithi161.stdout:6/433: rename d6/d7/dc/d85/d13/f35 to d6/d7/dc/d85/d31/f97 0 2024-01-17T23:38:07.360 INFO:tasks.workunit.client.0.smithi161.stdout:9/366: symlink d0/d8/d31/d58/l75 0 2024-01-17T23:38:07.381 INFO:tasks.workunit.client.0.smithi161.stdout:9/367: write d0/d39/d49/f57 [194763,93478] 0 2024-01-17T23:38:07.381 INFO:tasks.workunit.client.0.smithi161.stdout:9/368: fdatasync d0/d8/f10 0 2024-01-17T23:38:07.670 INFO:tasks.workunit.client.0.smithi161.stdout:5/440: mknod dd/d15/d1a/c83 0 2024-01-17T23:38:07.670 INFO:tasks.workunit.client.0.smithi161.stdout:5/441: write dd/d15/d1a/f57 [1250893,473] 0 2024-01-17T23:38:07.670 INFO:tasks.workunit.client.0.smithi161.stdout:5/442: readlink dd/d15/l72 0 2024-01-17T23:38:07.670 INFO:tasks.workunit.client.0.smithi161.stdout:5/443: truncate dd/f11 2021115 0 2024-01-17T23:38:07.719 INFO:tasks.workunit.client.0.smithi161.stdout:7/460: rmdir da/d34/d5a/d28/d2b 39 2024-01-17T23:38:07.719 INFO:tasks.workunit.client.0.smithi161.stdout:7/461: fdatasync da/d34/d4a/d4c/f6e 0 2024-01-17T23:38:07.809 INFO:tasks.workunit.client.0.smithi161.stdout:0/492: fsync d5/d34/d12/d2a/f7a 0 2024-01-17T23:38:07.809 INFO:tasks.workunit.client.0.smithi161.stdout:0/493: dread - d5/d3a/d49/f70 zero size 2024-01-17T23:38:07.809 INFO:tasks.workunit.client.0.smithi161.stdout:0/494: stat d5/d8/d68/d6b/l74 0 2024-01-17T23:38:07.828 INFO:tasks.workunit.client.0.smithi161.stdout:0/495: dread d5/d34/f45 [4194304,4194304] 0 2024-01-17T23:38:07.828 INFO:tasks.workunit.client.0.smithi161.stdout:0/496: fdatasync d5/d34/d12/d2a/d35/f8e 0 2024-01-17T23:38:08.125 INFO:tasks.workunit.client.0.smithi161.stdout:4/504: creat d9/de/f91 x:0 0 0 2024-01-17T23:38:08.189 INFO:tasks.workunit.client.0.smithi161.stdout:2/439: write d8/f6a [1163591,125551] 0 2024-01-17T23:38:08.189 INFO:tasks.workunit.client.0.smithi161.stdout:2/440: fdatasync d8/da/f58 0 2024-01-17T23:38:08.209 INFO:tasks.workunit.client.0.smithi161.stdout:2/441: write d8/d1c/d1e/f44 [1939136,3273] 0 2024-01-17T23:38:08.209 INFO:tasks.workunit.client.0.smithi161.stdout:2/442: chown d8/d67/d6c/d72 431132 1 2024-01-17T23:38:08.236 INFO:tasks.workunit.client.0.smithi161.stdout:2/443: dwrite d8/d2e/f95 [0,4194304] 0 2024-01-17T23:38:08.281 INFO:tasks.workunit.client.0.smithi161.stdout:2/444: dwrite d8/da/d52/d34/d35/d3a/f82 [0,4194304] 0 2024-01-17T23:38:08.281 INFO:tasks.workunit.client.0.smithi161.stdout:2/445: write d8/da/d52/f51 [1656711,37167] 0 2024-01-17T23:38:09.790 INFO:tasks.workunit.client.0.smithi161.stdout:3/437: rename d0/d5/d9/d1e/f39 to d0/d5/d9/d8b/f91 0 2024-01-17T23:38:09.790 INFO:tasks.workunit.client.0.smithi161.stdout:3/438: write d0/d5/d9/d1e/d3b/d52/f67 [4398931,27382] 0 2024-01-17T23:38:09.923 INFO:tasks.workunit.client.0.smithi161.stdout:6/434: creat d6/d7/dc/d85/f98 x:0 0 0 2024-01-17T23:38:10.295 INFO:tasks.workunit.client.0.smithi161.stdout:5/444: creat dd/d31/d7b/f84 x:0 0 0 2024-01-17T23:38:10.428 INFO:tasks.workunit.client.0.smithi161.stdout:7/462: mknod da/d34/d5a/d68/d8c/c9c 0 2024-01-17T23:38:10.860 INFO:tasks.workunit.client.0.smithi161.stdout:4/505: dread d9/d1b/d24/d25/f7c [0,4194304] 0 2024-01-17T23:38:11.183 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:38:11.187 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:38:11.407 INFO:tasks.workunit.client.0.smithi161.stdout:2/446: creat d8/da/d52/d34/d35/f99 x:0 0 0 2024-01-17T23:38:11.407 INFO:tasks.workunit.client.0.smithi161.stdout:2/447: truncate d8/da/d52/d34/d35/d3a/f82 5201365 0 2024-01-17T23:38:11.665 INFO:tasks.workunit.client.0.smithi161.stdout:3/439: creat d0/d5/d9/d1e/d5a/d8a/f92 x:0 0 0 2024-01-17T23:38:11.666 INFO:tasks.workunit.client.0.smithi161.stdout:3/440: chown d0/d5/d9/d38/c65 0 1 2024-01-17T23:38:11.909 INFO:tasks.workunit.client.0.smithi161.stdout:6/435: link d6/f7c d6/d7/dc/d3c/d81/f99 0 2024-01-17T23:38:12.068 INFO:tasks.workunit.client.0.smithi161.stdout:7/463: symlink da/d34/d5a/d3b/d3d/l9d 0 2024-01-17T23:38:12.080 INFO:tasks.workunit.client.0.smithi161.stdout:7/464: dread da/d34/d69/f7c [0,4194304] 0 2024-01-17T23:38:12.098 INFO:tasks.workunit.client.0.smithi161.stdout:5/445: dwrite dd/d15/f23 [0,4194304] 0 2024-01-17T23:38:12.185 INFO:tasks.workunit.client.0.smithi161.stdout:0/497: truncate d5/d34/d12/d2a/d35/f8e 1968762 0 2024-01-17T23:38:12.420 INFO:tasks.workunit.client.0.smithi161.stdout:1/477: rename d1/d8/d67 to d1/d8/d9d 0 2024-01-17T23:38:12.420 INFO:tasks.workunit.client.0.smithi161.stdout:4/506: unlink d9/de/d1e/d38/f49 0 2024-01-17T23:38:12.420 INFO:tasks.workunit.client.0.smithi161.stdout:1/478: stat d1/d31/d4e/c6a 0 2024-01-17T23:38:12.421 INFO:tasks.workunit.client.0.smithi161.stdout:4/507: write d9/d1b/d53/f85 [404578,97979] 0 2024-01-17T23:38:12.584 INFO:tasks.workunit.client.0.smithi161.stdout:2/448: mkdir d8/d4b/d9a 0 2024-01-17T23:38:12.652 INFO:tasks.workunit.client.0.smithi161.stdout:9/369: rename d0/d8/d14/d18/c36 to d0/d8/d31/d58/c76 0 2024-01-17T23:38:12.905 INFO:tasks.workunit.client.0.smithi161.stdout:3/441: link d0/d5/d9/f64 d0/d5/d9/d17/d2d/f93 0 2024-01-17T23:38:13.803 INFO:tasks.workunit.client.0.smithi161.stdout:6/436: getdents d6/d7/dc 0 2024-01-17T23:38:13.831 INFO:tasks.workunit.client.0.smithi161.stdout:6/437: dwrite d6/f2f [0,4194304] 0 2024-01-17T23:38:13.831 INFO:tasks.workunit.client.0.smithi161.stdout:6/438: chown d6/d7/dc/d43/f60 25410543 1 2024-01-17T23:38:13.837 INFO:tasks.workunit.client.0.smithi161.stdout:6/439: dread d6/d7/dc/d85/d31/f4e [0,4194304] 0 2024-01-17T23:38:14.100 INFO:tasks.workunit.client.0.smithi161.stdout:1/479: unlink d1/d11/f22 0 2024-01-17T23:38:14.100 INFO:tasks.workunit.client.0.smithi161.stdout:1/480: readlink d1/d8/l19 0 2024-01-17T23:38:14.128 INFO:tasks.workunit.client.0.smithi161.stdout:1/481: dwrite d1/d20/f5c [4194304,4194304] 0 2024-01-17T23:38:14.320 INFO:tasks.workunit.client.0.smithi161.stdout:4/508: symlink d9/d27/d3a/d8b/l92 0 2024-01-17T23:38:14.320 INFO:tasks.workunit.client.0.smithi161.stdout:4/509: write d9/d1b/d53/f7b [439534,80928] 0 2024-01-17T23:38:15.323 INFO:tasks.workunit.client.0.smithi161.stdout:3/442: creat d0/d5/d9/d17/d2d/f94 x:0 0 0 2024-01-17T23:38:15.338 INFO:tasks.workunit.client.0.smithi161.stdout:3/443: dread d0/d5/f19 [0,4194304] 0 2024-01-17T23:38:15.666 INFO:tasks.workunit.client.0.smithi161.stdout:5/446: getdents dd/d31/d7b 0 2024-01-17T23:38:15.813 INFO:tasks.workunit.client.0.smithi161.stdout:4/510: creat d9/d1b/d24/f93 x:0 0 0 2024-01-17T23:38:15.813 INFO:tasks.workunit.client.0.smithi161.stdout:4/511: write d9/f34 [4567840,65892] 0 2024-01-17T23:38:15.971 INFO:tasks.workunit.client.0.smithi161.stdout:3/444: mknod d0/d5/d9/d8b/c95 0 2024-01-17T23:38:15.974 INFO:tasks.workunit.client.0.smithi161.stdout:8/395: sync 2024-01-17T23:38:15.974 INFO:tasks.workunit.client.0.smithi161.stdout:8/396: chown d1/d3/d19/d1d/f82 20 1 2024-01-17T23:38:15.981 INFO:tasks.workunit.client.0.smithi161.stdout:3/445: dread d0/f12 [4194304,4194304] 0 2024-01-17T23:38:15.981 INFO:tasks.workunit.client.0.smithi161.stdout:3/446: chown d0/d5/d9/d17/f33 5297351 1 2024-01-17T23:38:15.992 INFO:tasks.workunit.client.0.smithi161.stdout:3/447: dread d0/d5/d9/d1e/f5f [0,4194304] 0 2024-01-17T23:38:16.240 INFO:tasks.workunit.client.0.smithi161.stdout:8/397: creat d1/d22/d2f/f85 x:0 0 0 2024-01-17T23:38:16.305 INFO:tasks.workunit.client.0.smithi161.stdout:3/448: mknod d0/d5/d9/d1e/c96 0 2024-01-17T23:38:16.458 INFO:tasks.workunit.client.0.smithi161.stdout:8/398: truncate d1/d3/f38 7781728 0 2024-01-17T23:38:16.999 INFO:tasks.workunit.client.0.smithi161.stdout:8/399: mkdir d1/d22/d2f/d86 0 2024-01-17T23:38:17.019 INFO:tasks.workunit.client.0.smithi161.stdout:8/400: dread d1/df/d20/d6a/f78 [0,4194304] 0 2024-01-17T23:38:17.489 INFO:tasks.workunit.client.0.smithi161.stdout:8/401: creat d1/d3/d19/f87 x:0 0 0 2024-01-17T23:38:17.631 INFO:tasks.workunit.client.0.smithi161.stdout:8/402: mkdir d1/d88 0 2024-01-17T23:38:18.137 INFO:tasks.workunit.client.0.smithi161.stdout:0/498: rename d5/d2e to d5/d3a/d49/d99 0 2024-01-17T23:38:18.137 INFO:tasks.workunit.client.0.smithi161.stdout:4/512: mknod d9/d27/c94 0 2024-01-17T23:38:18.138 INFO:tasks.workunit.client.0.smithi161.stdout:7/465: write da/d34/f52 [1611527,43921] 0 2024-01-17T23:38:18.138 INFO:tasks.workunit.client.0.smithi161.stdout:7/466: chown da/d34/d5a/d3b/d3d/l9d 1 1 2024-01-17T23:38:18.138 INFO:tasks.workunit.client.0.smithi161.stdout:7/467: truncate da/d34/d5a/d68/f97 341642 0 2024-01-17T23:38:18.138 INFO:tasks.workunit.client.0.smithi161.stdout:7/468: creat da/d34/d69/f9e x:0 0 0 2024-01-17T23:38:18.152 INFO:tasks.workunit.client.0.smithi161.stdout:2/449: write d8/f18 [562803,14753] 0 2024-01-17T23:38:18.161 INFO:tasks.workunit.client.0.smithi161.stdout:7/469: dread da/d14/f18 [0,4194304] 0 2024-01-17T23:38:18.628 INFO:tasks.workunit.client.0.smithi161.stdout:3/449: dwrite d0/d5/d9/d17/f18 [0,4194304] 0 2024-01-17T23:38:18.665 INFO:tasks.workunit.client.0.smithi161.stdout:3/450: dwrite d0/d5/d9/f64 [0,4194304] 0 2024-01-17T23:38:18.665 INFO:tasks.workunit.client.0.smithi161.stdout:3/451: chown d0/d5/d9/d1e/c96 15298 1 2024-01-17T23:38:18.719 INFO:tasks.workunit.client.0.smithi161.stdout:9/370: mknod d0/d8/c77 0 2024-01-17T23:38:18.719 INFO:tasks.workunit.client.0.smithi161.stdout:9/371: chown d0/c7 7651191 1 2024-01-17T23:38:18.985 INFO:tasks.workunit.client.0.smithi161.stdout:6/440: rename d6/d7/dc/d3c/d81/c96 to d6/d7/dc/d85/d31/d5d/d55/c9a 0 2024-01-17T23:38:18.985 INFO:tasks.workunit.client.0.smithi161.stdout:6/441: creat d6/d7/dc/d43/f9b x:0 0 0 2024-01-17T23:38:19.144 INFO:tasks.workunit.client.0.smithi161.stdout:4/513: creat d9/de/d1e/d58/f95 x:0 0 0 2024-01-17T23:38:19.192 INFO:tasks.workunit.client.0.smithi161.stdout:4/514: dwrite d9/fd [0,4194304] 0 2024-01-17T23:38:19.192 INFO:tasks.workunit.client.0.smithi161.stdout:4/515: chown d9/de/d1e/d38/d89 76465141 1 2024-01-17T23:38:19.240 INFO:tasks.workunit.client.0.smithi161.stdout:4/516: dwrite d9/de/d1e/d38/d6b/f7d [0,4194304] 0 2024-01-17T23:38:19.477 INFO:tasks.workunit.client.0.smithi161.stdout:2/450: symlink d8/da/l9b 0 2024-01-17T23:38:19.477 INFO:tasks.workunit.client.0.smithi161.stdout:2/451: chown d8/da/d52/d34/d35/d3a/f71 235631 1 2024-01-17T23:38:19.477 INFO:tasks.workunit.client.0.smithi161.stdout:2/452: creat d8/d4b/f9c x:0 0 0 2024-01-17T23:38:19.481 INFO:tasks.workunit.client.0.smithi161.stdout:2/453: read d8/da/d52/f33 [887645,124976] 0 2024-01-17T23:38:19.593 INFO:tasks.workunit.client.0.smithi161.stdout:7/470: truncate da/db/f11 1359622 0 2024-01-17T23:38:19.597 INFO:tasks.workunit.client.0.smithi161.stdout:7/471: dread da/d34/d69/f7c [0,4194304] 0 2024-01-17T23:38:20.000 INFO:tasks.workunit.client.0.smithi161.stdout:8/403: write d1/df/d20/f3e [148403,40859] 0 2024-01-17T23:38:20.806 INFO:tasks.workunit.client.0.smithi161.stdout:6/442: mknod d6/d7/dc/d85/d31/c9c 0 2024-01-17T23:38:21.484 INFO:tasks.workunit.client.0.smithi161.stdout:2/454: creat d8/d1c/d1e/f9d x:0 0 0 2024-01-17T23:38:21.484 INFO:tasks.workunit.client.0.smithi161.stdout:2/455: chown d8/d2e/c6e 352 1 2024-01-17T23:38:21.914 INFO:tasks.workunit.client.0.smithi161.stdout:7/472: symlink da/d34/d5a/d3b/d3d/d7f/l9f 0 2024-01-17T23:38:21.938 INFO:tasks.workunit.client.0.smithi161.stdout:8/404: truncate d1/d3/d19/d1d/d25/f67 1016793 0 2024-01-17T23:38:22.491 INFO:tasks.workunit.client.0.smithi161.stdout:4/517: mknod d9/d1b/d24/c96 0 2024-01-17T23:38:22.773 INFO:tasks.workunit.client.0.smithi161.stdout:2/456: rmdir d8/da/d52/d34/d35/d8c 0 2024-01-17T23:38:22.773 INFO:tasks.workunit.client.0.smithi161.stdout:7/473: mkdir da/d34/d5a/da0 0 2024-01-17T23:38:22.776 INFO:tasks.workunit.client.0.smithi161.stdout:7/474: read da/d34/d5a/d28/d2b/f79 [1156051,80144] 0 2024-01-17T23:38:22.795 INFO:tasks.workunit.client.0.smithi161.stdout:7/475: write da/d14/f18 [1753358,1078] 0 2024-01-17T23:38:22.795 INFO:tasks.workunit.client.0.smithi161.stdout:7/476: chown da/d34/d5a/d3b/f61 6691 1 2024-01-17T23:38:22.834 INFO:tasks.workunit.client.0.smithi161.stdout:8/405: rmdir d1/d22/d2f/d61 0 2024-01-17T23:38:22.834 INFO:tasks.workunit.client.0.smithi161.stdout:8/406: chown d1/d22/f74 2164722 1 2024-01-17T23:38:22.835 INFO:tasks.workunit.client.0.smithi161.stdout:8/407: write d1/d22/d2f/f85 [990536,127766] 0 2024-01-17T23:38:23.022 INFO:tasks.workunit.client.0.smithi161.stdout:1/482: rename d1/d85 to d1/d20/d26/d30/d8f/d9e 0 2024-01-17T23:38:23.022 INFO:tasks.workunit.client.0.smithi161.stdout:1/483: creat d1/d20/d26/d30/f9f x:0 0 0 2024-01-17T23:38:23.152 INFO:tasks.workunit.client.0.smithi161.stdout:4/518: mkdir d9/d1b/d24/d25/d5b/d97 0 2024-01-17T23:38:23.273 INFO:tasks.workunit.client.0.smithi161.stdout:0/499: sync 2024-01-17T23:38:23.306 INFO:tasks.workunit.client.0.smithi161.stdout:0/500: dwrite d5/d34/d21/f84 [0,4194304] 0 2024-01-17T23:38:23.331 INFO:tasks.workunit.client.0.smithi161.stdout:7/477: dread f8 [0,4194304] 0 2024-01-17T23:38:23.414 INFO:tasks.workunit.client.0.smithi161.stdout:8/408: mkdir d1/df/d46/d89 0 2024-01-17T23:38:23.414 INFO:tasks.workunit.client.0.smithi161.stdout:8/409: fdatasync d1/d3/d19/f87 0 2024-01-17T23:38:23.414 INFO:tasks.workunit.client.0.smithi161.stdout:8/410: stat d1/df/d20/c44 0 2024-01-17T23:38:23.445 INFO:tasks.workunit.client.0.smithi161.stdout:8/411: dwrite d1/d3/d19/d1d/f36 [0,4194304] 0 2024-01-17T23:38:23.554 INFO:tasks.workunit.client.0.smithi161.stdout:5/447: rename dd/d15/f30 to dd/d15/d1a/d34/f85 0 2024-01-17T23:38:23.619 INFO:tasks.workunit.client.0.smithi161.stdout:1/484: truncate d1/d2d/d3b/f2a 1727165 0 2024-01-17T23:38:23.825 INFO:tasks.workunit.client.0.smithi161.stdout:4/519: creat d9/d27/d3a/d8b/f98 x:0 0 0 2024-01-17T23:38:24.750 INFO:tasks.workunit.client.0.smithi161.stdout:9/372: rename d0/d8/d31/c60 to d0/d39/d49/d6e/c78 0 2024-01-17T23:38:24.902 INFO:tasks.workunit.client.0.smithi161.stdout:3/452: mknod d0/d5/d9/c97 0 2024-01-17T23:38:24.902 INFO:tasks.workunit.client.0.smithi161.stdout:5/448: mkdir dd/d15/d1a/d5d/d64/d7c/d86 0 2024-01-17T23:38:25.227 INFO:tasks.workunit.client.0.smithi161.stdout:4/520: mknod d9/d1b/c99 0 2024-01-17T23:38:25.755 INFO:tasks.workunit.client.0.smithi161.stdout:9/373: rename d0/d8/d14/d18/d20/l42 to d0/d8/d14/d18/d20/l79 0 2024-01-17T23:38:25.755 INFO:tasks.workunit.client.0.smithi161.stdout:9/374: write d0/d8/d14/d56/f74 [4169545,121970] 0 2024-01-17T23:38:25.861 INFO:tasks.workunit.client.0.smithi161.stdout:2/457: rename d8/da/d52/d34/d35/f99 to d8/d1c/d57/f9e 0 2024-01-17T23:38:26.163 INFO:tasks.workunit.client.0.smithi161.stdout:3/453: link d0/d5/d9/d17/l35 d0/d5/d9/d38/d4f/d50/l98 0 2024-01-17T23:38:26.208 INFO:tasks.workunit.client.0.smithi161.stdout:5/449: rmdir dd/d15/d4e 39 2024-01-17T23:38:26.208 INFO:tasks.workunit.client.0.smithi161.stdout:4/521: mknod d9/de/d1e/d38/c9a 0 2024-01-17T23:38:26.208 INFO:tasks.workunit.client.0.smithi161.stdout:5/450: getdents dd/d31/d3c 0 2024-01-17T23:38:26.208 INFO:tasks.workunit.client.0.smithi161.stdout:5/451: creat dd/d31/d7b/d78/f87 x:0 0 0 2024-01-17T23:38:26.575 INFO:tasks.workunit.client.0.smithi161.stdout:9/375: creat d0/d8/f7a x:0 0 0 2024-01-17T23:38:26.575 INFO:tasks.workunit.client.0.smithi161.stdout:9/376: read - d0/f51 zero size 2024-01-17T23:38:26.576 INFO:tasks.workunit.client.0.smithi161.stdout:9/377: chown d0/d8/d14/d56 468825 1 2024-01-17T23:38:26.576 INFO:tasks.workunit.client.0.smithi161.stdout:9/378: write d0/d8/f66 [1076916,9358] 0 2024-01-17T23:38:26.782 INFO:tasks.workunit.client.0.smithi161.stdout:1/485: rename d1/d8/d1c/f97 to d1/d20/d26/d30/d44/fa0 0 2024-01-17T23:38:26.782 INFO:tasks.workunit.client.0.smithi161.stdout:1/486: stat d1/d31/d8c 0 2024-01-17T23:38:26.782 INFO:tasks.workunit.client.0.smithi161.stdout:1/487: creat d1/d8/d1f/d4b/fa1 x:0 0 0 2024-01-17T23:38:26.832 INFO:tasks.workunit.client.0.smithi161.stdout:7/478: dwrite da/fc [4194304,4194304] 0 2024-01-17T23:38:26.908 INFO:tasks.workunit.client.0.smithi161.stdout:2/458: unlink d8/d1c/d1e/l5e 0 2024-01-17T23:38:26.908 INFO:tasks.workunit.client.0.smithi161.stdout:2/459: readlink d8/l94 0 2024-01-17T23:38:27.051 INFO:tasks.workunit.client.0.smithi161.stdout:3/454: creat d0/d5/d9/d1e/f99 x:0 0 0 2024-01-17T23:38:27.200 INFO:tasks.workunit.client.0.smithi161.stdout:8/412: dwrite d1/d3/d19/d1d/d25/f3b [0,4194304] 0 2024-01-17T23:38:27.239 INFO:tasks.workunit.client.0.smithi161.stdout:8/413: dwrite d1/d3d/f41 [0,4194304] 0 2024-01-17T23:38:27.239 INFO:tasks.workunit.client.0.smithi161.stdout:8/414: creat d1/df/d16/f8a x:0 0 0 2024-01-17T23:38:27.696 INFO:tasks.workunit.client.0.smithi161.stdout:5/452: mkdir dd/d15/d1a/d5d/d64/d7c/d88 0 2024-01-17T23:38:27.696 INFO:tasks.workunit.client.0.smithi161.stdout:9/379: creat d0/d8/d14/d18/d63/f7b x:0 0 0 2024-01-17T23:38:27.942 INFO:tasks.workunit.client.0.smithi161.stdout:1/488: rename d1/d20/d26/d30/f58 to d1/d20/d26/d30/d44/fa2 0 2024-01-17T23:38:28.211 INFO:tasks.workunit.client.0.smithi161.stdout:6/443: sync 2024-01-17T23:38:28.715 INFO:tasks.workunit.client.0.smithi161.stdout:0/501: creat d5/f9a x:0 0 0 2024-01-17T23:38:28.776 INFO:tasks.workunit.client.0.smithi161.stdout:3/455: dread d0/f4 [0,4194304] 0 2024-01-17T23:38:28.839 INFO:tasks.workunit.client.0.smithi161.stdout:4/522: rmdir d9/d1b/d53 39 2024-01-17T23:38:29.557 INFO:tasks.workunit.client.0.smithi161.stdout:8/415: unlink d1/df/d20/f3e 0 2024-01-17T23:38:29.734 INFO:tasks.workunit.client.0.smithi161.stdout:5/453: symlink dd/d31/d3c/l89 0 2024-01-17T23:38:29.897 INFO:tasks.workunit.client.0.smithi161.stdout:1/489: stat d1/la 0 2024-01-17T23:38:30.209 INFO:tasks.workunit.client.0.smithi161.stdout:6/444: mknod d6/d7/dc/d3c/c9d 0 2024-01-17T23:38:30.209 INFO:tasks.workunit.client.0.smithi161.stdout:7/479: truncate da/f2c 663504 0 2024-01-17T23:38:30.350 INFO:tasks.workunit.client.0.smithi161.stdout:0/502: truncate d5/d34/d21/f3d 3038608 0 2024-01-17T23:38:30.656 INFO:tasks.workunit.client.0.smithi161.stdout:3/456: rename d0/f1f to d0/d5/d9/d17/d2d/f9a 0 2024-01-17T23:38:30.657 INFO:tasks.workunit.client.0.smithi161.stdout:3/457: dread - d0/d5/d9/d17/d32/f8e zero size 2024-01-17T23:38:31.073 INFO:tasks.workunit.client.0.smithi161.stdout:8/416: unlink d1/df/d13/f1b 0 2024-01-17T23:38:31.074 INFO:tasks.workunit.client.0.smithi161.stdout:5/454: creat dd/d15/d4e/f8a x:0 0 0 2024-01-17T23:38:31.208 INFO:tasks.workunit.client.0.smithi161.stdout:1/490: creat d1/d31/fa3 x:0 0 0 2024-01-17T23:38:31.213 INFO:tasks.workunit.client.0.smithi161.stdout:1/491: dread d1/d20/d26/f68 [0,4194304] 0 2024-01-17T23:38:31.359 INFO:tasks.workunit.client.0.smithi161.stdout:6/445: symlink d6/d7/dc/d85/d31/d5d/d55/l9e 0 2024-01-17T23:38:31.359 INFO:tasks.workunit.client.0.smithi161.stdout:6/446: creat d6/d7/dc/d85/d31/f9f x:0 0 0 2024-01-17T23:38:31.867 INFO:tasks.workunit.client.0.smithi161.stdout:0/503: creat d5/d34/d20/d2b/d64/d88/f9b x:0 0 0 2024-01-17T23:38:31.867 INFO:tasks.workunit.client.0.smithi161.stdout:4/523: getdents d9/d1b/d24/d25 0 2024-01-17T23:38:31.867 INFO:tasks.workunit.client.0.smithi161.stdout:4/524: read - d9/de/f91 zero size 2024-01-17T23:38:31.881 INFO:tasks.workunit.client.0.smithi161.stdout:4/525: write d9/de/d1e/f40 [1962611,100778] 0 2024-01-17T23:38:31.899 INFO:tasks.workunit.client.0.smithi161.stdout:4/526: dread d9/de/f30 [0,4194304] 0 2024-01-17T23:38:31.937 INFO:tasks.workunit.client.0.smithi161.stdout:3/458: mknod d0/d5/d9/d1e/d3b/d52/c9b 0 2024-01-17T23:38:32.193 INFO:tasks.workunit.client.0.smithi161.stdout:8/417: rename d1/d22/f48 to d1/d22/d2f/d86/f8b 0 2024-01-17T23:38:32.426 INFO:tasks.workunit.client.0.smithi161.stdout:1/492: creat d1/d8/d9d/fa4 x:0 0 0 2024-01-17T23:38:32.658 INFO:tasks.workunit.client.0.smithi161.stdout:6/447: mknod d6/d58/ca0 0 2024-01-17T23:38:32.659 INFO:tasks.workunit.client.0.smithi161.stdout:6/448: chown d6 274710 1 2024-01-17T23:38:32.659 INFO:tasks.workunit.client.0.smithi161.stdout:6/449: fsync d6/d7/dc/d85/f49 0 2024-01-17T23:38:32.675 INFO:tasks.workunit.client.0.smithi161.stdout:6/450: dread d6/d7/dc/d85/d13/f6f [0,4194304] 0 2024-01-17T23:38:32.675 INFO:tasks.workunit.client.0.smithi161.stdout:6/451: write d6/d7/dc/d85/d31/f97 [863322,62236] 0 2024-01-17T23:38:32.707 INFO:tasks.workunit.client.0.smithi161.stdout:2/460: sync 2024-01-17T23:38:32.708 INFO:tasks.workunit.client.0.smithi161.stdout:2/461: stat d8/da 0 2024-01-17T23:38:32.738 INFO:tasks.workunit.client.0.smithi161.stdout:2/462: dwrite d8/d68/f6d [0,4194304] 0 2024-01-17T23:38:32.738 INFO:tasks.workunit.client.0.smithi161.stdout:2/463: chown d8/da/f58 821903935 1 2024-01-17T23:38:32.941 INFO:tasks.workunit.client.0.smithi161.stdout:0/504: mknod d5/d3a/d49/c9c 0 2024-01-17T23:38:32.941 INFO:tasks.workunit.client.0.smithi161.stdout:4/527: truncate f4 605694 0 2024-01-17T23:38:32.989 INFO:tasks.workunit.client.0.smithi161.stdout:4/528: dwrite d9/de/d1e/d38/d6b/f7d [0,4194304] 0 2024-01-17T23:38:32.989 INFO:tasks.workunit.client.0.smithi161.stdout:4/529: write d9/d27/d3a/d56/f5f [740502,86231] 0 2024-01-17T23:38:32.989 INFO:tasks.workunit.client.0.smithi161.stdout:4/530: chown d9/d27/d68 3 1 2024-01-17T23:38:32.990 INFO:tasks.workunit.client.0.smithi161.stdout:4/531: fdatasync d9/de/d1e/d38/f48 0 2024-01-17T23:38:33.078 INFO:tasks.workunit.client.0.smithi161.stdout:3/459: creat d0/d5/d9/d17/f9c x:0 0 0 2024-01-17T23:38:33.344 INFO:tasks.workunit.client.0.smithi161.stdout:8/418: mkdir d1/df/d16/d8c 0 2024-01-17T23:38:33.589 INFO:tasks.workunit.client.0.smithi161.stdout:1/493: rmdir d1/d11/d72/d81 39 2024-01-17T23:38:34.247 INFO:tasks.workunit.client.0.smithi161.stdout:9/380: dwrite d0/d39/d49/f57 [0,4194304] 0 2024-01-17T23:38:34.308 INFO:tasks.workunit.client.0.smithi161.stdout:4/532: symlink d9/d27/l9b 0 2024-01-17T23:38:34.327 INFO:tasks.workunit.client.0.smithi161.stdout:4/533: read d9/de/f33 [2788801,39990] 0 2024-01-17T23:38:34.327 INFO:tasks.workunit.client.0.smithi161.stdout:4/534: fsync d9/d27/d3a/f4a 0 2024-01-17T23:38:34.358 INFO:tasks.workunit.client.0.smithi161.stdout:4/535: dwrite d9/f13 [0,4194304] 0 2024-01-17T23:38:34.490 INFO:tasks.workunit.client.0.smithi161.stdout:3/460: mkdir d0/d5/d9/d38/d4f/d9d 0 2024-01-17T23:38:34.490 INFO:tasks.workunit.client.0.smithi161.stdout:8/419: creat d1/d3/d19/d1d/d25/f8d x:0 0 0 2024-01-17T23:38:34.502 INFO:tasks.workunit.client.0.smithi161.stdout:3/461: dread d0/d5/d9/d17/f18 [4194304,4194304] 0 2024-01-17T23:38:34.525 INFO:tasks.workunit.client.0.smithi161.stdout:3/462: dwrite d0/d5/d9/d38/d4f/d56/f7e [0,4194304] 0 2024-01-17T23:38:34.656 INFO:tasks.workunit.client.0.smithi161.stdout:1/494: fdatasync d1/d2d/d3b/f34 0 2024-01-17T23:38:34.679 INFO:tasks.workunit.client.0.smithi161.stdout:1/495: dwrite d1/d20/d26/d30/d44/f88 [0,4194304] 0 2024-01-17T23:38:34.682 INFO:tasks.workunit.client.0.smithi161.stdout:1/496: read d1/d2d/f7d [545766,127951] 0 2024-01-17T23:38:34.996 INFO:tasks.workunit.client.0.smithi161.stdout:6/452: rmdir d6/d7/dc/d43 39 2024-01-17T23:38:35.158 INFO:tasks.workunit.client.0.smithi161.stdout:9/381: link d0/d8/d31/f4d d0/d8/d31/f7c 0 2024-01-17T23:38:35.455 INFO:tasks.workunit.client.0.smithi161.stdout:4/536: mkdir d9/de/d1e/d58/d60/d9c 0 2024-01-17T23:38:35.456 INFO:tasks.workunit.client.0.smithi161.stdout:4/537: chown d9/de/d1e/f36 3 1 2024-01-17T23:38:35.456 INFO:tasks.workunit.client.0.smithi161.stdout:4/538: fsync d9/d51/d64/f70 0 2024-01-17T23:38:35.456 INFO:tasks.workunit.client.0.smithi161.stdout:4/539: write d9/de/d1e/f40 [1620841,3264] 0 2024-01-17T23:38:35.550 INFO:tasks.workunit.client.0.smithi161.stdout:8/420: mknod d1/d22/d2f/d86/c8e 0 2024-01-17T23:38:35.550 INFO:tasks.workunit.client.0.smithi161.stdout:8/421: chown d1/d3/c70 1001 1 2024-01-17T23:38:35.888 INFO:tasks.workunit.client.0.smithi161.stdout:3/463: mknod d0/d5/d9/d1e/d3b/c9e 0 2024-01-17T23:38:36.391 INFO:tasks.workunit.client.0.smithi161.stdout:1/497: rename d1/d31/d4e/f86 to d1/d8/d54/d94/fa5 0 2024-01-17T23:38:36.418 INFO:tasks.workunit.client.0.smithi161.stdout:1/498: dwrite d1/d2d/f7d [0,4194304] 0 2024-01-17T23:38:36.455 INFO:tasks.workunit.client.0.smithi161.stdout:7/480: write da/f62 [119990,121366] 0 2024-01-17T23:38:36.765 INFO:tasks.workunit.client.0.smithi161.stdout:6/453: rmdir d6/d7/dc/d43/d79 39 2024-01-17T23:38:36.765 INFO:tasks.workunit.client.0.smithi161.stdout:6/454: chown l1 5 1 2024-01-17T23:38:36.765 INFO:tasks.workunit.client.0.smithi161.stdout:3/464: rmdir d0/d72 39 2024-01-17T23:38:36.765 INFO:tasks.workunit.client.0.smithi161.stdout:9/382: creat d0/d8/d31/d58/f7d x:0 0 0 2024-01-17T23:38:36.765 INFO:tasks.workunit.client.0.smithi161.stdout:8/422: creat d1/df/d13/f8f x:0 0 0 2024-01-17T23:38:36.775 INFO:tasks.workunit.client.0.smithi161.stdout:9/383: dread d0/f4 [0,4194304] 0 2024-01-17T23:38:36.789 INFO:tasks.workunit.client.0.smithi161.stdout:9/384: write d0/d8/d14/f25 [910659,73539] 0 2024-01-17T23:38:37.157 INFO:tasks.workunit.client.0.smithi161.stdout:1/499: symlink d1/d8/d1f/d4b/la6 0 2024-01-17T23:38:37.176 INFO:tasks.workunit.client.0.smithi161.stdout:1/500: dread d1/d20/d26/d30/d44/fa2 [0,4194304] 0 2024-01-17T23:38:37.186 INFO:tasks.workunit.client.0.smithi161.stdout:1/501: dread d1/d2d/f7d [0,4194304] 0 2024-01-17T23:38:37.186 INFO:tasks.workunit.client.0.smithi161.stdout:1/502: chown d1/d11/d72/d81 815 1 2024-01-17T23:38:37.204 INFO:tasks.workunit.client.0.smithi161.stdout:5/455: sync 2024-01-17T23:38:37.204 INFO:tasks.workunit.client.0.smithi161.stdout:5/456: write dd/d31/d3c/f60 [377135,2253] 0 2024-01-17T23:38:37.577 INFO:tasks.workunit.client.0.smithi161.stdout:7/481: creat da/d34/fa1 x:0 0 0 2024-01-17T23:38:37.577 INFO:tasks.workunit.client.0.smithi161.stdout:7/482: fsync da/d34/d5a/d3b/f87 0 2024-01-17T23:38:37.577 INFO:tasks.workunit.client.0.smithi161.stdout:6/455: mknod d6/d7/dc/d43/d76/d90/ca1 0 2024-01-17T23:38:37.577 INFO:tasks.workunit.client.0.smithi161.stdout:6/456: read - d6/d58/f82 zero size 2024-01-17T23:38:37.706 INFO:tasks.workunit.client.0.smithi161.stdout:8/423: dwrite d1/df/d20/f6e [0,4194304] 0 2024-01-17T23:38:37.706 INFO:tasks.workunit.client.0.smithi161.stdout:8/424: stat d1/d3/d19/d1d/f36 0 2024-01-17T23:38:37.984 INFO:tasks.workunit.client.0.smithi161.stdout:9/385: truncate d0/d8/d31/f52 552290 0 2024-01-17T23:38:38.019 INFO:tasks.workunit.client.0.smithi161.stdout:9/386: dwrite d0/f30 [0,4194304] 0 2024-01-17T23:38:38.460 INFO:tasks.workunit.client.0.smithi161.stdout:1/503: unlink d1/d20/d26/d30/d44/c61 0 2024-01-17T23:38:38.463 INFO:tasks.workunit.client.0.smithi161.stdout:5/457: rmdir dd/d31/d7b 39 2024-01-17T23:38:38.502 INFO:tasks.workunit.client.0.smithi161.stdout:1/504: dwrite d1/d8/f1b [0,4194304] 0 2024-01-17T23:38:38.602 INFO:tasks.workunit.client.0.smithi161.stdout:2/464: symlink d8/da/l9f 0 2024-01-17T23:38:38.616 INFO:tasks.workunit.client.0.smithi161.stdout:2/465: write d8/da/f58 [1406679,71088] 0 2024-01-17T23:38:38.640 INFO:tasks.workunit.client.0.smithi161.stdout:2/466: dwrite d8/da/d52/d34/d35/d3a/f88 [0,4194304] 0 2024-01-17T23:38:38.657 INFO:tasks.workunit.client.0.smithi161.stdout:2/467: dread d8/da/d52/f53 [0,4194304] 0 2024-01-17T23:38:38.657 INFO:tasks.workunit.client.0.smithi161.stdout:2/468: write d8/d1c/d1e/f6f [270308,110065] 0 2024-01-17T23:38:38.736 INFO:tasks.workunit.client.0.smithi161.stdout:7/483: mkdir da/db/da2 0 2024-01-17T23:38:39.167 INFO:tasks.workunit.client.0.smithi161.stdout:8/425: creat d1/d88/f90 x:0 0 0 2024-01-17T23:38:39.168 INFO:tasks.workunit.client.0.smithi161.stdout:8/426: creat d1/df/d20/d6a/f91 x:0 0 0 2024-01-17T23:38:39.284 INFO:tasks.workunit.client.0.smithi161.stdout:4/540: creat d9/de/f9d x:0 0 0 2024-01-17T23:38:39.284 INFO:tasks.workunit.client.0.smithi161.stdout:4/541: chown d9/de/d1e/f35 158 1 2024-01-17T23:38:39.300 INFO:tasks.workunit.client.0.smithi161.stdout:4/542: dread d9/de/d1e/f36 [0,4194304] 0 2024-01-17T23:38:39.667 INFO:tasks.workunit.client.0.smithi161.stdout:9/387: rmdir d0 39 2024-01-17T23:38:40.002 INFO:tasks.workunit.client.0.smithi161.stdout:2/469: symlink d8/d4b/la0 0 2024-01-17T23:38:40.003 INFO:tasks.workunit.client.0.smithi161.stdout:2/470: chown d8/da/d52/l5a 13 1 2024-01-17T23:38:40.020 INFO:tasks.workunit.client.0.smithi161.stdout:2/471: dread d8/d2e/f63 [0,4194304] 0 2024-01-17T23:38:40.078 INFO:tasks.workunit.client.0.smithi161.stdout:1/505: symlink d1/la7 0 2024-01-17T23:38:40.860 INFO:tasks.workunit.client.0.smithi161.stdout:8/427: dread d1/d3/f9 [0,4194304] 0 2024-01-17T23:38:41.010 INFO:tasks.workunit.client.0.smithi161.stdout:4/543: link d9/d27/d3a/c5e d9/d27/d68/c9e 0 2024-01-17T23:38:41.010 INFO:tasks.workunit.client.0.smithi161.stdout:4/544: getdents d9/d27/d3a/d56 0 2024-01-17T23:38:41.011 INFO:tasks.workunit.client.0.smithi161.stdout:4/545: stat d9/d27/d68/d6d 0 2024-01-17T23:38:41.212 INFO:tasks.workunit.client.0.smithi161.stdout:9/388: symlink d0/d8/d14/d18/d63/l7e 0 2024-01-17T23:38:41.212 INFO:tasks.workunit.client.0.smithi161.stdout:5/458: rename dd/d15/f1b to dd/d15/d4e/d4f/f8b 0 2024-01-17T23:38:41.238 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:38:41.241 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:38:41.292 INFO:tasks.workunit.client.0.smithi161.stdout:2/472: creat d8/da/d52/fa1 x:0 0 0 2024-01-17T23:38:41.357 INFO:tasks.workunit.client.0.smithi161.stdout:1/506: rmdir d1/d2d/d3b 39 2024-01-17T23:38:41.522 INFO:tasks.workunit.client.0.smithi161.stdout:4/546: mkdir d9/d1b/d53/d9f 0 2024-01-17T23:38:41.522 INFO:tasks.workunit.client.0.smithi161.stdout:4/547: creat d9/de/d1e/d58/fa0 x:0 0 0 2024-01-17T23:38:41.555 INFO:tasks.workunit.client.0.smithi161.stdout:4/548: dwrite d9/f13 [0,4194304] 0 2024-01-17T23:38:42.380 INFO:tasks.workunit.client.0.smithi161.stdout:5/459: rename dd/d31/d7b/f7f to dd/d15/d1a/d5d/d64/d7c/f8c 0 2024-01-17T23:38:42.380 INFO:tasks.workunit.client.0.smithi161.stdout:1/507: symlink d1/d11/d72/la8 0 2024-01-17T23:38:42.380 INFO:tasks.workunit.client.0.smithi161.stdout:5/460: creat dd/d15/d1a/d5d/d64/f8d x:0 0 0 2024-01-17T23:38:42.380 INFO:tasks.workunit.client.0.smithi161.stdout:1/508: creat d1/d20/d26/d30/d8f/fa9 x:0 0 0 2024-01-17T23:38:42.428 INFO:tasks.workunit.client.0.smithi161.stdout:1/509: dwrite d1/d20/d26/d30/d44/f88 [0,4194304] 0 2024-01-17T23:38:42.544 INFO:tasks.workunit.client.0.smithi161.stdout:8/428: getdents d1/df/d20 0 2024-01-17T23:38:42.544 INFO:tasks.workunit.client.0.smithi161.stdout:8/429: fdatasync d1/d3/f5b 0 2024-01-17T23:38:42.863 INFO:tasks.workunit.client.0.smithi161.stdout:4/549: symlink d9/d27/d3a/d56/la1 0 2024-01-17T23:38:42.863 INFO:tasks.workunit.client.0.smithi161.stdout:4/550: chown d9/d27/d3a/f4a 498 1 2024-01-17T23:38:42.864 INFO:tasks.workunit.client.0.smithi161.stdout:4/551: write d9/de/d1e/f84 [610435,31347] 0 2024-01-17T23:38:42.943 INFO:tasks.workunit.client.0.smithi161.stdout:9/389: rmdir d0/d8/d14/d18/d20 39 2024-01-17T23:38:43.077 INFO:tasks.workunit.client.0.smithi161.stdout:2/473: rename d8/d4b/c98 to d8/da/d52/d34/d35/ca2 0 2024-01-17T23:38:43.342 INFO:tasks.workunit.client.0.smithi161.stdout:5/461: creat dd/d15/d4e/f8e x:0 0 0 2024-01-17T23:38:43.496 INFO:tasks.workunit.client.0.smithi161.stdout:1/510: link d1/d20/f2e d1/d20/d26/d30/d44/faa 0 2024-01-17T23:38:43.548 INFO:tasks.workunit.client.0.smithi161.stdout:8/430: mkdir d1/d22/d2f/d92 0 2024-01-17T23:38:44.142 INFO:tasks.workunit.client.0.smithi161.stdout:2/474: dread d8/d1c/d57/f73 [0,4194304] 0 2024-01-17T23:38:44.173 INFO:tasks.workunit.client.0.smithi161.stdout:2/475: dwrite d8/da/d52/d34/f69 [0,4194304] 0 2024-01-17T23:38:44.303 INFO:tasks.workunit.client.0.smithi161.stdout:9/390: mknod d0/d39/d49/c7f 0 2024-01-17T23:38:44.313 INFO:tasks.workunit.client.0.smithi161.stdout:9/391: dread d0/f4 [0,4194304] 0 2024-01-17T23:38:44.488 INFO:tasks.workunit.client.0.smithi161.stdout:1/511: symlink d1/d64/lab 0 2024-01-17T23:38:44.488 INFO:tasks.workunit.client.0.smithi161.stdout:1/512: chown d1/d8/d1f/f28 28497443 1 2024-01-17T23:38:44.493 INFO:tasks.workunit.client.0.smithi161.stdout:1/513: write d1/d20/d26/d30/d44/fa0 [516634,57151] 0 2024-01-17T23:38:44.493 INFO:tasks.workunit.client.0.smithi161.stdout:1/514: dread - d1/d31/fa3 zero size 2024-01-17T23:38:44.603 INFO:tasks.workunit.client.0.smithi161.stdout:8/431: mknod d1/df/d16/c93 0 2024-01-17T23:38:44.603 INFO:tasks.workunit.client.0.smithi161.stdout:8/432: chown d1/d3d/f41 6092798 1 2024-01-17T23:38:45.012 INFO:tasks.workunit.client.0.smithi161.stdout:2/476: creat d8/d1c/d1e/d80/fa3 x:0 0 0 2024-01-17T23:38:45.132 INFO:tasks.workunit.client.0.smithi161.stdout:1/515: mkdir d1/d31/d8c/dac 0 2024-01-17T23:38:45.353 INFO:tasks.workunit.client.0.smithi161.stdout:2/477: mknod d8/d1c/d1e/d80/d79/ca4 0 2024-01-17T23:38:45.414 INFO:tasks.workunit.client.0.smithi161.stdout:1/516: rmdir d1/d8/d1c/d3e 39 2024-01-17T23:38:45.545 INFO:tasks.workunit.client.0.smithi161.stdout:2/478: read d8/d1c/d57/f7f [2952209,96929] 0 2024-01-17T23:38:45.545 INFO:tasks.workunit.client.0.smithi161.stdout:2/479: fsync d8/da/d52/f65 0 2024-01-17T23:38:45.656 INFO:tasks.workunit.client.0.smithi161.stdout:1/517: rmdir d1/d31/d8c/dac 0 2024-01-17T23:38:45.656 INFO:tasks.workunit.client.0.smithi161.stdout:1/518: write d1/d20/d26/d30/f9f [252862,72724] 0 2024-01-17T23:38:45.906 INFO:tasks.workunit.client.0.smithi161.stdout:0/505: creat d5/d34/f9d x:0 0 0 2024-01-17T23:38:46.529 INFO:tasks.workunit.client.0.smithi161.stdout:1/519: mknod d1/d11/d72/cad 0 2024-01-17T23:38:46.752 INFO:tasks.workunit.client.0.smithi161.stdout:0/506: rmdir d5/d3a 39 2024-01-17T23:38:46.790 INFO:tasks.workunit.client.0.smithi161.stdout:0/507: dwrite d5/d8/f1f [4194304,4194304] 0 2024-01-17T23:38:47.102 INFO:tasks.workunit.client.0.smithi161.stdout:0/508: mkdir d5/d34/d21/d9e 0 2024-01-17T23:38:47.102 INFO:tasks.workunit.client.0.smithi161.stdout:0/509: chown d5/d3a/d90 269308095 1 2024-01-17T23:38:47.141 INFO:tasks.workunit.client.0.smithi161.stdout:4/552: write d9/de/d1e/f32 [3611292,2572] 0 2024-01-17T23:38:47.141 INFO:tasks.workunit.client.0.smithi161.stdout:4/553: chown d9/d27/d3a/d8b/l92 0 1 2024-01-17T23:38:47.141 INFO:tasks.workunit.client.0.smithi161.stdout:4/554: readlink d9/d27/d3a/l3d 0 2024-01-17T23:38:47.199 INFO:tasks.workunit.client.0.smithi161.stdout:0/510: symlink d5/d34/d20/l9f 0 2024-01-17T23:38:47.209 INFO:tasks.workunit.client.0.smithi161.stdout:5/462: write dd/f12 [449582,65042] 0 2024-01-17T23:38:47.290 INFO:tasks.workunit.client.0.smithi161.stdout:4/555: creat d9/d1b/fa2 x:0 0 0 2024-01-17T23:38:47.382 INFO:tasks.workunit.client.0.smithi161.stdout:0/511: creat d5/d34/d20/d2b/fa0 x:0 0 0 2024-01-17T23:38:47.382 INFO:tasks.workunit.client.0.smithi161.stdout:0/512: getdents d5/d34/d21/d76/d93 0 2024-01-17T23:38:47.622 INFO:tasks.workunit.client.0.smithi161.stdout:4/556: rmdir d9/d1b/d24/d25 39 2024-01-17T23:38:48.038 INFO:tasks.workunit.client.0.smithi161.stdout:4/557: link d9/d27/d3a/d56/f5f d9/d27/d3a/d87/fa3 0 2024-01-17T23:38:48.039 INFO:tasks.workunit.client.0.smithi161.stdout:4/558: readlink d9/de/d1e/l29 0 2024-01-17T23:38:48.118 INFO:tasks.workunit.client.0.smithi161.stdout:0/513: chown d5/d34/d12/f37 50484346 1 2024-01-17T23:38:48.118 INFO:tasks.workunit.client.0.smithi161.stdout:0/514: creat d5/d3a/d49/fa1 x:0 0 0 2024-01-17T23:38:48.118 INFO:tasks.workunit.client.0.smithi161.stdout:0/515: creat d5/d3a/d49/fa2 x:0 0 0 2024-01-17T23:38:48.118 INFO:tasks.workunit.client.0.smithi161.stdout:0/516: chown d5/d3a/d49/d99 0 1 2024-01-17T23:38:48.516 INFO:tasks.workunit.client.0.smithi161.stdout:4/559: mknod d9/d1b/ca4 0 2024-01-17T23:38:48.516 INFO:tasks.workunit.client.0.smithi161.stdout:4/560: truncate d9/de/d1e/d38/d6b/f7d 4235022 0 2024-01-17T23:38:48.516 INFO:tasks.workunit.client.0.smithi161.stdout:4/561: read - d9/de/d1e/d38/d6b/f76 zero size 2024-01-17T23:38:48.516 INFO:tasks.workunit.client.0.smithi161.stdout:4/562: creat d9/d1b/d24/d25/d5b/fa5 x:0 0 0 2024-01-17T23:38:48.767 INFO:tasks.workunit.client.0.smithi161.stdout:0/517: mkdir d5/d34/d21/d76/d93/da3 0 2024-01-17T23:38:48.775 INFO:tasks.workunit.client.0.smithi161.stdout:0/518: dread d5/d34/d12/d2a/d35/f8e [0,4194304] 0 2024-01-17T23:38:49.126 INFO:tasks.workunit.client.0.smithi161.stdout:4/563: creat d9/de/d1e/d58/d60/d8f/fa6 x:0 0 0 2024-01-17T23:38:49.126 INFO:tasks.workunit.client.0.smithi161.stdout:4/564: creat d9/de/d69/fa7 x:0 0 0 2024-01-17T23:38:49.220 INFO:tasks.workunit.client.0.smithi161.stdout:0/519: unlink d5/d8/c1c 0 2024-01-17T23:38:49.220 INFO:tasks.workunit.client.0.smithi161.stdout:0/520: creat d5/d34/d20/d2b/d64/d88/fa4 x:0 0 0 2024-01-17T23:38:49.268 INFO:tasks.workunit.client.0.smithi161.stdout:3/465: sync 2024-01-17T23:38:49.268 INFO:tasks.workunit.client.0.smithi161.stdout:3/466: fdatasync d0/f4 0 2024-01-17T23:38:49.268 INFO:tasks.workunit.client.0.smithi161.stdout:3/467: stat d0/d5/d9/d8b 0 2024-01-17T23:38:49.268 INFO:tasks.workunit.client.0.smithi161.stdout:3/468: creat d0/d5/d9/d1e/d5a/d8a/f9f x:0 0 0 2024-01-17T23:38:49.268 INFO:tasks.workunit.client.0.smithi161.stdout:3/469: creat d0/d5/d9/d1e/d3b/d52/fa0 x:0 0 0 2024-01-17T23:38:49.268 INFO:tasks.workunit.client.0.smithi161.stdout:3/470: fsync d0/d5/f1d 0 2024-01-17T23:38:49.445 INFO:tasks.workunit.client.0.smithi161.stdout:4/565: unlink d9/d1b/d24/d25/f2f 0 2024-01-17T23:38:49.465 INFO:tasks.workunit.client.0.smithi161.stdout:4/566: dread d9/d27/d68/d6d/f78 [0,4194304] 0 2024-01-17T23:38:50.007 INFO:tasks.workunit.client.0.smithi161.stdout:3/471: mknod d0/d5/d9/d38/d4f/d50/ca1 0 2024-01-17T23:38:50.216 INFO:tasks.workunit.client.0.smithi161.stdout:6/457: rmdir d6/d58 39 2024-01-17T23:38:50.216 INFO:tasks.workunit.client.0.smithi161.stdout:7/484: sync 2024-01-17T23:38:50.359 INFO:tasks.workunit.client.0.smithi161.stdout:3/472: getdents d0/d5/d9/d38/d4f/d56/d7c 0 2024-01-17T23:38:50.459 INFO:tasks.workunit.client.0.smithi161.stdout:6/458: creat d6/d7/dc/d43/d76/d90/fa2 x:0 0 0 2024-01-17T23:38:50.476 INFO:tasks.workunit.client.0.smithi161.stdout:6/459: dread d6/f2f [0,4194304] 0 2024-01-17T23:38:50.476 INFO:tasks.workunit.client.0.smithi161.stdout:6/460: readlink d6/d7/dc/l70 0 2024-01-17T23:38:50.476 INFO:tasks.workunit.client.0.smithi161.stdout:6/461: write d6/d7/dc/d85/d31/d5d/f46 [992160,126104] 0 2024-01-17T23:38:50.476 INFO:tasks.workunit.client.0.smithi161.stdout:6/462: chown d6/d7/dc/d85/c8f 1970 1 2024-01-17T23:38:50.500 INFO:tasks.workunit.client.0.smithi161.stdout:6/463: dwrite d6/d7/dc/d43/d79/f7f [0,4194304] 0 2024-01-17T23:38:50.669 INFO:tasks.workunit.client.0.smithi161.stdout:7/485: creat da/d34/d5a/d3b/d3d/d7f/fa3 x:0 0 0 2024-01-17T23:38:50.699 INFO:tasks.workunit.client.0.smithi161.stdout:7/486: dwrite da/d14/f32 [0,4194304] 0 2024-01-17T23:38:51.413 INFO:tasks.workunit.client.0.smithi161.stdout:5/463: dwrite dd/d15/f19 [0,4194304] 0 2024-01-17T23:38:51.760 INFO:tasks.workunit.client.0.smithi161.stdout:7/487: mkdir da/d34/d5a/d28/d43/da4 0 2024-01-17T23:38:51.760 INFO:tasks.workunit.client.0.smithi161.stdout:3/473: rmdir d0/d5/d9/d17/d2d 39 2024-01-17T23:38:52.027 INFO:tasks.workunit.client.0.smithi161.stdout:5/464: link dd/d31/d7b/f53 dd/d31/d56/f8f 0 2024-01-17T23:38:52.054 INFO:tasks.workunit.client.0.smithi161.stdout:5/465: dwrite dd/d15/d1a/f57 [0,4194304] 0 2024-01-17T23:38:52.054 INFO:tasks.workunit.client.0.smithi161.stdout:5/466: readlink dd/d31/l26 0 2024-01-17T23:38:52.178 INFO:tasks.workunit.client.0.smithi161.stdout:7/488: mknod da/d34/ca5 0 2024-01-17T23:38:52.435 INFO:tasks.workunit.client.0.smithi161.stdout:5/467: creat dd/d31/d3c/f90 x:0 0 0 2024-01-17T23:38:52.501 INFO:tasks.workunit.client.0.smithi161.stdout:7/489: creat da/d34/d5a/d68/d8c/fa6 x:0 0 0 2024-01-17T23:38:52.577 INFO:tasks.workunit.client.0.smithi161.stdout:0/521: fsync d5/d3a/d49/fa2 0 2024-01-17T23:38:52.577 INFO:tasks.workunit.client.0.smithi161.stdout:3/474: mkdir d0/da2 0 2024-01-17T23:38:52.604 INFO:tasks.workunit.client.0.smithi161.stdout:3/475: dwrite d0/d5/d9/d17/f36 [0,4194304] 0 2024-01-17T23:38:52.604 INFO:tasks.workunit.client.0.smithi161.stdout:3/476: chown d0/d5/d9/d38/c7f 1395702 1 2024-01-17T23:38:52.721 INFO:tasks.workunit.client.0.smithi161.stdout:5/468: dread dd/d15/d1a/d42/f58 [0,4194304] 0 2024-01-17T23:38:52.810 INFO:tasks.workunit.client.0.smithi161.stdout:0/522: symlink d5/d34/d8a/la5 0 2024-01-17T23:38:53.418 INFO:tasks.workunit.client.0.smithi161.stdout:8/433: rename d1/d22/d2f/d86/f8b to d1/f94 0 2024-01-17T23:38:53.418 INFO:tasks.workunit.client.0.smithi161.stdout:3/477: symlink d0/d5/d9/d38/d4f/d56/la3 0 2024-01-17T23:38:53.418 INFO:tasks.workunit.client.0.smithi161.stdout:8/434: chown d1/d3/c70 49371564 1 2024-01-17T23:38:53.418 INFO:tasks.workunit.client.0.smithi161.stdout:3/478: fdatasync d0/d5/d9/d1e/d3b/d52/f67 0 2024-01-17T23:38:53.418 INFO:tasks.workunit.client.0.smithi161.stdout:8/435: creat d1/d88/f95 x:0 0 0 2024-01-17T23:38:53.418 INFO:tasks.workunit.client.0.smithi161.stdout:7/490: mkdir da/da7 0 2024-01-17T23:38:53.446 INFO:tasks.workunit.client.0.smithi161.stdout:7/491: dwrite da/d34/d5a/f2f [8388608,4194304] 0 2024-01-17T23:38:53.457 INFO:tasks.workunit.client.0.smithi161.stdout:7/492: dread da/f26 [0,4194304] 0 2024-01-17T23:38:53.561 INFO:tasks.workunit.client.0.smithi161.stdout:5/469: symlink dd/d15/d1a/d5d/d64/d7c/d88/l91 0 2024-01-17T23:38:54.021 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:41:17.377 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:38:54.025 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:41:17.381 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:38:54.058 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:41:17.334 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:38:54.061 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:41:17.338 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:38:54.065 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:41:17.342 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:38:54.069 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:41:17.345 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:38:54.121 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:41:17.476 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:38:54.188 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:41:17.464 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:38:54.192 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:41:17.469 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:38:54.214 INFO:tasks.workunit.client.0.smithi161.stdout:3/479: creat d0/d5/d9/d17/d2d/fa4 x:0 0 0 2024-01-17T23:38:54.301 INFO:tasks.workunit.client.0.smithi161.stdout:7/493: dread da/d34/d5a/f85 [0,4194304] 0 2024-01-17T23:38:54.527 INFO:tasks.workunit.client.0.smithi161.stdout:3/480: mkdir d0/d5/d9/d38/d4f/da5 0 2024-01-17T23:38:54.527 INFO:tasks.workunit.client.0.smithi161.stdout:3/481: chown d0/d5/d9/d17/f1c 0 1 2024-01-17T23:38:54.564 INFO:tasks.workunit.client.0.smithi161.stdout:9/392: rmdir d0/d8/d14 39 2024-01-17T23:38:54.684 INFO:tasks.workunit.client.0.smithi161.stdout:7/494: mkdir da/db/d7a/da8 0 2024-01-17T23:38:54.684 INFO:tasks.workunit.client.0.smithi161.stdout:7/495: chown da/d34/d4a/d4c/f94 1 1 2024-01-17T23:38:54.708 INFO:tasks.workunit.client.0.smithi161.stdout:7/496: dwrite da/d34/d5a/d3b/d3d/f40 [4194304,4194304] 0 2024-01-17T23:38:54.829 INFO:tasks.workunit.client.0.smithi161.stdout:9/393: dread d0/d8/d31/f52 [0,4194304] 0 2024-01-17T23:38:55.387 INFO:tasks.workunit.client.0.smithi161.stdout:4/567: symlink d9/d27/la8 0 2024-01-17T23:38:55.400 INFO:tasks.workunit.client.0.smithi161.stdout:4/568: dread d9/de/f1a [4194304,4194304] 0 2024-01-17T23:38:55.400 INFO:tasks.workunit.client.0.smithi161.stdout:4/569: chown d9/de/d1e/d58/d60/d8f/fa6 166910 1 2024-01-17T23:38:55.401 INFO:tasks.workunit.client.0.smithi161.stdout:4/570: read - d9/de/d1e/d58/f95 zero size 2024-01-17T23:38:55.950 INFO:tasks.workunit.client.0.smithi161.stdout:1/520: sync 2024-01-17T23:38:56.108 INFO:tasks.workunit.client.0.smithi161.stdout:8/436: write d1/d3/f9 [8654021,690] 0 2024-01-17T23:38:56.137 INFO:tasks.workunit.client.0.smithi161.stdout:5/470: dwrite dd/d15/f22 [0,4194304] 0 2024-01-17T23:38:56.137 INFO:tasks.workunit.client.0.smithi161.stdout:5/471: fsync dd/d15/d1a/f57 0 2024-01-17T23:38:56.137 INFO:tasks.workunit.client.0.smithi161.stdout:5/472: read - dd/d15/d4e/f8e zero size 2024-01-17T23:38:56.158 INFO:tasks.workunit.client.0.smithi161.stdout:5/473: dwrite dd/d31/d7b/f84 [0,4194304] 0 2024-01-17T23:38:56.193 INFO:tasks.workunit.client.0.smithi161.stdout:5/474: dwrite dd/d15/d1a/f57 [0,4194304] 0 2024-01-17T23:38:56.222 INFO:tasks.workunit.client.0.smithi161.stdout:5/475: fdatasync dd/d31/d3c/f90 0 2024-01-17T23:38:56.222 INFO:tasks.workunit.client.0.smithi161.stdout:5/476: truncate dd/d15/d4e/f8e 48017 0 2024-01-17T23:38:56.260 INFO:tasks.workunit.client.0.smithi161.stdout:4/571: truncate f4 1435763 0 2024-01-17T23:38:56.362 INFO:tasks.workunit.client.0.smithi161.stdout:1/521: getdents d1/d2d 0 2024-01-17T23:38:56.454 INFO:tasks.workunit.client.0.smithi161.stdout:6/464: sync 2024-01-17T23:38:56.454 INFO:tasks.workunit.client.0.smithi161.stdout:6/465: creat d6/d7/dc/d3c/fa3 x:0 0 0 2024-01-17T23:38:56.454 INFO:tasks.workunit.client.0.smithi161.stdout:6/466: chown d6/d7/dc/d85 49422841 1 2024-01-17T23:38:56.454 INFO:tasks.workunit.client.0.smithi161.stdout:6/467: read d6/d7/dc/d1d/f2e [3172266,35192] 0 2024-01-17T23:38:56.454 INFO:tasks.workunit.client.0.smithi161.stdout:6/468: read d6/d7/dc/d85/d13/f6e [76004,68317] 0 2024-01-17T23:38:56.570 INFO:tasks.workunit.client.0.smithi161.stdout:8/437: unlink d1/df/d20/f6e 0 2024-01-17T23:38:57.158 INFO:tasks.workunit.client.0.smithi161.stdout:1/522: mkdir d1/d20/d26/d30/d8f/d9e/dae 0 2024-01-17T23:38:57.158 INFO:tasks.workunit.client.0.smithi161.stdout:1/523: readlink d1/d64/lab 0 2024-01-17T23:38:57.321 INFO:tasks.workunit.client.0.smithi161.stdout:2/480: rename d8/d1c/d1e/d80/fa3 to d8/fa5 0 2024-01-17T23:38:57.321 INFO:tasks.workunit.client.0.smithi161.stdout:2/481: chown d8/da/l5f 8311556 1 2024-01-17T23:38:57.321 INFO:tasks.workunit.client.0.smithi161.stdout:2/482: fdatasync d8/fa5 0 2024-01-17T23:38:57.321 INFO:tasks.workunit.client.0.smithi161.stdout:2/483: truncate d8/da/d52/d34/d35/d3a/f71 669567 0 2024-01-17T23:38:57.321 INFO:tasks.workunit.client.0.smithi161.stdout:2/484: chown d8/d2e/c6e 194657 1 2024-01-17T23:38:57.454 INFO:tasks.workunit.client.0.smithi161.stdout:6/469: mkdir d6/d7/dc/d85/da4 0 2024-01-17T23:38:57.475 INFO:tasks.workunit.client.0.smithi161.stdout:6/470: write d6/d7/dc/f4f [2784888,48006] 0 2024-01-17T23:38:57.541 INFO:tasks.workunit.client.0.smithi161.stdout:8/438: creat d1/df/f96 x:0 0 0 2024-01-17T23:38:57.725 INFO:tasks.workunit.client.0.smithi161.stdout:1/524: creat d1/d20/d26/d30/d8f/d9e/faf x:0 0 0 2024-01-17T23:38:57.744 INFO:tasks.workunit.client.0.smithi161.stdout:1/525: dread d1/f38 [0,4194304] 0 2024-01-17T23:38:58.466 INFO:tasks.workunit.client.0.smithi161.stdout:6/471: truncate d6/d7/dc/d3c/f73 54740 0 2024-01-17T23:38:58.466 INFO:tasks.workunit.client.0.smithi161.stdout:6/472: chown d6/d58/f87 4 1 2024-01-17T23:38:58.466 INFO:tasks.workunit.client.0.smithi161.stdout:6/473: write d6/d7/dc/d43/d76/d90/f93 [282899,60465] 0 2024-01-17T23:38:58.466 INFO:tasks.workunit.client.0.smithi161.stdout:6/474: write d6/d7/dc/d3c/fa3 [554173,124330] 0 2024-01-17T23:38:58.897 INFO:tasks.workunit.client.0.smithi161.stdout:0/523: rename d5/d34/d12/l4e to d5/d34/d21/d76/la6 0 2024-01-17T23:38:58.897 INFO:tasks.workunit.client.0.smithi161.stdout:0/524: stat f2 0 2024-01-17T23:38:58.987 INFO:tasks.workunit.client.0.smithi161.stdout:7/497: sync 2024-01-17T23:38:59.422 INFO:tasks.workunit.client.0.smithi161.stdout:6/475: symlink d6/d7/dc/d43/d76/la5 0 2024-01-17T23:38:59.422 INFO:tasks.workunit.client.0.smithi161.stdout:4/572: write f4 [2364617,92210] 0 2024-01-17T23:38:59.552 INFO:tasks.workunit.client.0.smithi161.stdout:8/439: symlink d1/df/d46/d89/l97 0 2024-01-17T23:38:59.790 INFO:tasks.workunit.client.0.smithi161.stdout:3/482: rename d0/d5/d9/d38/d4f/f62 to d0/d5/d9/d38/d4f/d56/fa6 0 2024-01-17T23:39:00.013 INFO:tasks.workunit.client.0.smithi161.stdout:0/525: mkdir d5/d8/d68/d6b/da7 0 2024-01-17T23:39:00.141 INFO:tasks.workunit.client.0.smithi161.stdout:7/498: mkdir da/d14/d35/d54/da9 0 2024-01-17T23:39:00.277 INFO:tasks.workunit.client.0.smithi161.stdout:6/476: truncate d6/d7/dc/d1d/f5e 467200 0 2024-01-17T23:39:00.277 INFO:tasks.workunit.client.0.smithi161.stdout:6/477: chown d6/d7/dc/l33 18795 1 2024-01-17T23:39:00.286 INFO:tasks.workunit.client.0.smithi161.stdout:6/478: dread d6/d7/dc/d85/d1a/d59/f83 [0,4194304] 0 2024-01-17T23:39:00.394 INFO:tasks.workunit.client.0.smithi161.stdout:4/573: creat d9/d1b/d53/d9f/fa9 x:0 0 0 2024-01-17T23:39:00.519 INFO:tasks.workunit.client.0.smithi161.stdout:8/440: creat d1/df/d46/d89/f98 x:0 0 0 2024-01-17T23:39:00.544 INFO:tasks.workunit.client.0.smithi161.stdout:8/441: dwrite d1/df/f96 [0,4194304] 0 2024-01-17T23:39:00.709 INFO:tasks.workunit.client.0.smithi161.stdout:9/394: rename d0/d8/d14/d18/d20/f45 to d0/d39/d49/d6e/f80 0 2024-01-17T23:39:00.852 INFO:tasks.workunit.client.0.smithi161.stdout:0/526: mknod d5/d34/d21/d76/d93/da3/ca8 0 2024-01-17T23:39:01.234 INFO:tasks.workunit.client.0.smithi161.stdout:4/574: link d9/de/d1e/d38/d6b/f7d d9/d51/d64/faa 0 2024-01-17T23:39:01.234 INFO:tasks.workunit.client.0.smithi161.stdout:4/575: chown d9/de/d1e/f36 98186357 1 2024-01-17T23:39:01.649 INFO:tasks.workunit.client.0.smithi161.stdout:8/442: creat d1/d55/f99 x:0 0 0 2024-01-17T23:39:01.649 INFO:tasks.workunit.client.0.smithi161.stdout:5/477: rename dd/d31/d3c/c40 to dd/d15/d1a/d5d/d64/d67/c92 0 2024-01-17T23:39:01.649 INFO:tasks.workunit.client.0.smithi161.stdout:5/478: fsync dd/d15/f2e 0 2024-01-17T23:39:01.649 INFO:tasks.workunit.client.0.smithi161.stdout:5/479: stat dd/f11 0 2024-01-17T23:39:01.649 INFO:tasks.workunit.client.0.smithi161.stdout:5/480: write dd/d15/d4e/f8a [689089,21864] 0 2024-01-17T23:39:01.649 INFO:tasks.workunit.client.0.smithi161.stdout:5/481: fdatasync dd/f50 0 2024-01-17T23:39:01.664 INFO:tasks.workunit.client.0.smithi161.stdout:8/443: dread d1/df/d20/d2a/f3c [0,4194304] 0 2024-01-17T23:39:01.664 INFO:tasks.workunit.client.0.smithi161.stdout:8/444: fdatasync d1/df/d16/f8a 0 2024-01-17T23:39:01.843 INFO:tasks.workunit.client.0.smithi161.stdout:9/395: mknod d0/d8/d14/d18/d63/c81 0 2024-01-17T23:39:01.866 INFO:tasks.workunit.client.0.smithi161.stdout:3/483: truncate d0/d72/f79 5211572 0 2024-01-17T23:39:01.872 INFO:tasks.workunit.client.0.smithi161.stdout:9/396: dwrite d0/d8/d14/d18/d20/f4f [0,4194304] 0 2024-01-17T23:39:01.881 INFO:tasks.workunit.client.0.smithi161.stdout:3/484: dread d0/d5/d9/d17/f37 [0,4194304] 0 2024-01-17T23:39:01.881 INFO:tasks.workunit.client.0.smithi161.stdout:3/485: dread - d0/d5/d9/d1e/d3b/f6f zero size 2024-01-17T23:39:01.881 INFO:tasks.workunit.client.0.smithi161.stdout:3/486: fdatasync d0/d5/d9/d1e/d5a/d8a/f9f 0 2024-01-17T23:39:01.972 INFO:tasks.workunit.client.0.smithi161.stdout:0/527: write d5/d34/d12/f1d [4990520,115882] 0 2024-01-17T23:39:02.151 INFO:tasks.workunit.client.0.smithi161.stdout:1/526: dwrite d1/d8/fc [0,4194304] 0 2024-01-17T23:39:03.503 INFO:tasks.workunit.client.0.smithi161.stdout:5/482: creat dd/d15/d51/f93 x:0 0 0 2024-01-17T23:39:03.652 INFO:tasks.workunit.client.0.smithi161.stdout:7/499: creat da/faa x:0 0 0 2024-01-17T23:39:03.652 INFO:tasks.workunit.client.0.smithi161.stdout:7/500: dread - da/d34/d5a/d3b/d3d/d7f/fa3 zero size 2024-01-17T23:39:03.987 INFO:tasks.workunit.client.0.smithi161.stdout:9/397: getdents d0/d8/d14/d18 0 2024-01-17T23:39:04.096 INFO:tasks.workunit.client.0.smithi161.stdout:0/528: readlink d5/d34/d12/l63 0 2024-01-17T23:39:04.097 INFO:tasks.workunit.client.0.smithi161.stdout:6/479: write d6/d7/dc/f19 [2389366,33834] 0 2024-01-17T23:39:04.097 INFO:tasks.workunit.client.0.smithi161.stdout:6/480: write d6/d7/fe [5121962,95541] 0 2024-01-17T23:39:04.097 INFO:tasks.workunit.client.0.smithi161.stdout:6/481: fsync d6/d7/dc/d85/d13/f6f 0 2024-01-17T23:39:04.097 INFO:tasks.workunit.client.0.smithi161.stdout:6/482: creat d6/d7/dc/d85/d31/fa6 x:0 0 0 2024-01-17T23:39:04.103 INFO:tasks.workunit.client.0.smithi161.stdout:1/527: mkdir d1/d20/d26/d30/d8f/d9e/dae/db0 0 2024-01-17T23:39:04.103 INFO:tasks.workunit.client.0.smithi161.stdout:1/528: creat d1/d20/d26/d30/d41/fb1 x:0 0 0 2024-01-17T23:39:05.115 INFO:tasks.workunit.client.0.smithi161.stdout:0/529: link d5/d34/d20/d2b/fa0 d5/d3a/fa9 0 2024-01-17T23:39:05.382 INFO:tasks.workunit.client.0.smithi161.stdout:6/483: link d6/d7/fe d6/d7/dc/d43/d76/fa7 0 2024-01-17T23:39:05.382 INFO:tasks.workunit.client.0.smithi161.stdout:6/484: write d6/d7/dc/f77 [199604,46237] 0 2024-01-17T23:39:05.578 INFO:tasks.workunit.client.0.smithi161.stdout:1/529: creat d1/d2d/fb2 x:0 0 0 2024-01-17T23:39:05.578 INFO:tasks.workunit.client.0.smithi161.stdout:1/530: chown d1/d20/d26/d32 351 1 2024-01-17T23:39:05.578 INFO:tasks.workunit.client.0.smithi161.stdout:1/531: chown d1/d20/d26/d30/d44/f88 16 1 2024-01-17T23:39:05.760 INFO:tasks.workunit.client.0.smithi161.stdout:2/485: rename d8/da/d52/d34 to d8/d1c/d1e/da6 0 2024-01-17T23:39:05.934 INFO:tasks.workunit.client.0.smithi161.stdout:7/501: mknod da/d14/cab 0 2024-01-17T23:39:05.966 INFO:tasks.workunit.client.0.smithi161.stdout:7/502: dwrite da/d34/d5a/d3b/f6d [0,4194304] 0 2024-01-17T23:39:05.980 INFO:tasks.workunit.client.0.smithi161.stdout:7/503: dread da/d34/d5a/d28/f3e [0,4194304] 0 2024-01-17T23:39:06.128 INFO:tasks.workunit.client.0.smithi161.stdout:6/485: unlink d6/d7/dc/d3c/f75 0 2024-01-17T23:39:06.160 INFO:tasks.workunit.client.0.smithi161.stdout:6/486: dwrite d6/d7/dc/d85/d1a/f6a [0,4194304] 0 2024-01-17T23:39:06.160 INFO:tasks.workunit.client.0.smithi161.stdout:6/487: getdents d6/d7/dc/d85/da4 0 2024-01-17T23:39:06.160 INFO:tasks.workunit.client.0.smithi161.stdout:6/488: write d6/d7/dc/f4f [4301332,54102] 0 2024-01-17T23:39:06.160 INFO:tasks.workunit.client.0.smithi161.stdout:6/489: truncate d6/d7/dc/d43/f94 853464 0 2024-01-17T23:39:06.160 INFO:tasks.workunit.client.0.smithi161.stdout:6/490: write d6/d7/dc/d43/d76/f86 [555645,97166] 0 2024-01-17T23:39:06.203 INFO:tasks.workunit.client.0.smithi161.stdout:6/491: dwrite d6/d7/dc/f77 [0,4194304] 0 2024-01-17T23:39:06.209 INFO:tasks.workunit.client.0.smithi161.stdout:6/492: dread d6/d7/dc/d3c/fa3 [0,4194304] 0 2024-01-17T23:39:06.220 INFO:tasks.workunit.client.0.smithi161.stdout:1/532: mkdir d1/d2d/db3 0 2024-01-17T23:39:06.412 INFO:tasks.workunit.client.0.smithi161.stdout:2/486: getdents d8/d1c/d1e/da6/d35/d3a 0 2024-01-17T23:39:06.412 INFO:tasks.workunit.client.0.smithi161.stdout:2/487: chown d8/d1c/l40 0 1 2024-01-17T23:39:06.412 INFO:tasks.workunit.client.0.smithi161.stdout:2/488: write d8/d4b/f85 [512568,51143] 0 2024-01-17T23:39:06.777 INFO:tasks.workunit.client.0.smithi161.stdout:4/576: sync 2024-01-17T23:39:06.876 INFO:tasks.workunit.client.0.smithi161.stdout:8/445: sync 2024-01-17T23:39:06.876 INFO:tasks.workunit.client.0.smithi161.stdout:8/446: read - d1/df/d20/d6a/f6c zero size 2024-01-17T23:39:07.393 INFO:tasks.workunit.client.0.smithi161.stdout:2/489: mknod d8/d1c/d75/ca7 0 2024-01-17T23:39:07.420 INFO:tasks.workunit.client.0.smithi161.stdout:2/490: dwrite d8/d1c/d57/f83 [0,4194304] 0 2024-01-17T23:39:07.449 INFO:tasks.workunit.client.0.smithi161.stdout:2/491: dwrite d8/d1c/d1e/f38 [0,4194304] 0 2024-01-17T23:39:07.467 INFO:tasks.workunit.client.0.smithi161.stdout:2/492: write d8/d1c/d1e/da6/d35/d3a/f88 [2176902,90006] 0 2024-01-17T23:39:07.494 INFO:tasks.workunit.client.0.smithi161.stdout:4/577: symlink d9/de/d1e/d38/d89/lab 0 2024-01-17T23:39:07.494 INFO:tasks.workunit.client.0.smithi161.stdout:4/578: stat d9/de/f33 0 2024-01-17T23:39:07.494 INFO:tasks.workunit.client.0.smithi161.stdout:4/579: chown d9/d27/l3c 0 1 2024-01-17T23:39:07.496 INFO:tasks.workunit.client.0.smithi161.stdout:2/493: dwrite d8/da/d52/f6b [4194304,4194304] 0 2024-01-17T23:39:07.507 INFO:tasks.workunit.client.0.smithi161.stdout:2/494: dread d8/f14 [0,4194304] 0 2024-01-17T23:39:07.660 INFO:tasks.workunit.client.0.smithi161.stdout:8/447: link d1/d3/f38 d1/d3/d19/d1d/f9a 0 2024-01-17T23:39:07.685 INFO:tasks.workunit.client.0.smithi161.stdout:8/448: dwrite d1/d22/d2f/f7a [0,4194304] 0 2024-01-17T23:39:08.589 INFO:tasks.workunit.client.0.smithi161.stdout:4/580: creat d9/d27/d3a/fac x:0 0 0 2024-01-17T23:39:08.590 INFO:tasks.workunit.client.0.smithi161.stdout:4/581: chown d9/de/d1e/d58/d60/d8f 4 1 2024-01-17T23:39:08.875 INFO:tasks.workunit.client.0.smithi161.stdout:2/495: mkdir d8/d2e/da8 0 2024-01-17T23:39:09.164 INFO:tasks.workunit.client.0.smithi161.stdout:5/483: sync 2024-01-17T23:39:09.186 INFO:tasks.workunit.client.0.smithi161.stdout:5/484: dread dd/d15/f19 [0,4194304] 0 2024-01-17T23:39:09.187 INFO:tasks.workunit.client.0.smithi161.stdout:5/485: readlink dd/d15/d51/l5c 0 2024-01-17T23:39:09.187 INFO:tasks.workunit.client.0.smithi161.stdout:5/486: chown dd/d15/d1a/d5d/f70 755 1 2024-01-17T23:39:09.187 INFO:tasks.workunit.client.0.smithi161.stdout:5/487: dread - dd/d15/d1a/d5d/f70 zero size 2024-01-17T23:39:09.187 INFO:tasks.workunit.client.0.smithi161.stdout:5/488: chown dd/d31/d3c/l89 473 1 2024-01-17T23:39:09.277 INFO:tasks.workunit.client.0.smithi161.stdout:8/449: creat d1/d3/d19/d1d/f9b x:0 0 0 2024-01-17T23:39:09.524 INFO:tasks.workunit.client.0.smithi161.stdout:5/489: mknod dd/d15/d6a/d80/c94 0 2024-01-17T23:39:09.528 INFO:tasks.workunit.client.0.smithi161.stdout:5/490: read dd/d15/d1a/d34/f85 [773771,16506] 0 2024-01-17T23:39:09.708 INFO:tasks.workunit.client.0.smithi161.stdout:8/450: symlink d1/d22/d2f/l9c 0 2024-01-17T23:39:09.800 INFO:tasks.workunit.client.0.smithi161.stdout:5/491: mknod dd/d15/d1a/d5d/d64/c95 0 2024-01-17T23:39:10.010 INFO:tasks.workunit.client.0.smithi161.stdout:8/451: symlink d1/d3/l9d 0 2024-01-17T23:39:10.073 INFO:tasks.workunit.client.0.smithi161.stdout:3/487: rename d0/d72 to d0/d5/d9/d38/d4f/d9d/da7 0 2024-01-17T23:39:10.074 INFO:tasks.workunit.client.0.smithi161.stdout:3/488: creat d0/d5/d9/d17/d32/fa8 x:0 0 0 2024-01-17T23:39:10.118 INFO:tasks.workunit.client.0.smithi161.stdout:8/452: dread - d1/df/d13/f8f zero size 2024-01-17T23:39:10.317 INFO:tasks.workunit.client.0.smithi161.stdout:9/398: rename d0/d8/d14/d18/d63/f7b to d0/d39/d49/f82 0 2024-01-17T23:39:10.317 INFO:tasks.workunit.client.0.smithi161.stdout:0/530: rename d5 to d5/d34/d20/d2d/d8d/daa 22 2024-01-17T23:39:10.317 INFO:tasks.workunit.client.0.smithi161.stdout:9/399: chown d0/d8/d14/d18/d63 482621 1 2024-01-17T23:39:10.317 INFO:tasks.workunit.client.0.smithi161.stdout:9/400: creat d0/d8/d31/d58/f83 x:0 0 0 2024-01-17T23:39:10.325 INFO:tasks.workunit.client.0.smithi161.stdout:0/531: dread d5/d34/d20/d2b/f69 [0,4194304] 0 2024-01-17T23:39:10.325 INFO:tasks.workunit.client.0.smithi161.stdout:0/532: fsync d5/d34/d20/f85 0 2024-01-17T23:39:10.536 INFO:tasks.workunit.client.0.smithi161.stdout:3/489: link d0/d5/d9/d38/d4f/d50/l8f d0/d5/d9/d1e/d5a/la9 0 2024-01-17T23:39:10.564 INFO:tasks.workunit.client.0.smithi161.stdout:3/490: dwrite d0/f2e [0,4194304] 0 2024-01-17T23:39:10.590 INFO:tasks.workunit.client.0.smithi161.stdout:3/491: dwrite d0/d5/d9/d1e/d5a/d8a/f92 [0,4194304] 0 2024-01-17T23:39:10.590 INFO:tasks.workunit.client.0.smithi161.stdout:3/492: fsync d0/d5/f1d 0 2024-01-17T23:39:10.590 INFO:tasks.workunit.client.0.smithi161.stdout:3/493: readlink d0/d5/d9/d1e/l20 0 2024-01-17T23:39:10.590 INFO:tasks.workunit.client.0.smithi161.stdout:3/494: stat d0/d5/f19 0 2024-01-17T23:39:10.611 INFO:tasks.workunit.client.0.smithi161.stdout:3/495: read d0/f2e [4184922,4562] 0 2024-01-17T23:39:10.614 INFO:tasks.workunit.client.0.smithi161.stdout:8/453: symlink d1/df/d13/l9e 0 2024-01-17T23:39:10.660 INFO:tasks.workunit.client.0.smithi161.stdout:8/454: dwrite d1/d22/f74 [0,4194304] 0 2024-01-17T23:39:10.981 INFO:tasks.workunit.client.0.smithi161.stdout:0/533: mknod d5/d34/d8a/cab 0 2024-01-17T23:39:10.981 INFO:tasks.workunit.client.0.smithi161.stdout:0/534: fsync d5/d34/d12/d2a/d35/f5d 0 2024-01-17T23:39:10.981 INFO:tasks.workunit.client.0.smithi161.stdout:0/535: truncate d5/d34/f9d 502202 0 2024-01-17T23:39:11.178 INFO:tasks.workunit.client.0.smithi161.stdout:3/496: mknod d0/d5/d9/d17/d2d/caa 0 2024-01-17T23:39:11.200 INFO:tasks.workunit.client.0.smithi161.stdout:3/497: read d0/d5/d9/d1e/d3b/d52/f67 [2557776,67316] 0 2024-01-17T23:39:11.200 INFO:tasks.workunit.client.0.smithi161.stdout:3/498: write d0/d5/d9/d17/d32/f89 [223993,100806] 0 2024-01-17T23:39:11.360 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:39:11.363 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:39:11.927 INFO:tasks.workunit.client.0.smithi161.stdout:3/499: creat d0/d5/d9/d1e/fab x:0 0 0 2024-01-17T23:39:11.927 INFO:tasks.workunit.client.0.smithi161.stdout:3/500: write d0/d5/d9/d1e/d3b/f78 [88981,98533] 0 2024-01-17T23:39:11.927 INFO:tasks.workunit.client.0.smithi161.stdout:3/501: chown d0/d5/d9/d1e/d3b/d52/c5e 385 1 2024-01-17T23:39:12.968 INFO:tasks.workunit.client.0.smithi161.stdout:7/504: rename da/d14/d35/d54 to da/db/d7a/d8f/dac 0 2024-01-17T23:39:13.083 INFO:tasks.workunit.client.0.smithi161.stdout:0/536: mknod d5/d3a/d49/d99/d96/cac 0 2024-01-17T23:39:13.083 INFO:tasks.workunit.client.0.smithi161.stdout:0/537: dread - d5/d3a/d49/fa1 zero size 2024-01-17T23:39:13.083 INFO:tasks.workunit.client.0.smithi161.stdout:0/538: chown d5/d34/d8a/cab 244 1 2024-01-17T23:39:13.179 INFO:tasks.workunit.client.0.smithi161.stdout:6/493: rename d6/d58/f8d to d6/d7/dc/d43/d79/fa8 0 2024-01-17T23:39:13.179 INFO:tasks.workunit.client.0.smithi161.stdout:6/494: chown d6/d7/dc/d85/d31/l69 41529 1 2024-01-17T23:39:13.292 INFO:tasks.workunit.client.0.smithi161.stdout:7/505: dread da/d34/d5a/f75 [0,4194304] 0 2024-01-17T23:39:13.317 INFO:tasks.workunit.client.0.smithi161.stdout:7/506: dwrite da/d14/f18 [4194304,4194304] 0 2024-01-17T23:39:13.550 INFO:tasks.workunit.client.0.smithi161.stdout:4/582: rename d9/de/f2b to d9/d1b/d24/d25/d5b/d97/fad 0 2024-01-17T23:39:13.684 INFO:tasks.workunit.client.0.smithi161.stdout:2/496: write d8/d1c/f1f [3783754,82619] 0 2024-01-17T23:39:13.764 INFO:tasks.workunit.client.0.smithi161.stdout:7/507: mkdir da/d34/d5a/d28/dad 0 2024-01-17T23:39:13.782 INFO:tasks.workunit.client.0.smithi161.stdout:7/508: dread da/d34/d5a/d28/d2b/f45 [0,4194304] 0 2024-01-17T23:39:14.591 INFO:tasks.workunit.client.0.smithi161.stdout:5/492: rename dd/d15/l72 to dd/d15/d1a/d5d/d64/d7c/d88/l96 0 2024-01-17T23:39:14.591 INFO:tasks.workunit.client.0.smithi161.stdout:5/493: dread - dd/d31/d56/f68 zero size 2024-01-17T23:39:14.591 INFO:tasks.workunit.client.0.smithi161.stdout:4/583: creat d9/de/d1e/d58/d60/d9c/fae x:0 0 0 2024-01-17T23:39:14.591 INFO:tasks.workunit.client.0.smithi161.stdout:5/494: write dd/d15/d1a/f25 [4421763,9023] 0 2024-01-17T23:39:14.598 INFO:tasks.workunit.client.0.smithi161.stdout:4/584: dread d9/fc [0,4194304] 0 2024-01-17T23:39:14.598 INFO:tasks.workunit.client.0.smithi161.stdout:4/585: chown d9/de/d1e/d58/f95 72291 1 2024-01-17T23:39:14.618 INFO:tasks.workunit.client.0.smithi161.stdout:5/495: dwrite dd/d15/d4e/d4f/f61 [0,4194304] 0 2024-01-17T23:39:14.729 INFO:tasks.workunit.client.0.smithi161.stdout:1/533: sync 2024-01-17T23:39:14.749 INFO:tasks.workunit.client.0.smithi161.stdout:1/534: dread d1/ff [0,4194304] 0 2024-01-17T23:39:14.749 INFO:tasks.workunit.client.0.smithi161.stdout:1/535: readlink d1/d8/d1f/d4b/la6 0 2024-01-17T23:39:14.762 INFO:tasks.workunit.client.0.smithi161.stdout:1/536: dread d1/d8/f56 [0,4194304] 0 2024-01-17T23:39:15.005 INFO:tasks.workunit.client.0.smithi161.stdout:7/509: symlink da/d34/d4a/lae 0 2024-01-17T23:39:15.049 INFO:tasks.workunit.client.0.smithi161.stdout:9/401: rename d0/d8/d31/d58/f83 to d0/d8/d14/d18/d20/f84 0 2024-01-17T23:39:15.669 INFO:tasks.workunit.client.0.smithi161.stdout:4/586: creat d9/d27/d68/d6d/faf x:0 0 0 2024-01-17T23:39:15.670 INFO:tasks.workunit.client.0.smithi161.stdout:8/455: rmdir d1/df 39 2024-01-17T23:39:15.670 INFO:tasks.workunit.client.0.smithi161.stdout:5/496: mkdir dd/d15/d4e/d4f/d97 0 2024-01-17T23:39:15.670 INFO:tasks.workunit.client.0.smithi161.stdout:1/537: creat d1/d20/d26/d30/d8f/d9e/dae/fb4 x:0 0 0 2024-01-17T23:39:15.670 INFO:tasks.workunit.client.0.smithi161.stdout:1/538: creat d1/d11/fb5 x:0 0 0 2024-01-17T23:39:15.698 INFO:tasks.workunit.client.0.smithi161.stdout:1/539: dwrite d1/d20/d26/d30/d44/fa0 [0,4194304] 0 2024-01-17T23:39:15.785 INFO:tasks.workunit.client.0.smithi161.stdout:7/510: stat da/d34/d5a/d28/d43/f78 0 2024-01-17T23:39:15.974 INFO:tasks.workunit.client.0.smithi161.stdout:3/502: rename d0/d5/d9/d1e/l20 to d0/d5/d9/d17/d2d/lac 0 2024-01-17T23:39:15.990 INFO:tasks.workunit.client.0.smithi161.stdout:3/503: dread d0/f4 [0,4194304] 0 2024-01-17T23:39:16.035 INFO:tasks.workunit.client.0.smithi161.stdout:3/504: dwrite d0/d5/d9/d38/f74 [0,4194304] 0 2024-01-17T23:39:16.057 INFO:tasks.workunit.client.0.smithi161.stdout:9/402: creat d0/d8/d14/f85 x:0 0 0 2024-01-17T23:39:16.057 INFO:tasks.workunit.client.0.smithi161.stdout:9/403: chown d0/d8/d31/f52 2896 1 2024-01-17T23:39:16.057 INFO:tasks.workunit.client.0.smithi161.stdout:9/404: creat d0/d8/d31/f86 x:0 0 0 2024-01-17T23:39:16.160 INFO:tasks.workunit.client.0.smithi161.stdout:8/456: creat d1/f9f x:0 0 0 2024-01-17T23:39:16.160 INFO:tasks.workunit.client.0.smithi161.stdout:8/457: dread - d1/d88/f95 zero size 2024-01-17T23:39:16.160 INFO:tasks.workunit.client.0.smithi161.stdout:8/458: write d1/d3/d19/d1d/f71 [245180,32629] 0 2024-01-17T23:39:16.720 INFO:tasks.workunit.client.0.smithi161.stdout:7/511: symlink da/d34/laf 0 2024-01-17T23:39:16.742 INFO:tasks.workunit.client.0.smithi161.stdout:7/512: dread da/d34/d5a/d3b/f6d [0,4194304] 0 2024-01-17T23:39:16.752 INFO:tasks.workunit.client.0.smithi161.stdout:7/513: dread da/d34/f52 [0,4194304] 0 2024-01-17T23:39:16.758 INFO:tasks.workunit.client.0.smithi161.stdout:7/514: dread f8 [0,4194304] 0 2024-01-17T23:39:17.174 INFO:tasks.workunit.client.0.smithi161.stdout:3/505: symlink d0/d5/d9/lad 0 2024-01-17T23:39:17.361 INFO:tasks.workunit.client.0.smithi161.stdout:9/405: mkdir d0/d8/d14/d87 0 2024-01-17T23:39:17.361 INFO:tasks.workunit.client.0.smithi161.stdout:9/406: chown d0/d8/d31/f68 0 1 2024-01-17T23:39:17.571 INFO:tasks.workunit.client.0.smithi161.stdout:8/459: mknod d1/df/d16/d8c/ca0 0 2024-01-17T23:39:17.572 INFO:tasks.workunit.client.0.smithi161.stdout:8/460: write d1/d3/d19/d1d/f71 [409685,57131] 0 2024-01-17T23:39:17.924 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:41:41.280 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:39:17.931 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:41:41.287 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:39:17.957 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:41:41.312 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:39:18.045 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:41:41.322 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:39:18.052 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:41:41.329 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:39:18.056 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:41:41.332 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:39:18.058 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:41:41.335 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:39:18.086 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:41:41.362 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:39:18.088 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:41:41.365 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:39:18.092 INFO:tasks.workunit.client.0.smithi161.stdout:2/497: truncate d8/da/d52/f6b 598071 0 2024-01-17T23:39:18.092 INFO:tasks.workunit.client.0.smithi161.stdout:2/498: fdatasync d8/da/d52/f53 0 2024-01-17T23:39:18.094 INFO:tasks.workunit.client.0.smithi161.stdout:6/495: sync 2024-01-17T23:39:18.160 INFO:tasks.workunit.client.0.smithi161.stdout:3/506: mknod d0/d5/d9/d38/cae 0 2024-01-17T23:39:18.160 INFO:tasks.workunit.client.0.smithi161.stdout:3/507: write d0/d5/d9/d17/d2d/f94 [561881,71336] 0 2024-01-17T23:39:18.161 INFO:tasks.workunit.client.0.smithi161.stdout:3/508: write d0/d5/d9/d1e/d3b/f78 [775292,53741] 0 2024-01-17T23:39:18.161 INFO:tasks.workunit.client.0.smithi161.stdout:3/509: write d0/d5/d9/d1e/f7a [166807,31058] 0 2024-01-17T23:39:18.161 INFO:tasks.workunit.client.0.smithi161.stdout:3/510: stat d0/d5/d9/d8b/c95 0 2024-01-17T23:39:18.296 INFO:tasks.workunit.client.0.smithi161.stdout:9/407: unlink d0/d8/d31/d58/l61 0 2024-01-17T23:39:18.296 INFO:tasks.workunit.client.0.smithi161.stdout:9/408: chown d0/d8/f5f 26466474 1 2024-01-17T23:39:18.296 INFO:tasks.workunit.client.0.smithi161.stdout:9/409: chown d0/d8/d14/d56 46950 1 2024-01-17T23:39:18.642 INFO:tasks.workunit.client.0.smithi161.stdout:1/540: symlink d1/d11/d72/d81/lb6 0 2024-01-17T23:39:18.715 INFO:tasks.workunit.client.0.smithi161.stdout:6/496: unlink d6/d58/f87 0 2024-01-17T23:39:18.857 INFO:tasks.workunit.client.0.smithi161.stdout:3/511: mkdir d0/d5/d9/d1e/d3b/d52/daf 0 2024-01-17T23:39:18.858 INFO:tasks.workunit.client.0.smithi161.stdout:3/512: getdents d0/d5/d9/d17/d5c 0 2024-01-17T23:39:18.858 INFO:tasks.workunit.client.0.smithi161.stdout:3/513: chown d0/d5/d9/d1e/d5a/f7d 125 1 2024-01-17T23:39:18.956 INFO:tasks.workunit.client.0.smithi161.stdout:9/410: rmdir d0/d39 39 2024-01-17T23:39:19.081 INFO:tasks.workunit.client.0.smithi161.stdout:1/541: symlink d1/d8/d1c/lb7 0 2024-01-17T23:39:19.081 INFO:tasks.workunit.client.0.smithi161.stdout:1/542: write d1/d2d/fb2 [311574,96252] 0 2024-01-17T23:39:19.221 INFO:tasks.workunit.client.0.smithi161.stdout:8/461: mknod d1/df/ca1 0 2024-01-17T23:39:19.229 INFO:tasks.workunit.client.0.smithi161.stdout:8/462: dread d1/d1c/f2b [0,4194304] 0 2024-01-17T23:39:19.229 INFO:tasks.workunit.client.0.smithi161.stdout:8/463: readlink d1/d1c/l45 0 2024-01-17T23:39:19.229 INFO:tasks.workunit.client.0.smithi161.stdout:8/464: chown d1/d22/d2f/l9c 126 1 2024-01-17T23:39:19.257 INFO:tasks.workunit.client.0.smithi161.stdout:8/465: dwrite d1/d22/f74 [0,4194304] 0 2024-01-17T23:39:19.292 INFO:tasks.workunit.client.0.smithi161.stdout:6/497: creat d6/d58/fa9 x:0 0 0 2024-01-17T23:39:19.292 INFO:tasks.workunit.client.0.smithi161.stdout:6/498: chown d6/d7/fe 2609 1 2024-01-17T23:39:19.292 INFO:tasks.workunit.client.0.smithi161.stdout:6/499: read - d6/d7/dc/d43/d76/d90/fa2 zero size 2024-01-17T23:39:19.292 INFO:tasks.workunit.client.0.smithi161.stdout:6/500: fdatasync d6/d7/dc/d85/d1a/d59/f83 0 2024-01-17T23:39:19.323 INFO:tasks.workunit.client.0.smithi161.stdout:6/501: dwrite d6/f2f [0,4194304] 0 2024-01-17T23:39:19.707 INFO:tasks.workunit.client.0.smithi161.stdout:8/466: symlink d1/df/d46/la2 0 2024-01-17T23:39:20.041 INFO:tasks.workunit.client.0.smithi161.stdout:1/543: fsync d1/d11/fb5 0 2024-01-17T23:39:20.306 INFO:tasks.workunit.client.0.smithi161.stdout:8/467: creat d1/df/d20/d6a/fa3 x:0 0 0 2024-01-17T23:39:20.395 INFO:tasks.workunit.client.0.smithi161.stdout:6/502: mknod d6/d7/dc/d43/d79/caa 0 2024-01-17T23:39:21.028 INFO:tasks.workunit.client.0.smithi161.stdout:4/587: sync 2024-01-17T23:39:21.439 INFO:tasks.workunit.client.0.smithi161.stdout:4/588: truncate d9/d27/d3a/f4a 3198531 0 2024-01-17T23:39:21.439 INFO:tasks.workunit.client.0.smithi161.stdout:4/589: chown c6 488452 1 2024-01-17T23:39:21.439 INFO:tasks.workunit.client.0.smithi161.stdout:4/590: write d9/d1b/fa2 [683848,52011] 0 2024-01-17T23:39:21.478 INFO:tasks.workunit.client.0.smithi161.stdout:4/591: dwrite d9/de/f30 [0,4194304] 0 2024-01-17T23:39:21.487 INFO:tasks.workunit.client.0.smithi161.stdout:1/544: rmdir d1/d11/d72 39 2024-01-17T23:39:21.487 INFO:tasks.workunit.client.0.smithi161.stdout:1/545: chown d1/d31/d4e 13635 1 2024-01-17T23:39:21.612 INFO:tasks.workunit.client.0.smithi161.stdout:1/546: getdents d1/d31/d4e 0 2024-01-17T23:39:21.632 INFO:tasks.workunit.client.0.smithi161.stdout:1/547: read d1/d20/f37 [1926461,74008] 0 2024-01-17T23:39:21.827 INFO:tasks.workunit.client.0.smithi161.stdout:3/514: dwrite d0/d5/d9/d17/d32/f8e [0,4194304] 0 2024-01-17T23:39:21.991 INFO:tasks.workunit.client.0.smithi161.stdout:0/539: rename d5/f9a to d5/d34/d20/d2b/d64/d88/fad 0 2024-01-17T23:39:21.991 INFO:tasks.workunit.client.0.smithi161.stdout:0/540: dread - d5/d34/d20/d2b/d64/f83 zero size 2024-01-17T23:39:22.376 INFO:tasks.workunit.client.0.smithi161.stdout:1/548: chown d1/d11/d72/d81/f82 4934566 1 2024-01-17T23:39:22.644 INFO:tasks.workunit.client.0.smithi161.stdout:3/515: mknod d0/d5/d9/d38/cb0 0 2024-01-17T23:39:22.644 INFO:tasks.workunit.client.0.smithi161.stdout:3/516: dread - d0/d5/d9/d17/f6b zero size 2024-01-17T23:39:22.644 INFO:tasks.workunit.client.0.smithi161.stdout:3/517: creat d0/d5/d9/d17/d32/fb1 x:0 0 0 2024-01-17T23:39:22.644 INFO:tasks.workunit.client.0.smithi161.stdout:3/518: chown d0/d5/d9/d1e/d3b/d52/f60 0 1 2024-01-17T23:39:22.645 INFO:tasks.workunit.client.0.smithi161.stdout:3/519: chown d0/d5/d9/d1e/c96 3396454 1 2024-01-17T23:39:23.178 INFO:tasks.workunit.client.0.smithi161.stdout:6/503: creat d6/d7/fab x:0 0 0 2024-01-17T23:39:23.178 INFO:tasks.workunit.client.0.smithi161.stdout:6/504: creat d6/d7/dc/d1d/fac x:0 0 0 2024-01-17T23:39:23.197 INFO:tasks.workunit.client.0.smithi161.stdout:6/505: dread d6/d7/dc/d43/f60 [0,4194304] 0 2024-01-17T23:39:23.844 INFO:tasks.workunit.client.0.smithi161.stdout:7/515: sync 2024-01-17T23:39:24.009 INFO:tasks.workunit.client.0.smithi161.stdout:8/468: creat d1/fa4 x:0 0 0 2024-01-17T23:39:24.010 INFO:tasks.workunit.client.0.smithi161.stdout:8/469: readlink d1/d3/d19/l5d 0 2024-01-17T23:39:24.196 INFO:tasks.workunit.client.0.smithi161.stdout:1/549: mknod d1/d20/d26/d30/d8f/cb8 0 2024-01-17T23:39:24.358 INFO:tasks.workunit.client.0.smithi161.stdout:3/520: creat d0/d5/d9/d38/d4f/d56/d7c/fb2 x:0 0 0 2024-01-17T23:39:24.359 INFO:tasks.workunit.client.0.smithi161.stdout:3/521: readlink d0/d5/d9/d38/d4f/d56/la3 0 2024-01-17T23:39:24.711 INFO:tasks.workunit.client.0.smithi161.stdout:6/506: creat d6/d7/dc/d43/d76/fad x:0 0 0 2024-01-17T23:39:25.037 INFO:tasks.workunit.client.0.smithi161.stdout:9/411: symlink d0/d8/l88 0 2024-01-17T23:39:25.037 INFO:tasks.workunit.client.0.smithi161.stdout:7/516: rmdir da/d34/d5a/d3b/d89 0 2024-01-17T23:39:25.037 INFO:tasks.workunit.client.0.smithi161.stdout:7/517: write da/d14/d35/d41/f73 [690636,37365] 0 2024-01-17T23:39:25.241 INFO:tasks.workunit.client.0.smithi161.stdout:8/470: link d1/f4e d1/df/d46/fa5 0 2024-01-17T23:39:25.241 INFO:tasks.workunit.client.0.smithi161.stdout:8/471: chown d1/df/d20/d2a/d53 2582171 1 2024-01-17T23:39:25.242 INFO:tasks.workunit.client.0.smithi161.stdout:1/550: link d1/l5 d1/d2d/db3/lb9 0 2024-01-17T23:39:25.242 INFO:tasks.workunit.client.0.smithi161.stdout:1/551: dread - d1/d20/d26/d30/d41/fb1 zero size 2024-01-17T23:39:25.391 INFO:tasks.workunit.client.0.smithi161.stdout:3/522: mkdir d0/d5/d9/d38/db3 0 2024-01-17T23:39:25.409 INFO:tasks.workunit.client.0.smithi161.stdout:3/523: write d0/d5/fa [2750430,54394] 0 2024-01-17T23:39:25.521 INFO:tasks.workunit.client.0.smithi161.stdout:6/507: rmdir d6/d7/dc/d43/d79 39 2024-01-17T23:39:25.706 INFO:tasks.workunit.client.0.smithi161.stdout:7/518: unlink da/db/d7a/f98 0 2024-01-17T23:39:26.231 INFO:tasks.workunit.client.0.smithi161.stdout:8/472: getdents d1/df 0 2024-01-17T23:39:26.471 INFO:tasks.workunit.client.0.smithi161.stdout:3/524: mkdir d0/d5/d9/d38/db3/db4 0 2024-01-17T23:39:26.471 INFO:tasks.workunit.client.0.smithi161.stdout:3/525: fdatasync d0/d5/d9/f55 0 2024-01-17T23:39:26.471 INFO:tasks.workunit.client.0.smithi161.stdout:3/526: readlink d0/d5/d9/d38/l4d 0 2024-01-17T23:39:26.571 INFO:tasks.workunit.client.0.smithi161.stdout:6/508: truncate d6/d7/dc/d43/f94 638423 0 2024-01-17T23:39:26.578 INFO:tasks.workunit.client.0.smithi161.stdout:6/509: dread d6/d7/f8 [0,4194304] 0 2024-01-17T23:39:26.602 INFO:tasks.workunit.client.0.smithi161.stdout:6/510: dwrite d6/d7/dc/d85/d13/f1c [0,4194304] 0 2024-01-17T23:39:26.602 INFO:tasks.workunit.client.0.smithi161.stdout:6/511: fdatasync d6/d58/f82 0 2024-01-17T23:39:26.602 INFO:tasks.workunit.client.0.smithi161.stdout:6/512: fdatasync d6/d7/dc/d1d/f95 0 2024-01-17T23:39:26.647 INFO:tasks.workunit.client.0.smithi161.stdout:7/519: mkdir da/d34/d5a/d3b/d3d/d82/db0 0 2024-01-17T23:39:26.736 INFO:tasks.workunit.client.0.smithi161.stdout:8/473: rmdir d1/d3 39 2024-01-17T23:39:26.973 INFO:tasks.workunit.client.0.smithi161.stdout:3/527: creat d0/d5/d9/d38/d4f/da5/fb5 x:0 0 0 2024-01-17T23:39:27.724 INFO:tasks.workunit.client.0.smithi161.stdout:0/541: sync 2024-01-17T23:39:27.886 INFO:tasks.workunit.client.0.smithi161.stdout:1/552: link d1/d2d/f6f d1/d8/fba 0 2024-01-17T23:39:27.914 INFO:tasks.workunit.client.0.smithi161.stdout:1/553: dwrite d1/d20/d26/d30/f77 [0,4194304] 0 2024-01-17T23:39:28.130 INFO:tasks.workunit.client.0.smithi161.stdout:0/542: truncate d5/d34/f45 959615 0 2024-01-17T23:39:28.981 INFO:tasks.workunit.client.0.smithi161.stdout:1/554: rmdir d1/d8/d1c 39 2024-01-17T23:39:28.981 INFO:tasks.workunit.client.0.smithi161.stdout:1/555: chown d1/d2d/l3d 7494222 1 2024-01-17T23:39:29.230 INFO:tasks.workunit.client.0.smithi161.stdout:1/556: getdents d1/d20/d26/d30/d44 0 2024-01-17T23:39:29.231 INFO:tasks.workunit.client.0.smithi161.stdout:1/557: fsync d1/d2d/fb2 0 2024-01-17T23:39:29.258 INFO:tasks.workunit.client.0.smithi161.stdout:1/558: dwrite d1/d20/d26/d30/d8f/d9e/f98 [0,4194304] 0 2024-01-17T23:39:29.412 INFO:tasks.workunit.client.0.smithi161.stdout:3/528: write d0/d5/d9/d1e/f7b [1499118,13921] 0 2024-01-17T23:39:29.412 INFO:tasks.workunit.client.0.smithi161.stdout:7/520: creat da/fb1 x:0 0 0 2024-01-17T23:39:29.446 INFO:tasks.workunit.client.0.smithi161.stdout:8/474: dwrite d1/d3/f12 [0,4194304] 0 2024-01-17T23:39:29.463 INFO:tasks.workunit.client.0.smithi161.stdout:3/529: dwrite d0/d5/f19 [0,4194304] 0 2024-01-17T23:39:29.463 INFO:tasks.workunit.client.0.smithi161.stdout:3/530: creat d0/d5/d9/d38/d4f/da5/fb6 x:0 0 0 2024-01-17T23:39:29.463 INFO:tasks.workunit.client.0.smithi161.stdout:3/531: chown d0/d5/d9 19 1 2024-01-17T23:39:29.463 INFO:tasks.workunit.client.0.smithi161.stdout:3/532: truncate d0/d5/d9/d17/d32/f89 337490 0 2024-01-17T23:39:29.467 INFO:tasks.workunit.client.0.smithi161.stdout:6/513: dwrite d6/d7/dc/f5b [0,4194304] 0 2024-01-17T23:39:29.474 INFO:tasks.workunit.client.0.smithi161.stdout:7/521: dwrite da/d34/d5a/d68/d8c/fa6 [0,4194304] 0 2024-01-17T23:39:29.712 INFO:tasks.workunit.client.0.smithi161.stdout:8/475: getdents d1/df/d46 0 2024-01-17T23:39:29.802 INFO:tasks.workunit.client.0.smithi161.stdout:0/543: dwrite f1 [0,4194304] 0 2024-01-17T23:39:29.810 INFO:tasks.workunit.client.0.smithi161.stdout:0/544: write d5/d34/d12/d2a/f7a [612394,86930] 0 2024-01-17T23:39:29.990 INFO:tasks.workunit.client.0.smithi161.stdout:3/533: mknod d0/d5/d9/d38/cb7 0 2024-01-17T23:39:30.111 INFO:tasks.workunit.client.0.smithi161.stdout:6/514: creat d6/d7/dc/d85/d31/d5d/d55/fae x:0 0 0 2024-01-17T23:39:30.332 INFO:tasks.workunit.client.0.smithi161.stdout:7/522: mkdir da/db/db2 0 2024-01-17T23:39:30.469 INFO:tasks.workunit.client.0.smithi161.stdout:8/476: symlink d1/df/d20/la6 0 2024-01-17T23:39:30.547 INFO:tasks.workunit.client.0.smithi161.stdout:5/497: rename dd/d15/d4e/c69 to dd/d15/c98 0 2024-01-17T23:39:30.547 INFO:tasks.workunit.client.0.smithi161.stdout:5/498: creat dd/d31/d56/f99 x:0 0 0 2024-01-17T23:39:31.322 INFO:tasks.workunit.client.0.smithi161.stdout:2/499: rename d8/d1c/l43 to d8/d4b/d9a/la9 0 2024-01-17T23:39:31.890 INFO:tasks.workunit.client.0.smithi161.stdout:5/499: link dd/d15/d4e/f8e dd/d15/d1a/f9a 0 2024-01-17T23:39:31.908 INFO:tasks.workunit.client.0.smithi161.stdout:4/592: rename d9/d27/l3c to d9/de/d1e/d58/d60/d8f/lb0 0 2024-01-17T23:39:31.908 INFO:tasks.workunit.client.0.smithi161.stdout:4/593: write d9/de/d1e/f40 [474676,1218] 0 2024-01-17T23:39:31.909 INFO:tasks.workunit.client.0.smithi161.stdout:4/594: creat d9/d27/d3a/fb1 x:0 0 0 2024-01-17T23:39:31.916 INFO:tasks.workunit.client.0.smithi161.stdout:4/595: dread d9/d27/d3a/d87/fa3 [0,4194304] 0 2024-01-17T23:39:31.916 INFO:tasks.workunit.client.0.smithi161.stdout:4/596: chown d9/d1b/d24/d25/f47 7177844 1 2024-01-17T23:39:32.078 INFO:tasks.workunit.client.0.smithi161.stdout:2/500: mknod d8/d67/d6c/caa 0 2024-01-17T23:39:32.079 INFO:tasks.workunit.client.0.smithi161.stdout:2/501: dread d8/d1c/d1e/da6/d35/d3a/f71 [0,4194304] 0 2024-01-17T23:39:32.277 INFO:tasks.workunit.client.0.smithi161.stdout:6/515: link d6/d7/dc/d85/d31/c54 d6/caf 0 2024-01-17T23:39:32.277 INFO:tasks.workunit.client.0.smithi161.stdout:9/412: sync 2024-01-17T23:39:32.277 INFO:tasks.workunit.client.0.smithi161.stdout:6/516: chown d6/d7/dc/d85/d13/c7d 131 1 2024-01-17T23:39:32.278 INFO:tasks.workunit.client.0.smithi161.stdout:6/517: chown d6/d7/dc/d3c/f8c 61627 1 2024-01-17T23:39:32.278 INFO:tasks.workunit.client.0.smithi161.stdout:9/413: creat d0/d8/d14/d18/d63/f89 x:0 0 0 2024-01-17T23:39:32.302 INFO:tasks.workunit.client.0.smithi161.stdout:6/518: dwrite d6/d7/dc/d85/d1a/d59/f83 [0,4194304] 0 2024-01-17T23:39:32.302 INFO:tasks.workunit.client.0.smithi161.stdout:6/519: chown d6/d7/dc/d1d/f5e 4108 1 2024-01-17T23:39:32.313 INFO:tasks.workunit.client.0.smithi161.stdout:6/520: write d6/d7/dc/d43/d76/fa7 [2842632,51983] 0 2024-01-17T23:39:32.522 INFO:tasks.workunit.client.0.smithi161.stdout:1/559: rename d1/d20/d26/d30/d8f/f9a to d1/d8/d1f/fbb 0 2024-01-17T23:39:32.660 INFO:tasks.workunit.client.0.smithi161.stdout:4/597: unlink d9/de/l80 0 2024-01-17T23:39:32.949 INFO:tasks.workunit.client.0.smithi161.stdout:2/502: link d8/da/d52/c70 d8/da/cab 0 2024-01-17T23:39:32.949 INFO:tasks.workunit.client.0.smithi161.stdout:2/503: fsync d8/d1c/d1e/da6/d35/f89 0 2024-01-17T23:39:33.069 INFO:tasks.workunit.client.0.smithi161.stdout:9/414: symlink d0/d8/d31/d73/l8a 0 2024-01-17T23:39:33.096 INFO:tasks.workunit.client.0.smithi161.stdout:9/415: dwrite d0/d8/f5f [0,4194304] 0 2024-01-17T23:39:33.179 INFO:tasks.workunit.client.0.smithi161.stdout:6/521: symlink d6/d7/dc/d43/d76/d90/lb0 0 2024-01-17T23:39:33.179 INFO:tasks.workunit.client.0.smithi161.stdout:6/522: creat d6/d7/dc/d85/d31/d5d/d55/fb1 x:0 0 0 2024-01-17T23:39:33.180 INFO:tasks.workunit.client.0.smithi161.stdout:6/523: chown d6/d7/dc/d85/d1a/d59/f83 1446699 1 2024-01-17T23:39:33.180 INFO:tasks.workunit.client.0.smithi161.stdout:6/524: fdatasync d6/d7/dc/d43/d76/f86 0 2024-01-17T23:39:33.418 INFO:tasks.workunit.client.0.smithi161.stdout:0/545: rename d5/d34/f45 to d5/d34/d21/d76/fae 0 2024-01-17T23:39:33.549 INFO:tasks.workunit.client.0.smithi161.stdout:1/560: truncate d1/d8/f5a 3981996 0 2024-01-17T23:39:33.549 INFO:tasks.workunit.client.0.smithi161.stdout:1/561: fsync d1/d8/d1f/f49 0 2024-01-17T23:39:34.920 INFO:tasks.workunit.client.0.smithi161.stdout:2/504: truncate d8/d1c/d1e/f38 978919 0 2024-01-17T23:39:35.106 INFO:tasks.workunit.client.0.smithi161.stdout:9/416: mknod d0/d8/c8b 0 2024-01-17T23:39:35.385 INFO:tasks.workunit.client.0.smithi161.stdout:6/525: rmdir d6 39 2024-01-17T23:39:35.412 INFO:tasks.workunit.client.0.smithi161.stdout:6/526: dwrite d6/d7/dc/d85/d13/f28 [0,4194304] 0 2024-01-17T23:39:35.538 INFO:tasks.workunit.client.0.smithi161.stdout:3/534: rename d0/d5/d9/d38/d4f/f80 to d0/d5/d9/d38/d4f/d56/fb8 0 2024-01-17T23:39:35.538 INFO:tasks.workunit.client.0.smithi161.stdout:3/535: chown d0/d5/d9/d38/f74 1701 1 2024-01-17T23:39:35.553 INFO:tasks.workunit.client.0.smithi161.stdout:3/536: write d0/d5/d9/d1e/d5a/f87 [3915892,106470] 0 2024-01-17T23:39:35.553 INFO:tasks.workunit.client.0.smithi161.stdout:3/537: fdatasync d0/d5/d9/d1e/f7a 0 2024-01-17T23:39:35.553 INFO:tasks.workunit.client.0.smithi161.stdout:3/538: readlink d0/d5/l31 0 2024-01-17T23:39:35.553 INFO:tasks.workunit.client.0.smithi161.stdout:3/539: stat d0/d5/d9/d17/f9c 0 2024-01-17T23:39:35.803 INFO:tasks.workunit.client.0.smithi161.stdout:0/546: symlink d5/d34/d21/laf 0 2024-01-17T23:39:36.566 INFO:tasks.workunit.client.0.smithi161.stdout:8/477: rmdir d1 39 2024-01-17T23:39:36.574 INFO:tasks.workunit.client.0.smithi161.stdout:8/478: write d1/df/f31 [105889,5829] 0 2024-01-17T23:39:36.812 INFO:tasks.workunit.client.0.smithi161.stdout:4/598: sync 2024-01-17T23:39:36.812 INFO:tasks.workunit.client.0.smithi161.stdout:4/599: readlink d9/d27/la8 0 2024-01-17T23:39:37.070 INFO:tasks.workunit.client.0.smithi161.stdout:2/505: creat d8/d67/fac x:0 0 0 2024-01-17T23:39:37.742 INFO:tasks.workunit.client.0.smithi161.stdout:7/523: rename da/d34/l4d to da/d34/d5a/d68/d8c/lb3 0 2024-01-17T23:39:37.844 INFO:tasks.workunit.client.0.smithi161.stdout:1/562: sync 2024-01-17T23:39:38.205 INFO:tasks.workunit.client.0.smithi161.stdout:0/547: mkdir d5/d8/d68/db0 0 2024-01-17T23:39:38.212 INFO:tasks.workunit.client.0.smithi161.stdout:8/479: creat d1/d22/d2f/d92/fa7 x:0 0 0 2024-01-17T23:39:38.344 INFO:tasks.workunit.client.0.smithi161.stdout:4/600: link d9/d27/d68/l79 d9/de/d1e/d58/d60/d9c/lb2 0 2024-01-17T23:39:38.638 INFO:tasks.workunit.client.0.smithi161.stdout:5/500: rename dd/d15/d1a/l2b to dd/d31/d3c/l9b 0 2024-01-17T23:39:38.865 INFO:tasks.workunit.client.0.smithi161.stdout:7/524: mknod da/d34/d5a/d28/d43/da4/cb4 0 2024-01-17T23:39:38.894 INFO:tasks.workunit.client.0.smithi161.stdout:7/525: dwrite da/d34/d69/f7c [0,4194304] 0 2024-01-17T23:39:39.002 INFO:tasks.workunit.client.0.smithi161.stdout:2/506: unlink d8/f4f 0 2024-01-17T23:39:39.271 INFO:tasks.workunit.client.0.smithi161.stdout:1/563: mknod d1/d8/cbc 0 2024-01-17T23:39:39.292 INFO:tasks.workunit.client.0.smithi161.stdout:1/564: dread d1/d20/d26/d30/d8f/d9e/f98 [0,4194304] 0 2024-01-17T23:39:39.382 INFO:tasks.workunit.client.0.smithi161.stdout:0/548: truncate d5/d3a/d49/d99/f31 1509059 0 2024-01-17T23:39:39.382 INFO:tasks.workunit.client.0.smithi161.stdout:0/549: write d5/d3a/d49/f5b [7374,124671] 0 2024-01-17T23:39:39.885 INFO:tasks.workunit.client.0.smithi161.stdout:6/527: mkdir d6/d7/dc/db2 0 2024-01-17T23:39:39.885 INFO:tasks.workunit.client.0.smithi161.stdout:9/417: write d0/d8/d31/f52 [33403,98951] 0 2024-01-17T23:39:39.885 INFO:tasks.workunit.client.0.smithi161.stdout:6/528: stat d6/d7/dc/d85/d1a/f62 0 2024-01-17T23:39:40.104 INFO:tasks.workunit.client.0.smithi161.stdout:7/526: symlink da/d34/d5a/d3b/d3d/d82/lb5 0 2024-01-17T23:39:40.195 INFO:tasks.workunit.client.0.smithi161.stdout:2/507: mknod d8/d2e/da8/cad 0 2024-01-17T23:39:40.473 INFO:tasks.workunit.client.0.smithi161.stdout:1/565: link d1/la7 d1/d8/d54/d94/lbd 0 2024-01-17T23:39:40.656 INFO:tasks.workunit.client.0.smithi161.stdout:0/550: symlink d5/d8/d68/d6b/lb1 0 2024-01-17T23:39:40.656 INFO:tasks.workunit.client.0.smithi161.stdout:0/551: fsync d5/f59 0 2024-01-17T23:39:41.040 INFO:tasks.workunit.client.0.smithi161.stdout:6/529: dread d6/f3d [0,4194304] 0 2024-01-17T23:39:41.181 INFO:tasks.workunit.client.0.smithi161.stdout:7/527: rename da/d34/d5a/d28/d2b/f84 to da/d34/d5a/d68/d8c/fb6 0 2024-01-17T23:39:41.214 INFO:tasks.workunit.client.0.smithi161.stdout:7/528: dwrite da/f26 [0,4194304] 0 2024-01-17T23:39:41.214 INFO:tasks.workunit.client.0.smithi161.stdout:7/529: fdatasync da/d34/d5a/d68/d8c/fa6 0 2024-01-17T23:39:41.214 INFO:tasks.workunit.client.0.smithi161.stdout:7/530: chown da/d14/d35/d41/l77 510978999 1 2024-01-17T23:39:41.216 INFO:tasks.workunit.client.0.smithi161.stdout:7/531: write da/d34/d5a/d68/f6b [279692,91693] 0 2024-01-17T23:39:41.408 INFO:tasks.workunit.client.0.smithi161.stdout:2/508: mkdir d8/d1c/d75/dae 0 2024-01-17T23:39:41.424 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:39:41.428 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:39:41.506 INFO:tasks.workunit.client.0.smithi161.stdout:1/566: readlink d1/d64/l70 0 2024-01-17T23:39:41.658 INFO:tasks.workunit.client.0.smithi161.stdout:9/418: mknod d0/d39/d49/c8c 0 2024-01-17T23:39:42.017 INFO:tasks.workunit.client.0.smithi161.stdout:6/530: mknod d6/d7/dc/d43/d76/cb3 0 2024-01-17T23:39:42.018 INFO:tasks.workunit.client.0.smithi161.stdout:0/552: rename d5/d34/d20/l7c to d5/d34/d20/d2d/d8d/lb2 0 2024-01-17T23:39:42.476 INFO:tasks.workunit.client.0.smithi161.stdout:2/509: mknod d8/da/d8d/caf 0 2024-01-17T23:39:42.476 INFO:tasks.workunit.client.0.smithi161.stdout:7/532: creat da/db/d7a/d8f/dac/fb7 x:0 0 0 2024-01-17T23:39:42.481 INFO:tasks.workunit.client.0.smithi161.stdout:1/567: truncate d1/d20/d26/d30/d44/f88 1779015 0 2024-01-17T23:39:42.481 INFO:tasks.workunit.client.0.smithi161.stdout:9/419: creat d0/d8/d14/d87/f8d x:0 0 0 2024-01-17T23:39:42.745 INFO:tasks.workunit.client.0.smithi161.stdout:4/601: write d9/f13 [3016109,16535] 0 2024-01-17T23:39:43.070 INFO:tasks.workunit.client.0.smithi161.stdout:0/553: getdents d5/d34/d20/d2d 0 2024-01-17T23:39:43.070 INFO:tasks.workunit.client.0.smithi161.stdout:0/554: write d5/d3a/d49/f70 [959937,22755] 0 2024-01-17T23:39:43.072 INFO:tasks.workunit.client.0.smithi161.stdout:3/540: sync 2024-01-17T23:39:43.073 INFO:tasks.workunit.client.0.smithi161.stdout:5/501: sync 2024-01-17T23:39:43.224 INFO:tasks.workunit.client.0.smithi161.stdout:7/533: mknod da/d14/d35/d41/cb8 0 2024-01-17T23:39:43.359 INFO:tasks.workunit.client.0.smithi161.stdout:2/510: mkdir d8/d4b/d9a/db0 0 2024-01-17T23:39:43.359 INFO:tasks.workunit.client.0.smithi161.stdout:2/511: stat d8/d1c/d57 0 2024-01-17T23:39:43.360 INFO:tasks.workunit.client.0.smithi161.stdout:2/512: fdatasync d8/d1c/f25 0 2024-01-17T23:39:43.752 INFO:tasks.workunit.client.0.smithi161.stdout:1/568: creat d1/d2d/d3b/fbe x:0 0 0 2024-01-17T23:39:43.753 INFO:tasks.workunit.client.0.smithi161.stdout:9/420: rename d0/d8/d31/d58/l75 to d0/d8/d14/d18/d63/l8e 0 2024-01-17T23:39:43.753 INFO:tasks.workunit.client.0.smithi161.stdout:9/421: chown d0/d8/d14/d18/d63/f89 26175285 1 2024-01-17T23:39:43.753 INFO:tasks.workunit.client.0.smithi161.stdout:9/422: creat d0/d8/d31/f8f x:0 0 0 2024-01-17T23:39:43.921 INFO:tasks.workunit.client.0.smithi161.stdout:4/602: creat d9/fb3 x:0 0 0 2024-01-17T23:39:43.921 INFO:tasks.workunit.client.0.smithi161.stdout:4/603: creat d9/de/d69/fb4 x:0 0 0 2024-01-17T23:39:43.979 INFO:tasks.workunit.client.0.smithi161.stdout:8/480: dwrite d1/d22/d2f/f3f [0,4194304] 0 2024-01-17T23:39:44.003 INFO:tasks.workunit.client.0.smithi161.stdout:8/481: dwrite d1/f2 [0,4194304] 0 2024-01-17T23:39:44.122 INFO:tasks.workunit.client.0.smithi161.stdout:0/555: mknod d5/d34/d21/cb3 0 2024-01-17T23:39:44.163 INFO:tasks.workunit.client.0.smithi161.stdout:0/556: dwrite d5/d3a/d49/d99/d96/f98 [0,4194304] 0 2024-01-17T23:39:44.163 INFO:tasks.workunit.client.0.smithi161.stdout:0/557: truncate d5/d3a/d49/f5b 441581 0 2024-01-17T23:39:44.181 INFO:tasks.workunit.client.0.smithi161.stdout:0/558: dread d5/d34/d21/f84 [0,4194304] 0 2024-01-17T23:39:44.871 INFO:tasks.workunit.client.0.smithi161.stdout:2/513: link d8/da/d52/f53 d8/da/d52/fb1 0 2024-01-17T23:39:45.090 INFO:tasks.workunit.client.0.smithi161.stdout:3/541: rename d0/d5/d9/d17/d2d/f9a to d0/d5/d9/d1e/d5a/fb9 0 2024-01-17T23:39:45.264 INFO:tasks.workunit.client.0.smithi161.stdout:9/423: chown d0/f50 12616849 1 2024-01-17T23:39:45.265 INFO:tasks.workunit.client.0.smithi161.stdout:9/424: creat d0/d8/d14/f90 x:0 0 0 2024-01-17T23:39:45.494 INFO:tasks.workunit.client.0.smithi161.stdout:8/482: creat d1/d22/d2f/d86/fa8 x:0 0 0 2024-01-17T23:39:46.323 INFO:tasks.workunit.client.0.smithi161.stdout:2/514: link d8/d4b/f9c d8/d2e/fb2 0 2024-01-17T23:39:46.362 INFO:tasks.workunit.client.0.smithi161.stdout:6/531: dwrite d6/d7/dc/d85/d31/f4e [0,4194304] 0 2024-01-17T23:39:46.368 INFO:tasks.workunit.client.0.smithi161.stdout:6/532: write d6/f7c [935995,95844] 0 2024-01-17T23:39:46.384 INFO:tasks.workunit.client.0.smithi161.stdout:1/569: rmdir d1/d20/d26/d30/d8f/d9e/dae 39 2024-01-17T23:39:46.403 INFO:tasks.workunit.client.0.smithi161.stdout:1/570: dread d1/d8/f1b [0,4194304] 0 2024-01-17T23:39:46.403 INFO:tasks.workunit.client.0.smithi161.stdout:1/571: fsync d1/f38 0 2024-01-17T23:39:46.403 INFO:tasks.workunit.client.0.smithi161.stdout:1/572: dread - d1/d8/d1c/f53 zero size 2024-01-17T23:39:47.023 INFO:tasks.workunit.client.0.smithi161.stdout:9/425: write d0/f4 [2391845,23] 0 2024-01-17T23:39:47.023 INFO:tasks.workunit.client.0.smithi161.stdout:9/426: write d0/d8/f7a [228389,37926] 0 2024-01-17T23:39:47.558 INFO:tasks.workunit.client.0.smithi161.stdout:0/559: mkdir d5/d3a/db4 0 2024-01-17T23:39:47.777 INFO:tasks.workunit.client.0.smithi161.stdout:6/533: mkdir d6/d7/dc/d3c/db4 0 2024-01-17T23:39:47.859 INFO:tasks.workunit.client.0.smithi161.stdout:1/573: stat d1/l5 0 2024-01-17T23:39:48.195 INFO:tasks.workunit.client.0.smithi161.stdout:6/534: mknod d6/d7/dc/d85/d1a/d59/cb5 0 2024-01-17T23:39:48.221 INFO:tasks.workunit.client.0.smithi161.stdout:6/535: dwrite d6/d7/dc/d85/d31/d5d/f46 [0,4194304] 0 2024-01-17T23:39:48.330 INFO:tasks.workunit.client.0.smithi161.stdout:5/502: sync 2024-01-17T23:39:48.556 INFO:tasks.workunit.client.0.smithi161.stdout:6/536: symlink d6/d58/lb6 0 2024-01-17T23:39:48.874 INFO:tasks.workunit.client.0.smithi161.stdout:5/503: unlink dd/d15/d1a/c2a 0 2024-01-17T23:39:48.874 INFO:tasks.workunit.client.0.smithi161.stdout:6/537: link d6/d7/dc/d85/d31/d5d/f36 d6/d7/fb7 0 2024-01-17T23:39:48.874 INFO:tasks.workunit.client.0.smithi161.stdout:5/504: fdatasync dd/d15/d1a/d42/f46 0 2024-01-17T23:39:48.874 INFO:tasks.workunit.client.0.smithi161.stdout:6/538: dread - d6/d7/dc/d85/d31/d5d/d55/fae zero size 2024-01-17T23:39:49.047 INFO:tasks.workunit.client.0.smithi161.stdout:5/505: creat dd/d15/f9c x:0 0 0 2024-01-17T23:39:49.140 INFO:tasks.workunit.client.0.smithi161.stdout:6/539: link d6/d7/dc/d43/f64 d6/d7/dc/d43/d76/d90/fb8 0 2024-01-17T23:39:49.248 INFO:tasks.workunit.client.0.smithi161.stdout:5/506: unlink dd/d31/d3c/f4b 0 2024-01-17T23:39:49.248 INFO:tasks.workunit.client.0.smithi161.stdout:5/507: dread - dd/d15/d1a/d5d/f65 zero size 2024-01-17T23:39:49.620 INFO:tasks.workunit.client.0.smithi161.stdout:6/540: mkdir d6/d7/dc/d43/db9 0 2024-01-17T23:39:49.620 INFO:tasks.workunit.client.0.smithi161.stdout:6/541: fdatasync d6/d7/dc/d85/d31/d5d/d55/f6b 0 2024-01-17T23:39:49.622 INFO:tasks.workunit.client.0.smithi161.stdout:4/604: sync 2024-01-17T23:39:49.623 INFO:tasks.workunit.client.0.smithi161.stdout:4/605: fdatasync d9/d27/d68/d6d/f78 0 2024-01-17T23:39:49.990 INFO:tasks.workunit.client.0.smithi161.stdout:6/542: creat d6/d7/dc/d85/d1a/d59/fba x:0 0 0 2024-01-17T23:39:50.127 INFO:tasks.workunit.client.0.smithi161.stdout:4/606: symlink d9/d1b/d24/d25/d5b/lb5 0 2024-01-17T23:39:50.496 INFO:tasks.workunit.client.0.smithi161.stdout:6/543: unlink d6/d7/dc/d43/d76/cb3 0 2024-01-17T23:39:50.496 INFO:tasks.workunit.client.0.smithi161.stdout:4/607: mknod d9/d27/d3a/d87/cb6 0 2024-01-17T23:39:50.496 INFO:tasks.workunit.client.0.smithi161.stdout:6/544: write d6/d7/dc/d85/d31/d5d/d55/fae [433188,8662] 0 2024-01-17T23:39:50.496 INFO:tasks.workunit.client.0.smithi161.stdout:6/545: readlink d6/d7/dc/d85/d31/l69 0 2024-01-17T23:39:50.981 INFO:tasks.workunit.client.0.smithi161.stdout:4/608: rmdir d9/de/d1e/d58/d60 39 2024-01-17T23:39:50.981 INFO:tasks.workunit.client.0.smithi161.stdout:4/609: readlink d9/d1b/l3e 0 2024-01-17T23:39:50.983 INFO:tasks.workunit.client.0.smithi161.stdout:3/542: write d0/d5/d9/d38/d4f/d56/fa6 [734157,86426] 0 2024-01-17T23:39:51.013 INFO:tasks.workunit.client.0.smithi161.stdout:1/574: write d1/d2d/f6f [531060,51341] 0 2024-01-17T23:39:51.013 INFO:tasks.workunit.client.0.smithi161.stdout:1/575: stat d1/d20/d26/d30/f5f 0 2024-01-17T23:39:51.374 INFO:tasks.workunit.client.0.smithi161.stdout:4/610: truncate d9/de/d1e/f40 2006103 0 2024-01-17T23:39:51.374 INFO:tasks.workunit.client.0.smithi161.stdout:4/611: creat d9/d1b/d24/d25/d5b/fb7 x:0 0 0 2024-01-17T23:39:51.374 INFO:tasks.workunit.client.0.smithi161.stdout:4/612: fsync d9/d27/d3a/fac 0 2024-01-17T23:39:51.616 INFO:tasks.workunit.client.0.smithi161.stdout:1/576: link d1/d11/f76 d1/d8/d9d/fbf 0 2024-01-17T23:39:51.616 INFO:tasks.workunit.client.0.smithi161.stdout:1/577: truncate d1/d20/d26/f68 302878 0 2024-01-17T23:39:51.888 INFO:tasks.workunit.client.0.smithi161.stdout:4/613: unlink d9/d27/d3a/fb1 0 2024-01-17T23:39:52.005 INFO:tasks.workunit.client.0.smithi161.stdout:3/543: symlink d0/d5/d9/d38/d4f/d9d/da7/lba 0 2024-01-17T23:39:52.005 INFO:tasks.workunit.client.0.smithi161.stdout:3/544: fsync d0/d5/d9/f64 0 2024-01-17T23:39:52.005 INFO:tasks.workunit.client.0.smithi161.stdout:3/545: read d0/d5/d9/d1e/f7a [4014731,7750] 0 2024-01-17T23:39:52.281 INFO:tasks.workunit.client.0.smithi161.stdout:4/614: creat d9/d27/fb8 x:0 0 0 2024-01-17T23:39:52.514 INFO:tasks.workunit.client.0.smithi161.stdout:3/546: creat d0/d5/d9/d1e/d3b/fbb x:0 0 0 2024-01-17T23:39:52.541 INFO:tasks.workunit.client.0.smithi161.stdout:3/547: dwrite d0/d5/d9/d1e/f7a [4194304,4194304] 0 2024-01-17T23:39:52.684 INFO:tasks.workunit.client.0.smithi161.stdout:4/615: unlink c5 0 2024-01-17T23:39:52.684 INFO:tasks.workunit.client.0.smithi161.stdout:4/616: truncate d9/d1b/d24/f93 540460 0 2024-01-17T23:39:52.690 INFO:tasks.workunit.client.0.smithi161.stdout:4/617: write d9/d27/d3a/d87/fa3 [430823,8168] 0 2024-01-17T23:39:52.911 INFO:tasks.workunit.client.0.smithi161.stdout:7/534: rename da/d34/d69 to da/d34/d5a/d3b/db9 0 2024-01-17T23:39:53.462 INFO:tasks.workunit.client.0.smithi161.stdout:4/618: mknod d9/de/d1e/d38/d89/cb9 0 2024-01-17T23:39:53.462 INFO:tasks.workunit.client.0.smithi161.stdout:8/483: rename d1/df/d46/f59 to d1/d3/d19/d1d/d25/d4b/fa9 0 2024-01-17T23:39:53.462 INFO:tasks.workunit.client.0.smithi161.stdout:4/619: fsync d9/fc 0 2024-01-17T23:39:53.462 INFO:tasks.workunit.client.0.smithi161.stdout:8/484: fdatasync d1/d3/d19/d1d/f36 0 2024-01-17T23:39:53.586 INFO:tasks.workunit.client.0.smithi161.stdout:7/535: mkdir da/db/d7a/d8f/dac/dba 0 2024-01-17T23:39:53.896 INFO:tasks.workunit.client.0.smithi161.stdout:2/515: rename d8/d1c/d1e to d8/d1c/d1e/db3 22 2024-01-17T23:39:53.896 INFO:tasks.workunit.client.0.smithi161.stdout:9/427: rename d0/d8 to d0/d8/d14/d87/d91 22 2024-01-17T23:39:54.079 INFO:tasks.workunit.client.0.smithi161.stdout:8/485: mkdir d1/d3/d19/d1d/daa 0 2024-01-17T23:39:54.341 INFO:tasks.workunit.client.0.smithi161.stdout:7/536: creat da/db/d7a/d8f/dac/da9/fbb x:0 0 0 2024-01-17T23:39:54.381 INFO:tasks.workunit.client.0.smithi161.stdout:2/516: chown c0 6176 1 2024-01-17T23:39:54.897 INFO:tasks.workunit.client.0.smithi161.stdout:6/546: rename d6/d7/dc/d3c/f8c to d6/d7/dc/db2/fbb 0 2024-01-17T23:39:54.897 INFO:tasks.workunit.client.0.smithi161.stdout:6/547: creat d6/d7/dc/d85/d31/d5d/d55/fbc x:0 0 0 2024-01-17T23:39:54.925 INFO:tasks.workunit.client.0.smithi161.stdout:6/548: dwrite d6/d7/dc/d85/d31/f9f [0,4194304] 0 2024-01-17T23:39:54.925 INFO:tasks.workunit.client.0.smithi161.stdout:6/549: fsync d6/d7/dc/d43/d76/f86 0 2024-01-17T23:39:55.062 INFO:tasks.workunit.client.0.smithi161.stdout:9/428: symlink d0/d39/l92 0 2024-01-17T23:39:55.293 INFO:tasks.workunit.client.0.smithi161.stdout:8/486: link d1/df/c29 d1/d55/cab 0 2024-01-17T23:39:55.293 INFO:tasks.workunit.client.0.smithi161.stdout:8/487: write d1/df/f96 [4819273,13407] 0 2024-01-17T23:39:55.320 INFO:tasks.workunit.client.0.smithi161.stdout:8/488: dwrite d1/df/d20/d6a/f91 [0,4194304] 0 2024-01-17T23:39:55.410 INFO:tasks.workunit.client.0.smithi161.stdout:7/537: rmdir da/d34/d5a/d28/d2b 39 2024-01-17T23:39:55.410 INFO:tasks.workunit.client.0.smithi161.stdout:7/538: fdatasync da/d34/d5a/d3b/d3d/d7f/fa3 0 2024-01-17T23:39:55.431 INFO:tasks.workunit.client.0.smithi161.stdout:7/539: write da/db/f13 [1438710,6238] 0 2024-01-17T23:39:55.432 INFO:tasks.workunit.client.0.smithi161.stdout:7/540: truncate da/db/d7a/d8f/dac/da9/fbb 608147 0 2024-01-17T23:39:55.467 INFO:tasks.workunit.client.0.smithi161.stdout:2/517: rmdir d8/d67/d6c/d72 39 2024-01-17T23:39:55.467 INFO:tasks.workunit.client.0.smithi161.stdout:2/518: chown d8/da/d52/fa1 7807790 1 2024-01-17T23:39:55.742 INFO:tasks.workunit.client.0.smithi161.stdout:5/508: sync 2024-01-17T23:39:55.742 INFO:tasks.workunit.client.0.smithi161.stdout:0/560: sync 2024-01-17T23:39:55.742 INFO:tasks.workunit.client.0.smithi161.stdout:5/509: write dd/d15/d1a/f43 [647548,74748] 0 2024-01-17T23:39:55.742 INFO:tasks.workunit.client.0.smithi161.stdout:0/561: write d5/d3a/fa9 [21157,67992] 0 2024-01-17T23:39:55.939 INFO:tasks.workunit.client.0.smithi161.stdout:3/548: write d0/d5/d9/d17/f33 [1822768,17334] 0 2024-01-17T23:39:55.939 INFO:tasks.workunit.client.0.smithi161.stdout:3/549: creat d0/d5/d9/d1e/d3b/d52/fbc x:0 0 0 2024-01-17T23:39:55.939 INFO:tasks.workunit.client.0.smithi161.stdout:3/550: stat d0/d5/d9/d17/d2d/fa4 0 2024-01-17T23:39:55.939 INFO:tasks.workunit.client.0.smithi161.stdout:3/551: write d0/d5/d9/d1e/d3b/d52/fa0 [988475,18668] 0 2024-01-17T23:39:55.955 INFO:tasks.workunit.client.0.smithi161.stdout:3/552: dread d0/d5/d9/d1e/d5a/f7d [0,4194304] 0 2024-01-17T23:39:56.140 INFO:tasks.workunit.client.0.smithi161.stdout:6/550: creat d6/d7/dc/d85/d1a/fbd x:0 0 0 2024-01-17T23:39:56.174 INFO:tasks.workunit.client.0.smithi161.stdout:6/551: dwrite d6/d7/fe [0,4194304] 0 2024-01-17T23:39:56.174 INFO:tasks.workunit.client.0.smithi161.stdout:6/552: chown d6/d7/dc/d85/d13/c7d 1403553481 1 2024-01-17T23:39:56.309 INFO:tasks.workunit.client.0.smithi161.stdout:9/429: creat d0/d8/d14/d56/f93 x:0 0 0 2024-01-17T23:39:56.309 INFO:tasks.workunit.client.0.smithi161.stdout:9/430: chown d0/d8/d14/d18/d20/l79 1 1 2024-01-17T23:39:56.309 INFO:tasks.workunit.client.0.smithi161.stdout:9/431: write d0/d8/d31/f68 [526126,111452] 0 2024-01-17T23:39:56.787 INFO:tasks.workunit.client.0.smithi161.stdout:1/578: symlink d1/lc0 0 2024-01-17T23:39:56.816 INFO:tasks.workunit.client.0.smithi161.stdout:1/579: dwrite d1/d20/d26/d30/d44/fa2 [0,4194304] 0 2024-01-17T23:39:56.816 INFO:tasks.workunit.client.0.smithi161.stdout:1/580: chown d1/d11 843871 1 2024-01-17T23:39:56.816 INFO:tasks.workunit.client.0.smithi161.stdout:1/581: write d1/d31/d8c/f90 [2356649,109797] 0 2024-01-17T23:39:56.892 INFO:tasks.workunit.client.0.smithi161.stdout:8/489: creat d1/d3d/fac x:0 0 0 2024-01-17T23:39:56.921 INFO:tasks.workunit.client.0.smithi161.stdout:8/490: dwrite d1/f4e [0,4194304] 0 2024-01-17T23:39:57.732 INFO:tasks.workunit.client.0.smithi161.stdout:5/510: mknod dd/d15/d1a/d42/c9d 0 2024-01-17T23:39:57.816 INFO:tasks.workunit.client.0.smithi161.stdout:0/562: getdents d5/d3a/d49/d99 0 2024-01-17T23:39:58.030 INFO:tasks.workunit.client.0.smithi161.stdout:3/553: mknod d0/d5/d9/d38/d4f/d56/cbd 0 2024-01-17T23:39:58.065 INFO:tasks.workunit.client.0.smithi161.stdout:3/554: dwrite d0/d5/d9/d1e/d5a/f7d [0,4194304] 0 2024-01-17T23:39:58.075 INFO:tasks.workunit.client.0.smithi161.stdout:3/555: dread d0/d5/d9/d1e/d3b/d52/fa0 [0,4194304] 0 2024-01-17T23:39:58.161 INFO:tasks.workunit.client.0.smithi161.stdout:6/553: getdents d6/d7/dc/d85 0 2024-01-17T23:39:58.161 INFO:tasks.workunit.client.0.smithi161.stdout:6/554: truncate d6/d7/dc/d85/d31/fa6 637705 0 2024-01-17T23:39:58.294 INFO:tasks.workunit.client.0.smithi161.stdout:9/432: truncate d0/d8/d14/f3f 1121542 0 2024-01-17T23:39:58.351 INFO:tasks.workunit.client.0.smithi161.stdout:4/620: write d9/de/d1e/d38/d6b/f7d [3201337,25151] 0 2024-01-17T23:39:58.357 INFO:tasks.workunit.client.0.smithi161.stdout:4/621: dread d9/d1b/d53/f7b [0,4194304] 0 2024-01-17T23:39:58.357 INFO:tasks.workunit.client.0.smithi161.stdout:4/622: write d9/f13 [47481,18173] 0 2024-01-17T23:39:58.476 INFO:tasks.workunit.client.0.smithi161.stdout:1/582: mkdir d1/d2d/dc1 0 2024-01-17T23:39:58.719 INFO:tasks.workunit.client.0.smithi161.stdout:8/491: rename d1/d3/cb to d1/d3/d19/d1d/cad 0 2024-01-17T23:39:58.720 INFO:tasks.workunit.client.0.smithi161.stdout:8/492: write d1/d22/d2f/f43 [1025321,101871] 0 2024-01-17T23:39:58.977 INFO:tasks.workunit.client.0.smithi161.stdout:2/519: creat d8/d67/d6c/d72/fb4 x:0 0 0 2024-01-17T23:39:58.977 INFO:tasks.workunit.client.0.smithi161.stdout:2/520: write d8/da/f27 [2865495,11053] 0 2024-01-17T23:39:59.320 INFO:tasks.workunit.client.0.smithi161.stdout:3/556: symlink d0/d5/d9/d38/d4f/lbe 0 2024-01-17T23:39:59.340 INFO:tasks.workunit.client.0.smithi161.stdout:0/563: read d5/d34/d12/f6f [917549,70205] 0 2024-01-17T23:39:59.431 INFO:tasks.workunit.client.0.smithi161.stdout:6/555: mknod d6/d7/dc/d85/d31/d5d/cbe 0 2024-01-17T23:39:59.805 INFO:tasks.workunit.client.0.smithi161.stdout:9/433: truncate d0/f4 2781392 0 2024-01-17T23:40:00.387 INFO:tasks.workunit.client.0.smithi161.stdout:7/541: write da/f15 [1784802,94874] 0 2024-01-17T23:40:00.388 INFO:tasks.workunit.client.0.smithi161.stdout:7/542: readlink da/d14/l95 0 2024-01-17T23:40:00.410 INFO:tasks.workunit.client.0.smithi161.stdout:7/543: read da/d34/d5a/d3b/db9/f7c [4486,25388] 0 2024-01-17T23:40:02.053 INFO:tasks.workunit.client.0.smithi161.stdout:3/557: creat d0/d5/d9/d38/d4f/d9d/da7/fbf x:0 0 0 2024-01-17T23:40:02.054 INFO:tasks.workunit.client.0.smithi161.stdout:3/558: readlink d0/d5/d9/d1e/d3b/l41 0 2024-01-17T23:40:02.068 INFO:tasks.workunit.client.0.smithi161.stdout:3/559: dread d0/d5/d9/d1e/d5a/d8a/f92 [0,4194304] 0 2024-01-17T23:40:02.219 INFO:tasks.workunit.client.0.smithi161.stdout:6/556: symlink d6/d7/dc/d85/d31/d5d/d55/lbf 0 2024-01-17T23:40:02.936 INFO:tasks.workunit.client.0.smithi161.stdout:7/544: mkdir da/db/db2/dbc 0 2024-01-17T23:40:02.936 INFO:tasks.workunit.client.0.smithi161.stdout:5/511: rename dd/d31/c5e to dd/d15/d4e/c9e 0 2024-01-17T23:40:02.937 INFO:tasks.workunit.client.0.smithi161.stdout:7/545: creat da/d34/d5a/d68/d8c/fbd x:0 0 0 2024-01-17T23:40:02.937 INFO:tasks.workunit.client.0.smithi161.stdout:7/546: chown da/d14/c71 63311928 1 2024-01-17T23:40:02.977 INFO:tasks.workunit.client.0.smithi161.stdout:7/547: dwrite da/d34/d5a/d3b/db9/f7c [0,4194304] 0 2024-01-17T23:40:03.011 INFO:tasks.workunit.client.0.smithi161.stdout:7/548: dwrite da/d14/f18 [4194304,4194304] 0 2024-01-17T23:40:03.012 INFO:tasks.workunit.client.0.smithi161.stdout:7/549: write da/db/d7a/d8f/dac/da9/fbb [332781,116060] 0 2024-01-17T23:40:03.012 INFO:tasks.workunit.client.0.smithi161.stdout:7/550: chown da/d34/d5a/f91 49 1 2024-01-17T23:40:03.078 INFO:tasks.workunit.client.0.smithi161.stdout:9/434: write d0/f4 [3743915,11320] 0 2024-01-17T23:40:03.078 INFO:tasks.workunit.client.0.smithi161.stdout:9/435: write d0/d8/d31/f8f [950775,61503] 0 2024-01-17T23:40:03.107 INFO:tasks.workunit.client.0.smithi161.stdout:3/560: dread d0/d5/d9/d17/d32/f89 [0,4194304] 0 2024-01-17T23:40:03.124 INFO:tasks.workunit.client.0.smithi161.stdout:3/561: write d0/d5/d9/d1e/d5a/d8a/f92 [2031594,77683] 0 2024-01-17T23:40:03.139 INFO:tasks.workunit.client.0.smithi161.stdout:3/562: dread d0/d5/d9/d1e/d3b/d52/f67 [0,4194304] 0 2024-01-17T23:40:03.474 INFO:tasks.workunit.client.0.smithi161.stdout:0/564: rename d5/d34/d20/d2b/fa0 to d5/d3a/d49/fb5 0 2024-01-17T23:40:03.755 INFO:tasks.workunit.client.0.smithi161.stdout:9/436: mknod d0/d8/d14/d18/d63/c94 0 2024-01-17T23:40:03.755 INFO:tasks.workunit.client.0.smithi161.stdout:9/437: fdatasync d0/d8/d31/f71 0 2024-01-17T23:40:03.755 INFO:tasks.workunit.client.0.smithi161.stdout:9/438: creat d0/d8/d14/d18/d63/f95 x:0 0 0 2024-01-17T23:40:03.755 INFO:tasks.workunit.client.0.smithi161.stdout:9/439: chown d0/d8/d14/d56/f93 16595 1 2024-01-17T23:40:03.918 INFO:tasks.workunit.client.0.smithi161.stdout:3/563: creat d0/d5/d9/d38/d4f/d50/fc0 x:0 0 0 2024-01-17T23:40:04.105 INFO:tasks.workunit.client.0.smithi161.stdout:5/512: rename dd/d15/f19 to dd/d15/d6a/d80/f9f 0 2024-01-17T23:40:04.412 INFO:tasks.workunit.client.0.smithi161.stdout:3/564: mknod d0/d5/d9/d17/d5c/cc1 0 2024-01-17T23:40:04.803 INFO:tasks.workunit.client.0.smithi161.stdout:4/623: sync 2024-01-17T23:40:04.803 INFO:tasks.workunit.client.0.smithi161.stdout:4/624: chown d9/d27/d3a/fac 27 1 2024-01-17T23:40:05.024 INFO:tasks.workunit.client.0.smithi161.stdout:1/583: dwrite d1/d8/f5a [4194304,4194304] 0 2024-01-17T23:40:05.274 INFO:tasks.workunit.client.0.smithi161.stdout:0/565: rmdir d5/d34/d21/d76 39 2024-01-17T23:40:05.274 INFO:tasks.workunit.client.0.smithi161.stdout:0/566: truncate d5/f59 682057 0 2024-01-17T23:40:05.274 INFO:tasks.workunit.client.0.smithi161.stdout:0/567: fsync d5/d34/d20/d2b/f56 0 2024-01-17T23:40:05.487 INFO:tasks.workunit.client.0.smithi161.stdout:3/565: mknod d0/d5/d9/d38/db3/cc2 0 2024-01-17T23:40:05.651 INFO:tasks.workunit.client.0.smithi161.stdout:4/625: truncate d9/f13 4208659 0 2024-01-17T23:40:05.778 INFO:tasks.workunit.client.0.smithi161.stdout:2/521: write d8/d4b/f85 [1241684,12138] 0 2024-01-17T23:40:05.972 INFO:tasks.workunit.client.0.smithi161.stdout:1/584: unlink d1/d11/d72/cad 0 2024-01-17T23:40:06.351 INFO:tasks.workunit.client.0.smithi161.stdout:0/568: link d5/d3a/d49/fa2 d5/d3a/d49/d99/d96/fb6 0 2024-01-17T23:40:06.428 INFO:tasks.workunit.client.0.smithi161.stdout:3/566: mknod d0/d5/d9/d17/d5c/cc3 0 2024-01-17T23:40:06.429 INFO:tasks.workunit.client.0.smithi161.stdout:3/567: chown d0/d5/c14 9691709 1 2024-01-17T23:40:06.452 INFO:tasks.workunit.client.0.smithi161.stdout:3/568: dread d0/d5/d9/f64 [0,4194304] 0 2024-01-17T23:40:07.027 INFO:tasks.workunit.client.0.smithi161.stdout:2/522: creat d8/d1c/d1e/da6/d35/fb5 x:0 0 0 2024-01-17T23:40:07.179 INFO:tasks.workunit.client.0.smithi161.stdout:1/585: rmdir d1/d20/d26/d30/d8f/d9e/dae/db0 0 2024-01-17T23:40:07.180 INFO:tasks.workunit.client.0.smithi161.stdout:1/586: write d1/d8/d9d/fbf [419494,85394] 0 2024-01-17T23:40:07.318 INFO:tasks.workunit.client.0.smithi161.stdout:0/569: creat d5/d3a/db4/fb7 x:0 0 0 2024-01-17T23:40:07.359 INFO:tasks.workunit.client.0.smithi161.stdout:8/493: dwrite d1/df/d20/d6a/f78 [0,4194304] 0 2024-01-17T23:40:07.368 INFO:tasks.workunit.client.0.smithi161.stdout:3/569: creat d0/d5/d9/d8b/fc4 x:0 0 0 2024-01-17T23:40:07.368 INFO:tasks.workunit.client.0.smithi161.stdout:3/570: chown d0/d5/c14 374965382 1 2024-01-17T23:40:07.385 INFO:tasks.workunit.client.0.smithi161.stdout:8/494: write d1/d3d/f40 [991739,39207] 0 2024-01-17T23:40:07.400 INFO:tasks.workunit.client.0.smithi161.stdout:8/495: dread d1/d3/f12 [0,4194304] 0 2024-01-17T23:40:07.401 INFO:tasks.workunit.client.0.smithi161.stdout:3/571: dwrite d0/d5/f19 [0,4194304] 0 2024-01-17T23:40:07.427 INFO:tasks.workunit.client.0.smithi161.stdout:3/572: dwrite d0/d5/d9/d17/d2d/f94 [0,4194304] 0 2024-01-17T23:40:07.428 INFO:tasks.workunit.client.0.smithi161.stdout:3/573: fsync d0/d5/d9/d1e/d3b/fbb 0 2024-01-17T23:40:07.441 INFO:tasks.workunit.client.0.smithi161.stdout:3/574: dread d0/d5/d9/f64 [0,4194304] 0 2024-01-17T23:40:07.467 INFO:tasks.workunit.client.0.smithi161.stdout:2/523: creat d8/d2e/da8/fb6 x:0 0 0 2024-01-17T23:40:07.499 INFO:tasks.workunit.client.0.smithi161.stdout:2/524: dwrite d8/d2e/f95 [0,4194304] 0 2024-01-17T23:40:07.499 INFO:tasks.workunit.client.0.smithi161.stdout:2/525: chown d8/d67/d6c 4 1 2024-01-17T23:40:07.499 INFO:tasks.workunit.client.0.smithi161.stdout:2/526: readlink d8/d2e/l2b 0 2024-01-17T23:40:07.699 INFO:tasks.workunit.client.0.smithi161.stdout:1/587: creat d1/d8/d54/d94/fc2 x:0 0 0 2024-01-17T23:40:07.699 INFO:tasks.workunit.client.0.smithi161.stdout:6/557: write d6/d7/dc/f4b [1315332,40899] 0 2024-01-17T23:40:07.782 INFO:tasks.workunit.client.0.smithi161.stdout:0/570: unlink d5/d34/d20/d2b/d64/d88/fad 0 2024-01-17T23:40:07.782 INFO:tasks.workunit.client.0.smithi161.stdout:0/571: chown d5/d34/d21/l8c 162032 1 2024-01-17T23:40:07.816 INFO:tasks.workunit.client.0.smithi161.stdout:0/572: dwrite d5/d34/d20/d2b/f69 [0,4194304] 0 2024-01-17T23:40:07.823 INFO:tasks.workunit.client.0.smithi161.stdout:0/573: dread d5/d34/d21/f3b [0,4194304] 0 2024-01-17T23:40:08.107 INFO:tasks.workunit.client.0.smithi161.stdout:3/575: link d0/d5/d9/d38/d4f/da5/fb5 d0/d5/d9/d17/fc5 0 2024-01-17T23:40:08.312 INFO:tasks.workunit.client.0.smithi161.stdout:6/558: unlink d6/d7/dc/d85/d31/d5d/d55/f6b 0 2024-01-17T23:40:08.401 INFO:tasks.workunit.client.0.smithi161.stdout:1/588: creat d1/d20/fc3 x:0 0 0 2024-01-17T23:40:08.785 INFO:tasks.workunit.client.0.smithi161.stdout:0/574: creat d5/d8/d68/fb8 x:0 0 0 2024-01-17T23:40:08.785 INFO:tasks.workunit.client.0.smithi161.stdout:0/575: chown d5/d34/d20 844 1 2024-01-17T23:40:08.933 INFO:tasks.workunit.client.0.smithi161.stdout:9/440: dwrite d0/d8/d14/f3f [0,4194304] 0 2024-01-17T23:40:08.933 INFO:tasks.workunit.client.0.smithi161.stdout:9/441: chown d0/d8/c2d 262 1 2024-01-17T23:40:09.093 INFO:tasks.workunit.client.0.smithi161.stdout:6/559: dwrite d6/d7/dc/d43/d79/f8a [0,4194304] 0 2024-01-17T23:40:09.118 INFO:tasks.workunit.client.0.smithi161.stdout:6/560: dwrite d6/d7/dc/d85/f98 [0,4194304] 0 2024-01-17T23:40:09.118 INFO:tasks.workunit.client.0.smithi161.stdout:6/561: chown d6/d7 87718912 1 2024-01-17T23:40:09.118 INFO:tasks.workunit.client.0.smithi161.stdout:6/562: write d6/d7/dc/d43/f74 [5224470,118847] 0 2024-01-17T23:40:09.130 INFO:tasks.workunit.client.0.smithi161.stdout:1/589: creat d1/d2d/d3b/fc4 x:0 0 0 2024-01-17T23:40:09.177 INFO:tasks.workunit.client.0.smithi161.stdout:1/590: dwrite d1/d31/d4e/f74 [0,4194304] 0 2024-01-17T23:40:09.468 INFO:tasks.workunit.client.0.smithi161.stdout:9/442: read d0/f30 [792741,42100] 0 2024-01-17T23:40:10.033 INFO:tasks.workunit.client.0.smithi161.stdout:1/591: rmdir d1/d20/d26/d30/d44 39 2024-01-17T23:40:10.033 INFO:tasks.workunit.client.0.smithi161.stdout:1/592: chown d1/d20/d26/d32/l50 72 1 2024-01-17T23:40:10.033 INFO:tasks.workunit.client.0.smithi161.stdout:1/593: creat d1/d2d/fc5 x:0 0 0 2024-01-17T23:40:10.121 INFO:tasks.workunit.client.0.smithi161.stdout:9/443: dwrite d0/d39/d49/d6e/f80 [0,4194304] 0 2024-01-17T23:40:10.517 INFO:tasks.workunit.client.0.smithi161.stdout:1/594: creat d1/d8/d54/fc6 x:0 0 0 2024-01-17T23:40:10.518 INFO:tasks.workunit.client.0.smithi161.stdout:1/595: creat d1/d8/d54/d94/fc7 x:0 0 0 2024-01-17T23:40:11.194 INFO:tasks.workunit.client.0.smithi161.stdout:1/596: symlink d1/d20/d26/lc8 0 2024-01-17T23:40:11.479 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:40:11.484 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:40:11.581 INFO:tasks.workunit.client.0.smithi161.stdout:7/551: rename da/f62 to da/da7/fbe 0 2024-01-17T23:40:11.581 INFO:tasks.workunit.client.0.smithi161.stdout:0/576: getdents d5/d3a/d49/d99/d96 0 2024-01-17T23:40:11.599 INFO:tasks.workunit.client.0.smithi161.stdout:7/552: dread da/d34/d4a/d4c/f6e [0,4194304] 0 2024-01-17T23:40:11.599 INFO:tasks.workunit.client.0.smithi161.stdout:7/553: chown da/d34/d4a/d4c/f94 92619 1 2024-01-17T23:40:11.611 INFO:tasks.workunit.client.0.smithi161.stdout:7/554: dread da/d34/f4f [4194304,4194304] 0 2024-01-17T23:40:11.626 INFO:tasks.workunit.client.0.smithi161.stdout:7/555: read da/d34/d4a/d4c/f6e [197383,103230] 0 2024-01-17T23:40:11.690 INFO:tasks.workunit.client.0.smithi161.stdout:1/597: symlink d1/d2d/d3b/lc9 0 2024-01-17T23:40:11.690 INFO:tasks.workunit.client.0.smithi161.stdout:1/598: dread - d1/d8/d1c/f53 zero size 2024-01-17T23:40:11.911 INFO:tasks.workunit.client.0.smithi161.stdout:2/527: rename d8/d68/f6d to d8/da/d52/fb7 0 2024-01-17T23:40:11.912 INFO:tasks.workunit.client.0.smithi161.stdout:4/626: write d9/d51/f54 [2476307,54895] 0 2024-01-17T23:40:11.912 INFO:tasks.workunit.client.0.smithi161.stdout:4/627: chown d9/d1b/d53/l55 19971863 1 2024-01-17T23:40:11.930 INFO:tasks.workunit.client.0.smithi161.stdout:4/628: dread d9/de/f33 [0,4194304] 0 2024-01-17T23:40:11.930 INFO:tasks.workunit.client.0.smithi161.stdout:4/629: chown d9/d27/d68/d6d/f78 5 1 2024-01-17T23:40:11.939 INFO:tasks.workunit.client.0.smithi161.stdout:2/528: dwrite d8/d1c/d1e/f9d [0,4194304] 0 2024-01-17T23:40:12.151 INFO:tasks.workunit.client.0.smithi161.stdout:0/577: symlink d5/d8/d68/d6b/lb9 0 2024-01-17T23:40:12.151 INFO:tasks.workunit.client.0.smithi161.stdout:0/578: readlink d5/l41 0 2024-01-17T23:40:12.225 INFO:tasks.workunit.client.0.smithi161.stdout:1/599: creat d1/d31/fca x:0 0 0 2024-01-17T23:40:12.249 INFO:tasks.workunit.client.0.smithi161.stdout:1/600: write d1/d20/d26/d30/f77 [1862284,121168] 0 2024-01-17T23:40:12.268 INFO:tasks.workunit.client.0.smithi161.stdout:1/601: dread d1/d20/f5c [0,4194304] 0 2024-01-17T23:40:13.077 INFO:tasks.workunit.client.0.smithi161.stdout:3/576: rename d0/d5/d9/d1e/d3b/d52/f5d to d0/d5/d9/d17/fc6 0 2024-01-17T23:40:13.103 INFO:tasks.workunit.client.0.smithi161.stdout:3/577: dwrite d0/d5/d9/d8b/fc4 [0,4194304] 0 2024-01-17T23:40:13.440 INFO:tasks.workunit.client.0.smithi161.stdout:0/579: getdents d5/d34/d21/d76 0 2024-01-17T23:40:13.459 INFO:tasks.workunit.client.0.smithi161.stdout:0/580: write d5/d34/d12/f1d [2869985,78879] 0 2024-01-17T23:40:13.488 INFO:tasks.workunit.client.0.smithi161.stdout:0/581: dwrite d5/d8/f9 [0,4194304] 0 2024-01-17T23:40:13.488 INFO:tasks.workunit.client.0.smithi161.stdout:0/582: fsync d5/d34/d20/d2b/f69 0 2024-01-17T23:40:13.488 INFO:tasks.workunit.client.0.smithi161.stdout:0/583: chown d5/d34/d12/d2a/d35/f8e 312 1 2024-01-17T23:40:13.489 INFO:tasks.workunit.client.0.smithi161.stdout:0/584: chown d5/d3a/d49/c9c 1 1 2024-01-17T23:40:15.223 INFO:tasks.workunit.client.0.smithi161.stdout:4/630: symlink d9/de/lba 0 2024-01-17T23:40:15.254 INFO:tasks.workunit.client.0.smithi161.stdout:4/631: dwrite d9/de/f45 [0,4194304] 0 2024-01-17T23:40:15.271 INFO:tasks.workunit.client.0.smithi161.stdout:5/513: sync 2024-01-17T23:40:15.439 INFO:tasks.workunit.client.0.smithi161.stdout:7/556: dwrite da/d34/d5a/f85 [0,4194304] 0 2024-01-17T23:40:15.862 INFO:tasks.workunit.client.0.smithi161.stdout:5/514: symlink dd/d15/d4e/d4f/la0 0 2024-01-17T23:40:15.862 INFO:tasks.workunit.client.0.smithi161.stdout:8/496: symlink d1/df/lae 0 2024-01-17T23:40:15.862 INFO:tasks.workunit.client.0.smithi161.stdout:8/497: chown d1/d22/d2f 7446 1 2024-01-17T23:40:16.002 INFO:tasks.workunit.client.0.smithi161.stdout:7/557: truncate da/d34/f7d 13681 0 2024-01-17T23:40:16.138 INFO:tasks.workunit.client.0.smithi161.stdout:0/585: rmdir d5/d3a/db4 39 2024-01-17T23:40:16.138 INFO:tasks.workunit.client.0.smithi161.stdout:0/586: dread - d5/d3a/db4/fb7 zero size 2024-01-17T23:40:16.138 INFO:tasks.workunit.client.0.smithi161.stdout:0/587: dread - d5/d34/d20/d2b/f91 zero size 2024-01-17T23:40:16.224 INFO:tasks.workunit.client.0.smithi161.stdout:8/498: dread d1/d3/d19/d1d/d25/f39 [0,4194304] 0 2024-01-17T23:40:16.545 INFO:tasks.workunit.client.0.smithi161.stdout:0/588: truncate d5/d3a/d49/d99/f31 1467091 0 2024-01-17T23:40:16.771 INFO:tasks.workunit.client.0.smithi161.stdout:3/578: rmdir d0/d5/d9/d1e/d3b 39 2024-01-17T23:40:16.771 INFO:tasks.workunit.client.0.smithi161.stdout:8/499: creat d1/df/faf x:0 0 0 2024-01-17T23:40:17.072 INFO:tasks.workunit.client.0.smithi161.stdout:0/589: mknod d5/d34/d20/d2b/cba 0 2024-01-17T23:40:17.073 INFO:tasks.workunit.client.0.smithi161.stdout:3/579: mknod d0/d5/d9/d38/db3/db4/cc7 0 2024-01-17T23:40:17.073 INFO:tasks.workunit.client.0.smithi161.stdout:3/580: dread - d0/d5/d9/d1e/d3b/f6f zero size 2024-01-17T23:40:17.073 INFO:tasks.workunit.client.0.smithi161.stdout:2/529: write d8/d1c/f49 [4816748,45744] 0 2024-01-17T23:40:17.247 INFO:tasks.workunit.client.0.smithi161.stdout:8/500: mkdir d1/d55/db0 0 2024-01-17T23:40:17.248 INFO:tasks.workunit.client.0.smithi161.stdout:8/501: chown d1/d3/d19/d1d/f9a 131365564 1 2024-01-17T23:40:17.676 INFO:tasks.workunit.client.0.smithi161.stdout:8/502: unlink d1/df/d13/f64 0 2024-01-17T23:40:18.124 INFO:tasks.workunit.client.0.smithi161.stdout:1/602: dwrite d1/d8/d1c/f7a [0,4194304] 0 2024-01-17T23:40:18.309 INFO:tasks.workunit.client.0.smithi161.stdout:6/563: rename d6/d7/dc/f4b to d6/d7/dc/d85/fc0 0 2024-01-17T23:40:18.309 INFO:tasks.workunit.client.0.smithi161.stdout:6/564: creat d6/d7/dc/d85/d31/d5d/d55/fc1 x:0 0 0 2024-01-17T23:40:18.329 INFO:tasks.workunit.client.0.smithi161.stdout:6/565: read d6/d7/dc/d85/d13/f28 [567425,34150] 0 2024-01-17T23:40:18.630 INFO:tasks.workunit.client.0.smithi161.stdout:2/530: mkdir d8/db8 0 2024-01-17T23:40:18.695 INFO:tasks.workunit.client.0.smithi161.stdout:7/558: dwrite da/d34/d5a/d28/d43/f59 [0,4194304] 0 2024-01-17T23:40:18.777 INFO:tasks.workunit.client.0.smithi161.stdout:9/444: rename d0/d8/d31/d58/c69 to d0/d39/d49/c96 0 2024-01-17T23:40:18.777 INFO:tasks.workunit.client.0.smithi161.stdout:9/445: chown d0/d8/d14/d18/d20/f5b 12153074 1 2024-01-17T23:40:18.777 INFO:tasks.workunit.client.0.smithi161.stdout:9/446: fdatasync d0/d8/d14/f44 0 2024-01-17T23:40:19.153 INFO:tasks.workunit.client.0.smithi161.stdout:2/531: symlink d8/d67/lb9 0 2024-01-17T23:40:19.272 INFO:tasks.workunit.client.0.smithi161.stdout:1/603: getdents d1/d31 0 2024-01-17T23:40:19.301 INFO:tasks.workunit.client.0.smithi161.stdout:1/604: dwrite d1/d8/d54/d94/fc2 [0,4194304] 0 2024-01-17T23:40:19.393 INFO:tasks.workunit.client.0.smithi161.stdout:7/559: symlink da/db/db2/lbf 0 2024-01-17T23:40:19.546 INFO:tasks.workunit.client.0.smithi161.stdout:4/632: rename d9/de/d1e/d38/l57 to d9/d51/d64/lbb 0 2024-01-17T23:40:19.574 INFO:tasks.workunit.client.0.smithi161.stdout:4/633: dwrite d9/d1b/d24/d25/f47 [0,4194304] 0 2024-01-17T23:40:19.574 INFO:tasks.workunit.client.0.smithi161.stdout:4/634: write d9/d1b/d53/d9f/fa9 [851275,73679] 0 2024-01-17T23:40:19.661 INFO:tasks.workunit.client.0.smithi161.stdout:9/447: mkdir d0/d8/d14/d18/d20/d97 0 2024-01-17T23:40:20.022 INFO:tasks.workunit.client.0.smithi161.stdout:1/605: truncate d1/d2d/f78 1476471 0 2024-01-17T23:40:20.023 INFO:tasks.workunit.client.0.smithi161.stdout:1/606: write d1/d2d/d3b/fbe [753025,118101] 0 2024-01-17T23:40:20.023 INFO:tasks.workunit.client.0.smithi161.stdout:1/607: fsync d1/d11/f76 0 2024-01-17T23:40:20.023 INFO:tasks.workunit.client.0.smithi161.stdout:1/608: chown d1/d8/d1c/f7a 637018615 1 2024-01-17T23:40:20.270 INFO:tasks.workunit.client.0.smithi161.stdout:7/560: mkdir da/db/d7a/dc0 0 2024-01-17T23:40:20.545 INFO:tasks.workunit.client.0.smithi161.stdout:5/515: rename dd/d15/d1a/c82 to dd/ca1 0 2024-01-17T23:40:20.546 INFO:tasks.workunit.client.0.smithi161.stdout:3/581: rename d0/d5/d9 to d0/d5/d9/d38/d4f/d56/d7c/dc8 22 2024-01-17T23:40:20.767 INFO:tasks.workunit.client.0.smithi161.stdout:4/635: rmdir d9/d27/d3a/d8b/d90 0 2024-01-17T23:40:20.767 INFO:tasks.workunit.client.0.smithi161.stdout:9/448: chown d0/c34 7303 1 2024-01-17T23:40:21.142 INFO:tasks.workunit.client.0.smithi161.stdout:1/609: read d1/f23 [562396,77742] 0 2024-01-17T23:40:21.142 INFO:tasks.workunit.client.0.smithi161.stdout:1/610: readlink d1/lc0 0 2024-01-17T23:40:21.142 INFO:tasks.workunit.client.0.smithi161.stdout:1/611: chown d1/d8/f5a 6530166 1 2024-01-17T23:40:21.188 INFO:tasks.workunit.client.0.smithi161.stdout:7/561: getdents da/d14 0 2024-01-17T23:40:21.188 INFO:tasks.workunit.client.0.smithi161.stdout:7/562: chown da/db/d7a/d8f/dac/fb7 250 1 2024-01-17T23:40:21.188 INFO:tasks.workunit.client.0.smithi161.stdout:7/563: chown da/d14 40839543 1 2024-01-17T23:40:21.384 INFO:tasks.workunit.client.0.smithi161.stdout:5/516: symlink dd/d15/d1a/d5d/d64/d7c/d86/la2 0 2024-01-17T23:40:21.403 INFO:tasks.workunit.client.0.smithi161.stdout:5/517: write dd/d15/f1c [2200359,46989] 0 2024-01-17T23:40:21.430 INFO:tasks.workunit.client.0.smithi161.stdout:5/518: dwrite dd/d15/d6a/d80/f9f [0,4194304] 0 2024-01-17T23:40:21.638 INFO:tasks.workunit.client.0.smithi161.stdout:3/582: mknod d0/d5/d9/d17/cc9 0 2024-01-17T23:40:21.638 INFO:tasks.workunit.client.0.smithi161.stdout:3/583: chown d0/d5/d9/d38/c44 47 1 2024-01-17T23:40:21.638 INFO:tasks.workunit.client.0.smithi161.stdout:3/584: fdatasync d0/d5/d9/d38/f74 0 2024-01-17T23:40:21.639 INFO:tasks.workunit.client.0.smithi161.stdout:3/585: truncate d0/d5/d9/d17/f9c 44788 0 2024-01-17T23:40:21.639 INFO:tasks.workunit.client.0.smithi161.stdout:3/586: chown d0/d5/d9/d38/cb7 2740 1 2024-01-17T23:40:21.639 INFO:tasks.workunit.client.0.smithi161.stdout:3/587: chown d0/d5/d9/d17/d2d/caa 10896 1 2024-01-17T23:40:21.639 INFO:tasks.workunit.client.0.smithi161.stdout:3/588: truncate d0/d5/d9/d17/f9c 387342 0 2024-01-17T23:40:21.639 INFO:tasks.workunit.client.0.smithi161.stdout:3/589: fsync d0/d5/d9/d8b/f91 0 2024-01-17T23:40:21.777 INFO:tasks.workunit.client.0.smithi161.stdout:4/636: truncate d9/d1b/d24/f2e 4219151 0 2024-01-17T23:40:21.777 INFO:tasks.workunit.client.0.smithi161.stdout:4/637: fsync d9/de/d69/f8a 0 2024-01-17T23:40:21.779 INFO:tasks.workunit.client.0.smithi161.stdout:0/590: sync 2024-01-17T23:40:21.779 INFO:tasks.workunit.client.0.smithi161.stdout:0/591: readlink d5/d8/l95 0 2024-01-17T23:40:21.805 INFO:tasks.workunit.client.0.smithi161.stdout:0/592: dwrite d5/d8/f8b [0,4194304] 0 2024-01-17T23:40:21.849 INFO:tasks.workunit.client.0.smithi161.stdout:1/612: creat d1/d64/fcb x:0 0 0 2024-01-17T23:40:21.849 INFO:tasks.workunit.client.0.smithi161.stdout:1/613: chown d1/d2d/fc5 5 1 2024-01-17T23:40:21.849 INFO:tasks.workunit.client.0.smithi161.stdout:1/614: write d1/d11/d72/d81/f82 [266131,54640] 0 2024-01-17T23:40:21.849 INFO:tasks.workunit.client.0.smithi161.stdout:1/615: chown d1/d8/d1f/l47 565955 1 2024-01-17T23:40:21.849 INFO:tasks.workunit.client.0.smithi161.stdout:1/616: chown d1/d31/c87 396330 1 2024-01-17T23:40:22.071 INFO:tasks.workunit.client.0.smithi161.stdout:8/503: unlink d1/f2 0 2024-01-17T23:40:22.101 INFO:tasks.workunit.client.0.smithi161.stdout:8/504: dwrite d1/f5f [0,4194304] 0 2024-01-17T23:40:22.390 INFO:tasks.workunit.client.0.smithi161.stdout:2/532: rename d8/d1c/d1e/da6/d35/d3a/c7b to d8/d67/d6c/d72/cba 0 2024-01-17T23:40:22.525 INFO:tasks.workunit.client.0.smithi161.stdout:3/590: getdents d0/d5/d9/d1e/d3b/d52 0 2024-01-17T23:40:22.696 INFO:tasks.workunit.client.0.smithi161.stdout:4/638: rmdir d9/de/d1e/d38/d89 39 2024-01-17T23:40:23.078 INFO:tasks.workunit.client.0.smithi161.stdout:0/593: mkdir d5/d34/d21/d97/dbb 0 2024-01-17T23:40:23.079 INFO:tasks.workunit.client.0.smithi161.stdout:0/594: fdatasync d5/d8/f9 0 2024-01-17T23:40:23.257 INFO:tasks.workunit.client.0.smithi161.stdout:1/617: dread d1/d2d/d3b/f2a [0,4194304] 0 2024-01-17T23:40:23.293 INFO:tasks.workunit.client.0.smithi161.stdout:1/618: dwrite d1/d20/f51 [0,4194304] 0 2024-01-17T23:40:23.293 INFO:tasks.workunit.client.0.smithi161.stdout:1/619: chown d1/l42 4859 1 2024-01-17T23:40:23.335 INFO:tasks.workunit.client.0.smithi161.stdout:1/620: dwrite d1/d20/d26/d30/f9f [0,4194304] 0 2024-01-17T23:40:23.360 INFO:tasks.workunit.client.0.smithi161.stdout:1/621: dwrite d1/d11/f75 [0,4194304] 0 2024-01-17T23:40:23.385 INFO:tasks.workunit.client.0.smithi161.stdout:1/622: dwrite d1/d11/d72/f89 [0,4194304] 0 2024-01-17T23:40:23.478 INFO:tasks.workunit.client.0.smithi161.stdout:8/505: mkdir d1/df/d13/db1 0 2024-01-17T23:40:23.717 INFO:tasks.workunit.client.0.smithi161.stdout:2/533: mknod d8/d1c/d1e/d80/d79/cbb 0 2024-01-17T23:40:23.717 INFO:tasks.workunit.client.0.smithi161.stdout:2/534: fdatasync d8/d2e/da8/fb6 0 2024-01-17T23:40:23.747 INFO:tasks.workunit.client.0.smithi161.stdout:2/535: dwrite d8/da/f27 [0,4194304] 0 2024-01-17T23:40:23.791 INFO:tasks.workunit.client.0.smithi161.stdout:3/591: mkdir d0/d5/d9/d38/d4f/d9d/dca 0 2024-01-17T23:40:23.792 INFO:tasks.workunit.client.0.smithi161.stdout:3/592: dread - d0/d5/d9/d38/d4f/d56/fb8 zero size 2024-01-17T23:40:23.940 INFO:tasks.workunit.client.0.smithi161.stdout:4/639: truncate d9/d27/f6c 960337 0 2024-01-17T23:40:23.960 INFO:tasks.workunit.client.0.smithi161.stdout:4/640: dread d9/d1b/d24/f43 [0,4194304] 0 2024-01-17T23:40:23.993 INFO:tasks.workunit.client.0.smithi161.stdout:4/641: dwrite d9/d1b/d53/d9f/fa9 [0,4194304] 0 2024-01-17T23:40:24.849 INFO:tasks.workunit.client.0.smithi161.stdout:1/623: unlink d1/d31/d4e/f83 0 2024-01-17T23:40:24.974 INFO:tasks.workunit.client.0.smithi161.stdout:8/506: mknod d1/df/d46/d89/cb2 0 2024-01-17T23:40:24.992 INFO:tasks.workunit.client.0.smithi161.stdout:8/507: write d1/d3/d19/d1d/f9a [4900712,108723] 0 2024-01-17T23:40:25.086 INFO:tasks.workunit.client.0.smithi161.stdout:2/536: mkdir d8/d67/dbc 0 2024-01-17T23:40:25.745 INFO:tasks.workunit.client.0.smithi161.stdout:4/642: symlink d9/d27/d3a/d56/lbc 0 2024-01-17T23:40:25.940 INFO:tasks.workunit.client.0.smithi161.stdout:0/595: getdents d5/d8 0 2024-01-17T23:40:26.268 INFO:tasks.workunit.client.0.smithi161.stdout:8/508: mknod d1/df/d16/d8c/cb3 0 2024-01-17T23:40:26.268 INFO:tasks.workunit.client.0.smithi161.stdout:8/509: stat d1/d55 0 2024-01-17T23:40:26.614 INFO:tasks.workunit.client.0.smithi161.stdout:7/564: write da/db/f11 [855175,11837] 0 2024-01-17T23:40:26.746 INFO:tasks.workunit.client.0.smithi161.stdout:6/566: sync 2024-01-17T23:40:26.746 INFO:tasks.workunit.client.0.smithi161.stdout:6/567: write d6/d7/fab [833325,80062] 0 2024-01-17T23:40:26.773 INFO:tasks.workunit.client.0.smithi161.stdout:6/568: dwrite d6/d7/dc/d43/d76/fad [0,4194304] 0 2024-01-17T23:40:27.065 INFO:tasks.workunit.client.0.smithi161.stdout:9/449: rename d0/d8/d14/l3c to d0/d39/d49/l98 0 2024-01-17T23:40:27.151 INFO:tasks.workunit.client.0.smithi161.stdout:4/643: unlink d9/d1b/d24/d25/c82 0 2024-01-17T23:40:27.426 INFO:tasks.workunit.client.0.smithi161.stdout:0/596: mkdir d5/d3a/d49/d99/d96/dbc 0 2024-01-17T23:40:27.427 INFO:tasks.workunit.client.0.smithi161.stdout:8/510: symlink d1/d3/lb4 0 2024-01-17T23:40:27.432 INFO:tasks.workunit.client.0.smithi161.stdout:8/511: dread d1/d3/d19/d1d/d25/f39 [0,4194304] 0 2024-01-17T23:40:28.015 INFO:tasks.workunit.client.0.smithi161.stdout:9/450: mknod d0/d8/d31/d73/c99 0 2024-01-17T23:40:28.016 INFO:tasks.workunit.client.0.smithi161.stdout:9/451: chown d0/d8/d14/d18/d20/f84 2065008751 1 2024-01-17T23:40:28.326 INFO:tasks.workunit.client.0.smithi161.stdout:8/512: link d1/df/d16/d8c/ca0 d1/d88/cb5 0 2024-01-17T23:40:28.650 INFO:tasks.workunit.client.0.smithi161.stdout:6/569: link d6/d7/dc/c3b d6/d7/dc/d43/d79/cc2 0 2024-01-17T23:40:28.767 INFO:tasks.workunit.client.0.smithi161.stdout:5/519: rename dd/d31/d56/f8f to dd/d15/d4e/fa3 0 2024-01-17T23:40:28.918 INFO:tasks.workunit.client.0.smithi161.stdout:9/452: mkdir d0/d8/d9a 0 2024-01-17T23:40:28.918 INFO:tasks.workunit.client.0.smithi161.stdout:9/453: chown d0/d8/d14 1327731 1 2024-01-17T23:40:28.922 INFO:tasks.workunit.client.0.smithi161.stdout:9/454: dread d0/d8/d31/f52 [0,4194304] 0 2024-01-17T23:40:28.922 INFO:tasks.workunit.client.0.smithi161.stdout:9/455: fsync d0/d8/f10 0 2024-01-17T23:40:28.925 INFO:tasks.workunit.client.0.smithi161.stdout:9/456: dread d0/d8/d14/d18/d20/f5b [0,4194304] 0 2024-01-17T23:40:29.190 INFO:tasks.workunit.client.0.smithi161.stdout:0/597: rmdir d5/d34/d20/d2b 39 2024-01-17T23:40:29.369 INFO:tasks.workunit.client.0.smithi161.stdout:4/644: mknod d9/d1b/d24/cbd 0 2024-01-17T23:40:29.508 INFO:tasks.workunit.client.0.smithi161.stdout:8/513: creat d1/df/d20/d6a/fb6 x:0 0 0 2024-01-17T23:40:29.537 INFO:tasks.workunit.client.0.smithi161.stdout:8/514: dwrite d1/d3/f5b [0,4194304] 0 2024-01-17T23:40:29.537 INFO:tasks.workunit.client.0.smithi161.stdout:8/515: creat d1/d22/d2f/d92/fb7 x:0 0 0 2024-01-17T23:40:29.867 INFO:tasks.workunit.client.0.smithi161.stdout:5/520: mkdir dd/d15/d1a/d42/da4 0 2024-01-17T23:40:29.867 INFO:tasks.workunit.client.0.smithi161.stdout:3/593: rename d0/d5/d9/d17/c46 to d0/d5/d9/d1e/d3b/d52/daf/ccb 0 2024-01-17T23:40:29.901 INFO:tasks.workunit.client.0.smithi161.stdout:9/457: mkdir d0/d8/d14/d87/d9b 0 2024-01-17T23:40:29.901 INFO:tasks.workunit.client.0.smithi161.stdout:9/458: write d0/d8/d14/d18/d20/f4f [5234399,59498] 0 2024-01-17T23:40:30.002 INFO:tasks.workunit.client.0.smithi161.stdout:0/598: truncate d5/d34/d12/d2a/f38 912041 0 2024-01-17T23:40:30.077 INFO:tasks.workunit.client.0.smithi161.stdout:4/645: link d9/de/d69/f8a d9/d51/d64/fbe 0 2024-01-17T23:40:30.737 INFO:tasks.workunit.client.0.smithi161.stdout:8/516: creat d1/df/d46/d89/fb8 x:0 0 0 2024-01-17T23:40:30.737 INFO:tasks.workunit.client.0.smithi161.stdout:8/517: dread - d1/df/d20/f7c zero size 2024-01-17T23:40:31.165 INFO:tasks.workunit.client.0.smithi161.stdout:5/521: read dd/d15/d1a/f57 [3003278,53263] 0 2024-01-17T23:40:31.433 INFO:tasks.workunit.client.0.smithi161.stdout:1/624: rename d1/d8/d1f/d4b/l8d to d1/d11/d72/lcc 0 2024-01-17T23:40:31.433 INFO:tasks.workunit.client.0.smithi161.stdout:1/625: fdatasync d1/d11/fb5 0 2024-01-17T23:40:31.433 INFO:tasks.workunit.client.0.smithi161.stdout:1/626: creat d1/d8/d9d/fcd x:0 0 0 2024-01-17T23:40:31.433 INFO:tasks.workunit.client.0.smithi161.stdout:1/627: fdatasync d1/d20/d26/d30/d41/f9c 0 2024-01-17T23:40:31.603 INFO:tasks.workunit.client.0.smithi161.stdout:9/459: truncate d0/d8/d14/d56/f74 1650079 0 2024-01-17T23:40:31.771 INFO:tasks.workunit.client.0.smithi161.stdout:0/599: dread d5/d3a/d49/d99/f31 [0,4194304] 0 2024-01-17T23:40:31.771 INFO:tasks.workunit.client.0.smithi161.stdout:0/600: write d5/d34/d12/d2a/d35/f8e [609378,28051] 0 2024-01-17T23:40:31.894 INFO:tasks.workunit.client.0.smithi161.stdout:4/646: mknod d9/d27/d68/cbf 0 2024-01-17T23:40:31.894 INFO:tasks.workunit.client.0.smithi161.stdout:4/647: fdatasync d9/d1b/d53/f7b 0 2024-01-17T23:40:31.894 INFO:tasks.workunit.client.0.smithi161.stdout:4/648: chown d9/de/d1e 2 1 2024-01-17T23:40:32.202 INFO:tasks.workunit.client.0.smithi161.stdout:8/518: dread d1/df/f14 [0,4194304] 0 2024-01-17T23:40:32.327 INFO:tasks.workunit.client.0.smithi161.stdout:6/570: rename d6/d7/dc/d43/d76 to d6/d7/dc/d43/dc3 0 2024-01-17T23:40:32.363 INFO:tasks.workunit.client.0.smithi161.stdout:5/522: truncate dd/d15/d1a/f25 486530 0 2024-01-17T23:40:32.538 INFO:tasks.workunit.client.0.smithi161.stdout:3/594: mkdir d0/d5/d9/d38/d4f/d9d/da7/dcc 0 2024-01-17T23:40:32.571 INFO:tasks.workunit.client.0.smithi161.stdout:3/595: dwrite d0/d5/d9/f55 [0,4194304] 0 2024-01-17T23:40:32.571 INFO:tasks.workunit.client.0.smithi161.stdout:3/596: chown d0/d5/d9/d38/d4f/da5 5165 1 2024-01-17T23:40:32.596 INFO:tasks.workunit.client.0.smithi161.stdout:3/597: dwrite d0/d5/d9/d38/d4f/d56/f7e [0,4194304] 0 2024-01-17T23:40:32.825 INFO:tasks.workunit.client.0.smithi161.stdout:9/460: mknod d0/d8/d14/d87/c9c 0 2024-01-17T23:40:32.828 INFO:tasks.workunit.client.0.smithi161.stdout:2/537: sync 2024-01-17T23:40:32.828 INFO:tasks.workunit.client.0.smithi161.stdout:2/538: write d8/f18 [2742953,100838] 0 2024-01-17T23:40:32.889 INFO:tasks.workunit.client.0.smithi161.stdout:0/601: truncate d5/d8/f3c 3875021 0 2024-01-17T23:40:33.199 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:42:56.556 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:33.201 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:42:56.557 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:33.237 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:42:56.593 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:33.325 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:42:56.602 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:33.329 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:42:56.607 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:33.330 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:42:56.606 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:33.335 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:42:56.612 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:33.400 INFO:tasks.workunit.client.0.smithi161.stdout:7/565: sync 2024-01-17T23:40:33.401 INFO:tasks.workunit.client.0.smithi161.stdout:8/519: rmdir d1/d3/d19/d1d 39 2024-01-17T23:40:33.401 INFO:tasks.workunit.client.0.smithi161.stdout:7/566: stat da/d34/d5a/d68/c80 0 2024-01-17T23:40:33.401 INFO:tasks.workunit.client.0.smithi161.stdout:8/520: chown d1/d3/l9d 339383347 1 2024-01-17T23:40:33.401 INFO:tasks.workunit.client.0.smithi161.stdout:7/567: chown da/db/db2 0 1 2024-01-17T23:40:33.419 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:42:56.696 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:33.428 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:42:56.706 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:33.483 INFO:tasks.workunit.client.0.smithi161.stdout:6/571: symlink d6/d7/dc/d3c/d81/lc4 0 2024-01-17T23:40:33.718 INFO:tasks.workunit.client.0.smithi161.stdout:5/523: creat dd/d15/d4e/d4f/d97/fa5 x:0 0 0 2024-01-17T23:40:33.744 INFO:tasks.workunit.client.0.smithi161.stdout:5/524: dwrite dd/d31/d7b/d78/f87 [0,4194304] 0 2024-01-17T23:40:33.938 INFO:tasks.workunit.client.0.smithi161.stdout:3/598: symlink d0/d5/d9/d38/d4f/lcd 0 2024-01-17T23:40:33.938 INFO:tasks.workunit.client.0.smithi161.stdout:3/599: write d0/d5/d9/d1e/d5a/d8a/f92 [785911,53155] 0 2024-01-17T23:40:33.938 INFO:tasks.workunit.client.0.smithi161.stdout:3/600: chown d0/d5/d9/d38/db3 1408 1 2024-01-17T23:40:33.944 INFO:tasks.workunit.client.0.smithi161.stdout:9/461: dread d0/d39/f59 [0,4194304] 0 2024-01-17T23:40:34.365 INFO:tasks.workunit.client.0.smithi161.stdout:0/602: creat d5/d34/d21/d76/fbd x:0 0 0 2024-01-17T23:40:34.395 INFO:tasks.workunit.client.0.smithi161.stdout:0/603: dwrite d5/d8/d68/f7d [0,4194304] 0 2024-01-17T23:40:34.395 INFO:tasks.workunit.client.0.smithi161.stdout:0/604: write d5/d34/d12/d2a/f7a [1510185,65424] 0 2024-01-17T23:40:34.404 INFO:tasks.workunit.client.0.smithi161.stdout:0/605: dread d5/d3a/d49/d99/f31 [0,4194304] 0 2024-01-17T23:40:34.404 INFO:tasks.workunit.client.0.smithi161.stdout:0/606: fsync d5/d8/d68/f7d 0 2024-01-17T23:40:34.727 INFO:tasks.workunit.client.0.smithi161.stdout:6/572: creat d6/d7/dc/d85/d1a/d59/d8e/fc5 x:0 0 0 2024-01-17T23:40:34.964 INFO:tasks.workunit.client.0.smithi161.stdout:5/525: readlink dd/d15/l16 0 2024-01-17T23:40:35.176 INFO:tasks.workunit.client.0.smithi161.stdout:3/601: truncate d0/d5/d9/d1e/d3b/d52/f67 3949544 0 2024-01-17T23:40:35.176 INFO:tasks.workunit.client.0.smithi161.stdout:3/602: chown d0/d5/d9/d38/db3 86581 1 2024-01-17T23:40:35.313 INFO:tasks.workunit.client.0.smithi161.stdout:9/462: rmdir d0/d39/d49/d6e 39 2024-01-17T23:40:35.914 INFO:tasks.workunit.client.0.smithi161.stdout:0/607: symlink d5/d34/d21/d97/dbb/lbe 0 2024-01-17T23:40:35.914 INFO:tasks.workunit.client.0.smithi161.stdout:0/608: getdents d5/d8/d68/db0 0 2024-01-17T23:40:36.019 INFO:tasks.workunit.client.0.smithi161.stdout:8/521: truncate d1/d3/d19/d1d/d25/f67 1964088 0 2024-01-17T23:40:36.561 INFO:tasks.workunit.client.0.smithi161.stdout:5/526: creat dd/d15/d1a/d5d/d64/d7c/d86/fa6 x:0 0 0 2024-01-17T23:40:36.701 INFO:tasks.workunit.client.0.smithi161.stdout:1/628: mknod d1/d20/d26/cce 0 2024-01-17T23:40:36.792 INFO:tasks.workunit.client.0.smithi161.stdout:3/603: truncate d0/d5/d9/d17/f1c 4062483 0 2024-01-17T23:40:37.240 INFO:tasks.workunit.client.0.smithi161.stdout:0/609: mkdir d5/d34/d20/d2b/dbf 0 2024-01-17T23:40:37.372 INFO:tasks.workunit.client.0.smithi161.stdout:8/522: creat d1/d88/fb9 x:0 0 0 2024-01-17T23:40:37.372 INFO:tasks.workunit.client.0.smithi161.stdout:8/523: dread - d1/df/d16/f2d zero size 2024-01-17T23:40:37.500 INFO:tasks.workunit.client.0.smithi161.stdout:5/527: read dd/d15/d4e/d4f/f61 [1767139,54114] 0 2024-01-17T23:40:37.541 INFO:tasks.workunit.client.0.smithi161.stdout:1/629: creat d1/d20/d26/d30/fcf x:0 0 0 2024-01-17T23:40:37.813 INFO:tasks.workunit.client.0.smithi161.stdout:3/604: link d0/d5/d9/d17/c1b d0/d5/d9/d1e/d3b/cce 0 2024-01-17T23:40:37.818 INFO:tasks.workunit.client.0.smithi161.stdout:3/605: dread d0/d5/d9/d1e/d3b/d52/fa0 [0,4194304] 0 2024-01-17T23:40:37.847 INFO:tasks.workunit.client.0.smithi161.stdout:3/606: dwrite d0/d5/d9/d1e/d5a/d8a/f92 [0,4194304] 0 2024-01-17T23:40:38.038 INFO:tasks.workunit.client.0.smithi161.stdout:8/524: creat d1/df/d20/d2a/d53/fba x:0 0 0 2024-01-17T23:40:38.107 INFO:tasks.workunit.client.0.smithi161.stdout:5/528: link dd/d15/d1a/f6b dd/d15/d1a/d34/fa7 0 2024-01-17T23:40:38.107 INFO:tasks.workunit.client.0.smithi161.stdout:5/529: chown dd/d15/d4e/c9e 496 1 2024-01-17T23:40:38.107 INFO:tasks.workunit.client.0.smithi161.stdout:5/530: write dd/d31/d3c/f5b [4272967,94974] 0 2024-01-17T23:40:38.107 INFO:tasks.workunit.client.0.smithi161.stdout:5/531: write dd/d31/d7b/d78/f7e [876763,11398] 0 2024-01-17T23:40:38.194 INFO:tasks.workunit.client.0.smithi161.stdout:1/630: dread d1/d20/d26/d30/f36 [0,4194304] 0 2024-01-17T23:40:38.369 INFO:tasks.workunit.client.0.smithi161.stdout:8/525: mknod d1/d3/cbb 0 2024-01-17T23:40:38.369 INFO:tasks.workunit.client.0.smithi161.stdout:5/532: symlink dd/d15/d6a/d80/la8 0 2024-01-17T23:40:38.380 INFO:tasks.workunit.client.0.smithi161.stdout:8/526: dread d1/df/d20/d6a/f91 [0,4194304] 0 2024-01-17T23:40:38.435 INFO:tasks.workunit.client.0.smithi161.stdout:1/631: unlink d1/d31/d8c/f90 0 2024-01-17T23:40:38.482 INFO:tasks.workunit.client.0.smithi161.stdout:1/632: dwrite d1/d11/fb5 [0,4194304] 0 2024-01-17T23:40:38.750 INFO:tasks.workunit.client.0.smithi161.stdout:5/533: chown dd/d15/l35 783842 1 2024-01-17T23:40:38.752 INFO:tasks.workunit.client.0.smithi161.stdout:8/527: mknod d1/d22/cbc 0 2024-01-17T23:40:38.752 INFO:tasks.workunit.client.0.smithi161.stdout:8/528: readlink d1/df/d13/l9e 0 2024-01-17T23:40:39.234 INFO:tasks.workunit.client.0.smithi161.stdout:5/534: mknod dd/d15/d1a/d5d/d64/d67/ca9 0 2024-01-17T23:40:39.234 INFO:tasks.workunit.client.0.smithi161.stdout:5/535: fsync dd/d15/d1a/d5d/d64/d7c/f8c 0 2024-01-17T23:40:39.456 INFO:tasks.workunit.client.0.smithi161.stdout:8/529: rmdir d1/d22/d2f/d92 39 2024-01-17T23:40:39.486 INFO:tasks.workunit.client.0.smithi161.stdout:8/530: dwrite d1/df/d20/d6a/f7b [0,4194304] 0 2024-01-17T23:40:39.486 INFO:tasks.workunit.client.0.smithi161.stdout:8/531: dread - d1/d3/d19/d1d/d25/d4b/f6b zero size 2024-01-17T23:40:39.787 INFO:tasks.workunit.client.0.smithi161.stdout:8/532: mkdir d1/d22/dbd 0 2024-01-17T23:40:39.787 INFO:tasks.workunit.client.0.smithi161.stdout:7/568: creat da/db/fc1 x:0 0 0 2024-01-17T23:40:39.787 INFO:tasks.workunit.client.0.smithi161.stdout:7/569: fsync da/d34/d5a/d28/d43/f59 0 2024-01-17T23:40:39.787 INFO:tasks.workunit.client.0.smithi161.stdout:8/533: write d1/df/d46/d89/f98 [428127,35112] 0 2024-01-17T23:40:39.787 INFO:tasks.workunit.client.0.smithi161.stdout:8/534: write d1/df/d20/d2a/d53/fba [614804,66572] 0 2024-01-17T23:40:39.987 INFO:tasks.workunit.client.0.smithi161.stdout:1/633: rename d1/d8/l1d to d1/d20/d26/d30/d8f/d9e/dae/ld0 0 2024-01-17T23:40:39.987 INFO:tasks.workunit.client.0.smithi161.stdout:1/634: fsync d1/d8/fba 0 2024-01-17T23:40:39.987 INFO:tasks.workunit.client.0.smithi161.stdout:2/539: write d8/f37 [601567,87825] 0 2024-01-17T23:40:39.987 INFO:tasks.workunit.client.0.smithi161.stdout:1/635: truncate d1/d8/d1c/f53 580712 0 2024-01-17T23:40:40.175 INFO:tasks.workunit.client.0.smithi161.stdout:3/607: mknod d0/d5/ccf 0 2024-01-17T23:40:40.175 INFO:tasks.workunit.client.0.smithi161.stdout:3/608: creat d0/d5/d9/d38/d4f/da5/fd0 x:0 0 0 2024-01-17T23:40:40.420 INFO:tasks.workunit.client.0.smithi161.stdout:7/570: creat da/da7/fc2 x:0 0 0 2024-01-17T23:40:40.576 INFO:tasks.workunit.client.0.smithi161.stdout:8/535: truncate d1/d3d/f40 290390 0 2024-01-17T23:40:40.905 INFO:tasks.workunit.client.0.smithi161.stdout:5/536: rename dd/d31/d56/l7a to dd/d15/d4e/d4f/d97/laa 0 2024-01-17T23:40:41.042 INFO:tasks.workunit.client.0.smithi161.stdout:2/540: getdents d8/d4b/d9a 0 2024-01-17T23:40:41.291 INFO:tasks.workunit.client.0.smithi161.stdout:1/636: mkdir d1/d31/dd1 0 2024-01-17T23:40:41.594 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:40:41.598 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:40:41.598 INFO:tasks.workunit.client.0.smithi161.stdout:7/571: symlink da/d34/d5a/d28/dad/lc3 0 2024-01-17T23:40:41.599 INFO:tasks.workunit.client.0.smithi161.stdout:7/572: fdatasync da/faa 0 2024-01-17T23:40:41.759 INFO:tasks.workunit.client.0.smithi161.stdout:8/536: symlink d1/d1c/lbe 0 2024-01-17T23:40:41.885 INFO:tasks.workunit.client.0.smithi161.stdout:5/537: creat dd/d15/d1a/d5d/d64/d7c/fab x:0 0 0 2024-01-17T23:40:41.885 INFO:tasks.workunit.client.0.smithi161.stdout:5/538: chown dd/d15/d1a/d5d/d64/f8d 163229 1 2024-01-17T23:40:42.069 INFO:tasks.workunit.client.0.smithi161.stdout:2/541: mknod d8/da/d8d/cbd 0 2024-01-17T23:40:42.470 INFO:tasks.workunit.client.0.smithi161.stdout:4/649: sync 2024-01-17T23:40:42.759 INFO:tasks.workunit.client.0.smithi161.stdout:8/537: mkdir d1/df/d16/dbf 0 2024-01-17T23:40:43.061 INFO:tasks.workunit.client.0.smithi161.stdout:2/542: mkdir d8/d1c/d75/dae/dbe 0 2024-01-17T23:40:43.061 INFO:tasks.workunit.client.0.smithi161.stdout:2/543: creat d8/d1c/d1e/da6/d35/fbf x:0 0 0 2024-01-17T23:40:43.064 INFO:tasks.workunit.client.0.smithi161.stdout:5/539: dread dd/d15/d4e/f8e [0,4194304] 0 2024-01-17T23:40:43.070 INFO:tasks.workunit.client.0.smithi161.stdout:2/544: dread d8/da/d52/f33 [0,4194304] 0 2024-01-17T23:40:43.071 INFO:tasks.workunit.client.0.smithi161.stdout:2/545: chown d8/d1c/d1e/l2c 962279662 1 2024-01-17T23:40:43.083 INFO:tasks.workunit.client.0.smithi161.stdout:8/538: mknod d1/df/d13/db1/cc0 0 2024-01-17T23:40:43.321 INFO:tasks.workunit.client.0.smithi161.stdout:5/540: rename dd/d15/d1a/d34/f85 to dd/d15/d1a/d5d/d64/fac 0 2024-01-17T23:40:43.385 INFO:tasks.workunit.client.0.smithi161.stdout:2/546: creat d8/d4b/d9a/fc0 x:0 0 0 2024-01-17T23:40:43.398 INFO:tasks.workunit.client.0.smithi161.stdout:2/547: dread d8/f14 [4194304,4194304] 0 2024-01-17T23:40:43.630 INFO:tasks.workunit.client.0.smithi161.stdout:2/548: link d8/d1c/l77 d8/d1c/d75/lc1 0 2024-01-17T23:40:44.100 INFO:tasks.workunit.client.0.smithi161.stdout:2/549: link d8/d1c/c3f d8/da/d8d/cc2 0 2024-01-17T23:40:44.117 INFO:tasks.workunit.client.0.smithi161.stdout:2/550: dread d8/d1c/d1e/da6/f69 [0,4194304] 0 2024-01-17T23:40:44.299 INFO:tasks.workunit.client.0.smithi161.stdout:2/551: rename d8/da/d52 to d8/d1c/d75/dae/dc3 0 2024-01-17T23:40:44.323 INFO:tasks.workunit.client.0.smithi161.stdout:2/552: dwrite d8/d1c/d1e/da6/d35/fbf [0,4194304] 0 2024-01-17T23:40:44.323 INFO:tasks.workunit.client.0.smithi161.stdout:2/553: truncate d8/d4b/d9a/fc0 583178 0 2024-01-17T23:40:44.323 INFO:tasks.workunit.client.0.smithi161.stdout:2/554: truncate d8/d1c/d57/f9e 996187 0 2024-01-17T23:40:44.704 INFO:tasks.workunit.client.0.smithi161.stdout:7/573: rename da/l16 to da/lc4 0 2024-01-17T23:40:44.705 INFO:tasks.workunit.client.0.smithi161.stdout:7/574: fsync da/da7/fbe 0 2024-01-17T23:40:44.706 INFO:tasks.workunit.client.0.smithi161.stdout:6/573: sync 2024-01-17T23:40:44.706 INFO:tasks.workunit.client.0.smithi161.stdout:9/463: sync 2024-01-17T23:40:44.706 INFO:tasks.workunit.client.0.smithi161.stdout:0/610: sync 2024-01-17T23:40:44.733 INFO:tasks.workunit.client.0.smithi161.stdout:0/611: write d5/d34/d12/d2a/d35/f82 [2654319,85813] 0 2024-01-17T23:40:44.734 INFO:tasks.workunit.client.0.smithi161.stdout:7/575: dwrite da/d34/d5a/d3b/db9/f7c [0,4194304] 0 2024-01-17T23:40:44.737 INFO:tasks.workunit.client.0.smithi161.stdout:6/574: write d6/d7/dc/f77 [3856922,36324] 0 2024-01-17T23:40:45.085 INFO:tasks.workunit.client.0.smithi161.stdout:2/555: mkdir d8/d1c/d1e/d80/dc4 0 2024-01-17T23:40:45.366 INFO:tasks.workunit.client.0.smithi161.stdout:0/612: getdents d5/d8/d68/d6b 0 2024-01-17T23:40:45.366 INFO:tasks.workunit.client.0.smithi161.stdout:0/613: truncate d5/d34/d20/d2b/d64/f78 4248002 0 2024-01-17T23:40:45.382 INFO:tasks.workunit.client.0.smithi161.stdout:0/614: dread d5/d34/d20/d2b/d64/f6c [0,4194304] 0 2024-01-17T23:40:45.627 INFO:tasks.workunit.client.0.smithi161.stdout:7/576: symlink da/d34/d5a/d68/d8c/lc5 0 2024-01-17T23:40:45.931 INFO:tasks.workunit.client.0.smithi161.stdout:6/575: rename d6/d7/dc/d1d/c29 to d6/d7/dc/d85/d31/d5d/d55/cc6 0 2024-01-17T23:40:45.950 INFO:tasks.workunit.client.0.smithi161.stdout:6/576: read d6/d7/dc/d43/f60 [3347957,115183] 0 2024-01-17T23:40:46.074 INFO:tasks.workunit.client.0.smithi161.stdout:2/556: mknod d8/d2e/cc5 0 2024-01-17T23:40:46.392 INFO:tasks.workunit.client.0.smithi161.stdout:0/615: creat d5/d3a/d49/d99/fc0 x:0 0 0 2024-01-17T23:40:46.399 INFO:tasks.workunit.client.0.smithi161.stdout:0/616: dread d5/d34/d12/d2a/f7a [0,4194304] 0 2024-01-17T23:40:46.399 INFO:tasks.workunit.client.0.smithi161.stdout:0/617: dread - d5/d34/d20/d2b/f56 zero size 2024-01-17T23:40:46.460 INFO:tasks.workunit.client.0.smithi161.stdout:7/577: mknod da/d34/d5a/d28/d43/da4/cc6 0 2024-01-17T23:40:46.566 INFO:tasks.workunit.client.0.smithi161.stdout:6/577: rename d6/d7/dc/d85/d31/d5d/f36 to d6/d7/dc/d3c/d81/fc7 0 2024-01-17T23:40:46.683 INFO:tasks.workunit.client.0.smithi161.stdout:2/557: creat d8/da/fc6 x:0 0 0 2024-01-17T23:40:46.683 INFO:tasks.workunit.client.0.smithi161.stdout:2/558: stat d8/d67/d6c/d72 0 2024-01-17T23:40:46.754 INFO:tasks.workunit.client.0.smithi161.stdout:0/618: mkdir d5/d3a/db4/dc1 0 2024-01-17T23:40:47.088 INFO:tasks.workunit.client.0.smithi161.stdout:2/559: unlink d8/da/l9b 0 2024-01-17T23:40:47.476 INFO:tasks.workunit.client.0.smithi161.stdout:0/619: creat d5/d34/d20/d2b/d64/d88/fc2 x:0 0 0 2024-01-17T23:40:47.482 INFO:tasks.workunit.client.0.smithi161.stdout:0/620: fsync d5/d34/d12/d2a/d35/f82 0 2024-01-17T23:40:47.874 INFO:tasks.workunit.client.0.smithi161.stdout:6/578: rmdir d6/d7/dc 39 2024-01-17T23:40:48.086 INFO:tasks.workunit.client.0.smithi161.stdout:2/560: truncate d8/d1c/d1e/d80/d79/f81 1835842 0 2024-01-17T23:40:48.270 INFO:tasks.workunit.client.0.smithi161.stdout:0/621: truncate d5/f25 591578 0 2024-01-17T23:40:48.270 INFO:tasks.workunit.client.0.smithi161.stdout:5/541: creat dd/d31/fad x:0 0 0 2024-01-17T23:40:48.600 INFO:tasks.workunit.client.0.smithi161.stdout:6/579: creat d6/d7/dc/d43/dc3/fc8 x:0 0 0 2024-01-17T23:40:48.600 INFO:tasks.workunit.client.0.smithi161.stdout:6/580: truncate d6/d58/f82 923189 0 2024-01-17T23:40:48.618 INFO:tasks.workunit.client.0.smithi161.stdout:6/581: dread d6/d7/dc/d85/d1a/f6a [0,4194304] 0 2024-01-17T23:40:48.735 INFO:tasks.workunit.client.0.smithi161.stdout:2/561: mkdir d8/d1c/d75/dc7 0 2024-01-17T23:40:48.736 INFO:tasks.workunit.client.0.smithi161.stdout:2/562: stat d8/d1c/d1e/f2a 0 2024-01-17T23:40:48.736 INFO:tasks.workunit.client.0.smithi161.stdout:2/563: truncate d8/d2e/f95 4748384 0 2024-01-17T23:40:48.752 INFO:tasks.workunit.client.0.smithi161.stdout:2/564: dread d8/d2e/f63 [0,4194304] 0 2024-01-17T23:40:48.934 INFO:tasks.workunit.client.0.smithi161.stdout:3/609: rmdir d0/d5/d9/d1e 39 2024-01-17T23:40:48.934 INFO:tasks.workunit.client.0.smithi161.stdout:1/637: sync 2024-01-17T23:40:48.934 INFO:tasks.workunit.client.0.smithi161.stdout:8/539: sync 2024-01-17T23:40:48.934 INFO:tasks.workunit.client.0.smithi161.stdout:4/650: sync 2024-01-17T23:40:48.972 INFO:tasks.workunit.client.0.smithi161.stdout:3/610: dread d0/d5/d9/f55 [0,4194304] 0 2024-01-17T23:40:48.972 INFO:tasks.workunit.client.0.smithi161.stdout:8/540: dwrite d1/d22/d2f/f3f [8388608,4194304] 0 2024-01-17T23:40:48.972 INFO:tasks.workunit.client.0.smithi161.stdout:8/541: chown d1/d3/d19/d1d/f9a 0 1 2024-01-17T23:40:48.972 INFO:tasks.workunit.client.0.smithi161.stdout:8/542: stat d1/df/f96 0 2024-01-17T23:40:49.067 INFO:tasks.workunit.client.0.smithi161.stdout:6/582: symlink d6/d7/dc/d3c/d81/lc9 0 2024-01-17T23:40:49.466 INFO:tasks.workunit.client.0.smithi161.stdout:1/638: unlink d1/d2d/f6f 0 2024-01-17T23:40:49.475 INFO:tasks.workunit.client.0.smithi161.stdout:1/639: dread d1/d8/f56 [0,4194304] 0 2024-01-17T23:40:49.504 INFO:tasks.workunit.client.0.smithi161.stdout:1/640: dwrite d1/d20/d26/d30/fcf [0,4194304] 0 2024-01-17T23:40:49.504 INFO:tasks.workunit.client.0.smithi161.stdout:1/641: chown d1/d20/d26/d30/d8f/d9e/dae/fb4 185694 1 2024-01-17T23:40:49.504 INFO:tasks.workunit.client.0.smithi161.stdout:1/642: creat d1/d20/d26/d30/d8f/d9e/fd2 x:0 0 0 2024-01-17T23:40:49.642 INFO:tasks.workunit.client.0.smithi161.stdout:4/651: mknod d9/de/cc0 0 2024-01-17T23:40:49.642 INFO:tasks.workunit.client.0.smithi161.stdout:4/652: write d9/f31 [1715380,87721] 0 2024-01-17T23:40:49.642 INFO:tasks.workunit.client.0.smithi161.stdout:4/653: write d9/d51/f54 [3530256,46443] 0 2024-01-17T23:40:49.804 INFO:tasks.workunit.client.0.smithi161.stdout:3/611: truncate d0/d5/d9/d1e/d3b/d52/f60 1466933 0 2024-01-17T23:40:49.822 INFO:tasks.workunit.client.0.smithi161.stdout:3/612: write d0/d5/d9/d38/f74 [56996,126776] 0 2024-01-17T23:40:49.970 INFO:tasks.workunit.client.0.smithi161.stdout:6/583: unlink d6/d7/dc/c3b 0 2024-01-17T23:40:50.547 INFO:tasks.workunit.client.0.smithi161.stdout:1/643: mkdir d1/d8/d1f/dd3 0 2024-01-17T23:40:50.849 INFO:tasks.workunit.client.0.smithi161.stdout:4/654: getdents d9/d1b/d24/d25/d5b/d97 0 2024-01-17T23:40:50.920 INFO:tasks.workunit.client.0.smithi161.stdout:3/613: creat d0/da2/fd1 x:0 0 0 2024-01-17T23:40:51.053 INFO:tasks.workunit.client.0.smithi161.stdout:7/578: rename da/d34/d5a/d28/d43 to da/db/d7a/dc7 0 2024-01-17T23:40:51.053 INFO:tasks.workunit.client.0.smithi161.stdout:7/579: fdatasync da/d34/d5a/d3b/d3d/d7f/fa3 0 2024-01-17T23:40:51.414 INFO:tasks.workunit.client.0.smithi161.stdout:6/584: truncate d6/d7/dc/d43/dc3/d90/f93 817226 0 2024-01-17T23:40:51.525 INFO:tasks.workunit.client.0.smithi161.stdout:1/644: truncate d1/d8/d1c/f39 4044322 0 2024-01-17T23:40:51.659 INFO:tasks.workunit.client.0.smithi161.stdout:4/655: truncate d9/fd 2718866 0 2024-01-17T23:40:51.735 INFO:tasks.workunit.client.0.smithi161.stdout:3/614: mknod d0/d5/d9/d38/d4f/cd2 0 2024-01-17T23:40:51.908 INFO:tasks.workunit.client.0.smithi161.stdout:5/542: rename dd/d15/d4e/d4f/d97/laa to dd/d15/d1a/d42/da4/lae 0 2024-01-17T23:40:51.948 INFO:tasks.workunit.client.0.smithi161.stdout:5/543: dwrite dd/d15/f2e [0,4194304] 0 2024-01-17T23:40:52.084 INFO:tasks.workunit.client.0.smithi161.stdout:7/580: link da/db/d7a/dc7/da4/cc6 da/d34/d5a/d3b/d3d/cc8 0 2024-01-17T23:40:52.084 INFO:tasks.workunit.client.0.smithi161.stdout:7/581: chown da/d34/d5a/d28/d2b/f45 3060709 1 2024-01-17T23:40:52.306 INFO:tasks.workunit.client.0.smithi161.stdout:1/645: stat d1/d8/d1c/c6b 0 2024-01-17T23:40:52.306 INFO:tasks.workunit.client.0.smithi161.stdout:1/646: fdatasync d1/d8/d9d/fa4 0 2024-01-17T23:40:52.507 INFO:tasks.workunit.client.0.smithi161.stdout:4/656: creat d9/d1b/d53/fc1 x:0 0 0 2024-01-17T23:40:52.560 INFO:tasks.workunit.client.0.smithi161.stdout:4/657: dwrite f4 [0,4194304] 0 2024-01-17T23:40:52.585 INFO:tasks.workunit.client.0.smithi161.stdout:9/464: unlink d0/d8/d14/l3b 0 2024-01-17T23:40:52.585 INFO:tasks.workunit.client.0.smithi161.stdout:9/465: fsync d0/d8/d14/d18/d20/f4f 0 2024-01-17T23:40:53.925 INFO:tasks.workunit.client.0.smithi161.stdout:0/622: dwrite d5/d3a/f80 [0,4194304] 0 2024-01-17T23:40:53.925 INFO:tasks.workunit.client.0.smithi161.stdout:0/623: chown d5/d3a/d49/l5e 108537 1 2024-01-17T23:40:54.146 INFO:tasks.workunit.client.0.smithi161.stdout:4/658: link d9/de/d1e/d58/d60/c83 d9/de/d69/cc2 0 2024-01-17T23:40:54.146 INFO:tasks.workunit.client.0.smithi161.stdout:4/659: creat d9/d1b/d52/fc3 x:0 0 0 2024-01-17T23:40:54.146 INFO:tasks.workunit.client.0.smithi161.stdout:4/660: truncate d9/de/f91 64421 0 2024-01-17T23:40:54.153 INFO:tasks.workunit.client.0.smithi161.stdout:4/661: dread d9/de/d1e/f32 [0,4194304] 0 2024-01-17T23:40:54.153 INFO:tasks.workunit.client.0.smithi161.stdout:4/662: fdatasync d9/d51/f54 0 2024-01-17T23:40:54.203 INFO:tasks.workunit.client.0.smithi161.stdout:9/466: chown d0/f3a 108 1 2024-01-17T23:40:54.204 INFO:tasks.workunit.client.0.smithi161.stdout:9/467: chown d0/f4 21 1 2024-01-17T23:40:54.204 INFO:tasks.workunit.client.0.smithi161.stdout:9/468: chown d0/d8/d14/d56/c6d 0 1 2024-01-17T23:40:54.503 INFO:tasks.workunit.client.0.smithi161.stdout:2/565: write d8/d67/d6c/d72/f96 [3635401,101331] 0 2024-01-17T23:40:54.893 INFO:tasks.workunit.client.0.smithi161.stdout:8/543: dwrite d1/d3/d19/d1d/d25/f60 [0,4194304] 0 2024-01-17T23:40:55.020 INFO:tasks.workunit.client.0.smithi161.stdout:4/663: getdents d9/d1b/d24 0 2024-01-17T23:40:55.020 INFO:tasks.workunit.client.0.smithi161.stdout:4/664: chown d9/l4d 3 1 2024-01-17T23:40:55.095 INFO:tasks.workunit.client.0.smithi161.stdout:9/469: dread - d0/f64 zero size 2024-01-17T23:40:55.310 INFO:tasks.workunit.client.0.smithi161.stdout:0/624: mknod d5/d34/cc3 0 2024-01-17T23:40:55.310 INFO:tasks.workunit.client.0.smithi161.stdout:0/625: stat d5/d8/d68/d6b/d89/l8f 0 2024-01-17T23:40:55.310 INFO:tasks.workunit.client.0.smithi161.stdout:0/626: chown d5/d3a/d49/l77 172 1 2024-01-17T23:40:55.593 INFO:tasks.workunit.client.0.smithi161.stdout:8/544: mknod d1/d1c/cc1 0 2024-01-17T23:40:55.771 INFO:tasks.workunit.client.0.smithi161.stdout:4/665: unlink d9/d1b/d24/d25/f7c 0 2024-01-17T23:40:55.771 INFO:tasks.workunit.client.0.smithi161.stdout:4/666: chown d9/d27/d3a/fac 333 1 2024-01-17T23:40:55.799 INFO:tasks.workunit.client.0.smithi161.stdout:4/667: dwrite d9/de/d1e/f40 [0,4194304] 0 2024-01-17T23:40:55.927 INFO:tasks.workunit.client.0.smithi161.stdout:9/470: getdents d0/d8 0 2024-01-17T23:40:55.951 INFO:tasks.workunit.client.0.smithi161.stdout:9/471: dwrite d0/d8/f66 [0,4194304] 0 2024-01-17T23:40:56.164 INFO:tasks.workunit.client.0.smithi161.stdout:8/545: mknod d1/d3/d19/cc2 0 2024-01-17T23:40:56.531 INFO:tasks.workunit.client.0.smithi161.stdout:4/668: unlink d9/d1b/c7e 0 2024-01-17T23:40:57.318 INFO:tasks.workunit.client.0.smithi161.stdout:8/546: truncate d1/df/d20/d2a/f3c 3313872 0 2024-01-17T23:40:57.318 INFO:tasks.workunit.client.0.smithi161.stdout:4/669: mkdir d9/d51/d64/dc4 0 2024-01-17T23:40:57.318 INFO:tasks.workunit.client.0.smithi161.stdout:4/670: chown d9/de/d1e/f84 21 1 2024-01-17T23:40:57.645 INFO:tasks.workunit.client.0.smithi161.stdout:5/544: write dd/d15/d1a/d42/f58 [1470509,15153] 0 2024-01-17T23:40:57.793 INFO:tasks.workunit.client.0.smithi161.stdout:8/547: getdents d1/df/d20/d2a 0 2024-01-17T23:40:57.819 INFO:tasks.workunit.client.0.smithi161.stdout:8/548: read d1/df/d46/fa5 [2811185,82385] 0 2024-01-17T23:40:57.876 INFO:tasks.workunit.client.0.smithi161.stdout:4/671: symlink d9/d27/d68/lc5 0 2024-01-17T23:40:57.876 INFO:tasks.workunit.client.0.smithi161.stdout:4/672: chown d9/de 0 1 2024-01-17T23:40:57.876 INFO:tasks.workunit.client.0.smithi161.stdout:4/673: dread - d9/de/d1e/d58/d60/d8f/fa6 zero size 2024-01-17T23:40:58.136 INFO:tasks.workunit.client.0.smithi161.stdout:8/549: symlink d1/d22/d2f/lc3 0 2024-01-17T23:40:58.165 INFO:tasks.workunit.client.0.smithi161.stdout:8/550: dwrite d1/d3/d19/f21 [0,4194304] 0 2024-01-17T23:40:58.213 INFO:tasks.workunit.client.0.smithi161.stdout:8/551: dwrite d1/df/d20/d6a/f6c [0,4194304] 0 2024-01-17T23:40:58.213 INFO:tasks.workunit.client.0.smithi161.stdout:8/552: write d1/d3/d19/d1d/d25/f62 [905266,51753] 0 2024-01-17T23:40:58.213 INFO:tasks.workunit.client.0.smithi161.stdout:8/553: stat d1/f94 0 2024-01-17T23:40:58.213 INFO:tasks.workunit.client.0.smithi161.stdout:8/554: getdents d1/df/d20/d2a 0 2024-01-17T23:40:58.230 INFO:tasks.workunit.client.0.smithi161.stdout:4/674: mknod d9/d1b/d52/cc6 0 2024-01-17T23:40:58.230 INFO:tasks.workunit.client.0.smithi161.stdout:8/555: dread d1/d3/d19/d1d/f9a [0,4194304] 0 2024-01-17T23:40:58.235 INFO:tasks.workunit.client.0.smithi161.stdout:4/675: dread d9/d51/d64/f70 [0,4194304] 0 2024-01-17T23:40:58.269 INFO:tasks.workunit.client.0.smithi161.stdout:8/556: dwrite d1/df/d20/d2a/d53/fba [0,4194304] 0 2024-01-17T23:40:58.269 INFO:tasks.workunit.client.0.smithi161.stdout:8/557: write d1/d3/d19/f87 [1015903,87406] 0 2024-01-17T23:40:58.312 INFO:tasks.workunit.client.0.smithi161.stdout:8/558: dwrite d1/df/f69 [0,4194304] 0 2024-01-17T23:40:58.312 INFO:tasks.workunit.client.0.smithi161.stdout:8/559: fsync d1/d22/f74 0 2024-01-17T23:40:58.358 INFO:tasks.workunit.client.0.smithi161.stdout:8/560: dwrite d1/df/d20/d2a/d53/fba [0,4194304] 0 2024-01-17T23:40:58.678 INFO:tasks.workunit.client.0.smithi161.stdout:4/676: mkdir d9/de/d1e/d58/d60/d9c/dc7 0 2024-01-17T23:40:58.678 INFO:tasks.workunit.client.0.smithi161.stdout:4/677: stat d9/de/d1e/f35 0 2024-01-17T23:40:58.678 INFO:tasks.workunit.client.0.smithi161.stdout:4/678: chown d9/d27/d3a/d56/lbc 330 1 2024-01-17T23:40:59.152 INFO:tasks.workunit.client.0.smithi161.stdout:8/561: symlink d1/df/d20/lc4 0 2024-01-17T23:40:59.152 INFO:tasks.workunit.client.0.smithi161.stdout:8/562: dread - d1/d22/d2f/d86/fa8 zero size 2024-01-17T23:40:59.152 INFO:tasks.workunit.client.0.smithi161.stdout:8/563: stat d1/d3/d19/l5d 0 2024-01-17T23:40:59.178 INFO:tasks.workunit.client.0.smithi161.stdout:8/564: dwrite f0 [8388608,4194304] 0 2024-01-17T23:40:59.863 INFO:tasks.workunit.client.0.smithi161.stdout:0/627: dwrite d5/d3a/d49/d99/f31 [0,4194304] 0 2024-01-17T23:41:00.842 INFO:tasks.workunit.client.0.smithi161.stdout:0/628: creat d5/d34/d20/d2b/dbf/fc4 x:0 0 0 2024-01-17T23:41:00.862 INFO:tasks.workunit.client.0.smithi161.stdout:5/545: write dd/d15/d4e/f8e [612544,53505] 0 2024-01-17T23:41:01.249 INFO:tasks.workunit.client.0.smithi161.stdout:0/629: creat d5/d34/fc5 x:0 0 0 2024-01-17T23:41:01.249 INFO:tasks.workunit.client.0.smithi161.stdout:0/630: chown d5/d34/d12/d2a/d35/f82 0 1 2024-01-17T23:41:01.513 INFO:tasks.workunit.client.0.smithi161.stdout:0/631: dwrite d5/d3a/f54 [0,4194304] 0 2024-01-17T23:41:01.806 INFO:tasks.workunit.client.0.smithi161.stdout:4/679: truncate d9/de/d1e/f40 1485885 0 2024-01-17T23:41:01.868 INFO:tasks.workunit.client.0.smithi161.stdout:0/632: mknod d5/d34/d20/d2d/d8d/cc6 0 2024-01-17T23:41:01.868 INFO:tasks.workunit.client.0.smithi161.stdout:0/633: truncate d5/d34/d20/d2b/d64/d88/fa4 442725 0 2024-01-17T23:41:02.024 INFO:tasks.workunit.client.0.smithi161.stdout:8/565: mkdir d1/dc5 0 2024-01-17T23:41:02.370 INFO:tasks.workunit.client.0.smithi161.stdout:0/634: stat d5/d34/d21/f3d 0 2024-01-17T23:41:02.370 INFO:tasks.workunit.client.0.smithi161.stdout:4/680: readlink d9/de/d1e/d58/l71 0 2024-01-17T23:41:02.370 INFO:tasks.workunit.client.0.smithi161.stdout:1/647: rename d1/f23 to d1/d20/d26/fd4 0 2024-01-17T23:41:02.381 INFO:tasks.workunit.client.0.smithi161.stdout:6/585: mkdir d6/d7/dc/dca 0 2024-01-17T23:41:02.588 INFO:tasks.workunit.client.0.smithi161.stdout:8/566: symlink d1/df/d46/d89/lc6 0 2024-01-17T23:41:02.606 INFO:tasks.workunit.client.0.smithi161.stdout:8/567: dread d1/df/f14 [0,4194304] 0 2024-01-17T23:41:02.673 INFO:tasks.workunit.client.0.smithi161.stdout:4/681: readlink d9/d1b/d53/l6f 0 2024-01-17T23:41:02.852 INFO:tasks.workunit.client.0.smithi161.stdout:0/635: mkdir d5/d34/d21/d9e/dc7 0 2024-01-17T23:41:02.852 INFO:tasks.workunit.client.0.smithi161.stdout:3/615: creat d0/fd3 x:0 0 0 2024-01-17T23:41:02.852 INFO:tasks.workunit.client.0.smithi161.stdout:3/616: write d0/d5/d9/d1e/d3b/f78 [1518310,35025] 0 2024-01-17T23:41:03.009 INFO:tasks.workunit.client.0.smithi161.stdout:2/566: rename d8/d1c/d1e/da6/d35/fb5 to d8/d1c/d1e/d80/dc4/fc8 0 2024-01-17T23:41:03.186 INFO:tasks.workunit.client.0.smithi161.stdout:6/586: write d6/d7/dc/f63 [307700,124007] 0 2024-01-17T23:41:03.256 INFO:tasks.workunit.client.0.smithi161.stdout:8/568: mkdir d1/d3d/dc7 0 2024-01-17T23:41:03.433 INFO:tasks.workunit.client.0.smithi161.stdout:3/617: dread d0/d5/d9/d17/f9c [0,4194304] 0 2024-01-17T23:41:04.742 INFO:tasks.workunit.client.0.smithi161.stdout:9/472: rename d0/d8/d14/d18/d20/f84 to d0/d8/d14/d18/d63/f9d 0 2024-01-17T23:41:04.764 INFO:tasks.workunit.client.0.smithi161.stdout:9/473: write d0/d8/d14/d18/d63/f6a [1212154,96940] 0 2024-01-17T23:41:04.838 INFO:tasks.workunit.client.0.smithi161.stdout:2/567: mkdir d8/db8/dc9 0 2024-01-17T23:41:04.838 INFO:tasks.workunit.client.0.smithi161.stdout:2/568: dread - d8/d67/d6c/d72/fb4 zero size 2024-01-17T23:41:05.007 INFO:tasks.workunit.client.0.smithi161.stdout:1/648: mkdir d1/d8/d54/d94/dd5 0 2024-01-17T23:41:05.415 INFO:tasks.workunit.client.0.smithi161.stdout:8/569: symlink d1/df/d20/d2a/d53/lc8 0 2024-01-17T23:41:05.416 INFO:tasks.workunit.client.0.smithi161.stdout:8/570: readlink d1/df/d20/d2a/d53/lc8 0 2024-01-17T23:41:05.416 INFO:tasks.workunit.client.0.smithi161.stdout:8/571: write d1/df/d13/f8f [149718,54208] 0 2024-01-17T23:41:05.494 INFO:tasks.workunit.client.0.smithi161.stdout:3/618: truncate d0/d5/d9/f53 3202450 0 2024-01-17T23:41:05.494 INFO:tasks.workunit.client.0.smithi161.stdout:3/619: fdatasync d0/d5/d9/d1e/d3b/f78 0 2024-01-17T23:41:05.494 INFO:tasks.workunit.client.0.smithi161.stdout:3/620: fsync d0/da2/fd1 0 2024-01-17T23:41:05.494 INFO:tasks.workunit.client.0.smithi161.stdout:3/621: creat d0/d5/d9/d38/d4f/d56/fd4 x:0 0 0 2024-01-17T23:41:05.494 INFO:tasks.workunit.client.0.smithi161.stdout:3/622: chown d0/d5/d9/d38/d4f/d56/d7c/fb2 0 1 2024-01-17T23:41:05.835 INFO:tasks.workunit.client.0.smithi161.stdout:5/546: rename dd/d15/d1a/f57 to dd/d31/faf 0 2024-01-17T23:41:06.124 INFO:tasks.workunit.client.0.smithi161.stdout:2/569: rmdir d8/d1c/d75/dae/dc3 39 2024-01-17T23:41:06.306 INFO:tasks.workunit.client.0.smithi161.stdout:1/649: mkdir d1/d31/d4e/dd6 0 2024-01-17T23:41:06.684 INFO:tasks.workunit.client.0.smithi161.stdout:6/587: read d6/d7/dc/d85/d31/d5d/f38 [26514,57043] 0 2024-01-17T23:41:06.691 INFO:tasks.workunit.client.0.smithi161.stdout:6/588: write d6/d7/f8 [1299980,95521] 0 2024-01-17T23:41:06.777 INFO:tasks.workunit.client.0.smithi161.stdout:8/572: truncate d1/d3/d19/d1d/f71 245184 0 2024-01-17T23:41:06.777 INFO:tasks.workunit.client.0.smithi161.stdout:8/573: readlink d1/d3/d19/d1d/d25/l68 0 2024-01-17T23:41:06.777 INFO:tasks.workunit.client.0.smithi161.stdout:8/574: write d1/df/d20/d6a/f6c [4535137,77265] 0 2024-01-17T23:41:06.809 INFO:tasks.workunit.client.0.smithi161.stdout:7/582: sync 2024-01-17T23:41:06.809 INFO:tasks.workunit.client.0.smithi161.stdout:7/583: write da/d34/d5a/d3b/f4b [2404058,41419] 0 2024-01-17T23:41:07.102 INFO:tasks.workunit.client.0.smithi161.stdout:3/623: mkdir d0/d5/d9/d8b/dd5 0 2024-01-17T23:41:07.270 INFO:tasks.workunit.client.0.smithi161.stdout:9/474: truncate d0/d8/d14/d56/f74 692522 0 2024-01-17T23:41:07.271 INFO:tasks.workunit.client.0.smithi161.stdout:9/475: write d0/d8/d14/d18/d63/f6a [2271038,111239] 0 2024-01-17T23:41:07.429 INFO:tasks.workunit.client.0.smithi161.stdout:1/650: creat d1/d20/fd7 x:0 0 0 2024-01-17T23:41:07.463 INFO:tasks.workunit.client.0.smithi161.stdout:1/651: dwrite d1/d20/f37 [0,4194304] 0 2024-01-17T23:41:07.463 INFO:tasks.workunit.client.0.smithi161.stdout:1/652: fdatasync d1/d20/d26/d30/d41/fb1 0 2024-01-17T23:41:07.478 INFO:tasks.workunit.client.0.smithi161.stdout:1/653: write d1/d8/d54/d94/fc2 [3490994,73009] 0 2024-01-17T23:41:07.496 INFO:tasks.workunit.client.0.smithi161.stdout:1/654: write d1/d20/d26/d30/fcf [3367115,50034] 0 2024-01-17T23:41:07.855 INFO:tasks.workunit.client.0.smithi161.stdout:8/575: truncate d1/d22/d2f/f43 1414351 0 2024-01-17T23:41:07.887 INFO:tasks.workunit.client.0.smithi161.stdout:8/576: dwrite d1/df/d13/f8f [0,4194304] 0 2024-01-17T23:41:08.331 INFO:tasks.workunit.client.0.smithi161.stdout:9/476: mkdir d0/d8/d14/d18/d20/d97/d9e 0 2024-01-17T23:41:08.331 INFO:tasks.workunit.client.0.smithi161.stdout:9/477: read d0/d8/d14/f25 [2846856,2671] 0 2024-01-17T23:41:08.358 INFO:tasks.workunit.client.0.smithi161.stdout:9/478: dwrite d0/d8/d14/f90 [0,4194304] 0 2024-01-17T23:41:08.387 INFO:tasks.workunit.client.0.smithi161.stdout:9/479: dwrite d0/d8/d14/d18/f55 [0,4194304] 0 2024-01-17T23:41:08.387 INFO:tasks.workunit.client.0.smithi161.stdout:9/480: write d0/d8/d14/d18/f55 [4309570,119745] 0 2024-01-17T23:41:08.388 INFO:tasks.workunit.client.0.smithi161.stdout:9/481: creat d0/d8/d14/d56/f9f x:0 0 0 2024-01-17T23:41:08.580 INFO:tasks.workunit.client.0.smithi161.stdout:2/570: rmdir d8/da 39 2024-01-17T23:41:08.971 INFO:tasks.workunit.client.0.smithi161.stdout:0/636: sync 2024-01-17T23:41:08.971 INFO:tasks.workunit.client.0.smithi161.stdout:6/589: rmdir d6/d7/dc/d43/dc3 39 2024-01-17T23:41:09.189 INFO:tasks.workunit.client.0.smithi161.stdout:8/577: link d1/d3/d19/f21 d1/d22/d2f/d92/fc9 0 2024-01-17T23:41:09.720 INFO:tasks.workunit.client.0.smithi161.stdout:9/482: creat d0/d8/fa0 x:0 0 0 2024-01-17T23:41:09.935 INFO:tasks.workunit.client.0.smithi161.stdout:2/571: truncate d8/d1c/d75/dae/dc3/f51 790507 0 2024-01-17T23:41:09.936 INFO:tasks.workunit.client.0.smithi161.stdout:1/655: symlink d1/d8/d1c/ld8 0 2024-01-17T23:41:10.051 INFO:tasks.workunit.client.0.smithi161.stdout:0/637: getdents d5/d34/d21/d76/d93 0 2024-01-17T23:41:10.051 INFO:tasks.workunit.client.0.smithi161.stdout:0/638: write d5/d34/d20/f85 [3029765,124699] 0 2024-01-17T23:41:10.356 INFO:tasks.workunit.client.0.smithi161.stdout:8/578: unlink d1/d3/d19/d1d/d25/f8d 0 2024-01-17T23:41:10.647 INFO:tasks.workunit.client.0.smithi161.stdout:9/483: mknod d0/d8/d14/d18/d20/ca1 0 2024-01-17T23:41:11.119 INFO:tasks.workunit.client.0.smithi161.stdout:1/656: unlink d1/d20/d26/d30/d8f/cb8 0 2024-01-17T23:41:11.120 INFO:tasks.workunit.client.0.smithi161.stdout:0/639: rmdir d5/d34/d21/d97 39 2024-01-17T23:41:11.120 INFO:tasks.workunit.client.0.smithi161.stdout:0/640: chown d5/l7f 258399257 1 2024-01-17T23:41:11.120 INFO:tasks.workunit.client.0.smithi161.stdout:1/657: fsync d1/d20/d26/d30/d8f/d9e/fd2 0 2024-01-17T23:41:11.665 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:41:11.669 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:41:11.887 INFO:tasks.workunit.client.0.smithi161.stdout:4/682: symlink d9/lc8 0 2024-01-17T23:41:12.157 INFO:tasks.workunit.client.0.smithi161.stdout:1/658: dread - d1/d8/d1f/d4b/f71 zero size 2024-01-17T23:41:12.157 INFO:tasks.workunit.client.0.smithi161.stdout:1/659: chown d1/d8/d1c/c6b 64151 1 2024-01-17T23:41:12.293 INFO:tasks.workunit.client.0.smithi161.stdout:0/641: mkdir d5/d34/d21/d97/dc8 0 2024-01-17T23:41:12.343 INFO:tasks.workunit.client.0.smithi161.stdout:8/579: write d1/d3/d19/d1d/f71 [969594,61300] 0 2024-01-17T23:41:12.377 INFO:tasks.workunit.client.0.smithi161.stdout:3/624: dwrite d0/d5/fa [0,4194304] 0 2024-01-17T23:41:12.397 INFO:tasks.workunit.client.0.smithi161.stdout:4/683: dread - d9/d27/d68/d6d/faf zero size 2024-01-17T23:41:12.700 INFO:tasks.workunit.client.0.smithi161.stdout:1/660: creat d1/d20/d26/d30/d44/fd9 x:0 0 0 2024-01-17T23:41:12.732 INFO:tasks.workunit.client.0.smithi161.stdout:1/661: dwrite d1/d20/d26/d30/d8f/d9e/dae/fb4 [0,4194304] 0 2024-01-17T23:41:12.868 INFO:tasks.workunit.client.0.smithi161.stdout:8/580: truncate d1/d3/d19/d1d/f9a 12176807 0 2024-01-17T23:41:13.100 INFO:tasks.workunit.client.0.smithi161.stdout:4/684: rename d9/d27/d3a/d8b/f98 to d9/d27/d68/fc9 0 2024-01-17T23:41:13.100 INFO:tasks.workunit.client.0.smithi161.stdout:4/685: dread - d9/de/d1e/d58/d60/d8f/fa6 zero size 2024-01-17T23:41:13.595 INFO:tasks.workunit.client.0.smithi161.stdout:0/642: truncate d5/f25 433097 0 2024-01-17T23:41:13.616 INFO:tasks.workunit.client.0.smithi161.stdout:0/643: write d5/d3a/f54 [966176,12827] 0 2024-01-17T23:41:13.814 INFO:tasks.workunit.client.0.smithi161.stdout:8/581: getdents d1/df 0 2024-01-17T23:41:13.848 INFO:tasks.workunit.client.0.smithi161.stdout:8/582: dwrite d1/f4e [0,4194304] 0 2024-01-17T23:41:13.848 INFO:tasks.workunit.client.0.smithi161.stdout:8/583: fsync d1/df/d46/d89/fb8 0 2024-01-17T23:41:14.161 INFO:tasks.workunit.client.0.smithi161.stdout:5/547: unlink dd/d15/d1a/f28 0 2024-01-17T23:41:14.161 INFO:tasks.workunit.client.0.smithi161.stdout:5/548: truncate dd/d31/d3c/f90 347540 0 2024-01-17T23:41:14.407 INFO:tasks.workunit.client.0.smithi161.stdout:0/644: creat d5/d34/d8a/fc9 x:0 0 0 2024-01-17T23:41:14.417 INFO:tasks.workunit.client.0.smithi161.stdout:0/645: dread d5/d34/d20/d2b/d64/f6c [0,4194304] 0 2024-01-17T23:41:14.418 INFO:tasks.workunit.client.0.smithi161.stdout:0/646: dread - d5/d34/d21/d76/f87 zero size 2024-01-17T23:41:14.428 INFO:tasks.workunit.client.0.smithi161.stdout:0/647: dread f1 [0,4194304] 0 2024-01-17T23:41:14.787 INFO:tasks.workunit.client.0.smithi161.stdout:6/590: dwrite d6/d7/fab [0,4194304] 0 2024-01-17T23:41:14.832 INFO:tasks.workunit.client.0.smithi161.stdout:4/686: creat d9/d51/fca x:0 0 0 2024-01-17T23:41:15.131 INFO:tasks.workunit.client.0.smithi161.stdout:0/648: truncate d5/d3a/d49/d99/d96/f98 3067737 0 2024-01-17T23:41:15.131 INFO:tasks.workunit.client.0.smithi161.stdout:0/649: stat d5/d34/cc3 0 2024-01-17T23:41:15.913 INFO:tasks.workunit.client.0.smithi161.stdout:6/591: creat d6/d7/dc/d3c/db4/fcb x:0 0 0 2024-01-17T23:41:15.917 INFO:tasks.workunit.client.0.smithi161.stdout:0/650: dread d5/d34/d12/d2a/f38 [0,4194304] 0 2024-01-17T23:41:16.185 INFO:tasks.workunit.client.0.smithi161.stdout:7/584: rmdir da/d34/d4a 39 2024-01-17T23:41:16.212 INFO:tasks.workunit.client.0.smithi161.stdout:7/585: dwrite da/d34/d5a/d68/d8c/fb6 [0,4194304] 0 2024-01-17T23:41:16.223 INFO:tasks.workunit.client.0.smithi161.stdout:2/572: link d8/d67/d6c/d72/f7c d8/d1c/d1e/fca 0 2024-01-17T23:41:16.466 INFO:tasks.workunit.client.0.smithi161.stdout:3/625: dwrite d0/d5/d9/d38/f49 [0,4194304] 0 2024-01-17T23:41:16.594 INFO:tasks.workunit.client.0.smithi161.stdout:9/484: sync 2024-01-17T23:41:16.898 INFO:tasks.workunit.client.0.smithi161.stdout:6/592: mkdir d6/d7/dc/d85/d13/dcc 0 2024-01-17T23:41:17.006 INFO:tasks.workunit.client.0.smithi161.stdout:0/651: mknod d5/d34/d21/d97/dbb/cca 0 2024-01-17T23:41:17.134 INFO:tasks.workunit.client.0.smithi161.stdout:4/687: rename d9/d27/d68/d6d to d9/d27/d3a/d8b/dcb 0 2024-01-17T23:41:17.554 INFO:tasks.workunit.client.0.smithi161.stdout:7/586: creat da/db/d7a/da8/fc9 x:0 0 0 2024-01-17T23:41:17.554 INFO:tasks.workunit.client.0.smithi161.stdout:2/573: link d8/d4b/la0 d8/db8/dc9/lcb 0 2024-01-17T23:41:17.554 INFO:tasks.workunit.client.0.smithi161.stdout:2/574: getdents d8/d2e/d84 0 2024-01-17T23:41:17.554 INFO:tasks.workunit.client.0.smithi161.stdout:2/575: fdatasync d8/d1c/f1f 0 2024-01-17T23:41:17.764 INFO:tasks.workunit.client.0.smithi161.stdout:9/485: dread - d0/f51 zero size 2024-01-17T23:41:17.778 INFO:tasks.workunit.client.0.smithi161.stdout:0/652: read d5/d34/d20/d2b/d64/f78 [1608861,45854] 0 2024-01-17T23:41:17.779 INFO:tasks.workunit.client.0.smithi161.stdout:0/653: chown d5/d3a/d49/l7b 93853027 1 2024-01-17T23:41:18.306 INFO:tasks.workunit.client.0.smithi161.stdout:5/549: sync 2024-01-17T23:41:18.306 INFO:tasks.workunit.client.0.smithi161.stdout:8/584: sync 2024-01-17T23:41:18.306 INFO:tasks.workunit.client.0.smithi161.stdout:1/662: sync 2024-01-17T23:41:18.306 INFO:tasks.workunit.client.0.smithi161.stdout:5/550: write dd/d15/d1a/d5d/d64/d7c/fab [373041,12250] 0 2024-01-17T23:41:18.428 INFO:tasks.workunit.client.0.smithi161.stdout:7/587: mknod da/d34/d5a/d3b/db9/cca 0 2024-01-17T23:41:18.569 INFO:tasks.workunit.client.0.smithi161.stdout:2/576: mkdir d8/d67/d6c/dcc 0 2024-01-17T23:41:18.569 INFO:tasks.workunit.client.0.smithi161.stdout:2/577: read d8/d1c/d75/dae/dc3/f33 [909476,6534] 0 2024-01-17T23:41:18.569 INFO:tasks.workunit.client.0.smithi161.stdout:2/578: write d8/d2e/fb2 [875002,36959] 0 2024-01-17T23:41:18.730 INFO:tasks.workunit.client.0.smithi161.stdout:0/654: dread d5/d34/d20/d2b/f75 [0,4194304] 0 2024-01-17T23:41:18.730 INFO:tasks.workunit.client.0.smithi161.stdout:0/655: truncate d5/d34/d20/d2b/d64/d88/fc2 939707 0 2024-01-17T23:41:19.118 INFO:tasks.workunit.client.0.smithi161.stdout:1/663: link d1/d8/d1f/d4b/la6 d1/d8/d54/lda 0 2024-01-17T23:41:19.119 INFO:tasks.workunit.client.0.smithi161.stdout:5/551: mknod dd/d15/d4e/d4f/cb0 0 2024-01-17T23:41:19.520 INFO:tasks.workunit.client.0.smithi161.stdout:7/588: symlink da/db/d7a/da8/lcb 0 2024-01-17T23:41:19.611 INFO:tasks.workunit.client.0.smithi161.stdout:2/579: dread d8/d4b/d9a/fc0 [0,4194304] 0 2024-01-17T23:41:19.625 INFO:tasks.workunit.client.0.smithi161.stdout:2/580: dread d8/f14 [0,4194304] 0 2024-01-17T23:41:19.625 INFO:tasks.workunit.client.0.smithi161.stdout:2/581: chown d8/d2e/cc5 5870 1 2024-01-17T23:41:19.625 INFO:tasks.workunit.client.0.smithi161.stdout:2/582: truncate d8/da/d8d/f97 518936 0 2024-01-17T23:41:19.711 INFO:tasks.workunit.client.0.smithi161.stdout:0/656: mkdir d5/d34/d21/d76/dcb 0 2024-01-17T23:41:19.712 INFO:tasks.workunit.client.0.smithi161.stdout:0/657: chown d5/d34/d21/d9e/dc7 179 1 2024-01-17T23:41:19.992 INFO:tasks.workunit.client.0.smithi161.stdout:5/552: symlink dd/d15/d1a/d42/da4/lb1 0 2024-01-17T23:41:19.992 INFO:tasks.workunit.client.0.smithi161.stdout:5/553: fsync dd/d31/d3c/f5b 0 2024-01-17T23:41:20.059 INFO:tasks.workunit.client.0.smithi161.stdout:7/589: creat da/d34/d5a/d3b/db9/fcc x:0 0 0 2024-01-17T23:41:20.255 INFO:tasks.workunit.client.0.smithi161.stdout:2/583: mkdir d8/d1c/d1e/d80/dcd 0 2024-01-17T23:41:20.296 INFO:tasks.workunit.client.0.smithi161.stdout:2/584: dwrite d8/da/f27 [0,4194304] 0 2024-01-17T23:41:20.457 INFO:tasks.workunit.client.0.smithi161.stdout:0/658: mkdir d5/d8/d68/db0/dcc 0 2024-01-17T23:41:20.491 INFO:tasks.workunit.client.0.smithi161.stdout:0/659: dwrite d5/d34/d20/d2b/d64/d88/fc2 [0,4194304] 0 2024-01-17T23:41:20.492 INFO:tasks.workunit.client.0.smithi161.stdout:0/660: truncate d5/d34/d21/d76/f79 804347 0 2024-01-17T23:41:20.492 INFO:tasks.workunit.client.0.smithi161.stdout:0/661: chown d5/f59 53 1 2024-01-17T23:41:20.517 INFO:tasks.workunit.client.0.smithi161.stdout:1/664: rename d1/d20/d26/d30/d8f/d9e/dae/fb4 to d1/d8/d9d/fdb 0 2024-01-17T23:41:20.517 INFO:tasks.workunit.client.0.smithi161.stdout:1/665: stat d1/d20/f51 0 2024-01-17T23:41:20.517 INFO:tasks.workunit.client.0.smithi161.stdout:1/666: fsync d1/d8/d54/d94/fc7 0 2024-01-17T23:41:20.517 INFO:tasks.workunit.client.0.smithi161.stdout:1/667: fsync d1/d20/d26/d30/d44/f88 0 2024-01-17T23:41:20.553 INFO:tasks.workunit.client.0.smithi161.stdout:3/626: dwrite d0/d5/d9/d17/d32/f89 [0,4194304] 0 2024-01-17T23:41:20.553 INFO:tasks.workunit.client.0.smithi161.stdout:3/627: chown d0/d5/d9/d38/d4f/d56/d7c/c82 112787 1 2024-01-17T23:41:20.553 INFO:tasks.workunit.client.0.smithi161.stdout:3/628: creat d0/d5/d9/d17/d2d/fd6 x:0 0 0 2024-01-17T23:41:20.769 INFO:tasks.workunit.client.0.smithi161.stdout:7/590: creat da/db/d7a/d8f/dac/fcd x:0 0 0 2024-01-17T23:41:20.793 INFO:tasks.workunit.client.0.smithi161.stdout:4/688: write d9/de/d1e/f66 [1695649,13029] 0 2024-01-17T23:41:21.013 INFO:tasks.workunit.client.0.smithi161.stdout:2/585: mkdir d8/d67/d6c/dce 0 2024-01-17T23:41:21.043 INFO:tasks.workunit.client.0.smithi161.stdout:2/586: dwrite d8/d1c/d57/f7f [0,4194304] 0 2024-01-17T23:41:21.394 INFO:tasks.workunit.client.0.smithi161.stdout:0/662: creat d5/d8/d68/d6b/fcd x:0 0 0 2024-01-17T23:41:21.407 INFO:tasks.workunit.client.0.smithi161.stdout:0/663: dread d5/d8/f29 [0,4194304] 0 2024-01-17T23:41:21.657 INFO:tasks.workunit.client.0.smithi161.stdout:1/668: creat d1/d2d/dc1/fdc x:0 0 0 2024-01-17T23:41:22.360 INFO:tasks.workunit.client.0.smithi161.stdout:6/593: creat d6/fcd x:0 0 0 2024-01-17T23:41:22.361 INFO:tasks.workunit.client.0.smithi161.stdout:6/594: stat d6/d7/dc/d85/d1a/l45 0 2024-01-17T23:41:22.361 INFO:tasks.workunit.client.0.smithi161.stdout:3/629: symlink d0/d5/d9/d1e/d3b/d52/daf/ld7 0 2024-01-17T23:41:22.386 INFO:tasks.workunit.client.0.smithi161.stdout:3/630: dwrite d0/d5/d9/d38/d4f/d56/f7e [0,4194304] 0 2024-01-17T23:41:22.394 INFO:tasks.workunit.client.0.smithi161.stdout:3/631: write d0/d5/d9/d1e/f7b [1071915,8676] 0 2024-01-17T23:41:22.394 INFO:tasks.workunit.client.0.smithi161.stdout:3/632: truncate d0/d5/d9/d17/d2d/fa4 728223 0 2024-01-17T23:41:22.416 INFO:tasks.workunit.client.0.smithi161.stdout:3/633: dwrite d0/d5/d9/d38/d4f/d56/fb8 [0,4194304] 0 2024-01-17T23:41:22.416 INFO:tasks.workunit.client.0.smithi161.stdout:3/634: readlink d0/d5/d9/d38/d4f/lcd 0 2024-01-17T23:41:22.487 INFO:tasks.workunit.client.0.smithi161.stdout:7/591: getdents da/db/d7a/dc7 0 2024-01-17T23:41:22.516 INFO:tasks.workunit.client.0.smithi161.stdout:7/592: dwrite da/db/fc1 [0,4194304] 0 2024-01-17T23:41:22.516 INFO:tasks.workunit.client.0.smithi161.stdout:7/593: truncate da/db/d7a/d8f/dac/fb7 908060 0 2024-01-17T23:41:22.516 INFO:tasks.workunit.client.0.smithi161.stdout:7/594: fdatasync da/d34/d5a/d68/f97 0 2024-01-17T23:41:22.516 INFO:tasks.workunit.client.0.smithi161.stdout:7/595: truncate da/d34/d4a/d4c/f70 80409 0 2024-01-17T23:41:22.648 INFO:tasks.workunit.client.0.smithi161.stdout:4/689: link d9/d1b/d24/f93 d9/d1b/d24/d25/fcc 0 2024-01-17T23:41:22.671 INFO:tasks.workunit.client.0.smithi161.stdout:4/690: dwrite d9/de/d1e/d58/d60/d9c/fae [0,4194304] 0 2024-01-17T23:41:22.735 INFO:tasks.workunit.client.0.smithi161.stdout:0/664: creat d5/d34/d21/d9e/dc7/fce x:0 0 0 2024-01-17T23:41:24.170 INFO:tasks.workunit.client.0.smithi161.stdout:7/596: rename da/d34/d5a/d3b/d3d/d82/f99 to da/d34/d5a/d28/fce 0 2024-01-17T23:41:24.658 INFO:tasks.workunit.client.0.smithi161.stdout:4/691: dwrite d9/f34 [0,4194304] 0 2024-01-17T23:41:24.736 INFO:tasks.workunit.client.0.smithi161.stdout:5/554: write dd/ff [1300094,118594] 0 2024-01-17T23:41:24.747 INFO:tasks.workunit.client.0.smithi161.stdout:5/555: dread dd/d15/f1c [0,4194304] 0 2024-01-17T23:41:25.309 INFO:tasks.workunit.client.0.smithi161.stdout:7/597: symlink da/d34/d5a/da0/lcf 0 2024-01-17T23:41:25.310 INFO:tasks.workunit.client.0.smithi161.stdout:7/598: fsync da/d34/f4f 0 2024-01-17T23:41:25.499 INFO:tasks.workunit.client.0.smithi161.stdout:4/692: creat d9/de/d1e/d38/fcd x:0 0 0 2024-01-17T23:41:25.531 INFO:tasks.workunit.client.0.smithi161.stdout:4/693: dwrite d9/de/d1e/f35 [0,4194304] 0 2024-01-17T23:41:25.613 INFO:tasks.workunit.client.0.smithi161.stdout:5/556: unlink dd/d15/l18 0 2024-01-17T23:41:25.712 INFO:tasks.workunit.client.0.smithi161.stdout:7/599: truncate da/d34/d5a/d68/d8c/fa6 117323 0 2024-01-17T23:41:25.713 INFO:tasks.workunit.client.0.smithi161.stdout:7/600: write da/d34/d5a/f91 [335682,129013] 0 2024-01-17T23:41:25.713 INFO:tasks.workunit.client.0.smithi161.stdout:7/601: fsync da/fc 0 2024-01-17T23:41:25.741 INFO:tasks.workunit.client.0.smithi161.stdout:7/602: dwrite da/f26 [0,4194304] 0 2024-01-17T23:41:25.754 INFO:tasks.workunit.client.0.smithi161.stdout:7/603: dread da/d34/d5a/f91 [0,4194304] 0 2024-01-17T23:41:25.754 INFO:tasks.workunit.client.0.smithi161.stdout:7/604: creat da/da7/fd0 x:0 0 0 2024-01-17T23:41:25.947 INFO:tasks.workunit.client.0.smithi161.stdout:4/694: symlink d9/d27/d3a/d56/lce 0 2024-01-17T23:41:26.268 INFO:tasks.workunit.client.0.smithi161.stdout:7/605: mknod da/d34/cd1 0 2024-01-17T23:41:26.293 INFO:tasks.workunit.client.0.smithi161.stdout:7/606: dwrite da/d34/d5a/d3b/f61 [0,4194304] 0 2024-01-17T23:41:26.349 INFO:tasks.workunit.client.0.smithi161.stdout:4/695: getdents d9/d1b 0 2024-01-17T23:41:26.350 INFO:tasks.workunit.client.0.smithi161.stdout:4/696: readlink d9/d1b/d24/d25/l61 0 2024-01-17T23:41:26.468 INFO:tasks.workunit.client.0.smithi161.stdout:5/557: rename dd/d15/d4e/f5f to dd/d15/d1a/d5d/d64/fb2 0 2024-01-17T23:41:26.468 INFO:tasks.workunit.client.0.smithi161.stdout:5/558: chown dd/d15/d4e/d4f/d97/fa5 59244 1 2024-01-17T23:41:27.011 INFO:tasks.workunit.client.0.smithi161.stdout:7/607: getdents da/db/d7a 0 2024-01-17T23:41:27.143 INFO:tasks.workunit.client.0.smithi161.stdout:4/697: getdents d9/d51/d64/dc4 0 2024-01-17T23:41:27.239 INFO:tasks.workunit.client.0.smithi161.stdout:5/559: mknod dd/d15/d4e/d4f/d97/cb3 0 2024-01-17T23:41:27.240 INFO:tasks.workunit.client.0.smithi161.stdout:5/560: truncate dd/d15/d51/f6e 631029 0 2024-01-17T23:41:27.240 INFO:tasks.workunit.client.0.smithi161.stdout:5/561: creat dd/d15/d51/fb4 x:0 0 0 2024-01-17T23:41:27.390 INFO:tasks.workunit.client.0.smithi161.stdout:9/486: sync 2024-01-17T23:41:27.390 INFO:tasks.workunit.client.0.smithi161.stdout:8/585: sync 2024-01-17T23:41:27.419 INFO:tasks.workunit.client.0.smithi161.stdout:9/487: dwrite d0/d8/d31/f68 [0,4194304] 0 2024-01-17T23:41:27.419 INFO:tasks.workunit.client.0.smithi161.stdout:9/488: fdatasync d0/f4 0 2024-01-17T23:41:27.524 INFO:tasks.workunit.client.0.smithi161.stdout:7/608: mkdir da/db/d7a/da8/dd2 0 2024-01-17T23:41:27.543 INFO:tasks.workunit.client.0.smithi161.stdout:7/609: dread da/d34/d5a/d3b/db9/f7c [0,4194304] 0 2024-01-17T23:41:27.732 INFO:tasks.workunit.client.0.smithi161.stdout:4/698: rmdir d9/d27/d3a/d87 39 2024-01-17T23:41:27.751 INFO:tasks.workunit.client.0.smithi161.stdout:2/587: write d8/d2e/f95 [2238012,69226] 0 2024-01-17T23:41:27.751 INFO:tasks.workunit.client.0.smithi161.stdout:2/588: readlink d8/d67/d6c/l91 0 2024-01-17T23:41:27.914 INFO:tasks.workunit.client.0.smithi161.stdout:5/562: creat dd/d15/d1a/d5d/d64/d7c/d88/fb5 x:0 0 0 2024-01-17T23:41:27.914 INFO:tasks.workunit.client.0.smithi161.stdout:5/563: fsync dd/d31/d7b/f84 0 2024-01-17T23:41:27.941 INFO:tasks.workunit.client.0.smithi161.stdout:5/564: dwrite dd/d15/d1a/d42/f58 [0,4194304] 0 2024-01-17T23:41:27.942 INFO:tasks.workunit.client.0.smithi161.stdout:5/565: truncate dd/d15/d51/f93 73865 0 2024-01-17T23:41:27.994 INFO:tasks.workunit.client.0.smithi161.stdout:8/586: truncate d1/d3d/f41 3327365 0 2024-01-17T23:41:27.995 INFO:tasks.workunit.client.0.smithi161.stdout:8/587: rename d1/df to d1/df/d20/d2a/d56/dca 22 2024-01-17T23:41:28.196 INFO:tasks.workunit.client.0.smithi161.stdout:1/669: dwrite d1/d2d/d3b/f21 [0,4194304] 0 2024-01-17T23:41:28.356 INFO:tasks.workunit.client.0.smithi161.stdout:9/489: mkdir d0/d8/d14/d18/d20/da2 0 2024-01-17T23:41:28.363 INFO:tasks.workunit.client.0.smithi161.stdout:9/490: dread d0/d8/d31/f8f [0,4194304] 0 2024-01-17T23:41:28.363 INFO:tasks.workunit.client.0.smithi161.stdout:9/491: chown d0/d8/d14/d56/f93 33 1 2024-01-17T23:41:28.493 INFO:tasks.workunit.client.0.smithi161.stdout:7/610: symlink da/d34/d5a/ld3 0 2024-01-17T23:41:28.493 INFO:tasks.workunit.client.0.smithi161.stdout:7/611: creat da/d34/d4a/d4c/fd4 x:0 0 0 2024-01-17T23:41:28.519 INFO:tasks.workunit.client.0.smithi161.stdout:6/595: write d6/d58/f82 [1587169,63726] 0 2024-01-17T23:41:28.519 INFO:tasks.workunit.client.0.smithi161.stdout:6/596: dread - d6/d7/dc/d85/d1a/d59/d8e/fc5 zero size 2024-01-17T23:41:28.545 INFO:tasks.workunit.client.0.smithi161.stdout:4/699: dwrite d9/fc [0,4194304] 0 2024-01-17T23:41:28.648 INFO:tasks.workunit.client.0.smithi161.stdout:2/589: symlink d8/d4b/lcf 0 2024-01-17T23:41:28.776 INFO:tasks.workunit.client.0.smithi161.stdout:3/635: dwrite d0/d5/d9/d17/f9c [0,4194304] 0 2024-01-17T23:41:28.939 INFO:tasks.workunit.client.0.smithi161.stdout:8/588: dread d1/d3/f9 [0,4194304] 0 2024-01-17T23:41:29.237 INFO:tasks.workunit.client.0.smithi161.stdout:1/670: getdents d1/d8 0 2024-01-17T23:41:29.636 INFO:tasks.workunit.client.0.smithi161.stdout:6/597: symlink d6/d7/dc/d43/dc3/lce 0 2024-01-17T23:41:29.951 INFO:tasks.workunit.client.0.smithi161.stdout:4/700: symlink d9/d1b/d24/d25/lcf 0 2024-01-17T23:41:30.036 INFO:tasks.workunit.client.0.smithi161.stdout:4/701: chown d9/de/d1e/d38/c9a 6834889 1 2024-01-17T23:41:30.142 INFO:tasks.workunit.client.0.smithi161.stdout:2/590: dwrite d8/d4b/f9c [0,4194304] 0 2024-01-17T23:41:30.189 INFO:tasks.workunit.client.0.smithi161.stdout:2/591: dwrite d8/f37 [0,4194304] 0 2024-01-17T23:41:30.189 INFO:tasks.workunit.client.0.smithi161.stdout:2/592: write d8/d67/fac [430211,20422] 0 2024-01-17T23:41:30.189 INFO:tasks.workunit.client.0.smithi161.stdout:2/593: write d8/d4b/f85 [1565531,19983] 0 2024-01-17T23:41:30.206 INFO:tasks.workunit.client.0.smithi161.stdout:2/594: dread d8/d2e/fb2 [0,4194304] 0 2024-01-17T23:41:30.423 INFO:tasks.workunit.client.0.smithi161.stdout:3/636: unlink d0/d5/d9/d38/cae 0 2024-01-17T23:41:30.478 INFO:tasks.workunit.client.0.smithi161.stdout:8/589: mknod d1/d3/d19/d1d/daa/ccb 0 2024-01-17T23:41:32.822 INFO:tasks.workunit.client.0.smithi161.stdout:4/702: truncate d9/d27/d3a/d56/f5f 572840 0 2024-01-17T23:41:32.848 INFO:tasks.workunit.client.0.smithi161.stdout:4/703: dwrite d9/de/d1e/d58/f95 [0,4194304] 0 2024-01-17T23:41:32.979 INFO:tasks.workunit.client.0.smithi161.stdout:2/595: mknod d8/d1c/d75/dae/cd0 0 2024-01-17T23:41:33.072 INFO:tasks.workunit.client.0.smithi161.stdout:3/637: creat d0/d5/d9/d1e/d5a/fd8 x:0 0 0 2024-01-17T23:41:33.090 INFO:tasks.workunit.client.0.smithi161.stdout:3/638: dread d0/f77 [0,4194304] 0 2024-01-17T23:41:33.228 INFO:tasks.workunit.client.0.smithi161.stdout:8/590: rename d1/df/ca1 to d1/df/d20/d6a/ccc 0 2024-01-17T23:41:33.235 INFO:tasks.workunit.client.0.smithi161.stdout:8/591: dread d1/d22/d2f/f85 [0,4194304] 0 2024-01-17T23:41:33.573 INFO:tasks.workunit.client.0.smithi161.stdout:1/671: truncate d1/d2d/d3b/f7e 11068 0 2024-01-17T23:41:33.583 INFO:tasks.workunit.client.0.smithi161.stdout:1/672: read d1/d8/d1f/f49 [221447,1454] 0 2024-01-17T23:41:33.953 INFO:tasks.workunit.client.0.smithi161.stdout:4/704: creat d9/d1b/d24/d25/fd0 x:0 0 0 2024-01-17T23:41:33.985 INFO:tasks.workunit.client.0.smithi161.stdout:4/705: dwrite d9/d27/d3a/d8b/dcb/f78 [0,4194304] 0 2024-01-17T23:41:34.091 INFO:tasks.workunit.client.0.smithi161.stdout:2/596: unlink d8/d1c/d1e/c42 0 2024-01-17T23:41:34.091 INFO:tasks.workunit.client.0.smithi161.stdout:2/597: chown d8/d1c/d75/lc1 66 1 2024-01-17T23:41:34.092 INFO:tasks.workunit.client.0.smithi161.stdout:2/598: chown d8/d67/d6c/d72/f96 382553829 1 2024-01-17T23:41:34.103 INFO:tasks.workunit.client.0.smithi161.stdout:2/599: dread d8/d1c/d1e/da6/d35/fbf [0,4194304] 0 2024-01-17T23:41:34.103 INFO:tasks.workunit.client.0.smithi161.stdout:2/600: fdatasync d8/d4b/d9a/fc0 0 2024-01-17T23:41:34.190 INFO:tasks.workunit.client.0.smithi161.stdout:3/639: getdents d0/d5/d9/d1e/d3b 0 2024-01-17T23:41:34.216 INFO:tasks.workunit.client.0.smithi161.stdout:3/640: dwrite d0/d5/d9/f64 [4194304,4194304] 0 2024-01-17T23:41:34.302 INFO:tasks.workunit.client.0.smithi161.stdout:8/592: creat d1/d3/d19/d1d/d25/fcd x:0 0 0 2024-01-17T23:41:34.302 INFO:tasks.workunit.client.0.smithi161.stdout:8/593: dread - d1/d3/d19/d1d/d25/d4b/f6b zero size 2024-01-17T23:41:34.302 INFO:tasks.workunit.client.0.smithi161.stdout:8/594: fsync d1/f4e 0 2024-01-17T23:41:34.447 INFO:tasks.workunit.client.0.smithi161.stdout:1/673: dread d1/d2d/f78 [0,4194304] 0 2024-01-17T23:41:34.695 INFO:tasks.workunit.client.0.smithi161.stdout:4/706: symlink d9/de/d1e/d38/d6b/ld1 0 2024-01-17T23:41:34.722 INFO:tasks.workunit.client.0.smithi161.stdout:9/492: dwrite d0/f51 [0,4194304] 0 2024-01-17T23:41:34.724 INFO:tasks.workunit.client.0.smithi161.stdout:2/601: symlink d8/d1c/d1e/da6/d35/d3a/ld1 0 2024-01-17T23:41:34.724 INFO:tasks.workunit.client.0.smithi161.stdout:2/602: fsync d8/f37 0 2024-01-17T23:41:34.758 INFO:tasks.workunit.client.0.smithi161.stdout:3/641: rmdir d0/d5/d9/d1e/d3b 39 2024-01-17T23:41:34.759 INFO:tasks.workunit.client.0.smithi161.stdout:3/642: chown d0/c70 112 1 2024-01-17T23:41:34.759 INFO:tasks.workunit.client.0.smithi161.stdout:8/595: mkdir d1/d22/dbd/dce 0 2024-01-17T23:41:34.759 INFO:tasks.workunit.client.0.smithi161.stdout:3/643: chown d0/d5/d9/d17/d5c 0 1 2024-01-17T23:41:35.202 INFO:tasks.workunit.client.0.smithi161.stdout:9/493: link d0/d8/d31/d58/c76 d0/d8/d14/d18/d63/ca3 0 2024-01-17T23:41:35.203 INFO:tasks.workunit.client.0.smithi161.stdout:9/494: creat d0/d8/d31/d58/fa4 x:0 0 0 2024-01-17T23:41:35.226 INFO:tasks.workunit.client.0.smithi161.stdout:9/495: write d0/d39/d49/d6e/f80 [927193,17801] 0 2024-01-17T23:41:35.226 INFO:tasks.workunit.client.0.smithi161.stdout:9/496: write d0/d8/d14/d18/d63/f89 [585863,5591] 0 2024-01-17T23:41:35.235 INFO:tasks.workunit.client.0.smithi161.stdout:9/497: dread d0/d8/d14/f25 [0,4194304] 0 2024-01-17T23:41:35.314 INFO:tasks.workunit.client.0.smithi161.stdout:2/603: unlink d8/d1c/d57/f73 0 2024-01-17T23:41:35.314 INFO:tasks.workunit.client.0.smithi161.stdout:2/604: write d8/da/f58 [3980067,3299] 0 2024-01-17T23:41:35.314 INFO:tasks.workunit.client.0.smithi161.stdout:2/605: fdatasync d8/da/d8d/f97 0 2024-01-17T23:41:35.315 INFO:tasks.workunit.client.0.smithi161.stdout:2/606: stat d8/d1c/l1b 0 2024-01-17T23:41:35.354 INFO:tasks.workunit.client.0.smithi161.stdout:2/607: dwrite d8/d1c/d1e/f44 [0,4194304] 0 2024-01-17T23:41:35.422 INFO:tasks.workunit.client.0.smithi161.stdout:8/596: mknod d1/df/d13/db1/ccf 0 2024-01-17T23:41:35.578 INFO:tasks.workunit.client.0.smithi161.stdout:4/707: creat d9/d27/d3a/d87/fd2 x:0 0 0 2024-01-17T23:41:36.476 INFO:tasks.workunit.client.0.smithi161.stdout:8/597: creat d1/d55/fd0 x:0 0 0 2024-01-17T23:41:36.476 INFO:tasks.workunit.client.0.smithi161.stdout:8/598: write d1/df/d20/f7c [335279,93739] 0 2024-01-17T23:41:36.667 INFO:tasks.workunit.client.0.smithi161.stdout:9/498: mknod d0/ca5 0 2024-01-17T23:41:36.667 INFO:tasks.workunit.client.0.smithi161.stdout:9/499: truncate d0/d8/d31/f71 590379 0 2024-01-17T23:41:36.805 INFO:tasks.workunit.client.0.smithi161.stdout:8/599: getdents d1/df/d16 0 2024-01-17T23:41:36.899 INFO:tasks.workunit.client.0.smithi161.stdout:4/708: symlink d9/d27/d3a/d87/ld3 0 2024-01-17T23:41:36.993 INFO:tasks.workunit.client.0.smithi161.stdout:9/500: creat d0/fa6 x:0 0 0 2024-01-17T23:41:37.168 INFO:tasks.workunit.client.0.smithi161.stdout:0/665: mkdir d5/dcf 0 2024-01-17T23:41:37.193 INFO:tasks.workunit.client.0.smithi161.stdout:0/666: dwrite d5/d34/d20/d2b/dbf/fc4 [0,4194304] 0 2024-01-17T23:41:37.664 INFO:tasks.workunit.client.0.smithi161.stdout:4/709: mkdir d9/de/d69/dd4 0 2024-01-17T23:41:37.682 INFO:tasks.workunit.client.0.smithi161.stdout:4/710: dread d9/de/f33 [0,4194304] 0 2024-01-17T23:41:37.682 INFO:tasks.workunit.client.0.smithi161.stdout:4/711: dread - d9/de/d1e/d38/fcd zero size 2024-01-17T23:41:38.356 INFO:tasks.workunit.client.0.smithi161.stdout:0/667: chown d5/d34/d12/l4d 3290344 1 2024-01-17T23:41:38.801 INFO:tasks.workunit.client.0.smithi161.stdout:4/712: read d9/f31 [371577,5987] 0 2024-01-17T23:41:38.896 INFO:tasks.workunit.client.0.smithi161.stdout:0/668: symlink d5/d34/d21/d76/d93/ld0 0 2024-01-17T23:41:38.922 INFO:tasks.workunit.client.0.smithi161.stdout:0/669: dwrite f0 [0,4194304] 0 2024-01-17T23:41:39.058 INFO:tasks.workunit.client.0.smithi161.stdout:4/713: mknod d9/d1b/d53/cd5 0 2024-01-17T23:41:39.058 INFO:tasks.workunit.client.0.smithi161.stdout:4/714: chown d9/d1b/d52/fc3 4848074 1 2024-01-17T23:41:39.064 INFO:tasks.workunit.client.0.smithi161.stdout:4/715: dread d9/d1b/fa2 [0,4194304] 0 2024-01-17T23:41:39.472 INFO:tasks.workunit.client.0.smithi161.stdout:8/600: read d1/d22/d2f/d92/fc9 [1081405,102638] 0 2024-01-17T23:41:39.503 INFO:tasks.workunit.client.0.smithi161.stdout:8/601: dwrite d1/d88/f95 [0,4194304] 0 2024-01-17T23:41:39.569 INFO:tasks.workunit.client.0.smithi161.stdout:4/716: mknod d9/de/d69/cd6 0 2024-01-17T23:41:40.035 INFO:tasks.workunit.client.0.smithi161.stdout:4/717: symlink d9/d27/d68/ld7 0 2024-01-17T23:41:40.035 INFO:tasks.workunit.client.0.smithi161.stdout:4/718: dread - d9/d1b/d52/fc3 zero size 2024-01-17T23:41:40.137 INFO:tasks.workunit.client.0.smithi161.stdout:4/719: dread d9/de/d1e/d58/d60/d9c/fae [0,4194304] 0 2024-01-17T23:41:40.818 INFO:tasks.workunit.client.0.smithi161.stdout:1/674: rename d1/l5 to d1/d2d/dc1/ldd 0 2024-01-17T23:41:40.963 INFO:tasks.workunit.client.0.smithi161.stdout:4/720: truncate d9/f31 3535554 0 2024-01-17T23:41:40.991 INFO:tasks.workunit.client.0.smithi161.stdout:4/721: dwrite d9/de/d1e/d58/fa0 [0,4194304] 0 2024-01-17T23:41:41.127 INFO:tasks.workunit.client.0.smithi161.stdout:1/675: creat d1/d8/d54/fde x:0 0 0 2024-01-17T23:41:41.432 INFO:tasks.workunit.client.0.smithi161.stdout:4/722: unlink d9/de/d1e/d58/f95 0 2024-01-17T23:41:41.432 INFO:tasks.workunit.client.0.smithi161.stdout:3/644: rename d0/d5/d9/d17/d5c/cc3 to d0/d5/cd9 0 2024-01-17T23:41:41.432 INFO:tasks.workunit.client.0.smithi161.stdout:4/723: dread - d9/d1b/f3b zero size 2024-01-17T23:41:41.571 INFO:tasks.workunit.client.0.smithi161.stdout:1/676: creat d1/d20/d26/d30/fdf x:0 0 0 2024-01-17T23:41:41.575 INFO:tasks.workunit.client.0.smithi161.stdout:1/677: read d1/d8/d1f/f25 [22213,3379] 0 2024-01-17T23:41:41.575 INFO:tasks.workunit.client.0.smithi161.stdout:1/678: chown d1/d11/d72/d81 2 1 2024-01-17T23:41:41.599 INFO:tasks.workunit.client.0.smithi161.stdout:1/679: write d1/d31/d4e/f74 [2421151,45825] 0 2024-01-17T23:41:41.629 INFO:tasks.workunit.client.0.smithi161.stdout:1/680: dwrite d1/d20/d26/d30/f9f [0,4194304] 0 2024-01-17T23:41:41.629 INFO:tasks.workunit.client.0.smithi161.stdout:1/681: readlink d1/la 0 2024-01-17T23:41:41.629 INFO:tasks.workunit.client.0.smithi161.stdout:1/682: fsync d1/d20/d26/d30/d8f/d9e/fd2 0 2024-01-17T23:41:41.629 INFO:tasks.workunit.client.0.smithi161.stdout:1/683: write d1/d8/d54/d94/fc7 [664256,112977] 0 2024-01-17T23:41:41.736 INFO:tasks.workunit.client.0.smithi161.stdout:7/612: rmdir da/d34 39 2024-01-17T23:41:41.736 INFO:tasks.workunit.client.0.smithi161.stdout:2/608: rename d8/d1c/d1e/da6/d35/c32 to d8/db8/dc9/cd2 0 2024-01-17T23:41:41.736 INFO:tasks.workunit.client.0.smithi161.stdout:2/609: read - d8/d2e/da8/fb6 zero size 2024-01-17T23:41:41.736 INFO:tasks.workunit.client.0.smithi161.stdout:2/610: getdents d8/d2e/d84 0 2024-01-17T23:41:41.736 INFO:tasks.workunit.client.0.smithi161.stdout:7/613: write da/d34/d4a/d4c/fd4 [72103,120975] 0 2024-01-17T23:41:41.736 INFO:tasks.workunit.client.0.smithi161.stdout:7/614: fdatasync da/d34/d5a/d68/f97 0 2024-01-17T23:41:41.772 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:41:41.775 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:41:41.850 INFO:tasks.workunit.client.0.smithi161.stdout:3/645: mknod d0/d5/d9/d38/d4f/d50/cda 0 2024-01-17T23:41:41.850 INFO:tasks.workunit.client.0.smithi161.stdout:3/646: write d0/d5/d9/d1e/d3b/d52/fbc [410229,20857] 0 2024-01-17T23:41:41.850 INFO:tasks.workunit.client.0.smithi161.stdout:3/647: fdatasync d0/f4 0 2024-01-17T23:41:41.850 INFO:tasks.workunit.client.0.smithi161.stdout:3/648: creat d0/d5/d9/d38/d4f/d50/fdb x:0 0 0 2024-01-17T23:41:41.850 INFO:tasks.workunit.client.0.smithi161.stdout:3/649: fsync d0/d5/d9/d1e/f7a 0 2024-01-17T23:41:41.868 INFO:tasks.workunit.client.0.smithi161.stdout:3/650: write d0/d5/d9/f55 [2784961,48256] 0 2024-01-17T23:41:41.868 INFO:tasks.workunit.client.0.smithi161.stdout:3/651: fsync d0/d5/d9/d38/d4f/d50/fc0 0 2024-01-17T23:41:41.868 INFO:tasks.workunit.client.0.smithi161.stdout:3/652: readlink d0/d5/d9/d17/d2d/l63 0 2024-01-17T23:41:41.879 INFO:tasks.workunit.client.0.smithi161.stdout:3/653: dread d0/d5/d9/d17/d32/f8e [0,4194304] 0 2024-01-17T23:41:41.893 INFO:tasks.workunit.client.0.smithi161.stdout:4/724: mkdir d9/de/d1e/d38/d89/dd8 0 2024-01-17T23:41:41.893 INFO:tasks.workunit.client.0.smithi161.stdout:4/725: stat d9/d1b/d52 0 2024-01-17T23:41:41.893 INFO:tasks.workunit.client.0.smithi161.stdout:4/726: chown d9/de/f1a 147 1 2024-01-17T23:41:41.900 INFO:tasks.workunit.client.0.smithi161.stdout:3/654: write d0/d5/d9/d1e/d5a/fb9 [4073965,11617] 0 2024-01-17T23:41:41.919 INFO:tasks.workunit.client.0.smithi161.stdout:3/655: dread d0/d5/d9/d17/d32/f4a [0,4194304] 0 2024-01-17T23:41:41.919 INFO:tasks.workunit.client.0.smithi161.stdout:3/656: chown d0/d5/d9/d38/db3/cc2 0 1 2024-01-17T23:41:41.919 INFO:tasks.workunit.client.0.smithi161.stdout:3/657: dread - d0/d5/d9/d1e/d5a/fd8 zero size 2024-01-17T23:41:42.243 INFO:tasks.workunit.client.0.smithi161.stdout:1/684: mknod d1/d20/d26/d30/ce0 0 2024-01-17T23:41:42.243 INFO:tasks.workunit.client.0.smithi161.stdout:5/566: creat dd/d15/d1a/fb6 x:0 0 0 2024-01-17T23:41:42.307 INFO:tasks.workunit.client.0.smithi161.stdout:2/611: symlink d8/d1c/d75/ld3 0 2024-01-17T23:41:42.461 INFO:tasks.workunit.client.0.smithi161.stdout:7/615: creat da/db/d7a/d8f/fd5 x:0 0 0 2024-01-17T23:41:43.352 INFO:tasks.workunit.client.0.smithi161.stdout:0/670: write d5/f59 [811202,75500] 0 2024-01-17T23:41:43.479 INFO:tasks.workunit.client.0.smithi161.stdout:5/567: rmdir dd/d15/d6a 39 2024-01-17T23:41:43.587 INFO:tasks.workunit.client.0.smithi161.stdout:1/685: creat d1/d8/fe1 x:0 0 0 2024-01-17T23:41:43.604 INFO:tasks.workunit.client.0.smithi161.stdout:1/686: dread d1/f38 [0,4194304] 0 2024-01-17T23:41:43.702 INFO:tasks.workunit.client.0.smithi161.stdout:2/612: mknod d8/d1c/d75/dae/cd4 0 2024-01-17T23:41:43.702 INFO:tasks.workunit.client.0.smithi161.stdout:2/613: stat d8/da/l5f 0 2024-01-17T23:41:43.723 INFO:tasks.workunit.client.0.smithi161.stdout:2/614: dread d8/d1c/d1e/fca [0,4194304] 0 2024-01-17T23:41:44.018 INFO:tasks.workunit.client.0.smithi161.stdout:0/671: rmdir d5/d3a/d49/d99/d96 39 2024-01-17T23:41:44.035 INFO:tasks.workunit.client.0.smithi161.stdout:0/672: dread d5/d34/d20/f2f [0,4194304] 0 2024-01-17T23:41:44.198 INFO:tasks.workunit.client.0.smithi161.stdout:5/568: creat dd/d15/d1a/d34/fb7 x:0 0 0 2024-01-17T23:41:44.655 INFO:tasks.workunit.client.0.smithi161.stdout:5/569: mkdir dd/d31/db8 0 2024-01-17T23:41:45.147 INFO:tasks.workunit.client.0.smithi161.stdout:0/673: link d5/d34/d8a/cab d5/d34/d12/d2a/d35/cd1 0 2024-01-17T23:41:45.561 INFO:tasks.workunit.client.0.smithi161.stdout:0/674: symlink d5/d34/d20/d2b/dbf/ld2 0 2024-01-17T23:41:45.561 INFO:tasks.workunit.client.0.smithi161.stdout:0/675: read d5/d8/f1f [2871325,9535] 0 2024-01-17T23:41:45.561 INFO:tasks.workunit.client.0.smithi161.stdout:0/676: fsync d5/d34/d20/d2b/d64/d88/fa4 0 2024-01-17T23:41:45.585 INFO:tasks.workunit.client.0.smithi161.stdout:9/501: sync 2024-01-17T23:41:45.585 INFO:tasks.workunit.client.0.smithi161.stdout:6/598: sync 2024-01-17T23:41:45.586 INFO:tasks.workunit.client.0.smithi161.stdout:8/602: sync 2024-01-17T23:41:45.945 INFO:tasks.workunit.client.0.smithi161.stdout:0/677: truncate f0 3678011 0 2024-01-17T23:41:46.039 INFO:tasks.workunit.client.0.smithi161.stdout:6/599: link d6/d7/l66 d6/d7/dc/d43/dc3/lcf 0 2024-01-17T23:41:46.095 INFO:tasks.workunit.client.0.smithi161.stdout:8/603: getdents d1/d22/dbd 0 2024-01-17T23:41:46.360 INFO:tasks.workunit.client.0.smithi161.stdout:6/600: unlink d6/d7/dc/d3c/d81/f99 0 2024-01-17T23:41:46.373 INFO:tasks.workunit.client.0.smithi161.stdout:6/601: dread d6/d7/dc/d85/d1a/d59/f83 [0,4194304] 0 2024-01-17T23:41:46.795 INFO:tasks.workunit.client.0.smithi161.stdout:6/602: mkdir d6/d7/dc/d85/d1a/dd0 0 2024-01-17T23:41:46.796 INFO:tasks.workunit.client.0.smithi161.stdout:9/502: rmdir d0/d8/d9a 0 2024-01-17T23:41:46.801 INFO:tasks.workunit.client.0.smithi161.stdout:9/503: dread d0/d8/d31/f8f [0,4194304] 0 2024-01-17T23:41:46.826 INFO:tasks.workunit.client.0.smithi161.stdout:2/615: dwrite d8/d4b/f9c [0,4194304] 0 2024-01-17T23:41:47.066 INFO:tasks.workunit.client.0.smithi161.stdout:6/603: creat d6/d7/dc/d43/db9/fd1 x:0 0 0 2024-01-17T23:41:47.067 INFO:tasks.workunit.client.0.smithi161.stdout:9/504: symlink d0/d8/d14/la7 0 2024-01-17T23:41:47.068 INFO:tasks.workunit.client.0.smithi161.stdout:9/505: chown d0/d8/d14/l62 287 1 2024-01-17T23:41:47.119 INFO:tasks.workunit.client.0.smithi161.stdout:6/604: dwrite d6/d7/dc/d85/d1a/f6a [0,4194304] 0 2024-01-17T23:41:47.145 INFO:tasks.workunit.client.0.smithi161.stdout:6/605: dwrite d6/d7/dc/d85/d13/f37 [0,4194304] 0 2024-01-17T23:41:47.258 INFO:tasks.workunit.client.0.smithi161.stdout:2/616: link d8/d1c/d75/dae/dc3/fa1 d8/d1c/d57/fd5 0 2024-01-17T23:41:47.346 INFO:tasks.workunit.client.0.smithi161.stdout:9/506: symlink d0/d8/d31/la8 0 2024-01-17T23:41:47.807 INFO:tasks.workunit.client.0.smithi161.stdout:6/606: symlink d6/d7/dc/d3c/ld2 0 2024-01-17T23:41:47.852 INFO:tasks.workunit.client.0.smithi161.stdout:6/607: dwrite d6/d7/dc/d85/d31/f97 [0,4194304] 0 2024-01-17T23:41:47.877 INFO:tasks.workunit.client.0.smithi161.stdout:6/608: dwrite d6/d7/f2b [0,4194304] 0 2024-01-17T23:41:47.877 INFO:tasks.workunit.client.0.smithi161.stdout:6/609: fsync d6/d7/dc/d85/d31/d5d/d55/fae 0 2024-01-17T23:41:47.877 INFO:tasks.workunit.client.0.smithi161.stdout:6/610: chown d6/d7/dc/d3c/c52 96248978 1 2024-01-17T23:41:47.922 INFO:tasks.workunit.client.0.smithi161.stdout:6/611: dwrite d6/d7/f8 [0,4194304] 0 2024-01-17T23:41:48.011 INFO:tasks.workunit.client.0.smithi161.stdout:2/617: symlink d8/d1c/d75/dae/ld6 0 2024-01-17T23:41:48.188 INFO:tasks.workunit.client.0.smithi161.stdout:9/507: mknod d0/d8/d14/d56/ca9 0 2024-01-17T23:41:48.544 INFO:tasks.workunit.client.0.smithi161.stdout:8/604: symlink d1/d3/ld1 0 2024-01-17T23:41:48.552 INFO:tasks.workunit.client.0.smithi161.stdout:8/605: dread d1/d3/d19/d1d/f71 [0,4194304] 0 2024-01-17T23:41:49.184 INFO:tasks.workunit.client.0.smithi161.stdout:6/612: fdatasync d6/d7/dc/d43/d79/f7f 0 2024-01-17T23:41:49.310 INFO:tasks.workunit.client.0.smithi161.stdout:0/678: unlink d5/d34/fc5 0 2024-01-17T23:41:49.610 INFO:tasks.workunit.client.0.smithi161.stdout:9/508: link d0/d39/d49/d6e/f80 d0/d8/d14/d18/d63/faa 0 2024-01-17T23:41:49.610 INFO:tasks.workunit.client.0.smithi161.stdout:9/509: stat d0/d39/l92 0 2024-01-17T23:41:50.044 INFO:tasks.workunit.client.0.smithi161.stdout:8/606: rmdir d1/d55/db0 0 2024-01-17T23:41:50.044 INFO:tasks.workunit.client.0.smithi161.stdout:6/613: getdents d6/d7/dc/d3c/d81 0 2024-01-17T23:41:50.060 INFO:tasks.workunit.client.0.smithi161.stdout:8/607: dread f0 [8388608,4194304] 0 2024-01-17T23:41:50.060 INFO:tasks.workunit.client.0.smithi161.stdout:8/608: stat d1/d22/d2f/d86 0 2024-01-17T23:41:50.060 INFO:tasks.workunit.client.0.smithi161.stdout:8/609: write d1/d22/d2f/f85 [1575324,21561] 0 2024-01-17T23:41:50.185 INFO:tasks.workunit.client.0.smithi161.stdout:0/679: creat d5/d8/d68/db0/fd3 x:0 0 0 2024-01-17T23:41:50.185 INFO:tasks.workunit.client.0.smithi161.stdout:0/680: fsync d5/d8/d68/f7d 0 2024-01-17T23:41:50.565 INFO:tasks.workunit.client.0.smithi161.stdout:3/658: rename d0/d5/d9/lad to d0/d5/d9/d8b/dd5/ldc 0 2024-01-17T23:41:50.566 INFO:tasks.workunit.client.0.smithi161.stdout:6/614: creat d6/d7/dc/d43/d79/fd3 x:0 0 0 2024-01-17T23:41:50.596 INFO:tasks.workunit.client.0.smithi161.stdout:3/659: dwrite d0/d5/d9/d38/d4f/da5/fd0 [0,4194304] 0 2024-01-17T23:41:50.596 INFO:tasks.workunit.client.0.smithi161.stdout:3/660: chown d0/d5/d9/d1e/d3b/d52/f60 4 1 2024-01-17T23:41:50.597 INFO:tasks.workunit.client.0.smithi161.stdout:3/661: write d0/d5/d9/d38/f74 [1365526,64738] 0 2024-01-17T23:41:50.597 INFO:tasks.workunit.client.0.smithi161.stdout:3/662: chown d0/d5/d9/d38/d4f/d56/la3 2625 1 2024-01-17T23:41:50.597 INFO:tasks.workunit.client.0.smithi161.stdout:3/663: chown d0/d5/d9/d1e/d3b/d52/c9b 70365166 1 2024-01-17T23:41:50.652 INFO:tasks.workunit.client.0.smithi161.stdout:8/610: mknod d1/df/d16/dbf/cd2 0 2024-01-17T23:41:50.897 INFO:tasks.workunit.client.0.smithi161.stdout:0/681: mkdir d5/d34/d21/dd4 0 2024-01-17T23:41:51.025 INFO:tasks.workunit.client.0.smithi161.stdout:7/616: rename da/d34/d5a/d28/c33 to da/db/cd6 0 2024-01-17T23:41:51.025 INFO:tasks.workunit.client.0.smithi161.stdout:7/617: write da/d14/d35/d41/f73 [688712,112229] 0 2024-01-17T23:41:51.150 INFO:tasks.workunit.client.0.smithi161.stdout:6/615: creat d6/d7/dc/d85/d31/fd4 x:0 0 0 2024-01-17T23:41:51.150 INFO:tasks.workunit.client.0.smithi161.stdout:6/616: chown d6/d7/dc/d85/d31/d5d/d55/fbc 725652 1 2024-01-17T23:41:51.151 INFO:tasks.workunit.client.0.smithi161.stdout:6/617: fsync d6/d7/dc/d43/dc3/f86 0 2024-01-17T23:41:51.168 INFO:tasks.workunit.client.0.smithi161.stdout:6/618: dread d6/d7/dc/d85/f98 [0,4194304] 0 2024-01-17T23:41:51.439 INFO:tasks.workunit.client.0.smithi161.stdout:8/611: unlink d1/d3/d19/d1d/f82 0 2024-01-17T23:41:51.690 INFO:tasks.workunit.client.0.smithi161.stdout:5/570: rename dd/d31/d3c/f5b to dd/d15/d1a/d42/fb9 0 2024-01-17T23:41:51.778 INFO:tasks.workunit.client.0.smithi161.stdout:7/618: dread da/d34/d5a/f75 [0,4194304] 0 2024-01-17T23:41:51.778 INFO:tasks.workunit.client.0.smithi161.stdout:7/619: write da/d34/d5a/d3b/db9/f9e [675332,112226] 0 2024-01-17T23:41:51.792 INFO:tasks.workunit.client.0.smithi161.stdout:7/620: dread da/d34/d5a/d3b/f6d [0,4194304] 0 2024-01-17T23:41:52.208 INFO:tasks.workunit.client.0.smithi161.stdout:8/612: creat d1/d3/d19/d1d/d25/d4b/fd3 x:0 0 0 2024-01-17T23:41:52.463 INFO:tasks.workunit.client.0.smithi161.stdout:3/664: rename d0/d5/d9/d1e/d3b/d52/fa0 to d0/d5/d9/d38/db3/fdd 0 2024-01-17T23:41:52.628 INFO:tasks.workunit.client.0.smithi161.stdout:7/621: symlink da/db/d7a/d8f/dac/ld7 0 2024-01-17T23:41:53.019 INFO:tasks.workunit.client.0.smithi161.stdout:8/613: mkdir d1/df/d13/db1/dd4 0 2024-01-17T23:41:53.019 INFO:tasks.workunit.client.0.smithi161.stdout:8/614: readlink d1/df/d20/lc4 0 2024-01-17T23:41:53.019 INFO:tasks.workunit.client.0.smithi161.stdout:8/615: write d1/d3d/fac [604480,102472] 0 2024-01-17T23:41:53.020 INFO:tasks.workunit.client.0.smithi161.stdout:8/616: dread - d1/f9f zero size 2024-01-17T23:41:53.039 INFO:tasks.workunit.client.0.smithi161.stdout:8/617: write d1/d3/d19/d1d/f36 [936427,16953] 0 2024-01-17T23:41:53.056 INFO:tasks.workunit.client.0.smithi161.stdout:8/618: dread d1/d3/d19/d1d/d25/f3b [0,4194304] 0 2024-01-17T23:41:53.056 INFO:tasks.workunit.client.0.smithi161.stdout:8/619: write d1/d3/d19/d1d/f9b [165648,98310] 0 2024-01-17T23:41:53.143 INFO:tasks.workunit.client.0.smithi161.stdout:3/665: truncate d0/d5/d9/d17/f36 400168 0 2024-01-17T23:41:53.143 INFO:tasks.workunit.client.0.smithi161.stdout:3/666: write d0/d5/d9/d8b/fc4 [4899133,57143] 0 2024-01-17T23:41:53.305 INFO:tasks.workunit.client.0.smithi161.stdout:7/622: creat da/db/d7a/d8f/dac/dba/fd8 x:0 0 0 2024-01-17T23:41:53.336 INFO:tasks.workunit.client.0.smithi161.stdout:7/623: dwrite da/db/f13 [0,4194304] 0 2024-01-17T23:41:53.546 INFO:tasks.workunit.client.0.smithi161.stdout:8/620: mknod d1/d22/dbd/dce/cd5 0 2024-01-17T23:41:53.575 INFO:tasks.workunit.client.0.smithi161.stdout:8/621: dwrite d1/d55/fd0 [0,4194304] 0 2024-01-17T23:41:53.575 INFO:tasks.workunit.client.0.smithi161.stdout:8/622: fdatasync d1/d22/d2f/d92/fb7 0 2024-01-17T23:41:53.596 INFO:tasks.workunit.client.0.smithi161.stdout:8/623: write d1/d22/f74 [2307449,109432] 0 2024-01-17T23:41:53.618 INFO:tasks.workunit.client.0.smithi161.stdout:3/667: creat d0/d5/d9/d38/d4f/d9d/da7/fde x:0 0 0 2024-01-17T23:41:53.646 INFO:tasks.workunit.client.0.smithi161.stdout:3/668: dwrite d0/d5/d9/d1e/d5a/f7d [0,4194304] 0 2024-01-17T23:41:53.681 INFO:tasks.workunit.client.0.smithi161.stdout:3/669: dwrite d0/da2/fd1 [0,4194304] 0 2024-01-17T23:41:53.910 INFO:tasks.workunit.client.0.smithi161.stdout:7/624: mknod da/d34/d5a/d28/d2b/cd9 0 2024-01-17T23:41:53.925 INFO:tasks.workunit.client.0.smithi161.stdout:7/625: dread da/d34/d5a/d3b/d3d/f40 [0,4194304] 0 2024-01-17T23:41:54.175 INFO:tasks.workunit.client.0.smithi161.stdout:8/624: mkdir d1/d22/d2f/dd6 0 2024-01-17T23:41:54.203 INFO:tasks.workunit.client.0.smithi161.stdout:8/625: dwrite d1/d22/d2f/d92/fa7 [0,4194304] 0 2024-01-17T23:41:54.645 INFO:tasks.workunit.client.0.smithi161.stdout:7/626: creat da/d34/d5a/d28/fda x:0 0 0 2024-01-17T23:41:55.085 INFO:tasks.workunit.client.0.smithi161.stdout:8/626: truncate d1/d3/f9 8074368 0 2024-01-17T23:41:55.096 INFO:tasks.workunit.client.0.smithi161.stdout:0/682: dread d5/d34/d21/d76/fae [0,4194304] 0 2024-01-17T23:41:55.229 INFO:tasks.workunit.client.0.smithi161.stdout:7/627: mknod da/db/d7a/da8/cdb 0 2024-01-17T23:41:55.229 INFO:tasks.workunit.client.0.smithi161.stdout:9/510: write d0/f64 [586323,101626] 0 2024-01-17T23:41:55.229 INFO:tasks.workunit.client.0.smithi161.stdout:9/511: readlink d0/d8/d14/d18/l2e 0 2024-01-17T23:41:55.254 INFO:tasks.workunit.client.0.smithi161.stdout:7/628: dwrite da/da7/fd0 [0,4194304] 0 2024-01-17T23:41:55.256 INFO:tasks.workunit.client.0.smithi161.stdout:1/687: sync 2024-01-17T23:41:55.256 INFO:tasks.workunit.client.0.smithi161.stdout:4/727: sync 2024-01-17T23:41:55.256 INFO:tasks.workunit.client.0.smithi161.stdout:2/618: sync 2024-01-17T23:41:55.291 INFO:tasks.workunit.client.0.smithi161.stdout:2/619: dwrite d8/d1c/d57/fd5 [0,4194304] 0 2024-01-17T23:41:55.309 INFO:tasks.workunit.client.0.smithi161.stdout:2/620: write d8/d1c/d75/dae/dc3/fb7 [1259093,23680] 0 2024-01-17T23:41:55.443 INFO:tasks.workunit.client.0.smithi161.stdout:0/683: creat d5/d34/d21/dd4/fd5 x:0 0 0 2024-01-17T23:41:55.443 INFO:tasks.workunit.client.0.smithi161.stdout:0/684: fdatasync d5/d34/d20/d2b/d64/f78 0 2024-01-17T23:41:55.469 INFO:tasks.workunit.client.0.smithi161.stdout:0/685: dwrite d5/d34/d12/d2a/d35/f8e [0,4194304] 0 2024-01-17T23:41:55.737 INFO:tasks.workunit.client.0.smithi161.stdout:9/512: mkdir d0/d8/d14/dab 0 2024-01-17T23:41:55.738 INFO:tasks.workunit.client.0.smithi161.stdout:9/513: chown d0/d8/d14/d56/c6d 62765101 1 2024-01-17T23:41:56.047 INFO:tasks.workunit.client.0.smithi161.stdout:1/688: link d1/d8/d1c/c59 d1/d8/d54/d94/ce2 0 2024-01-17T23:41:56.060 INFO:tasks.workunit.client.0.smithi161.stdout:1/689: write d1/d8/fc [2722505,50727] 0 2024-01-17T23:41:56.972 INFO:tasks.workunit.client.0.smithi161.stdout:2/621: mkdir d8/d4b/d9a/db0/dd7 0 2024-01-17T23:41:57.114 INFO:tasks.workunit.client.0.smithi161.stdout:8/627: getdents d1/d55 0 2024-01-17T23:41:57.116 INFO:tasks.workunit.client.0.smithi161.stdout:6/619: sync 2024-01-17T23:41:57.398 INFO:tasks.workunit.client.0.smithi161.stdout:0/686: getdents d5/d34/d20/d2b/d64 0 2024-01-17T23:41:57.560 INFO:tasks.workunit.client.0.smithi161.stdout:9/514: link d0/d8/d14/c72 d0/d39/d49/cac 0 2024-01-17T23:41:57.560 INFO:tasks.workunit.client.0.smithi161.stdout:5/571: sync 2024-01-17T23:41:57.560 INFO:tasks.workunit.client.0.smithi161.stdout:9/515: stat d0/d8/d14/d18/d63/l7e 0 2024-01-17T23:41:57.680 INFO:tasks.workunit.client.0.smithi161.stdout:1/690: symlink d1/le3 0 2024-01-17T23:41:57.707 INFO:tasks.workunit.client.0.smithi161.stdout:1/691: dwrite d1/d8/d1c/f69 [4194304,4194304] 0 2024-01-17T23:41:57.707 INFO:tasks.workunit.client.0.smithi161.stdout:1/692: dread - d1/d20/d26/d30/d41/fb1 zero size 2024-01-17T23:41:58.038 INFO:tasks.workunit.client.0.smithi161.stdout:8/628: mknod d1/df/d13/db1/cd7 0 2024-01-17T23:41:58.069 INFO:tasks.workunit.client.0.smithi161.stdout:8/629: dwrite d1/df/d20/d6a/f6c [0,4194304] 0 2024-01-17T23:41:58.122 INFO:tasks.workunit.client.0.smithi161.stdout:9/516: dwrite d0/f2c [0,4194304] 0 2024-01-17T23:41:58.202 INFO:tasks.workunit.client.0.smithi161.stdout:5/572: creat dd/d15/d1a/d5d/d64/d67/fba x:0 0 0 2024-01-17T23:41:58.860 INFO:tasks.workunit.client.0.smithi161.stdout:5/573: symlink dd/d15/d4e/d4f/lbb 0 2024-01-17T23:41:59.381 INFO:tasks.workunit.client.0.smithi161.stdout:3/670: dwrite d0/d5/d9/d17/d2d/fa4 [0,4194304] 0 2024-01-17T23:41:59.405 INFO:tasks.workunit.client.0.smithi161.stdout:4/728: rename d9/l3f to d9/d27/d3a/d87/ld9 0 2024-01-17T23:41:59.405 INFO:tasks.workunit.client.0.smithi161.stdout:4/729: readlink d9/d27/d3a/d56/la1 0 2024-01-17T23:41:59.433 INFO:tasks.workunit.client.0.smithi161.stdout:4/730: dwrite d9/de/f33 [0,4194304] 0 2024-01-17T23:41:59.457 INFO:tasks.workunit.client.0.smithi161.stdout:4/731: dwrite d9/d1b/d24/d25/f47 [4194304,4194304] 0 2024-01-17T23:42:00.481 INFO:tasks.workunit.client.0.smithi161.stdout:2/622: rename d8/d1c/d1e/d80/d79/ca4 to d8/d1c/d1e/da6/cd8 0 2024-01-17T23:42:00.711 INFO:tasks.workunit.client.0.smithi161.stdout:7/629: sync 2024-01-17T23:42:00.711 INFO:tasks.workunit.client.0.smithi161.stdout:7/630: creat da/da7/fdc x:0 0 0 2024-01-17T23:42:00.711 INFO:tasks.workunit.client.0.smithi161.stdout:7/631: chown da/d34/d5a/d68/d8c 2735960 1 2024-01-17T23:42:00.711 INFO:tasks.workunit.client.0.smithi161.stdout:7/632: fsync da/d34/d5a/d3b/f87 0 2024-01-17T23:42:00.827 INFO:tasks.workunit.client.0.smithi161.stdout:4/732: creat d9/d27/d68/fda x:0 0 0 2024-01-17T23:42:01.021 INFO:tasks.workunit.client.0.smithi161.stdout:6/620: rename d6/d7/dc/d85/d31/d5d/f46 to d6/d7/dc/d43/fd5 0 2024-01-17T23:42:01.021 INFO:tasks.workunit.client.0.smithi161.stdout:6/621: chown d6/d7/l66 10454299 1 2024-01-17T23:42:01.043 INFO:tasks.workunit.client.0.smithi161.stdout:6/622: dread d6/d7/f8 [0,4194304] 0 2024-01-17T23:42:01.088 INFO:tasks.workunit.client.0.smithi161.stdout:2/623: creat d8/d1c/d75/dae/fd9 x:0 0 0 2024-01-17T23:42:01.530 INFO:tasks.workunit.client.0.smithi161.stdout:7/633: symlink da/db/db2/ldd 0 2024-01-17T23:42:01.693 INFO:tasks.workunit.client.0.smithi161.stdout:4/733: unlink d9/d27/d3a/d56/la1 0 2024-01-17T23:42:01.934 INFO:tasks.workunit.client.0.smithi161.stdout:2/624: creat d8/da/fda x:0 0 0 2024-01-17T23:42:02.106 INFO:tasks.workunit.client.0.smithi161.stdout:7/634: mkdir da/db/d7a/d8f/dde 0 2024-01-17T23:42:02.110 INFO:tasks.workunit.client.0.smithi161.stdout:7/635: dread da/d34/d4a/d4c/fd4 [0,4194304] 0 2024-01-17T23:42:02.288 INFO:tasks.workunit.client.0.smithi161.stdout:0/687: rename d5/d3a/d49/d99/f58 to d5/d34/d12/fd6 0 2024-01-17T23:42:02.306 INFO:tasks.workunit.client.0.smithi161.stdout:0/688: dread d5/d8/d68/f7d [0,4194304] 0 2024-01-17T23:42:02.484 INFO:tasks.workunit.client.0.smithi161.stdout:7/636: symlink da/db/db2/ldf 0 2024-01-17T23:42:02.484 INFO:tasks.workunit.client.0.smithi161.stdout:8/630: write d1/d22/d2f/d92/fc9 [62447,99872] 0 2024-01-17T23:42:02.484 INFO:tasks.workunit.client.0.smithi161.stdout:8/631: dread - d1/d3/d19/d1d/d25/d4b/fd3 zero size 2024-01-17T23:42:02.488 INFO:tasks.workunit.client.0.smithi161.stdout:8/632: dread d1/d3/d19/d1d/f9b [0,4194304] 0 2024-01-17T23:42:02.697 INFO:tasks.workunit.client.0.smithi161.stdout:1/693: rename d1/d20/f37 to d1/d8/d1f/fe4 0 2024-01-17T23:42:02.697 INFO:tasks.workunit.client.0.smithi161.stdout:1/694: chown d1/d11/f75 35055 1 2024-01-17T23:42:02.697 INFO:tasks.workunit.client.0.smithi161.stdout:1/695: write d1/d31/fa3 [704310,101277] 0 2024-01-17T23:42:02.698 INFO:tasks.workunit.client.0.smithi161.stdout:1/696: fdatasync d1/d11/f75 0 2024-01-17T23:42:02.698 INFO:tasks.workunit.client.0.smithi161.stdout:0/689: mkdir d5/d3a/d49/d99/dd7 0 2024-01-17T23:42:02.715 INFO:tasks.workunit.client.0.smithi161.stdout:9/517: write d0/f3a [3586803,3248] 0 2024-01-17T23:42:02.746 INFO:tasks.workunit.client.0.smithi161.stdout:7/637: creat da/db/db2/fe0 x:0 0 0 2024-01-17T23:42:02.757 INFO:tasks.workunit.client.0.smithi161.stdout:7/638: dread da/f26 [0,4194304] 0 2024-01-17T23:42:02.764 INFO:tasks.workunit.client.0.smithi161.stdout:7/639: dread f8 [0,4194304] 0 2024-01-17T23:42:03.961 INFO:tasks.workunit.client.0.smithi161.stdout:5/574: rename dd/d31/d3c/f90 to dd/fbc 0 2024-01-17T23:42:03.961 INFO:tasks.workunit.client.0.smithi161.stdout:5/575: read - dd/d31/d56/f99 zero size 2024-01-17T23:42:03.961 INFO:tasks.workunit.client.0.smithi161.stdout:5/576: stat dd/d15/d1a/d42/da4 0 2024-01-17T23:42:03.961 INFO:tasks.workunit.client.0.smithi161.stdout:5/577: chown dd/d15/d1a/d42 30 1 2024-01-17T23:42:03.979 INFO:tasks.workunit.client.0.smithi161.stdout:5/578: dread dd/d15/d1a/d42/fb9 [0,4194304] 0 2024-01-17T23:42:04.181 INFO:tasks.workunit.client.0.smithi161.stdout:9/518: creat d0/d8/d14/d18/d20/d97/d9e/fad x:0 0 0 2024-01-17T23:42:04.195 INFO:tasks.workunit.client.0.smithi161.stdout:9/519: read d0/d8/d14/f90 [2473468,120907] 0 2024-01-17T23:42:04.274 INFO:tasks.workunit.client.0.smithi161.stdout:7/640: dread da/db/d7a/d8f/dac/fb7 [0,4194304] 0 2024-01-17T23:42:04.324 INFO:tasks.workunit.client.0.smithi161.stdout:7/641: dwrite da/d34/d5a/d3b/f61 [0,4194304] 0 2024-01-17T23:42:04.326 INFO:tasks.workunit.client.0.smithi161.stdout:7/642: read da/db/d7a/d8f/dac/fb7 [795767,7728] 0 2024-01-17T23:42:04.573 INFO:tasks.workunit.client.0.smithi161.stdout:3/671: dwrite d0/d5/d9/d17/f1c [0,4194304] 0 2024-01-17T23:42:04.573 INFO:tasks.workunit.client.0.smithi161.stdout:3/672: stat d0/d5/d9/d1e/d3b/c76 0 2024-01-17T23:42:04.574 INFO:tasks.workunit.client.0.smithi161.stdout:3/673: dread - d0/d5/d9/d17/d2d/fd6 zero size 2024-01-17T23:42:04.847 INFO:tasks.workunit.client.0.smithi161.stdout:5/579: link dd/d15/d1a/f43 dd/d31/db8/fbd 0 2024-01-17T23:42:05.035 INFO:tasks.workunit.client.0.smithi161.stdout:9/520: unlink d0/f4 0 2024-01-17T23:42:05.035 INFO:tasks.workunit.client.0.smithi161.stdout:9/521: truncate d0/d8/d14/d87/f8d 905592 0 2024-01-17T23:42:05.035 INFO:tasks.workunit.client.0.smithi161.stdout:9/522: chown d0/d8/l88 2 1 2024-01-17T23:42:05.304 INFO:tasks.workunit.client.0.smithi161.stdout:3/674: unlink d0/d5/d9/d38/d4f/d56/fd4 0 2024-01-17T23:42:05.304 INFO:tasks.workunit.client.0.smithi161.stdout:3/675: write d0/d5/d9/d1e/d5a/fb9 [5116796,71070] 0 2024-01-17T23:42:05.304 INFO:tasks.workunit.client.0.smithi161.stdout:3/676: readlink d0/d5/d9/d1e/d3b/d52/daf/ld7 0 2024-01-17T23:42:05.338 INFO:tasks.workunit.client.0.smithi161.stdout:3/677: dwrite d0/d5/d9/d38/d4f/d50/fdb [0,4194304] 0 2024-01-17T23:42:05.338 INFO:tasks.workunit.client.0.smithi161.stdout:3/678: write d0/d5/d9/d17/d32/f89 [4688206,74919] 0 2024-01-17T23:42:05.378 INFO:tasks.workunit.client.0.smithi161.stdout:3/679: dwrite d0/d5/d9/d38/d4f/d9d/da7/fbf [0,4194304] 0 2024-01-17T23:42:05.501 INFO:tasks.workunit.client.0.smithi161.stdout:6/623: rename d6/d7/dc/d85/f11 to d6/d7/dc/d43/d79/fd6 0 2024-01-17T23:42:05.501 INFO:tasks.workunit.client.0.smithi161.stdout:2/625: rename d8 to d8/d67/d6c/ddb 22 2024-01-17T23:42:05.501 INFO:tasks.workunit.client.0.smithi161.stdout:2/626: chown d8/d1c/d75/dae/ld6 33945388 1 2024-01-17T23:42:05.841 INFO:tasks.workunit.client.0.smithi161.stdout:9/523: mkdir d0/d8/d14/d18/d20/d97/dae 0 2024-01-17T23:42:06.588 INFO:tasks.workunit.client.0.smithi161.stdout:3/680: creat d0/d5/d9/d1e/d3b/fdf x:0 0 0 2024-01-17T23:42:06.601 INFO:tasks.workunit.client.0.smithi161.stdout:3/681: dread d0/d5/d9/d17/f18 [0,4194304] 0 2024-01-17T23:42:06.632 INFO:tasks.workunit.client.0.smithi161.stdout:3/682: dwrite d0/d5/f1d [0,4194304] 0 2024-01-17T23:42:06.632 INFO:tasks.workunit.client.0.smithi161.stdout:3/683: write d0/d5/d9/d17/d2d/fd6 [896361,30144] 0 2024-01-17T23:42:06.633 INFO:tasks.workunit.client.0.smithi161.stdout:3/684: chown d0/d5/d9/d38/d4f/d50/l8f 5653181 1 2024-01-17T23:42:06.781 INFO:tasks.workunit.client.0.smithi161.stdout:5/580: rename dd/d31/c4d to dd/d31/db8/cbe 0 2024-01-17T23:42:07.117 INFO:tasks.workunit.client.0.smithi161.stdout:4/734: dwrite f4 [4194304,4194304] 0 2024-01-17T23:42:07.435 INFO:tasks.workunit.client.0.smithi161.stdout:9/524: rename d0/d8/d14/d18/d63/l8e to d0/d8/d14/d18/d63/laf 0 2024-01-17T23:42:07.809 INFO:tasks.workunit.client.0.smithi161.stdout:5/581: mkdir dd/d15/d51/dbf 0 2024-01-17T23:42:07.840 INFO:tasks.workunit.client.0.smithi161.stdout:5/582: dwrite dd/d15/d51/f62 [0,4194304] 0 2024-01-17T23:42:07.840 INFO:tasks.workunit.client.0.smithi161.stdout:5/583: chown dd/d15/d1a/d5d/d64/d67 22524 1 2024-01-17T23:42:08.124 INFO:tasks.workunit.client.0.smithi161.stdout:4/735: mkdir d9/d1b/d24/ddb 0 2024-01-17T23:42:08.368 INFO:tasks.workunit.client.0.smithi161.stdout:9/525: getdents d0/d8/d14 0 2024-01-17T23:42:08.369 INFO:tasks.workunit.client.0.smithi161.stdout:9/526: chown d0/d8/c77 11332 1 2024-01-17T23:42:08.868 INFO:tasks.workunit.client.0.smithi161.stdout:9/527: mknod d0/d8/d14/d18/d20/d97/dae/cb0 0 2024-01-17T23:42:08.868 INFO:tasks.workunit.client.0.smithi161.stdout:9/528: fsync d0/d8/d14/d18/d63/f89 0 2024-01-17T23:42:08.868 INFO:tasks.workunit.client.0.smithi161.stdout:9/529: write d0/d8/d14/d18/d63/f9d [349954,15739] 0 2024-01-17T23:42:08.868 INFO:tasks.workunit.client.0.smithi161.stdout:9/530: creat d0/d8/d14/d18/d20/d97/d9e/fb1 x:0 0 0 2024-01-17T23:42:08.868 INFO:tasks.workunit.client.0.smithi161.stdout:9/531: write d0/d39/d49/f82 [1035923,126329] 0 2024-01-17T23:42:09.029 INFO:tasks.workunit.client.0.smithi161.stdout:5/584: readlink dd/d15/d6a/d80/la8 0 2024-01-17T23:42:09.182 INFO:tasks.workunit.client.0.smithi161.stdout:8/633: sync 2024-01-17T23:42:09.465 INFO:tasks.workunit.client.0.smithi161.stdout:5/585: creat dd/d15/d6a/fc0 x:0 0 0 2024-01-17T23:42:09.488 INFO:tasks.workunit.client.0.smithi161.stdout:1/697: dwrite d1/d8/d1f/f25 [0,4194304] 0 2024-01-17T23:42:09.489 INFO:tasks.workunit.client.0.smithi161.stdout:1/698: chown d1/d11/l33 234150 1 2024-01-17T23:42:09.559 INFO:tasks.workunit.client.0.smithi161.stdout:8/634: link d1/f94 d1/d22/d2f/dd6/fd8 0 2024-01-17T23:42:09.605 INFO:tasks.workunit.client.0.smithi161.stdout:0/690: write d5/d3a/f43 [747358,91315] 0 2024-01-17T23:42:09.605 INFO:tasks.workunit.client.0.smithi161.stdout:0/691: chown d5/d34/d20/l5f 1044662 1 2024-01-17T23:42:09.692 INFO:tasks.workunit.client.0.smithi161.stdout:9/532: getdents d0/d8/d31/d58 0 2024-01-17T23:42:09.717 INFO:tasks.workunit.client.0.smithi161.stdout:9/533: write d0/f50 [912492,4024] 0 2024-01-17T23:42:09.717 INFO:tasks.workunit.client.0.smithi161.stdout:9/534: dread - d0/d8/d14/d56/f9f zero size 2024-01-17T23:42:09.764 INFO:tasks.workunit.client.0.smithi161.stdout:5/586: mknod dd/d15/d4e/d4f/cc1 0 2024-01-17T23:42:09.764 INFO:tasks.workunit.client.0.smithi161.stdout:5/587: creat dd/d15/d1a/d5d/d64/d67/fc2 x:0 0 0 2024-01-17T23:42:10.117 INFO:tasks.workunit.client.0.smithi161.stdout:1/699: rename d1/d20/d26/d30/d8f/d9e/faf to d1/d2d/fe5 0 2024-01-17T23:42:10.118 INFO:tasks.workunit.client.0.smithi161.stdout:1/700: chown d1/d8/d54/d94/ce2 4716 1 2024-01-17T23:42:10.139 INFO:tasks.workunit.client.0.smithi161.stdout:1/701: dread d1/d20/f2e [4194304,4194304] 0 2024-01-17T23:42:11.010 INFO:tasks.workunit.client.0.smithi161.stdout:9/535: creat d0/d39/d49/d6e/fb2 x:0 0 0 2024-01-17T23:42:11.010 INFO:tasks.workunit.client.0.smithi161.stdout:6/624: getdents d6/d7/dc/d85 0 2024-01-17T23:42:11.208 INFO:tasks.workunit.client.0.smithi161.stdout:5/588: creat dd/d15/d4e/d4f/d77/fc3 x:0 0 0 2024-01-17T23:42:11.237 INFO:tasks.workunit.client.0.smithi161.stdout:5/589: dwrite dd/d15/d1a/d42/f58 [0,4194304] 0 2024-01-17T23:42:11.483 INFO:tasks.workunit.client.0.smithi161.stdout:0/692: rename d5/d8/f29 to d5/d34/d21/fd8 0 2024-01-17T23:42:11.483 INFO:tasks.workunit.client.0.smithi161.stdout:0/693: chown d5/d3a/d49/fa1 0 1 2024-01-17T23:42:11.595 INFO:tasks.workunit.client.0.smithi161.stdout:1/702: symlink d1/d20/le6 0 2024-01-17T23:42:11.595 INFO:tasks.workunit.client.0.smithi161.stdout:1/703: fsync d1/d2d/f78 0 2024-01-17T23:42:11.626 INFO:tasks.workunit.client.0.smithi161.stdout:7/643: dwrite da/d34/d5a/f75 [0,4194304] 0 2024-01-17T23:42:11.731 INFO:tasks.workunit.client.0.smithi161.stdout:9/536: creat d0/d8/d14/d87/fb3 x:0 0 0 2024-01-17T23:42:11.918 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:42:11.922 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:42:12.254 INFO:tasks.workunit.client.0.smithi161.stdout:0/694: rename d5/d3a/d49/d99/f31 to d5/d34/d20/d2b/fd9 0 2024-01-17T23:42:12.254 INFO:tasks.workunit.client.0.smithi161.stdout:0/695: creat d5/d3a/d49/d99/fda x:0 0 0 2024-01-17T23:42:12.477 INFO:tasks.workunit.client.0.smithi161.stdout:7/644: creat da/d14/d35/fe1 x:0 0 0 2024-01-17T23:42:12.477 INFO:tasks.workunit.client.0.smithi161.stdout:7/645: chown da/db/d7a/dc0 434 1 2024-01-17T23:42:12.753 INFO:tasks.workunit.client.0.smithi161.stdout:9/537: dread - d0/d8/d31/f86 zero size 2024-01-17T23:42:13.009 INFO:tasks.workunit.client.0.smithi161.stdout:2/627: sync 2024-01-17T23:42:13.009 INFO:tasks.workunit.client.0.smithi161.stdout:3/685: sync 2024-01-17T23:42:13.009 INFO:tasks.workunit.client.0.smithi161.stdout:2/628: readlink d8/d2e/l5c 0 2024-01-17T23:42:13.031 INFO:tasks.workunit.client.0.smithi161.stdout:2/629: write d8/d1c/d75/dae/dc3/f53 [533367,69230] 0 2024-01-17T23:42:13.031 INFO:tasks.workunit.client.0.smithi161.stdout:2/630: write d8/d2e/f95 [1967898,52777] 0 2024-01-17T23:42:13.750 INFO:tasks.workunit.client.0.smithi161.stdout:0/696: mknod d5/d3a/d49/d99/dd7/cdb 0 2024-01-17T23:42:13.859 INFO:tasks.workunit.client.0.smithi161.stdout:1/704: dread d1/d8/d1c/d3e/f92 [0,4194304] 0 2024-01-17T23:42:13.859 INFO:tasks.workunit.client.0.smithi161.stdout:1/705: chown d1/d2d/d3b/f7e 11703 1 2024-01-17T23:42:13.872 INFO:tasks.workunit.client.0.smithi161.stdout:1/706: dread d1/d20/f51 [0,4194304] 0 2024-01-17T23:42:14.088 INFO:tasks.workunit.client.0.smithi161.stdout:9/538: symlink d0/d8/d14/d18/d63/lb4 0 2024-01-17T23:42:14.175 INFO:tasks.workunit.client.0.smithi161.stdout:3/686: truncate d0/d5/d9/d38/d4f/d9d/da7/f79 1248260 0 2024-01-17T23:42:14.279 INFO:tasks.workunit.client.0.smithi161.stdout:2/631: symlink d8/d67/dbc/ldc 0 2024-01-17T23:42:14.418 INFO:tasks.workunit.client.0.smithi161.stdout:4/736: dwrite d9/de/d1e/d58/d60/d9c/fae [0,4194304] 0 2024-01-17T23:42:14.776 INFO:tasks.workunit.client.0.smithi161.stdout:7/646: creat da/d34/d5a/d28/d2b/d93/fe2 x:0 0 0 2024-01-17T23:42:14.942 INFO:tasks.workunit.client.0.smithi161.stdout:9/539: fsync d0/d8/f7a 0 2024-01-17T23:42:14.990 INFO:tasks.workunit.client.0.smithi161.stdout:9/540: dwrite d0/d8/d14/f25 [4194304,4194304] 0 2024-01-17T23:42:14.990 INFO:tasks.workunit.client.0.smithi161.stdout:9/541: chown d0/d8/d31/f68 1407 1 2024-01-17T23:42:14.990 INFO:tasks.workunit.client.0.smithi161.stdout:9/542: fdatasync d0/f2c 0 2024-01-17T23:42:15.003 INFO:tasks.workunit.client.0.smithi161.stdout:9/543: read d0/d8/d14/d18/f1d [3558961,36712] 0 2024-01-17T23:42:15.006 INFO:tasks.workunit.client.0.smithi161.stdout:9/544: read d0/d8/d14/d18/d20/f5b [173735,130400] 0 2024-01-17T23:42:15.006 INFO:tasks.workunit.client.0.smithi161.stdout:9/545: creat d0/d8/d14/d87/fb5 x:0 0 0 2024-01-17T23:42:15.218 INFO:tasks.workunit.client.0.smithi161.stdout:7/647: rmdir da/d34/d5a/d68 39 2024-01-17T23:42:15.667 INFO:tasks.workunit.client.0.smithi161.stdout:2/632: getdents d8/d67 0 2024-01-17T23:42:15.686 INFO:tasks.workunit.client.0.smithi161.stdout:2/633: write d8/d67/d6c/d72/f7c [2037255,108745] 0 2024-01-17T23:42:15.814 INFO:tasks.workunit.client.0.smithi161.stdout:8/635: sync 2024-01-17T23:42:15.926 INFO:tasks.workunit.client.0.smithi161.stdout:7/648: mknod da/d34/d4a/ce3 0 2024-01-17T23:42:15.927 INFO:tasks.workunit.client.0.smithi161.stdout:7/649: dread - da/d34/fa1 zero size 2024-01-17T23:42:16.228 INFO:tasks.workunit.client.0.smithi161.stdout:8/636: symlink d1/df/d46/ld9 0 2024-01-17T23:42:16.236 INFO:tasks.workunit.client.0.smithi161.stdout:8/637: dread d1/d1c/f35 [0,4194304] 0 2024-01-17T23:42:16.284 INFO:tasks.workunit.client.0.smithi161.stdout:7/650: chown da/d34/d4a/d4c 1175963 1 2024-01-17T23:42:16.284 INFO:tasks.workunit.client.0.smithi161.stdout:7/651: creat da/db/d7a/d8f/fe4 x:0 0 0 2024-01-17T23:42:16.417 INFO:tasks.workunit.client.0.smithi161.stdout:8/638: unlink d1/d3/d19/d1d/daa/ccb 0 2024-01-17T23:42:16.803 INFO:tasks.workunit.client.0.smithi161.stdout:8/639: symlink d1/d3d/dc7/lda 0 2024-01-17T23:42:17.075 INFO:tasks.workunit.client.0.smithi161.stdout:8/640: link d1/d3/d19/d1d/d25/f39 d1/d22/dbd/dce/fdb 0 2024-01-17T23:42:17.278 INFO:tasks.workunit.client.0.smithi161.stdout:6/625: dwrite d6/d7/dc/d1d/f5e [0,4194304] 0 2024-01-17T23:42:17.278 INFO:tasks.workunit.client.0.smithi161.stdout:6/626: dread - d6/d7/dc/d85/d1a/f3e zero size 2024-01-17T23:42:17.279 INFO:tasks.workunit.client.0.smithi161.stdout:6/627: write d6/d7/dc/d43/f60 [4315759,40544] 0 2024-01-17T23:42:17.300 INFO:tasks.workunit.client.0.smithi161.stdout:6/628: dwrite d6/d58/fa9 [0,4194304] 0 2024-01-17T23:42:17.542 INFO:tasks.workunit.client.0.smithi161.stdout:5/590: dwrite dd/d15/d4e/fa3 [0,4194304] 0 2024-01-17T23:42:17.553 INFO:tasks.workunit.client.0.smithi161.stdout:5/591: dread dd/d15/d4e/fa3 [0,4194304] 0 2024-01-17T23:42:17.583 INFO:tasks.workunit.client.0.smithi161.stdout:5/592: dwrite dd/d15/d1a/d5d/d64/d7c/f8c [0,4194304] 0 2024-01-17T23:42:17.651 INFO:tasks.workunit.client.0.smithi161.stdout:8/641: mknod d1/d3/d19/cdc 0 2024-01-17T23:42:18.054 INFO:tasks.workunit.client.0.smithi161.stdout:6/629: symlink d6/d7/dc/d85/d31/ld7 0 2024-01-17T23:42:18.700 INFO:tasks.workunit.client.0.smithi161.stdout:5/593: mkdir dd/d15/d1a/d5d/d64/d7c/dc4 0 2024-01-17T23:42:18.700 INFO:tasks.workunit.client.0.smithi161.stdout:5/594: truncate dd/d15/f1c 4911888 0 2024-01-17T23:42:18.705 INFO:tasks.workunit.client.0.smithi161.stdout:5/595: read dd/d15/d4e/f8a [596985,36321] 0 2024-01-17T23:42:18.850 INFO:tasks.workunit.client.0.smithi161.stdout:6/630: mknod d6/d7/dc/d85/d1a/d59/cd8 0 2024-01-17T23:42:18.999 INFO:tasks.workunit.client.0.smithi161.stdout:5/596: mknod dd/d15/d1a/d42/cc5 0 2024-01-17T23:42:18.999 INFO:tasks.workunit.client.0.smithi161.stdout:5/597: chown dd/d15/d51 1 1 2024-01-17T23:42:18.999 INFO:tasks.workunit.client.0.smithi161.stdout:5/598: truncate dd/d15/d4e/f8e 1618049 0 2024-01-17T23:42:19.024 INFO:tasks.workunit.client.0.smithi161.stdout:5/599: dwrite dd/f24 [0,4194304] 0 2024-01-17T23:42:19.024 INFO:tasks.workunit.client.0.smithi161.stdout:5/600: dread - dd/d31/d56/f99 zero size 2024-01-17T23:42:19.024 INFO:tasks.workunit.client.0.smithi161.stdout:5/601: getdents dd/d15/d1a/d5d/d64/d7c/dc4 0 2024-01-17T23:42:19.089 INFO:tasks.workunit.client.0.smithi161.stdout:0/697: sync 2024-01-17T23:42:19.089 INFO:tasks.workunit.client.0.smithi161.stdout:1/707: sync 2024-01-17T23:42:19.089 INFO:tasks.workunit.client.0.smithi161.stdout:0/698: chown d5/d34/d12 6774 1 2024-01-17T23:42:19.118 INFO:tasks.workunit.client.0.smithi161.stdout:0/699: dwrite d5/d34/d21/f3b [0,4194304] 0 2024-01-17T23:42:19.152 INFO:tasks.workunit.client.0.smithi161.stdout:4/737: dwrite d9/f23 [0,4194304] 0 2024-01-17T23:42:19.416 INFO:tasks.workunit.client.0.smithi161.stdout:5/602: creat dd/d15/d4e/fc6 x:0 0 0 2024-01-17T23:42:19.416 INFO:tasks.workunit.client.0.smithi161.stdout:5/603: dread - dd/d15/d6a/fc0 zero size 2024-01-17T23:42:19.455 INFO:tasks.workunit.client.0.smithi161.stdout:5/604: dwrite dd/d15/d4e/d4f/d97/fa5 [0,4194304] 0 2024-01-17T23:42:19.473 INFO:tasks.workunit.client.0.smithi161.stdout:5/605: write dd/d15/d1a/d42/f46 [3911973,54873] 0 2024-01-17T23:42:19.530 INFO:tasks.workunit.client.0.smithi161.stdout:6/631: link d6/d7/dc/d43/f94 d6/d7/dc/db2/fd9 0 2024-01-17T23:42:19.530 INFO:tasks.workunit.client.0.smithi161.stdout:6/632: chown d6/d7/dc/d85/d31/d5d/l39 169556720 1 2024-01-17T23:42:19.560 INFO:tasks.workunit.client.0.smithi161.stdout:6/633: dwrite d6/d7/dc/d85/d1a/f62 [0,4194304] 0 2024-01-17T23:42:19.560 INFO:tasks.workunit.client.0.smithi161.stdout:6/634: chown d6 11512 1 2024-01-17T23:42:19.594 INFO:tasks.workunit.client.0.smithi161.stdout:1/708: creat d1/d8/d1f/dd3/fe7 x:0 0 0 2024-01-17T23:42:19.610 INFO:tasks.workunit.client.0.smithi161.stdout:1/709: dread d1/f38 [4194304,4194304] 0 2024-01-17T23:42:19.644 INFO:tasks.workunit.client.0.smithi161.stdout:1/710: dwrite d1/d20/d26/d30/f3f [0,4194304] 0 2024-01-17T23:42:19.738 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:44:43.095 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:42:19.742 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:44:43.099 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:42:19.770 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:44:43.048 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:42:19.775 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:44:43.051 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:42:19.780 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:44:43.058 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:42:19.784 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:44:43.061 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:42:19.804 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:44:43.160 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:42:19.822 INFO:tasks.workunit.client.0.smithi161.stdout:0/700: creat d5/d8/d68/db0/dcc/fdc x:0 0 0 2024-01-17T23:42:19.822 INFO:tasks.workunit.client.0.smithi161.stdout:0/701: creat d5/d34/d20/d2b/d64/d88/fdd x:0 0 0 2024-01-17T23:42:19.822 INFO:tasks.workunit.client.0.smithi161.stdout:0/702: fdatasync d5/d3a/d49/d99/fc0 0 2024-01-17T23:42:19.868 INFO:tasks.workunit.client.0.smithi161.stdout:0/703: dwrite d5/d3a/d49/f70 [0,4194304] 0 2024-01-17T23:42:19.868 INFO:tasks.workunit.client.0.smithi161.stdout:0/704: creat d5/d34/d21/dd4/fde x:0 0 0 2024-01-17T23:42:19.887 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:44:43.165 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:42:19.900 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:44:43.177 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:42:20.250 INFO:tasks.workunit.client.0.smithi161.stdout:7/652: dwrite da/db/d7a/d8f/dac/fb7 [0,4194304] 0 2024-01-17T23:42:20.255 INFO:tasks.workunit.client.0.smithi161.stdout:5/606: dread dd/d15/d51/f93 [0,4194304] 0 2024-01-17T23:42:20.255 INFO:tasks.workunit.client.0.smithi161.stdout:5/607: creat dd/d15/d1a/d42/fc7 x:0 0 0 2024-01-17T23:42:20.255 INFO:tasks.workunit.client.0.smithi161.stdout:5/608: write dd/d15/d51/f62 [5009943,34057] 0 2024-01-17T23:42:20.277 INFO:tasks.workunit.client.0.smithi161.stdout:5/609: dwrite dd/d15/d1a/d42/fb9 [0,4194304] 0 2024-01-17T23:42:20.277 INFO:tasks.workunit.client.0.smithi161.stdout:5/610: dread - dd/d15/d1a/d5d/d64/d7c/d88/fb5 zero size 2024-01-17T23:42:20.330 INFO:tasks.workunit.client.0.smithi161.stdout:6/635: dread d6/d7/dc/f4f [0,4194304] 0 2024-01-17T23:42:20.330 INFO:tasks.workunit.client.0.smithi161.stdout:6/636: readlink d6/d7/dc/d85/d31/d5d/d55/l9e 0 2024-01-17T23:42:20.425 INFO:tasks.workunit.client.0.smithi161.stdout:1/711: truncate d1/d20/d26/d30/d44/fa2 991968 0 2024-01-17T23:42:20.445 INFO:tasks.workunit.client.0.smithi161.stdout:1/712: dread d1/d11/d72/f89 [0,4194304] 0 2024-01-17T23:42:20.460 INFO:tasks.workunit.client.0.smithi161.stdout:1/713: read d1/d20/f5c [4475610,46303] 0 2024-01-17T23:42:21.049 INFO:tasks.workunit.client.0.smithi161.stdout:0/705: rename d5/d8/l10 to d5/d34/d20/d2d/ldf 0 2024-01-17T23:42:21.150 INFO:tasks.workunit.client.0.smithi161.stdout:3/687: mkdir d0/de0 0 2024-01-17T23:42:21.150 INFO:tasks.workunit.client.0.smithi161.stdout:3/688: chown d0/de0 0 1 2024-01-17T23:42:21.172 INFO:tasks.workunit.client.0.smithi161.stdout:3/689: write d0/da2/fd1 [1530596,122459] 0 2024-01-17T23:42:21.172 INFO:tasks.workunit.client.0.smithi161.stdout:3/690: creat d0/d5/d9/d38/d4f/da5/fe1 x:0 0 0 2024-01-17T23:42:21.469 INFO:tasks.workunit.client.0.smithi161.stdout:7/653: rmdir da/d34/d5a/d28/dad 39 2024-01-17T23:42:21.943 INFO:tasks.workunit.client.0.smithi161.stdout:6/637: mkdir d6/d7/dc/d43/dc3/dda 0 2024-01-17T23:42:21.943 INFO:tasks.workunit.client.0.smithi161.stdout:6/638: write d6/d7/dc/d85/d1a/d59/d8e/fc5 [410641,121202] 0 2024-01-17T23:42:22.108 INFO:tasks.workunit.client.0.smithi161.stdout:1/714: creat d1/d11/d72/d81/fe8 x:0 0 0 2024-01-17T23:42:22.108 INFO:tasks.workunit.client.0.smithi161.stdout:1/715: write d1/d8/d1f/f28 [4651002,28162] 0 2024-01-17T23:42:22.519 INFO:tasks.workunit.client.0.smithi161.stdout:3/691: rmdir d0/de0 0 2024-01-17T23:42:22.519 INFO:tasks.workunit.client.0.smithi161.stdout:3/692: write d0/d5/d9/d38/db3/fdd [1791278,20933] 0 2024-01-17T23:42:22.648 INFO:tasks.workunit.client.0.smithi161.stdout:7/654: symlink da/d14/le5 0 2024-01-17T23:42:22.715 INFO:tasks.workunit.client.0.smithi161.stdout:5/611: mknod dd/d15/cc8 0 2024-01-17T23:42:22.837 INFO:tasks.workunit.client.0.smithi161.stdout:6/639: rename d6/d7/dc/d43/dc3/lce to d6/d7/dc/d85/d31/d5d/d55/ldb 0 2024-01-17T23:42:23.275 INFO:tasks.workunit.client.0.smithi161.stdout:1/716: creat d1/d20/fe9 x:0 0 0 2024-01-17T23:42:23.276 INFO:tasks.workunit.client.0.smithi161.stdout:1/717: fsync d1/d8/f56 0 2024-01-17T23:42:23.276 INFO:tasks.workunit.client.0.smithi161.stdout:1/718: truncate d1/d20/d26/d30/f5f 329506 0 2024-01-17T23:42:23.281 INFO:tasks.workunit.client.0.smithi161.stdout:1/719: dread d1/d2d/fb2 [0,4194304] 0 2024-01-17T23:42:23.377 INFO:tasks.workunit.client.0.smithi161.stdout:0/706: getdents d5/d34/d21/d76 0 2024-01-17T23:42:24.037 INFO:tasks.workunit.client.0.smithi161.stdout:3/693: creat d0/d5/d9/d38/d4f/d9d/dca/fe2 x:0 0 0 2024-01-17T23:42:24.058 INFO:tasks.workunit.client.0.smithi161.stdout:3/694: dread d0/d5/d9/f64 [0,4194304] 0 2024-01-17T23:42:24.065 INFO:tasks.workunit.client.0.smithi161.stdout:3/695: dread d0/d5/d9/d17/d2d/fd6 [0,4194304] 0 2024-01-17T23:42:24.185 INFO:tasks.workunit.client.0.smithi161.stdout:5/612: mkdir dd/d15/d1a/d5d/dc9 0 2024-01-17T23:42:24.252 INFO:tasks.workunit.client.0.smithi161.stdout:6/640: truncate d6/d7/dc/d1d/f2e 1970234 0 2024-01-17T23:42:24.252 INFO:tasks.workunit.client.0.smithi161.stdout:6/641: creat d6/d7/dc/d85/d1a/d59/fdc x:0 0 0 2024-01-17T23:42:24.252 INFO:tasks.workunit.client.0.smithi161.stdout:6/642: stat d6/d7/dc/d43/dc3/d90/fa2 0 2024-01-17T23:42:24.496 INFO:tasks.workunit.client.0.smithi161.stdout:0/707: getdents d5 0 2024-01-17T23:42:24.533 INFO:tasks.workunit.client.0.smithi161.stdout:0/708: dwrite d5/f32 [0,4194304] 0 2024-01-17T23:42:24.959 INFO:tasks.workunit.client.0.smithi161.stdout:7/655: mknod da/d34/d4a/ce6 0 2024-01-17T23:42:24.963 INFO:tasks.workunit.client.0.smithi161.stdout:7/656: read da/d34/d5a/f91 [49865,58911] 0 2024-01-17T23:42:25.095 INFO:tasks.workunit.client.0.smithi161.stdout:5/613: rename dd/d15/d1a/d5d/f70 to dd/d15/d4e/d4f/d77/fca 0 2024-01-17T23:42:25.120 INFO:tasks.workunit.client.0.smithi161.stdout:4/738: dwrite d9/d27/d3a/d56/f5f [0,4194304] 0 2024-01-17T23:42:25.120 INFO:tasks.workunit.client.0.smithi161.stdout:4/739: chown d9/d1b/f3b 0 1 2024-01-17T23:42:25.120 INFO:tasks.workunit.client.0.smithi161.stdout:4/740: truncate d9/de/d1e/d38/d6b/f76 589143 0 2024-01-17T23:42:25.529 INFO:tasks.workunit.client.0.smithi161.stdout:8/642: rmdir d1/d22/d2f 39 2024-01-17T23:42:25.529 INFO:tasks.workunit.client.0.smithi161.stdout:2/634: sync 2024-01-17T23:42:25.529 INFO:tasks.workunit.client.0.smithi161.stdout:9/546: sync 2024-01-17T23:42:25.623 INFO:tasks.workunit.client.0.smithi161.stdout:3/696: unlink d0/d5/d9/f55 0 2024-01-17T23:42:25.651 INFO:tasks.workunit.client.0.smithi161.stdout:6/643: mkdir d6/d7/dc/d3c/ddd 0 2024-01-17T23:42:25.652 INFO:tasks.workunit.client.0.smithi161.stdout:6/644: write d6/d7/dc/d85/d31/f97 [4325196,89742] 0 2024-01-17T23:42:25.652 INFO:tasks.workunit.client.0.smithi161.stdout:6/645: getdents d6/d7/dc/d3c/ddd 0 2024-01-17T23:42:25.851 INFO:tasks.workunit.client.0.smithi161.stdout:1/720: getdents d1/d20/d26/d30 0 2024-01-17T23:42:26.117 INFO:tasks.workunit.client.0.smithi161.stdout:0/709: unlink d5/d34/d20/d2b/d64/d88/f9b 0 2024-01-17T23:42:26.392 INFO:tasks.workunit.client.0.smithi161.stdout:7/657: unlink da/da7/fdc 0 2024-01-17T23:42:26.415 INFO:tasks.workunit.client.0.smithi161.stdout:7/658: dread da/d14/f32 [0,4194304] 0 2024-01-17T23:42:26.445 INFO:tasks.workunit.client.0.smithi161.stdout:7/659: dwrite da/d34/d4a/d4c/fd4 [0,4194304] 0 2024-01-17T23:42:26.516 INFO:tasks.workunit.client.0.smithi161.stdout:5/614: readlink dd/d15/d6a/d80/la8 0 2024-01-17T23:42:26.516 INFO:tasks.workunit.client.0.smithi161.stdout:5/615: write dd/d15/f1c [3619234,77448] 0 2024-01-17T23:42:27.532 INFO:tasks.workunit.client.0.smithi161.stdout:8/643: mknod d1/d3/d19/d1d/daa/cdd 0 2024-01-17T23:42:27.532 INFO:tasks.workunit.client.0.smithi161.stdout:8/644: chown d1/df/d16/d8c 0 1 2024-01-17T23:42:27.806 INFO:tasks.workunit.client.0.smithi161.stdout:9/547: mknod d0/d8/d14/d18/d63/cb6 0 2024-01-17T23:42:27.831 INFO:tasks.workunit.client.0.smithi161.stdout:9/548: dwrite d0/d8/d31/f86 [0,4194304] 0 2024-01-17T23:42:28.041 INFO:tasks.workunit.client.0.smithi161.stdout:3/697: link d0/d5/d9/d38/f74 d0/d5/d9/d1e/d3b/d52/daf/fe3 0 2024-01-17T23:42:28.288 INFO:tasks.workunit.client.0.smithi161.stdout:1/721: mknod d1/d8/d1f/d4b/cea 0 2024-01-17T23:42:28.353 INFO:tasks.workunit.client.0.smithi161.stdout:0/710: mknod d5/d34/d21/d97/ce0 0 2024-01-17T23:42:28.354 INFO:tasks.workunit.client.0.smithi161.stdout:0/711: chown d5/d8 76 1 2024-01-17T23:42:28.599 INFO:tasks.workunit.client.0.smithi161.stdout:7/660: mknod da/d34/d5a/d3b/d3d/d82/ce7 0 2024-01-17T23:42:28.900 INFO:tasks.workunit.client.0.smithi161.stdout:5/616: truncate dd/d31/d7b/f84 2015235 0 2024-01-17T23:42:28.901 INFO:tasks.workunit.client.0.smithi161.stdout:5/617: write dd/d15/d1a/d5d/d64/d7c/d88/fb5 [169597,110459] 0 2024-01-17T23:42:28.982 INFO:tasks.workunit.client.0.smithi161.stdout:4/741: getdents d9/d1b/d53/d9f 0 2024-01-17T23:42:28.983 INFO:tasks.workunit.client.0.smithi161.stdout:4/742: dread - d9/d1b/f8e zero size 2024-01-17T23:42:28.983 INFO:tasks.workunit.client.0.smithi161.stdout:4/743: getdents d9/de/d69/dd4 0 2024-01-17T23:42:28.983 INFO:tasks.workunit.client.0.smithi161.stdout:4/744: stat d9/d27/d3a/d8b/dcb 0 2024-01-17T23:42:29.030 INFO:tasks.workunit.client.0.smithi161.stdout:8/645: symlink d1/d22/lde 0 2024-01-17T23:42:29.079 INFO:tasks.workunit.client.0.smithi161.stdout:8/646: dwrite d1/d3/d19/d1d/d25/d4b/fd3 [0,4194304] 0 2024-01-17T23:42:29.289 INFO:tasks.workunit.client.0.smithi161.stdout:2/635: mkdir d8/d67/d6c/d72/ddd 0 2024-01-17T23:42:29.568 INFO:tasks.workunit.client.0.smithi161.stdout:9/549: dread d0/d8/d31/f71 [0,4194304] 0 2024-01-17T23:42:29.588 INFO:tasks.workunit.client.0.smithi161.stdout:9/550: dread d0/d8/d14/f65 [0,4194304] 0 2024-01-17T23:42:29.610 INFO:tasks.workunit.client.0.smithi161.stdout:9/551: write d0/d39/d49/f57 [3225546,109577] 0 2024-01-17T23:42:29.610 INFO:tasks.workunit.client.0.smithi161.stdout:9/552: fdatasync d0/d8/d14/d56/f93 0 2024-01-17T23:42:29.610 INFO:tasks.workunit.client.0.smithi161.stdout:9/553: readlink d0/d8/d14/d18/d63/l7e 0 2024-01-17T23:42:29.938 INFO:tasks.workunit.client.0.smithi161.stdout:1/722: creat d1/d2d/feb x:0 0 0 2024-01-17T23:42:29.948 INFO:tasks.workunit.client.0.smithi161.stdout:1/723: dread d1/d20/d26/d30/d44/f88 [0,4194304] 0 2024-01-17T23:42:29.968 INFO:tasks.workunit.client.0.smithi161.stdout:0/712: stat d5/d34/d20/d2d/c73 0 2024-01-17T23:42:30.111 INFO:tasks.workunit.client.0.smithi161.stdout:7/661: creat da/d34/d5a/d28/d2b/fe8 x:0 0 0 2024-01-17T23:42:30.111 INFO:tasks.workunit.client.0.smithi161.stdout:7/662: fdatasync da/d14/d35/fe1 0 2024-01-17T23:42:30.111 INFO:tasks.workunit.client.0.smithi161.stdout:7/663: read da/d14/f18 [1779922,118588] 0 2024-01-17T23:42:30.384 INFO:tasks.workunit.client.0.smithi161.stdout:3/698: creat d0/d5/fe4 x:0 0 0 2024-01-17T23:42:30.384 INFO:tasks.workunit.client.0.smithi161.stdout:3/699: chown d0/d5/d9/d17/f6b 1899 1 2024-01-17T23:42:31.024 INFO:tasks.workunit.client.0.smithi161.stdout:5/618: mkdir dd/d15/d1a/d5d/dc9/dcb 0 2024-01-17T23:42:31.024 INFO:tasks.workunit.client.0.smithi161.stdout:5/619: creat dd/d15/d1a/d5d/d64/fcc x:0 0 0 2024-01-17T23:42:31.308 INFO:tasks.workunit.client.0.smithi161.stdout:4/745: mknod d9/de/d1e/d58/d60/d9c/dc7/cdc 0 2024-01-17T23:42:31.308 INFO:tasks.workunit.client.0.smithi161.stdout:4/746: dread - d9/d1b/d53/fc1 zero size 2024-01-17T23:42:31.663 INFO:tasks.workunit.client.0.smithi161.stdout:2/636: unlink d8/d1c/l29 0 2024-01-17T23:42:31.663 INFO:tasks.workunit.client.0.smithi161.stdout:8/647: mknod d1/d22/d2f/d86/cdf 0 2024-01-17T23:42:31.663 INFO:tasks.workunit.client.0.smithi161.stdout:2/637: fdatasync d8/da/f27 0 2024-01-17T23:42:31.663 INFO:tasks.workunit.client.0.smithi161.stdout:8/648: truncate d1/d22/d2f/d92/fb7 242656 0 2024-01-17T23:42:32.154 INFO:tasks.workunit.client.0.smithi161.stdout:6/646: rename d6/d7/dc/d43/db9 to d6/d7/dc/d43/dde 0 2024-01-17T23:42:32.170 INFO:tasks.workunit.client.0.smithi161.stdout:9/554: read d0/d8/f5f [1355241,129514] 0 2024-01-17T23:42:32.170 INFO:tasks.workunit.client.0.smithi161.stdout:9/555: chown d0/d8/d14/d18/d20/da2 806 1 2024-01-17T23:42:32.334 INFO:tasks.workunit.client.0.smithi161.stdout:0/713: truncate d5/d34/d20/f2f 3495482 0 2024-01-17T23:42:32.335 INFO:tasks.workunit.client.0.smithi161.stdout:0/714: chown d5/d34/d20/d2d/l36 19502 1 2024-01-17T23:42:32.565 INFO:tasks.workunit.client.0.smithi161.stdout:7/664: mkdir da/d34/d5a/de9 0 2024-01-17T23:42:33.353 INFO:tasks.workunit.client.0.smithi161.stdout:2/638: symlink d8/d2e/lde 0 2024-01-17T23:42:33.353 INFO:tasks.workunit.client.0.smithi161.stdout:2/639: stat d8/d68/f90 0 2024-01-17T23:42:33.434 INFO:tasks.workunit.client.0.smithi161.stdout:6/647: truncate d6/d7/dc/d1d/f5e 3521961 0 2024-01-17T23:42:33.434 INFO:tasks.workunit.client.0.smithi161.stdout:6/648: dread - d6/d7/dc/d85/f72 zero size 2024-01-17T23:42:33.624 INFO:tasks.workunit.client.0.smithi161.stdout:9/556: creat d0/d8/d14/dab/fb7 x:0 0 0 2024-01-17T23:42:33.813 INFO:tasks.workunit.client.0.smithi161.stdout:1/724: dread d1/d20/d26/d30/d44/fa2 [0,4194304] 0 2024-01-17T23:42:33.860 INFO:tasks.workunit.client.0.smithi161.stdout:1/725: dwrite d1/d20/fc3 [0,4194304] 0 2024-01-17T23:42:33.860 INFO:tasks.workunit.client.0.smithi161.stdout:1/726: creat d1/d8/d54/d94/fec x:0 0 0 2024-01-17T23:42:33.860 INFO:tasks.workunit.client.0.smithi161.stdout:1/727: readlink d1/l40 0 2024-01-17T23:42:33.860 INFO:tasks.workunit.client.0.smithi161.stdout:1/728: truncate d1/d2d/fc5 789947 0 2024-01-17T23:42:34.182 INFO:tasks.workunit.client.0.smithi161.stdout:7/665: truncate da/d34/d5a/d3b/d3d/f40 2397185 0 2024-01-17T23:42:34.211 INFO:tasks.workunit.client.0.smithi161.stdout:7/666: dwrite da/d34/d5a/d3b/db9/f7c [4194304,4194304] 0 2024-01-17T23:42:34.229 INFO:tasks.workunit.client.0.smithi161.stdout:7/667: dread da/d14/f32 [0,4194304] 0 2024-01-17T23:42:34.438 INFO:tasks.workunit.client.0.smithi161.stdout:8/649: truncate d1/df/d20/d2a/f34 7661298 0 2024-01-17T23:42:34.622 INFO:tasks.workunit.client.0.smithi161.stdout:2/640: unlink d8/d1c/d1e/da6/d35/d3a/f88 0 2024-01-17T23:42:34.752 INFO:tasks.workunit.client.0.smithi161.stdout:6/649: mknod d6/d7/dc/db2/cdf 0 2024-01-17T23:42:34.775 INFO:tasks.workunit.client.0.smithi161.stdout:6/650: dwrite d6/d7/dc/d85/d1a/d59/fdc [0,4194304] 0 2024-01-17T23:42:34.862 INFO:tasks.workunit.client.0.smithi161.stdout:9/557: symlink d0/d8/d14/d87/d9b/lb8 0 2024-01-17T23:42:34.862 INFO:tasks.workunit.client.0.smithi161.stdout:9/558: creat d0/d8/d14/d87/fb9 x:0 0 0 2024-01-17T23:42:34.862 INFO:tasks.workunit.client.0.smithi161.stdout:9/559: chown d0/d8/d14/d87/d9b/lb8 1 1 2024-01-17T23:42:34.862 INFO:tasks.workunit.client.0.smithi161.stdout:9/560: readlink d0/d8/d14/d18/l1e 0 2024-01-17T23:42:35.552 INFO:tasks.workunit.client.0.smithi161.stdout:0/715: symlink d5/d34/d12/d2a/d35/le1 0 2024-01-17T23:42:35.791 INFO:tasks.workunit.client.0.smithi161.stdout:7/668: symlink da/da7/lea 0 2024-01-17T23:42:35.797 INFO:tasks.workunit.client.0.smithi161.stdout:7/669: dread da/db/d7a/dc7/f5b [0,4194304] 0 2024-01-17T23:42:35.797 INFO:tasks.workunit.client.0.smithi161.stdout:7/670: dread - da/d34/d5a/d28/f42 zero size 2024-01-17T23:42:35.797 INFO:tasks.workunit.client.0.smithi161.stdout:7/671: dread - da/db/d7a/d8f/dac/dba/fd8 zero size 2024-01-17T23:42:36.057 INFO:tasks.workunit.client.0.smithi161.stdout:8/650: mknod d1/d3d/dc7/ce0 0 2024-01-17T23:42:36.057 INFO:tasks.workunit.client.0.smithi161.stdout:8/651: write d1/d3/f12 [4249170,109085] 0 2024-01-17T23:42:36.057 INFO:tasks.workunit.client.0.smithi161.stdout:8/652: truncate d1/df/d20/d6a/fb6 115620 0 2024-01-17T23:42:36.057 INFO:tasks.workunit.client.0.smithi161.stdout:8/653: fdatasync d1/df/d20/d6a/f91 0 2024-01-17T23:42:36.058 INFO:tasks.workunit.client.0.smithi161.stdout:8/654: read d1/d22/d2f/d92/fc9 [2972745,51098] 0 2024-01-17T23:42:36.085 INFO:tasks.workunit.client.0.smithi161.stdout:8/655: dwrite d1/d3/d19/d1d/f83 [0,4194304] 0 2024-01-17T23:42:36.279 INFO:tasks.workunit.client.0.smithi161.stdout:2/641: creat d8/d1c/d1e/da6/fdf x:0 0 0 2024-01-17T23:42:36.279 INFO:tasks.workunit.client.0.smithi161.stdout:2/642: creat d8/d2e/da8/fe0 x:0 0 0 2024-01-17T23:42:36.858 INFO:tasks.workunit.client.0.smithi161.stdout:9/561: symlink d0/d8/d14/d18/d20/d97/d9e/lba 0 2024-01-17T23:42:36.858 INFO:tasks.workunit.client.0.smithi161.stdout:9/562: fsync d0/fa6 0 2024-01-17T23:42:36.865 INFO:tasks.workunit.client.0.smithi161.stdout:9/563: dread d0/d8/d14/f90 [0,4194304] 0 2024-01-17T23:42:37.367 INFO:tasks.workunit.client.0.smithi161.stdout:3/700: mknod d0/d5/d9/d38/ce5 0 2024-01-17T23:42:37.908 INFO:tasks.workunit.client.0.smithi161.stdout:2/643: symlink d8/d2e/le1 0 2024-01-17T23:42:37.923 INFO:tasks.workunit.client.0.smithi161.stdout:2/644: dread d8/d68/f90 [0,4194304] 0 2024-01-17T23:42:37.969 INFO:tasks.workunit.client.0.smithi161.stdout:6/651: symlink d6/d7/dc/d43/d79/le0 0 2024-01-17T23:42:38.151 INFO:tasks.workunit.client.0.smithi161.stdout:9/564: creat d0/d8/d14/d18/d20/da2/fbb x:0 0 0 2024-01-17T23:42:38.153 INFO:tasks.workunit.client.0.smithi161.stdout:9/565: dread d0/d8/d31/f71 [0,4194304] 0 2024-01-17T23:42:38.315 INFO:tasks.workunit.client.0.smithi161.stdout:3/701: chown d0/d5/d9/d17/d2d/c58 538 1 2024-01-17T23:42:38.315 INFO:tasks.workunit.client.0.smithi161.stdout:3/702: readlink d0/d5/d9/d1e/l3f 0 2024-01-17T23:42:38.432 INFO:tasks.workunit.client.0.smithi161.stdout:2/645: truncate d8/d4b/d9a/fc0 349678 0 2024-01-17T23:42:38.432 INFO:tasks.workunit.client.0.smithi161.stdout:2/646: write d8/d2e/da8/fb6 [111899,61002] 0 2024-01-17T23:42:38.697 INFO:tasks.workunit.client.0.smithi161.stdout:6/652: symlink d6/d7/dc/d85/d13/dcc/le1 0 2024-01-17T23:42:38.744 INFO:tasks.workunit.client.0.smithi161.stdout:7/672: link da/d34/d5a/d28/dad/lc3 da/d34/d4a/d4c/leb 0 2024-01-17T23:42:38.784 INFO:tasks.workunit.client.0.smithi161.stdout:9/566: symlink d0/d8/d14/d18/d20/da2/lbc 0 2024-01-17T23:42:39.108 INFO:tasks.workunit.client.0.smithi161.stdout:3/703: unlink d0/d5/d9/d1e/d5a/f87 0 2024-01-17T23:42:39.431 INFO:tasks.workunit.client.0.smithi161.stdout:2/647: symlink d8/d1c/d1e/d80/le2 0 2024-01-17T23:42:39.644 INFO:tasks.workunit.client.0.smithi161.stdout:6/653: dread d6/d7/dc/d85/d31/fa6 [0,4194304] 0 2024-01-17T23:42:39.662 INFO:tasks.workunit.client.0.smithi161.stdout:6/654: read d6/d7/dc/d43/dc3/d90/fb8 [295367,46280] 0 2024-01-17T23:42:39.662 INFO:tasks.workunit.client.0.smithi161.stdout:6/655: write d6/d7/dc/d85/d31/d5d/d55/fc1 [813268,82364] 0 2024-01-17T23:42:39.682 INFO:tasks.workunit.client.0.smithi161.stdout:6/656: dread d6/d7/dc/d43/d79/fd6 [0,4194304] 0 2024-01-17T23:42:39.682 INFO:tasks.workunit.client.0.smithi161.stdout:6/657: write d6/d7/dc/d85/d1a/fbd [573202,69532] 0 2024-01-17T23:42:39.742 INFO:tasks.workunit.client.0.smithi161.stdout:9/567: mknod d0/d8/d14/d18/cbd 0 2024-01-17T23:42:39.742 INFO:tasks.workunit.client.0.smithi161.stdout:9/568: truncate d0/d8/d14/d18/d20/d97/d9e/fad 372188 0 2024-01-17T23:42:39.743 INFO:tasks.workunit.client.0.smithi161.stdout:9/569: stat d0/d8/d14/d18/d20/d97/dae/cb0 0 2024-01-17T23:42:40.033 INFO:tasks.workunit.client.0.smithi161.stdout:3/704: dwrite d0/d5/d9/d17/d32/f89 [0,4194304] 0 2024-01-17T23:42:40.033 INFO:tasks.workunit.client.0.smithi161.stdout:3/705: creat d0/d5/d9/d38/d4f/d9d/dca/fe6 x:0 0 0 2024-01-17T23:42:40.197 INFO:tasks.workunit.client.0.smithi161.stdout:2/648: mknod d8/da/ce3 0 2024-01-17T23:42:40.202 INFO:tasks.workunit.client.0.smithi161.stdout:2/649: read d8/d67/fac [249677,31346] 0 2024-01-17T23:42:40.202 INFO:tasks.workunit.client.0.smithi161.stdout:2/650: readlink d8/d1c/d1e/d80/l64 0 2024-01-17T23:42:40.238 INFO:tasks.workunit.client.0.smithi161.stdout:2/651: dwrite d8/d1c/d75/dae/dc3/fa1 [0,4194304] 0 2024-01-17T23:42:40.261 INFO:tasks.workunit.client.0.smithi161.stdout:6/658: symlink d6/d7/dc/d85/d1a/d59/d8e/le2 0 2024-01-17T23:42:40.976 INFO:tasks.workunit.client.0.smithi161.stdout:6/659: mkdir d6/d7/dc/d3c/ddd/de3 0 2024-01-17T23:42:41.474 INFO:tasks.workunit.client.0.smithi161.stdout:6/660: unlink d6/d7/dc/d85/d1a/d59/fba 0 2024-01-17T23:42:41.475 INFO:tasks.workunit.client.0.smithi161.stdout:6/661: stat d6/d7/dc/dca 0 2024-01-17T23:42:42.141 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:42:42.145 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:42:43.311 INFO:tasks.workunit.client.0.smithi161.stdout:6/662: mknod d6/d7/dc/d43/ce4 0 2024-01-17T23:42:43.311 INFO:tasks.workunit.client.0.smithi161.stdout:5/620: rename dd/d15/d1a/l75 to dd/d15/d6a/lcd 0 2024-01-17T23:42:43.464 INFO:tasks.workunit.client.0.smithi161.stdout:6/663: creat d6/d7/dc/d85/d31/d5d/fe5 x:0 0 0 2024-01-17T23:42:43.579 INFO:tasks.workunit.client.0.smithi161.stdout:4/747: rename d9/d1b/d52/c86 to d9/de/d69/dd4/cdd 0 2024-01-17T23:42:43.579 INFO:tasks.workunit.client.0.smithi161.stdout:4/748: readlink d9/d27/d3a/l3d 0 2024-01-17T23:42:43.955 INFO:tasks.workunit.client.0.smithi161.stdout:6/664: mknod d6/d7/dc/d85/d1a/dd0/ce6 0 2024-01-17T23:42:44.395 INFO:tasks.workunit.client.0.smithi161.stdout:1/729: rename d1/d8/d54/d94/fc2 to d1/d20/d26/d30/d8f/fed 0 2024-01-17T23:42:44.577 INFO:tasks.workunit.client.0.smithi161.stdout:8/656: sync 2024-01-17T23:42:44.704 INFO:tasks.workunit.client.0.smithi161.stdout:6/665: getdents d6/d7/dc/d85/d31 0 2024-01-17T23:42:44.926 INFO:tasks.workunit.client.0.smithi161.stdout:0/716: rename d5/d34/c51 to d5/d3a/d49/d99/ce2 0 2024-01-17T23:42:44.926 INFO:tasks.workunit.client.0.smithi161.stdout:8/657: mknod d1/df/d46/ce1 0 2024-01-17T23:42:44.926 INFO:tasks.workunit.client.0.smithi161.stdout:6/666: creat d6/d7/dc/d85/d13/dcc/fe7 x:0 0 0 2024-01-17T23:42:44.951 INFO:tasks.workunit.client.0.smithi161.stdout:6/667: dwrite d6/d7/dc/d85/d13/f6e [0,4194304] 0 2024-01-17T23:42:45.240 INFO:tasks.workunit.client.0.smithi161.stdout:1/730: getdents d1/d20/d26/d30/d44 0 2024-01-17T23:42:45.241 INFO:tasks.workunit.client.0.smithi161.stdout:1/731: write d1/f2 [8032547,78241] 0 2024-01-17T23:42:45.395 INFO:tasks.workunit.client.0.smithi161.stdout:7/673: rename da/d34/d5a/d3b/d3d/c50 to da/db/d7a/d8f/dde/cec 0 2024-01-17T23:42:45.404 INFO:tasks.workunit.client.0.smithi161.stdout:7/674: dread da/d34/f52 [0,4194304] 0 2024-01-17T23:42:45.531 INFO:tasks.workunit.client.0.smithi161.stdout:0/717: truncate d5/d34/d21/f84 2379889 0 2024-01-17T23:42:45.532 INFO:tasks.workunit.client.0.smithi161.stdout:0/718: dread - d5/d3a/d49/fa2 zero size 2024-01-17T23:42:46.114 INFO:tasks.workunit.client.0.smithi161.stdout:6/668: creat d6/d7/dc/dca/fe8 x:0 0 0 2024-01-17T23:42:46.114 INFO:tasks.workunit.client.0.smithi161.stdout:5/621: sync 2024-01-17T23:42:46.114 INFO:tasks.workunit.client.0.smithi161.stdout:6/669: creat d6/d7/dc/d85/d1a/d59/d8e/fe9 x:0 0 0 2024-01-17T23:42:46.301 INFO:tasks.workunit.client.0.smithi161.stdout:1/732: mknod d1/d11/cee 0 2024-01-17T23:42:46.325 INFO:tasks.workunit.client.0.smithi161.stdout:1/733: write d1/d8/d1c/f7a [324820,98751] 0 2024-01-17T23:42:46.325 INFO:tasks.workunit.client.0.smithi161.stdout:1/734: dread - d1/d20/fd7 zero size 2024-01-17T23:42:46.325 INFO:tasks.workunit.client.0.smithi161.stdout:1/735: write d1/d8/d1c/d3e/f92 [4904453,20229] 0 2024-01-17T23:42:46.325 INFO:tasks.workunit.client.0.smithi161.stdout:1/736: chown d1/d20/f2e 118099607 1 2024-01-17T23:42:46.669 INFO:tasks.workunit.client.0.smithi161.stdout:9/570: rename d0/d8/d31/f4d to d0/d8/d14/d18/d20/da2/fbe 0 2024-01-17T23:42:46.784 INFO:tasks.workunit.client.0.smithi161.stdout:8/658: truncate d1/df/d20/d2a/f34 7445685 0 2024-01-17T23:42:46.801 INFO:tasks.workunit.client.0.smithi161.stdout:8/659: dread d1/df/d20/d6a/f6d [0,4194304] 0 2024-01-17T23:42:46.850 INFO:tasks.workunit.client.0.smithi161.stdout:5/622: mkdir dd/d15/d51/dce 0 2024-01-17T23:42:47.077 INFO:tasks.workunit.client.0.smithi161.stdout:6/670: creat d6/d7/dc/d43/d79/fea x:0 0 0 2024-01-17T23:42:47.077 INFO:tasks.workunit.client.0.smithi161.stdout:6/671: stat d6/d7/dc/d85/d31/d5d/fe5 0 2024-01-17T23:42:47.427 INFO:tasks.workunit.client.0.smithi161.stdout:1/737: mkdir d1/d11/d72/def 0 2024-01-17T23:42:47.721 INFO:tasks.workunit.client.0.smithi161.stdout:7/675: getdents da/d34/d5a/d3b/d3d 0 2024-01-17T23:42:47.721 INFO:tasks.workunit.client.0.smithi161.stdout:7/676: write da/db/d7a/d8f/fd5 [106695,8211] 0 2024-01-17T23:42:47.745 INFO:tasks.workunit.client.0.smithi161.stdout:3/706: rename d0/d5/d9/d38/d4f/da5/fd0 to d0/da2/fe7 0 2024-01-17T23:42:47.750 INFO:tasks.workunit.client.0.smithi161.stdout:3/707: dread d0/d5/d9/d1e/f7b [0,4194304] 0 2024-01-17T23:42:47.883 INFO:tasks.workunit.client.0.smithi161.stdout:9/571: link d0/f50 d0/d8/d14/d87/d9b/fbf 0 2024-01-17T23:42:47.887 INFO:tasks.workunit.client.0.smithi161.stdout:9/572: read d0/f64 [200779,110539] 0 2024-01-17T23:42:47.887 INFO:tasks.workunit.client.0.smithi161.stdout:9/573: dread - d0/d8/d31/d58/f7d zero size 2024-01-17T23:42:47.887 INFO:tasks.workunit.client.0.smithi161.stdout:9/574: stat d0/d8/d14/d18/d20/d97/d9e/fb1 0 2024-01-17T23:42:48.308 INFO:tasks.workunit.client.0.smithi161.stdout:6/672: creat d6/d7/dc/d85/d13/feb x:0 0 0 2024-01-17T23:42:48.572 INFO:tasks.workunit.client.0.smithi161.stdout:1/738: mkdir d1/d8/d1f/df0 0 2024-01-17T23:42:48.572 INFO:tasks.workunit.client.0.smithi161.stdout:7/677: readlink da/d34/d5a/d28/d2b/l6f 0 2024-01-17T23:42:48.573 INFO:tasks.workunit.client.0.smithi161.stdout:7/678: chown da/d34/d5a/ld3 5 1 2024-01-17T23:42:48.573 INFO:tasks.workunit.client.0.smithi161.stdout:7/679: truncate da/da7/fc2 186637 0 2024-01-17T23:42:48.587 INFO:tasks.workunit.client.0.smithi161.stdout:1/739: dread d1/d20/d26/d30/d8f/d9e/f98 [0,4194304] 0 2024-01-17T23:42:48.605 INFO:tasks.workunit.client.0.smithi161.stdout:1/740: write d1/d20/f5c [1128691,43371] 0 2024-01-17T23:42:48.605 INFO:tasks.workunit.client.0.smithi161.stdout:1/741: write d1/d8/d54/fde [811315,24374] 0 2024-01-17T23:42:48.609 INFO:tasks.workunit.client.0.smithi161.stdout:1/742: write d1/d8/f56 [4578207,67748] 0 2024-01-17T23:42:48.628 INFO:tasks.workunit.client.0.smithi161.stdout:1/743: write d1/d8/d1c/d3e/f92 [3534872,64953] 0 2024-01-17T23:42:48.920 INFO:tasks.workunit.client.0.smithi161.stdout:3/708: rmdir d0/d5/d9/d38/d4f/d9d/da7/dcc 0 2024-01-17T23:42:48.943 INFO:tasks.workunit.client.0.smithi161.stdout:3/709: dwrite d0/d5/d9/d1e/fab [0,4194304] 0 2024-01-17T23:42:48.944 INFO:tasks.workunit.client.0.smithi161.stdout:3/710: creat d0/d5/d9/d1e/d5a/fe8 x:0 0 0 2024-01-17T23:42:49.554 INFO:tasks.workunit.client.0.smithi161.stdout:6/673: creat d6/d7/dc/d43/dde/fec x:0 0 0 2024-01-17T23:42:49.554 INFO:tasks.workunit.client.0.smithi161.stdout:6/674: write d6/fcd [1029826,45708] 0 2024-01-17T23:42:49.735 INFO:tasks.workunit.client.0.smithi161.stdout:1/744: mkdir d1/d8/df1 0 2024-01-17T23:42:49.748 INFO:tasks.workunit.client.0.smithi161.stdout:1/745: write d1/d20/f2e [4050906,118627] 0 2024-01-17T23:42:49.771 INFO:tasks.workunit.client.0.smithi161.stdout:1/746: dwrite d1/d11/d72/d81/f82 [0,4194304] 0 2024-01-17T23:42:50.181 INFO:tasks.workunit.client.0.smithi161.stdout:3/711: chown d0/d5/d9/d17/d5c/cc1 326356815 1 2024-01-17T23:42:50.181 INFO:tasks.workunit.client.0.smithi161.stdout:3/712: write d0/d5/d9/d1e/f7b [414147,128141] 0 2024-01-17T23:42:50.181 INFO:tasks.workunit.client.0.smithi161.stdout:3/713: readlink d0/d5/d9/d38/l4d 0 2024-01-17T23:42:50.181 INFO:tasks.workunit.client.0.smithi161.stdout:3/714: chown d0/d5/d9/d38/l88 8 1 2024-01-17T23:42:50.668 INFO:tasks.workunit.client.0.smithi161.stdout:9/575: link d0/d39/d49/c53 d0/d39/d49/d6e/cc0 0 2024-01-17T23:42:50.931 INFO:tasks.workunit.client.0.smithi161.stdout:5/623: sync 2024-01-17T23:42:50.931 INFO:tasks.workunit.client.0.smithi161.stdout:8/660: sync 2024-01-17T23:42:51.201 INFO:tasks.workunit.client.0.smithi161.stdout:2/652: rename d8/d2e to d8/d1c/d75/dae/de4 0 2024-01-17T23:42:51.454 INFO:tasks.workunit.client.0.smithi161.stdout:3/715: mknod d0/d5/d9/d1e/ce9 0 2024-01-17T23:42:51.567 INFO:tasks.workunit.client.0.smithi161.stdout:9/576: symlink d0/d8/d14/d87/lc1 0 2024-01-17T23:42:51.919 INFO:tasks.workunit.client.0.smithi161.stdout:5/624: link dd/d15/d51/fb4 dd/d15/d4e/d4f/d97/fcf 0 2024-01-17T23:42:51.920 INFO:tasks.workunit.client.0.smithi161.stdout:1/747: mkdir d1/d64/df2 0 2024-01-17T23:42:52.107 INFO:tasks.workunit.client.0.smithi161.stdout:4/749: rename d9/de/d69/cd6 to d9/d1b/d24/d25/d5b/cde 0 2024-01-17T23:42:52.107 INFO:tasks.workunit.client.0.smithi161.stdout:4/750: chown d9/de/d1e/d38/c9a 85 1 2024-01-17T23:42:52.107 INFO:tasks.workunit.client.0.smithi161.stdout:4/751: creat d9/d27/d68/fdf x:0 0 0 2024-01-17T23:42:52.208 INFO:tasks.workunit.client.0.smithi161.stdout:2/653: rmdir d8/d1c/d75 39 2024-01-17T23:42:52.208 INFO:tasks.workunit.client.0.smithi161.stdout:2/654: chown d8/d67/d6c/d72/fb4 30834274 1 2024-01-17T23:42:52.275 INFO:tasks.workunit.client.0.smithi161.stdout:3/716: rename d0/d5/d9/d8b/f91 to d0/d5/d9/d8b/fea 0 2024-01-17T23:42:52.455 INFO:tasks.workunit.client.0.smithi161.stdout:9/577: mkdir d0/d8/d14/d87/d9b/dc2 0 2024-01-17T23:42:52.483 INFO:tasks.workunit.client.0.smithi161.stdout:9/578: dwrite d0/f50 [0,4194304] 0 2024-01-17T23:42:52.700 INFO:tasks.workunit.client.0.smithi161.stdout:7/680: rmdir da/d34/d5a 39 2024-01-17T23:42:52.700 INFO:tasks.workunit.client.0.smithi161.stdout:5/625: symlink dd/d15/d1a/d34/ld0 0 2024-01-17T23:42:52.701 INFO:tasks.workunit.client.0.smithi161.stdout:7/681: write da/d34/d5a/d28/f7b [397316,111184] 0 2024-01-17T23:42:52.837 INFO:tasks.workunit.client.0.smithi161.stdout:1/748: creat d1/d8/df1/ff3 x:0 0 0 2024-01-17T23:42:53.017 INFO:tasks.workunit.client.0.smithi161.stdout:0/719: rename d5/d8/d68/l6d to d5/d34/d21/d9e/dc7/le3 0 2024-01-17T23:42:53.017 INFO:tasks.workunit.client.0.smithi161.stdout:8/661: rename d1/d3d to d1/d3d/de2 22 2024-01-17T23:42:53.017 INFO:tasks.workunit.client.0.smithi161.stdout:0/720: write d5/d3a/d49/fa2 [801127,51322] 0 2024-01-17T23:42:53.034 INFO:tasks.workunit.client.0.smithi161.stdout:0/721: dread d5/d34/d12/f6f [0,4194304] 0 2024-01-17T23:42:53.034 INFO:tasks.workunit.client.0.smithi161.stdout:0/722: dread - d5/d8/d68/db0/dcc/fdc zero size 2024-01-17T23:42:53.385 INFO:tasks.workunit.client.0.smithi161.stdout:2/655: mkdir d8/d1c/d75/dc7/de5 0 2024-01-17T23:42:53.413 INFO:tasks.workunit.client.0.smithi161.stdout:2/656: dwrite d8/d1c/d1e/da6/fdf [0,4194304] 0 2024-01-17T23:42:53.413 INFO:tasks.workunit.client.0.smithi161.stdout:2/657: fdatasync d8/d1c/f49 0 2024-01-17T23:42:53.456 INFO:tasks.workunit.client.0.smithi161.stdout:3/717: chown d0/d5/d9/d17/f9c 1 1 2024-01-17T23:42:53.680 INFO:tasks.workunit.client.0.smithi161.stdout:5/626: mkdir dd/d15/d1a/d5d/dd1 0 2024-01-17T23:42:53.796 INFO:tasks.workunit.client.0.smithi161.stdout:7/682: truncate da/d34/d5a/d3b/f6d 997632 0 2024-01-17T23:42:53.925 INFO:tasks.workunit.client.0.smithi161.stdout:1/749: truncate d1/ff 889592 0 2024-01-17T23:42:55.099 INFO:tasks.workunit.client.0.smithi161.stdout:8/662: mkdir d1/d3/d19/d1d/de3 0 2024-01-17T23:42:55.129 INFO:tasks.workunit.client.0.smithi161.stdout:8/663: dwrite d1/df/d20/d6a/f91 [0,4194304] 0 2024-01-17T23:42:55.403 INFO:tasks.workunit.client.0.smithi161.stdout:4/752: symlink d9/le0 0 2024-01-17T23:42:55.414 INFO:tasks.workunit.client.0.smithi161.stdout:0/723: dread d5/d34/d21/f84 [0,4194304] 0 2024-01-17T23:42:55.792 INFO:tasks.workunit.client.0.smithi161.stdout:2/658: dread d8/d4b/d9a/fc0 [0,4194304] 0 2024-01-17T23:42:55.792 INFO:tasks.workunit.client.0.smithi161.stdout:2/659: readlink d8/d67/dbc/ldc 0 2024-01-17T23:42:55.792 INFO:tasks.workunit.client.0.smithi161.stdout:2/660: readlink d8/d1c/d75/lc1 0 2024-01-17T23:42:56.117 INFO:tasks.workunit.client.0.smithi161.stdout:9/579: mknod d0/d39/d49/d6e/cc3 0 2024-01-17T23:42:56.211 INFO:tasks.workunit.client.0.smithi161.stdout:5/627: creat dd/d31/db8/fd2 x:0 0 0 2024-01-17T23:42:56.465 INFO:tasks.workunit.client.0.smithi161.stdout:7/683: rmdir da/d34/d5a/d3b/db9 39 2024-01-17T23:42:56.483 INFO:tasks.workunit.client.0.smithi161.stdout:7/684: dread da/d34/d5a/f2f [4194304,4194304] 0 2024-01-17T23:42:57.347 INFO:tasks.workunit.client.0.smithi161.stdout:8/664: rename d1/f94 to d1/d22/d2f/dd6/fe4 0 2024-01-17T23:42:57.508 INFO:tasks.workunit.client.0.smithi161.stdout:4/753: mkdir d9/d51/d64/dc4/de1 0 2024-01-17T23:42:57.770 INFO:tasks.workunit.client.0.smithi161.stdout:0/724: mknod d5/d8/d68/ce4 0 2024-01-17T23:42:57.770 INFO:tasks.workunit.client.0.smithi161.stdout:0/725: fsync f1 0 2024-01-17T23:42:57.842 INFO:tasks.workunit.client.0.smithi161.stdout:2/661: mknod d8/d1c/d75/dae/de4/d84/ce6 0 2024-01-17T23:42:57.979 INFO:tasks.workunit.client.0.smithi161.stdout:5/628: creat dd/d15/d4e/fd3 x:0 0 0 2024-01-17T23:42:57.979 INFO:tasks.workunit.client.0.smithi161.stdout:5/629: chown dd/d15/d4e/d4f 735 1 2024-01-17T23:42:58.155 INFO:tasks.workunit.client.0.smithi161.stdout:7/685: creat da/db/d7a/d8f/fed x:0 0 0 2024-01-17T23:42:58.283 INFO:tasks.workunit.client.0.smithi161.stdout:4/754: rename d9/de/f19 to d9/d1b/d24/d25/d5b/fe2 0 2024-01-17T23:42:58.716 INFO:tasks.workunit.client.0.smithi161.stdout:0/726: symlink d5/d34/d21/d76/dcb/le5 0 2024-01-17T23:42:58.716 INFO:tasks.workunit.client.0.smithi161.stdout:2/662: mkdir d8/d1c/d75/dc7/de5/de7 0 2024-01-17T23:42:58.932 INFO:tasks.workunit.client.0.smithi161.stdout:5/630: rename dd/d15/d1a/d5d/d64/d67/fba to dd/d15/d1a/d5d/d64/d7c/fd4 0 2024-01-17T23:42:58.992 INFO:tasks.workunit.client.0.smithi161.stdout:3/718: dwrite d0/d5/d9/d17/fc6 [0,4194304] 0 2024-01-17T23:42:59.291 INFO:tasks.workunit.client.0.smithi161.stdout:0/727: rmdir d5/d3a/d49/d99/d96 39 2024-01-17T23:42:59.291 INFO:tasks.workunit.client.0.smithi161.stdout:0/728: fdatasync d5/d34/d20/d2b/d64/f83 0 2024-01-17T23:42:59.341 INFO:tasks.workunit.client.0.smithi161.stdout:0/729: dwrite d5/d8/d68/db0/fd3 [0,4194304] 0 2024-01-17T23:42:59.352 INFO:tasks.workunit.client.0.smithi161.stdout:0/730: read d5/d34/d21/d76/fae [466880,107199] 0 2024-01-17T23:42:59.399 INFO:tasks.workunit.client.0.smithi161.stdout:0/731: dwrite d5/d34/d12/f37 [4194304,4194304] 0 2024-01-17T23:42:59.436 INFO:tasks.workunit.client.0.smithi161.stdout:0/732: dwrite d5/d3a/db4/fb7 [0,4194304] 0 2024-01-17T23:42:59.456 INFO:tasks.workunit.client.0.smithi161.stdout:2/663: link d8/d1c/c3f d8/d67/d6c/d72/ddd/ce8 0 2024-01-17T23:43:00.007 INFO:tasks.workunit.client.0.smithi161.stdout:5/631: mknod dd/d15/d1a/d5d/d64/cd5 0 2024-01-17T23:43:00.214 INFO:tasks.workunit.client.0.smithi161.stdout:6/675: rmdir d6/d7/dc/dca 39 2024-01-17T23:43:00.216 INFO:tasks.workunit.client.0.smithi161.stdout:1/750: sync 2024-01-17T23:43:00.216 INFO:tasks.workunit.client.0.smithi161.stdout:1/751: fsync d1/d2d/fc5 0 2024-01-17T23:43:00.216 INFO:tasks.workunit.client.0.smithi161.stdout:1/752: stat d1/c65 0 2024-01-17T23:43:00.216 INFO:tasks.workunit.client.0.smithi161.stdout:1/753: stat d1/d11/fb5 0 2024-01-17T23:43:00.255 INFO:tasks.workunit.client.0.smithi161.stdout:1/754: dwrite d1/d8/d9d/fbf [0,4194304] 0 2024-01-17T23:43:00.361 INFO:tasks.workunit.client.0.smithi161.stdout:3/719: rmdir d0/d5/d9/d8b/dd5 39 2024-01-17T23:43:00.384 INFO:tasks.workunit.client.0.smithi161.stdout:3/720: write d0/d5/d9/d17/d32/f89 [2190377,117769] 0 2024-01-17T23:43:00.384 INFO:tasks.workunit.client.0.smithi161.stdout:3/721: dread - d0/d5/d9/d38/d4f/d9d/da7/fde zero size 2024-01-17T23:43:00.977 INFO:tasks.workunit.client.0.smithi161.stdout:2/664: unlink d8/d1c/d75/dae/ld6 0 2024-01-17T23:43:00.977 INFO:tasks.workunit.client.0.smithi161.stdout:2/665: fdatasync d8/d1c/d75/dae/dc3/fb7 0 2024-01-17T23:43:01.342 INFO:tasks.workunit.client.0.smithi161.stdout:7/686: rename da/db/d7a/dc7/l27 to da/d34/d5a/d28/dad/lee 0 2024-01-17T23:43:01.380 INFO:tasks.workunit.client.0.smithi161.stdout:8/665: dwrite d1/df/d20/d6a/f78 [0,4194304] 0 2024-01-17T23:43:01.383 INFO:tasks.workunit.client.0.smithi161.stdout:7/687: dwrite da/f2c [0,4194304] 0 2024-01-17T23:43:01.385 INFO:tasks.workunit.client.0.smithi161.stdout:8/666: dread d1/d3/f12 [4194304,4194304] 0 2024-01-17T23:43:01.435 INFO:tasks.workunit.client.0.smithi161.stdout:5/632: creat dd/d15/d1a/d42/da4/fd6 x:0 0 0 2024-01-17T23:43:01.461 INFO:tasks.workunit.client.0.smithi161.stdout:5/633: dwrite dd/d15/d1a/d5d/d64/d7c/fd4 [0,4194304] 0 2024-01-17T23:43:01.461 INFO:tasks.workunit.client.0.smithi161.stdout:5/634: chown dd/d15/d1a/d5d/d64/d67 3510 1 2024-01-17T23:43:01.509 INFO:tasks.workunit.client.0.smithi161.stdout:6/676: creat d6/fed x:0 0 0 2024-01-17T23:43:01.520 INFO:tasks.workunit.client.0.smithi161.stdout:6/677: dread d6/d7/dc/d85/f49 [0,4194304] 0 2024-01-17T23:43:02.081 INFO:tasks.workunit.client.0.smithi161.stdout:3/722: symlink d0/d5/d9/d1e/d3b/leb 0 2024-01-17T23:43:02.082 INFO:tasks.workunit.client.0.smithi161.stdout:3/723: creat d0/d5/d9/d17/d32/fec x:0 0 0 2024-01-17T23:43:02.508 INFO:tasks.workunit.client.0.smithi161.stdout:2/666: mknod d8/da/ce9 0 2024-01-17T23:43:02.508 INFO:tasks.workunit.client.0.smithi161.stdout:2/667: write d8/d1c/d75/dae/de4/fb2 [4649994,111464] 0 2024-01-17T23:43:02.509 INFO:tasks.workunit.client.0.smithi161.stdout:0/733: rename d5/d8/f8b to d5/d34/d20/d2b/fe6 0 2024-01-17T23:43:02.509 INFO:tasks.workunit.client.0.smithi161.stdout:9/580: symlink d0/d8/lc4 0 2024-01-17T23:43:02.509 INFO:tasks.workunit.client.0.smithi161.stdout:9/581: dread - d0/d8/d31/d58/fa4 zero size 2024-01-17T23:43:02.966 INFO:tasks.workunit.client.0.smithi161.stdout:7/688: unlink da/db/l56 0 2024-01-17T23:43:02.966 INFO:tasks.workunit.client.0.smithi161.stdout:8/667: symlink d1/df/d13/db1/dd4/le5 0 2024-01-17T23:43:03.463 INFO:tasks.workunit.client.0.smithi161.stdout:5/635: creat dd/d15/d1a/fd7 x:0 0 0 2024-01-17T23:43:03.464 INFO:tasks.workunit.client.0.smithi161.stdout:5/636: stat dd/d15/d1a 0 2024-01-17T23:43:03.880 INFO:tasks.workunit.client.0.smithi161.stdout:4/755: write d9/de/d1e/d58/f72 [1664516,57169] 0 2024-01-17T23:43:03.880 INFO:tasks.workunit.client.0.smithi161.stdout:4/756: truncate d9/d1b/f3b 328623 0 2024-01-17T23:43:04.088 INFO:tasks.workunit.client.0.smithi161.stdout:2/668: creat d8/db8/dc9/fea x:0 0 0 2024-01-17T23:43:04.207 INFO:tasks.workunit.client.0.smithi161.stdout:0/734: link d5/d34/d21/d76/f87 d5/d34/d20/fe7 0 2024-01-17T23:43:04.334 INFO:tasks.workunit.client.0.smithi161.stdout:9/582: creat d0/d8/d31/d73/fc5 x:0 0 0 2024-01-17T23:43:04.334 INFO:tasks.workunit.client.0.smithi161.stdout:9/583: stat d0/d8/d14/f3f 0 2024-01-17T23:43:04.334 INFO:tasks.workunit.client.0.smithi161.stdout:9/584: fsync d0/d8/d14/d18/d20/da2/fbb 0 2024-01-17T23:43:04.444 INFO:tasks.workunit.client.0.smithi161.stdout:8/668: dread d1/d3/f9 [4194304,4194304] 0 2024-01-17T23:43:04.471 INFO:tasks.workunit.client.0.smithi161.stdout:8/669: dwrite d1/f58 [0,4194304] 0 2024-01-17T23:43:04.562 INFO:tasks.workunit.client.0.smithi161.stdout:5/637: rename dd/d15/d51/f93 to dd/d15/d1a/d5d/dc9/fd8 0 2024-01-17T23:43:04.953 INFO:tasks.workunit.client.0.smithi161.stdout:4/757: fdatasync d9/f10 0 2024-01-17T23:43:05.084 INFO:tasks.workunit.client.0.smithi161.stdout:3/724: mknod d0/d5/d9/d38/d4f/d9d/da7/ced 0 2024-01-17T23:43:05.089 INFO:tasks.workunit.client.0.smithi161.stdout:3/725: dread d0/d5/d9/d17/d2d/fd6 [0,4194304] 0 2024-01-17T23:43:05.089 INFO:tasks.workunit.client.0.smithi161.stdout:3/726: write d0/d5/d9/d1e/d3b/fbb [702746,78282] 0 2024-01-17T23:43:05.228 INFO:tasks.workunit.client.0.smithi161.stdout:2/669: mkdir d8/d1c/d75/dc7/de5/deb 0 2024-01-17T23:43:05.403 INFO:tasks.workunit.client.0.smithi161.stdout:0/735: readlink d5/d34/d12/l4a 0 2024-01-17T23:43:05.435 INFO:tasks.workunit.client.0.smithi161.stdout:0/736: dwrite d5/d34/d20/d2b/fe6 [0,4194304] 0 2024-01-17T23:43:05.626 INFO:tasks.workunit.client.0.smithi161.stdout:9/585: link d0/f3a d0/d8/d14/d87/fc6 0 2024-01-17T23:43:05.627 INFO:tasks.workunit.client.0.smithi161.stdout:9/586: dread d0/d8/d14/f44 [0,4194304] 0 2024-01-17T23:43:05.627 INFO:tasks.workunit.client.0.smithi161.stdout:9/587: chown d0/d8/d14/d87/lc1 116 1 2024-01-17T23:43:05.627 INFO:tasks.workunit.client.0.smithi161.stdout:9/588: chown d0/f2c 6024 1 2024-01-17T23:43:06.046 INFO:tasks.workunit.client.0.smithi161.stdout:8/670: symlink d1/d3d/le6 0 2024-01-17T23:43:06.047 INFO:tasks.workunit.client.0.smithi161.stdout:5/638: truncate dd/d15/d1a/f63 3598806 0 2024-01-17T23:43:06.078 INFO:tasks.workunit.client.0.smithi161.stdout:5/639: dwrite dd/f12 [0,4194304] 0 2024-01-17T23:43:06.440 INFO:tasks.workunit.client.0.smithi161.stdout:4/758: creat d9/d27/d3a/d8b/dcb/fe3 x:0 0 0 2024-01-17T23:43:06.440 INFO:tasks.workunit.client.0.smithi161.stdout:4/759: readlink d9/d27/d3a/l3d 0 2024-01-17T23:43:06.440 INFO:tasks.workunit.client.0.smithi161.stdout:4/760: chown d9/de/d1e/d38/d6b 1922 1 2024-01-17T23:43:06.682 INFO:tasks.workunit.client.0.smithi161.stdout:3/727: truncate d0/f4 4332467 0 2024-01-17T23:43:06.718 INFO:tasks.workunit.client.0.smithi161.stdout:2/670: stat d8/db8/dc9/lcb 0 2024-01-17T23:43:06.745 INFO:tasks.workunit.client.0.smithi161.stdout:2/671: dread d8/d4b/f9c [0,4194304] 0 2024-01-17T23:43:06.745 INFO:tasks.workunit.client.0.smithi161.stdout:2/672: creat d8/d1c/d1e/da6/d35/fec x:0 0 0 2024-01-17T23:43:06.769 INFO:tasks.workunit.client.0.smithi161.stdout:1/755: sync 2024-01-17T23:43:06.782 INFO:tasks.workunit.client.0.smithi161.stdout:2/673: dwrite d8/d1c/d75/dae/dc3/fa1 [0,4194304] 0 2024-01-17T23:43:06.795 INFO:tasks.workunit.client.0.smithi161.stdout:1/756: dwrite d1/d8/fe1 [0,4194304] 0 2024-01-17T23:43:06.899 INFO:tasks.workunit.client.0.smithi161.stdout:0/737: creat d5/d34/d20/fe8 x:0 0 0 2024-01-17T23:43:07.660 INFO:tasks.workunit.client.0.smithi161.stdout:5/640: rmdir dd/d15/d1a/d5d/d64/d7c/d88 39 2024-01-17T23:43:07.891 INFO:tasks.workunit.client.0.smithi161.stdout:4/761: mknod d9/de/d69/dd4/ce4 0 2024-01-17T23:43:08.301 INFO:tasks.workunit.client.0.smithi161.stdout:2/674: symlink d8/d1c/d1e/d80/led 0 2024-01-17T23:43:08.301 INFO:tasks.workunit.client.0.smithi161.stdout:2/675: fdatasync d8/d1c/d75/dae/fd9 0 2024-01-17T23:43:08.308 INFO:tasks.workunit.client.0.smithi161.stdout:6/678: sync 2024-01-17T23:43:09.419 INFO:tasks.workunit.client.0.smithi161.stdout:0/738: truncate d5/d34/d20/f85 2042619 0 2024-01-17T23:43:09.420 INFO:tasks.workunit.client.0.smithi161.stdout:0/739: chown d5/d34/d21/d97/dbb 21178572 1 2024-01-17T23:43:09.420 INFO:tasks.workunit.client.0.smithi161.stdout:0/740: write d5/d3a/d49/d99/fda [390198,56908] 0 2024-01-17T23:43:09.517 INFO:tasks.workunit.client.0.smithi161.stdout:9/589: unlink d0/d39/c70 0 2024-01-17T23:43:09.773 INFO:tasks.workunit.client.0.smithi161.stdout:4/762: creat d9/d1b/d24/ddb/fe5 x:0 0 0 2024-01-17T23:43:09.958 INFO:tasks.workunit.client.0.smithi161.stdout:3/728: symlink d0/d5/d9/d17/lee 0 2024-01-17T23:43:10.141 INFO:tasks.workunit.client.0.smithi161.stdout:2/676: symlink d8/d67/lee 0 2024-01-17T23:43:10.141 INFO:tasks.workunit.client.0.smithi161.stdout:2/677: stat d8 0 2024-01-17T23:43:10.228 INFO:tasks.workunit.client.0.smithi161.stdout:7/689: mkdir da/def 0 2024-01-17T23:43:10.228 INFO:tasks.workunit.client.0.smithi161.stdout:7/690: readlink da/d34/d5a/d3b/d3d/l9a 0 2024-01-17T23:43:10.243 INFO:tasks.workunit.client.0.smithi161.stdout:7/691: dread da/d34/d5a/d3b/f4b [0,4194304] 0 2024-01-17T23:43:10.243 INFO:tasks.workunit.client.0.smithi161.stdout:7/692: read - da/d34/d5a/d28/d2b/fe8 zero size 2024-01-17T23:43:10.254 INFO:tasks.workunit.client.0.smithi161.stdout:7/693: dread da/d34/d5a/d28/f3e [0,4194304] 0 2024-01-17T23:43:10.254 INFO:tasks.workunit.client.0.smithi161.stdout:7/694: stat da/d34/fa1 0 2024-01-17T23:43:10.376 INFO:tasks.workunit.client.0.smithi161.stdout:9/590: mknod d0/d8/d14/d87/d9b/cc7 0 2024-01-17T23:43:10.504 INFO:tasks.workunit.client.0.smithi161.stdout:5/641: truncate dd/fbc 595566 0 2024-01-17T23:43:10.505 INFO:tasks.workunit.client.0.smithi161.stdout:5/642: write dd/d15/d1a/d34/fb7 [771788,109136] 0 2024-01-17T23:43:10.505 INFO:tasks.workunit.client.0.smithi161.stdout:5/643: write dd/d31/db8/fd2 [332690,21414] 0 2024-01-17T23:43:10.505 INFO:tasks.workunit.client.0.smithi161.stdout:5/644: dread - dd/d31/d56/f99 zero size 2024-01-17T23:43:10.619 INFO:tasks.workunit.client.0.smithi161.stdout:4/763: truncate d9/de/d1e/f36 2515347 0 2024-01-17T23:43:11.113 INFO:tasks.workunit.client.0.smithi161.stdout:7/695: creat da/d34/d5a/da0/ff0 x:0 0 0 2024-01-17T23:43:11.194 INFO:tasks.workunit.client.0.smithi161.stdout:9/591: link d0/d8/d14/d18/d20/da2/fbb d0/d39/d49/fc8 0 2024-01-17T23:43:11.584 INFO:tasks.workunit.client.0.smithi161.stdout:4/764: creat d9/d1b/d53/d9f/fe6 x:0 0 0 2024-01-17T23:43:12.003 INFO:tasks.workunit.client.0.smithi161.stdout:5/645: rmdir dd/d15/d1a/d42 39 2024-01-17T23:43:12.113 INFO:tasks.workunit.client.0.smithi161.stdout:4/765: rmdir d9/de/d1e/d38/d6b 39 2024-01-17T23:43:12.134 INFO:tasks.workunit.client.0.smithi161.stdout:4/766: dread d9/d1b/d52/f59 [0,4194304] 0 2024-01-17T23:43:12.288 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:43:12.289 INFO:tasks.workunit.client.0.smithi161.stdout:7/696: link da/c1d da/db/d7a/d8f/dac/da9/cf1 0 2024-01-17T23:43:12.289 INFO:tasks.workunit.client.0.smithi161.stdout:7/697: truncate da/d34/d5a/d68/d8c/f8d 2398171 0 2024-01-17T23:43:12.289 INFO:tasks.workunit.client.0.smithi161.stdout:7/698: read - da/d34/d5a/d28/d2b/d93/fe2 zero size 2024-01-17T23:43:12.289 INFO:tasks.workunit.client.0.smithi161.stdout:7/699: chown da/d34/d5a/c3c 31 1 2024-01-17T23:43:12.291 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:43:12.531 INFO:tasks.workunit.client.0.smithi161.stdout:5/646: unlink dd/d15/d1a/f63 0 2024-01-17T23:43:13.089 INFO:tasks.workunit.client.0.smithi161.stdout:4/767: mkdir d9/de/d1e/d58/d60/d9c/dc7/de7 0 2024-01-17T23:43:13.089 INFO:tasks.workunit.client.0.smithi161.stdout:7/700: fsync da/d34/d5a/d28/d2b/f45 0 2024-01-17T23:43:13.118 INFO:tasks.workunit.client.0.smithi161.stdout:4/768: dwrite d9/d1b/d24/d25/d5b/fa5 [0,4194304] 0 2024-01-17T23:43:13.126 INFO:tasks.workunit.client.0.smithi161.stdout:7/701: dwrite da/d34/d5a/d3b/f4b [0,4194304] 0 2024-01-17T23:43:13.401 INFO:tasks.workunit.client.0.smithi161.stdout:3/729: getdents d0/d5/d9/d17 0 2024-01-17T23:43:13.560 INFO:tasks.workunit.client.0.smithi161.stdout:5/647: mkdir dd/d15/d1a/d5d/d64/d7c/dd9 0 2024-01-17T23:43:13.561 INFO:tasks.workunit.client.0.smithi161.stdout:5/648: read - dd/d15/d1a/d5d/d64/fcc zero size 2024-01-17T23:43:13.561 INFO:tasks.workunit.client.0.smithi161.stdout:5/649: truncate dd/d31/fad 398830 0 2024-01-17T23:43:14.163 INFO:tasks.workunit.client.0.smithi161.stdout:2/678: rmdir d8/d1c/d1e/da6 39 2024-01-17T23:43:14.341 INFO:tasks.workunit.client.0.smithi161.stdout:3/730: creat d0/d5/d9/d1e/d3b/d52/daf/fef x:0 0 0 2024-01-17T23:43:14.439 INFO:tasks.workunit.client.0.smithi161.stdout:5/650: dread dd/d15/f23 [0,4194304] 0 2024-01-17T23:43:14.767 INFO:tasks.workunit.client.0.smithi161.stdout:4/769: rmdir d9/d1b/d24/d25 39 2024-01-17T23:43:14.794 INFO:tasks.workunit.client.0.smithi161.stdout:9/592: dwrite d0/d8/d31/f71 [0,4194304] 0 2024-01-17T23:43:14.794 INFO:tasks.workunit.client.0.smithi161.stdout:9/593: stat d0/f51 0 2024-01-17T23:43:14.794 INFO:tasks.workunit.client.0.smithi161.stdout:9/594: read d0/d8/d14/d18/d20/f5b [337518,94927] 0 2024-01-17T23:43:14.794 INFO:tasks.workunit.client.0.smithi161.stdout:9/595: chown d0/d8/d14/d18/l2e 57382574 1 2024-01-17T23:43:15.389 INFO:tasks.workunit.client.0.smithi161.stdout:5/651: truncate dd/f11 1471059 0 2024-01-17T23:43:15.389 INFO:tasks.workunit.client.0.smithi161.stdout:8/671: rename d1/d3/d19/d1d/d25/d4b/fa9 to d1/fe7 0 2024-01-17T23:43:15.390 INFO:tasks.workunit.client.0.smithi161.stdout:8/672: read - d1/d3/d19/d1d/d25/fcd zero size 2024-01-17T23:43:15.674 INFO:tasks.workunit.client.0.smithi161.stdout:4/770: symlink d9/d1b/d24/d25/d5b/d97/le8 0 2024-01-17T23:43:15.674 INFO:tasks.workunit.client.0.smithi161.stdout:4/771: chown d9/d1b/d24/ddb/fe5 332641964 1 2024-01-17T23:43:15.992 INFO:tasks.workunit.client.0.smithi161.stdout:9/596: creat d0/d8/d14/d18/fc9 x:0 0 0 2024-01-17T23:43:15.993 INFO:tasks.workunit.client.0.smithi161.stdout:9/597: read - d0/d8/d14/d18/d20/da2/fbb zero size 2024-01-17T23:43:16.011 INFO:tasks.workunit.client.0.smithi161.stdout:9/598: write d0/d8/d14/d18/d20/f4f [534429,112609] 0 2024-01-17T23:43:16.488 INFO:tasks.workunit.client.0.smithi161.stdout:6/679: sync 2024-01-17T23:43:16.488 INFO:tasks.workunit.client.0.smithi161.stdout:1/757: sync 2024-01-17T23:43:17.030 INFO:tasks.workunit.client.0.smithi161.stdout:5/652: mkdir dd/d15/d4e/d4f/d97/dda 0 2024-01-17T23:43:17.030 INFO:tasks.workunit.client.0.smithi161.stdout:5/653: chown dd/d31/db8/cbe 1725 1 2024-01-17T23:43:17.030 INFO:tasks.workunit.client.0.smithi161.stdout:5/654: fsync dd/d15/d4e/d4f/f61 0 2024-01-17T23:43:17.053 INFO:tasks.workunit.client.0.smithi161.stdout:5/655: write dd/d15/d1a/d5d/d64/d7c/f8c [1438818,113680] 0 2024-01-17T23:43:17.053 INFO:tasks.workunit.client.0.smithi161.stdout:5/656: fsync dd/d15/d1a/d5d/d64/d7c/d88/fb5 0 2024-01-17T23:43:17.080 INFO:tasks.workunit.client.0.smithi161.stdout:5/657: dwrite dd/d31/d56/f68 [0,4194304] 0 2024-01-17T23:43:17.104 INFO:tasks.workunit.client.0.smithi161.stdout:5/658: dwrite dd/d15/d1a/d5d/d64/d7c/fab [0,4194304] 0 2024-01-17T23:43:17.104 INFO:tasks.workunit.client.0.smithi161.stdout:5/659: write dd/d15/d1a/d42/f46 [2866269,59056] 0 2024-01-17T23:43:17.157 INFO:tasks.workunit.client.0.smithi161.stdout:0/741: rename d5/d34/d20/d2d to d5/d34/d21/d9e/de9 0 2024-01-17T23:43:17.195 INFO:tasks.workunit.client.0.smithi161.stdout:0/742: dwrite d5/d34/d20/d2b/fd9 [0,4194304] 0 2024-01-17T23:43:17.216 INFO:tasks.workunit.client.0.smithi161.stdout:0/743: write d5/d3a/d49/f70 [3345068,33413] 0 2024-01-17T23:43:17.254 INFO:tasks.workunit.client.0.smithi161.stdout:8/673: symlink d1/d1c/le8 0 2024-01-17T23:43:17.275 INFO:tasks.workunit.client.0.smithi161.stdout:8/674: read d1/d88/f95 [2479713,99942] 0 2024-01-17T23:43:17.349 INFO:tasks.workunit.client.0.smithi161.stdout:4/772: mkdir d9/d27/d68/de9 0 2024-01-17T23:43:17.616 INFO:tasks.workunit.client.0.smithi161.stdout:9/599: rmdir d0/d8/d14/d18/d20/d97/dae 39 2024-01-17T23:43:17.662 INFO:tasks.workunit.client.0.smithi161.stdout:9/600: dwrite d0/d8/d14/d18/d63/faa [0,4194304] 0 2024-01-17T23:43:17.904 INFO:tasks.workunit.client.0.smithi161.stdout:1/758: symlink d1/d20/d26/lf4 0 2024-01-17T23:43:18.687 INFO:tasks.workunit.client.0.smithi161.stdout:5/660: link dd/c3b dd/d15/d1a/d5d/d64/d7c/cdb 0 2024-01-17T23:43:18.687 INFO:tasks.workunit.client.0.smithi161.stdout:5/661: dread - dd/d15/f9c zero size 2024-01-17T23:43:18.910 INFO:tasks.workunit.client.0.smithi161.stdout:7/702: rename da/d34/d4a/d4c/fd4 to da/db/db2/ff2 0 2024-01-17T23:43:19.262 INFO:tasks.workunit.client.0.smithi161.stdout:8/675: link d1/d3/ld1 d1/d3d/le9 0 2024-01-17T23:43:19.262 INFO:tasks.workunit.client.0.smithi161.stdout:0/744: creat d5/d3a/db4/dc1/fea x:0 0 0 2024-01-17T23:43:19.262 INFO:tasks.workunit.client.0.smithi161.stdout:8/676: chown d1/df/d13/db1 0 1 2024-01-17T23:43:19.262 INFO:tasks.workunit.client.0.smithi161.stdout:8/677: creat d1/df/d20/d6a/fea x:0 0 0 2024-01-17T23:43:19.268 INFO:tasks.workunit.client.0.smithi161.stdout:8/678: dread d1/d1c/f35 [0,4194304] 0 2024-01-17T23:43:19.528 INFO:tasks.workunit.client.0.smithi161.stdout:9/601: creat d0/d8/d31/d58/fca x:0 0 0 2024-01-17T23:43:19.837 INFO:tasks.workunit.client.0.smithi161.stdout:1/759: unlink d1/d2d/fb2 0 2024-01-17T23:43:19.838 INFO:tasks.workunit.client.0.smithi161.stdout:5/662: symlink dd/d15/d1a/d42/ldc 0 2024-01-17T23:43:19.838 INFO:tasks.workunit.client.0.smithi161.stdout:1/760: write d1/d20/d26/d30/fcf [4081316,13491] 0 2024-01-17T23:43:19.838 INFO:tasks.workunit.client.0.smithi161.stdout:5/663: chown dd/d15/d51/f62 8697 1 2024-01-17T23:43:19.838 INFO:tasks.workunit.client.0.smithi161.stdout:5/664: write dd/d15/d1a/d42/f46 [2301509,110984] 0 2024-01-17T23:43:19.879 INFO:tasks.workunit.client.0.smithi161.stdout:1/761: dwrite d1/d2d/feb [0,4194304] 0 2024-01-17T23:43:19.879 INFO:tasks.workunit.client.0.smithi161.stdout:1/762: dread - d1/d8/d9d/fa4 zero size 2024-01-17T23:43:19.905 INFO:tasks.workunit.client.0.smithi161.stdout:1/763: dwrite d1/d20/d26/d30/d41/f9c [0,4194304] 0 2024-01-17T23:43:20.200 INFO:tasks.workunit.client.0.smithi161.stdout:2/679: rename d8/d67/d6c/l91 to d8/d1c/d75/dae/lef 0 2024-01-17T23:43:20.520 INFO:tasks.workunit.client.0.smithi161.stdout:8/679: creat d1/d3d/d51/feb x:0 0 0 2024-01-17T23:43:20.742 INFO:tasks.workunit.client.0.smithi161.stdout:9/602: mkdir d0/d8/d14/d18/d20/da2/dcb 0 2024-01-17T23:43:20.759 INFO:tasks.workunit.client.0.smithi161.stdout:9/603: dread d0/d8/d14/d18/f55 [0,4194304] 0 2024-01-17T23:43:21.462 INFO:tasks.workunit.client.0.smithi161.stdout:5/665: truncate dd/d15/f23 497393 0 2024-01-17T23:43:22.071 INFO:tasks.workunit.client.0.smithi161.stdout:2/680: creat d8/db8/ff0 x:0 0 0 2024-01-17T23:43:22.449 INFO:tasks.workunit.client.0.smithi161.stdout:3/731: rename d0/d5/d9/d17/f18 to d0/d5/d9/ff0 0 2024-01-17T23:43:22.449 INFO:tasks.workunit.client.0.smithi161.stdout:3/732: creat d0/d5/d9/d1e/d5a/d8a/ff1 x:0 0 0 2024-01-17T23:43:22.466 INFO:tasks.workunit.client.0.smithi161.stdout:3/733: dread d0/d5/f1d [0,4194304] 0 2024-01-17T23:43:22.547 INFO:tasks.workunit.client.0.smithi161.stdout:0/745: mkdir d5/d3a/deb 0 2024-01-17T23:43:22.547 INFO:tasks.workunit.client.0.smithi161.stdout:0/746: write d5/d8/f1f [750528,130956] 0 2024-01-17T23:43:22.547 INFO:tasks.workunit.client.0.smithi161.stdout:0/747: fdatasync d5/d3a/d49/fa1 0 2024-01-17T23:43:22.547 INFO:tasks.workunit.client.0.smithi161.stdout:0/748: chown d5/d34/d21/fd8 46089717 1 2024-01-17T23:43:22.798 INFO:tasks.workunit.client.0.smithi161.stdout:8/680: creat d1/df/d20/d2a/d56/fec x:0 0 0 2024-01-17T23:43:22.798 INFO:tasks.workunit.client.0.smithi161.stdout:8/681: creat d1/df/d20/d2a/d56/fed x:0 0 0 2024-01-17T23:43:22.823 INFO:tasks.workunit.client.0.smithi161.stdout:8/682: dwrite d1/d3/d19/d1d/d25/f62 [0,4194304] 0 2024-01-17T23:43:23.008 INFO:tasks.workunit.client.0.smithi161.stdout:5/666: mknod dd/d15/d1a/d5d/d64/d7c/d88/cdd 0 2024-01-17T23:43:23.045 INFO:tasks.workunit.client.0.smithi161.stdout:4/773: write d9/d1b/d24/d25/d5b/fe2 [1817039,47865] 0 2024-01-17T23:43:23.045 INFO:tasks.workunit.client.0.smithi161.stdout:4/774: dread - d9/d51/fca zero size 2024-01-17T23:43:23.064 INFO:tasks.workunit.client.0.smithi161.stdout:4/775: dread d9/d27/d3a/d8b/dcb/f78 [0,4194304] 0 2024-01-17T23:43:23.094 INFO:tasks.workunit.client.0.smithi161.stdout:4/776: dwrite d9/d1b/fa2 [0,4194304] 0 2024-01-17T23:43:23.216 INFO:tasks.workunit.client.0.smithi161.stdout:2/681: creat d8/d1c/d75/dae/dc3/ff1 x:0 0 0 2024-01-17T23:43:23.216 INFO:tasks.workunit.client.0.smithi161.stdout:2/682: write d8/da/fda [941270,72312] 0 2024-01-17T23:43:23.278 INFO:tasks.workunit.client.0.smithi161.stdout:6/680: rename d6/d7/dc/d85/c44 to d6/d7/dc/d85/d31/cee 0 2024-01-17T23:43:23.492 INFO:tasks.workunit.client.0.smithi161.stdout:3/734: symlink d0/d5/d9/d1e/d3b/lf2 0 2024-01-17T23:43:23.492 INFO:tasks.workunit.client.0.smithi161.stdout:3/735: creat d0/d5/d9/d8b/ff3 x:0 0 0 2024-01-17T23:43:23.961 INFO:tasks.workunit.client.0.smithi161.stdout:8/683: dread d1/d3/d19/d1d/d25/f39 [0,4194304] 0 2024-01-17T23:43:24.377 INFO:tasks.workunit.client.0.smithi161.stdout:4/777: symlink d9/de/d69/lea 0 2024-01-17T23:43:24.377 INFO:tasks.workunit.client.0.smithi161.stdout:4/778: dread - d9/de/d69/f8a zero size 2024-01-17T23:43:24.661 INFO:tasks.workunit.client.0.smithi161.stdout:2/683: symlink d8/d4b/lf2 0 2024-01-17T23:43:24.661 INFO:tasks.workunit.client.0.smithi161.stdout:2/684: stat d8/d1c/d75/dae/dbe 0 2024-01-17T23:43:24.697 INFO:tasks.workunit.client.0.smithi161.stdout:7/703: rename da/db/d7a/l9b to da/d34/d5a/da0/lf3 0 2024-01-17T23:43:24.880 INFO:tasks.workunit.client.0.smithi161.stdout:6/681: symlink d6/d7/dc/d3c/ddd/de3/lef 0 2024-01-17T23:43:25.116 INFO:tasks.workunit.client.0.smithi161.stdout:3/736: getdents d0/d5/d9/d38/d4f 0 2024-01-17T23:43:25.116 INFO:tasks.workunit.client.0.smithi161.stdout:3/737: chown d0/d5/d9/d38/d4f/cd2 211311 1 2024-01-17T23:43:25.116 INFO:tasks.workunit.client.0.smithi161.stdout:3/738: chown d0/d5/d9/d1e/d5a/f7d 517542871 1 2024-01-17T23:43:25.137 INFO:tasks.workunit.client.0.smithi161.stdout:3/739: write d0/d5/d9/d1e/fab [2095523,44820] 0 2024-01-17T23:43:25.137 INFO:tasks.workunit.client.0.smithi161.stdout:3/740: fsync d0/d5/d9/f53 0 2024-01-17T23:43:25.137 INFO:tasks.workunit.client.0.smithi161.stdout:3/741: fdatasync d0/d5/d9/d1e/d5a/d8a/ff1 0 2024-01-17T23:43:25.150 INFO:tasks.workunit.client.0.smithi161.stdout:3/742: dread d0/d5/d9/d1e/d3b/d52/daf/fe3 [0,4194304] 0 2024-01-17T23:43:25.176 INFO:tasks.workunit.client.0.smithi161.stdout:3/743: dwrite d0/d5/d9/d38/d4f/d9d/dca/fe6 [0,4194304] 0 2024-01-17T23:43:25.176 INFO:tasks.workunit.client.0.smithi161.stdout:3/744: fsync d0/d5/d9/d1e/d3b/d52/daf/fe3 0 2024-01-17T23:43:25.197 INFO:tasks.workunit.client.0.smithi161.stdout:3/745: write d0/d5/d9/d38/f49 [10722,4239] 0 2024-01-17T23:43:25.197 INFO:tasks.workunit.client.0.smithi161.stdout:3/746: chown d0/d5/d9/d38/d4f/d9d/dca/fe2 205 1 2024-01-17T23:43:25.546 INFO:tasks.workunit.client.0.smithi161.stdout:8/684: link d1/df/l6f d1/df/d16/dbf/lee 0 2024-01-17T23:43:25.681 INFO:tasks.workunit.client.0.smithi161.stdout:5/667: getdents dd/d31/d3c 0 2024-01-17T23:43:25.705 INFO:tasks.workunit.client.0.smithi161.stdout:5/668: dwrite dd/d31/d56/f99 [0,4194304] 0 2024-01-17T23:43:25.742 INFO:tasks.workunit.client.0.smithi161.stdout:5/669: dwrite dd/d15/d4e/d4f/f61 [0,4194304] 0 2024-01-17T23:43:25.742 INFO:tasks.workunit.client.0.smithi161.stdout:5/670: write dd/d15/f9c [219711,113325] 0 2024-01-17T23:43:25.742 INFO:tasks.workunit.client.0.smithi161.stdout:5/671: chown dd/d31/d3c/l5a 189711259 1 2024-01-17T23:43:25.758 INFO:tasks.workunit.client.0.smithi161.stdout:4/779: creat d9/de/d1e/d38/d89/dd8/feb x:0 0 0 2024-01-17T23:43:26.064 INFO:tasks.workunit.client.0.smithi161.stdout:1/764: rename d1/d11/d72/d81/lb6 to d1/d20/d26/lf5 0 2024-01-17T23:43:26.065 INFO:tasks.workunit.client.0.smithi161.stdout:1/765: chown d1/d8/d54/d94/fa5 10090 1 2024-01-17T23:43:26.223 INFO:tasks.workunit.client.0.smithi161.stdout:7/704: mknod da/d34/d4a/d4c/cf4 0 2024-01-17T23:43:26.223 INFO:tasks.workunit.client.0.smithi161.stdout:7/705: fdatasync da/d34/d5a/d3b/d3d/d7f/fa3 0 2024-01-17T23:43:26.223 INFO:tasks.workunit.client.0.smithi161.stdout:7/706: write da/db/f13 [4622815,49934] 0 2024-01-17T23:43:26.483 INFO:tasks.workunit.client.0.smithi161.stdout:6/682: creat d6/d7/dc/d85/d31/d5d/ff0 x:0 0 0 2024-01-17T23:43:26.484 INFO:tasks.workunit.client.0.smithi161.stdout:6/683: creat d6/d7/dc/d3c/ff1 x:0 0 0 2024-01-17T23:43:26.834 INFO:tasks.workunit.client.0.smithi161.stdout:0/749: dwrite d5/d34/d12/f6f [0,4194304] 0 2024-01-17T23:43:26.835 INFO:tasks.workunit.client.0.smithi161.stdout:0/750: write d5/d34/d12/d2a/d35/f82 [201416,38629] 0 2024-01-17T23:43:27.565 INFO:tasks.workunit.client.0.smithi161.stdout:3/747: dread d0/d5/d9/ff0 [0,4194304] 0 2024-01-17T23:43:27.565 INFO:tasks.workunit.client.0.smithi161.stdout:3/748: fdatasync d0/d5/d9/d17/f1c 0 2024-01-17T23:43:27.800 INFO:tasks.workunit.client.0.smithi161.stdout:8/685: creat d1/d3/fef x:0 0 0 2024-01-17T23:43:28.018 INFO:tasks.workunit.client.0.smithi161.stdout:5/672: dread dd/d15/d1a/d42/fb9 [0,4194304] 0 2024-01-17T23:43:28.826 INFO:tasks.workunit.client.0.smithi161.stdout:7/707: unlink da/d34/d5a/d3b/db9/f9e 0 2024-01-17T23:43:28.826 INFO:tasks.workunit.client.0.smithi161.stdout:7/708: read da/d34/d5a/d3b/d3d/f40 [2388171,116108] 0 2024-01-17T23:43:28.826 INFO:tasks.workunit.client.0.smithi161.stdout:7/709: truncate da/db/f2a 1396626 0 2024-01-17T23:43:28.826 INFO:tasks.workunit.client.0.smithi161.stdout:7/710: chown da/faa 3 1 2024-01-17T23:43:28.826 INFO:tasks.workunit.client.0.smithi161.stdout:7/711: fdatasync da/d34/d5a/d28/fda 0 2024-01-17T23:43:28.865 INFO:tasks.workunit.client.0.smithi161.stdout:6/684: mknod d6/cf2 0 2024-01-17T23:43:28.865 INFO:tasks.workunit.client.0.smithi161.stdout:6/685: write d6/d7/dc/d85/d1a/f3e [263467,120712] 0 2024-01-17T23:43:28.865 INFO:tasks.workunit.client.0.smithi161.stdout:6/686: readlink d6/d7/dc/d85/d31/l69 0 2024-01-17T23:43:29.019 INFO:tasks.workunit.client.0.smithi161.stdout:2/685: write d8/d1c/d1e/d80/d79/f81 [2066270,8828] 0 2024-01-17T23:43:29.020 INFO:tasks.workunit.client.0.smithi161.stdout:2/686: stat d8/d1c/d75/dae/dc3/f33 0 2024-01-17T23:43:29.020 INFO:tasks.workunit.client.0.smithi161.stdout:2/687: write d8/d1c/d1e/fca [1830472,124677] 0 2024-01-17T23:43:29.020 INFO:tasks.workunit.client.0.smithi161.stdout:2/688: chown d8/d1c/d75/dae/dc3/f65 3 1 2024-01-17T23:43:29.020 INFO:tasks.workunit.client.0.smithi161.stdout:2/689: chown d8/da 910 1 2024-01-17T23:43:29.050 INFO:tasks.workunit.client.0.smithi161.stdout:2/690: dwrite d8/d1c/d1e/f2a [0,4194304] 0 2024-01-17T23:43:29.262 INFO:tasks.workunit.client.0.smithi161.stdout:0/751: symlink d5/d8/d68/db0/lec 0 2024-01-17T23:43:29.263 INFO:tasks.workunit.client.0.smithi161.stdout:3/749: mkdir d0/d5/d9/d1e/d3b/df4 0 2024-01-17T23:43:29.285 INFO:tasks.workunit.client.0.smithi161.stdout:0/752: write d5/f32 [4191644,6607] 0 2024-01-17T23:43:29.285 INFO:tasks.workunit.client.0.smithi161.stdout:0/753: chown d5/d8/l95 131859 1 2024-01-17T23:43:29.285 INFO:tasks.workunit.client.0.smithi161.stdout:0/754: creat d5/d3a/db4/dc1/fed x:0 0 0 2024-01-17T23:43:29.475 INFO:tasks.workunit.client.0.smithi161.stdout:8/686: link d1/df/d20/d6a/f91 d1/df/d13/ff0 0 2024-01-17T23:43:29.503 INFO:tasks.workunit.client.0.smithi161.stdout:8/687: dwrite d1/f58 [0,4194304] 0 2024-01-17T23:43:29.529 INFO:tasks.workunit.client.0.smithi161.stdout:8/688: dwrite d1/d3/d19/d1d/d25/d4b/f6b [0,4194304] 0 2024-01-17T23:43:29.549 INFO:tasks.workunit.client.0.smithi161.stdout:5/673: mkdir dd/d15/d1a/d5d/dc9/dde 0 2024-01-17T23:43:29.737 INFO:tasks.workunit.client.0.smithi161.stdout:9/604: rename d0/d8/c77 to d0/d8/d14/d18/d20/d97/dae/ccc 0 2024-01-17T23:43:29.737 INFO:tasks.workunit.client.0.smithi161.stdout:9/605: chown d0/d8/d14/dab 5336 1 2024-01-17T23:43:29.737 INFO:tasks.workunit.client.0.smithi161.stdout:9/606: write d0/d8/d14/d56/f93 [847286,85232] 0 2024-01-17T23:43:29.737 INFO:tasks.workunit.client.0.smithi161.stdout:9/607: write d0/fa6 [821774,95182] 0 2024-01-17T23:43:29.935 INFO:tasks.workunit.client.0.smithi161.stdout:6/687: mkdir d6/d7/dc/db2/df3 0 2024-01-17T23:43:29.965 INFO:tasks.workunit.client.0.smithi161.stdout:6/688: dwrite d6/d7/dc/d85/d13/f37 [0,4194304] 0 2024-01-17T23:43:29.965 INFO:tasks.workunit.client.0.smithi161.stdout:6/689: chown d6/d7/dc/d85/d1a/d59/c7b 0 1 2024-01-17T23:43:30.005 INFO:tasks.workunit.client.0.smithi161.stdout:2/691: symlink d8/d1c/d75/dc7/de5/lf3 0 2024-01-17T23:43:30.528 INFO:tasks.workunit.client.0.smithi161.stdout:0/755: unlink d5/d3a/d49/l7b 0 2024-01-17T23:43:30.528 INFO:tasks.workunit.client.0.smithi161.stdout:8/689: unlink d1/df/d13/db1/ccf 0 2024-01-17T23:43:30.529 INFO:tasks.workunit.client.0.smithi161.stdout:8/690: chown d1/d3/d19/d1d/f27 0 1 2024-01-17T23:43:30.529 INFO:tasks.workunit.client.0.smithi161.stdout:0/756: chown d5/d34/d21/d9e/dc7/le3 1 1 2024-01-17T23:43:30.529 INFO:tasks.workunit.client.0.smithi161.stdout:0/757: chown d5/d3a/f80 169967 1 2024-01-17T23:43:30.529 INFO:tasks.workunit.client.0.smithi161.stdout:0/758: stat d5/d34/d20/d2b/dbf/fc4 0 2024-01-17T23:43:30.544 INFO:tasks.workunit.client.0.smithi161.stdout:8/691: dread d1/d88/f95 [0,4194304] 0 2024-01-17T23:43:30.544 INFO:tasks.workunit.client.0.smithi161.stdout:8/692: readlink d1/d22/d2f/lc3 0 2024-01-17T23:43:30.589 INFO:tasks.workunit.client.0.smithi161.stdout:5/674: rmdir dd/d15/d6a/d80 39 2024-01-17T23:43:30.589 INFO:tasks.workunit.client.0.smithi161.stdout:5/675: fsync dd/d31/d56/f99 0 2024-01-17T23:43:30.627 INFO:tasks.workunit.client.0.smithi161.stdout:5/676: dwrite dd/d31/d7b/d78/f87 [0,4194304] 0 2024-01-17T23:43:31.073 INFO:tasks.workunit.client.0.smithi161.stdout:7/712: rename da/da7/fd0 to da/db/d7a/dc0/ff5 0 2024-01-17T23:43:31.093 INFO:tasks.workunit.client.0.smithi161.stdout:7/713: dread da/db/f13 [0,4194304] 0 2024-01-17T23:43:31.093 INFO:tasks.workunit.client.0.smithi161.stdout:7/714: dread - da/d34/d5a/d28/fce zero size 2024-01-17T23:43:31.147 INFO:tasks.workunit.client.0.smithi161.stdout:9/608: truncate d0/d8/d14/d18/d20/d97/d9e/fad 507532 0 2024-01-17T23:43:31.147 INFO:tasks.workunit.client.0.smithi161.stdout:9/609: truncate d0/d8/d14/dab/fb7 870841 0 2024-01-17T23:43:31.463 INFO:tasks.workunit.client.0.smithi161.stdout:6/690: unlink d6/d7/dc/d85/d31/d5d/d55/c9a 0 2024-01-17T23:43:31.464 INFO:tasks.workunit.client.0.smithi161.stdout:2/692: creat d8/d67/ff4 x:0 0 0 2024-01-17T23:43:31.464 INFO:tasks.workunit.client.0.smithi161.stdout:2/693: fdatasync d8/f14 0 2024-01-17T23:43:32.207 INFO:tasks.workunit.client.0.smithi161.stdout:8/693: creat d1/d22/dbd/dce/ff1 x:0 0 0 2024-01-17T23:43:32.208 INFO:tasks.workunit.client.0.smithi161.stdout:8/694: fdatasync d1/d3/d19/d1d/f27 0 2024-01-17T23:43:32.229 INFO:tasks.workunit.client.0.smithi161.stdout:8/695: dread d1/d3/d19/d1d/d25/d4b/f63 [0,4194304] 0 2024-01-17T23:43:32.229 INFO:tasks.workunit.client.0.smithi161.stdout:8/696: write d1/d22/dbd/dce/ff1 [1046854,110236] 0 2024-01-17T23:43:32.230 INFO:tasks.workunit.client.0.smithi161.stdout:8/697: chown d1/df/f69 261204004 1 2024-01-17T23:43:32.264 INFO:tasks.workunit.client.0.smithi161.stdout:8/698: dwrite d1/df/d20/d6a/f91 [0,4194304] 0 2024-01-17T23:43:32.264 INFO:tasks.workunit.client.0.smithi161.stdout:8/699: write d1/d3/d19/d1d/d25/fcd [698015,54745] 0 2024-01-17T23:43:32.374 INFO:tasks.workunit.client.0.smithi161.stdout:5/677: rmdir dd/d15/d4e/d4f/d97/dda 0 2024-01-17T23:43:32.375 INFO:tasks.workunit.client.0.smithi161.stdout:5/678: fsync dd/d15/d4e/fa3 0 2024-01-17T23:43:32.375 INFO:tasks.workunit.client.0.smithi161.stdout:5/679: fdatasync dd/d15/d4e/d4f/d97/fa5 0 2024-01-17T23:43:32.494 INFO:tasks.workunit.client.0.smithi161.stdout:4/780: write d9/d27/f6c [129362,4243] 0 2024-01-17T23:43:32.832 INFO:tasks.workunit.client.0.smithi161.stdout:7/715: truncate da/f15 3097802 0 2024-01-17T23:43:32.963 INFO:tasks.workunit.client.0.smithi161.stdout:9/610: dread d0/d8/d14/d56/f74 [0,4194304] 0 2024-01-17T23:43:32.963 INFO:tasks.workunit.client.0.smithi161.stdout:9/611: chown d0/d8/d14/d18 49 1 2024-01-17T23:43:33.005 INFO:tasks.workunit.client.0.smithi161.stdout:1/766: dwrite d1/d8/d1c/f39 [0,4194304] 0 2024-01-17T23:43:33.006 INFO:tasks.workunit.client.0.smithi161.stdout:1/767: read - d1/d2d/fe5 zero size 2024-01-17T23:43:33.080 INFO:tasks.workunit.client.0.smithi161.stdout:2/694: mknod d8/d67/cf5 0 2024-01-17T23:43:33.145 INFO:tasks.workunit.client.0.smithi161.stdout:6/691: truncate d6/d7/dc/d85/fc0 2121540 0 2024-01-17T23:43:33.592 INFO:tasks.workunit.client.0.smithi161.stdout:4/781: mknod d9/de/d1e/d38/cec 0 2024-01-17T23:43:33.614 INFO:tasks.workunit.client.0.smithi161.stdout:4/782: write d9/f10 [1252368,70384] 0 2024-01-17T23:43:34.075 INFO:tasks.workunit.client.0.smithi161.stdout:7/716: creat da/d34/d5a/d68/ff6 x:0 0 0 2024-01-17T23:43:34.341 INFO:tasks.workunit.client.0.smithi161.stdout:2/695: mknod d8/d1c/d75/dae/de4/d84/cf6 0 2024-01-17T23:43:34.341 INFO:tasks.workunit.client.0.smithi161.stdout:9/612: creat d0/d8/d31/fcd x:0 0 0 2024-01-17T23:43:35.317 INFO:tasks.workunit.client.0.smithi161.stdout:5/680: readlink dd/d15/d6a/d80/la8 0 2024-01-17T23:43:35.317 INFO:tasks.workunit.client.0.smithi161.stdout:5/681: write dd/d15/d4e/fd3 [466984,57985] 0 2024-01-17T23:43:35.453 INFO:tasks.workunit.client.0.smithi161.stdout:4/783: mknod d9/d51/d64/dc4/de1/ced 0 2024-01-17T23:43:35.453 INFO:tasks.workunit.client.0.smithi161.stdout:7/717: truncate da/db/d7a/dc7/f5b 2335700 0 2024-01-17T23:43:35.453 INFO:tasks.workunit.client.0.smithi161.stdout:7/718: readlink l6 0 2024-01-17T23:43:35.453 INFO:tasks.workunit.client.0.smithi161.stdout:4/784: dread - d9/de/d69/fa7 zero size 2024-01-17T23:43:35.685 INFO:tasks.workunit.client.0.smithi161.stdout:1/768: getdents d1/d2d/d3b 0 2024-01-17T23:43:35.687 INFO:tasks.workunit.client.0.smithi161.stdout:1/769: dread d1/d2d/d3b/f7e [0,4194304] 0 2024-01-17T23:43:35.851 INFO:tasks.workunit.client.0.smithi161.stdout:2/696: symlink d8/d4b/lf7 0 2024-01-17T23:43:36.206 INFO:tasks.workunit.client.0.smithi161.stdout:7/719: chown da/d34/d5a/d68/c80 2 1 2024-01-17T23:43:36.227 INFO:tasks.workunit.client.0.smithi161.stdout:7/720: dread da/d34/d5a/d3b/f61 [0,4194304] 0 2024-01-17T23:43:36.246 INFO:tasks.workunit.client.0.smithi161.stdout:7/721: dread da/db/f13 [0,4194304] 0 2024-01-17T23:43:36.291 INFO:tasks.workunit.client.0.smithi161.stdout:4/785: dread d9/fd [0,4194304] 0 2024-01-17T23:43:36.291 INFO:tasks.workunit.client.0.smithi161.stdout:4/786: chown d9/de/c4b 3 1 2024-01-17T23:43:36.291 INFO:tasks.workunit.client.0.smithi161.stdout:4/787: dread - d9/d27/d3a/d87/fd2 zero size 2024-01-17T23:43:36.532 INFO:tasks.workunit.client.0.smithi161.stdout:1/770: truncate d1/d20/d26/d30/f5f 1369930 0 2024-01-17T23:43:36.532 INFO:tasks.workunit.client.0.smithi161.stdout:2/697: unlink d8/d1c/d1e/d80/dc4/fc8 0 2024-01-17T23:43:36.557 INFO:tasks.workunit.client.0.smithi161.stdout:2/698: read d8/d1c/d1e/da6/fdf [2857579,41650] 0 2024-01-17T23:43:36.557 INFO:tasks.workunit.client.0.smithi161.stdout:2/699: write d8/d1c/d75/dae/dc3/f33 [2196771,96558] 0 2024-01-17T23:43:36.655 INFO:tasks.workunit.client.0.smithi161.stdout:7/722: read da/d34/d5a/d68/f6b [138119,55173] 0 2024-01-17T23:43:36.882 INFO:tasks.workunit.client.0.smithi161.stdout:2/700: creat d8/d1c/d1e/d80/dc4/ff8 x:0 0 0 2024-01-17T23:43:36.893 INFO:tasks.workunit.client.0.smithi161.stdout:2/701: dread d8/f18 [0,4194304] 0 2024-01-17T23:43:36.911 INFO:tasks.workunit.client.0.smithi161.stdout:2/702: dread d8/da/f76 [0,4194304] 0 2024-01-17T23:43:36.994 INFO:tasks.workunit.client.0.smithi161.stdout:7/723: truncate da/d34/d5a/f75 759263 0 2024-01-17T23:43:37.016 INFO:tasks.workunit.client.0.smithi161.stdout:7/724: write da/d34/d5a/f2f [10361419,52125] 0 2024-01-17T23:43:37.016 INFO:tasks.workunit.client.0.smithi161.stdout:7/725: readlink da/db/db2/lbf 0 2024-01-17T23:43:37.016 INFO:tasks.workunit.client.0.smithi161.stdout:7/726: fsync da/d14/f32 0 2024-01-17T23:43:37.613 INFO:tasks.workunit.client.0.smithi161.stdout:7/727: write da/f15 [907591,90070] 0 2024-01-17T23:43:37.641 INFO:tasks.workunit.client.0.smithi161.stdout:8/700: write d1/df/d20/d2a/f3c [1271446,74452] 0 2024-01-17T23:43:37.661 INFO:tasks.workunit.client.0.smithi161.stdout:8/701: read d1/df/d46/fa5 [3136627,81694] 0 2024-01-17T23:43:37.998 INFO:tasks.workunit.client.0.smithi161.stdout:8/702: mkdir d1/d3/d19/df2 0 2024-01-17T23:43:39.002 INFO:tasks.workunit.client.0.smithi161.stdout:1/771: creat d1/ff6 x:0 0 0 2024-01-17T23:43:39.002 INFO:tasks.workunit.client.0.smithi161.stdout:1/772: truncate d1/d8/d1f/d4b/fa1 278268 0 2024-01-17T23:43:39.025 INFO:tasks.workunit.client.0.smithi161.stdout:1/773: read d1/d8/d1c/f48 [3409553,42304] 0 2024-01-17T23:43:39.040 INFO:tasks.workunit.client.0.smithi161.stdout:2/703: dwrite d8/d67/fac [0,4194304] 0 2024-01-17T23:43:39.565 INFO:tasks.workunit.client.0.smithi161.stdout:3/750: rename d0/d5/l2f to d0/d5/d9/d38/db3/db4/lf5 0 2024-01-17T23:43:39.935 INFO:tasks.workunit.client.0.smithi161.stdout:8/703: unlink d1/d3/d19/d1d/d25/f62 0 2024-01-17T23:43:40.040 INFO:tasks.workunit.client.0.smithi161.stdout:1/774: creat d1/d20/d26/d30/ff7 x:0 0 0 2024-01-17T23:43:40.040 INFO:tasks.workunit.client.0.smithi161.stdout:1/775: creat d1/d20/ff8 x:0 0 0 2024-01-17T23:43:40.040 INFO:tasks.workunit.client.0.smithi161.stdout:1/776: chown d1/d20/d26/c27 27251935 1 2024-01-17T23:43:40.040 INFO:tasks.workunit.client.0.smithi161.stdout:1/777: fsync d1/d8/df1/ff3 0 2024-01-17T23:43:40.041 INFO:tasks.workunit.client.0.smithi161.stdout:1/778: write d1/d8/d1f/f49 [1866134,97841] 0 2024-01-17T23:43:40.367 INFO:tasks.workunit.client.0.smithi161.stdout:2/704: mknod d8/d1c/d75/dae/cf9 0 2024-01-17T23:43:40.498 INFO:tasks.workunit.client.0.smithi161.stdout:0/759: rename d5/d34/d12/d2a to d5/d3a/deb/dee 0 2024-01-17T23:43:40.674 INFO:tasks.workunit.client.0.smithi161.stdout:3/751: link d0/d5/d9/d1e/d5a/la9 d0/d5/d9/d38/db3/db4/lf6 0 2024-01-17T23:43:40.888 INFO:tasks.workunit.client.0.smithi161.stdout:8/704: mkdir d1/d3/d19/d1d/df3 0 2024-01-17T23:43:41.015 INFO:tasks.workunit.client.0.smithi161.stdout:5/682: creat dd/d15/d1a/fdf x:0 0 0 2024-01-17T23:43:41.016 INFO:tasks.workunit.client.0.smithi161.stdout:5/683: readlink dd/l37 0 2024-01-17T23:43:41.403 INFO:tasks.workunit.client.0.smithi161.stdout:1/779: creat d1/d31/dd1/ff9 x:0 0 0 2024-01-17T23:43:41.675 INFO:tasks.workunit.client.0.smithi161.stdout:9/613: rename d0/d8/d31/d73/l8a to d0/d8/d14/d18/d20/d97/lce 0 2024-01-17T23:43:41.708 INFO:tasks.workunit.client.0.smithi161.stdout:9/614: dwrite d0/d8/d14/d87/d9b/fbf [0,4194304] 0 2024-01-17T23:43:41.708 INFO:tasks.workunit.client.0.smithi161.stdout:9/615: chown d0/f2c 0 1 2024-01-17T23:43:41.923 INFO:tasks.workunit.client.0.smithi161.stdout:0/760: unlink d5/d3a/d49/fb5 0 2024-01-17T23:43:41.923 INFO:tasks.workunit.client.0.smithi161.stdout:0/761: chown d5/d34/d20/d2b 7 1 2024-01-17T23:43:41.923 INFO:tasks.workunit.client.0.smithi161.stdout:0/762: dread - d5/d34/d20/d2b/f56 zero size 2024-01-17T23:43:42.145 INFO:tasks.workunit.client.0.smithi161.stdout:3/752: mkdir d0/d5/d9/d38/d4f/d9d/df7 0 2024-01-17T23:43:42.296 INFO:tasks.workunit.client.0.smithi161.stdout:5/684: mkdir dd/d15/d4e/d4f/de0 0 2024-01-17T23:43:42.296 INFO:tasks.workunit.client.0.smithi161.stdout:5/685: readlink dd/d15/l35 0 2024-01-17T23:43:42.296 INFO:tasks.workunit.client.0.smithi161.stdout:5/686: write dd/d15/d1a/f6b [965627,107007] 0 2024-01-17T23:43:42.342 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:43:42.347 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:43:42.498 INFO:tasks.workunit.client.0.smithi161.stdout:6/692: sync 2024-01-17T23:43:43.055 INFO:tasks.workunit.client.0.smithi161.stdout:0/763: link d5/d34/d21/d9e/de9/d8d/lb2 d5/d3a/deb/dee/lef 0 2024-01-17T23:43:43.055 INFO:tasks.workunit.client.0.smithi161.stdout:0/764: write d5/d3a/db4/dc1/fea [760766,44487] 0 2024-01-17T23:43:43.070 INFO:tasks.workunit.client.0.smithi161.stdout:0/765: write d5/d34/f47 [678715,45385] 0 2024-01-17T23:43:43.203 INFO:tasks.workunit.client.0.smithi161.stdout:3/753: unlink d0/d5/d9/d17/d2d/c90 0 2024-01-17T23:43:43.284 INFO:tasks.workunit.client.0.smithi161.stdout:8/705: getdents d1/d3 0 2024-01-17T23:43:43.482 INFO:tasks.workunit.client.0.smithi161.stdout:5/687: creat dd/d31/d7b/fe1 x:0 0 0 2024-01-17T23:43:43.482 INFO:tasks.workunit.client.0.smithi161.stdout:5/688: fsync dd/d15/d1a/d5d/d64/f73 0 2024-01-17T23:43:43.523 INFO:tasks.workunit.client.0.smithi161.stdout:5/689: dwrite dd/d15/d4e/d4f/d97/fa5 [0,4194304] 0 2024-01-17T23:43:43.588 INFO:tasks.workunit.client.0.smithi161.stdout:6/693: mknod d6/d7/dc/d3c/ddd/de3/cf4 0 2024-01-17T23:43:43.744 INFO:tasks.workunit.client.0.smithi161.stdout:1/780: mknod d1/d8/d1c/d3e/cfa 0 2024-01-17T23:43:43.767 INFO:tasks.workunit.client.0.smithi161.stdout:1/781: write d1/d8/d54/d94/fa5 [3932340,127870] 0 2024-01-17T23:43:43.787 INFO:tasks.workunit.client.0.smithi161.stdout:1/782: dread d1/d20/f2e [4194304,4194304] 0 2024-01-17T23:43:43.787 INFO:tasks.workunit.client.0.smithi161.stdout:1/783: write d1/d31/dd1/ff9 [359893,4040] 0 2024-01-17T23:43:43.797 INFO:tasks.workunit.client.0.smithi161.stdout:1/784: dread d1/d2d/f7d [0,4194304] 0 2024-01-17T23:43:43.958 INFO:tasks.workunit.client.0.smithi161.stdout:4/788: rename d9/d27/d3a/d87/cb6 to d9/d27/d3a/d8b/cee 0 2024-01-17T23:43:43.958 INFO:tasks.workunit.client.0.smithi161.stdout:4/789: dread - d9/d27/d68/fdf zero size 2024-01-17T23:43:44.020 INFO:tasks.workunit.client.0.smithi161.stdout:9/616: symlink d0/d39/d49/d6e/lcf 0 2024-01-17T23:43:44.230 INFO:tasks.workunit.client.0.smithi161.stdout:0/766: creat d5/d3a/d49/d99/dd7/ff0 x:0 0 0 2024-01-17T23:43:44.249 INFO:tasks.workunit.client.0.smithi161.stdout:0/767: dread d5/d8/d68/db0/fd3 [0,4194304] 0 2024-01-17T23:43:44.435 INFO:tasks.workunit.client.0.smithi161.stdout:3/754: mknod d0/d5/d9/d17/d5c/cf8 0 2024-01-17T23:43:44.897 INFO:tasks.workunit.client.0.smithi161.stdout:2/705: dwrite d8/d1c/f31 [0,4194304] 0 2024-01-17T23:43:44.908 INFO:tasks.workunit.client.0.smithi161.stdout:2/706: dread d8/d67/d6c/d72/f96 [0,4194304] 0 2024-01-17T23:43:44.908 INFO:tasks.workunit.client.0.smithi161.stdout:2/707: getdents d8/d67/d6c/dcc 0 2024-01-17T23:43:44.908 INFO:tasks.workunit.client.0.smithi161.stdout:2/708: truncate d8/fa5 845466 0 2024-01-17T23:43:45.676 INFO:tasks.workunit.client.0.smithi161.stdout:5/690: rmdir dd/d15/d1a/d5d/d64 39 2024-01-17T23:43:45.676 INFO:tasks.workunit.client.0.smithi161.stdout:1/785: mkdir d1/d8/dfb 0 2024-01-17T23:43:45.676 INFO:tasks.workunit.client.0.smithi161.stdout:1/786: chown d1/l40 6990 1 2024-01-17T23:43:45.676 INFO:tasks.workunit.client.0.smithi161.stdout:1/787: creat d1/d2d/ffc x:0 0 0 2024-01-17T23:43:45.676 INFO:tasks.workunit.client.0.smithi161.stdout:1/788: stat d1/lc0 0 2024-01-17T23:43:45.676 INFO:tasks.workunit.client.0.smithi161.stdout:1/789: truncate d1/d64/fcb 152968 0 2024-01-17T23:43:46.035 INFO:tasks.workunit.client.0.smithi161.stdout:7/728: rename da/d34/d5a/d68/d8c/lc5 to da/d34/d5a/d3b/d3d/d82/db0/lf7 0 2024-01-17T23:43:46.046 INFO:tasks.workunit.client.0.smithi161.stdout:7/729: read da/f26 [689733,113979] 0 2024-01-17T23:43:46.436 INFO:tasks.workunit.client.0.smithi161.stdout:4/790: symlink d9/de/d1e/d58/lef 0 2024-01-17T23:43:46.573 INFO:tasks.workunit.client.0.smithi161.stdout:0/768: mkdir d5/d8/d68/db0/dcc/df1 0 2024-01-17T23:43:46.574 INFO:tasks.workunit.client.0.smithi161.stdout:0/769: chown d5/d34/c16 2469292 1 2024-01-17T23:43:46.832 INFO:tasks.workunit.client.0.smithi161.stdout:3/755: unlink d0/d5/d9/d1e/d3b/d52/daf/fe3 0 2024-01-17T23:43:47.024 INFO:tasks.workunit.client.0.smithi161.stdout:2/709: mknod d8/d68/cfa 0 2024-01-17T23:43:47.024 INFO:tasks.workunit.client.0.smithi161.stdout:2/710: write d8/da/fc6 [150222,38453] 0 2024-01-17T23:43:47.024 INFO:tasks.workunit.client.0.smithi161.stdout:2/711: chown d8/fa5 9067014 1 2024-01-17T23:43:47.556 INFO:tasks.workunit.client.0.smithi161.stdout:1/790: creat d1/d8/d1c/ffd x:0 0 0 2024-01-17T23:43:47.608 INFO:tasks.workunit.client.0.smithi161.stdout:1/791: dwrite d1/d11/f76 [0,4194304] 0 2024-01-17T23:43:47.661 INFO:tasks.workunit.client.0.smithi161.stdout:1/792: dwrite d1/d11/d72/f89 [0,4194304] 0 2024-01-17T23:43:48.063 INFO:tasks.workunit.client.0.smithi161.stdout:9/617: rename d0/d8/d14/d18/d20/f4f to d0/d8/d31/d58/fd0 0 2024-01-17T23:43:48.063 INFO:tasks.workunit.client.0.smithi161.stdout:9/618: chown d0/d8/d14/d18/d20/d97/lce 2756 1 2024-01-17T23:43:48.256 INFO:tasks.workunit.client.0.smithi161.stdout:4/791: mkdir d9/de/d1e/d58/d60/d9c/dc7/df0 0 2024-01-17T23:43:48.256 INFO:tasks.workunit.client.0.smithi161.stdout:4/792: creat d9/d27/d3a/d8b/ff1 x:0 0 0 2024-01-17T23:43:48.614 INFO:tasks.workunit.client.0.smithi161.stdout:3/756: rename d0/d5/d9/d1e/l27 to d0/d5/d9/d1e/lf9 0 2024-01-17T23:43:48.625 INFO:tasks.workunit.client.0.smithi161.stdout:8/706: sync 2024-01-17T23:43:48.628 INFO:tasks.workunit.client.0.smithi161.stdout:3/757: write d0/d5/d9/f64 [6145153,1951] 0 2024-01-17T23:43:48.954 INFO:tasks.workunit.client.0.smithi161.stdout:6/694: sync 2024-01-17T23:43:48.956 INFO:tasks.workunit.client.0.smithi161.stdout:1/793: dread d1/f18 [4194304,4194304] 0 2024-01-17T23:43:49.203 INFO:tasks.workunit.client.0.smithi161.stdout:9/619: rmdir d0/d8/d14/d56 39 2024-01-17T23:43:49.802 INFO:tasks.workunit.client.0.smithi161.stdout:2/712: mknod d8/d67/d6c/d72/cfb 0 2024-01-17T23:43:50.102 INFO:tasks.workunit.client.0.smithi161.stdout:8/707: symlink d1/df/d16/lf4 0 2024-01-17T23:43:50.102 INFO:tasks.workunit.client.0.smithi161.stdout:3/758: mknod d0/d5/d9/cfa 0 2024-01-17T23:43:50.102 INFO:tasks.workunit.client.0.smithi161.stdout:6/695: symlink d6/d7/dc/d3c/ddd/de3/lf5 0 2024-01-17T23:43:50.134 INFO:tasks.workunit.client.0.smithi161.stdout:1/794: dread d1/d8/d1c/d3e/f92 [0,4194304] 0 2024-01-17T23:43:50.403 INFO:tasks.workunit.client.0.smithi161.stdout:2/713: symlink d8/da/d8d/lfc 0 2024-01-17T23:43:50.475 INFO:tasks.workunit.client.0.smithi161.stdout:8/708: symlink d1/df/d16/d8c/lf5 0 2024-01-17T23:43:50.722 INFO:tasks.workunit.client.0.smithi161.stdout:6/696: mknod d6/d7/dc/d85/d1a/d59/d8e/cf6 0 2024-01-17T23:43:50.738 INFO:tasks.workunit.client.0.smithi161.stdout:6/697: write d6/d7/dc/d43/f74 [2294323,22353] 0 2024-01-17T23:43:50.876 INFO:tasks.workunit.client.0.smithi161.stdout:9/620: getdents d0/d8/d14/d18/d20/da2 0 2024-01-17T23:43:50.979 INFO:tasks.workunit.client.0.smithi161.stdout:1/795: mknod d1/d8/dfb/cfe 0 2024-01-17T23:43:50.981 INFO:tasks.workunit.client.0.smithi161.stdout:1/796: read d1/d2d/fc5 [55459,127157] 0 2024-01-17T23:43:51.099 INFO:tasks.workunit.client.0.smithi161.stdout:2/714: symlink d8/db8/lfd 0 2024-01-17T23:43:51.121 INFO:tasks.workunit.client.0.smithi161.stdout:2/715: dread d8/f37 [0,4194304] 0 2024-01-17T23:43:51.290 INFO:tasks.workunit.client.0.smithi161.stdout:8/709: getdents d1/df 0 2024-01-17T23:43:51.717 INFO:tasks.workunit.client.0.smithi161.stdout:6/698: creat d6/d7/dc/d43/dc3/d90/ff7 x:0 0 0 2024-01-17T23:43:51.766 INFO:tasks.workunit.client.0.smithi161.stdout:5/691: sync 2024-01-17T23:43:51.766 INFO:tasks.workunit.client.0.smithi161.stdout:5/692: write dd/d15/d6a/fc0 [7320,120662] 0 2024-01-17T23:43:51.793 INFO:tasks.workunit.client.0.smithi161.stdout:5/693: dwrite dd/d15/d1a/f43 [0,4194304] 0 2024-01-17T23:43:51.998 INFO:tasks.workunit.client.0.smithi161.stdout:1/797: mkdir d1/d20/d26/d30/d8f/dff 0 2024-01-17T23:43:51.998 INFO:tasks.workunit.client.0.smithi161.stdout:1/798: truncate d1/d11/d72/d81/f82 4653752 0 2024-01-17T23:43:51.999 INFO:tasks.workunit.client.0.smithi161.stdout:1/799: readlink d1/d11/d72/la8 0 2024-01-17T23:43:52.081 INFO:tasks.workunit.client.0.smithi161.stdout:8/710: creat d1/d22/d2f/dd6/ff6 x:0 0 0 2024-01-17T23:43:52.081 INFO:tasks.workunit.client.0.smithi161.stdout:8/711: fdatasync d1/d22/dbd/dce/ff1 0 2024-01-17T23:43:52.353 INFO:tasks.workunit.client.0.smithi161.stdout:9/621: getdents d0/d8/d31/d73 0 2024-01-17T23:43:52.353 INFO:tasks.workunit.client.0.smithi161.stdout:9/622: chown d0/d8/d14/dab/fb7 30595085 1 2024-01-17T23:43:52.561 INFO:tasks.workunit.client.0.smithi161.stdout:5/694: unlink dd/d15/d1a/d5d/d64/fcc 0 2024-01-17T23:43:52.561 INFO:tasks.workunit.client.0.smithi161.stdout:5/695: dread - dd/d15/d4e/d4f/d77/fca zero size 2024-01-17T23:43:52.561 INFO:tasks.workunit.client.0.smithi161.stdout:5/696: fsync dd/d31/d3c/f60 0 2024-01-17T23:43:52.561 INFO:tasks.workunit.client.0.smithi161.stdout:5/697: truncate dd/d15/d51/fb4 370562 0 2024-01-17T23:43:52.561 INFO:tasks.workunit.client.0.smithi161.stdout:5/698: chown dd/d15/d4e/d4f/d77 107540 1 2024-01-17T23:43:52.723 INFO:tasks.workunit.client.0.smithi161.stdout:1/800: mkdir d1/d8/dfb/d100 0 2024-01-17T23:43:52.723 INFO:tasks.workunit.client.0.smithi161.stdout:1/801: chown d1/lc0 842 1 2024-01-17T23:43:53.188 INFO:tasks.workunit.client.0.smithi161.stdout:8/712: getdents d1/d1c 0 2024-01-17T23:43:53.188 INFO:tasks.workunit.client.0.smithi161.stdout:9/623: creat d0/d8/d14/d56/fd1 x:0 0 0 2024-01-17T23:43:53.210 INFO:tasks.workunit.client.0.smithi161.stdout:8/713: read d1/df/d20/d6a/f6d [3368694,18833] 0 2024-01-17T23:43:53.210 INFO:tasks.workunit.client.0.smithi161.stdout:8/714: chown d1/d55/c66 1432 1 2024-01-17T23:43:53.217 INFO:tasks.workunit.client.0.smithi161.stdout:8/715: read d1/d3/d19/f87 [574438,12896] 0 2024-01-17T23:43:53.217 INFO:tasks.workunit.client.0.smithi161.stdout:8/716: read - d1/fa4 zero size 2024-01-17T23:43:53.217 INFO:tasks.workunit.client.0.smithi161.stdout:8/717: creat d1/d22/dbd/dce/ff7 x:0 0 0 2024-01-17T23:43:53.242 INFO:tasks.workunit.client.0.smithi161.stdout:8/718: dwrite d1/d88/f90 [0,4194304] 0 2024-01-17T23:43:53.242 INFO:tasks.workunit.client.0.smithi161.stdout:8/719: dread - d1/df/d16/f2d zero size 2024-01-17T23:43:53.242 INFO:tasks.workunit.client.0.smithi161.stdout:8/720: readlink d1/df/l6f 0 2024-01-17T23:43:53.267 INFO:tasks.workunit.client.0.smithi161.stdout:8/721: dwrite d1/d3/f5b [0,4194304] 0 2024-01-17T23:43:53.494 INFO:tasks.workunit.client.0.smithi161.stdout:1/802: creat d1/d20/d26/d30/d8f/dff/f101 x:0 0 0 2024-01-17T23:43:53.494 INFO:tasks.workunit.client.0.smithi161.stdout:1/803: readlink d1/l40 0 2024-01-17T23:43:53.494 INFO:tasks.workunit.client.0.smithi161.stdout:1/804: stat d1 0 2024-01-17T23:43:53.701 INFO:tasks.workunit.client.0.smithi161.stdout:9/624: chown d0/d8/c17 17175669 1 2024-01-17T23:43:53.941 INFO:tasks.workunit.client.0.smithi161.stdout:4/793: dwrite d9/d1b/f3b [0,4194304] 0 2024-01-17T23:43:53.941 INFO:tasks.workunit.client.0.smithi161.stdout:4/794: truncate d9/d51/fca 129012 0 2024-01-17T23:43:54.186 INFO:tasks.workunit.client.0.smithi161.stdout:0/770: write d5/d34/d21/f3d [1710044,40151] 0 2024-01-17T23:43:54.186 INFO:tasks.workunit.client.0.smithi161.stdout:8/722: mknod d1/df/d20/d2a/cf8 0 2024-01-17T23:43:54.394 INFO:tasks.workunit.client.0.smithi161.stdout:7/730: rename da/d34/d5a/d3b to da/d34/d5a/da0/df8 0 2024-01-17T23:43:54.394 INFO:tasks.workunit.client.0.smithi161.stdout:7/731: dread - da/d34/d5a/d28/fce zero size 2024-01-17T23:43:54.394 INFO:tasks.workunit.client.0.smithi161.stdout:7/732: creat da/d14/d35/d41/ff9 x:0 0 0 2024-01-17T23:43:54.408 INFO:tasks.workunit.client.0.smithi161.stdout:7/733: write da/db/d7a/dc0/ff5 [843035,32482] 0 2024-01-17T23:43:54.408 INFO:tasks.workunit.client.0.smithi161.stdout:7/734: chown da/db/d7a/d8f/dac/da9/fbb 8069 1 2024-01-17T23:43:54.560 INFO:tasks.workunit.client.0.smithi161.stdout:5/699: getdents dd/d15/d1a/d34 0 2024-01-17T23:43:54.561 INFO:tasks.workunit.client.0.smithi161.stdout:5/700: chown dd/d15/d4e/fd3 1 1 2024-01-17T23:43:54.561 INFO:tasks.workunit.client.0.smithi161.stdout:5/701: fsync dd/f12 0 2024-01-17T23:43:54.805 INFO:tasks.workunit.client.0.smithi161.stdout:9/625: creat d0/d39/d49/d6e/fd2 x:0 0 0 2024-01-17T23:43:55.031 INFO:tasks.workunit.client.0.smithi161.stdout:3/759: write d0/d5/d9/d38/db3/fdd [91835,106714] 0 2024-01-17T23:43:55.072 INFO:tasks.workunit.client.0.smithi161.stdout:0/771: write d5/d3a/f43 [316422,112448] 0 2024-01-17T23:43:55.072 INFO:tasks.workunit.client.0.smithi161.stdout:0/772: dread - d5/d34/d21/d76/f87 zero size 2024-01-17T23:43:55.174 INFO:tasks.workunit.client.0.smithi161.stdout:8/723: mkdir d1/d3/d19/d1d/df9 0 2024-01-17T23:43:55.210 INFO:tasks.workunit.client.0.smithi161.stdout:8/724: dwrite d1/d22/d2f/d92/fa7 [4194304,4194304] 0 2024-01-17T23:43:55.210 INFO:tasks.workunit.client.0.smithi161.stdout:8/725: truncate d1/df/d20/d6a/fea 460618 0 2024-01-17T23:43:55.584 INFO:tasks.workunit.client.0.smithi161.stdout:2/716: rename d8/da/ce3 to d8/db8/dc9/cfe 0 2024-01-17T23:43:55.607 INFO:tasks.workunit.client.0.smithi161.stdout:2/717: dread d8/d1c/d1e/f2a [0,4194304] 0 2024-01-17T23:43:55.694 INFO:tasks.workunit.client.0.smithi161.stdout:7/735: symlink da/d34/d5a/da0/df8/d3d/d82/db0/lfa 0 2024-01-17T23:43:55.694 INFO:tasks.workunit.client.0.smithi161.stdout:7/736: chown da/d34/d4a/ce3 57664 1 2024-01-17T23:43:55.877 INFO:tasks.workunit.client.0.smithi161.stdout:9/626: fdatasync d0/d8/fa0 0 2024-01-17T23:43:56.003 INFO:tasks.workunit.client.0.smithi161.stdout:4/795: mknod d9/d51/cf2 0 2024-01-17T23:43:56.003 INFO:tasks.workunit.client.0.smithi161.stdout:4/796: write d9/de/d1e/d58/f72 [2442325,72902] 0 2024-01-17T23:43:56.113 INFO:tasks.workunit.client.0.smithi161.stdout:3/760: creat d0/d5/d9/d38/d4f/ffb x:0 0 0 2024-01-17T23:43:56.113 INFO:tasks.workunit.client.0.smithi161.stdout:3/761: creat d0/d5/d9/d38/d4f/d50/ffc x:0 0 0 2024-01-17T23:43:56.113 INFO:tasks.workunit.client.0.smithi161.stdout:3/762: creat d0/d5/d9/d17/d32/ffd x:0 0 0 2024-01-17T23:43:56.113 INFO:tasks.workunit.client.0.smithi161.stdout:3/763: stat d0/d5/d9/d17/d2d/c58 0 2024-01-17T23:43:56.360 INFO:tasks.workunit.client.0.smithi161.stdout:0/773: rmdir d5/d8/d68/d6b/d89 39 2024-01-17T23:43:56.493 INFO:tasks.workunit.client.0.smithi161.stdout:8/726: truncate d1/d3/d19/f21 983845 0 2024-01-17T23:43:56.493 INFO:tasks.workunit.client.0.smithi161.stdout:8/727: fdatasync d1/df/d46/d89/fb8 0 2024-01-17T23:43:56.712 INFO:tasks.workunit.client.0.smithi161.stdout:2/718: symlink d8/d1c/d1e/d80/lff 0 2024-01-17T23:43:56.728 INFO:tasks.workunit.client.0.smithi161.stdout:2/719: dread d8/f37 [0,4194304] 0 2024-01-17T23:43:56.728 INFO:tasks.workunit.client.0.smithi161.stdout:2/720: dread - d8/db8/ff0 zero size 2024-01-17T23:43:56.729 INFO:tasks.workunit.client.0.smithi161.stdout:2/721: stat d8/d1c/d75/dae/de4/d84/ce6 0 2024-01-17T23:43:56.729 INFO:tasks.workunit.client.0.smithi161.stdout:2/722: creat d8/db8/dc9/f100 x:0 0 0 2024-01-17T23:43:57.100 INFO:tasks.workunit.client.0.smithi161.stdout:7/737: mkdir da/db/dfb 0 2024-01-17T23:43:57.100 INFO:tasks.workunit.client.0.smithi161.stdout:5/702: truncate dd/d15/d1a/d5d/d64/fb2 352683 0 2024-01-17T23:43:57.125 INFO:tasks.workunit.client.0.smithi161.stdout:5/703: write dd/d15/d1a/d5d/d64/d7c/fd4 [552079,84245] 0 2024-01-17T23:43:57.208 INFO:tasks.workunit.client.0.smithi161.stdout:9/627: mknod d0/d8/d31/d73/cd3 0 2024-01-17T23:43:57.208 INFO:tasks.workunit.client.0.smithi161.stdout:6/699: write d6/d7/dc/d85/fc0 [2542110,126602] 0 2024-01-17T23:43:57.208 INFO:tasks.workunit.client.0.smithi161.stdout:6/700: write d6/d7/dc/d43/dc3/d90/ff7 [674590,93358] 0 2024-01-17T23:43:57.306 INFO:tasks.workunit.client.0.smithi161.stdout:4/797: mknod d9/de/d69/cf3 0 2024-01-17T23:43:57.717 INFO:tasks.workunit.client.0.smithi161.stdout:3/764: unlink d0/d5/d9/d1e/l3f 0 2024-01-17T23:43:57.740 INFO:tasks.workunit.client.0.smithi161.stdout:3/765: dwrite d0/d5/d9/d38/d4f/da5/fb6 [0,4194304] 0 2024-01-17T23:43:57.798 INFO:tasks.workunit.client.0.smithi161.stdout:0/774: mkdir d5/d34/d8a/df2 0 2024-01-17T23:43:57.967 INFO:tasks.workunit.client.0.smithi161.stdout:8/728: symlink d1/df/d16/dbf/lfa 0 2024-01-17T23:43:58.225 INFO:tasks.workunit.client.0.smithi161.stdout:2/723: unlink d8/da/ce9 0 2024-01-17T23:43:58.259 INFO:tasks.workunit.client.0.smithi161.stdout:2/724: dwrite d8/da/f58 [0,4194304] 0 2024-01-17T23:43:58.260 INFO:tasks.workunit.client.0.smithi161.stdout:2/725: truncate d8/d67/ff4 395843 0 2024-01-17T23:43:58.346 INFO:tasks.workunit.client.0.smithi161.stdout:7/738: truncate da/da7/fbe 866631 0 2024-01-17T23:43:58.346 INFO:tasks.workunit.client.0.smithi161.stdout:7/739: readlink da/d34/d5a/ld3 0 2024-01-17T23:43:58.347 INFO:tasks.workunit.client.0.smithi161.stdout:7/740: chown da/d34/d5a/d68/c80 218 1 2024-01-17T23:43:58.559 INFO:tasks.workunit.client.0.smithi161.stdout:5/704: truncate dd/d15/f2e 1884472 0 2024-01-17T23:43:58.559 INFO:tasks.workunit.client.0.smithi161.stdout:5/705: chown dd/d31/d56/c6c 0 1 2024-01-17T23:43:58.820 INFO:tasks.workunit.client.0.smithi161.stdout:6/701: truncate d6/d7/dc/d43/f60 802346 0 2024-01-17T23:43:58.833 INFO:tasks.workunit.client.0.smithi161.stdout:6/702: write d6/d7/dc/d85/f98 [1090058,121137] 0 2024-01-17T23:43:58.833 INFO:tasks.workunit.client.0.smithi161.stdout:6/703: chown d6/d7/dc/d85/d13/f37 380574119 1 2024-01-17T23:43:58.853 INFO:tasks.workunit.client.0.smithi161.stdout:6/704: dread d6/d7/dc/d85/d31/f97 [0,4194304] 0 2024-01-17T23:43:58.930 INFO:tasks.workunit.client.0.smithi161.stdout:4/798: mknod d9/de/d1e/d58/d60/d9c/cf4 0 2024-01-17T23:43:58.930 INFO:tasks.workunit.client.0.smithi161.stdout:4/799: read - d9/d1b/d24/d25/d5b/fb7 zero size 2024-01-17T23:43:59.351 INFO:tasks.workunit.client.0.smithi161.stdout:1/805: write d1/d20/d26/d30/d44/fa2 [1432590,5977] 0 2024-01-17T23:43:59.351 INFO:tasks.workunit.client.0.smithi161.stdout:1/806: chown d1/ff6 2 1 2024-01-17T23:43:59.360 INFO:tasks.workunit.client.0.smithi161.stdout:1/807: dread d1/d20/f2e [0,4194304] 0 2024-01-17T23:43:59.665 INFO:tasks.workunit.client.0.smithi161.stdout:3/766: write d0/d5/d9/d17/f37 [1141764,48005] 0 2024-01-17T23:43:59.665 INFO:tasks.workunit.client.0.smithi161.stdout:3/767: write d0/d5/d9/d17/d32/ffd [581178,129979] 0 2024-01-17T23:43:59.665 INFO:tasks.workunit.client.0.smithi161.stdout:3/768: read d0/d5/d9/d17/d2d/f93 [4472391,11392] 0 2024-01-17T23:43:59.665 INFO:tasks.workunit.client.0.smithi161.stdout:3/769: write d0/d5/d9/d8b/ff3 [438277,92457] 0 2024-01-17T23:43:59.665 INFO:tasks.workunit.client.0.smithi161.stdout:3/770: chown d0/d5/d9/d1e/d3b/df4 0 1 2024-01-17T23:43:59.665 INFO:tasks.workunit.client.0.smithi161.stdout:3/771: chown d0/d5/d9/d17/d32/fb1 309413 1 2024-01-17T23:43:59.696 INFO:tasks.workunit.client.0.smithi161.stdout:3/772: dwrite d0/d5/fa [0,4194304] 0 2024-01-17T23:43:59.733 INFO:tasks.workunit.client.0.smithi161.stdout:3/773: dwrite d0/d5/d9/d38/d4f/d9d/dca/fe6 [4194304,4194304] 0 2024-01-17T23:43:59.739 INFO:tasks.workunit.client.0.smithi161.stdout:3/774: write d0/d5/d9/d17/d2d/fd6 [12286,62995] 0 2024-01-17T23:44:00.019 INFO:tasks.workunit.client.0.smithi161.stdout:8/729: symlink d1/df/d13/db1/lfb 0 2024-01-17T23:44:00.019 INFO:tasks.workunit.client.0.smithi161.stdout:8/730: stat d1/df/d20/c54 0 2024-01-17T23:44:00.043 INFO:tasks.workunit.client.0.smithi161.stdout:8/731: dwrite d1/d22/d2f/f7a [0,4194304] 0 2024-01-17T23:44:00.073 INFO:tasks.workunit.client.0.smithi161.stdout:8/732: dwrite d1/d3/f5b [0,4194304] 0 2024-01-17T23:44:00.302 INFO:tasks.workunit.client.0.smithi161.stdout:2/726: truncate d8/d1c/d1e/da6/d35/d3a/f71 729692 0 2024-01-17T23:44:00.302 INFO:tasks.workunit.client.0.smithi161.stdout:7/741: symlink da/db/db2/lfc 0 2024-01-17T23:44:00.302 INFO:tasks.workunit.client.0.smithi161.stdout:2/727: write d8/f14 [2340637,85466] 0 2024-01-17T23:44:00.302 INFO:tasks.workunit.client.0.smithi161.stdout:2/728: read d8/f14 [342279,23994] 0 2024-01-17T23:44:00.302 INFO:tasks.workunit.client.0.smithi161.stdout:2/729: write d8/da/f58 [4835660,16035] 0 2024-01-17T23:44:00.395 INFO:tasks.workunit.client.0.smithi161.stdout:9/628: getdents d0/d8/d14/d56 0 2024-01-17T23:44:00.397 INFO:tasks.workunit.client.0.smithi161.stdout:5/706: dread dd/d15/d1a/d5d/dc9/fd8 [0,4194304] 0 2024-01-17T23:44:00.575 INFO:tasks.workunit.client.0.smithi161.stdout:1/808: mknod d1/d2d/dc1/c102 0 2024-01-17T23:44:00.575 INFO:tasks.workunit.client.0.smithi161.stdout:3/775: truncate d0/d5/d9/d17/d32/f4a 1570380 0 2024-01-17T23:44:00.589 INFO:tasks.workunit.client.0.smithi161.stdout:3/776: dread d0/da2/fe7 [0,4194304] 0 2024-01-17T23:44:00.589 INFO:tasks.workunit.client.0.smithi161.stdout:3/777: fdatasync d0/d5/d9/d1e/d3b/d52/f67 0 2024-01-17T23:44:00.597 INFO:tasks.workunit.client.0.smithi161.stdout:4/800: dread d9/d27/d3a/d87/fa3 [0,4194304] 0 2024-01-17T23:44:00.618 INFO:tasks.workunit.client.0.smithi161.stdout:0/775: mkdir d5/d3a/deb/df3 0 2024-01-17T23:44:01.092 INFO:tasks.workunit.client.0.smithi161.stdout:8/733: truncate d1/d3/d19/d1d/d25/d4b/fd3 653637 0 2024-01-17T23:44:01.316 INFO:tasks.workunit.client.0.smithi161.stdout:7/742: symlink da/d34/d5a/d68/d8c/lfd 0 2024-01-17T23:44:01.712 INFO:tasks.workunit.client.0.smithi161.stdout:2/730: creat d8/d67/d6c/dce/f101 x:0 0 0 2024-01-17T23:44:01.717 INFO:tasks.workunit.client.0.smithi161.stdout:2/731: dread d8/d1c/d1e/f6f [0,4194304] 0 2024-01-17T23:44:01.717 INFO:tasks.workunit.client.0.smithi161.stdout:2/732: write d8/d1c/d1e/fca [2590269,58870] 0 2024-01-17T23:44:01.732 INFO:tasks.workunit.client.0.smithi161.stdout:2/733: dread d8/d1c/d75/dae/de4/fb2 [0,4194304] 0 2024-01-17T23:44:01.732 INFO:tasks.workunit.client.0.smithi161.stdout:2/734: fdatasync d8/d1c/f49 0 2024-01-17T23:44:01.973 INFO:tasks.workunit.client.0.smithi161.stdout:9/629: symlink d0/d8/d14/d18/ld4 0 2024-01-17T23:44:02.371 INFO:tasks.workunit.client.0.smithi161.stdout:1/809: read d1/d20/d26/d30/f5f [387892,57635] 0 2024-01-17T23:44:02.532 INFO:tasks.workunit.client.0.smithi161.stdout:3/778: link d0/d5/fa d0/d5/d9/d38/db3/db4/ffe 0 2024-01-17T23:44:02.532 INFO:tasks.workunit.client.0.smithi161.stdout:3/779: chown d0/d5/d9/d38/d4f/d50/l8f 5466466 1 2024-01-17T23:44:02.557 INFO:tasks.workunit.client.0.smithi161.stdout:3/780: read d0/d5/d9/d8b/fc4 [3679491,122732] 0 2024-01-17T23:44:02.583 INFO:tasks.workunit.client.0.smithi161.stdout:3/781: dwrite d0/d5/d9/d1e/d5a/d8a/f92 [0,4194304] 0 2024-01-17T23:44:02.801 INFO:tasks.workunit.client.0.smithi161.stdout:4/801: creat d9/de/d1e/d58/d60/d9c/dc7/ff5 x:0 0 0 2024-01-17T23:44:02.974 INFO:tasks.workunit.client.0.smithi161.stdout:0/776: rename d5/d34/d20/c86 to d5/d34/cf4 0 2024-01-17T23:44:02.974 INFO:tasks.workunit.client.0.smithi161.stdout:0/777: creat d5/d34/d8a/ff5 x:0 0 0 2024-01-17T23:44:02.994 INFO:tasks.workunit.client.0.smithi161.stdout:0/778: dread d5/d34/d20/d2b/fd9 [0,4194304] 0 2024-01-17T23:44:03.021 INFO:tasks.workunit.client.0.smithi161.stdout:0/779: dwrite d5/d8/d68/db0/fd3 [0,4194304] 0 2024-01-17T23:44:03.021 INFO:tasks.workunit.client.0.smithi161.stdout:0/780: stat d5/d8/d68/db0/dcc/fdc 0 2024-01-17T23:44:03.021 INFO:tasks.workunit.client.0.smithi161.stdout:0/781: chown d5/d34/d21/d76/fae 55555 1 2024-01-17T23:44:03.090 INFO:tasks.workunit.client.0.smithi161.stdout:8/734: mknod d1/d22/d2f/d86/cfc 0 2024-01-17T23:44:03.184 INFO:tasks.workunit.client.0.smithi161.stdout:2/735: mknod d8/da/c102 0 2024-01-17T23:44:03.188 INFO:tasks.workunit.client.0.smithi161.stdout:2/736: dread d8/d1c/d1e/f6f [0,4194304] 0 2024-01-17T23:44:03.296 INFO:tasks.workunit.client.0.smithi161.stdout:9/630: mkdir d0/d8/d14/d87/d9b/dd5 0 2024-01-17T23:44:03.696 INFO:tasks.workunit.client.0.smithi161.stdout:1/810: mkdir d1/d8/d1f/d4b/d103 0 2024-01-17T23:44:03.696 INFO:tasks.workunit.client.0.smithi161.stdout:1/811: write d1/d20/f2e [8119715,106382] 0 2024-01-17T23:44:03.696 INFO:tasks.workunit.client.0.smithi161.stdout:1/812: stat d1/l4c 0 2024-01-17T23:44:03.732 INFO:tasks.workunit.client.0.smithi161.stdout:1/813: dwrite d1/d20/d26/d30/d41/f9c [4194304,4194304] 0 2024-01-17T23:44:03.946 INFO:tasks.workunit.client.0.smithi161.stdout:4/802: unlink d9/d1b/l37 0 2024-01-17T23:44:03.946 INFO:tasks.workunit.client.0.smithi161.stdout:4/803: fdatasync d9/d27/d68/fdf 0 2024-01-17T23:44:04.782 INFO:tasks.workunit.client.0.smithi161.stdout:7/743: rename da/d34/d4a/d4c/f6e to da/db/db2/dbc/ffe 0 2024-01-17T23:44:04.782 INFO:tasks.workunit.client.0.smithi161.stdout:7/744: chown da/d34/d5a/d28/c72 423140169 1 2024-01-17T23:44:05.212 INFO:tasks.workunit.client.0.smithi161.stdout:8/735: unlink d1/d22/d2f/d86/c8e 0 2024-01-17T23:44:05.212 INFO:tasks.workunit.client.0.smithi161.stdout:8/736: write d1/df/d46/d89/fb8 [66431,116439] 0 2024-01-17T23:44:05.305 INFO:tasks.workunit.client.0.smithi161.stdout:2/737: symlink d8/db8/dc9/l103 0 2024-01-17T23:44:05.370 INFO:tasks.workunit.client.0.smithi161.stdout:9/631: mkdir d0/d8/d14/d87/dd6 0 2024-01-17T23:44:05.370 INFO:tasks.workunit.client.0.smithi161.stdout:9/632: fsync d0/d8/d31/fcd 0 2024-01-17T23:44:05.837 INFO:tasks.workunit.client.0.smithi161.stdout:4/804: link d9/de/cc0 d9/d51/d64/dc4/de1/cf6 0 2024-01-17T23:44:05.883 INFO:tasks.workunit.client.0.smithi161.stdout:6/705: dwrite d6/d7/dc/f5b [0,4194304] 0 2024-01-17T23:44:05.886 INFO:tasks.workunit.client.0.smithi161.stdout:4/805: dwrite d9/de/d1e/d58/d60/d9c/fae [0,4194304] 0 2024-01-17T23:44:05.912 INFO:tasks.workunit.client.0.smithi161.stdout:4/806: dwrite d9/de/d1e/d38/f48 [0,4194304] 0 2024-01-17T23:44:06.190 INFO:tasks.workunit.client.0.smithi161.stdout:7/745: truncate da/fc 7172009 0 2024-01-17T23:44:06.191 INFO:tasks.workunit.client.0.smithi161.stdout:7/746: chown da/db/d7a/d8f/dac/da9 203649 1 2024-01-17T23:44:06.315 INFO:tasks.workunit.client.0.smithi161.stdout:8/737: truncate d1/d22/d2f/f3f 3824327 0 2024-01-17T23:44:06.387 INFO:tasks.workunit.client.0.smithi161.stdout:2/738: stat d8/d1c/d1e/da6/cd8 0 2024-01-17T23:44:06.706 INFO:tasks.workunit.client.0.smithi161.stdout:6/706: rename d6/d58/ca0 to d6/d7/dc/d85/d1a/dd0/cf8 0 2024-01-17T23:44:07.116 INFO:tasks.workunit.client.0.smithi161.stdout:4/807: mkdir d9/de/d1e/d58/d60/d8f/df7 0 2024-01-17T23:44:07.657 INFO:tasks.workunit.client.0.smithi161.stdout:7/747: creat da/d34/d5a/da0/df8/d3d/d82/db0/fff x:0 0 0 2024-01-17T23:44:07.853 INFO:tasks.workunit.client.0.smithi161.stdout:8/738: mknod d1/df/d16/dbf/cfd 0 2024-01-17T23:44:07.853 INFO:tasks.workunit.client.0.smithi161.stdout:8/739: chown d1/df/d16/d8c 18 1 2024-01-17T23:44:07.943 INFO:tasks.workunit.client.0.smithi161.stdout:2/739: creat d8/d1c/d1e/da6/d35/f104 x:0 0 0 2024-01-17T23:44:08.755 INFO:tasks.workunit.client.0.smithi161.stdout:8/740: creat d1/d3d/dc7/ffe x:0 0 0 2024-01-17T23:44:08.756 INFO:tasks.workunit.client.0.smithi161.stdout:8/741: chown d1/df/d16/lf4 54480411 1 2024-01-17T23:44:09.183 INFO:tasks.workunit.client.0.smithi161.stdout:8/742: mkdir d1/d3d/dff 0 2024-01-17T23:44:09.183 INFO:tasks.workunit.client.0.smithi161.stdout:8/743: chown d1/d22/d2f/dd6/ff6 2539055 1 2024-01-17T23:44:09.213 INFO:tasks.workunit.client.0.smithi161.stdout:8/744: dwrite d1/d3/d19/d1d/d25/f3b [0,4194304] 0 2024-01-17T23:44:09.216 INFO:tasks.workunit.client.0.smithi161.stdout:8/745: dread d1/df/d20/d6a/fea [0,4194304] 0 2024-01-17T23:44:09.216 INFO:tasks.workunit.client.0.smithi161.stdout:8/746: chown d1/df/d13/c79 1979571 1 2024-01-17T23:44:09.656 INFO:tasks.workunit.client.0.smithi161.stdout:8/747: symlink d1/d3/d19/d1d/df3/l100 0 2024-01-17T23:44:09.906 INFO:tasks.workunit.client.0.smithi161.stdout:8/748: mknod d1/d3/d19/d1d/daa/c101 0 2024-01-17T23:44:10.120 INFO:tasks.workunit.client.0.smithi161.stdout:2/740: truncate d8/f14 2777567 0 2024-01-17T23:44:10.120 INFO:tasks.workunit.client.0.smithi161.stdout:2/741: stat d8/d1c/d1e/d80/led 0 2024-01-17T23:44:10.160 INFO:tasks.workunit.client.0.smithi161.stdout:3/782: dwrite d0/d5/f81 [0,4194304] 0 2024-01-17T23:44:10.160 INFO:tasks.workunit.client.0.smithi161.stdout:3/783: readlink d0/d5/l25 0 2024-01-17T23:44:10.270 INFO:tasks.workunit.client.0.smithi161.stdout:8/749: symlink d1/d55/l102 0 2024-01-17T23:44:10.270 INFO:tasks.workunit.client.0.smithi161.stdout:8/750: readlink d1/d3/d19/d1d/df3/l100 0 2024-01-17T23:44:10.270 INFO:tasks.workunit.client.0.smithi161.stdout:8/751: read - d1/df/d20/d2a/d56/fec zero size 2024-01-17T23:44:10.296 INFO:tasks.workunit.client.0.smithi161.stdout:8/752: dwrite d1/df/d16/f2d [0,4194304] 0 2024-01-17T23:44:10.695 INFO:tasks.workunit.client.0.smithi161.stdout:2/742: unlink d8/db8/dc9/fea 0 2024-01-17T23:44:10.778 INFO:tasks.workunit.client.0.smithi161.stdout:3/784: unlink d0/d5/d9/d1e/d5a/la9 0 2024-01-17T23:44:11.070 INFO:tasks.workunit.client.0.smithi161.stdout:8/753: symlink d1/d22/dbd/l103 0 2024-01-17T23:44:11.220 INFO:tasks.workunit.client.0.smithi161.stdout:2/743: link d8/d1c/d1e/da6/fdf d8/d67/dbc/f105 0 2024-01-17T23:44:11.221 INFO:tasks.workunit.client.0.smithi161.stdout:2/744: fsync d8/d1c/d75/dae/dc3/fb1 0 2024-01-17T23:44:11.326 INFO:tasks.workunit.client.0.smithi161.stdout:0/782: write d5/d34/d20/d2b/f91 [846839,62792] 0 2024-01-17T23:44:11.326 INFO:tasks.workunit.client.0.smithi161.stdout:0/783: truncate d5/d34/d20/fe8 397407 0 2024-01-17T23:44:11.326 INFO:tasks.workunit.client.0.smithi161.stdout:0/784: dread - d5/d34/d21/d76/f87 zero size 2024-01-17T23:44:11.326 INFO:tasks.workunit.client.0.smithi161.stdout:0/785: write d5/d34/f23 [726644,94048] 0 2024-01-17T23:44:11.326 INFO:tasks.workunit.client.0.smithi161.stdout:0/786: fsync d5/d34/d21/d76/f79 0 2024-01-17T23:44:11.628 INFO:tasks.workunit.client.0.smithi161.stdout:2/745: creat d8/d1c/d75/dc7/de5/f106 x:0 0 0 2024-01-17T23:44:11.628 INFO:tasks.workunit.client.0.smithi161.stdout:2/746: write d8/d1c/d57/f83 [5111286,17945] 0 2024-01-17T23:44:11.670 INFO:tasks.workunit.client.0.smithi161.stdout:3/785: truncate d0/d5/d9/d38/f74 4173266 0 2024-01-17T23:44:11.670 INFO:tasks.workunit.client.0.smithi161.stdout:3/786: creat d0/d5/d9/d1e/d3b/fff x:0 0 0 2024-01-17T23:44:11.692 INFO:tasks.workunit.client.0.smithi161.stdout:3/787: dwrite d0/d5/d9/d17/d32/fec [0,4194304] 0 2024-01-17T23:44:11.826 INFO:tasks.workunit.client.0.smithi161.stdout:0/787: rmdir d5/d3a/deb/dee 39 2024-01-17T23:44:11.842 INFO:tasks.workunit.client.0.smithi161.stdout:0/788: dread d5/d34/d21/d76/fae [0,4194304] 0 2024-01-17T23:44:11.866 INFO:tasks.workunit.client.0.smithi161.stdout:1/814: dwrite d1/d8/d1f/d4b/fa1 [0,4194304] 0 2024-01-17T23:44:12.465 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:44:12.469 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:44:12.499 INFO:tasks.workunit.client.0.smithi161.stdout:0/789: read - d5/d3a/db4/dc1/fed zero size 2024-01-17T23:44:12.500 INFO:tasks.workunit.client.0.smithi161.stdout:0/790: fsync d5/d3a/deb/dee/d35/f8e 0 2024-01-17T23:44:12.500 INFO:tasks.workunit.client.0.smithi161.stdout:0/791: fsync d5/d3a/deb/dee/d35/f82 0 2024-01-17T23:44:12.537 INFO:tasks.workunit.client.0.smithi161.stdout:9/633: write d0/f2a [1438384,103958] 0 2024-01-17T23:44:12.537 INFO:tasks.workunit.client.0.smithi161.stdout:9/634: chown d0/f51 178 1 2024-01-17T23:44:12.538 INFO:tasks.workunit.client.0.smithi161.stdout:9/635: chown d0/d8/d14/d18/d20/d97 9 1 2024-01-17T23:44:12.538 INFO:tasks.workunit.client.0.smithi161.stdout:9/636: truncate d0/d8/d31/f7c 1370933 0 2024-01-17T23:44:12.564 INFO:tasks.workunit.client.0.smithi161.stdout:9/637: dwrite d0/d8/d14/d56/f93 [0,4194304] 0 2024-01-17T23:44:12.664 INFO:tasks.workunit.client.0.smithi161.stdout:1/815: link d1/d11/cee d1/d11/c104 0 2024-01-17T23:44:12.664 INFO:tasks.workunit.client.0.smithi161.stdout:1/816: write d1/d20/d26/d30/d8f/d9e/fd2 [872179,68169] 0 2024-01-17T23:44:12.664 INFO:tasks.workunit.client.0.smithi161.stdout:1/817: write d1/d11/d72/d81/fe8 [736498,91144] 0 2024-01-17T23:44:12.664 INFO:tasks.workunit.client.0.smithi161.stdout:1/818: creat d1/d20/d26/d30/d8f/dff/f105 x:0 0 0 2024-01-17T23:44:13.310 INFO:tasks.workunit.client.0.smithi161.stdout:9/638: mknod d0/d8/d14/d18/d20/da2/dcb/cd7 0 2024-01-17T23:44:13.527 INFO:tasks.workunit.client.0.smithi161.stdout:1/819: creat d1/d64/df2/f106 x:0 0 0 2024-01-17T23:44:13.612 INFO:tasks.workunit.client.0.smithi161.stdout:1/820: mknod d1/d11/d72/c107 0 2024-01-17T23:44:13.612 INFO:tasks.workunit.client.0.smithi161.stdout:1/821: getdents d1/d2d/d3b 0 2024-01-17T23:44:13.631 INFO:tasks.workunit.client.0.smithi161.stdout:1/822: dread d1/d8/d1c/f48 [0,4194304] 0 2024-01-17T23:44:13.632 INFO:tasks.workunit.client.0.smithi161.stdout:1/823: creat d1/d8/d1f/dd3/f108 x:0 0 0 2024-01-17T23:44:14.225 INFO:tasks.workunit.client.0.smithi161.stdout:6/707: dwrite d6/d7/dc/d85/d1a/f62 [0,4194304] 0 2024-01-17T23:44:14.425 INFO:tasks.workunit.client.0.smithi161.stdout:5/707: mknod dd/ce2 0 2024-01-17T23:44:14.532 INFO:tasks.workunit.client.0.smithi161.stdout:6/708: mknod d6/d7/dc/d85/d31/cf9 0 2024-01-17T23:44:14.944 INFO:tasks.workunit.client.0.smithi161.stdout:5/708: symlink dd/d31/d7b/d78/le3 0 2024-01-17T23:44:15.284 INFO:tasks.workunit.client.0.smithi161.stdout:6/709: unlink d6/d7/dc/d43/d79/fa8 0 2024-01-17T23:44:15.284 INFO:tasks.workunit.client.0.smithi161.stdout:6/710: chown d6/d7/dc/dca 0 1 2024-01-17T23:44:15.551 INFO:tasks.workunit.client.0.smithi161.stdout:8/754: dwrite f0 [0,4194304] 0 2024-01-17T23:44:15.551 INFO:tasks.workunit.client.0.smithi161.stdout:8/755: chown d1/d3/l9d 0 1 2024-01-17T23:44:15.809 INFO:tasks.workunit.client.0.smithi161.stdout:5/709: symlink dd/d15/d1a/d42/da4/le4 0 2024-01-17T23:44:16.001 INFO:tasks.workunit.client.0.smithi161.stdout:6/711: unlink d6/d7/dc/d85/d1a/f6a 0 2024-01-17T23:44:16.001 INFO:tasks.workunit.client.0.smithi161.stdout:6/712: stat d6/d7/dc/d85/d13/c7d 0 2024-01-17T23:44:16.749 INFO:tasks.workunit.client.0.smithi161.stdout:1/824: rmdir d1/d2d 39 2024-01-17T23:44:16.749 INFO:tasks.workunit.client.0.smithi161.stdout:1/825: write d1/d20/f2e [3569508,81297] 0 2024-01-17T23:44:16.911 INFO:tasks.workunit.client.0.smithi161.stdout:6/713: mkdir d6/dfa 0 2024-01-17T23:44:17.134 INFO:tasks.workunit.client.0.smithi161.stdout:5/710: rmdir dd/d15/d4e 39 2024-01-17T23:44:17.448 INFO:tasks.workunit.client.0.smithi161.stdout:6/714: readlink d6/d7/dc/l70 0 2024-01-17T23:44:17.684 INFO:tasks.workunit.client.0.smithi161.stdout:6/715: mkdir d6/d7/dc/d85/d13/dfb 0 2024-01-17T23:44:18.090 INFO:tasks.workunit.client.0.smithi161.stdout:7/748: rename l6 to da/db/d7a/l100 0 2024-01-17T23:44:18.090 INFO:tasks.workunit.client.0.smithi161.stdout:7/749: dread - da/d34/d4a/d4c/f94 zero size 2024-01-17T23:44:18.203 INFO:tasks.workunit.client.0.smithi161.stdout:1/826: symlink d1/d8/l109 0 2024-01-17T23:44:18.363 INFO:tasks.workunit.client.0.smithi161.stdout:5/711: getdents dd/d15/d1a/d5d/d64/d67 0 2024-01-17T23:44:18.363 INFO:tasks.workunit.client.0.smithi161.stdout:5/712: truncate dd/f50 463314 0 2024-01-17T23:44:18.423 INFO:tasks.workunit.client.0.smithi161.stdout:6/716: mkdir d6/dfc 0 2024-01-17T23:44:18.736 INFO:tasks.workunit.client.0.smithi161.stdout:2/747: rename d8/d67/cf5 to d8/d67/d6c/dce/c107 0 2024-01-17T23:44:18.743 INFO:tasks.workunit.client.0.smithi161.stdout:8/756: write d1/d3/d19/d1d/d25/d4b/fd3 [149898,128293] 0 2024-01-17T23:44:18.761 INFO:tasks.workunit.client.0.smithi161.stdout:2/748: dwrite d8/d1c/d75/dae/dc3/fb7 [4194304,4194304] 0 2024-01-17T23:44:18.905 INFO:tasks.workunit.client.0.smithi161.stdout:7/750: truncate da/db/d7a/d8f/fd5 303789 0 2024-01-17T23:44:19.024 INFO:tasks.workunit.client.0.smithi161.stdout:5/713: mknod dd/d15/d1a/d5d/dc9/dcb/ce5 0 2024-01-17T23:44:19.024 INFO:tasks.workunit.client.0.smithi161.stdout:1/827: creat d1/d2d/f10a x:0 0 0 2024-01-17T23:44:19.044 INFO:tasks.workunit.client.0.smithi161.stdout:5/714: read dd/d31/db8/fbd [3188078,12127] 0 2024-01-17T23:44:19.746 INFO:tasks.workunit.client.0.smithi161.stdout:8/757: creat d1/df/d20/f104 x:0 0 0 2024-01-17T23:44:19.924 INFO:tasks.workunit.client.0.smithi161.stdout:2/749: mkdir d8/d1c/d75/dae/de4/d108 0 2024-01-17T23:44:19.993 INFO:tasks.workunit.client.0.smithi161.stdout:4/808: rmdir d9/de/d1e/d38 39 2024-01-17T23:44:20.165 INFO:tasks.workunit.client.0.smithi161.stdout:7/751: mkdir da/db/d7a/d8f/dde/d101 0 2024-01-17T23:44:20.165 INFO:tasks.workunit.client.0.smithi161.stdout:1/828: unlink d1/d8/d9d/fdb 0 2024-01-17T23:44:20.191 INFO:tasks.workunit.client.0.smithi161.stdout:7/752: dwrite da/d34/d5a/d68/ff6 [0,4194304] 0 2024-01-17T23:44:20.543 INFO:tasks.workunit.client.0.smithi161.stdout:2/750: unlink d8/d1c/d75/dae/dc3/c41 0 2024-01-17T23:44:20.572 INFO:tasks.workunit.client.0.smithi161.stdout:2/751: dwrite d8/d1c/d1e/da6/d35/fbf [0,4194304] 0 2024-01-17T23:44:20.586 INFO:tasks.workunit.client.0.smithi161.stdout:4/809: creat d9/d1b/d53/d9f/ff8 x:0 0 0 2024-01-17T23:44:20.594 INFO:tasks.workunit.client.0.smithi161.stdout:2/752: dread d8/d1c/f49 [0,4194304] 0 2024-01-17T23:44:20.594 INFO:tasks.workunit.client.0.smithi161.stdout:2/753: creat d8/d1c/d1e/da6/d35/f109 x:0 0 0 2024-01-17T23:44:20.594 INFO:tasks.workunit.client.0.smithi161.stdout:2/754: fdatasync d8/d1c/d75/dae/dc3/fb7 0 2024-01-17T23:44:20.604 INFO:tasks.workunit.client.0.smithi161.stdout:4/810: dread d9/de/f30 [0,4194304] 0 2024-01-17T23:44:20.605 INFO:tasks.workunit.client.0.smithi161.stdout:4/811: dread - d9/de/d69/fb4 zero size 2024-01-17T23:44:21.890 INFO:tasks.workunit.client.0.smithi161.stdout:2/755: creat d8/d1c/d75/dae/de4/f10a x:0 0 0 2024-01-17T23:44:23.756 INFO:tasks.workunit.client.0.smithi161.stdout:2/756: symlink d8/d1c/d1e/d80/l10b 0 2024-01-17T23:44:23.757 INFO:tasks.workunit.client.0.smithi161.stdout:2/757: creat d8/d1c/d57/f10c x:0 0 0 2024-01-17T23:44:23.757 INFO:tasks.workunit.client.0.smithi161.stdout:2/758: chown d8/d1c/d75/dae/dc3/fa1 1146355 1 2024-01-17T23:44:23.757 INFO:tasks.workunit.client.0.smithi161.stdout:2/759: read d8/d1c/f25 [2180281,112186] 0 2024-01-17T23:44:23.762 INFO:tasks.workunit.client.0.smithi161.stdout:6/717: link d6/d7/dc/d85/d13/f37 d6/d7/ffd 0 2024-01-17T23:44:23.765 INFO:tasks.workunit.client.0.smithi161.stdout:5/715: write dd/d15/d51/f6e [142753,75009] 0 2024-01-17T23:44:23.765 INFO:tasks.workunit.client.0.smithi161.stdout:5/716: write dd/d15/f9c [769079,46728] 0 2024-01-17T23:44:23.765 INFO:tasks.workunit.client.0.smithi161.stdout:5/717: write dd/f24 [108608,115037] 0 2024-01-17T23:44:23.765 INFO:tasks.workunit.client.0.smithi161.stdout:5/718: chown dd/d15/d4e/d4f/d77/fc3 101383106 1 2024-01-17T23:44:23.789 INFO:tasks.workunit.client.0.smithi161.stdout:1/829: write d1/d20/d26/d30/f5f [373780,76899] 0 2024-01-17T23:44:23.790 INFO:tasks.workunit.client.0.smithi161.stdout:1/830: creat d1/d8/d1f/d4b/f10b x:0 0 0 2024-01-17T23:44:23.799 INFO:tasks.workunit.client.0.smithi161.stdout:2/760: dwrite d8/d1c/d75/dc7/de5/f106 [0,4194304] 0 2024-01-17T23:44:23.800 INFO:tasks.workunit.client.0.smithi161.stdout:7/753: write da/d34/d4a/d4c/f70 [434304,109230] 0 2024-01-17T23:44:23.806 INFO:tasks.workunit.client.0.smithi161.stdout:8/758: write d1/d3/d19/d1d/d25/f39 [468471,63699] 0 2024-01-17T23:44:23.806 INFO:tasks.workunit.client.0.smithi161.stdout:8/759: dread - d1/fa4 zero size 2024-01-17T23:44:23.806 INFO:tasks.workunit.client.0.smithi161.stdout:8/760: stat d1/df/f96 0 2024-01-17T23:44:24.363 INFO:tasks.workunit.client.0.smithi161.stdout:3/788: rename d0/d5/d9/cfa to d0/d5/d9/d17/d5c/c100 0 2024-01-17T23:44:24.535 INFO:tasks.workunit.client.0.smithi161.stdout:6/718: creat d6/d7/dc/d43/dc3/dda/ffe x:0 0 0 2024-01-17T23:44:24.535 INFO:tasks.workunit.client.0.smithi161.stdout:6/719: chown d6/d7/fab 125998439 1 2024-01-17T23:44:25.147 INFO:tasks.workunit.client.0.smithi161.stdout:7/754: truncate da/d34/d5a/f2f 12370009 0 2024-01-17T23:44:25.245 INFO:tasks.workunit.client.0.smithi161.stdout:8/761: truncate d1/df/d20/d6a/f7b 2055827 0 2024-01-17T23:44:25.245 INFO:tasks.workunit.client.0.smithi161.stdout:8/762: dread - d1/d55/f99 zero size 2024-01-17T23:44:25.245 INFO:tasks.workunit.client.0.smithi161.stdout:8/763: readlink d1/d3d/le9 0 2024-01-17T23:44:26.095 INFO:tasks.workunit.client.0.smithi161.stdout:6/720: mknod d6/d7/dc/d85/d31/cff 0 2024-01-17T23:44:26.098 INFO:tasks.workunit.client.0.smithi161.stdout:6/721: write d6/d7/dc/d85/fc0 [102749,48300] 0 2024-01-17T23:44:26.623 INFO:tasks.workunit.client.0.smithi161.stdout:7/755: creat da/f102 x:0 0 0 2024-01-17T23:44:26.685 INFO:tasks.workunit.client.0.smithi161.stdout:4/812: sync 2024-01-17T23:44:26.685 INFO:tasks.workunit.client.0.smithi161.stdout:4/813: readlink d9/d27/d3a/d56/lce 0 2024-01-17T23:44:26.685 INFO:tasks.workunit.client.0.smithi161.stdout:4/814: truncate d9/de/d1e/f84 657310 0 2024-01-17T23:44:26.685 INFO:tasks.workunit.client.0.smithi161.stdout:4/815: creat d9/de/d69/ff9 x:0 0 0 2024-01-17T23:44:26.751 INFO:tasks.workunit.client.0.smithi161.stdout:8/764: mkdir d1/d88/d105 0 2024-01-17T23:44:26.751 INFO:tasks.workunit.client.0.smithi161.stdout:8/765: chown d1/d55/l102 477539 1 2024-01-17T23:44:26.751 INFO:tasks.workunit.client.0.smithi161.stdout:8/766: fdatasync d1/d22/d2f/f3f 0 2024-01-17T23:44:27.000 INFO:tasks.workunit.client.0.smithi161.stdout:0/792: rename d5/d8/d68 to d5/df6 0 2024-01-17T23:44:27.000 INFO:tasks.workunit.client.0.smithi161.stdout:0/793: chown d5/dcf 1029269 1 2024-01-17T23:44:27.000 INFO:tasks.workunit.client.0.smithi161.stdout:0/794: write d5/d34/d21/fd8 [143825,32248] 0 2024-01-17T23:44:27.200 INFO:tasks.workunit.client.0.smithi161.stdout:6/722: mkdir d6/d7/dc/d3c/db4/d100 0 2024-01-17T23:44:27.289 INFO:tasks.workunit.client.0.smithi161.stdout:1/831: dwrite d1/d20/d26/f68 [0,4194304] 0 2024-01-17T23:44:27.467 INFO:tasks.workunit.client.0.smithi161.stdout:4/816: symlink d9/d1b/d53/lfa 0 2024-01-17T23:44:27.799 INFO:tasks.workunit.client.0.smithi161.stdout:2/761: dwrite d8/d67/ff4 [0,4194304] 0 2024-01-17T23:44:27.861 INFO:tasks.workunit.client.0.smithi161.stdout:9/639: rename d0/d8/d14/d18/d20/d97/lce to d0/d8/d31/d58/ld8 0 2024-01-17T23:44:28.711 INFO:tasks.workunit.client.0.smithi161.stdout:4/817: symlink d9/d27/d68/de9/lfb 0 2024-01-17T23:44:29.272 INFO:tasks.workunit.client.0.smithi161.stdout:3/789: sync 2024-01-17T23:44:29.537 INFO:tasks.workunit.client.0.smithi161.stdout:5/719: rename dd/d15/d4e/d4f/cb0 to dd/ce6 0 2024-01-17T23:44:29.537 INFO:tasks.workunit.client.0.smithi161.stdout:7/756: write da/d34/d5a/d68/d8c/f8d [58848,124625] 0 2024-01-17T23:44:29.552 INFO:tasks.workunit.client.0.smithi161.stdout:7/757: write da/db/d7a/dc7/f59 [775416,120573] 0 2024-01-17T23:44:29.552 INFO:tasks.workunit.client.0.smithi161.stdout:7/758: dread - da/d14/d35/fe1 zero size 2024-01-17T23:44:29.732 INFO:tasks.workunit.client.0.smithi161.stdout:9/640: unlink d0/d8/d14/d18/d63/laf 0 2024-01-17T23:44:29.732 INFO:tasks.workunit.client.0.smithi161.stdout:9/641: read - d0/d8/d31/d73/fc5 zero size 2024-01-17T23:44:29.890 INFO:tasks.workunit.client.0.smithi161.stdout:4/818: getdents d9/d1b/d24/d25/d5b 0 2024-01-17T23:44:30.248 INFO:tasks.workunit.client.0.smithi161.stdout:3/790: mknod d0/d5/d9/d1e/d3b/d52/c101 0 2024-01-17T23:44:30.248 INFO:tasks.workunit.client.0.smithi161.stdout:5/720: read dd/d15/d1a/d42/f46 [334390,36316] 0 2024-01-17T23:44:30.610 INFO:tasks.workunit.client.0.smithi161.stdout:9/642: mknod d0/d8/d31/d73/cd9 0 2024-01-17T23:44:30.772 INFO:tasks.workunit.client.0.smithi161.stdout:4/819: mkdir d9/d1b/d24/d25/d5b/d97/dfc 0 2024-01-17T23:44:30.932 INFO:tasks.workunit.client.0.smithi161.stdout:3/791: mkdir d0/d5/d9/d17/d32/d102 0 2024-01-17T23:44:30.958 INFO:tasks.workunit.client.0.smithi161.stdout:3/792: dwrite d0/d5/d9/d1e/d3b/f6f [0,4194304] 0 2024-01-17T23:44:30.959 INFO:tasks.workunit.client.0.smithi161.stdout:3/793: chown d0/d5/d9/d17/d2d 6 1 2024-01-17T23:44:30.959 INFO:tasks.workunit.client.0.smithi161.stdout:3/794: creat d0/d5/d9/d8b/f103 x:0 0 0 2024-01-17T23:44:31.070 INFO:tasks.workunit.client.0.smithi161.stdout:5/721: symlink dd/d15/d1a/d5d/dd1/le7 0 2024-01-17T23:44:31.070 INFO:tasks.workunit.client.0.smithi161.stdout:5/722: readlink dd/d15/d4e/d4f/la0 0 2024-01-17T23:44:31.108 INFO:tasks.workunit.client.0.smithi161.stdout:5/723: dwrite dd/d15/d1a/d5d/d64/fac [0,4194304] 0 2024-01-17T23:44:31.108 INFO:tasks.workunit.client.0.smithi161.stdout:5/724: stat dd/d15/d1a/d5d/dd1/le7 0 2024-01-17T23:44:31.194 INFO:tasks.workunit.client.0.smithi161.stdout:9/643: creat d0/d39/d49/fda x:0 0 0 2024-01-17T23:44:31.194 INFO:tasks.workunit.client.0.smithi161.stdout:9/644: fdatasync d0/d8/d14/d18/d63/faa 0 2024-01-17T23:44:31.433 INFO:tasks.workunit.client.0.smithi161.stdout:4/820: symlink d9/d1b/d53/lfd 0 2024-01-17T23:44:31.705 INFO:tasks.workunit.client.0.smithi161.stdout:3/795: unlink d0/d5/d9/d1e/d3b/d52/c101 0 2024-01-17T23:44:32.091 INFO:tasks.workunit.client.0.smithi161.stdout:5/725: mknod dd/d15/d51/dbf/ce8 0 2024-01-17T23:44:32.096 INFO:tasks.workunit.client.0.smithi161.stdout:5/726: dread dd/d15/d1a/d34/fb7 [0,4194304] 0 2024-01-17T23:44:32.218 INFO:tasks.workunit.client.0.smithi161.stdout:9/645: rmdir d0/d8/d14/d87/d9b/dc2 0 2024-01-17T23:44:32.385 INFO:tasks.workunit.client.0.smithi161.stdout:4/821: symlink d9/de/d1e/d58/d60/d9c/dc7/lfe 0 2024-01-17T23:44:32.405 INFO:tasks.workunit.client.0.smithi161.stdout:4/822: dread f4 [4194304,4194304] 0 2024-01-17T23:44:32.430 INFO:tasks.workunit.client.0.smithi161.stdout:4/823: dwrite d9/de/d1e/d58/d60/d8f/fa6 [0,4194304] 0 2024-01-17T23:44:32.574 INFO:tasks.workunit.client.0.smithi161.stdout:3/796: truncate d0/d5/d9/d17/d32/f8e 3908181 0 2024-01-17T23:44:32.574 INFO:tasks.workunit.client.0.smithi161.stdout:3/797: write d0/d5/d9/d1e/d3b/d52/f67 [2910357,129458] 0 2024-01-17T23:44:32.574 INFO:tasks.workunit.client.0.smithi161.stdout:3/798: chown d0/d5/d9/d38 5 1 2024-01-17T23:44:32.599 INFO:tasks.workunit.client.0.smithi161.stdout:3/799: dwrite d0/d5/f1d [4194304,4194304] 0 2024-01-17T23:44:32.599 INFO:tasks.workunit.client.0.smithi161.stdout:3/800: stat d0/d5/d9/d1e/fab 0 2024-01-17T23:44:32.986 INFO:tasks.workunit.client.0.smithi161.stdout:9/646: chown d0/d39/d49/d6e/c78 103537778 1 2024-01-17T23:44:33.501 INFO:tasks.workunit.client.0.smithi161.stdout:4/824: mknod d9/de/d1e/d58/d60/d9c/dc7/de7/cff 0 2024-01-17T23:44:33.501 INFO:tasks.workunit.client.0.smithi161.stdout:4/825: write d9/d1b/d24/d25/d5b/d97/fad [1540247,77265] 0 2024-01-17T23:44:33.501 INFO:tasks.workunit.client.0.smithi161.stdout:4/826: chown d9/de/d69/lea 7829941 1 2024-01-17T23:44:33.530 INFO:tasks.workunit.client.0.smithi161.stdout:4/827: dwrite d9/d1b/d24/ddb/fe5 [0,4194304] 0 2024-01-17T23:44:33.541 INFO:tasks.workunit.client.0.smithi161.stdout:4/828: dread d9/de/d1e/d38/f48 [0,4194304] 0 2024-01-17T23:44:33.856 INFO:tasks.workunit.client.0.smithi161.stdout:9/647: rmdir d0/d8/d14/d87 39 2024-01-17T23:44:34.035 INFO:tasks.workunit.client.0.smithi161.stdout:8/767: rename d1/df/d20/d6a/f78 to d1/d3/d19/d1d/f106 0 2024-01-17T23:44:34.484 INFO:tasks.workunit.client.0.smithi161.stdout:4/829: mknod d9/d51/d64/dc4/de1/c100 0 2024-01-17T23:44:34.484 INFO:tasks.workunit.client.0.smithi161.stdout:4/830: stat d9/d27/d3a/d8b/dcb/faf 0 2024-01-17T23:44:34.484 INFO:tasks.workunit.client.0.smithi161.stdout:4/831: chown d9/de/d69/ff9 171 1 2024-01-17T23:44:34.495 INFO:tasks.workunit.client.0.smithi161.stdout:4/832: dread d9/d1b/d24/d25/d5b/fe2 [0,4194304] 0 2024-01-17T23:44:34.495 INFO:tasks.workunit.client.0.smithi161.stdout:4/833: fsync d9/de/d1e/d38/f48 0 2024-01-17T23:44:34.549 INFO:tasks.workunit.client.0.smithi161.stdout:1/832: rename d1/d8/d1f/l29 to d1/d20/d26/d30/d8f/l10c 0 2024-01-17T23:44:35.272 INFO:tasks.workunit.client.0.smithi161.stdout:8/768: truncate d1/d3/d19/d1d/f106 3679756 0 2024-01-17T23:44:35.326 INFO:tasks.workunit.client.0.smithi161.stdout:0/795: symlink d5/lf7 0 2024-01-17T23:44:35.495 INFO:tasks.workunit.client.0.smithi161.stdout:4/834: read d9/f13 [98897,9662] 0 2024-01-17T23:44:35.526 INFO:tasks.workunit.client.0.smithi161.stdout:4/835: dwrite d9/de/f45 [0,4194304] 0 2024-01-17T23:44:35.580 INFO:tasks.workunit.client.0.smithi161.stdout:9/648: mknod d0/cdb 0 2024-01-17T23:44:35.580 INFO:tasks.workunit.client.0.smithi161.stdout:9/649: readlink d0/d8/d14/d18/d63/l7e 0 2024-01-17T23:44:35.808 INFO:tasks.workunit.client.0.smithi161.stdout:2/762: rename d8/d1c/d1e/da6/cd8 to d8/d1c/d75/dae/de4/d84/c10d 0 2024-01-17T23:44:35.808 INFO:tasks.workunit.client.0.smithi161.stdout:2/763: chown d8/d1c/d75/dae/de4/da8/fe0 13 1 2024-01-17T23:44:36.226 INFO:tasks.workunit.client.0.smithi161.stdout:8/769: mknod d1/d1c/c107 0 2024-01-17T23:44:36.298 INFO:tasks.workunit.client.0.smithi161.stdout:0/796: dread f1 [0,4194304] 0 2024-01-17T23:44:36.326 INFO:tasks.workunit.client.0.smithi161.stdout:5/727: sync 2024-01-17T23:44:36.326 INFO:tasks.workunit.client.0.smithi161.stdout:7/759: sync 2024-01-17T23:44:36.326 INFO:tasks.workunit.client.0.smithi161.stdout:6/723: sync 2024-01-17T23:44:36.326 INFO:tasks.workunit.client.0.smithi161.stdout:6/724: chown d6/d7/dc/d85/d31/d5d/f21 9 1 2024-01-17T23:44:36.767 INFO:tasks.workunit.client.0.smithi161.stdout:3/801: rename d0/d5/d9/d17/c2a to d0/d5/d9/d38/db3/c104 0 2024-01-17T23:44:36.960 INFO:tasks.workunit.client.0.smithi161.stdout:2/764: mkdir d8/d4b/d9a/d10e 0 2024-01-17T23:44:37.175 INFO:tasks.workunit.client.0.smithi161.stdout:8/770: symlink d1/d22/dbd/l108 0 2024-01-17T23:44:37.242 INFO:tasks.workunit.client.0.smithi161.stdout:0/797: mkdir d5/d34/df8 0 2024-01-17T23:44:37.529 INFO:tasks.workunit.client.0.smithi161.stdout:7/760: link da/db/d7a/l100 da/d34/d5a/d28/d2b/d93/l103 0 2024-01-17T23:44:37.880 INFO:tasks.workunit.client.0.smithi161.stdout:4/836: getdents d9/d51 0 2024-01-17T23:44:37.880 INFO:tasks.workunit.client.0.smithi161.stdout:4/837: stat d9/de/d1e/d58/d60/d9c/dc7/de7/cff 0 2024-01-17T23:44:38.087 INFO:tasks.workunit.client.0.smithi161.stdout:9/650: rename d0/d8/d31/d58/fca to d0/d8/d14/d18/d20/d97/d9e/fdc 0 2024-01-17T23:44:38.283 INFO:tasks.workunit.client.0.smithi161.stdout:8/771: unlink d1/d1c/f2b 0 2024-01-17T23:44:38.283 INFO:tasks.workunit.client.0.smithi161.stdout:8/772: write d1/d22/d2f/dd6/ff6 [282944,52588] 0 2024-01-17T23:44:38.283 INFO:tasks.workunit.client.0.smithi161.stdout:8/773: creat d1/df/d20/d6a/f109 x:0 0 0 2024-01-17T23:44:38.283 INFO:tasks.workunit.client.0.smithi161.stdout:8/774: fdatasync d1/d3/d19/f87 0 2024-01-17T23:44:38.284 INFO:tasks.workunit.client.0.smithi161.stdout:8/775: creat d1/d3d/f10a x:0 0 0 2024-01-17T23:44:38.633 INFO:tasks.workunit.client.0.smithi161.stdout:1/833: sync 2024-01-17T23:44:38.633 INFO:tasks.workunit.client.0.smithi161.stdout:1/834: fdatasync d1/d8/d9d/f93 0 2024-01-17T23:44:38.633 INFO:tasks.workunit.client.0.smithi161.stdout:1/835: readlink d1/la7 0 2024-01-17T23:44:38.633 INFO:tasks.workunit.client.0.smithi161.stdout:1/836: creat d1/d64/df2/f10d x:0 0 0 2024-01-17T23:44:39.121 INFO:tasks.workunit.client.0.smithi161.stdout:4/838: rmdir d9/de/d1e/d58/d60 39 2024-01-17T23:44:39.145 INFO:tasks.workunit.client.0.smithi161.stdout:4/839: dwrite d9/d1b/d24/d25/d5b/fe2 [0,4194304] 0 2024-01-17T23:44:39.145 INFO:tasks.workunit.client.0.smithi161.stdout:4/840: truncate d9/d27/d68/fc9 907606 0 2024-01-17T23:44:39.344 INFO:tasks.workunit.client.0.smithi161.stdout:3/802: rename d0/d5/d9/d17/c45 to d0/d5/d9/d17/d2d/c105 0 2024-01-17T23:44:39.684 INFO:tasks.workunit.client.0.smithi161.stdout:8/776: link d1/d55/l102 d1/d88/d105/l10b 0 2024-01-17T23:44:39.684 INFO:tasks.workunit.client.0.smithi161.stdout:8/777: fdatasync d1/d22/d2f/d86/fa8 0 2024-01-17T23:44:39.774 INFO:tasks.workunit.client.0.smithi161.stdout:0/798: creat d5/d3a/d49/d99/ff9 x:0 0 0 2024-01-17T23:44:39.774 INFO:tasks.workunit.client.0.smithi161.stdout:0/799: write d5/d34/d21/d76/f87 [780807,68559] 0 2024-01-17T23:44:39.960 INFO:tasks.workunit.client.0.smithi161.stdout:5/728: dwrite dd/f50 [0,4194304] 0 2024-01-17T23:44:40.573 INFO:tasks.workunit.client.0.smithi161.stdout:4/841: getdents d9/de/d1e/d38/d6b 0 2024-01-17T23:44:40.823 INFO:tasks.workunit.client.0.smithi161.stdout:2/765: rename d8/d1c/d1e/da6/d35/d3a/f71 to d8/d1c/d75/dc7/de5/f10f 0 2024-01-17T23:44:41.196 INFO:tasks.workunit.client.0.smithi161.stdout:7/761: sync 2024-01-17T23:44:41.373 INFO:tasks.workunit.client.0.smithi161.stdout:4/842: mkdir d9/d27/d3a/d8b/d101 0 2024-01-17T23:44:41.373 INFO:tasks.workunit.client.0.smithi161.stdout:4/843: readlink d9/de/d1e/l29 0 2024-01-17T23:44:41.375 INFO:tasks.workunit.client.0.smithi161.stdout:9/651: rename d0/d8/d31/c38 to d0/d8/d14/d56/cdd 0 2024-01-17T23:44:41.375 INFO:tasks.workunit.client.0.smithi161.stdout:9/652: chown d0/d8/d14/d56/fd1 1730 1 2024-01-17T23:44:41.393 INFO:tasks.workunit.client.0.smithi161.stdout:4/844: dread d9/f23 [0,4194304] 0 2024-01-17T23:44:41.410 INFO:tasks.workunit.client.0.smithi161.stdout:9/653: dwrite d0/d39/d49/f82 [0,4194304] 0 2024-01-17T23:44:41.523 INFO:tasks.workunit.client.0.smithi161.stdout:2/766: rmdir d8/d1c/d75/dae/dbe 0 2024-01-17T23:44:41.523 INFO:tasks.workunit.client.0.smithi161.stdout:2/767: read d8/d68/f90 [169728,60561] 0 2024-01-17T23:44:41.523 INFO:tasks.workunit.client.0.smithi161.stdout:6/725: write d6/d7/dc/db2/fd9 [907893,130475] 0 2024-01-17T23:44:41.546 INFO:tasks.workunit.client.0.smithi161.stdout:6/726: dread d6/d7/fab [0,4194304] 0 2024-01-17T23:44:41.575 INFO:tasks.workunit.client.0.smithi161.stdout:6/727: dwrite d6/d7/dc/d85/d13/f28 [0,4194304] 0 2024-01-17T23:44:41.587 INFO:tasks.workunit.client.0.smithi161.stdout:7/762: rmdir da/d34/d5a/da0/df8/d3d/d82 39 2024-01-17T23:44:41.616 INFO:tasks.workunit.client.0.smithi161.stdout:7/763: dwrite da/d14/d35/fe1 [0,4194304] 0 2024-01-17T23:44:41.616 INFO:tasks.workunit.client.0.smithi161.stdout:7/764: chown da/db/dfb 0 1 2024-01-17T23:44:41.622 INFO:tasks.workunit.client.0.smithi161.stdout:7/765: dread da/d14/d35/d41/f73 [0,4194304] 0 2024-01-17T23:44:41.622 INFO:tasks.workunit.client.0.smithi161.stdout:7/766: write da/d34/d5a/d68/d8c/f8d [3162891,81598] 0 2024-01-17T23:44:41.726 INFO:tasks.workunit.client.0.smithi161.stdout:8/778: rename d1/df/d13/db1/dd4 to d1/d55/d10c 0 2024-01-17T23:44:41.727 INFO:tasks.workunit.client.0.smithi161.stdout:8/779: creat d1/d22/dbd/dce/f10d x:0 0 0 2024-01-17T23:44:41.727 INFO:tasks.workunit.client.0.smithi161.stdout:8/780: stat d1/dc5 0 2024-01-17T23:44:41.981 INFO:tasks.workunit.client.0.smithi161.stdout:4/845: symlink d9/d27/d3a/d56/l102 0 2024-01-17T23:44:42.297 INFO:tasks.workunit.client.0.smithi161.stdout:9/654: unlink d0/d8/d14/d18/d20/c4e 0 2024-01-17T23:44:42.297 INFO:tasks.workunit.client.0.smithi161.stdout:9/655: chown d0/d8/d14/d87/f8d 49059839 1 2024-01-17T23:44:42.444 INFO:tasks.workunit.client.0.smithi161.stdout:2/768: symlink d8/d1c/d1e/da6/d35/l110 0 2024-01-17T23:44:42.520 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:44:42.523 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:44:42.690 INFO:tasks.workunit.client.0.smithi161.stdout:6/728: mknod d6/d7/c101 0 2024-01-17T23:44:43.276 INFO:tasks.workunit.client.0.smithi161.stdout:7/767: symlink da/def/l104 0 2024-01-17T23:44:43.276 INFO:tasks.workunit.client.0.smithi161.stdout:0/800: rename d5/d34/d20/l62 to d5/df6/db0/dcc/df1/lfa 0 2024-01-17T23:44:43.320 INFO:tasks.workunit.client.0.smithi161.stdout:7/768: dwrite da/d34/d5a/d68/d8c/fb6 [0,4194304] 0 2024-01-17T23:44:43.320 INFO:tasks.workunit.client.0.smithi161.stdout:7/769: dread - da/db/db2/fe0 zero size 2024-01-17T23:44:43.320 INFO:tasks.workunit.client.0.smithi161.stdout:7/770: fdatasync da/d34/d5a/d28/fda 0 2024-01-17T23:44:43.321 INFO:tasks.workunit.client.0.smithi161.stdout:7/771: truncate da/db/db2/fe0 881355 0 2024-01-17T23:44:43.493 INFO:tasks.workunit.client.0.smithi161.stdout:8/781: creat d1/d3d/dff/f10e x:0 0 0 2024-01-17T23:44:43.553 INFO:tasks.workunit.client.0.smithi161.stdout:1/837: sync 2024-01-17T23:44:44.053 INFO:tasks.workunit.client.0.smithi161.stdout:3/803: rmdir d0/d5/d9/d1e/d3b/d52 39 2024-01-17T23:44:44.085 INFO:tasks.workunit.client.0.smithi161.stdout:6/729: mknod d6/d7/dc/d43/dc3/d90/c102 0 2024-01-17T23:44:44.118 INFO:tasks.workunit.client.0.smithi161.stdout:6/730: dwrite d6/d7/dc/d3c/d81/fc7 [0,4194304] 0 2024-01-17T23:44:44.119 INFO:tasks.workunit.client.0.smithi161.stdout:6/731: stat d6/d7/dc/d85/d31/d5d/cbe 0 2024-01-17T23:44:44.144 INFO:tasks.workunit.client.0.smithi161.stdout:6/732: dwrite d6/fed [0,4194304] 0 2024-01-17T23:44:44.144 INFO:tasks.workunit.client.0.smithi161.stdout:6/733: chown d6/d7/dc/d85/d1a/dd0/cf8 2596218 1 2024-01-17T23:44:44.348 INFO:tasks.workunit.client.0.smithi161.stdout:5/729: rename dd/d31/d56/c6c to dd/d31/db8/ce9 0 2024-01-17T23:44:44.348 INFO:tasks.workunit.client.0.smithi161.stdout:5/730: dread - dd/d15/d1a/d5d/d64/d67/fc2 zero size 2024-01-17T23:44:44.348 INFO:tasks.workunit.client.0.smithi161.stdout:5/731: readlink dd/d15/d6a/d80/la8 0 2024-01-17T23:44:44.552 INFO:tasks.workunit.client.0.smithi161.stdout:0/801: symlink d5/d34/d21/d9e/dc7/lfb 0 2024-01-17T23:44:44.560 INFO:tasks.workunit.client.0.smithi161.stdout:0/802: dread f1 [0,4194304] 0 2024-01-17T23:44:44.829 INFO:tasks.workunit.client.0.smithi161.stdout:1/838: mkdir d1/d20/d26/d30/d8f/d9e/d10e 0 2024-01-17T23:44:44.830 INFO:tasks.workunit.client.0.smithi161.stdout:1/839: chown d1/d11/d72 12 1 2024-01-17T23:44:45.012 INFO:tasks.workunit.client.0.smithi161.stdout:9/656: link d0/d8/d31/d58/ld8 d0/d39/lde 0 2024-01-17T23:44:45.012 INFO:tasks.workunit.client.0.smithi161.stdout:9/657: truncate d0/d8/d31/fcd 797527 0 2024-01-17T23:44:45.012 INFO:tasks.workunit.client.0.smithi161.stdout:9/658: rename d0 to d0/d8/d31/d58/ddf 22 2024-01-17T23:44:45.039 INFO:tasks.workunit.client.0.smithi161.stdout:9/659: dwrite d0/d39/d49/f57 [4194304,4194304] 0 2024-01-17T23:44:45.044 INFO:tasks.workunit.client.0.smithi161.stdout:9/660: dread d0/d8/d31/f8f [0,4194304] 0 2024-01-17T23:44:45.071 INFO:tasks.workunit.client.0.smithi161.stdout:9/661: dwrite d0/f51 [0,4194304] 0 2024-01-17T23:44:45.107 INFO:tasks.workunit.client.0.smithi161.stdout:9/662: dwrite d0/d8/d14/d56/fd1 [0,4194304] 0 2024-01-17T23:44:45.110 INFO:tasks.workunit.client.0.smithi161.stdout:9/663: dread d0/d8/d14/d56/f74 [0,4194304] 0 2024-01-17T23:44:45.146 INFO:tasks.workunit.client.0.smithi161.stdout:9/664: dwrite d0/d39/d49/f57 [4194304,4194304] 0 2024-01-17T23:44:45.146 INFO:tasks.workunit.client.0.smithi161.stdout:9/665: rename d0 to d0/d8/d14/d18/d20/da2/dcb/de0 22 2024-01-17T23:44:45.497 INFO:tasks.workunit.client.0.smithi161.stdout:3/804: mknod d0/d5/d9/d1e/c106 0 2024-01-17T23:44:45.608 INFO:tasks.workunit.client.0.smithi161.stdout:6/734: symlink d6/d7/dc/d3c/l103 0 2024-01-17T23:44:45.608 INFO:tasks.workunit.client.0.smithi161.stdout:6/735: chown d6/d7/dc/d3c/c84 393 1 2024-01-17T23:44:46.057 INFO:tasks.workunit.client.0.smithi161.stdout:5/732: mknod dd/d15/d1a/d5d/dc9/dde/cea 0 2024-01-17T23:44:46.200 INFO:tasks.workunit.client.0.smithi161.stdout:0/803: link d5/d34/d20/l9f d5/d34/d21/d9e/de9/lfc 0 2024-01-17T23:44:46.200 INFO:tasks.workunit.client.0.smithi161.stdout:0/804: write d5/d34/d8a/ff5 [1008442,32324] 0 2024-01-17T23:44:46.200 INFO:tasks.workunit.client.0.smithi161.stdout:0/805: dread - d5/df6/fb8 zero size 2024-01-17T23:44:46.329 INFO:tasks.workunit.client.0.smithi161.stdout:7/772: symlink da/d34/d5a/d28/d2b/l105 0 2024-01-17T23:44:46.329 INFO:tasks.workunit.client.0.smithi161.stdout:7/773: stat da/d34/d5a/d68/f6b 0 2024-01-17T23:44:46.330 INFO:tasks.workunit.client.0.smithi161.stdout:7/774: dread - da/fb1 zero size 2024-01-17T23:44:46.785 INFO:tasks.workunit.client.0.smithi161.stdout:1/840: unlink d1/d31/dd1/ff9 0 2024-01-17T23:44:46.806 INFO:tasks.workunit.client.0.smithi161.stdout:9/666: dread d0/d39/d49/d6e/f80 [0,4194304] 0 2024-01-17T23:44:46.811 INFO:tasks.workunit.client.0.smithi161.stdout:8/782: rmdir d1/df/d20/d6a 39 2024-01-17T23:44:46.811 INFO:tasks.workunit.client.0.smithi161.stdout:3/805: creat d0/d5/d9/d38/d4f/d9d/df7/f107 x:0 0 0 2024-01-17T23:44:46.811 INFO:tasks.workunit.client.0.smithi161.stdout:6/736: symlink d6/d7/dc/d1d/l104 0 2024-01-17T23:44:46.811 INFO:tasks.workunit.client.0.smithi161.stdout:6/737: chown d6/d7/dc/d85/d31/l69 0 1 2024-01-17T23:44:46.811 INFO:tasks.workunit.client.0.smithi161.stdout:6/738: write d6/d7/dc/d43/d79/fd3 [67617,104252] 0 2024-01-17T23:44:46.831 INFO:tasks.workunit.client.0.smithi161.stdout:8/783: dread d1/d3/d19/d1d/d25/f3b [0,4194304] 0 2024-01-17T23:44:46.835 INFO:tasks.workunit.client.0.smithi161.stdout:1/841: dwrite d1/d31/fa3 [0,4194304] 0 2024-01-17T23:44:46.835 INFO:tasks.workunit.client.0.smithi161.stdout:9/667: write d0/d8/d14/f65 [716230,55527] 0 2024-01-17T23:44:46.835 INFO:tasks.workunit.client.0.smithi161.stdout:1/842: getdents d1/d2d/d3b 0 2024-01-17T23:44:46.838 INFO:tasks.workunit.client.0.smithi161.stdout:6/739: write d6/d7/dc/d85/d13/f6f [3053813,49825] 0 2024-01-17T23:44:47.304 INFO:tasks.workunit.client.0.smithi161.stdout:7/775: rename da/db/l1c to da/def/l106 0 2024-01-17T23:44:47.496 INFO:tasks.workunit.client.0.smithi161.stdout:3/806: creat d0/d5/d9/f108 x:0 0 0 2024-01-17T23:44:47.496 INFO:tasks.workunit.client.0.smithi161.stdout:3/807: creat d0/d5/d9/d1e/d5a/d8a/f109 x:0 0 0 2024-01-17T23:44:47.496 INFO:tasks.workunit.client.0.smithi161.stdout:3/808: chown d0/d5/d9/d17/d2d/l43 50 1 2024-01-17T23:44:47.522 INFO:tasks.workunit.client.0.smithi161.stdout:3/809: dwrite d0/d5/d9/d8b/f103 [0,4194304] 0 2024-01-17T23:44:47.541 INFO:tasks.workunit.client.0.smithi161.stdout:3/810: dread d0/d5/d9/d17/f1c [0,4194304] 0 2024-01-17T23:44:47.724 INFO:tasks.workunit.client.0.smithi161.stdout:8/784: unlink d1/df/d13/db1/cc0 0 2024-01-17T23:44:47.724 INFO:tasks.workunit.client.0.smithi161.stdout:8/785: truncate d1/d3/d19/d1d/d25/f4d 866066 0 2024-01-17T23:44:47.915 INFO:tasks.workunit.client.0.smithi161.stdout:1/843: mkdir d1/d11/d72/def/d10f 0 2024-01-17T23:44:47.916 INFO:tasks.workunit.client.0.smithi161.stdout:9/668: creat d0/d8/d14/d87/fe1 x:0 0 0 2024-01-17T23:44:47.988 INFO:tasks.workunit.client.0.smithi161.stdout:6/740: creat d6/dfa/f105 x:0 0 0 2024-01-17T23:44:48.315 INFO:tasks.workunit.client.0.smithi161.stdout:5/733: getdents dd/d15/d1a/d5d/d64 0 2024-01-17T23:44:48.464 INFO:tasks.workunit.client.0.smithi161.stdout:0/806: write d5/d3a/d49/d99/d96/fb6 [970933,19961] 0 2024-01-17T23:44:48.464 INFO:tasks.workunit.client.0.smithi161.stdout:0/807: chown d5/d3a/deb 27368 1 2024-01-17T23:44:49.066 INFO:tasks.workunit.client.0.smithi161.stdout:3/811: rename d0/d5/d9/d38/cb7 to d0/d5/d9/d38/db3/db4/c10a 0 2024-01-17T23:44:49.119 INFO:tasks.workunit.client.0.smithi161.stdout:8/786: link d1/df/d20/c44 d1/d3d/dc7/c10f 0 2024-01-17T23:44:49.119 INFO:tasks.workunit.client.0.smithi161.stdout:8/787: chown d1/d55/d10c 1675899 1 2024-01-17T23:44:49.180 INFO:tasks.workunit.client.0.smithi161.stdout:1/844: dread d1/d11/d72/d81/f82 [0,4194304] 0 2024-01-17T23:44:49.241 INFO:tasks.workunit.client.0.smithi161.stdout:6/741: symlink d6/d7/dc/d85/d1a/l106 0 2024-01-17T23:44:49.265 INFO:tasks.workunit.client.0.smithi161.stdout:6/742: dread d6/fed [0,4194304] 0 2024-01-17T23:44:49.265 INFO:tasks.workunit.client.0.smithi161.stdout:6/743: write d6/d7/dc/d43/dde/fec [295398,22239] 0 2024-01-17T23:44:49.284 INFO:tasks.workunit.client.0.smithi161.stdout:6/744: dread d6/d7/fab [0,4194304] 0 2024-01-17T23:44:49.284 INFO:tasks.workunit.client.0.smithi161.stdout:6/745: write d6/d7/dc/d85/d31/d5d/ff0 [994986,8790] 0 2024-01-17T23:44:49.284 INFO:tasks.workunit.client.0.smithi161.stdout:6/746: chown d6/d7/dc/d85/d1a/dd0 885 1 2024-01-17T23:44:49.501 INFO:tasks.workunit.client.0.smithi161.stdout:5/734: getdents dd/d15 0 2024-01-17T23:44:49.537 INFO:tasks.workunit.client.0.smithi161.stdout:5/735: dwrite dd/d15/d51/f6e [0,4194304] 0 2024-01-17T23:44:49.548 INFO:tasks.workunit.client.0.smithi161.stdout:5/736: read dd/d31/d7b/f53 [615169,77505] 0 2024-01-17T23:44:49.693 INFO:tasks.workunit.client.0.smithi161.stdout:0/808: creat d5/d34/d12/ffd x:0 0 0 2024-01-17T23:44:49.714 INFO:tasks.workunit.client.0.smithi161.stdout:0/809: write d5/df6/db0/fd3 [1679161,130028] 0 2024-01-17T23:44:49.714 INFO:tasks.workunit.client.0.smithi161.stdout:0/810: truncate d5/d3a/d49/d99/d96/fb6 2019618 0 2024-01-17T23:44:49.714 INFO:tasks.workunit.client.0.smithi161.stdout:0/811: write d5/d34/d8a/ff5 [1901060,93905] 0 2024-01-17T23:44:49.714 INFO:tasks.workunit.client.0.smithi161.stdout:0/812: chown d5/d34/d21/d9e/dc7/fce 53770 1 2024-01-17T23:44:49.992 INFO:tasks.workunit.client.0.smithi161.stdout:9/669: rename d0/d8/d14/d18/d63/lb4 to d0/d8/d31/d58/le2 0 2024-01-17T23:44:50.005 INFO:tasks.workunit.client.0.smithi161.stdout:9/670: dread d0/d8/d14/d18/f55 [0,4194304] 0 2024-01-17T23:44:50.005 INFO:tasks.workunit.client.0.smithi161.stdout:9/671: creat d0/d8/d14/d18/d63/fe3 x:0 0 0 2024-01-17T23:44:50.227 INFO:tasks.workunit.client.0.smithi161.stdout:3/812: unlink d0/d5/d9/d8b/c8d 0 2024-01-17T23:44:50.333 INFO:tasks.workunit.client.0.smithi161.stdout:8/788: mknod d1/df/d16/d8c/c110 0 2024-01-17T23:44:50.362 INFO:tasks.workunit.client.0.smithi161.stdout:8/789: dwrite d1/df/f69 [0,4194304] 0 2024-01-17T23:44:50.381 INFO:tasks.workunit.client.0.smithi161.stdout:8/790: dread d1/df/f69 [0,4194304] 0 2024-01-17T23:44:50.381 INFO:tasks.workunit.client.0.smithi161.stdout:8/791: write d1/df/d20/d2a/d53/fba [4436562,51341] 0 2024-01-17T23:44:51.327 INFO:tasks.workunit.client.0.smithi161.stdout:6/747: link d6/d7/dc/d85/d1a/c26 d6/d7/dc/d3c/c107 0 2024-01-17T23:44:51.346 INFO:tasks.workunit.client.0.smithi161.stdout:6/748: write d6/d7/dc/d3c/d81/fc7 [4052918,115425] 0 2024-01-17T23:44:51.346 INFO:tasks.workunit.client.0.smithi161.stdout:6/749: fdatasync d6/d7/dc/d85/d31/fa6 0 2024-01-17T23:44:51.358 INFO:tasks.workunit.client.0.smithi161.stdout:6/750: write d6/d7/dc/d85/d1a/d59/f83 [149631,126491] 0 2024-01-17T23:44:51.358 INFO:tasks.workunit.client.0.smithi161.stdout:6/751: chown d6/d7/dc/d43/f74 370 1 2024-01-17T23:44:51.358 INFO:tasks.workunit.client.0.smithi161.stdout:6/752: stat d6/d7/dc/d85/d31/d5d/l30 0 2024-01-17T23:44:51.914 INFO:tasks.workunit.client.0.smithi161.stdout:5/737: mkdir dd/d15/d1a/d5d/d64/d7c/dd9/deb 0 2024-01-17T23:44:51.915 INFO:tasks.workunit.client.0.smithi161.stdout:5/738: stat dd/d15/d1a/d5d/d64/d7c/d88 0 2024-01-17T23:44:52.239 INFO:tasks.workunit.client.0.smithi161.stdout:0/813: getdents d5/d3a/d49 0 2024-01-17T23:44:52.486 INFO:tasks.workunit.client.0.smithi161.stdout:9/672: rename d0/d8/d14/d18/d20/da2/fbb to d0/d8/d14/d18/d20/fe4 0 2024-01-17T23:44:52.491 INFO:tasks.workunit.client.0.smithi161.stdout:9/673: read d0/d39/f59 [314943,31202] 0 2024-01-17T23:44:52.509 INFO:tasks.workunit.client.0.smithi161.stdout:9/674: write d0/d8/d14/d18/d63/faa [2373175,114950] 0 2024-01-17T23:44:52.517 INFO:tasks.workunit.client.0.smithi161.stdout:9/675: write d0/d8/d31/d58/fd0 [5162552,35817] 0 2024-01-17T23:44:52.518 INFO:tasks.workunit.client.0.smithi161.stdout:9/676: fdatasync d0/d39/d49/fc8 0 2024-01-17T23:44:52.520 INFO:tasks.workunit.client.0.smithi161.stdout:9/677: write d0/d8/d14/d18/d63/f89 [242181,30963] 0 2024-01-17T23:44:52.588 INFO:tasks.workunit.client.0.smithi161.stdout:3/813: getdents d0/d5/d9/d1e/d3b/d52/daf 0 2024-01-17T23:44:52.695 INFO:tasks.workunit.client.0.smithi161.stdout:8/792: creat d1/d3/d19/d1d/df3/f111 x:0 0 0 2024-01-17T23:44:52.695 INFO:tasks.workunit.client.0.smithi161.stdout:8/793: dread - d1/df/faf zero size 2024-01-17T23:44:52.721 INFO:tasks.workunit.client.0.smithi161.stdout:8/794: dwrite d1/df/d46/d89/f98 [0,4194304] 0 2024-01-17T23:44:52.965 INFO:tasks.workunit.client.0.smithi161.stdout:6/753: unlink d6/d7/dc/d43/dde/fd1 0 2024-01-17T23:44:52.965 INFO:tasks.workunit.client.0.smithi161.stdout:6/754: fsync d6/d7/dc/d85/d13/f6e 0 2024-01-17T23:44:52.991 INFO:tasks.workunit.client.0.smithi161.stdout:6/755: dwrite d6/d7/dc/d85/d13/f61 [0,4194304] 0 2024-01-17T23:44:52.992 INFO:tasks.workunit.client.0.smithi161.stdout:6/756: write d6/d7/dc/d85/d31/d5d/d55/fbc [85012,121556] 0 2024-01-17T23:44:53.110 INFO:tasks.workunit.client.0.smithi161.stdout:4/846: symlink d9/de/d1e/d58/d60/l103 0 2024-01-17T23:44:53.129 INFO:tasks.workunit.client.0.smithi161.stdout:4/847: write d9/d27/d3a/d56/f5f [2446787,69339] 0 2024-01-17T23:44:53.129 INFO:tasks.workunit.client.0.smithi161.stdout:4/848: chown d9/d27/d68/ld7 963 1 2024-01-17T23:44:53.248 INFO:tasks.workunit.client.0.smithi161.stdout:5/739: unlink dd/d15/l35 0 2024-01-17T23:44:53.584 INFO:tasks.workunit.client.0.smithi161.stdout:0/814: truncate d5/d34/d20/d2b/fe6 1262405 0 2024-01-17T23:44:53.835 INFO:tasks.workunit.client.0.smithi161.stdout:3/814: mkdir d0/d5/d9/d38/db3/db4/d10b 0 2024-01-17T23:44:54.183 INFO:tasks.workunit.client.0.smithi161.stdout:8/795: creat d1/df/d16/f112 x:0 0 0 2024-01-17T23:44:54.183 INFO:tasks.workunit.client.0.smithi161.stdout:8/796: fdatasync d1/fe7 0 2024-01-17T23:44:54.451 INFO:tasks.workunit.client.0.smithi161.stdout:6/757: truncate d6/d7/dc/d43/d79/fd6 4341528 0 2024-01-17T23:44:55.209 INFO:tasks.workunit.client.0.smithi161.stdout:8/797: mkdir d1/d3/d113 0 2024-01-17T23:44:55.209 INFO:tasks.workunit.client.0.smithi161.stdout:8/798: readlink d1/df/d20/d2a/d53/lc8 0 2024-01-17T23:44:55.209 INFO:tasks.workunit.client.0.smithi161.stdout:8/799: chown d1/df/d46/fa5 21 1 2024-01-17T23:44:55.209 INFO:tasks.workunit.client.0.smithi161.stdout:6/758: read d6/d7/dc/d43/f60 [256334,49454] 0 2024-01-17T23:44:56.311 INFO:tasks.workunit.client.0.smithi161.stdout:7/776: dwrite da/d34/d5a/da0/df8/d3d/f40 [0,4194304] 0 2024-01-17T23:44:56.569 INFO:tasks.workunit.client.0.smithi161.stdout:5/740: truncate dd/d15/d6a/d80/f9f 4846153 0 2024-01-17T23:44:56.569 INFO:tasks.workunit.client.0.smithi161.stdout:5/741: chown dd/d15/d1a/d34/fb7 948 1 2024-01-17T23:44:56.569 INFO:tasks.workunit.client.0.smithi161.stdout:5/742: readlink dd/d31/d3c/l5a 0 2024-01-17T23:44:56.576 INFO:tasks.workunit.client.0.smithi161.stdout:5/743: read dd/d15/f2e [430463,95604] 0 2024-01-17T23:44:56.576 INFO:tasks.workunit.client.0.smithi161.stdout:5/744: write dd/d15/d1a/d5d/d64/f8d [734886,84386] 0 2024-01-17T23:44:56.831 INFO:tasks.workunit.client.0.smithi161.stdout:8/800: creat d1/d3/d19/d1d/daa/f114 x:0 0 0 2024-01-17T23:44:57.124 INFO:tasks.workunit.client.0.smithi161.stdout:5/745: fdatasync dd/d15/d4e/f66 0 2024-01-17T23:44:57.722 INFO:tasks.workunit.client.0.smithi161.stdout:5/746: truncate dd/d31/d7b/f84 2718819 0 2024-01-17T23:44:58.550 INFO:tasks.workunit.client.0.smithi161.stdout:2/769: rmdir d8/d1c/d57 39 2024-01-17T23:44:58.553 INFO:tasks.workunit.client.0.smithi161.stdout:1/845: sync 2024-01-17T23:44:58.686 INFO:tasks.workunit.client.0.smithi161.stdout:4/849: rename d9/de/d1e/d58 to d9/d27/d3a/d8b/d101/d104 0 2024-01-17T23:44:58.977 INFO:tasks.workunit.client.0.smithi161.stdout:1/846: symlink d1/d31/d4e/l110 0 2024-01-17T23:44:58.977 INFO:tasks.workunit.client.0.smithi161.stdout:1/847: readlink d1/d8/d54/d94/lbd 0 2024-01-17T23:44:58.977 INFO:tasks.workunit.client.0.smithi161.stdout:1/848: chown d1/d20/d26/d30/d8f/d9e/fd2 0 1 2024-01-17T23:44:58.978 INFO:tasks.workunit.client.0.smithi161.stdout:1/849: dread - d1/d8/d1f/dd3/f108 zero size 2024-01-17T23:44:58.978 INFO:tasks.workunit.client.0.smithi161.stdout:1/850: creat d1/d8/d54/d94/f111 x:0 0 0 2024-01-17T23:44:58.978 INFO:tasks.workunit.client.0.smithi161.stdout:1/851: readlink d1/d8/d54/lda 0 2024-01-17T23:44:59.302 INFO:tasks.workunit.client.0.smithi161.stdout:4/850: creat d9/d27/d3a/d8b/d101/d104/d60/f105 x:0 0 0 2024-01-17T23:44:59.302 INFO:tasks.workunit.client.0.smithi161.stdout:4/851: stat d9/d27/d3a/d8b/dcb 0 2024-01-17T23:44:59.339 INFO:tasks.workunit.client.0.smithi161.stdout:4/852: dwrite d9/de/d69/f8a [0,4194304] 0 2024-01-17T23:44:59.339 INFO:tasks.workunit.client.0.smithi161.stdout:4/853: write d9/de/d1e/f66 [4181406,6959] 0 2024-01-17T23:44:59.503 INFO:tasks.workunit.client.0.smithi161.stdout:1/852: mkdir d1/d8/dfb/d112 0 2024-01-17T23:44:59.531 INFO:tasks.workunit.client.0.smithi161.stdout:1/853: dwrite d1/d20/d26/d30/d44/fd9 [0,4194304] 0 2024-01-17T23:44:59.903 INFO:tasks.workunit.client.0.smithi161.stdout:4/854: link f4 d9/d27/d3a/f106 0 2024-01-17T23:45:00.232 INFO:tasks.workunit.client.0.smithi161.stdout:1/854: symlink d1/d8/d54/d94/dd5/l113 0 2024-01-17T23:45:00.386 INFO:tasks.workunit.client.0.smithi161.stdout:4/855: mknod d9/de/d1e/d38/d89/dd8/c107 0 2024-01-17T23:45:00.405 INFO:tasks.workunit.client.0.smithi161.stdout:4/856: write d9/d1b/d52/f59 [1559881,83497] 0 2024-01-17T23:45:00.674 INFO:tasks.workunit.client.0.smithi161.stdout:3/815: dwrite d0/d5/d9/d17/f6b [0,4194304] 0 2024-01-17T23:45:00.685 INFO:tasks.workunit.client.0.smithi161.stdout:6/759: dwrite d6/d7/dc/d85/d13/f37 [0,4194304] 0 2024-01-17T23:45:00.705 INFO:tasks.workunit.client.0.smithi161.stdout:3/816: dwrite d0/d5/d9/d38/d4f/d9d/da7/fbf [0,4194304] 0 2024-01-17T23:45:01.010 INFO:tasks.workunit.client.0.smithi161.stdout:4/857: creat d9/de/d1e/d38/d6b/f108 x:0 0 0 2024-01-17T23:45:01.040 INFO:tasks.workunit.client.0.smithi161.stdout:8/801: dwrite d1/d22/d2f/d92/fa7 [4194304,4194304] 0 2024-01-17T23:45:01.259 INFO:tasks.workunit.client.0.smithi161.stdout:6/760: truncate d6/d7/dc/d43/d79/fd6 4170651 0 2024-01-17T23:45:01.449 INFO:tasks.workunit.client.0.smithi161.stdout:3/817: link d0/d5/d9/d1e/d3b/d52/f60 d0/d5/d9/d1e/d5a/f10c 0 2024-01-17T23:45:01.653 INFO:tasks.workunit.client.0.smithi161.stdout:9/678: creat d0/d39/fe5 x:0 0 0 2024-01-17T23:45:01.654 INFO:tasks.workunit.client.0.smithi161.stdout:9/679: creat d0/d8/d14/d18/d63/fe6 x:0 0 0 2024-01-17T23:45:01.654 INFO:tasks.workunit.client.0.smithi161.stdout:9/680: chown d0/d8/d14/d18/f55 206266 1 2024-01-17T23:45:01.654 INFO:tasks.workunit.client.0.smithi161.stdout:9/681: write d0/d8/d14/d87/fb9 [793859,51612] 0 2024-01-17T23:45:01.794 INFO:tasks.workunit.client.0.smithi161.stdout:6/761: symlink d6/dfa/l108 0 2024-01-17T23:45:02.159 INFO:tasks.workunit.client.0.smithi161.stdout:9/682: fdatasync d0/d8/f10 0 2024-01-17T23:45:02.407 INFO:tasks.workunit.client.0.smithi161.stdout:6/762: creat d6/d7/dc/d3c/d81/f109 x:0 0 0 2024-01-17T23:45:02.427 INFO:tasks.workunit.client.0.smithi161.stdout:6/763: dread d6/d7/dc/d85/d31/d5d/f21 [0,4194304] 0 2024-01-17T23:45:02.427 INFO:tasks.workunit.client.0.smithi161.stdout:6/764: write d6/d7/dc/d85/d1a/f3e [282108,115705] 0 2024-01-17T23:45:02.427 INFO:tasks.workunit.client.0.smithi161.stdout:6/765: chown d6/d7/dc/d85/d31/l32 994458 1 2024-01-17T23:45:02.427 INFO:tasks.workunit.client.0.smithi161.stdout:6/766: readlink l4 0 2024-01-17T23:45:03.515 INFO:tasks.workunit.client.0.smithi161.stdout:6/767: mknod d6/c10a 0 2024-01-17T23:45:03.516 INFO:tasks.workunit.client.0.smithi161.stdout:6/768: chown d6/d7/dc/d85/d31/d5d/d55/f7a 363 1 2024-01-17T23:45:04.436 INFO:tasks.workunit.client.0.smithi161.stdout:4/858: dwrite d9/d27/d3a/f4a [0,4194304] 0 2024-01-17T23:45:04.510 INFO:tasks.workunit.client.0.smithi161.stdout:3/818: write d0/d5/d9/d38/db3/db4/ffe [933560,1367] 0 2024-01-17T23:45:04.543 INFO:tasks.workunit.client.0.smithi161.stdout:3/819: dwrite d0/d5/d9/d1e/d5a/d8a/f109 [0,4194304] 0 2024-01-17T23:45:04.548 INFO:tasks.workunit.client.0.smithi161.stdout:3/820: dread d0/d5/d9/d17/d2d/fd6 [0,4194304] 0 2024-01-17T23:45:04.809 INFO:tasks.workunit.client.0.smithi161.stdout:0/815: rename d5/dcf to d5/df6/db0/dcc/dfe 0 2024-01-17T23:45:05.067 INFO:tasks.workunit.client.0.smithi161.stdout:4/859: link d9/de/d1e/f32 d9/d27/d3a/d8b/d101/d104/d60/d9c/dc7/de7/f109 0 2024-01-17T23:45:05.067 INFO:tasks.workunit.client.0.smithi161.stdout:4/860: chown d9/d27/d3a/d87/fd2 6 1 2024-01-17T23:45:05.194 INFO:tasks.workunit.client.0.smithi161.stdout:3/821: creat d0/d5/d9/d38/db3/db4/d10b/f10d x:0 0 0 2024-01-17T23:45:05.407 INFO:tasks.workunit.client.0.smithi161.stdout:7/777: rename da/d34/f4f to da/d34/d5a/d68/d8c/f107 0 2024-01-17T23:45:05.408 INFO:tasks.workunit.client.0.smithi161.stdout:7/778: write da/f102 [1036463,49163] 0 2024-01-17T23:45:05.586 INFO:tasks.workunit.client.0.smithi161.stdout:0/816: creat d5/df6/d6b/fff x:0 0 0 2024-01-17T23:45:05.913 INFO:tasks.workunit.client.0.smithi161.stdout:4/861: creat d9/d1b/f10a x:0 0 0 2024-01-17T23:45:06.013 INFO:tasks.workunit.client.0.smithi161.stdout:3/822: mknod d0/da2/c10e 0 2024-01-17T23:45:06.013 INFO:tasks.workunit.client.0.smithi161.stdout:3/823: chown d0/d5/d9/c8c 0 1 2024-01-17T23:45:06.132 INFO:tasks.workunit.client.0.smithi161.stdout:5/747: rename dd/d15/d1a/d5d/d64/d67/fc2 to dd/d15/d4e/d4f/de0/fec 0 2024-01-17T23:45:06.222 INFO:tasks.workunit.client.0.smithi161.stdout:7/779: mknod da/db/c108 0 2024-01-17T23:45:06.377 INFO:tasks.workunit.client.0.smithi161.stdout:3/824: creat d0/d5/d9/d17/d5c/f10f x:0 0 0 2024-01-17T23:45:06.377 INFO:tasks.workunit.client.0.smithi161.stdout:3/825: chown d0/c2b 2636042 1 2024-01-17T23:45:06.700 INFO:tasks.workunit.client.0.smithi161.stdout:2/770: rename d8/d1c/c3f to d8/d1c/d75/dae/c111 0 2024-01-17T23:45:06.720 INFO:tasks.workunit.client.0.smithi161.stdout:5/748: dread dd/d15/d4e/d4f/f61 [0,4194304] 0 2024-01-17T23:45:06.720 INFO:tasks.workunit.client.0.smithi161.stdout:5/749: readlink dd/d15/d1a/d42/l81 0 2024-01-17T23:45:06.728 INFO:tasks.workunit.client.0.smithi161.stdout:2/771: dwrite d8/f18 [0,4194304] 0 2024-01-17T23:45:06.971 INFO:tasks.workunit.client.0.smithi161.stdout:3/826: creat d0/d5/d9/d1e/d3b/d52/daf/f110 x:0 0 0 2024-01-17T23:45:07.075 INFO:tasks.workunit.client.0.smithi161.stdout:1/855: rename d1/l42 to d1/d31/l114 0 2024-01-17T23:45:07.106 INFO:tasks.workunit.client.0.smithi161.stdout:1/856: dwrite d1/d8/f56 [0,4194304] 0 2024-01-17T23:45:07.228 INFO:tasks.workunit.client.0.smithi161.stdout:5/750: creat dd/d15/d1a/d5d/dc9/dcb/fed x:0 0 0 2024-01-17T23:45:07.294 INFO:tasks.workunit.client.0.smithi161.stdout:2/772: creat d8/da/d8d/f112 x:0 0 0 2024-01-17T23:45:07.405 INFO:tasks.workunit.client.0.smithi161.stdout:7/780: truncate da/d34/d5a/d68/f97 777376 0 2024-01-17T23:45:07.413 INFO:tasks.workunit.client.0.smithi161.stdout:7/781: dread da/d34/f52 [0,4194304] 0 2024-01-17T23:45:07.692 INFO:tasks.workunit.client.0.smithi161.stdout:8/802: rename d1/d3/c5a to d1/d88/d105/c115 0 2024-01-17T23:45:07.720 INFO:tasks.workunit.client.0.smithi161.stdout:6/769: dwrite d6/f3d [0,4194304] 0 2024-01-17T23:45:07.769 INFO:tasks.workunit.client.0.smithi161.stdout:1/857: symlink d1/d11/d72/l115 0 2024-01-17T23:45:07.977 INFO:tasks.workunit.client.0.smithi161.stdout:5/751: truncate dd/d31/d56/f99 295786 0 2024-01-17T23:45:07.981 INFO:tasks.workunit.client.0.smithi161.stdout:9/683: sync 2024-01-17T23:45:07.981 INFO:tasks.workunit.client.0.smithi161.stdout:9/684: dread - d0/d8/fa0 zero size 2024-01-17T23:45:07.994 INFO:tasks.workunit.client.0.smithi161.stdout:5/752: dread dd/d15/d4e/d4f/f61 [0,4194304] 0 2024-01-17T23:45:08.001 INFO:tasks.workunit.client.0.smithi161.stdout:5/753: dread dd/d15/d1a/d34/fa7 [0,4194304] 0 2024-01-17T23:45:08.002 INFO:tasks.workunit.client.0.smithi161.stdout:5/754: chown dd/d31/d3c/f4c 879129130 1 2024-01-17T23:45:08.002 INFO:tasks.workunit.client.0.smithi161.stdout:5/755: chown dd/d15/d1a/d5d/dc9/dde/cea 204 1 2024-01-17T23:45:08.076 INFO:tasks.workunit.client.0.smithi161.stdout:7/782: mknod da/db/d7a/d8f/dac/da9/c109 0 2024-01-17T23:45:08.076 INFO:tasks.workunit.client.0.smithi161.stdout:7/783: chown da/d34/d5a/d28/d2b/d93/l103 1843749 1 2024-01-17T23:45:08.120 INFO:tasks.workunit.client.0.smithi161.stdout:7/784: dwrite da/d34/d5a/d28/d2b/d93/fe2 [0,4194304] 0 2024-01-17T23:45:08.672 INFO:tasks.workunit.client.0.smithi161.stdout:8/803: symlink d1/df/d16/l116 0 2024-01-17T23:45:09.385 INFO:tasks.workunit.client.0.smithi161.stdout:6/770: link d6/d7/dc/d85/d31/cf9 d6/d7/dc/d3c/ddd/de3/c10b 0 2024-01-17T23:45:09.484 INFO:tasks.workunit.client.0.smithi161.stdout:1/858: truncate d1/d11/d72/f89 1855259 0 2024-01-17T23:45:09.509 INFO:tasks.workunit.client.0.smithi161.stdout:1/859: write d1/f3a [3814784,54110] 0 2024-01-17T23:45:09.861 INFO:tasks.workunit.client.0.smithi161.stdout:5/756: read dd/d31/d7b/f84 [2097638,119416] 0 2024-01-17T23:45:09.861 INFO:tasks.workunit.client.0.smithi161.stdout:5/757: read dd/d15/d1a/d5d/d64/d7c/fd4 [3706645,119742] 0 2024-01-17T23:45:09.862 INFO:tasks.workunit.client.0.smithi161.stdout:5/758: creat dd/d15/d51/fee x:0 0 0 2024-01-17T23:45:10.617 INFO:tasks.workunit.client.0.smithi161.stdout:8/804: link d1/df/d20/d6a/fb6 d1/d3/d19/d1d/d25/f117 0 2024-01-17T23:45:10.617 INFO:tasks.workunit.client.0.smithi161.stdout:8/805: creat d1/df/d20/d2a/d53/f118 x:0 0 0 2024-01-17T23:45:10.825 INFO:tasks.workunit.client.0.smithi161.stdout:6/771: mkdir d6/d7/dc/d85/d13/dcc/d10c 0 2024-01-17T23:45:11.088 INFO:tasks.workunit.client.0.smithi161.stdout:1/860: mkdir d1/d11/d116 0 2024-01-17T23:45:11.166 INFO:tasks.workunit.client.0.smithi161.stdout:9/685: getdents d0/d39 0 2024-01-17T23:45:11.166 INFO:tasks.workunit.client.0.smithi161.stdout:9/686: dread - d0/d8/d14/d18/d20/fe4 zero size 2024-01-17T23:45:11.194 INFO:tasks.workunit.client.0.smithi161.stdout:9/687: dwrite d0/d8/d14/f44 [0,4194304] 0 2024-01-17T23:45:11.700 INFO:tasks.workunit.client.0.smithi161.stdout:8/806: truncate d1/d3/f18 1314303 0 2024-01-17T23:45:11.704 INFO:tasks.workunit.client.0.smithi161.stdout:8/807: dread d1/df/d20/f4c [0,4194304] 0 2024-01-17T23:45:11.704 INFO:tasks.workunit.client.0.smithi161.stdout:8/808: fsync d1/d22/d2f/dd6/fe4 0 2024-01-17T23:45:11.716 INFO:tasks.workunit.client.0.smithi161.stdout:8/809: dread d1/d3/d19/d1d/f36 [0,4194304] 0 2024-01-17T23:45:11.736 INFO:tasks.workunit.client.0.smithi161.stdout:8/810: dread d1/d3/d19/d1d/d25/d4b/f6b [0,4194304] 0 2024-01-17T23:45:11.741 INFO:tasks.workunit.client.0.smithi161.stdout:6/772: mkdir d6/dfa/d10d 0 2024-01-17T23:45:11.792 INFO:tasks.workunit.client.0.smithi161.stdout:1/861: mknod d1/d2d/c117 0 2024-01-17T23:45:11.792 INFO:tasks.workunit.client.0.smithi161.stdout:1/862: fsync d1/d20/d26/d30/d44/fd9 0 2024-01-17T23:45:12.079 INFO:tasks.workunit.client.0.smithi161.stdout:3/827: write d0/d5/d9/d17/f33 [4000927,97943] 0 2024-01-17T23:45:12.079 INFO:tasks.workunit.client.0.smithi161.stdout:3/828: chown d0/d5/d9/d1e/l6d 112 1 2024-01-17T23:45:12.380 INFO:tasks.workunit.client.0.smithi161.stdout:8/811: truncate d1/d3/d19/d1d/f71 348828 0 2024-01-17T23:45:12.568 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:45:12.572 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:45:13.002 INFO:tasks.workunit.client.0.smithi161.stdout:8/812: unlink d1/d3/d19/c3a 0 2024-01-17T23:45:13.093 INFO:tasks.workunit.client.0.smithi161.stdout:1/863: truncate d1/ff 464751 0 2024-01-17T23:45:13.093 INFO:tasks.workunit.client.0.smithi161.stdout:1/864: dread - d1/d8/d54/fc6 zero size 2024-01-17T23:45:13.214 INFO:tasks.workunit.client.0.smithi161.stdout:3/829: rmdir d0/da2 39 2024-01-17T23:45:13.214 INFO:tasks.workunit.client.0.smithi161.stdout:3/830: truncate d0/d5/d9/d1e/d3b/d52/daf/fef 221518 0 2024-01-17T23:45:13.308 INFO:tasks.workunit.client.0.smithi161.stdout:8/813: link d1/d3/d19/d1d/f9b d1/d22/d2f/dd6/f119 0 2024-01-17T23:45:13.308 INFO:tasks.workunit.client.0.smithi161.stdout:8/814: write d1/d22/d2f/dd6/ff6 [1122651,87778] 0 2024-01-17T23:45:13.511 INFO:tasks.workunit.client.0.smithi161.stdout:1/865: symlink d1/d20/d26/d32/l118 0 2024-01-17T23:45:13.511 INFO:tasks.workunit.client.0.smithi161.stdout:1/866: fsync d1/d8/d1f/fe4 0 2024-01-17T23:45:14.153 INFO:tasks.workunit.client.0.smithi161.stdout:8/815: creat d1/df/d20/f11a x:0 0 0 2024-01-17T23:45:14.489 INFO:tasks.workunit.client.0.smithi161.stdout:1/867: creat d1/d11/f119 x:0 0 0 2024-01-17T23:45:14.490 INFO:tasks.workunit.client.0.smithi161.stdout:3/831: unlink d0/d5/d9/d1e/lf9 0 2024-01-17T23:45:14.490 INFO:tasks.workunit.client.0.smithi161.stdout:3/832: fdatasync d0/d5/d9/d17/d5c/f10f 0 2024-01-17T23:45:14.493 INFO:tasks.workunit.client.0.smithi161.stdout:7/785: sync 2024-01-17T23:45:14.516 INFO:tasks.workunit.client.0.smithi161.stdout:3/833: dwrite d0/d5/d9/d17/d5c/f10f [0,4194304] 0 2024-01-17T23:45:15.099 INFO:tasks.workunit.client.0.smithi161.stdout:7/786: getdents da/d34/d5a/da0/df8/d3d/d7f 0 2024-01-17T23:45:15.303 INFO:tasks.workunit.client.0.smithi161.stdout:3/834: unlink d0/d5/d9/d38/d4f/d50/l98 0 2024-01-17T23:45:15.303 INFO:tasks.workunit.client.0.smithi161.stdout:3/835: fdatasync d0/d5/d9/d17/d32/f89 0 2024-01-17T23:45:15.503 INFO:tasks.workunit.client.0.smithi161.stdout:5/759: write dd/d15/d4e/d4f/d97/fcf [1413255,83592] 0 2024-01-17T23:45:15.504 INFO:tasks.workunit.client.0.smithi161.stdout:7/787: truncate da/d34/d5a/f2f 4614738 0 2024-01-17T23:45:15.534 INFO:tasks.workunit.client.0.smithi161.stdout:5/760: dwrite dd/d31/f38 [0,4194304] 0 2024-01-17T23:45:16.164 INFO:tasks.workunit.client.0.smithi161.stdout:5/761: symlink dd/d15/d1a/d5d/dc9/dcb/lef 0 2024-01-17T23:45:16.327 INFO:tasks.workunit.client.0.smithi161.stdout:6/773: write d6/d7/dc/f63 [773171,39409] 0 2024-01-17T23:45:16.359 INFO:tasks.workunit.client.0.smithi161.stdout:6/774: dwrite d6/d7/dc/d85/d13/f28 [4194304,4194304] 0 2024-01-17T23:45:16.379 INFO:tasks.workunit.client.0.smithi161.stdout:6/775: write d6/d7/fab [253263,10831] 0 2024-01-17T23:45:16.379 INFO:tasks.workunit.client.0.smithi161.stdout:6/776: chown d6/d7/dc/d85/d31/d5d/f38 2587577 1 2024-01-17T23:45:16.507 INFO:tasks.workunit.client.0.smithi161.stdout:5/762: rmdir dd/d15/d4e/d4f/d77 39 2024-01-17T23:45:16.920 INFO:tasks.workunit.client.0.smithi161.stdout:4/862: rename d9/f31 to d9/d27/d3a/d87/f10b 0 2024-01-17T23:45:16.950 INFO:tasks.workunit.client.0.smithi161.stdout:4/863: dwrite d9/d1b/f3b [0,4194304] 0 2024-01-17T23:45:16.950 INFO:tasks.workunit.client.0.smithi161.stdout:4/864: readlink d9/de/d1e/d38/l65 0 2024-01-17T23:45:16.979 INFO:tasks.workunit.client.0.smithi161.stdout:5/763: creat dd/d31/d3c/ff0 x:0 0 0 2024-01-17T23:45:16.979 INFO:tasks.workunit.client.0.smithi161.stdout:5/764: chown dd/d15/d1a/d5d/dc9/dcb 5010 1 2024-01-17T23:45:17.583 INFO:tasks.workunit.client.0.smithi161.stdout:4/865: truncate d9/d27/d3a/d8b/d101/d104/d60/d9c/dc7/de7/f109 2906296 0 2024-01-17T23:45:17.583 INFO:tasks.workunit.client.0.smithi161.stdout:4/866: write d9/d1b/d24/f43 [5193932,31464] 0 2024-01-17T23:45:17.691 INFO:tasks.workunit.client.0.smithi161.stdout:5/765: rmdir dd/d15/d1a/d5d/d64/d7c/dd9/deb 0 2024-01-17T23:45:17.691 INFO:tasks.workunit.client.0.smithi161.stdout:5/766: chown dd/d15/d51/c7d 1806989 1 2024-01-17T23:45:17.882 INFO:tasks.workunit.client.0.smithi161.stdout:0/817: rename d5/d34/d20/d2b/f75 to d5/df6/d6b/d89/f100 0 2024-01-17T23:45:17.882 INFO:tasks.workunit.client.0.smithi161.stdout:2/773: rename d8 to d8/d67/d6c/d72/ddd/d113 22 2024-01-17T23:45:17.898 INFO:tasks.workunit.client.0.smithi161.stdout:2/774: write d8/da/f58 [462436,125432] 0 2024-01-17T23:45:17.898 INFO:tasks.workunit.client.0.smithi161.stdout:2/775: fsync d8/d1c/d75/dae/dc3/fb7 0 2024-01-17T23:45:18.081 INFO:tasks.workunit.client.0.smithi161.stdout:4/867: mknod d9/d1b/c10c 0 2024-01-17T23:45:18.214 INFO:tasks.workunit.client.0.smithi161.stdout:0/818: dread d5/df6/d6b/d89/f100 [0,4194304] 0 2024-01-17T23:45:18.372 INFO:tasks.workunit.client.0.smithi161.stdout:9/688: rename d0/d8/d31/d58/c76 to d0/d8/d14/d87/d9b/dd5/ce7 0 2024-01-17T23:45:18.436 INFO:tasks.workunit.client.0.smithi161.stdout:4/868: symlink d9/d27/l10d 0 2024-01-17T23:45:18.444 INFO:tasks.workunit.client.0.smithi161.stdout:4/869: dread d9/d27/f6c [0,4194304] 0 2024-01-17T23:45:18.444 INFO:tasks.workunit.client.0.smithi161.stdout:4/870: chown d9/d1b/d24/d25/d5b/f8c 9 1 2024-01-17T23:45:18.899 INFO:tasks.workunit.client.0.smithi161.stdout:9/689: symlink d0/d8/d14/d18/le8 0 2024-01-17T23:45:19.101 INFO:tasks.workunit.client.0.smithi161.stdout:4/871: mkdir d9/d27/d3a/d8b/d101/d10e 0 2024-01-17T23:45:19.101 INFO:tasks.workunit.client.0.smithi161.stdout:4/872: stat d9/d51/d64/dc4/de1 0 2024-01-17T23:45:19.119 INFO:tasks.workunit.client.0.smithi161.stdout:4/873: write d9/d27/d3a/d8b/dcb/f78 [6858296,108333] 0 2024-01-17T23:45:19.217 INFO:tasks.workunit.client.0.smithi161.stdout:0/819: mkdir d5/d3a/d49/d99/d96/dbc/d101 0 2024-01-17T23:45:19.229 INFO:tasks.workunit.client.0.smithi161.stdout:0/820: dread d5/d34/d21/f84 [0,4194304] 0 2024-01-17T23:45:19.229 INFO:tasks.workunit.client.0.smithi161.stdout:0/821: dread - d5/d3a/d49/d99/ff9 zero size 2024-01-17T23:45:19.322 INFO:tasks.workunit.client.0.smithi161.stdout:7/788: dwrite da/d34/d5a/da0/df8/db9/f7c [0,4194304] 0 2024-01-17T23:45:19.323 INFO:tasks.workunit.client.0.smithi161.stdout:7/789: chown da/d14/f32 2 1 2024-01-17T23:45:19.414 INFO:tasks.workunit.client.0.smithi161.stdout:1/868: rename d1/d11/d72/lcc to d1/d11/d72/d81/l11a 0 2024-01-17T23:45:19.768 INFO:tasks.workunit.client.0.smithi161.stdout:4/874: readlink d9/l39 0 2024-01-17T23:45:20.344 INFO:tasks.workunit.client.0.smithi161.stdout:7/790: creat da/db/d7a/dc0/f10a x:0 0 0 2024-01-17T23:45:20.344 INFO:tasks.workunit.client.0.smithi161.stdout:7/791: truncate da/d34/d5a/d28/fda 788894 0 2024-01-17T23:45:20.439 INFO:tasks.workunit.client.0.smithi161.stdout:8/816: sync 2024-01-17T23:45:20.471 INFO:tasks.workunit.client.0.smithi161.stdout:8/817: dwrite d1/d22/d2f/d92/fa7 [0,4194304] 0 2024-01-17T23:45:20.472 INFO:tasks.workunit.client.0.smithi161.stdout:8/818: chown f0 2012134662 1 2024-01-17T23:45:20.501 INFO:tasks.workunit.client.0.smithi161.stdout:8/819: dwrite d1/df/d13/f8f [0,4194304] 0 2024-01-17T23:45:20.501 INFO:tasks.workunit.client.0.smithi161.stdout:8/820: fsync d1/d22/dbd/dce/ff7 0 2024-01-17T23:45:20.645 INFO:tasks.workunit.client.0.smithi161.stdout:3/836: rename d0/d5/d9/d1e/d3b/d52/daf/fef to d0/d5/d9/d1e/f111 0 2024-01-17T23:45:20.823 INFO:tasks.workunit.client.0.smithi161.stdout:1/869: mkdir d1/d20/d26/d30/d11b 0 2024-01-17T23:45:20.823 INFO:tasks.workunit.client.0.smithi161.stdout:1/870: fdatasync d1/d8/d1c/f39 0 2024-01-17T23:45:20.912 INFO:tasks.workunit.client.0.smithi161.stdout:9/690: getdents d0/d8/d14/d18/d20 0 2024-01-17T23:45:21.153 INFO:tasks.workunit.client.0.smithi161.stdout:7/792: creat da/d34/d5a/de9/f10b x:0 0 0 2024-01-17T23:45:21.153 INFO:tasks.workunit.client.0.smithi161.stdout:7/793: readlink da/d34/d5a/da0/df8/d3d/d7f/l9f 0 2024-01-17T23:45:21.181 INFO:tasks.workunit.client.0.smithi161.stdout:7/794: dwrite da/db/d7a/d8f/dac/fb7 [0,4194304] 0 2024-01-17T23:45:21.181 INFO:tasks.workunit.client.0.smithi161.stdout:7/795: creat da/d14/d35/f10c x:0 0 0 2024-01-17T23:45:21.341 INFO:tasks.workunit.client.0.smithi161.stdout:8/821: symlink d1/df/d20/d2a/d53/l11b 0 2024-01-17T23:45:21.661 INFO:tasks.workunit.client.0.smithi161.stdout:9/691: mknod d0/d8/d14/d18/d20/d97/ce9 0 2024-01-17T23:45:22.215 INFO:tasks.workunit.client.0.smithi161.stdout:8/822: dread d1/df/d20/d6a/fb6 [0,4194304] 0 2024-01-17T23:45:22.565 INFO:tasks.workunit.client.0.smithi161.stdout:5/767: write dd/d15/d1a/d42/f46 [147777,114036] 0 2024-01-17T23:45:22.596 INFO:tasks.workunit.client.0.smithi161.stdout:5/768: dwrite dd/d15/d1a/fb6 [0,4194304] 0 2024-01-17T23:45:22.919 INFO:tasks.workunit.client.0.smithi161.stdout:9/692: mknod d0/d8/d31/d73/cea 0 2024-01-17T23:45:22.919 INFO:tasks.workunit.client.0.smithi161.stdout:8/823: mknod d1/d88/c11c 0 2024-01-17T23:45:22.919 INFO:tasks.workunit.client.0.smithi161.stdout:8/824: readlink d1/df/l6f 0 2024-01-17T23:45:22.940 INFO:tasks.workunit.client.0.smithi161.stdout:8/825: read d1/d3/f9 [736505,38116] 0 2024-01-17T23:45:22.940 INFO:tasks.workunit.client.0.smithi161.stdout:8/826: chown d1/d55/cab 203585 1 2024-01-17T23:45:22.952 INFO:tasks.workunit.client.0.smithi161.stdout:5/769: symlink dd/d15/d1a/d5d/lf1 0 2024-01-17T23:45:22.952 INFO:tasks.workunit.client.0.smithi161.stdout:5/770: creat dd/d15/d1a/d5d/d64/d7c/ff2 x:0 0 0 2024-01-17T23:45:23.110 INFO:tasks.workunit.client.0.smithi161.stdout:6/777: rename d6/d7/dc/d3c to d6/dfa/d10e 0 2024-01-17T23:45:23.310 INFO:tasks.workunit.client.0.smithi161.stdout:9/693: getdents d0/d8/d14/d87/d9b 0 2024-01-17T23:45:23.310 INFO:tasks.workunit.client.0.smithi161.stdout:9/694: dread - d0/d39/fe5 zero size 2024-01-17T23:45:23.427 INFO:tasks.workunit.client.0.smithi161.stdout:8/827: creat d1/df/d20/d2a/f11d x:0 0 0 2024-01-17T23:45:23.781 INFO:tasks.workunit.client.0.smithi161.stdout:2/776: rename d8/d1c/d75/dae/dc3/c3b to d8/d4b/d9a/db0/c114 0 2024-01-17T23:45:23.781 INFO:tasks.workunit.client.0.smithi161.stdout:9/695: truncate d0/f2c 1011586 0 2024-01-17T23:45:23.781 INFO:tasks.workunit.client.0.smithi161.stdout:9/696: read - d0/d8/d14/d18/fc9 zero size 2024-01-17T23:45:24.273 INFO:tasks.workunit.client.0.smithi161.stdout:1/871: rename d1/d8/d54/d94/lbd to d1/d20/d26/d30/d8f/d9e/dae/l11c 0 2024-01-17T23:45:25.095 INFO:tasks.workunit.client.0.smithi161.stdout:5/771: rename dd/d15/d51/l5c to dd/d15/d1a/d42/lf3 0 2024-01-17T23:45:25.101 INFO:tasks.workunit.client.0.smithi161.stdout:5/772: read dd/d15/d1a/f6b [470686,65028] 0 2024-01-17T23:45:25.219 INFO:tasks.workunit.client.0.smithi161.stdout:1/872: mknod d1/d20/d26/d30/d8f/c11d 0 2024-01-17T23:45:25.221 INFO:tasks.workunit.client.0.smithi161.stdout:0/822: sync 2024-01-17T23:45:25.422 INFO:tasks.workunit.client.0.smithi161.stdout:4/875: dwrite d9/d27/d68/fc9 [0,4194304] 0 2024-01-17T23:45:25.422 INFO:tasks.workunit.client.0.smithi161.stdout:4/876: fsync d9/d1b/d53/d9f/fa9 0 2024-01-17T23:45:25.580 INFO:tasks.workunit.client.0.smithi161.stdout:6/778: rename d6/d58/lb6 to d6/d7/dc/d85/d13/l10f 0 2024-01-17T23:45:25.686 INFO:tasks.workunit.client.0.smithi161.stdout:5/773: symlink dd/d15/d1a/d5d/d64/d7c/d86/lf4 0 2024-01-17T23:45:25.737 INFO:tasks.workunit.client.0.smithi161.stdout:1/873: mknod d1/d8/d9d/c11e 0 2024-01-17T23:45:25.834 INFO:tasks.workunit.client.0.smithi161.stdout:3/837: dwrite d0/d5/d9/d1e/d5a/fb9 [0,4194304] 0 2024-01-17T23:45:25.878 INFO:tasks.workunit.client.0.smithi161.stdout:0/823: mknod d5/d34/d21/d76/c102 0 2024-01-17T23:45:26.385 INFO:tasks.workunit.client.0.smithi161.stdout:6/779: link d6/d7/dc/d85/d13/l6d d6/d7/dc/d85/d13/dcc/l110 0 2024-01-17T23:45:26.400 INFO:tasks.workunit.client.0.smithi161.stdout:6/780: dread d6/dfa/d10e/f4a [0,4194304] 0 2024-01-17T23:45:26.419 INFO:tasks.workunit.client.0.smithi161.stdout:6/781: dread d6/d58/fa9 [0,4194304] 0 2024-01-17T23:45:26.434 INFO:tasks.workunit.client.0.smithi161.stdout:6/782: dread d6/d7/dc/d85/d31/d5d/f21 [0,4194304] 0 2024-01-17T23:45:26.434 INFO:tasks.workunit.client.0.smithi161.stdout:6/783: truncate d6/d7/dc/db2/fd9 1163524 0 2024-01-17T23:45:26.434 INFO:tasks.workunit.client.0.smithi161.stdout:6/784: getdents d6/d7/dc/db2/df3 0 2024-01-17T23:45:26.437 INFO:tasks.workunit.client.0.smithi161.stdout:5/774: creat dd/d15/d1a/d5d/d64/ff5 x:0 0 0 2024-01-17T23:45:26.527 INFO:tasks.workunit.client.0.smithi161.stdout:1/874: truncate d1/d20/f2e 1438443 0 2024-01-17T23:45:26.527 INFO:tasks.workunit.client.0.smithi161.stdout:1/875: chown d1/d20/fd7 49909065 1 2024-01-17T23:45:26.527 INFO:tasks.workunit.client.0.smithi161.stdout:1/876: chown d1/d11/d72/f89 123697906 1 2024-01-17T23:45:26.848 INFO:tasks.workunit.client.0.smithi161.stdout:3/838: symlink d0/d5/d9/d38/d4f/d9d/dca/l112 0 2024-01-17T23:45:27.048 INFO:tasks.workunit.client.0.smithi161.stdout:0/824: symlink d5/d34/d21/d97/dbb/l103 0 2024-01-17T23:45:27.265 INFO:tasks.workunit.client.0.smithi161.stdout:6/785: creat d6/d7/dc/d43/f111 x:0 0 0 2024-01-17T23:45:27.277 INFO:tasks.workunit.client.0.smithi161.stdout:7/796: write da/fc [6403166,103614] 0 2024-01-17T23:45:27.277 INFO:tasks.workunit.client.0.smithi161.stdout:7/797: chown da/d34/d5a/d28/dad 62955 1 2024-01-17T23:45:27.382 INFO:tasks.workunit.client.0.smithi161.stdout:5/775: symlink dd/d15/d51/dce/lf6 0 2024-01-17T23:45:27.940 INFO:tasks.workunit.client.0.smithi161.stdout:0/825: chown d5/d3a/l55 793 1 2024-01-17T23:45:27.940 INFO:tasks.workunit.client.0.smithi161.stdout:0/826: fdatasync d5/d34/d20/d2b/f56 0 2024-01-17T23:45:28.077 INFO:tasks.workunit.client.0.smithi161.stdout:6/786: mkdir d6/d7/dc/db2/d112 0 2024-01-17T23:45:28.328 INFO:tasks.workunit.client.0.smithi161.stdout:7/798: dread da/db/d7a/dc7/f5b [0,4194304] 0 2024-01-17T23:45:28.405 INFO:tasks.workunit.client.0.smithi161.stdout:5/776: getdents dd/d15/d1a 0 2024-01-17T23:45:28.641 INFO:tasks.workunit.client.0.smithi161.stdout:3/839: link d0/d5/d9/d17/d32/fec d0/d5/f113 0 2024-01-17T23:45:28.677 INFO:tasks.workunit.client.0.smithi161.stdout:3/840: dwrite d0/d5/fa [0,4194304] 0 2024-01-17T23:45:28.677 INFO:tasks.workunit.client.0.smithi161.stdout:3/841: fsync d0/d5/d9/d38/f74 0 2024-01-17T23:45:28.677 INFO:tasks.workunit.client.0.smithi161.stdout:3/842: write d0/d5/fe4 [393893,117023] 0 2024-01-17T23:45:28.713 INFO:tasks.workunit.client.0.smithi161.stdout:6/787: mkdir d6/d7/dc/d43/dc3/d113 0 2024-01-17T23:45:28.919 INFO:tasks.workunit.client.0.smithi161.stdout:7/799: mkdir da/d34/d5a/de9/d10d 0 2024-01-17T23:45:29.073 INFO:tasks.workunit.client.0.smithi161.stdout:5/777: mkdir dd/d15/d51/dbf/df7 0 2024-01-17T23:45:29.088 INFO:tasks.workunit.client.0.smithi161.stdout:5/778: dread dd/d15/d1a/d5d/d64/d7c/fd4 [0,4194304] 0 2024-01-17T23:45:29.372 INFO:tasks.workunit.client.0.smithi161.stdout:9/697: sync 2024-01-17T23:45:29.372 INFO:tasks.workunit.client.0.smithi161.stdout:2/777: sync 2024-01-17T23:45:29.372 INFO:tasks.workunit.client.0.smithi161.stdout:9/698: write d0/d8/d14/d87/fb9 [1269644,71523] 0 2024-01-17T23:45:29.427 INFO:tasks.workunit.client.0.smithi161.stdout:8/828: dwrite d1/df/d20/d6a/fb6 [0,4194304] 0 2024-01-17T23:45:29.427 INFO:tasks.workunit.client.0.smithi161.stdout:8/829: fsync d1/d3/d19/d1d/d25/f117 0 2024-01-17T23:45:29.471 INFO:tasks.workunit.client.0.smithi161.stdout:3/843: rmdir d0/d5/d9/d38/d4f/da5 39 2024-01-17T23:45:29.709 INFO:tasks.workunit.client.0.smithi161.stdout:7/800: link da/db/d7a/dc7/da4/cb4 da/db/db2/c10e 0 2024-01-17T23:45:29.821 INFO:tasks.workunit.client.0.smithi161.stdout:5/779: creat dd/d15/d4e/d4f/ff8 x:0 0 0 2024-01-17T23:45:29.822 INFO:tasks.workunit.client.0.smithi161.stdout:5/780: chown dd/d15/d4e/c9e 2 1 2024-01-17T23:45:29.822 INFO:tasks.workunit.client.0.smithi161.stdout:5/781: fsync dd/d15/d1a/f9a 0 2024-01-17T23:45:30.087 INFO:tasks.workunit.client.0.smithi161.stdout:2/778: getdents d8/d1c/d75/dae/de4/da8 0 2024-01-17T23:45:30.115 INFO:tasks.workunit.client.0.smithi161.stdout:2/779: dwrite d8/d1c/d1e/d80/d79/f81 [0,4194304] 0 2024-01-17T23:45:30.115 INFO:tasks.workunit.client.0.smithi161.stdout:2/780: creat d8/d1c/d75/dc7/de5/f115 x:0 0 0 2024-01-17T23:45:30.115 INFO:tasks.workunit.client.0.smithi161.stdout:2/781: fdatasync d8/d1c/d1e/da6/d35/fbf 0 2024-01-17T23:45:30.123 INFO:tasks.workunit.client.0.smithi161.stdout:2/782: dread d8/d1c/d75/dae/dc3/f33 [0,4194304] 0 2024-01-17T23:45:30.138 INFO:tasks.workunit.client.0.smithi161.stdout:2/783: dread d8/da/f76 [0,4194304] 0 2024-01-17T23:45:30.138 INFO:tasks.workunit.client.0.smithi161.stdout:2/784: fsync d8/d1c/d57/f83 0 2024-01-17T23:45:30.169 INFO:tasks.workunit.client.0.smithi161.stdout:9/699: truncate d0/d39/d49/f82 2295341 0 2024-01-17T23:45:30.518 INFO:tasks.workunit.client.0.smithi161.stdout:8/830: unlink d1/d22/dbd/dce/fdb 0 2024-01-17T23:45:30.602 INFO:tasks.workunit.client.0.smithi161.stdout:3/844: link d0/d5/d9/d17/f33 d0/d5/d9/d38/db3/db4/d10b/f114 0 2024-01-17T23:45:31.229 INFO:tasks.workunit.client.0.smithi161.stdout:5/782: read dd/d31/d56/f99 [131851,86986] 0 2024-01-17T23:45:31.674 INFO:tasks.workunit.client.0.smithi161.stdout:2/785: rmdir d8/d4b/d9a/db0/dd7 0 2024-01-17T23:45:31.779 INFO:tasks.workunit.client.0.smithi161.stdout:9/700: getdents d0/d8/d31/d73 0 2024-01-17T23:45:31.950 INFO:tasks.workunit.client.0.smithi161.stdout:8/831: unlink d1/d1c/cc1 0 2024-01-17T23:45:31.950 INFO:tasks.workunit.client.0.smithi161.stdout:8/832: fsync d1/d22/d2f/dd6/fe4 0 2024-01-17T23:45:32.201 INFO:tasks.workunit.client.0.smithi161.stdout:3/845: truncate d0/d5/d9/d17/d5c/f10f 708559 0 2024-01-17T23:45:32.305 INFO:tasks.workunit.client.0.smithi161.stdout:6/788: rmdir d6/d7/dc/db2/df3 0 2024-01-17T23:45:32.334 INFO:tasks.workunit.client.0.smithi161.stdout:6/789: dwrite d6/f65 [0,4194304] 0 2024-01-17T23:45:32.402 INFO:tasks.workunit.client.0.smithi161.stdout:4/877: dwrite d9/d1b/d24/d25/fcc [0,4194304] 0 2024-01-17T23:45:32.441 INFO:tasks.workunit.client.0.smithi161.stdout:7/801: symlink da/d34/d5a/d68/l10f 0 2024-01-17T23:45:32.469 INFO:tasks.workunit.client.0.smithi161.stdout:7/802: dwrite da/d34/d5a/d28/f7b [0,4194304] 0 2024-01-17T23:45:32.635 INFO:tasks.workunit.client.0.smithi161.stdout:5/783: creat dd/d15/d51/dbf/ff9 x:0 0 0 2024-01-17T23:45:32.673 INFO:tasks.workunit.client.0.smithi161.stdout:5/784: dwrite dd/d15/d1a/d42/f46 [0,4194304] 0 2024-01-17T23:45:33.006 INFO:tasks.workunit.client.0.smithi161.stdout:8/833: mknod d1/dc5/c11e 0 2024-01-17T23:45:33.006 INFO:tasks.workunit.client.0.smithi161.stdout:8/834: chown d1/fe7 6070 1 2024-01-17T23:45:33.229 INFO:tasks.workunit.client.0.smithi161.stdout:1/877: sync 2024-01-17T23:45:34.097 INFO:tasks.workunit.client.0.smithi161.stdout:4/878: symlink d9/de/d1e/d38/d89/l10f 0 2024-01-17T23:45:34.123 INFO:tasks.workunit.client.0.smithi161.stdout:0/827: dwrite f2 [0,4194304] 0 2024-01-17T23:45:34.143 INFO:tasks.workunit.client.0.smithi161.stdout:4/879: dwrite d9/d1b/d53/d9f/ff8 [0,4194304] 0 2024-01-17T23:45:34.373 INFO:tasks.workunit.client.0.smithi161.stdout:7/803: creat da/db/d7a/da8/dd2/f110 x:0 0 0 2024-01-17T23:45:34.487 INFO:tasks.workunit.client.0.smithi161.stdout:5/785: stat dd/c1e 0 2024-01-17T23:45:34.668 INFO:tasks.workunit.client.0.smithi161.stdout:2/786: getdents d8/d1c/d1e/d80/dc4 0 2024-01-17T23:45:34.706 INFO:tasks.workunit.client.0.smithi161.stdout:2/787: dwrite d8/f37 [0,4194304] 0 2024-01-17T23:45:34.707 INFO:tasks.workunit.client.0.smithi161.stdout:2/788: fsync d8/d1c/d1e/f38 0 2024-01-17T23:45:34.707 INFO:tasks.workunit.client.0.smithi161.stdout:2/789: read d8/d67/d6c/d72/f96 [1542504,70914] 0 2024-01-17T23:45:34.790 INFO:tasks.workunit.client.0.smithi161.stdout:8/835: symlink d1/d3/d19/d1d/df3/l11f 0 2024-01-17T23:45:34.804 INFO:tasks.workunit.client.0.smithi161.stdout:8/836: write d1/df/d13/ff0 [2337457,100172] 0 2024-01-17T23:45:34.955 INFO:tasks.workunit.client.0.smithi161.stdout:1/878: creat d1/d20/d26/d30/d44/f11f x:0 0 0 2024-01-17T23:45:35.087 INFO:tasks.workunit.client.0.smithi161.stdout:0/828: creat d5/df6/db0/dcc/df1/f104 x:0 0 0 2024-01-17T23:45:35.258 INFO:tasks.workunit.client.0.smithi161.stdout:4/880: symlink d9/de/d1e/d38/d89/dd8/l110 0 2024-01-17T23:45:35.307 INFO:tasks.workunit.client.0.smithi161.stdout:4/881: dwrite d9/d27/d3a/d8b/dcb/f78 [0,4194304] 0 2024-01-17T23:45:35.307 INFO:tasks.workunit.client.0.smithi161.stdout:4/882: read - d9/de/d1e/d38/d6b/f108 zero size 2024-01-17T23:45:35.594 INFO:tasks.workunit.client.0.smithi161.stdout:5/786: link dd/d15/c3d dd/d15/d51/cfa 0 2024-01-17T23:45:35.905 INFO:tasks.workunit.client.0.smithi161.stdout:2/790: mknod d8/d67/d6c/dcc/c116 0 2024-01-17T23:45:35.906 INFO:tasks.workunit.client.0.smithi161.stdout:2/791: dread d8/d4b/d9a/fc0 [0,4194304] 0 2024-01-17T23:45:35.906 INFO:tasks.workunit.client.0.smithi161.stdout:2/792: truncate d8/d1c/d1e/d80/dc4/ff8 183405 0 2024-01-17T23:45:35.945 INFO:tasks.workunit.client.0.smithi161.stdout:8/837: mkdir d1/df/d46/d89/d120 0 2024-01-17T23:45:35.946 INFO:tasks.workunit.client.0.smithi161.stdout:8/838: truncate d1/df/d20/d2a/d53/f118 301324 0 2024-01-17T23:45:35.964 INFO:tasks.workunit.client.0.smithi161.stdout:8/839: read d1/f5f [4183409,76861] 0 2024-01-17T23:45:36.251 INFO:tasks.workunit.client.0.smithi161.stdout:1/879: link d1/d20/d26/d30/d8f/fa9 d1/d31/dd1/f120 0 2024-01-17T23:45:36.251 INFO:tasks.workunit.client.0.smithi161.stdout:0/829: creat d5/f105 x:0 0 0 2024-01-17T23:45:36.428 INFO:tasks.workunit.client.0.smithi161.stdout:4/883: mknod d9/d27/d3a/d8b/d101/d104/d60/d8f/df7/c111 0 2024-01-17T23:45:36.620 INFO:tasks.workunit.client.0.smithi161.stdout:7/804: truncate da/d34/d5a/d28/d2b/f79 2623216 0 2024-01-17T23:45:36.620 INFO:tasks.workunit.client.0.smithi161.stdout:7/805: readlink da/d34/d5a/d28/dad/lee 0 2024-01-17T23:45:37.045 INFO:tasks.workunit.client.0.smithi161.stdout:2/793: symlink d8/da/l117 0 2024-01-17T23:45:37.595 INFO:tasks.workunit.client.0.smithi161.stdout:0/830: mkdir d5/d34/d21/d97/dc8/d106 0 2024-01-17T23:45:37.740 INFO:tasks.workunit.client.0.smithi161.stdout:4/884: getdents d9/de 0 2024-01-17T23:45:38.771 INFO:tasks.workunit.client.0.smithi161.stdout:2/794: creat d8/d67/d6c/dcc/f118 x:0 0 0 2024-01-17T23:45:38.798 INFO:tasks.workunit.client.0.smithi161.stdout:2/795: dwrite d8/d1c/d57/f7f [4194304,4194304] 0 2024-01-17T23:45:38.873 INFO:tasks.workunit.client.0.smithi161.stdout:0/831: truncate d5/f25 72642 0 2024-01-17T23:45:38.873 INFO:tasks.workunit.client.0.smithi161.stdout:0/832: write d5/d3a/d49/fa1 [391226,104205] 0 2024-01-17T23:45:38.873 INFO:tasks.workunit.client.0.smithi161.stdout:0/833: fsync f0 0 2024-01-17T23:45:38.890 INFO:tasks.workunit.client.0.smithi161.stdout:0/834: dread f0 [0,4194304] 0 2024-01-17T23:45:38.910 INFO:tasks.workunit.client.0.smithi161.stdout:9/701: dwrite d0/d8/d14/d56/f74 [0,4194304] 0 2024-01-17T23:45:39.029 INFO:tasks.workunit.client.0.smithi161.stdout:2/796: rmdir d8/d1c/d57 39 2024-01-17T23:45:39.365 INFO:tasks.workunit.client.0.smithi161.stdout:0/835: rmdir d5/d3a/d49/d99/d96/dbc 39 2024-01-17T23:45:39.370 INFO:tasks.workunit.client.0.smithi161.stdout:2/797: mknod d8/d1c/c119 0 2024-01-17T23:45:39.401 INFO:tasks.workunit.client.0.smithi161.stdout:2/798: dwrite d8/d1c/d75/dae/de4/f95 [0,4194304] 0 2024-01-17T23:45:39.401 INFO:tasks.workunit.client.0.smithi161.stdout:2/799: truncate d8/d1c/d1e/f6f 1099450 0 2024-01-17T23:45:39.415 INFO:tasks.workunit.client.0.smithi161.stdout:3/846: dwrite d0/d5/d9/d38/d4f/d9d/dca/fe6 [4194304,4194304] 0 2024-01-17T23:45:39.418 INFO:tasks.workunit.client.0.smithi161.stdout:9/702: symlink d0/d8/d14/leb 0 2024-01-17T23:45:39.934 INFO:tasks.workunit.client.0.smithi161.stdout:0/836: link d5/lf d5/d34/d21/d76/d93/da3/l107 0 2024-01-17T23:45:40.029 INFO:tasks.workunit.client.0.smithi161.stdout:6/790: sync 2024-01-17T23:45:40.037 INFO:tasks.workunit.client.0.smithi161.stdout:2/800: dread d8/f14 [0,4194304] 0 2024-01-17T23:45:40.042 INFO:tasks.workunit.client.0.smithi161.stdout:6/791: dread d6/d7/dc/d85/d13/f61 [0,4194304] 0 2024-01-17T23:45:40.042 INFO:tasks.workunit.client.0.smithi161.stdout:6/792: read d6/dfa/d10e/f4a [2674123,103998] 0 2024-01-17T23:45:40.042 INFO:tasks.workunit.client.0.smithi161.stdout:6/793: fsync d6/d7/dc/d43/dc3/fc8 0 2024-01-17T23:45:40.069 INFO:tasks.workunit.client.0.smithi161.stdout:6/794: dwrite d6/d7/dc/d43/dc3/fa7 [4194304,4194304] 0 2024-01-17T23:45:40.205 INFO:tasks.workunit.client.0.smithi161.stdout:3/847: creat d0/d5/d9/d38/db3/f115 x:0 0 0 2024-01-17T23:45:40.411 INFO:tasks.workunit.client.0.smithi161.stdout:0/837: mkdir d5/d34/d21/d9e/de9/d8d/d108 0 2024-01-17T23:45:40.442 INFO:tasks.workunit.client.0.smithi161.stdout:0/838: dwrite d5/f59 [0,4194304] 0 2024-01-17T23:45:40.696 INFO:tasks.workunit.client.0.smithi161.stdout:6/795: mknod d6/d7/dc/d85/d13/dcc/d10c/c114 0 2024-01-17T23:45:41.140 INFO:tasks.workunit.client.0.smithi161.stdout:0/839: unlink d5/df6/db0/lec 0 2024-01-17T23:45:41.161 INFO:tasks.workunit.client.0.smithi161.stdout:0/840: write d5/d3a/d49/f7e [362829,62495] 0 2024-01-17T23:45:41.248 INFO:tasks.workunit.client.0.smithi161.stdout:6/796: rmdir d6/d7/dc/db2 39 2024-01-17T23:45:41.248 INFO:tasks.workunit.client.0.smithi161.stdout:6/797: chown d6/caf 24 1 2024-01-17T23:45:41.248 INFO:tasks.workunit.client.0.smithi161.stdout:6/798: write d6/d7/dc/d85/f98 [863297,28049] 0 2024-01-17T23:45:41.285 INFO:tasks.workunit.client.0.smithi161.stdout:6/799: dwrite d6/d7/dc/d85/d31/d5d/d55/fbc [0,4194304] 0 2024-01-17T23:45:41.285 INFO:tasks.workunit.client.0.smithi161.stdout:6/800: truncate d6/d7/dc/d85/d31/f92 302876 0 2024-01-17T23:45:41.537 INFO:tasks.workunit.client.0.smithi161.stdout:0/841: dread d5/d34/d12/f6f [0,4194304] 0 2024-01-17T23:45:41.563 INFO:tasks.workunit.client.0.smithi161.stdout:0/842: write d5/d3a/deb/dee/d35/f82 [7292383,28031] 0 2024-01-17T23:45:41.563 INFO:tasks.workunit.client.0.smithi161.stdout:0/843: chown d5/d34/df8 12 1 2024-01-17T23:45:42.272 INFO:tasks.workunit.client.0.smithi161.stdout:6/801: dread d6/d7/dc/f77 [0,4194304] 0 2024-01-17T23:45:42.337 INFO:tasks.workunit.client.0.smithi161.stdout:0/844: symlink d5/d3a/deb/l109 0 2024-01-17T23:45:42.338 INFO:tasks.workunit.client.0.smithi161.stdout:0/845: chown d5/d34/d21/d76/la6 257784479 1 2024-01-17T23:45:42.551 INFO:tasks.workunit.client.0.smithi161.stdout:6/802: truncate d6/dfa/d10e/d81/fc7 631263 0 2024-01-17T23:45:42.571 INFO:tasks.workunit.client.0.smithi161.stdout:6/803: dread d6/d7/dc/f4f [0,4194304] 0 2024-01-17T23:45:42.754 INFO:tasks.workunit.client.0.smithi161.stdout:8/840: write d1/d3/d19/f21 [317261,24056] 0 2024-01-17T23:45:42.766 INFO:tasks.workunit.client.0.smithi161.stdout:1/880: write d1/d11/d72/d81/f82 [3231457,2087] 0 2024-01-17T23:45:42.866 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:45:42.870 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:45:43.289 INFO:tasks.workunit.client.0.smithi161.stdout:6/804: mkdir d6/d7/dc/db2/d112/d115 0 2024-01-17T23:45:43.324 INFO:tasks.workunit.client.0.smithi161.stdout:6/805: dwrite d6/f65 [0,4194304] 0 2024-01-17T23:45:43.335 INFO:tasks.workunit.client.0.smithi161.stdout:6/806: dread d6/d7/dc/d43/dc3/d90/fb8 [0,4194304] 0 2024-01-17T23:45:43.335 INFO:tasks.workunit.client.0.smithi161.stdout:6/807: readlink d6/d7/dc/d43/dc3/d90/lb0 0 2024-01-17T23:45:43.356 INFO:tasks.workunit.client.0.smithi161.stdout:6/808: dread d6/d7/ffd [0,4194304] 0 2024-01-17T23:45:43.356 INFO:tasks.workunit.client.0.smithi161.stdout:6/809: creat d6/d7/dc/d85/d13/dcc/f116 x:0 0 0 2024-01-17T23:45:43.374 INFO:tasks.workunit.client.0.smithi161.stdout:6/810: read d6/d7/dc/f77 [706518,91307] 0 2024-01-17T23:45:43.375 INFO:tasks.workunit.client.0.smithi161.stdout:6/811: chown d6/d7/dc/d85/d1a/dd0/ce6 325564859 1 2024-01-17T23:45:43.382 INFO:tasks.workunit.client.0.smithi161.stdout:6/812: dread d6/d7/dc/d43/d79/f8a [0,4194304] 0 2024-01-17T23:45:43.400 INFO:tasks.workunit.client.0.smithi161.stdout:6/813: dread d6/d7/dc/d43/d79/f7f [0,4194304] 0 2024-01-17T23:45:43.423 INFO:tasks.workunit.client.0.smithi161.stdout:6/814: dwrite d6/fed [0,4194304] 0 2024-01-17T23:45:43.497 INFO:tasks.workunit.client.0.smithi161.stdout:8/841: unlink d1/d3/d19/cc2 0 2024-01-17T23:45:43.523 INFO:tasks.workunit.client.0.smithi161.stdout:8/842: dwrite d1/df/d16/f8a [0,4194304] 0 2024-01-17T23:45:43.554 INFO:tasks.workunit.client.0.smithi161.stdout:8/843: dwrite d1/df/d46/fa5 [0,4194304] 0 2024-01-17T23:45:43.554 INFO:tasks.workunit.client.0.smithi161.stdout:8/844: truncate d1/df/d20/d2a/f11d 161824 0 2024-01-17T23:45:44.327 INFO:tasks.workunit.client.0.smithi161.stdout:8/845: creat d1/df/d13/db1/f121 x:0 0 0 2024-01-17T23:45:44.328 INFO:tasks.workunit.client.0.smithi161.stdout:8/846: stat d1/df/d20/d2a/d56/fec 0 2024-01-17T23:45:44.328 INFO:tasks.workunit.client.0.smithi161.stdout:8/847: write d1/df/d20/f4c [277936,29673] 0 2024-01-17T23:45:44.328 INFO:tasks.workunit.client.0.smithi161.stdout:8/848: readlink d1/d55/d10c/le5 0 2024-01-17T23:45:44.719 INFO:tasks.workunit.client.0.smithi161.stdout:9/703: write d0/d8/d14/d87/f8d [296150,90694] 0 2024-01-17T23:45:44.719 INFO:tasks.workunit.client.0.smithi161.stdout:9/704: fdatasync d0/d8/d31/d58/f7d 0 2024-01-17T23:45:44.781 INFO:tasks.workunit.client.0.smithi161.stdout:6/815: truncate d6/d58/f82 834889 0 2024-01-17T23:45:44.781 INFO:tasks.workunit.client.0.smithi161.stdout:6/816: fdatasync d6/d7/dc/d43/dc3/fc8 0 2024-01-17T23:45:44.802 INFO:tasks.workunit.client.0.smithi161.stdout:6/817: dread d6/d7/f2b [0,4194304] 0 2024-01-17T23:45:45.028 INFO:tasks.workunit.client.0.smithi161.stdout:9/705: mknod d0/d8/d31/cec 0 2024-01-17T23:45:45.132 INFO:tasks.workunit.client.0.smithi161.stdout:2/801: dwrite d8/d4b/d9a/fc0 [0,4194304] 0 2024-01-17T23:45:45.132 INFO:tasks.workunit.client.0.smithi161.stdout:2/802: write d8/db8/ff0 [5784,10375] 0 2024-01-17T23:45:45.375 INFO:tasks.workunit.client.0.smithi161.stdout:3/848: write d0/d5/d9/d1e/fab [441073,89428] 0 2024-01-17T23:45:45.375 INFO:tasks.workunit.client.0.smithi161.stdout:5/787: rename dd/f24 to dd/d15/d51/dbf/df7/ffb 0 2024-01-17T23:45:45.375 INFO:tasks.workunit.client.0.smithi161.stdout:5/788: chown dd/d15/d1a/d5d/d64/l6f 526133 1 2024-01-17T23:45:45.375 INFO:tasks.workunit.client.0.smithi161.stdout:5/789: fdatasync dd/d15/d4e/d4f/d97/fcf 0 2024-01-17T23:45:45.389 INFO:tasks.workunit.client.0.smithi161.stdout:3/849: dread d0/d5/fa [0,4194304] 0 2024-01-17T23:45:45.389 INFO:tasks.workunit.client.0.smithi161.stdout:3/850: chown d0/d5/d9/d17/d5c/c100 57002 1 2024-01-17T23:45:45.738 INFO:tasks.workunit.client.0.smithi161.stdout:2/803: symlink d8/d1c/d75/dae/de4/d108/l11a 0 2024-01-17T23:45:45.895 INFO:tasks.workunit.client.0.smithi161.stdout:0/846: rename d5/d34/cc3 to d5/d3a/db4/c10a 0 2024-01-17T23:45:46.011 INFO:tasks.workunit.client.0.smithi161.stdout:5/790: unlink dd/d15/d51/fee 0 2024-01-17T23:45:46.112 INFO:tasks.workunit.client.0.smithi161.stdout:3/851: truncate d0/d5/d9/d38/f74 196322 0 2024-01-17T23:45:46.175 INFO:tasks.workunit.client.0.smithi161.stdout:2/804: link d8/d1c/d75/dae/dc3/fb7 d8/d4b/f11b 0 2024-01-17T23:45:46.175 INFO:tasks.workunit.client.0.smithi161.stdout:2/805: chown d8/d1c/d75/dae 37964734 1 2024-01-17T23:45:46.191 INFO:tasks.workunit.client.0.smithi161.stdout:2/806: dread d8/d1c/d75/dae/dc3/f53 [0,4194304] 0 2024-01-17T23:45:46.193 INFO:tasks.workunit.client.0.smithi161.stdout:2/807: dread d8/d1c/d1e/da6/d35/d3a/f82 [4194304,4194304] 0 2024-01-17T23:45:46.193 INFO:tasks.workunit.client.0.smithi161.stdout:2/808: creat d8/d1c/d75/dae/dc3/f11c x:0 0 0 2024-01-17T23:45:46.282 INFO:tasks.workunit.client.0.smithi161.stdout:8/849: rename d1/df/d16/f112 to d1/d55/d10c/f122 0 2024-01-17T23:45:46.594 INFO:tasks.workunit.client.0.smithi161.stdout:5/791: unlink dd/c1f 0 2024-01-17T23:45:46.814 INFO:tasks.workunit.client.0.smithi161.stdout:2/809: mkdir d8/d4b/d9a/d10e/d11d 0 2024-01-17T23:45:46.814 INFO:tasks.workunit.client.0.smithi161.stdout:2/810: chown d8/da/f27 29 1 2024-01-17T23:45:46.821 INFO:tasks.workunit.client.0.smithi161.stdout:6/818: dread d6/d7/fb7 [0,4194304] 0 2024-01-17T23:45:46.830 INFO:tasks.workunit.client.0.smithi161.stdout:2/811: dread d8/da/f76 [0,4194304] 0 2024-01-17T23:45:47.219 INFO:tasks.workunit.client.0.smithi161.stdout:3/852: mknod d0/d5/d9/d38/d4f/da5/c116 0 2024-01-17T23:45:47.614 INFO:tasks.workunit.client.0.smithi161.stdout:3/853: unlink d0/d5/d9/d1e/c96 0 2024-01-17T23:45:47.634 INFO:tasks.workunit.client.0.smithi161.stdout:3/854: write d0/d5/d9/f53 [2304251,95304] 0 2024-01-17T23:45:47.840 INFO:tasks.workunit.client.0.smithi161.stdout:3/855: unlink d0/d5/d9/d17/f1c 0 2024-01-17T23:45:47.840 INFO:tasks.workunit.client.0.smithi161.stdout:3/856: fsync d0/d5/d9/d1e/d5a/fb9 0 2024-01-17T23:45:47.840 INFO:tasks.workunit.client.0.smithi161.stdout:3/857: chown d0/d5/d9/d38/d4f/d9d/dca 4 1 2024-01-17T23:45:48.122 INFO:tasks.workunit.client.0.smithi161.stdout:1/881: dwrite d1/d8/f5a [4194304,4194304] 0 2024-01-17T23:45:48.142 INFO:tasks.workunit.client.0.smithi161.stdout:1/882: write d1/d8/f1b [816020,8171] 0 2024-01-17T23:45:48.394 INFO:tasks.workunit.client.0.smithi161.stdout:3/858: rmdir d0/d5/d9/d1e/d3b/d52 39 2024-01-17T23:45:48.394 INFO:tasks.workunit.client.0.smithi161.stdout:3/859: chown d0/d5/d9/d1e/d3b/lf2 0 1 2024-01-17T23:45:48.394 INFO:tasks.workunit.client.0.smithi161.stdout:3/860: stat d0/d5/d9/d38/d4f/d50/ca1 0 2024-01-17T23:45:48.395 INFO:tasks.workunit.client.0.smithi161.stdout:3/861: creat d0/d5/d9/d17/d2d/f117 x:0 0 0 2024-01-17T23:45:48.397 INFO:tasks.workunit.client.0.smithi161.stdout:7/806: sync 2024-01-17T23:45:48.397 INFO:tasks.workunit.client.0.smithi161.stdout:4/885: sync 2024-01-17T23:45:48.397 INFO:tasks.workunit.client.0.smithi161.stdout:4/886: readlink d9/de/d69/lea 0 2024-01-17T23:45:48.397 INFO:tasks.workunit.client.0.smithi161.stdout:4/887: readlink d9/d27/d3a/d8b/d101/d104/d60/d9c/lb2 0 2024-01-17T23:45:48.434 INFO:tasks.workunit.client.0.smithi161.stdout:7/807: dwrite da/d34/d4a/d4c/f70 [0,4194304] 0 2024-01-17T23:45:48.438 INFO:tasks.workunit.client.0.smithi161.stdout:9/706: dwrite d0/f30 [0,4194304] 0 2024-01-17T23:45:48.830 INFO:tasks.workunit.client.0.smithi161.stdout:8/850: getdents d1/d55/d10c 0 2024-01-17T23:45:48.856 INFO:tasks.workunit.client.0.smithi161.stdout:5/792: write dd/d15/d1a/f43 [4060209,30984] 0 2024-01-17T23:45:48.857 INFO:tasks.workunit.client.0.smithi161.stdout:5/793: read - dd/d15/d1a/f59 zero size 2024-01-17T23:45:48.857 INFO:tasks.workunit.client.0.smithi161.stdout:5/794: fsync dd/d15/d1a/d5d/d64/d7c/d86/fa6 0 2024-01-17T23:45:48.857 INFO:tasks.workunit.client.0.smithi161.stdout:5/795: stat dd/d15/d1a/d5d/dc9/dcb/ce5 0 2024-01-17T23:45:48.857 INFO:tasks.workunit.client.0.smithi161.stdout:5/796: read dd/d15/f2e [1799276,23787] 0 2024-01-17T23:45:48.885 INFO:tasks.workunit.client.0.smithi161.stdout:0/847: dwrite d5/d34/d20/fe8 [0,4194304] 0 2024-01-17T23:45:48.889 INFO:tasks.workunit.client.0.smithi161.stdout:6/819: dwrite d6/d7/dc/d43/d79/fd6 [0,4194304] 0 2024-01-17T23:45:49.206 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:48:12.564 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:45:49.211 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:48:12.568 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:45:49.229 INFO:tasks.workunit.client.0.smithi161.stdout:4/888: mknod d9/de/d1e/c112 0 2024-01-17T23:45:49.229 INFO:tasks.workunit.client.0.smithi161.stdout:4/889: fdatasync d9/d27/d3a/d56/f5f 0 2024-01-17T23:45:49.241 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:48:12.519 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:45:49.243 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:48:12.521 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:45:49.251 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:48:12.528 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:45:49.251 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:48:12.529 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:45:49.316 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:48:12.673 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:45:49.415 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:48:12.693 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:45:49.420 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:48:12.698 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:45:49.529 INFO:tasks.workunit.client.0.smithi161.stdout:7/808: symlink da/db/d7a/l111 0 2024-01-17T23:45:49.529 INFO:tasks.workunit.client.0.smithi161.stdout:7/809: chown da/db/d7a/da8/dd2 2305381 1 2024-01-17T23:45:49.529 INFO:tasks.workunit.client.0.smithi161.stdout:7/810: fsync da/d34/d5a/d68/ff6 0 2024-01-17T23:45:49.592 INFO:tasks.workunit.client.0.smithi161.stdout:2/812: rename d8/d1c/d1e/l20 to d8/l11e 0 2024-01-17T23:45:49.606 INFO:tasks.workunit.client.0.smithi161.stdout:2/813: dread d8/d1c/d75/dae/dc3/fa1 [0,4194304] 0 2024-01-17T23:45:50.366 INFO:tasks.workunit.client.0.smithi161.stdout:1/883: rmdir d1/d20/d26/d30/d44 39 2024-01-17T23:45:50.366 INFO:tasks.workunit.client.0.smithi161.stdout:1/884: creat d1/d31/dd1/f121 x:0 0 0 2024-01-17T23:45:50.366 INFO:tasks.workunit.client.0.smithi161.stdout:5/797: creat dd/d15/d1a/d5d/ffc x:0 0 0 2024-01-17T23:45:50.637 INFO:tasks.workunit.client.0.smithi161.stdout:0/848: creat d5/d3a/deb/dee/d35/f10b x:0 0 0 2024-01-17T23:45:50.656 INFO:tasks.workunit.client.0.smithi161.stdout:0/849: dread d5/d34/d21/f3b [0,4194304] 0 2024-01-17T23:45:50.666 INFO:tasks.workunit.client.0.smithi161.stdout:0/850: dread d5/d34/d21/d76/fae [0,4194304] 0 2024-01-17T23:45:50.704 INFO:tasks.workunit.client.0.smithi161.stdout:3/862: getdents d0/d5/d9/d38/db3 0 2024-01-17T23:45:50.801 INFO:tasks.workunit.client.0.smithi161.stdout:4/890: symlink d9/d1b/d53/d9f/l113 0 2024-01-17T23:45:50.851 INFO:tasks.workunit.client.0.smithi161.stdout:4/891: dwrite d9/d1b/d24/d25/d5b/f8c [0,4194304] 0 2024-01-17T23:45:50.851 INFO:tasks.workunit.client.0.smithi161.stdout:4/892: write d9/d1b/d24/d25/fd0 [343590,6145] 0 2024-01-17T23:45:50.851 INFO:tasks.workunit.client.0.smithi161.stdout:4/893: chown d9/d1b/d24/l63 3316612 1 2024-01-17T23:45:50.875 INFO:tasks.workunit.client.0.smithi161.stdout:4/894: dwrite d9/de/f45 [4194304,4194304] 0 2024-01-17T23:45:50.922 INFO:tasks.workunit.client.0.smithi161.stdout:4/895: dwrite d9/d27/d3a/d87/f10b [0,4194304] 0 2024-01-17T23:45:51.090 INFO:tasks.workunit.client.0.smithi161.stdout:9/707: write d0/d39/d49/f82 [3328017,34905] 0 2024-01-17T23:45:51.090 INFO:tasks.workunit.client.0.smithi161.stdout:9/708: chown d0/d8/d14/d87/lc1 322457928 1 2024-01-17T23:45:51.119 INFO:tasks.workunit.client.0.smithi161.stdout:9/709: dwrite d0/d8/d14/d87/fb9 [0,4194304] 0 2024-01-17T23:45:51.119 INFO:tasks.workunit.client.0.smithi161.stdout:9/710: chown d0/d39/lde 119 1 2024-01-17T23:45:51.949 INFO:tasks.workunit.client.0.smithi161.stdout:2/814: mknod d8/d67/d6c/dcc/c11f 0 2024-01-17T23:45:52.427 INFO:tasks.workunit.client.0.smithi161.stdout:1/885: mkdir d1/d20/d26/d32/d122 0 2024-01-17T23:45:52.590 INFO:tasks.workunit.client.0.smithi161.stdout:0/851: link d5/d3a/deb/dee/l39 d5/df6/d6b/da7/l10c 0 2024-01-17T23:45:52.591 INFO:tasks.workunit.client.0.smithi161.stdout:0/852: fdatasync d5/d3a/deb/dee/d35/f5d 0 2024-01-17T23:45:52.613 INFO:tasks.workunit.client.0.smithi161.stdout:5/798: read dd/d15/f22 [1238621,60489] 0 2024-01-17T23:45:52.631 INFO:tasks.workunit.client.0.smithi161.stdout:5/799: write dd/d31/f38 [3125413,97977] 0 2024-01-17T23:45:52.649 INFO:tasks.workunit.client.0.smithi161.stdout:5/800: write dd/f50 [3004188,86560] 0 2024-01-17T23:45:52.674 INFO:tasks.workunit.client.0.smithi161.stdout:3/863: rmdir d0/d5/d9/d38/d4f/d9d 39 2024-01-17T23:45:52.674 INFO:tasks.workunit.client.0.smithi161.stdout:5/801: dwrite dd/d15/d1a/d5d/ffc [0,4194304] 0 2024-01-17T23:45:53.129 INFO:tasks.workunit.client.0.smithi161.stdout:4/896: creat d9/d27/d3a/f114 x:0 0 0 2024-01-17T23:45:53.476 INFO:tasks.workunit.client.0.smithi161.stdout:9/711: creat d0/d8/d31/d73/fed x:0 0 0 2024-01-17T23:45:53.501 INFO:tasks.workunit.client.0.smithi161.stdout:9/712: dwrite d0/d8/d14/d87/d9b/fbf [0,4194304] 0 2024-01-17T23:45:54.564 INFO:tasks.workunit.client.0.smithi161.stdout:1/886: creat d1/d11/d72/def/d10f/f123 x:0 0 0 2024-01-17T23:45:54.564 INFO:tasks.workunit.client.0.smithi161.stdout:1/887: chown d1/d8/df1 2155993 1 2024-01-17T23:45:54.596 INFO:tasks.workunit.client.0.smithi161.stdout:1/888: dwrite d1/d8/d1c/f69 [4194304,4194304] 0 2024-01-17T23:45:54.626 INFO:tasks.workunit.client.0.smithi161.stdout:1/889: dwrite d1/d31/d4e/f74 [0,4194304] 0 2024-01-17T23:45:54.962 INFO:tasks.workunit.client.0.smithi161.stdout:0/853: rmdir d5/d34/d8a/df2 0 2024-01-17T23:45:54.996 INFO:tasks.workunit.client.0.smithi161.stdout:0/854: dwrite d5/d34/d20/f81 [0,4194304] 0 2024-01-17T23:45:55.175 INFO:tasks.workunit.client.0.smithi161.stdout:8/851: rename d1/c7f to d1/df/d46/d89/d120/c123 0 2024-01-17T23:45:55.191 INFO:tasks.workunit.client.0.smithi161.stdout:8/852: dread d1/df/d20/d2a/f34 [0,4194304] 0 2024-01-17T23:45:55.191 INFO:tasks.workunit.client.0.smithi161.stdout:8/853: fdatasync d1/d22/dbd/dce/ff1 0 2024-01-17T23:45:55.192 INFO:tasks.workunit.client.0.smithi161.stdout:8/854: fdatasync d1/df/d20/d2a/d53/f118 0 2024-01-17T23:45:55.199 INFO:tasks.workunit.client.0.smithi161.stdout:8/855: dread d1/df/d13/ff0 [0,4194304] 0 2024-01-17T23:45:55.681 INFO:tasks.workunit.client.0.smithi161.stdout:4/897: mknod d9/d51/d64/c115 0 2024-01-17T23:45:55.800 INFO:tasks.workunit.client.0.smithi161.stdout:9/713: mknod d0/d8/d14/d56/cee 0 2024-01-17T23:45:55.819 INFO:tasks.workunit.client.0.smithi161.stdout:9/714: write d0/d8/d14/f25 [8298147,49541] 0 2024-01-17T23:45:56.126 INFO:tasks.workunit.client.0.smithi161.stdout:1/890: mkdir d1/d11/d124 0 2024-01-17T23:45:56.458 INFO:tasks.workunit.client.0.smithi161.stdout:0/855: symlink d5/d34/d20/d2b/d64/d88/l10d 0 2024-01-17T23:45:56.688 INFO:tasks.workunit.client.0.smithi161.stdout:6/820: rename d6/d7/dc/d85/d31/d5d/d55/fc1 to d6/d7/dc/d85/d13/dcc/f117 0 2024-01-17T23:45:56.812 INFO:tasks.workunit.client.0.smithi161.stdout:8/856: getdents d1/df/d16/d8c 0 2024-01-17T23:45:56.812 INFO:tasks.workunit.client.0.smithi161.stdout:8/857: fdatasync d1/df/d13/f8f 0 2024-01-17T23:45:57.072 INFO:tasks.workunit.client.0.smithi161.stdout:9/715: symlink d0/d8/d14/d18/lef 0 2024-01-17T23:45:57.073 INFO:tasks.workunit.client.0.smithi161.stdout:0/856: symlink d5/d8/l10e 0 2024-01-17T23:45:57.073 INFO:tasks.workunit.client.0.smithi161.stdout:0/857: chown d5/d34/d20/fe7 1 1 2024-01-17T23:45:57.073 INFO:tasks.workunit.client.0.smithi161.stdout:0/858: stat d5/df6/d6b/d89 0 2024-01-17T23:45:57.234 INFO:tasks.workunit.client.0.smithi161.stdout:7/811: rename da/d34/l92 to da/d34/d5a/d28/d2b/d93/l112 0 2024-01-17T23:45:57.397 INFO:tasks.workunit.client.0.smithi161.stdout:9/716: dwrite d0/d8/d14/d87/fb9 [0,4194304] 0 2024-01-17T23:45:57.397 INFO:tasks.workunit.client.0.smithi161.stdout:9/717: dread - d0/d8/d14/d87/fe1 zero size 2024-01-17T23:45:57.502 INFO:tasks.workunit.client.0.smithi161.stdout:8/858: creat d1/d3/d19/d1d/d25/f124 x:0 0 0 2024-01-17T23:45:57.520 INFO:tasks.workunit.client.0.smithi161.stdout:8/859: dread d1/df/f96 [0,4194304] 0 2024-01-17T23:45:57.520 INFO:tasks.workunit.client.0.smithi161.stdout:8/860: fdatasync d1/d3d/f40 0 2024-01-17T23:45:57.520 INFO:tasks.workunit.client.0.smithi161.stdout:8/861: chown d1/d3/d19/d1d/d25 28913 1 2024-01-17T23:45:58.133 INFO:tasks.workunit.client.0.smithi161.stdout:3/864: rename d0/d5/c4c to d0/d5/d9/d38/db3/c118 0 2024-01-17T23:45:58.134 INFO:tasks.workunit.client.0.smithi161.stdout:3/865: write d0/d5/d9/f108 [419809,130865] 0 2024-01-17T23:45:58.134 INFO:tasks.workunit.client.0.smithi161.stdout:3/866: chown d0/d5/d9/d1e/d3b/c66 1037629 1 2024-01-17T23:45:58.134 INFO:tasks.workunit.client.0.smithi161.stdout:3/867: stat d0/d5/d9/d17/d32/fb1 0 2024-01-17T23:45:58.201 INFO:tasks.workunit.client.0.smithi161.stdout:7/812: symlink da/da7/l113 0 2024-01-17T23:45:58.201 INFO:tasks.workunit.client.0.smithi161.stdout:7/813: dread - da/d34/d5a/d28/fce zero size 2024-01-17T23:45:58.455 INFO:tasks.workunit.client.0.smithi161.stdout:9/718: dread d0/d8/f66 [0,4194304] 0 2024-01-17T23:45:58.467 INFO:tasks.workunit.client.0.smithi161.stdout:9/719: dread d0/d8/d31/d58/fd0 [0,4194304] 0 2024-01-17T23:45:58.467 INFO:tasks.workunit.client.0.smithi161.stdout:9/720: dread - d0/d39/d49/d6e/fd2 zero size 2024-01-17T23:45:58.467 INFO:tasks.workunit.client.0.smithi161.stdout:9/721: truncate d0/d8/d14/d18/d20/d97/d9e/fdc 513869 0 2024-01-17T23:45:58.467 INFO:tasks.workunit.client.0.smithi161.stdout:9/722: truncate d0/d8/d14/d18/d20/d97/d9e/fdc 1227919 0 2024-01-17T23:45:58.477 INFO:tasks.workunit.client.0.smithi161.stdout:9/723: dread d0/d8/f10 [0,4194304] 0 2024-01-17T23:45:58.491 INFO:tasks.workunit.client.0.smithi161.stdout:9/724: write d0/d8/d31/f68 [592834,85463] 0 2024-01-17T23:45:58.625 INFO:tasks.workunit.client.0.smithi161.stdout:8/862: rmdir d1/d22 39 2024-01-17T23:45:58.786 INFO:tasks.workunit.client.0.smithi161.stdout:1/891: rename d1/d8/l9 to d1/d8/d54/d94/dd5/l125 0 2024-01-17T23:45:58.828 INFO:tasks.workunit.client.0.smithi161.stdout:3/868: mknod d0/d5/d9/d38/d4f/d56/d7c/c119 0 2024-01-17T23:45:58.858 INFO:tasks.workunit.client.0.smithi161.stdout:3/869: dwrite d0/d5/d9/d38/d4f/d50/fc0 [0,4194304] 0 2024-01-17T23:45:58.858 INFO:tasks.workunit.client.0.smithi161.stdout:3/870: chown d0/f2e 36833 1 2024-01-17T23:45:58.879 INFO:tasks.workunit.client.0.smithi161.stdout:3/871: write d0/d5/d9/d1e/d5a/f7d [3668383,8128] 0 2024-01-17T23:45:58.898 INFO:tasks.workunit.client.0.smithi161.stdout:3/872: write d0/d5/d9/d1e/d3b/f6f [3655739,33796] 0 2024-01-17T23:45:59.121 INFO:tasks.workunit.client.0.smithi161.stdout:6/821: truncate d6/d7/dc/d43/d79/fd6 2831854 0 2024-01-17T23:45:59.121 INFO:tasks.workunit.client.0.smithi161.stdout:6/822: stat d6/d7/dc/d85/d31/d5d/fe5 0 2024-01-17T23:45:59.278 INFO:tasks.workunit.client.0.smithi161.stdout:2/815: sync 2024-01-17T23:45:59.278 INFO:tasks.workunit.client.0.smithi161.stdout:2/816: write d8/d1c/f25 [9184185,115205] 0 2024-01-17T23:45:59.296 INFO:tasks.workunit.client.0.smithi161.stdout:2/817: write d8/d1c/f1f [7392389,85771] 0 2024-01-17T23:45:59.296 INFO:tasks.workunit.client.0.smithi161.stdout:2/818: creat d8/d1c/d1e/da6/d35/f120 x:0 0 0 2024-01-17T23:45:59.297 INFO:tasks.workunit.client.0.smithi161.stdout:2/819: truncate d8/da/fda 1046964 0 2024-01-17T23:45:59.362 INFO:tasks.workunit.client.0.smithi161.stdout:9/725: creat d0/d8/d14/d18/d20/ff0 x:0 0 0 2024-01-17T23:45:59.387 INFO:tasks.workunit.client.0.smithi161.stdout:9/726: dwrite d0/d8/d14/f25 [0,4194304] 0 2024-01-17T23:45:59.423 INFO:tasks.workunit.client.0.smithi161.stdout:9/727: dwrite d0/d8/d14/f85 [0,4194304] 0 2024-01-17T23:45:59.424 INFO:tasks.workunit.client.0.smithi161.stdout:9/728: fdatasync d0/fa6 0 2024-01-17T23:45:59.619 INFO:tasks.workunit.client.0.smithi161.stdout:8/863: dread d1/d3/d19/d1d/f71 [0,4194304] 0 2024-01-17T23:45:59.637 INFO:tasks.workunit.client.0.smithi161.stdout:5/802: sync 2024-01-17T23:45:59.733 INFO:tasks.workunit.client.0.smithi161.stdout:1/892: unlink d1/d2d/f78 0 2024-01-17T23:46:00.540 INFO:tasks.workunit.client.0.smithi161.stdout:6/823: mkdir d6/d7/dc/d43/dde/d118 0 2024-01-17T23:46:00.838 INFO:tasks.workunit.client.0.smithi161.stdout:2/820: mknod d8/da/d8d/c121 0 2024-01-17T23:46:01.066 INFO:tasks.workunit.client.0.smithi161.stdout:9/729: mkdir d0/d8/d14/d18/d20/d97/d9e/df1 0 2024-01-17T23:46:01.074 INFO:tasks.workunit.client.0.smithi161.stdout:9/730: read d0/d8/d31/f8f [574200,34770] 0 2024-01-17T23:46:01.098 INFO:tasks.workunit.client.0.smithi161.stdout:4/898: dwrite d9/fc [0,4194304] 0 2024-01-17T23:46:01.111 INFO:tasks.workunit.client.0.smithi161.stdout:4/899: dread d9/fd [0,4194304] 0 2024-01-17T23:46:01.302 INFO:tasks.workunit.client.0.smithi161.stdout:5/803: unlink dd/d31/d56/f68 0 2024-01-17T23:46:01.704 INFO:tasks.workunit.client.0.smithi161.stdout:0/859: write d5/d8/f3c [4104974,55100] 0 2024-01-17T23:46:01.704 INFO:tasks.workunit.client.0.smithi161.stdout:0/860: truncate d5/d34/d20/fe7 1660963 0 2024-01-17T23:46:02.120 INFO:tasks.workunit.client.0.smithi161.stdout:1/893: mknod d1/d31/dd1/c126 0 2024-01-17T23:46:02.120 INFO:tasks.workunit.client.0.smithi161.stdout:3/873: symlink d0/d5/d9/d38/d4f/da5/l11a 0 2024-01-17T23:46:02.154 INFO:tasks.workunit.client.0.smithi161.stdout:1/894: dwrite d1/d11/d72/d81/fe8 [0,4194304] 0 2024-01-17T23:46:02.154 INFO:tasks.workunit.client.0.smithi161.stdout:1/895: truncate d1/d20/d26/d30/d44/f88 2709415 0 2024-01-17T23:46:02.171 INFO:tasks.workunit.client.0.smithi161.stdout:3/874: dwrite d0/d5/d9/d17/d2d/f94 [4194304,4194304] 0 2024-01-17T23:46:02.252 INFO:tasks.workunit.client.0.smithi161.stdout:6/824: creat d6/dfa/d10d/f119 x:0 0 0 2024-01-17T23:46:02.277 INFO:tasks.workunit.client.0.smithi161.stdout:6/825: dwrite d6/f51 [0,4194304] 0 2024-01-17T23:46:02.277 INFO:tasks.workunit.client.0.smithi161.stdout:6/826: fdatasync d6/d7/dc/d85/d1a/d59/fdc 0 2024-01-17T23:46:02.295 INFO:tasks.workunit.client.0.smithi161.stdout:6/827: dread d6/f51 [0,4194304] 0 2024-01-17T23:46:02.295 INFO:tasks.workunit.client.0.smithi161.stdout:6/828: stat d6/fa 0 2024-01-17T23:46:02.330 INFO:tasks.workunit.client.0.smithi161.stdout:6/829: dwrite d6/d7/dc/d85/d1a/d59/d8e/fe9 [0,4194304] 0 2024-01-17T23:46:02.411 INFO:tasks.workunit.client.0.smithi161.stdout:2/821: unlink d8/d1c/d75/dae/cd4 0 2024-01-17T23:46:02.411 INFO:tasks.workunit.client.0.smithi161.stdout:2/822: dread - d8/da/d8d/f112 zero size 2024-01-17T23:46:02.479 INFO:tasks.workunit.client.0.smithi161.stdout:9/731: rmdir d0/d8/d14/d18/d20/da2 39 2024-01-17T23:46:02.479 INFO:tasks.workunit.client.0.smithi161.stdout:9/732: creat d0/d8/d14/dab/ff2 x:0 0 0 2024-01-17T23:46:02.655 INFO:tasks.workunit.client.0.smithi161.stdout:4/900: creat d9/de/d1e/d38/f116 x:0 0 0 2024-01-17T23:46:02.655 INFO:tasks.workunit.client.0.smithi161.stdout:4/901: fdatasync d9/d1b/d24/ddb/fe5 0 2024-01-17T23:46:02.742 INFO:tasks.workunit.client.0.smithi161.stdout:5/804: creat dd/d15/d1a/d5d/dc9/dde/ffd x:0 0 0 2024-01-17T23:46:03.150 INFO:tasks.workunit.client.0.smithi161.stdout:1/896: unlink d1/d64/lab 0 2024-01-17T23:46:03.414 INFO:tasks.workunit.client.0.smithi161.stdout:3/875: dread d0/d5/d9/d38/d4f/d56/fb8 [0,4194304] 0 2024-01-17T23:46:03.415 INFO:tasks.workunit.client.0.smithi161.stdout:3/876: read d0/da2/fd1 [300467,81835] 0 2024-01-17T23:46:03.447 INFO:tasks.workunit.client.0.smithi161.stdout:3/877: dwrite d0/d5/d9/d17/fc6 [4194304,4194304] 0 2024-01-17T23:46:03.447 INFO:tasks.workunit.client.0.smithi161.stdout:3/878: chown d0/d5/d9/d1e/d3b/f78 1 1 2024-01-17T23:46:03.455 INFO:tasks.workunit.client.0.smithi161.stdout:7/814: dwrite da/fc [0,4194304] 0 2024-01-17T23:46:03.455 INFO:tasks.workunit.client.0.smithi161.stdout:7/815: chown da/d14/d35 7388 1 2024-01-17T23:46:04.327 INFO:tasks.workunit.client.0.smithi161.stdout:9/733: creat d0/d8/d14/d56/ff3 x:0 0 0 2024-01-17T23:46:04.597 INFO:tasks.workunit.client.0.smithi161.stdout:4/902: dread d9/de/d1e/f40 [0,4194304] 0 2024-01-17T23:46:04.817 INFO:tasks.workunit.client.0.smithi161.stdout:1/897: rmdir d1/d64/df2 39 2024-01-17T23:46:05.315 INFO:tasks.workunit.client.0.smithi161.stdout:6/830: link d6/d7/dc/d85/d31/f4e d6/d7/dc/d43/d79/f11a 0 2024-01-17T23:46:05.481 INFO:tasks.workunit.client.0.smithi161.stdout:2/823: getdents d8/d1c/d75/dae/de4 0 2024-01-17T23:46:05.609 INFO:tasks.workunit.client.0.smithi161.stdout:9/734: dread d0/d8/d14/d18/d20/d97/d9e/fad [0,4194304] 0 2024-01-17T23:46:05.609 INFO:tasks.workunit.client.0.smithi161.stdout:9/735: readlink d0/d8/d31/d58/ld8 0 2024-01-17T23:46:05.702 INFO:tasks.workunit.client.0.smithi161.stdout:5/805: getdents dd/d15/d1a/d5d/d64/d7c 0 2024-01-17T23:46:05.702 INFO:tasks.workunit.client.0.smithi161.stdout:5/806: dread - dd/d15/d4e/f66 zero size 2024-01-17T23:46:05.793 INFO:tasks.workunit.client.0.smithi161.stdout:4/903: creat d9/d27/d3a/d8b/d101/d104/d60/d8f/f117 x:0 0 0 2024-01-17T23:46:05.793 INFO:tasks.workunit.client.0.smithi161.stdout:4/904: creat d9/d51/d64/f118 x:0 0 0 2024-01-17T23:46:05.931 INFO:tasks.workunit.client.0.smithi161.stdout:1/898: rmdir d1/d20/d26/d30/d44 39 2024-01-17T23:46:05.931 INFO:tasks.workunit.client.0.smithi161.stdout:1/899: write d1/d8/d1f/f49 [2905655,23153] 0 2024-01-17T23:46:05.953 INFO:tasks.workunit.client.0.smithi161.stdout:1/900: write d1/d20/d26/d30/d44/fd9 [2093822,77984] 0 2024-01-17T23:46:06.033 INFO:tasks.workunit.client.0.smithi161.stdout:3/879: getdents d0/d5/d9/d38/d4f/d56 0 2024-01-17T23:46:06.258 INFO:tasks.workunit.client.0.smithi161.stdout:2/824: dread d8/d1c/d75/dc7/de5/f10f [0,4194304] 0 2024-01-17T23:46:06.258 INFO:tasks.workunit.client.0.smithi161.stdout:2/825: write d8/d1c/d75/dae/fd9 [945698,8583] 0 2024-01-17T23:46:06.322 INFO:tasks.workunit.client.0.smithi161.stdout:9/736: mknod d0/d8/d14/dab/cf4 0 2024-01-17T23:46:06.322 INFO:tasks.workunit.client.0.smithi161.stdout:9/737: dread - d0/d8/d31/d73/fc5 zero size 2024-01-17T23:46:06.322 INFO:tasks.workunit.client.0.smithi161.stdout:9/738: creat d0/d8/d14/d18/d20/ff5 x:0 0 0 2024-01-17T23:46:06.322 INFO:tasks.workunit.client.0.smithi161.stdout:9/739: chown d0/d8/d14/c35 4 1 2024-01-17T23:46:06.322 INFO:tasks.workunit.client.0.smithi161.stdout:9/740: fdatasync d0/d8/d31/f52 0 2024-01-17T23:46:06.322 INFO:tasks.workunit.client.0.smithi161.stdout:9/741: stat d0/d8/d14/d56/l5e 0 2024-01-17T23:46:06.322 INFO:tasks.workunit.client.0.smithi161.stdout:9/742: creat d0/d8/d14/d56/ff6 x:0 0 0 2024-01-17T23:46:06.628 INFO:tasks.workunit.client.0.smithi161.stdout:4/905: symlink d9/d1b/d24/d25/d5b/d97/l119 0 2024-01-17T23:46:06.628 INFO:tasks.workunit.client.0.smithi161.stdout:4/906: write d9/d51/d64/f118 [666461,86701] 0 2024-01-17T23:46:06.628 INFO:tasks.workunit.client.0.smithi161.stdout:4/907: fsync d9/d1b/d24/d25/d5b/d97/fad 0 2024-01-17T23:46:06.806 INFO:tasks.workunit.client.0.smithi161.stdout:1/901: dread d1/ff [0,4194304] 0 2024-01-17T23:46:06.806 INFO:tasks.workunit.client.0.smithi161.stdout:1/902: write d1/d20/d26/d30/d41/fb1 [99630,108412] 0 2024-01-17T23:46:06.806 INFO:tasks.workunit.client.0.smithi161.stdout:1/903: write d1/d8/d1f/d4b/f99 [706519,50049] 0 2024-01-17T23:46:06.806 INFO:tasks.workunit.client.0.smithi161.stdout:1/904: truncate d1/d31/dd1/f121 915885 0 2024-01-17T23:46:06.807 INFO:tasks.workunit.client.0.smithi161.stdout:1/905: chown d1/d64/df2 19086981 1 2024-01-17T23:46:07.127 INFO:tasks.workunit.client.0.smithi161.stdout:8/864: sync 2024-01-17T23:46:07.227 INFO:tasks.workunit.client.0.smithi161.stdout:2/826: unlink d8/da/d8d/cc2 0 2024-01-17T23:46:07.514 INFO:tasks.workunit.client.0.smithi161.stdout:4/908: symlink d9/d1b/d24/l11a 0 2024-01-17T23:46:07.514 INFO:tasks.workunit.client.0.smithi161.stdout:5/807: symlink dd/d15/d4e/lfe 0 2024-01-17T23:46:07.514 INFO:tasks.workunit.client.0.smithi161.stdout:4/909: chown d9/d27/d3a/d56/lce 1594931918 1 2024-01-17T23:46:07.514 INFO:tasks.workunit.client.0.smithi161.stdout:5/808: fsync dd/f12 0 2024-01-17T23:46:07.514 INFO:tasks.workunit.client.0.smithi161.stdout:4/910: chown d9/d27/d3a/d8b/d101/d104/d60/d9c 37158480 1 2024-01-17T23:46:07.533 INFO:tasks.workunit.client.0.smithi161.stdout:4/911: dread d9/d27/d3a/d87/fa3 [0,4194304] 0 2024-01-17T23:46:07.533 INFO:tasks.workunit.client.0.smithi161.stdout:4/912: dread - d9/d27/d3a/d8b/d101/d104/d60/d9c/dc7/ff5 zero size 2024-01-17T23:46:07.556 INFO:tasks.workunit.client.0.smithi161.stdout:5/809: dwrite dd/d15/d51/fb4 [0,4194304] 0 2024-01-17T23:46:07.556 INFO:tasks.workunit.client.0.smithi161.stdout:5/810: stat dd/d15/d1a/d42/cc5 0 2024-01-17T23:46:07.566 INFO:tasks.workunit.client.0.smithi161.stdout:4/913: dwrite d9/de/d1e/d38/f116 [0,4194304] 0 2024-01-17T23:46:07.612 INFO:tasks.workunit.client.0.smithi161.stdout:3/880: mkdir d0/d5/d9/d38/d4f/d9d/da7/d11b 0 2024-01-17T23:46:07.654 INFO:tasks.workunit.client.0.smithi161.stdout:3/881: dwrite d0/d5/d9/d1e/d3b/fdf [0,4194304] 0 2024-01-17T23:46:07.845 INFO:tasks.workunit.client.0.smithi161.stdout:8/865: mkdir d1/df/d16/dbf/d125 0 2024-01-17T23:46:07.848 INFO:tasks.workunit.client.0.smithi161.stdout:8/866: dread d1/df/d20/d6a/fea [0,4194304] 0 2024-01-17T23:46:07.848 INFO:tasks.workunit.client.0.smithi161.stdout:8/867: fdatasync d1/d3/f38 0 2024-01-17T23:46:07.848 INFO:tasks.workunit.client.0.smithi161.stdout:8/868: creat d1/df/d20/d2a/d53/f126 x:0 0 0 2024-01-17T23:46:07.848 INFO:tasks.workunit.client.0.smithi161.stdout:8/869: creat d1/df/d16/f127 x:0 0 0 2024-01-17T23:46:07.848 INFO:tasks.workunit.client.0.smithi161.stdout:8/870: chown d1/d3/d19/l77 3 1 2024-01-17T23:46:07.877 INFO:tasks.workunit.client.0.smithi161.stdout:2/827: dread d8/d1c/d57/f7f [4194304,4194304] 0 2024-01-17T23:46:08.049 INFO:tasks.workunit.client.0.smithi161.stdout:1/906: rename d1/d2d/ffc to d1/d8/d1c/d3e/f127 0 2024-01-17T23:46:08.074 INFO:tasks.workunit.client.0.smithi161.stdout:1/907: dwrite d1/d31/fca [0,4194304] 0 2024-01-17T23:46:08.075 INFO:tasks.workunit.client.0.smithi161.stdout:1/908: dread - d1/d8/d54/d94/f111 zero size 2024-01-17T23:46:08.434 INFO:tasks.workunit.client.0.smithi161.stdout:5/811: creat dd/d31/fff x:0 0 0 2024-01-17T23:46:08.461 INFO:tasks.workunit.client.0.smithi161.stdout:5/812: dwrite dd/d15/d1a/d5d/dc9/dcb/fed [0,4194304] 0 2024-01-17T23:46:09.424 INFO:tasks.workunit.client.0.smithi161.stdout:8/871: mknod d1/d22/c128 0 2024-01-17T23:46:09.532 INFO:tasks.workunit.client.0.smithi161.stdout:2/828: unlink d8/da/d8d/f97 0 2024-01-17T23:46:09.654 INFO:tasks.workunit.client.0.smithi161.stdout:9/743: link d0/d8/d31/d73/fc5 d0/d8/d14/d18/d20/da2/ff7 0 2024-01-17T23:46:10.194 INFO:tasks.workunit.client.0.smithi161.stdout:1/909: symlink d1/d8/d54/d94/l128 0 2024-01-17T23:46:10.602 INFO:tasks.workunit.client.0.smithi161.stdout:4/914: mkdir d9/de/d1e/d38/d6b/d11b 0 2024-01-17T23:46:10.602 INFO:tasks.workunit.client.0.smithi161.stdout:5/813: truncate dd/d31/f38 3181721 0 2024-01-17T23:46:10.602 INFO:tasks.workunit.client.0.smithi161.stdout:5/814: creat dd/d15/d1a/d5d/f100 x:0 0 0 2024-01-17T23:46:10.735 INFO:tasks.workunit.client.0.smithi161.stdout:8/872: dread d1/d22/d2f/d92/fa7 [4194304,4194304] 0 2024-01-17T23:46:11.008 INFO:tasks.workunit.client.0.smithi161.stdout:2/829: symlink d8/d1c/d75/l122 0 2024-01-17T23:46:11.288 INFO:tasks.workunit.client.0.smithi161.stdout:9/744: read d0/d8/d14/f3f [66875,60464] 0 2024-01-17T23:46:11.288 INFO:tasks.workunit.client.0.smithi161.stdout:9/745: chown d0/d8/d14/d18 17257 1 2024-01-17T23:46:11.288 INFO:tasks.workunit.client.0.smithi161.stdout:9/746: write d0/d39/d49/f57 [3918950,107977] 0 2024-01-17T23:46:11.304 INFO:tasks.workunit.client.0.smithi161.stdout:9/747: dread d0/d8/d14/d18/f55 [0,4194304] 0 2024-01-17T23:46:11.304 INFO:tasks.workunit.client.0.smithi161.stdout:9/748: write d0/d8/d14/f41 [215081,8862] 0 2024-01-17T23:46:11.304 INFO:tasks.workunit.client.0.smithi161.stdout:9/749: read - d0/d8/d14/d18/d20/ff0 zero size 2024-01-17T23:46:11.304 INFO:tasks.workunit.client.0.smithi161.stdout:9/750: write d0/d8/d31/d73/fed [782375,82833] 0 2024-01-17T23:46:11.489 INFO:tasks.workunit.client.0.smithi161.stdout:0/861: write d5/d34/d12/fd6 [1786498,95749] 0 2024-01-17T23:46:11.516 INFO:tasks.workunit.client.0.smithi161.stdout:0/862: dwrite f2 [4194304,4194304] 0 2024-01-17T23:46:11.963 INFO:tasks.workunit.client.0.smithi161.stdout:7/816: dwrite da/d34/d5a/f75 [0,4194304] 0 2024-01-17T23:46:12.031 INFO:tasks.workunit.client.0.smithi161.stdout:6/831: dwrite d6/d7/fe [8388608,4194304] 0 2024-01-17T23:46:12.031 INFO:tasks.workunit.client.0.smithi161.stdout:6/832: write d6/d7/dc/d43/f9b [281174,22386] 0 2024-01-17T23:46:12.031 INFO:tasks.workunit.client.0.smithi161.stdout:6/833: write d6/d7/dc/d85/d13/dcc/f116 [229238,111753] 0 2024-01-17T23:46:12.109 INFO:tasks.workunit.client.0.smithi161.stdout:4/915: rmdir d9/d27/d3a 39 2024-01-17T23:46:12.114 INFO:tasks.workunit.client.0.smithi161.stdout:4/916: read d9/de/d1e/f40 [800623,63695] 0 2024-01-17T23:46:12.410 INFO:tasks.workunit.client.0.smithi161.stdout:8/873: truncate d1/d3/d19/d1d/d25/d4b/f6b 2886957 0 2024-01-17T23:46:12.525 INFO:tasks.workunit.client.0.smithi161.stdout:2/830: read - d8/d1c/d75/dae/de4/f10a zero size 2024-01-17T23:46:12.945 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:46:12.949 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:46:14.135 INFO:tasks.workunit.client.0.smithi161.stdout:3/882: dwrite d0/d5/d9/d17/d32/f8e [0,4194304] 0 2024-01-17T23:46:14.203 INFO:tasks.workunit.client.0.smithi161.stdout:1/910: symlink d1/d11/d72/d81/l129 0 2024-01-17T23:46:14.480 INFO:tasks.workunit.client.0.smithi161.stdout:7/817: rmdir da/db/d7a/d8f/dac 39 2024-01-17T23:46:14.530 INFO:tasks.workunit.client.0.smithi161.stdout:6/834: dread d6/d7/dc/d85/d31/d5d/ff0 [0,4194304] 0 2024-01-17T23:46:14.704 INFO:tasks.workunit.client.0.smithi161.stdout:4/917: mknod d9/d27/d3a/d8b/d101/d104/d60/d8f/df7/c11c 0 2024-01-17T23:46:14.930 INFO:tasks.workunit.client.0.smithi161.stdout:8/874: symlink d1/df/d20/d2a/d53/l129 0 2024-01-17T23:46:14.949 INFO:tasks.workunit.client.0.smithi161.stdout:8/875: write d1/f58 [2131146,74748] 0 2024-01-17T23:46:15.069 INFO:tasks.workunit.client.0.smithi161.stdout:2/831: mkdir d8/d1c/d75/dae/de4/d84/d123 0 2024-01-17T23:46:15.069 INFO:tasks.workunit.client.0.smithi161.stdout:2/832: creat d8/d4b/d9a/f124 x:0 0 0 2024-01-17T23:46:15.097 INFO:tasks.workunit.client.0.smithi161.stdout:2/833: dwrite d8/da/f58 [0,4194304] 0 2024-01-17T23:46:15.220 INFO:tasks.workunit.client.0.smithi161.stdout:3/883: symlink d0/d5/d9/d17/d32/d102/l11c 0 2024-01-17T23:46:15.269 INFO:tasks.workunit.client.0.smithi161.stdout:3/884: dwrite d0/d5/d9/d1e/d3b/fff [0,4194304] 0 2024-01-17T23:46:15.579 INFO:tasks.workunit.client.0.smithi161.stdout:1/911: rename d1/d20/d26/d30/d8f/c96 to d1/d20/d26/d30/d44/c12a 0 2024-01-17T23:46:15.925 INFO:tasks.workunit.client.0.smithi161.stdout:6/835: creat d6/d7/dc/db2/f11b x:0 0 0 2024-01-17T23:46:15.925 INFO:tasks.workunit.client.0.smithi161.stdout:6/836: dread - d6/dfa/d10e/ff1 zero size 2024-01-17T23:46:15.947 INFO:tasks.workunit.client.0.smithi161.stdout:4/918: symlink d9/d51/d64/l11d 0 2024-01-17T23:46:15.947 INFO:tasks.workunit.client.0.smithi161.stdout:4/919: fsync d9/de/d69/fa7 0 2024-01-17T23:46:16.254 INFO:tasks.workunit.client.0.smithi161.stdout:8/876: creat d1/df/d16/d8c/f12a x:0 0 0 2024-01-17T23:46:16.254 INFO:tasks.workunit.client.0.smithi161.stdout:8/877: readlink d1/d3/d19/d1d/l65 0 2024-01-17T23:46:16.254 INFO:tasks.workunit.client.0.smithi161.stdout:8/878: dread - d1/df/d20/d2a/d56/fed zero size 2024-01-17T23:46:16.254 INFO:tasks.workunit.client.0.smithi161.stdout:8/879: truncate d1/df/d20/f11a 284904 0 2024-01-17T23:46:16.254 INFO:tasks.workunit.client.0.smithi161.stdout:8/880: chown d1/df/d20/d2a 272 1 2024-01-17T23:46:16.267 INFO:tasks.workunit.client.0.smithi161.stdout:8/881: dread d1/d22/d2f/f7a [0,4194304] 0 2024-01-17T23:46:16.267 INFO:tasks.workunit.client.0.smithi161.stdout:8/882: chown d1/d88/f95 15263 1 2024-01-17T23:46:16.323 INFO:tasks.workunit.client.0.smithi161.stdout:2/834: mkdir d8/d4b/d9a/db0/d125 0 2024-01-17T23:46:16.966 INFO:tasks.workunit.client.0.smithi161.stdout:1/912: creat d1/d20/d26/d30/d8f/f12b x:0 0 0 2024-01-17T23:46:17.026 INFO:tasks.workunit.client.0.smithi161.stdout:7/818: symlink da/d34/d5a/d28/d2b/l114 0 2024-01-17T23:46:17.026 INFO:tasks.workunit.client.0.smithi161.stdout:7/819: truncate da/db/d7a/d8f/fe4 156159 0 2024-01-17T23:46:17.026 INFO:tasks.workunit.client.0.smithi161.stdout:7/820: chown da/d34/d5a/da0/df8/d3d/d82/ce7 2 1 2024-01-17T23:46:17.053 INFO:tasks.workunit.client.0.smithi161.stdout:7/821: dwrite da/d14/d35/f10c [0,4194304] 0 2024-01-17T23:46:17.300 INFO:tasks.workunit.client.0.smithi161.stdout:6/837: rename d6/dfa/d10e/d81/f109 to d6/d7/dc/db2/f11c 0 2024-01-17T23:46:17.301 INFO:tasks.workunit.client.0.smithi161.stdout:6/838: dread - d6/d7/dc/db2/f11b zero size 2024-01-17T23:46:17.314 INFO:tasks.workunit.client.0.smithi161.stdout:6/839: read d6/d7/dc/d43/d79/f11a [3849921,74031] 0 2024-01-17T23:46:17.314 INFO:tasks.workunit.client.0.smithi161.stdout:6/840: write d6/dfa/d10d/f119 [210688,63618] 0 2024-01-17T23:46:17.320 INFO:tasks.workunit.client.0.smithi161.stdout:4/920: truncate d9/d51/d64/f70 359511 0 2024-01-17T23:46:17.321 INFO:tasks.workunit.client.0.smithi161.stdout:4/921: chown d9/de/lba 1 1 2024-01-17T23:46:17.333 INFO:tasks.workunit.client.0.smithi161.stdout:6/841: read d6/d7/dc/d85/d1a/f62 [3718366,91058] 0 2024-01-17T23:46:17.778 INFO:tasks.workunit.client.0.smithi161.stdout:2/835: symlink d8/d1c/d75/dae/de4/d84/l126 0 2024-01-17T23:46:17.779 INFO:tasks.workunit.client.0.smithi161.stdout:8/883: mknod d1/d3d/d51/c12b 0 2024-01-17T23:46:17.810 INFO:tasks.workunit.client.0.smithi161.stdout:8/884: dwrite d1/d3/f5b [0,4194304] 0 2024-01-17T23:46:17.832 INFO:tasks.workunit.client.0.smithi161.stdout:8/885: write d1/df/d20/d2a/d53/fba [4093253,103282] 0 2024-01-17T23:46:18.207 INFO:tasks.workunit.client.0.smithi161.stdout:1/913: symlink d1/d8/d9d/l12c 0 2024-01-17T23:46:18.208 INFO:tasks.workunit.client.0.smithi161.stdout:5/815: write dd/d31/fad [323379,27343] 0 2024-01-17T23:46:18.506 INFO:tasks.workunit.client.0.smithi161.stdout:3/885: symlink d0/d5/d9/d38/d4f/l11d 0 2024-01-17T23:46:18.506 INFO:tasks.workunit.client.0.smithi161.stdout:3/886: fsync d0/d5/d9/d1e/d3b/d52/daf/f110 0 2024-01-17T23:46:18.506 INFO:tasks.workunit.client.0.smithi161.stdout:3/887: chown d0/d5/d9/d17/d32/f89 17703 1 2024-01-17T23:46:18.517 INFO:tasks.workunit.client.0.smithi161.stdout:3/888: dread d0/d5/d9/f64 [4194304,4194304] 0 2024-01-17T23:46:18.543 INFO:tasks.workunit.client.0.smithi161.stdout:3/889: dwrite d0/d5/d9/d38/d4f/d56/d7c/fb2 [0,4194304] 0 2024-01-17T23:46:18.588 INFO:tasks.workunit.client.0.smithi161.stdout:7/822: symlink da/db/d7a/dc0/l115 0 2024-01-17T23:46:18.588 INFO:tasks.workunit.client.0.smithi161.stdout:7/823: truncate da/db/d7a/d8f/fe4 551342 0 2024-01-17T23:46:18.850 INFO:tasks.workunit.client.0.smithi161.stdout:4/922: mkdir d9/d51/d11e 0 2024-01-17T23:46:18.978 INFO:tasks.workunit.client.0.smithi161.stdout:6/842: creat d6/d7/dc/d85/d1a/f11d x:0 0 0 2024-01-17T23:46:19.119 INFO:tasks.workunit.client.0.smithi161.stdout:2/836: creat d8/d1c/d75/dae/de4/da8/f127 x:0 0 0 2024-01-17T23:46:19.119 INFO:tasks.workunit.client.0.smithi161.stdout:2/837: fdatasync d8/d1c/d75/dae/fd9 0 2024-01-17T23:46:19.119 INFO:tasks.workunit.client.0.smithi161.stdout:2/838: truncate d8/d1c/d1e/da6/f69 4222085 0 2024-01-17T23:46:19.378 INFO:tasks.workunit.client.0.smithi161.stdout:1/914: symlink d1/d8/d1c/l12d 0 2024-01-17T23:46:19.484 INFO:tasks.workunit.client.0.smithi161.stdout:5/816: getdents dd/d15 0 2024-01-17T23:46:20.042 INFO:tasks.workunit.client.0.smithi161.stdout:7/824: symlink da/db/d7a/da8/dd2/l116 0 2024-01-17T23:46:20.042 INFO:tasks.workunit.client.0.smithi161.stdout:4/923: mknod d9/d51/d64/dc4/de1/c11f 0 2024-01-17T23:46:20.042 INFO:tasks.workunit.client.0.smithi161.stdout:4/924: dread - d9/d27/d3a/d8b/ff1 zero size 2024-01-17T23:46:20.043 INFO:tasks.workunit.client.0.smithi161.stdout:7/825: write da/d34/f52 [1689840,54083] 0 2024-01-17T23:46:20.043 INFO:tasks.workunit.client.0.smithi161.stdout:4/925: write d9/d27/d3a/d8b/dcb/f78 [4654517,91925] 0 2024-01-17T23:46:20.064 INFO:tasks.workunit.client.0.smithi161.stdout:4/926: dwrite d9/d27/d3a/d8b/dcb/faf [0,4194304] 0 2024-01-17T23:46:20.111 INFO:tasks.workunit.client.0.smithi161.stdout:6/843: unlink d6/d7/dc/d85/d1a/d59/fdc 0 2024-01-17T23:46:20.140 INFO:tasks.workunit.client.0.smithi161.stdout:6/844: dwrite d6/fa [0,4194304] 0 2024-01-17T23:46:20.657 INFO:tasks.workunit.client.0.smithi161.stdout:0/863: dwrite d5/d3a/deb/dee/f38 [0,4194304] 0 2024-01-17T23:46:20.657 INFO:tasks.workunit.client.0.smithi161.stdout:0/864: chown d5/d34/d20/d2b/f56 12 1 2024-01-17T23:46:20.791 INFO:tasks.workunit.client.0.smithi161.stdout:9/751: sync 2024-01-17T23:46:20.945 INFO:tasks.workunit.client.0.smithi161.stdout:5/817: creat dd/d15/d1a/d5d/dd1/f101 x:0 0 0 2024-01-17T23:46:21.189 INFO:tasks.workunit.client.0.smithi161.stdout:7/826: creat da/d34/d5a/da0/df8/d3d/d7f/f117 x:0 0 0 2024-01-17T23:46:21.189 INFO:tasks.workunit.client.0.smithi161.stdout:7/827: fdatasync da/d34/d5a/da0/df8/f61 0 2024-01-17T23:46:21.584 INFO:tasks.workunit.client.0.smithi161.stdout:4/927: creat d9/d1b/d24/d25/d5b/f120 x:0 0 0 2024-01-17T23:46:21.644 INFO:tasks.workunit.client.0.smithi161.stdout:6/845: link d6/d7/dc/d85/d1a/d59/d8e/le2 d6/d7/dc/d43/dc3/l11e 0 2024-01-17T23:46:21.644 INFO:tasks.workunit.client.0.smithi161.stdout:6/846: creat d6/d7/dc/db2/f11f x:0 0 0 2024-01-17T23:46:22.317 INFO:tasks.workunit.client.0.smithi161.stdout:5/818: getdents dd/d15/d1a/d5d/d64/d7c/dd9 0 2024-01-17T23:46:22.317 INFO:tasks.workunit.client.0.smithi161.stdout:5/819: chown dd/d31/d7b/d78/f87 25129 1 2024-01-17T23:46:22.506 INFO:tasks.workunit.client.0.smithi161.stdout:7/828: getdents da/db 0 2024-01-17T23:46:22.634 INFO:tasks.workunit.client.0.smithi161.stdout:4/928: symlink d9/d27/d3a/d56/l121 0 2024-01-17T23:46:22.887 INFO:tasks.workunit.client.0.smithi161.stdout:6/847: mkdir d6/d7/dc/d43/dde/d120 0 2024-01-17T23:46:23.067 INFO:tasks.workunit.client.0.smithi161.stdout:3/890: rename d0/f77 to d0/d5/f11e 0 2024-01-17T23:46:23.237 INFO:tasks.workunit.client.0.smithi161.stdout:5/820: creat dd/d15/d1a/d5d/d64/d7c/f102 x:0 0 0 2024-01-17T23:46:23.237 INFO:tasks.workunit.client.0.smithi161.stdout:7/829: creat da/d34/d5a/d68/f118 x:0 0 0 2024-01-17T23:46:23.237 INFO:tasks.workunit.client.0.smithi161.stdout:5/821: creat dd/d15/d51/dbf/f103 x:0 0 0 2024-01-17T23:46:23.237 INFO:tasks.workunit.client.0.smithi161.stdout:5/822: write dd/d15/d51/dbf/ff9 [41897,91923] 0 2024-01-17T23:46:23.270 INFO:tasks.workunit.client.0.smithi161.stdout:7/830: dwrite da/d34/d5a/da0/df8/f4b [0,4194304] 0 2024-01-17T23:46:23.271 INFO:tasks.workunit.client.0.smithi161.stdout:7/831: stat da/db/db2/dbc/ffe 0 2024-01-17T23:46:23.271 INFO:tasks.workunit.client.0.smithi161.stdout:7/832: chown da/db/d7a/da8 53390 1 2024-01-17T23:46:23.271 INFO:tasks.workunit.client.0.smithi161.stdout:7/833: chown da/db/d7a/da8/fc9 6 1 2024-01-17T23:46:23.271 INFO:tasks.workunit.client.0.smithi161.stdout:7/834: fdatasync da/da7/fc2 0 2024-01-17T23:46:23.341 INFO:tasks.workunit.client.0.smithi161.stdout:4/929: unlink d9/d27/la8 0 2024-01-17T23:46:23.364 INFO:tasks.workunit.client.0.smithi161.stdout:4/930: dwrite d9/d51/d64/f118 [0,4194304] 0 2024-01-17T23:46:23.391 INFO:tasks.workunit.client.0.smithi161.stdout:4/931: dwrite d9/d1b/d53/fc1 [0,4194304] 0 2024-01-17T23:46:23.391 INFO:tasks.workunit.client.0.smithi161.stdout:4/932: readlink d9/d1b/d24/d25/d5b/l6e 0 2024-01-17T23:46:23.391 INFO:tasks.workunit.client.0.smithi161.stdout:4/933: truncate d9/d27/d3a/d8b/d101/d104/d60/f105 230355 0 2024-01-17T23:46:23.391 INFO:tasks.workunit.client.0.smithi161.stdout:4/934: fsync d9/d51/fca 0 2024-01-17T23:46:23.391 INFO:tasks.workunit.client.0.smithi161.stdout:4/935: chown d9/d27/d3a/d56/f5f 64 1 2024-01-17T23:46:23.391 INFO:tasks.workunit.client.0.smithi161.stdout:4/936: chown d9/d1b/d52/f59 81 1 2024-01-17T23:46:23.448 INFO:tasks.workunit.client.0.smithi161.stdout:6/848: truncate d6/d7/f8 1430602 0 2024-01-17T23:46:23.484 INFO:tasks.workunit.client.0.smithi161.stdout:6/849: dwrite d6/d7/dc/d85/d13/dcc/f116 [0,4194304] 0 2024-01-17T23:46:23.633 INFO:tasks.workunit.client.0.smithi161.stdout:2/839: rename d8/d68/f90 to d8/d1c/d75/dae/de4/f128 0 2024-01-17T23:46:23.633 INFO:tasks.workunit.client.0.smithi161.stdout:2/840: write d8/f6a [1282636,96476] 0 2024-01-17T23:46:23.691 INFO:tasks.workunit.client.0.smithi161.stdout:3/891: truncate d0/d5/d9/d17/d2d/f94 4805860 0 2024-01-17T23:46:24.243 INFO:tasks.workunit.client.0.smithi161.stdout:7/835: symlink da/d14/d35/d41/l119 0 2024-01-17T23:46:24.726 INFO:tasks.workunit.client.0.smithi161.stdout:0/865: creat d5/d34/f10f x:0 0 0 2024-01-17T23:46:25.297 INFO:tasks.workunit.client.0.smithi161.stdout:4/937: rmdir d9/de/d1e/d38/d89 39 2024-01-17T23:46:25.322 INFO:tasks.workunit.client.0.smithi161.stdout:4/938: read d9/d27/d68/fc9 [1972033,6098] 0 2024-01-17T23:46:25.353 INFO:tasks.workunit.client.0.smithi161.stdout:4/939: dwrite d9/d1b/f3b [0,4194304] 0 2024-01-17T23:46:25.353 INFO:tasks.workunit.client.0.smithi161.stdout:4/940: write d9/d27/d3a/d8b/dcb/fe3 [80244,46604] 0 2024-01-17T23:46:25.353 INFO:tasks.workunit.client.0.smithi161.stdout:4/941: write d9/d27/d3a/d87/fa3 [4265613,72311] 0 2024-01-17T23:46:25.377 INFO:tasks.workunit.client.0.smithi161.stdout:4/942: dwrite d9/d27/d3a/d8b/d101/d104/d60/f105 [0,4194304] 0 2024-01-17T23:46:25.722 INFO:tasks.workunit.client.0.smithi161.stdout:2/841: unlink d8/d1c/d1e/da6/d35/d3a/c56 0 2024-01-17T23:46:25.850 INFO:tasks.workunit.client.0.smithi161.stdout:3/892: dread d0/d5/d9/d17/fc6 [4194304,4194304] 0 2024-01-17T23:46:25.850 INFO:tasks.workunit.client.0.smithi161.stdout:3/893: chown d0/d5/d9/c8c 290168446 1 2024-01-17T23:46:26.083 INFO:tasks.workunit.client.0.smithi161.stdout:7/836: creat da/d34/d5a/d68/f11a x:0 0 0 2024-01-17T23:46:26.083 INFO:tasks.workunit.client.0.smithi161.stdout:7/837: chown da/d14/c71 185 1 2024-01-17T23:46:26.314 INFO:tasks.workunit.client.0.smithi161.stdout:0/866: mkdir d5/d3a/db4/d110 0 2024-01-17T23:46:27.910 INFO:tasks.workunit.client.0.smithi161.stdout:3/894: mkdir d0/d5/d9/d1e/d5a/d11f 0 2024-01-17T23:46:27.910 INFO:tasks.workunit.client.0.smithi161.stdout:3/895: write d0/d5/d9/d17/d32/fb1 [854653,73789] 0 2024-01-17T23:46:27.935 INFO:tasks.workunit.client.0.smithi161.stdout:3/896: dwrite d0/d5/d9/d1e/d5a/fd8 [0,4194304] 0 2024-01-17T23:46:28.379 INFO:tasks.workunit.client.0.smithi161.stdout:4/943: mknod d9/de/d1e/d38/d6b/c122 0 2024-01-17T23:46:28.506 INFO:tasks.workunit.client.0.smithi161.stdout:2/842: creat d8/d1c/d75/dc7/de5/de7/f129 x:0 0 0 2024-01-17T23:46:28.811 INFO:tasks.workunit.client.0.smithi161.stdout:3/897: truncate d0/d5/d9/d1e/d3b/fbb 29592 0 2024-01-17T23:46:28.879 INFO:tasks.workunit.client.0.smithi161.stdout:7/838: symlink da/d34/d5a/d28/d2b/l11b 0 2024-01-17T23:46:28.989 INFO:tasks.workunit.client.0.smithi161.stdout:0/867: mknod d5/d34/d12/c111 0 2024-01-17T23:46:29.013 INFO:tasks.workunit.client.0.smithi161.stdout:0/868: dread d5/d8/f1f [4194304,4194304] 0 2024-01-17T23:46:29.013 INFO:tasks.workunit.client.0.smithi161.stdout:0/869: stat d5/d3a/d49/d99 0 2024-01-17T23:46:29.013 INFO:tasks.workunit.client.0.smithi161.stdout:0/870: readlink d5/d34/d12/l4d 0 2024-01-17T23:46:29.040 INFO:tasks.workunit.client.0.smithi161.stdout:0/871: dwrite d5/d34/f10f [0,4194304] 0 2024-01-17T23:46:29.309 INFO:tasks.workunit.client.0.smithi161.stdout:2/843: creat d8/d1c/d57/f12a x:0 0 0 2024-01-17T23:46:29.309 INFO:tasks.workunit.client.0.smithi161.stdout:2/844: chown d8/d1c/f31 228914503 1 2024-01-17T23:46:29.408 INFO:tasks.workunit.client.0.smithi161.stdout:6/850: rmdir d6/d7/dc/d85/d1a/d59 39 2024-01-17T23:46:29.409 INFO:tasks.workunit.client.0.smithi161.stdout:3/898: read d0/d5/d9/d1e/f111 [165938,106810] 0 2024-01-17T23:46:29.834 INFO:tasks.workunit.client.0.smithi161.stdout:8/886: mknod d1/c12c 0 2024-01-17T23:46:29.938 INFO:tasks.workunit.client.0.smithi161.stdout:3/899: unlink d0/d5/d9/d38/db3/db4/d10b/f114 0 2024-01-17T23:46:29.993 INFO:tasks.workunit.client.0.smithi161.stdout:7/839: truncate da/d34/d4a/f5c 356111 0 2024-01-17T23:46:29.993 INFO:tasks.workunit.client.0.smithi161.stdout:7/840: dread - da/d34/d4a/d4c/f94 zero size 2024-01-17T23:46:30.132 INFO:tasks.workunit.client.0.smithi161.stdout:4/944: getdents d9/d27/d3a/d56 0 2024-01-17T23:46:30.132 INFO:tasks.workunit.client.0.smithi161.stdout:4/945: write d9/d1b/d24/f93 [4420528,114276] 0 2024-01-17T23:46:30.263 INFO:tasks.workunit.client.0.smithi161.stdout:8/887: symlink d1/d3/d19/d1d/daa/l12d 0 2024-01-17T23:46:30.264 INFO:tasks.workunit.client.0.smithi161.stdout:8/888: creat d1/df/d20/d2a/f12e x:0 0 0 2024-01-17T23:46:30.304 INFO:tasks.workunit.client.0.smithi161.stdout:3/900: creat d0/d5/d9/d1e/d3b/df4/f120 x:0 0 0 2024-01-17T23:46:30.304 INFO:tasks.workunit.client.0.smithi161.stdout:3/901: chown d0/d5/d9/d1e/d3b/f6f 39160 1 2024-01-17T23:46:30.305 INFO:tasks.workunit.client.0.smithi161.stdout:3/902: chown d0/d5/d9/d1e/d3b/fdf 9162214 1 2024-01-17T23:46:30.305 INFO:tasks.workunit.client.0.smithi161.stdout:3/903: chown d0/d5/d9/d1e/d5a/fe8 574805 1 2024-01-17T23:46:30.305 INFO:tasks.workunit.client.0.smithi161.stdout:3/904: fsync d0/d5/d9/d8b/fea 0 2024-01-17T23:46:31.189 INFO:tasks.workunit.client.0.smithi161.stdout:8/889: creat d1/d22/d2f/f12f x:0 0 0 2024-01-17T23:46:31.350 INFO:tasks.workunit.client.0.smithi161.stdout:3/905: link d0/da2/fe7 d0/d5/d9/d38/d4f/d50/f121 0 2024-01-17T23:46:31.376 INFO:tasks.workunit.client.0.smithi161.stdout:3/906: read d0/d5/f113 [2008614,4836] 0 2024-01-17T23:46:31.376 INFO:tasks.workunit.client.0.smithi161.stdout:3/907: creat d0/d5/d9/d38/db3/db4/d10b/f122 x:0 0 0 2024-01-17T23:46:32.917 INFO:tasks.workunit.client.0.smithi161.stdout:5/823: dwrite dd/d31/faf [0,4194304] 0 2024-01-17T23:46:33.134 INFO:tasks.workunit.client.0.smithi161.stdout:5/824: mkdir dd/d15/d51/dce/d104 0 2024-01-17T23:46:33.713 INFO:tasks.workunit.client.0.smithi161.stdout:5/825: rmdir dd/d15/d1a/d5d/d64/d7c/d86 39 2024-01-17T23:46:33.713 INFO:tasks.workunit.client.0.smithi161.stdout:9/752: creat d0/ff8 x:0 0 0 2024-01-17T23:46:33.713 INFO:tasks.workunit.client.0.smithi161.stdout:9/753: chown d0/d8/d14/f85 1112371 1 2024-01-17T23:46:33.713 INFO:tasks.workunit.client.0.smithi161.stdout:9/754: fsync d0/d8/d14/d18/d63/fe6 0 2024-01-17T23:46:33.758 INFO:tasks.workunit.client.0.smithi161.stdout:5/826: dwrite dd/d15/d1a/f43 [4194304,4194304] 0 2024-01-17T23:46:33.784 INFO:tasks.workunit.client.0.smithi161.stdout:1/915: sync 2024-01-17T23:46:33.839 INFO:tasks.workunit.client.0.smithi161.stdout:1/916: dwrite d1/d8/d1c/f48 [0,4194304] 0 2024-01-17T23:46:33.874 INFO:tasks.workunit.client.0.smithi161.stdout:1/917: dwrite d1/f3a [0,4194304] 0 2024-01-17T23:46:34.304 INFO:tasks.workunit.client.0.smithi161.stdout:7/841: write da/da7/fbe [884107,128313] 0 2024-01-17T23:46:34.346 INFO:tasks.workunit.client.0.smithi161.stdout:4/946: dwrite d9/f13 [0,4194304] 0 2024-01-17T23:46:34.346 INFO:tasks.workunit.client.0.smithi161.stdout:4/947: readlink d9/de/d1e/l29 0 2024-01-17T23:46:34.399 INFO:tasks.workunit.client.0.smithi161.stdout:8/890: dwrite d1/df/d20/d2a/f11d [0,4194304] 0 2024-01-17T23:46:34.419 INFO:tasks.workunit.client.0.smithi161.stdout:8/891: write d1/df/d46/fa5 [2232481,18966] 0 2024-01-17T23:46:34.571 INFO:tasks.workunit.client.0.smithi161.stdout:9/755: rmdir d0/d8/d14/d18/d20/d97/d9e/df1 0 2024-01-17T23:46:34.571 INFO:tasks.workunit.client.0.smithi161.stdout:9/756: chown d0/f51 52 1 2024-01-17T23:46:34.789 INFO:tasks.workunit.client.0.smithi161.stdout:5/827: fsync dd/d15/d4e/fd3 0 2024-01-17T23:46:35.090 INFO:tasks.workunit.client.0.smithi161.stdout:1/918: symlink d1/d20/d26/l12e 0 2024-01-17T23:46:35.090 INFO:tasks.workunit.client.0.smithi161.stdout:1/919: readlink d1/la7 0 2024-01-17T23:46:35.624 INFO:tasks.workunit.client.0.smithi161.stdout:8/892: dread d1/d3/d19/d1d/d25/f4d [0,4194304] 0 2024-01-17T23:46:35.653 INFO:tasks.workunit.client.0.smithi161.stdout:8/893: dwrite d1/df/d16/f2d [0,4194304] 0 2024-01-17T23:46:35.654 INFO:tasks.workunit.client.0.smithi161.stdout:8/894: write d1/df/d20/d6a/f6d [3371490,130972] 0 2024-01-17T23:46:35.677 INFO:tasks.workunit.client.0.smithi161.stdout:8/895: dread d1/d88/f90 [0,4194304] 0 2024-01-17T23:46:36.046 INFO:tasks.workunit.client.0.smithi161.stdout:5/828: link dd/d15/d4e/lfe dd/d15/d1a/d34/l105 0 2024-01-17T23:46:36.047 INFO:tasks.workunit.client.0.smithi161.stdout:5/829: chown dd/d15/f1c 20 1 2024-01-17T23:46:36.047 INFO:tasks.workunit.client.0.smithi161.stdout:5/830: chown dd/d15/d1a/d5d/dc9/dcb/lef 88385 1 2024-01-17T23:46:36.166 INFO:tasks.workunit.client.0.smithi161.stdout:1/920: rmdir d1/d11/d72 39 2024-01-17T23:46:36.702 INFO:tasks.workunit.client.0.smithi161.stdout:8/896: symlink d1/df/d20/d2a/d53/l130 0 2024-01-17T23:46:37.071 INFO:tasks.workunit.client.0.smithi161.stdout:1/921: mknod d1/d2d/dc1/c12f 0 2024-01-17T23:46:37.084 INFO:tasks.workunit.client.0.smithi161.stdout:8/897: mknod d1/d3/d19/d1d/c131 0 2024-01-17T23:46:37.103 INFO:tasks.workunit.client.0.smithi161.stdout:0/872: rename d5/d34/f47 to d5/d3a/deb/dee/f112 0 2024-01-17T23:46:37.568 INFO:tasks.workunit.client.0.smithi161.stdout:1/922: creat d1/d8/dfb/d112/f130 x:0 0 0 2024-01-17T23:46:37.568 INFO:tasks.workunit.client.0.smithi161.stdout:8/898: mkdir d1/d3/d19/d1d/daa/d132 0 2024-01-17T23:46:37.585 INFO:tasks.workunit.client.0.smithi161.stdout:1/923: dread d1/f38 [0,4194304] 0 2024-01-17T23:46:37.595 INFO:tasks.workunit.client.0.smithi161.stdout:8/899: dwrite d1/df/f31 [0,4194304] 0 2024-01-17T23:46:37.714 INFO:tasks.workunit.client.0.smithi161.stdout:0/873: dread d5/d3a/fa9 [0,4194304] 0 2024-01-17T23:46:37.913 INFO:tasks.workunit.client.0.smithi161.stdout:2/845: rename d8/d67/d6c/d72 to d8/d4b/d9a/db0/d125/d12b 0 2024-01-17T23:46:37.913 INFO:tasks.workunit.client.0.smithi161.stdout:7/842: write da/d34/d5a/da0/df8/f48 [325993,51182] 0 2024-01-17T23:46:37.913 INFO:tasks.workunit.client.0.smithi161.stdout:7/843: stat da/db/db2/ldf 0 2024-01-17T23:46:37.913 INFO:tasks.workunit.client.0.smithi161.stdout:2/846: creat d8/d1c/d75/dc7/de5/f12c x:0 0 0 2024-01-17T23:46:38.045 INFO:tasks.workunit.client.0.smithi161.stdout:4/948: write d9/d27/d3a/d87/fa3 [1510183,1721] 0 2024-01-17T23:46:38.318 INFO:tasks.workunit.client.0.smithi161.stdout:8/900: creat d1/d22/f133 x:0 0 0 2024-01-17T23:46:38.412 INFO:tasks.workunit.client.0.smithi161.stdout:0/874: mkdir d5/d34/d21/d113 0 2024-01-17T23:46:38.698 INFO:tasks.workunit.client.0.smithi161.stdout:6/851: rename d6/d7/dc/d85/d13/dcc/f116 to d6/d7/dc/d85/da4/f121 0 2024-01-17T23:46:38.699 INFO:tasks.workunit.client.0.smithi161.stdout:7/844: creat da/db/d7a/d8f/dac/f11c x:0 0 0 2024-01-17T23:46:38.744 INFO:tasks.workunit.client.0.smithi161.stdout:6/852: dwrite d6/d7/dc/d85/d31/d5d/d55/fb1 [0,4194304] 0 2024-01-17T23:46:38.747 INFO:tasks.workunit.client.0.smithi161.stdout:9/757: dwrite d0/d8/d14/d18/d20/da2/fbe [0,4194304] 0 2024-01-17T23:46:38.747 INFO:tasks.workunit.client.0.smithi161.stdout:9/758: chown d0/f51 48 1 2024-01-17T23:46:38.762 INFO:tasks.workunit.client.0.smithi161.stdout:9/759: dread d0/d8/d14/f85 [0,4194304] 0 2024-01-17T23:46:38.762 INFO:tasks.workunit.client.0.smithi161.stdout:9/760: creat d0/d8/d14/d18/d20/ff9 x:0 0 0 2024-01-17T23:46:39.362 INFO:tasks.workunit.client.0.smithi161.stdout:4/949: link d9/d51/cf2 d9/d1b/d24/d25/d5b/c123 0 2024-01-17T23:46:39.362 INFO:tasks.workunit.client.0.smithi161.stdout:4/950: fdatasync d9/f10 0 2024-01-17T23:46:39.573 INFO:tasks.workunit.client.0.smithi161.stdout:8/901: mkdir d1/d3/d19/d1d/df3/d134 0 2024-01-17T23:46:39.934 INFO:tasks.workunit.client.0.smithi161.stdout:7/845: getdents da/d34/d5a/d28 0 2024-01-17T23:46:39.960 INFO:tasks.workunit.client.0.smithi161.stdout:7/846: dwrite da/db/d7a/d8f/dac/f11c [0,4194304] 0 2024-01-17T23:46:40.126 INFO:tasks.workunit.client.0.smithi161.stdout:6/853: read d6/d7/dc/d43/dc3/d90/f93 [15154,85639] 0 2024-01-17T23:46:40.146 INFO:tasks.workunit.client.0.smithi161.stdout:5/831: dwrite dd/d15/d1a/d5d/d64/f8d [0,4194304] 0 2024-01-17T23:46:40.147 INFO:tasks.workunit.client.0.smithi161.stdout:5/832: write dd/d15/d1a/d34/fa7 [2105184,129585] 0 2024-01-17T23:46:40.649 INFO:tasks.workunit.client.0.smithi161.stdout:2/847: mknod d8/d4b/d9a/db0/d125/d12b/c12d 0 2024-01-17T23:46:40.649 INFO:tasks.workunit.client.0.smithi161.stdout:2/848: chown c0 40236 1 2024-01-17T23:46:40.650 INFO:tasks.workunit.client.0.smithi161.stdout:2/849: write d8/d1c/d75/dae/de4/da8/fb6 [565569,22801] 0 2024-01-17T23:46:40.937 INFO:tasks.workunit.client.0.smithi161.stdout:4/951: link d9/d27/d3a/d87/f10b d9/d27/d3a/d8b/d101/d104/d60/d9c/dc7/f124 0 2024-01-17T23:46:41.344 INFO:tasks.workunit.client.0.smithi161.stdout:3/908: rename d0/d5/d9/d38/d4f/d56 to d0/d5/d9/d1e/d5a/d8a/d123 0 2024-01-17T23:46:41.832 INFO:tasks.workunit.client.0.smithi161.stdout:7/847: mknod da/d34/d5a/da0/df8/d3d/c11d 0 2024-01-17T23:46:41.832 INFO:tasks.workunit.client.0.smithi161.stdout:7/848: creat da/d34/d5a/da0/df8/d3d/d7f/f11e x:0 0 0 2024-01-17T23:46:41.832 INFO:tasks.workunit.client.0.smithi161.stdout:7/849: chown da/d14/d35/d41/l77 89595373 1 2024-01-17T23:46:41.837 INFO:tasks.workunit.client.0.smithi161.stdout:7/850: dread da/db/f2a [0,4194304] 0 2024-01-17T23:46:41.837 INFO:tasks.workunit.client.0.smithi161.stdout:7/851: readlink da/db/d7a/l100 0 2024-01-17T23:46:41.837 INFO:tasks.workunit.client.0.smithi161.stdout:7/852: fdatasync da/d34/d5a/d68/d8c/fb6 0 2024-01-17T23:46:41.837 INFO:tasks.workunit.client.0.smithi161.stdout:7/853: readlink da/lc4 0 2024-01-17T23:46:41.837 INFO:tasks.workunit.client.0.smithi161.stdout:7/854: fsync da/d34/d5a/d28/d2b/fe8 0 2024-01-17T23:46:41.837 INFO:tasks.workunit.client.0.smithi161.stdout:7/855: stat da/db/db2/ldd 0 2024-01-17T23:46:41.855 INFO:tasks.workunit.client.0.smithi161.stdout:7/856: dread da/d34/d5a/f85 [0,4194304] 0 2024-01-17T23:46:41.855 INFO:tasks.workunit.client.0.smithi161.stdout:7/857: dread - da/db/d7a/da8/fc9 zero size 2024-01-17T23:46:41.864 INFO:tasks.workunit.client.0.smithi161.stdout:7/858: dread da/d34/d5a/f85 [0,4194304] 0 2024-01-17T23:46:41.915 INFO:tasks.workunit.client.0.smithi161.stdout:6/854: mknod d6/d7/dc/d85/d31/d5d/d55/c122 0 2024-01-17T23:46:41.915 INFO:tasks.workunit.client.0.smithi161.stdout:6/855: chown d6/d7/dc/d85/d13/f37 9757 1 2024-01-17T23:46:41.915 INFO:tasks.workunit.client.0.smithi161.stdout:6/856: creat d6/dfa/f123 x:0 0 0 2024-01-17T23:46:41.915 INFO:tasks.workunit.client.0.smithi161.stdout:6/857: truncate d6/d7/dc/d85/d31/fd4 449484 0 2024-01-17T23:46:42.246 INFO:tasks.workunit.client.0.smithi161.stdout:9/761: mkdir d0/d8/d14/d18/d20/d97/dae/dfa 0 2024-01-17T23:46:42.246 INFO:tasks.workunit.client.0.smithi161.stdout:9/762: fsync d0/d8/d14/d18/d20/d97/d9e/fb1 0 2024-01-17T23:46:42.246 INFO:tasks.workunit.client.0.smithi161.stdout:9/763: truncate d0/d8/d14/d18/d20/fe4 669874 0 2024-01-17T23:46:42.289 INFO:tasks.workunit.client.0.smithi161.stdout:2/850: dwrite d8/d1c/d57/fd5 [0,4194304] 0 2024-01-17T23:46:42.474 INFO:tasks.workunit.client.0.smithi161.stdout:4/952: mkdir d9/d51/d125 0 2024-01-17T23:46:42.598 INFO:tasks.workunit.client.0.smithi161.stdout:3/909: mknod d0/d5/d9/d17/d32/c124 0 2024-01-17T23:46:42.601 INFO:tasks.workunit.client.0.smithi161.stdout:3/910: write d0/d5/d9/d1e/d3b/d52/fbc [338,7690] 0 2024-01-17T23:46:42.981 INFO:tasks.workunit.client.0.smithi161.stdout:7/859: getdents da/d34 0 2024-01-17T23:46:43.010 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:46:43.013 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:46:43.231 INFO:tasks.workunit.client.0.smithi161.stdout:9/764: dread d0/d8/d14/dab/fb7 [0,4194304] 0 2024-01-17T23:46:43.246 INFO:tasks.workunit.client.0.smithi161.stdout:6/858: dread d6/d7/dc/d43/d79/fd6 [0,4194304] 0 2024-01-17T23:46:43.246 INFO:tasks.workunit.client.0.smithi161.stdout:6/859: chown d6/d7/dc/d43 18763 1 2024-01-17T23:46:43.431 INFO:tasks.workunit.client.0.smithi161.stdout:1/924: rename d1/d20/d26/fd4 to d1/d8/d1c/d3e/f131 0 2024-01-17T23:46:43.432 INFO:tasks.workunit.client.0.smithi161.stdout:2/851: truncate d8/d4b/f9c 2438860 0 2024-01-17T23:46:43.432 INFO:tasks.workunit.client.0.smithi161.stdout:1/925: creat d1/d2d/f132 x:0 0 0 2024-01-17T23:46:43.612 INFO:tasks.workunit.client.0.smithi161.stdout:4/953: getdents d9/d27/d3a/d8b/d101/d104/d60/d9c 0 2024-01-17T23:46:43.612 INFO:tasks.workunit.client.0.smithi161.stdout:4/954: chown d9/d27/d3a/d87/fa3 138506 1 2024-01-17T23:46:43.612 INFO:tasks.workunit.client.0.smithi161.stdout:4/955: fdatasync d9/d27/d3a/d8b/dcb/faf 0 2024-01-17T23:46:43.771 INFO:tasks.workunit.client.0.smithi161.stdout:3/911: symlink d0/d5/d9/d38/d4f/d9d/df7/l125 0 2024-01-17T23:46:43.858 INFO:tasks.workunit.client.0.smithi161.stdout:7/860: mkdir da/d34/d5a/de9/d11f 0 2024-01-17T23:46:43.874 INFO:tasks.workunit.client.0.smithi161.stdout:7/861: dread da/d34/d5a/d28/d2b/f45 [0,4194304] 0 2024-01-17T23:46:43.875 INFO:tasks.workunit.client.0.smithi161.stdout:7/862: stat da/db/d7a/d8f/fed 0 2024-01-17T23:46:44.362 INFO:tasks.workunit.client.0.smithi161.stdout:9/765: creat d0/d8/d31/d73/ffb x:0 0 0 2024-01-17T23:46:44.368 INFO:tasks.workunit.client.0.smithi161.stdout:9/766: dread d0/d8/d14/f3f [0,4194304] 0 2024-01-17T23:46:44.368 INFO:tasks.workunit.client.0.smithi161.stdout:9/767: write d0/d8/d14/d87/fe1 [946514,29919] 0 2024-01-17T23:46:44.432 INFO:tasks.workunit.client.0.smithi161.stdout:6/860: symlink d6/d7/dc/db2/l124 0 2024-01-17T23:46:45.190 INFO:tasks.workunit.client.0.smithi161.stdout:1/926: creat d1/d8/d54/d94/dd5/f133 x:0 0 0 2024-01-17T23:46:45.190 INFO:tasks.workunit.client.0.smithi161.stdout:1/927: dread - d1/d8/df1/ff3 zero size 2024-01-17T23:46:45.483 INFO:tasks.workunit.client.0.smithi161.stdout:4/956: fdatasync d9/de/d1e/d38/d6b/f76 0 2024-01-17T23:46:45.677 INFO:tasks.workunit.client.0.smithi161.stdout:7/863: unlink da/d34/d5a/d68/d8c/lb3 0 2024-01-17T23:46:45.827 INFO:tasks.workunit.client.0.smithi161.stdout:9/768: mknod d0/d8/d14/cfc 0 2024-01-17T23:46:45.961 INFO:tasks.workunit.client.0.smithi161.stdout:6/861: rmdir d6/d7/dc/d43/dc3/d113 0 2024-01-17T23:46:46.075 INFO:tasks.workunit.client.0.smithi161.stdout:0/875: rename d5/d3a/d49/fa2 to d5/d3a/f114 0 2024-01-17T23:46:46.374 INFO:tasks.workunit.client.0.smithi161.stdout:1/928: mknod d1/d8/d1c/c134 0 2024-01-17T23:46:46.669 INFO:tasks.workunit.client.0.smithi161.stdout:4/957: unlink d9/de/d69/lea 0 2024-01-17T23:46:46.687 INFO:tasks.workunit.client.0.smithi161.stdout:4/958: dread d9/d27/d3a/d87/f10b [0,4194304] 0 2024-01-17T23:46:46.710 INFO:tasks.workunit.client.0.smithi161.stdout:4/959: write d9/d1b/d24/d25/d5b/f8c [1226145,78683] 0 2024-01-17T23:46:46.743 INFO:tasks.workunit.client.0.smithi161.stdout:9/769: symlink d0/d8/d14/d18/d20/d97/d9e/lfd 0 2024-01-17T23:46:46.743 INFO:tasks.workunit.client.0.smithi161.stdout:9/770: stat d0/d8/d14/f65 0 2024-01-17T23:46:47.009 INFO:tasks.workunit.client.0.smithi161.stdout:6/862: creat d6/dfa/d10e/d81/f125 x:0 0 0 2024-01-17T23:46:47.041 INFO:tasks.workunit.client.0.smithi161.stdout:8/902: rename d1/d3/d19/d1d/d25/f3b to d1/d88/f135 0 2024-01-17T23:46:47.195 INFO:tasks.workunit.client.0.smithi161.stdout:0/876: creat d5/d3a/deb/dee/d35/f115 x:0 0 0 2024-01-17T23:46:47.435 INFO:tasks.workunit.client.0.smithi161.stdout:1/929: mknod d1/d11/d116/c135 0 2024-01-17T23:46:47.435 INFO:tasks.workunit.client.0.smithi161.stdout:1/930: chown d1/d20/d26/d32/c3c 1536858 1 2024-01-17T23:46:47.435 INFO:tasks.workunit.client.0.smithi161.stdout:1/931: write d1/d8/d1f/dd3/f108 [95762,110772] 0 2024-01-17T23:46:47.462 INFO:tasks.workunit.client.0.smithi161.stdout:1/932: dwrite d1/d20/d26/d30/ff7 [0,4194304] 0 2024-01-17T23:46:47.656 INFO:tasks.workunit.client.0.smithi161.stdout:9/771: truncate d0/d8/d14/f85 3672537 0 2024-01-17T23:46:47.675 INFO:tasks.workunit.client.0.smithi161.stdout:9/772: dread d0/d8/d14/d18/d63/faa [0,4194304] 0 2024-01-17T23:46:47.698 INFO:tasks.workunit.client.0.smithi161.stdout:9/773: dwrite d0/d8/d31/d58/fa4 [0,4194304] 0 2024-01-17T23:46:47.973 INFO:tasks.workunit.client.0.smithi161.stdout:6/863: unlink d6/d7/dc/d85/d1a/f11d 0 2024-01-17T23:46:47.973 INFO:tasks.workunit.client.0.smithi161.stdout:6/864: stat d6/d7/dc/d85/d13/dcc/d10c 0 2024-01-17T23:46:48.052 INFO:tasks.workunit.client.0.smithi161.stdout:3/912: rename d0/d5/d9/d1e/d3b/l41 to d0/d5/d9/d38/db3/db4/l126 0 2024-01-17T23:46:48.178 INFO:tasks.workunit.client.0.smithi161.stdout:8/903: truncate d1/d3/d19/d1d/f9b 157828 0 2024-01-17T23:46:48.335 INFO:tasks.workunit.client.0.smithi161.stdout:0/877: mknod d5/df6/d6b/da7/c116 0 2024-01-17T23:46:48.362 INFO:tasks.workunit.client.0.smithi161.stdout:0/878: dwrite d5/df6/db0/dcc/df1/f104 [0,4194304] 0 2024-01-17T23:46:49.129 INFO:tasks.workunit.client.0.smithi161.stdout:6/865: chown d6/d7/dc/l25 5493360 1 2024-01-17T23:46:49.254 INFO:tasks.workunit.client.0.smithi161.stdout:4/960: rename d9/d1b/d24/l67 to d9/d27/d3a/l126 0 2024-01-17T23:46:49.255 INFO:tasks.workunit.client.0.smithi161.stdout:4/961: chown d9/de/d1e/d38/d89/dd8 1 1 2024-01-17T23:46:49.275 INFO:tasks.workunit.client.0.smithi161.stdout:4/962: dwrite d9/d27/d3a/d8b/d101/d104/d60/d8f/fa6 [0,4194304] 0 2024-01-17T23:46:49.339 INFO:tasks.workunit.client.0.smithi161.stdout:3/913: getdents d0/d5/d9/d38/db3 0 2024-01-17T23:46:49.760 INFO:tasks.workunit.client.0.smithi161.stdout:0/879: unlink d5/d34/d8a/la5 0 2024-01-17T23:46:50.430 INFO:tasks.workunit.client.0.smithi161.stdout:4/963: unlink d9/d1b/f10a 0 2024-01-17T23:46:50.430 INFO:tasks.workunit.client.0.smithi161.stdout:7/864: unlink da/d34/ca5 0 2024-01-17T23:46:50.430 INFO:tasks.workunit.client.0.smithi161.stdout:7/865: fsync da/faa 0 2024-01-17T23:46:50.439 INFO:tasks.workunit.client.0.smithi161.stdout:4/964: dread d9/d27/d3a/d8b/d101/d104/f72 [0,4194304] 0 2024-01-17T23:46:50.439 INFO:tasks.workunit.client.0.smithi161.stdout:4/965: stat d9/d51/d64 0 2024-01-17T23:46:50.474 INFO:tasks.workunit.client.0.smithi161.stdout:4/966: dwrite d9/d1b/d24/d25/d5b/fa5 [0,4194304] 0 2024-01-17T23:46:50.519 INFO:tasks.workunit.client.0.smithi161.stdout:3/914: rmdir d0/d5/d9/d1e/d5a/d11f 0 2024-01-17T23:46:50.519 INFO:tasks.workunit.client.0.smithi161.stdout:3/915: chown d0/d5 14277549 1 2024-01-17T23:46:50.627 INFO:tasks.workunit.client.0.smithi161.stdout:5/833: link dd/d15/d1a/d5d/dc9/dcb/lef dd/d15/l106 0 2024-01-17T23:46:50.958 INFO:tasks.workunit.client.0.smithi161.stdout:0/880: link d5/d34/d20/d2b/f91 d5/df6/db0/f117 0 2024-01-17T23:46:51.183 INFO:tasks.workunit.client.0.smithi161.stdout:1/933: symlink d1/d64/df2/l136 0 2024-01-17T23:46:51.183 INFO:tasks.workunit.client.0.smithi161.stdout:1/934: getdents d1/d20/d26/d30/d8f/d9e/d10e 0 2024-01-17T23:46:51.183 INFO:tasks.workunit.client.0.smithi161.stdout:1/935: chown d1/l16 511005 1 2024-01-17T23:46:51.227 INFO:tasks.workunit.client.0.smithi161.stdout:6/866: getdents d6/d7/dc/d43/dc3/dda 0 2024-01-17T23:46:51.475 INFO:tasks.workunit.client.0.smithi161.stdout:7/866: rmdir da/db/d7a/d8f/dde/d101 0 2024-01-17T23:46:51.723 INFO:tasks.workunit.client.0.smithi161.stdout:4/967: symlink d9/de/d1e/l127 0 2024-01-17T23:46:51.868 INFO:tasks.workunit.client.0.smithi161.stdout:3/916: symlink d0/d5/d9/d17/l127 0 2024-01-17T23:46:51.868 INFO:tasks.workunit.client.0.smithi161.stdout:3/917: fdatasync d0/d5/d9/d17/d2d/fa4 0 2024-01-17T23:46:51.898 INFO:tasks.workunit.client.0.smithi161.stdout:5/834: symlink dd/d15/d1a/d5d/d64/d7c/d86/l107 0 2024-01-17T23:46:51.918 INFO:tasks.workunit.client.0.smithi161.stdout:5/835: dread dd/d15/d1a/d42/f58 [0,4194304] 0 2024-01-17T23:46:51.918 INFO:tasks.workunit.client.0.smithi161.stdout:5/836: chown dd/d15/d1a/c76 1633617818 1 2024-01-17T23:46:51.918 INFO:tasks.workunit.client.0.smithi161.stdout:5/837: read dd/d15/d1a/d5d/d64/f79 [69127,22081] 0 2024-01-17T23:46:52.160 INFO:tasks.workunit.client.0.smithi161.stdout:1/936: creat d1/d11/d116/f137 x:0 0 0 2024-01-17T23:46:52.310 INFO:tasks.workunit.client.0.smithi161.stdout:6/867: truncate d6/d7/dc/d43/f9b 291781 0 2024-01-17T23:46:52.690 INFO:tasks.workunit.client.0.smithi161.stdout:4/968: mkdir d9/d1b/d24/d25/d128 0 2024-01-17T23:46:52.690 INFO:tasks.workunit.client.0.smithi161.stdout:4/969: write d9/d1b/d24/f2e [3018757,83640] 0 2024-01-17T23:46:53.247 INFO:tasks.workunit.client.0.smithi161.stdout:6/868: creat d6/d7/dc/dca/f126 x:0 0 0 2024-01-17T23:46:53.377 INFO:tasks.workunit.client.0.smithi161.stdout:4/970: unlink d9/de/d1e/l2d 0 2024-01-17T23:46:53.377 INFO:tasks.workunit.client.0.smithi161.stdout:4/971: chown d9/de/l42 4698 1 2024-01-17T23:46:53.388 INFO:tasks.workunit.client.0.smithi161.stdout:4/972: dread d9/d1b/f3b [0,4194304] 0 2024-01-17T23:46:53.599 INFO:tasks.workunit.client.0.smithi161.stdout:6/869: symlink d6/dfc/l127 0 2024-01-17T23:46:53.599 INFO:tasks.workunit.client.0.smithi161.stdout:6/870: chown d6/d7/dc/d85/d31/d5d/cbe 3 1 2024-01-17T23:46:53.805 INFO:tasks.workunit.client.0.smithi161.stdout:4/973: creat d9/d27/f129 x:0 0 0 2024-01-17T23:46:53.805 INFO:tasks.workunit.client.0.smithi161.stdout:4/974: chown d9/de/d1e/d38/d6b/d11b 6899 1 2024-01-17T23:46:53.894 INFO:tasks.workunit.client.0.smithi161.stdout:6/871: symlink d6/d7/dc/d85/d31/d5d/d55/l128 0 2024-01-17T23:46:53.908 INFO:tasks.workunit.client.0.smithi161.stdout:6/872: dread d6/d7/dc/d85/d31/f97 [0,4194304] 0 2024-01-17T23:46:53.926 INFO:tasks.workunit.client.0.smithi161.stdout:6/873: write d6/fa [3291454,7559] 0 2024-01-17T23:46:53.926 INFO:tasks.workunit.client.0.smithi161.stdout:6/874: read - d6/d7/dc/d43/d79/fea zero size 2024-01-17T23:46:53.926 INFO:tasks.workunit.client.0.smithi161.stdout:6/875: fsync d6/dfa/d10e/db4/fcb 0 2024-01-17T23:46:53.946 INFO:tasks.workunit.client.0.smithi161.stdout:6/876: dwrite d6/dfa/d10e/ff1 [0,4194304] 0 2024-01-17T23:46:53.959 INFO:tasks.workunit.client.0.smithi161.stdout:6/877: dread d6/d7/dc/d85/f98 [0,4194304] 0 2024-01-17T23:46:53.990 INFO:tasks.workunit.client.0.smithi161.stdout:2/852: truncate d8/d4b/f9c 2983496 0 2024-01-17T23:46:54.000 INFO:tasks.workunit.client.0.smithi161.stdout:2/853: dread d8/f18 [0,4194304] 0 2024-01-17T23:46:54.049 INFO:tasks.workunit.client.0.smithi161.stdout:4/975: mkdir d9/d27/d68/d12a 0 2024-01-17T23:46:54.076 INFO:tasks.workunit.client.0.smithi161.stdout:4/976: dwrite d9/d1b/f3b [0,4194304] 0 2024-01-17T23:46:54.480 INFO:tasks.workunit.client.0.smithi161.stdout:6/878: creat d6/d7/f129 x:0 0 0 2024-01-17T23:46:54.480 INFO:tasks.workunit.client.0.smithi161.stdout:6/879: write d6/d7/dc/d85/d13/dcc/fe7 [152542,125972] 0 2024-01-17T23:46:54.590 INFO:tasks.workunit.client.0.smithi161.stdout:2/854: mknod d8/db8/c12e 0 2024-01-17T23:46:57.607 INFO:tasks.workunit.client.0.smithi161.stdout:8/904: rename d1/d3/d19/d1d/daa to d1/d3d/d51/d136 0 2024-01-17T23:46:57.642 INFO:tasks.workunit.client.0.smithi161.stdout:3/918: dwrite d0/d5/f19 [0,4194304] 0 2024-01-17T23:46:57.656 INFO:tasks.workunit.client.0.smithi161.stdout:1/937: dwrite d1/d20/d26/d30/fcf [0,4194304] 0 2024-01-17T23:46:57.671 INFO:tasks.workunit.client.0.smithi161.stdout:3/919: dwrite d0/da2/fd1 [4194304,4194304] 0 2024-01-17T23:46:57.703 INFO:tasks.workunit.client.0.smithi161.stdout:3/920: dwrite d0/d5/d9/d17/d2d/fa4 [0,4194304] 0 2024-01-17T23:46:57.703 INFO:tasks.workunit.client.0.smithi161.stdout:3/921: chown d0/d5/d9/d38/d4f/d9d/da7/d11b 1 1 2024-01-17T23:46:57.725 INFO:tasks.workunit.client.0.smithi161.stdout:3/922: read d0/d5/d9/d1e/d5a/fb9 [2214581,46513] 0 2024-01-17T23:46:57.725 INFO:tasks.workunit.client.0.smithi161.stdout:3/923: write d0/d5/d9/d17/d32/f89 [141343,106790] 0 2024-01-17T23:46:57.725 INFO:tasks.workunit.client.0.smithi161.stdout:3/924: fdatasync d0/d5/d9/d17/f36 0 2024-01-17T23:46:57.744 INFO:tasks.workunit.client.0.smithi161.stdout:3/925: dread d0/f2e [0,4194304] 0 2024-01-17T23:46:57.862 INFO:tasks.workunit.client.0.smithi161.stdout:4/977: dwrite d9/d27/d3a/d8b/d101/d104/d60/d9c/dc7/de7/f109 [0,4194304] 0 2024-01-17T23:46:58.064 INFO:tasks.workunit.client.0.smithi161.stdout:9/774: rename d0/d8/d14/d18/l1e to d0/d8/d14/d18/d20/da2/dcb/lfe 0 2024-01-17T23:46:58.652 INFO:tasks.workunit.client.0.smithi161.stdout:3/926: getdents d0/d5/d9/d1e/d5a 0 2024-01-17T23:46:58.822 INFO:tasks.workunit.client.0.smithi161.stdout:4/978: unlink d9/de/d1e/d38/d89/dd8/c107 0 2024-01-17T23:46:59.410 INFO:tasks.workunit.client.0.smithi161.stdout:8/905: unlink d1/d22/cbc 0 2024-01-17T23:46:59.410 INFO:tasks.workunit.client.0.smithi161.stdout:9/775: creat d0/d8/d14/d18/d20/fff x:0 0 0 2024-01-17T23:46:59.527 INFO:tasks.workunit.client.0.smithi161.stdout:4/979: truncate d9/f10 2994515 0 2024-01-17T23:47:00.035 INFO:tasks.workunit.client.0.smithi161.stdout:0/881: rename d5/f25 to d5/df6/db0/dcc/dfe/f118 0 2024-01-17T23:47:00.036 INFO:tasks.workunit.client.0.smithi161.stdout:0/882: creat d5/d3a/db4/dc1/f119 x:0 0 0 2024-01-17T23:47:00.036 INFO:tasks.workunit.client.0.smithi161.stdout:8/906: mkdir d1/df/d16/dbf/d125/d137 0 2024-01-17T23:47:00.036 INFO:tasks.workunit.client.0.smithi161.stdout:0/883: chown d5/d34/d20/l9f 215 1 2024-01-17T23:47:00.036 INFO:tasks.workunit.client.0.smithi161.stdout:8/907: chown d1/d3/ld 0 1 2024-01-17T23:47:00.036 INFO:tasks.workunit.client.0.smithi161.stdout:8/908: truncate d1/d3/d19/d1d/f36 5143210 0 2024-01-17T23:47:00.036 INFO:tasks.workunit.client.0.smithi161.stdout:8/909: truncate d1/d3/f12 4437472 0 2024-01-17T23:47:00.054 INFO:tasks.workunit.client.0.smithi161.stdout:8/910: dread d1/d88/f90 [0,4194304] 0 2024-01-17T23:47:00.056 INFO:tasks.workunit.client.0.smithi161.stdout:9/776: mkdir d0/d8/d14/d56/d100 0 2024-01-17T23:47:00.528 INFO:tasks.workunit.client.0.smithi161.stdout:7/867: rename da/d34/d5a/d28/d2b/d93/fe2 to da/db/d7a/f120 0 2024-01-17T23:47:00.529 INFO:tasks.workunit.client.0.smithi161.stdout:7/868: chown da/db/d7a/dc0 2154395 1 2024-01-17T23:47:00.529 INFO:tasks.workunit.client.0.smithi161.stdout:7/869: read da/d34/d5a/da0/df8/f48 [607229,67040] 0 2024-01-17T23:47:00.871 INFO:tasks.workunit.client.0.smithi161.stdout:5/838: creat dd/d15/d1a/d5d/f108 x:0 0 0 2024-01-17T23:47:00.871 INFO:tasks.workunit.client.0.smithi161.stdout:5/839: fsync dd/d31/fff 0 2024-01-17T23:47:01.518 INFO:tasks.workunit.client.0.smithi161.stdout:2/855: rename d8/d1c/d1e/f38 to d8/d67/d6c/f12f 0 2024-01-17T23:47:01.518 INFO:tasks.workunit.client.0.smithi161.stdout:2/856: write d8/d1c/d75/dc7/de5/f12c [238964,17884] 0 2024-01-17T23:47:01.518 INFO:tasks.workunit.client.0.smithi161.stdout:2/857: dread - d8/d1c/d75/dae/dc3/f11c zero size 2024-01-17T23:47:01.541 INFO:tasks.workunit.client.0.smithi161.stdout:2/858: write d8/d67/ff4 [920865,18354] 0 2024-01-17T23:47:01.559 INFO:tasks.workunit.client.0.smithi161.stdout:2/859: dread d8/d1c/d75/dae/dc3/f53 [0,4194304] 0 2024-01-17T23:47:01.586 INFO:tasks.workunit.client.0.smithi161.stdout:2/860: dwrite d8/db8/ff0 [0,4194304] 0 2024-01-17T23:47:01.894 INFO:tasks.workunit.client.0.smithi161.stdout:9/777: mkdir d0/d101 0 2024-01-17T23:47:02.184 INFO:tasks.workunit.client.0.smithi161.stdout:1/938: rename d1/d8/d54/fde to d1/d8/d1c/f138 0 2024-01-17T23:47:02.205 INFO:tasks.workunit.client.0.smithi161.stdout:1/939: dread d1/f3a [0,4194304] 0 2024-01-17T23:47:02.240 INFO:tasks.workunit.client.0.smithi161.stdout:1/940: dwrite d1/d11/d72/d81/f82 [0,4194304] 0 2024-01-17T23:47:02.477 INFO:tasks.workunit.client.0.smithi161.stdout:2/861: creat d8/d4b/d9a/db0/f130 x:0 0 0 2024-01-17T23:47:03.119 INFO:tasks.workunit.client.0.smithi161.stdout:4/980: dwrite d9/f13 [4194304,4194304] 0 2024-01-17T23:47:03.290 INFO:tasks.workunit.client.0.smithi161.stdout:3/927: rename d0/d5/d9/d1e/d3b/fdf to d0/d5/d9/d17/d5c/f128 0 2024-01-17T23:47:03.531 INFO:tasks.workunit.client.0.smithi161.stdout:0/884: write d5/d3a/d49/fa1 [439446,52800] 0 2024-01-17T23:47:03.756 INFO:tasks.workunit.client.0.smithi161.stdout:9/778: symlink d0/d8/d14/d18/d20/d97/dae/l102 0 2024-01-17T23:47:03.769 INFO:tasks.workunit.client.0.smithi161.stdout:9/779: dread d0/d8/d31/f68 [0,4194304] 0 2024-01-17T23:47:03.776 INFO:tasks.workunit.client.0.smithi161.stdout:9/780: dread d0/d8/f10 [0,4194304] 0 2024-01-17T23:47:03.789 INFO:tasks.workunit.client.0.smithi161.stdout:9/781: dread d0/d8/d31/d58/fd0 [0,4194304] 0 2024-01-17T23:47:03.855 INFO:tasks.workunit.client.0.smithi161.stdout:6/880: sync 2024-01-17T23:47:03.873 INFO:tasks.workunit.client.0.smithi161.stdout:6/881: dread d6/fed [0,4194304] 0 2024-01-17T23:47:03.873 INFO:tasks.workunit.client.0.smithi161.stdout:6/882: fsync d6/d58/fa9 0 2024-01-17T23:47:03.898 INFO:tasks.workunit.client.0.smithi161.stdout:6/883: dwrite d6/d7/dc/d43/d79/f8a [0,4194304] 0 2024-01-17T23:47:04.155 INFO:tasks.workunit.client.0.smithi161.stdout:3/928: rmdir d0/d5/d9/d38/d4f/d9d/da7/d11b 0 2024-01-17T23:47:04.287 INFO:tasks.workunit.client.0.smithi161.stdout:1/941: mkdir d1/d11/d72/d81/d139 0 2024-01-17T23:47:04.287 INFO:tasks.workunit.client.0.smithi161.stdout:1/942: write d1/d8/d9d/fcd [1017250,56330] 0 2024-01-17T23:47:04.290 INFO:tasks.workunit.client.0.smithi161.stdout:8/911: sync 2024-01-17T23:47:04.315 INFO:tasks.workunit.client.0.smithi161.stdout:1/943: dwrite d1/d8/d1f/f25 [4194304,4194304] 0 2024-01-17T23:47:04.331 INFO:tasks.workunit.client.0.smithi161.stdout:1/944: read d1/d2d/feb [2299892,100932] 0 2024-01-17T23:47:04.331 INFO:tasks.workunit.client.0.smithi161.stdout:1/945: fsync d1/d11/f119 0 2024-01-17T23:47:04.486 INFO:tasks.workunit.client.0.smithi161.stdout:0/885: creat d5/df6/f11a x:0 0 0 2024-01-17T23:47:04.486 INFO:tasks.workunit.client.0.smithi161.stdout:0/886: stat d5/df6/db0/fd3 0 2024-01-17T23:47:04.486 INFO:tasks.workunit.client.0.smithi161.stdout:0/887: readlink d5/d34/l15 0 2024-01-17T23:47:04.585 INFO:tasks.workunit.client.0.smithi161.stdout:9/782: symlink d0/d8/d14/d87/l103 0 2024-01-17T23:47:04.753 INFO:tasks.workunit.client.0.smithi161.stdout:4/981: mkdir d9/d1b/d24/d25/d12b 0 2024-01-17T23:47:04.769 INFO:tasks.workunit.client.0.smithi161.stdout:4/982: dread d9/d27/d68/fc9 [0,4194304] 0 2024-01-17T23:47:05.234 INFO:tasks.workunit.client.0.smithi161.stdout:7/870: rename da/d34/d4a/l60 to da/d34/d5a/da0/df8/d3d/d82/l121 0 2024-01-17T23:47:05.461 INFO:tasks.workunit.client.0.smithi161.stdout:3/929: dread d0/d5/d9/d38/d4f/d9d/da7/f79 [0,4194304] 0 2024-01-17T23:47:05.461 INFO:tasks.workunit.client.0.smithi161.stdout:3/930: write d0/d5/d9/d1e/f7b [1955677,65056] 0 2024-01-17T23:47:05.461 INFO:tasks.workunit.client.0.smithi161.stdout:3/931: write d0/da2/fe7 [4555258,26666] 0 2024-01-17T23:47:05.461 INFO:tasks.workunit.client.0.smithi161.stdout:3/932: chown d0/d5/d9/d38/d4f/d9d/df7 29183 1 2024-01-17T23:47:05.573 INFO:tasks.workunit.client.0.smithi161.stdout:8/912: mkdir d1/d3/d19/df2/d138 0 2024-01-17T23:47:05.573 INFO:tasks.workunit.client.0.smithi161.stdout:8/913: write d1/df/d20/d6a/f91 [1401055,60658] 0 2024-01-17T23:47:06.150 INFO:tasks.workunit.client.0.smithi161.stdout:4/983: fdatasync d9/de/d1e/d38/d6b/f7d 0 2024-01-17T23:47:06.233 INFO:tasks.workunit.client.0.smithi161.stdout:5/840: dwrite dd/d15/d4e/d4f/f61 [0,4194304] 0 2024-01-17T23:47:06.233 INFO:tasks.workunit.client.0.smithi161.stdout:5/841: creat dd/d31/d3c/f109 x:0 0 0 2024-01-17T23:47:06.310 INFO:tasks.workunit.client.0.smithi161.stdout:1/946: rename d1/d20/d26/d30/f9f to d1/d20/d26/d30/d8f/d9e/d10e/f13a 0 2024-01-17T23:47:06.704 INFO:tasks.workunit.client.0.smithi161.stdout:3/933: creat d0/d5/d9/d38/d4f/d9d/da7/f129 x:0 0 0 2024-01-17T23:47:06.709 INFO:tasks.workunit.client.0.smithi161.stdout:3/934: dread d0/d5/d9/f108 [0,4194304] 0 2024-01-17T23:47:06.725 INFO:tasks.workunit.client.0.smithi161.stdout:8/914: dread - d1/d22/dbd/dce/f10d zero size 2024-01-17T23:47:06.726 INFO:tasks.workunit.client.0.smithi161.stdout:5/842: getdents dd/d15/d1a/d5d/d64/d7c/d88 0 2024-01-17T23:47:06.726 INFO:tasks.workunit.client.0.smithi161.stdout:5/843: write dd/d15/d1a/d5d/f108 [727146,84179] 0 2024-01-17T23:47:06.727 INFO:tasks.workunit.client.0.smithi161.stdout:5/844: chown dd/fbc 11615 1 2024-01-17T23:47:07.087 INFO:tasks.workunit.client.0.smithi161.stdout:4/984: rename d9/d1b/d53/fc1 to d9/d51/d64/dc4/f12c 0 2024-01-17T23:47:07.089 INFO:tasks.workunit.client.0.smithi161.stdout:2/862: sync 2024-01-17T23:47:07.159 INFO:tasks.workunit.client.0.smithi161.stdout:7/871: link da/c1d da/d34/d4a/c122 0 2024-01-17T23:47:07.270 INFO:tasks.workunit.client.0.smithi161.stdout:3/935: unlink d0/d5/d9/d17/d32/fa8 0 2024-01-17T23:47:07.270 INFO:tasks.workunit.client.0.smithi161.stdout:3/936: fsync d0/d5/d9/d1e/d5a/fd8 0 2024-01-17T23:47:07.270 INFO:tasks.workunit.client.0.smithi161.stdout:3/937: chown d0/d5/d9/c22 3280 1 2024-01-17T23:47:07.564 INFO:tasks.workunit.client.0.smithi161.stdout:5/845: truncate dd/d31/d7b/d78/f87 893068 0 2024-01-17T23:47:07.587 INFO:tasks.workunit.client.0.smithi161.stdout:5/846: dread dd/d15/d1a/d5d/d64/f73 [0,4194304] 0 2024-01-17T23:47:07.915 INFO:tasks.workunit.client.0.smithi161.stdout:4/985: link d9/d1b/d24/f75 d9/d27/d3a/d8b/d101/d104/d60/d9c/dc7/f12d 0 2024-01-17T23:47:07.915 INFO:tasks.workunit.client.0.smithi161.stdout:4/986: truncate d9/de/f2c 4350449 0 2024-01-17T23:47:08.108 INFO:tasks.workunit.client.0.smithi161.stdout:2/863: write d8/d4b/d9a/db0/d125/d12b/fb4 [473825,89710] 0 2024-01-17T23:47:08.278 INFO:tasks.workunit.client.0.smithi161.stdout:7/872: mknod da/d14/d35/d41/c123 0 2024-01-17T23:47:08.278 INFO:tasks.workunit.client.0.smithi161.stdout:9/783: rmdir d0/d8/d14/d87 39 2024-01-17T23:47:08.302 INFO:tasks.workunit.client.0.smithi161.stdout:7/873: dwrite da/d34/fa1 [0,4194304] 0 2024-01-17T23:47:08.575 INFO:tasks.workunit.client.0.smithi161.stdout:1/947: rename d1/d8/d54/d94/fa5 to d1/d8/d1c/d3e/f13b 0 2024-01-17T23:47:08.724 INFO:tasks.workunit.client.0.smithi161.stdout:4/987: read d9/f34 [3315205,129545] 0 2024-01-17T23:47:08.871 INFO:tasks.workunit.client.0.smithi161.stdout:2/864: mknod d8/d4b/d9a/db0/d125/c131 0 2024-01-17T23:47:09.000 INFO:tasks.workunit.client.0.smithi161.stdout:9/784: link d0/d8/d14/d87/lc1 d0/d8/d31/l104 0 2024-01-17T23:47:09.048 INFO:tasks.workunit.client.0.smithi161.stdout:6/884: sync 2024-01-17T23:47:09.048 INFO:tasks.workunit.client.0.smithi161.stdout:6/885: creat d6/dfa/d10d/f12a x:0 0 0 2024-01-17T23:47:09.426 INFO:tasks.workunit.client.0.smithi161.stdout:7/874: getdents da/db/d7a/dc7/da4 0 2024-01-17T23:47:09.773 INFO:tasks.workunit.client.0.smithi161.stdout:1/948: rmdir d1/d20/d26/d30/d11b 0 2024-01-17T23:47:09.773 INFO:tasks.workunit.client.0.smithi161.stdout:3/938: rename d0/da2/c10e to d0/d5/d9/d17/d2d/c12a 0 2024-01-17T23:47:09.788 INFO:tasks.workunit.client.0.smithi161.stdout:1/949: write d1/d2d/f7d [2391068,3419] 0 2024-01-17T23:47:09.788 INFO:tasks.workunit.client.0.smithi161.stdout:1/950: read d1/d8/d1c/f7a [2153207,1698] 0 2024-01-17T23:47:09.788 INFO:tasks.workunit.client.0.smithi161.stdout:1/951: creat d1/d11/d72/def/d10f/f13c x:0 0 0 2024-01-17T23:47:09.888 INFO:tasks.workunit.client.0.smithi161.stdout:4/988: creat d9/d1b/d24/d25/d5b/f12e x:0 0 0 2024-01-17T23:47:09.888 INFO:tasks.workunit.client.0.smithi161.stdout:2/865: mkdir d8/d68/d132 0 2024-01-17T23:47:09.917 INFO:tasks.workunit.client.0.smithi161.stdout:0/888: sync 2024-01-17T23:47:09.929 INFO:tasks.workunit.client.0.smithi161.stdout:0/889: dread d5/d3a/deb/dee/f112 [0,4194304] 0 2024-01-17T23:47:09.935 INFO:tasks.workunit.client.0.smithi161.stdout:0/890: write d5/d34/d20/d2b/f91 [538189,108258] 0 2024-01-17T23:47:10.075 INFO:tasks.workunit.client.0.smithi161.stdout:9/785: mkdir d0/d8/d14/d87/d9b/d105 0 2024-01-17T23:47:10.197 INFO:tasks.workunit.client.0.smithi161.stdout:6/886: creat d6/f12b x:0 0 0 2024-01-17T23:47:10.197 INFO:tasks.workunit.client.0.smithi161.stdout:7/875: rmdir da/db/d7a/dc7 39 2024-01-17T23:47:10.197 INFO:tasks.workunit.client.0.smithi161.stdout:7/876: readlink da/db/l1f 0 2024-01-17T23:47:10.220 INFO:tasks.workunit.client.0.smithi161.stdout:6/887: dwrite d6/dfa/d10d/f119 [0,4194304] 0 2024-01-17T23:47:10.380 INFO:tasks.workunit.client.0.smithi161.stdout:3/939: dread d0/d5/d9/d17/d5c/f10f [0,4194304] 0 2024-01-17T23:47:10.833 INFO:tasks.workunit.client.0.smithi161.stdout:1/952: creat d1/d20/d26/d30/d8f/d9e/d10e/f13d x:0 0 0 2024-01-17T23:47:10.858 INFO:tasks.workunit.client.0.smithi161.stdout:1/953: dwrite d1/d8/d1c/ffd [0,4194304] 0 2024-01-17T23:47:11.206 INFO:tasks.workunit.client.0.smithi161.stdout:4/989: symlink d9/de/d1e/d38/l12f 0 2024-01-17T23:47:11.206 INFO:tasks.workunit.client.0.smithi161.stdout:4/990: fdatasync d9/d1b/d24/d25/d5b/f8c 0 2024-01-17T23:47:11.230 INFO:tasks.workunit.client.0.smithi161.stdout:4/991: dread d9/f13 [0,4194304] 0 2024-01-17T23:47:11.289 INFO:tasks.workunit.client.0.smithi161.stdout:2/866: symlink d8/d1c/d75/dae/de4/da8/l133 0 2024-01-17T23:47:11.343 INFO:tasks.workunit.client.0.smithi161.stdout:0/891: truncate d5/d3a/fa9 974149 0 2024-01-17T23:47:11.476 INFO:tasks.workunit.client.0.smithi161.stdout:9/786: readlink d0/d8/d14/d18/d20/da2/lbc 0 2024-01-17T23:47:11.797 INFO:tasks.workunit.client.0.smithi161.stdout:7/877: getdents da/d34 0 2024-01-17T23:47:11.802 INFO:tasks.workunit.client.0.smithi161.stdout:7/878: dread da/d34/d5a/da0/df8/f87 [0,4194304] 0 2024-01-17T23:47:11.977 INFO:tasks.workunit.client.0.smithi161.stdout:6/888: mkdir d6/d7/d12c 0 2024-01-17T23:47:12.333 INFO:tasks.workunit.client.0.smithi161.stdout:5/847: write dd/d31/d56/f99 [106307,92578] 0 2024-01-17T23:47:13.056 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:47:13.060 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:47:13.079 INFO:tasks.workunit.client.0.smithi161.stdout:1/954: creat d1/d2d/d3b/f13e x:0 0 0 2024-01-17T23:47:13.156 INFO:tasks.workunit.client.0.smithi161.stdout:4/992: read - d9/fb3 zero size 2024-01-17T23:47:13.435 INFO:tasks.workunit.client.0.smithi161.stdout:0/892: creat d5/d3a/deb/df3/f11b x:0 0 0 2024-01-17T23:47:13.473 INFO:tasks.workunit.client.0.smithi161.stdout:9/787: dread d0/d8/d14/d18/d20/d97/d9e/fdc [0,4194304] 0 2024-01-17T23:47:13.924 INFO:tasks.workunit.client.0.smithi161.stdout:6/889: creat d6/dfa/d10e/f12d x:0 0 0 2024-01-17T23:47:14.265 INFO:tasks.workunit.client.0.smithi161.stdout:5/848: rmdir dd/d15/d51 39 2024-01-17T23:47:14.370 INFO:tasks.workunit.client.0.smithi161.stdout:1/955: dread d1/d8/fc [0,4194304] 0 2024-01-17T23:47:14.370 INFO:tasks.workunit.client.0.smithi161.stdout:1/956: creat d1/d11/d72/def/d10f/f13f x:0 0 0 2024-01-17T23:47:14.503 INFO:tasks.workunit.client.0.smithi161.stdout:4/993: creat d9/d1b/d53/f130 x:0 0 0 2024-01-17T23:47:14.698 INFO:tasks.workunit.client.0.smithi161.stdout:0/893: link d5/d34/c52 d5/d34/d21/d97/dc8/c11c 0 2024-01-17T23:47:15.180 INFO:tasks.workunit.client.0.smithi161.stdout:6/890: rename d6/d7/dc/d43/dc3/fad to d6/d7/dc/db2/d112/d115/f12e 0 2024-01-17T23:47:15.198 INFO:tasks.workunit.client.0.smithi161.stdout:6/891: write d6/d58/fa9 [2098308,100622] 0 2024-01-17T23:47:15.198 INFO:tasks.workunit.client.0.smithi161.stdout:6/892: truncate d6/dfa/d10e/db4/fcb 1024879 0 2024-01-17T23:47:15.199 INFO:tasks.workunit.client.0.smithi161.stdout:6/893: fdatasync d6/d7/dc/d85/d31/d5d/ff0 0 2024-01-17T23:47:15.319 INFO:tasks.workunit.client.0.smithi161.stdout:5/849: mknod dd/d15/d4e/d4f/c10a 0 2024-01-17T23:47:15.319 INFO:tasks.workunit.client.0.smithi161.stdout:5/850: readlink dd/d15/d51/dce/lf6 0 2024-01-17T23:47:15.751 INFO:tasks.workunit.client.0.smithi161.stdout:1/957: rmdir d1/d8/d1f/d4b/d103 0 2024-01-17T23:47:15.751 INFO:tasks.workunit.client.0.smithi161.stdout:4/994: creat d9/d27/d3a/d8b/dcb/f131 x:0 0 0 2024-01-17T23:47:15.852 INFO:tasks.workunit.client.0.smithi161.stdout:0/894: symlink d5/df6/d6b/l11d 0 2024-01-17T23:47:16.479 INFO:tasks.workunit.client.0.smithi161.stdout:6/894: rmdir d6/d7/dc/db2/d112/d115 39 2024-01-17T23:47:17.241 INFO:tasks.workunit.client.0.smithi161.stdout:4/995: creat d9/d27/d3a/d8b/d101/d104/d60/f132 x:0 0 0 2024-01-17T23:47:17.251 INFO:tasks.workunit.client.0.smithi161.stdout:0/895: link d5/d34/d21/d97/dbb/l103 d5/d34/d21/l11e 0 2024-01-17T23:47:17.251 INFO:tasks.workunit.client.0.smithi161.stdout:0/896: dread - d5/df6/fb8 zero size 2024-01-17T23:47:17.566 INFO:tasks.workunit.client.0.smithi161.stdout:8/915: rmdir d1/d3d 39 2024-01-17T23:47:17.571 INFO:tasks.workunit.client.0.smithi161.stdout:8/916: dread d1/d22/d2f/dd6/ff6 [0,4194304] 0 2024-01-17T23:47:17.685 INFO:tasks.workunit.client.0.smithi161.stdout:6/895: creat d6/d7/dc/d85/d13/f12f x:0 0 0 2024-01-17T23:47:17.685 INFO:tasks.workunit.client.0.smithi161.stdout:6/896: chown d6/d7/dc/d85/d31/cf9 137963888 1 2024-01-17T23:47:18.233 INFO:tasks.workunit.client.0.smithi161.stdout:4/996: symlink d9/d27/d68/l133 0 2024-01-17T23:47:18.238 INFO:tasks.workunit.client.0.smithi161.stdout:0/897: unlink d5/df6/d6b/d89/f100 0 2024-01-17T23:47:18.420 INFO:tasks.workunit.client.0.smithi161.stdout:8/917: mknod d1/df/d20/d6a/c139 0 2024-01-17T23:47:18.420 INFO:tasks.workunit.client.0.smithi161.stdout:6/897: rename d6/d7/dc/d85/d31/d5d/d55/lbf to d6/d7/dc/db2/d112/l130 0 2024-01-17T23:47:18.518 INFO:tasks.workunit.client.0.smithi161.stdout:1/958: rename d1/d8/d54/d94/dd5 to d1/d8/d54/d94/d140 0 2024-01-17T23:47:18.642 INFO:tasks.workunit.client.0.smithi161.stdout:9/788: creat d0/d8/d14/f106 x:0 0 0 2024-01-17T23:47:18.671 INFO:tasks.workunit.client.0.smithi161.stdout:9/789: dwrite d0/d8/d14/d18/d63/faa [0,4194304] 0 2024-01-17T23:47:18.711 INFO:tasks.workunit.client.0.smithi161.stdout:4/997: creat d9/d1b/d53/f134 x:0 0 0 2024-01-17T23:47:18.712 INFO:tasks.workunit.client.0.smithi161.stdout:4/998: write d9/de/d1e/d38/d6b/f108 [103362,32862] 0 2024-01-17T23:47:18.712 INFO:tasks.workunit.client.0.smithi161.stdout:4/999: stat d9/d1b/d53 0 2024-01-17T23:47:18.790 INFO:tasks.workunit.client.0.smithi161.stdout:0/898: mknod d5/d3a/deb/df3/c11f 0 2024-01-17T23:47:19.008 INFO:tasks.workunit.client.0.smithi161.stdout:8/918: creat d1/df/d20/d2a/f13a x:0 0 0 2024-01-17T23:47:19.008 INFO:tasks.workunit.client.0.smithi161.stdout:6/898: creat d6/d7/dc/d85/da4/f131 x:0 0 0 2024-01-17T23:47:19.028 INFO:tasks.workunit.client.0.smithi161.stdout:6/899: write d6/f2f [19975,58548] 0 2024-01-17T23:47:19.257 INFO:tasks.workunit.client.0.smithi161.stdout:9/790: mkdir d0/d39/d49/d107 0 2024-01-17T23:47:19.258 INFO:tasks.workunit.client.0.smithi161.stdout:9/791: fdatasync d0/d39/d49/f82 0 2024-01-17T23:47:19.292 INFO:tasks.workunit.client.0.smithi161.stdout:9/792: dwrite d0/d8/d14/d18/fc9 [0,4194304] 0 2024-01-17T23:47:19.293 INFO:tasks.workunit.client.0.smithi161.stdout:2/867: dwrite d8/fa5 [0,4194304] 0 2024-01-17T23:47:19.342 INFO:tasks.workunit.client.0.smithi161.stdout:8/919: creat d1/df/d16/dbf/d125/f13b x:0 0 0 2024-01-17T23:47:19.475 INFO:tasks.workunit.client.0.smithi161.stdout:6/900: rename d6/d7/dc/d43/d79/le0 to d6/d58/l132 0 2024-01-17T23:47:19.551 INFO:tasks.workunit.client.0.smithi161.stdout:0/899: link d5/d3a/deb/dee/d35/c4b d5/d8/c120 0 2024-01-17T23:47:19.551 INFO:tasks.workunit.client.0.smithi161.stdout:0/900: chown d5/d3a/deb/df3 7331876 1 2024-01-17T23:47:19.844 INFO:tasks.workunit.client.0.smithi161.stdout:7/879: link da/db/d7a/d8f/dac/f11c da/d34/f124 0 2024-01-17T23:47:19.876 INFO:tasks.workunit.client.0.smithi161.stdout:9/793: chown d0/d8/d14/d56/ca9 7450 1 2024-01-17T23:47:19.876 INFO:tasks.workunit.client.0.smithi161.stdout:9/794: chown d0/d39/d49/d6e 466518902 1 2024-01-17T23:47:20.108 INFO:tasks.workunit.client.0.smithi161.stdout:2/868: truncate d8/d1c/d75/dc7/de5/f10f 1754590 0 2024-01-17T23:47:20.259 INFO:tasks.workunit.client.0.smithi161.stdout:6/901: mknod d6/dfa/d10e/d81/c133 0 2024-01-17T23:47:20.362 INFO:tasks.workunit.client.0.smithi161.stdout:0/901: mknod d5/d34/d21/d113/c121 0 2024-01-17T23:47:20.362 INFO:tasks.workunit.client.0.smithi161.stdout:0/902: stat d5/d34/c16 0 2024-01-17T23:47:20.362 INFO:tasks.workunit.client.0.smithi161.stdout:0/903: write d5/f105 [971536,112949] 0 2024-01-17T23:47:20.374 INFO:tasks.workunit.client.0.smithi161.stdout:3/940: write d0/d5/d9/ff0 [5767143,67411] 0 2024-01-17T23:47:20.516 INFO:tasks.workunit.client.0.smithi161.stdout:9/795: rename d0/d8/d14/d18/d20/da2/ff7 to d0/d8/d14/d18/d20/d97/f108 0 2024-01-17T23:47:20.994 INFO:tasks.workunit.client.0.smithi161.stdout:0/904: unlink d5/df6/d6b/l74 0 2024-01-17T23:47:21.156 INFO:tasks.workunit.client.0.smithi161.stdout:1/959: mkdir d1/d141 0 2024-01-17T23:47:21.214 INFO:tasks.workunit.client.0.smithi161.stdout:7/880: dread da/d34/d5a/da0/df8/d3d/f40 [0,4194304] 0 2024-01-17T23:47:21.214 INFO:tasks.workunit.client.0.smithi161.stdout:7/881: fdatasync da/d34/d5a/da0/df8/d3d/d7f/f11e 0 2024-01-17T23:47:21.243 INFO:tasks.workunit.client.0.smithi161.stdout:7/882: dwrite da/d34/d5a/da0/df8/f4b [0,4194304] 0 2024-01-17T23:47:21.257 INFO:tasks.workunit.client.0.smithi161.stdout:7/883: write da/d34/d5a/f85 [529645,97535] 0 2024-01-17T23:47:21.257 INFO:tasks.workunit.client.0.smithi161.stdout:7/884: write da/faa [907220,86850] 0 2024-01-17T23:47:21.464 INFO:tasks.workunit.client.0.smithi161.stdout:2/869: link d8/d1c/d75/dae/de4/d84/cf6 d8/d4b/d9a/db0/d125/d12b/ddd/c134 0 2024-01-17T23:47:21.493 INFO:tasks.workunit.client.0.smithi161.stdout:2/870: dwrite d8/da/d8d/f112 [0,4194304] 0 2024-01-17T23:47:21.665 INFO:tasks.workunit.client.0.smithi161.stdout:0/905: creat d5/d34/d21/d76/dcb/f122 x:0 0 0 2024-01-17T23:47:21.665 INFO:tasks.workunit.client.0.smithi161.stdout:0/906: readlink d5/d34/l15 0 2024-01-17T23:47:21.788 INFO:tasks.workunit.client.0.smithi161.stdout:3/941: rmdir d0/d5/d9/d17/d2d 39 2024-01-17T23:47:21.812 INFO:tasks.workunit.client.0.smithi161.stdout:3/942: dwrite d0/d5/d9/ff0 [0,4194304] 0 2024-01-17T23:47:21.812 INFO:tasks.workunit.client.0.smithi161.stdout:3/943: chown d0/d5/d9/d38/d4f 23501 1 2024-01-17T23:47:22.000 INFO:tasks.workunit.client.0.smithi161.stdout:1/960: rename d1/d31/l114 to d1/d20/d26/l142 0 2024-01-17T23:47:22.007 INFO:tasks.workunit.client.0.smithi161.stdout:1/961: dread d1/d20/d26/d30/d44/fa2 [0,4194304] 0 2024-01-17T23:47:22.007 INFO:tasks.workunit.client.0.smithi161.stdout:1/962: write d1/d20/d26/d30/d8f/dff/f101 [570258,84674] 0 2024-01-17T23:47:22.018 INFO:tasks.workunit.client.0.smithi161.stdout:1/963: dread d1/d2d/d3b/f2a [0,4194304] 0 2024-01-17T23:47:22.018 INFO:tasks.workunit.client.0.smithi161.stdout:1/964: read d1/d8/d1f/dd3/f108 [99657,13389] 0 2024-01-17T23:47:22.575 INFO:tasks.workunit.client.0.smithi161.stdout:7/885: chown da/d34/d4a/d4c/l7e 6582633 1 2024-01-17T23:47:22.575 INFO:tasks.workunit.client.0.smithi161.stdout:9/796: symlink d0/d8/d14/d18/d20/da2/l109 0 2024-01-17T23:47:22.810 INFO:tasks.workunit.client.0.smithi161.stdout:2/871: chown d8/d1c/d57/f10c 572218 1 2024-01-17T23:47:22.810 INFO:tasks.workunit.client.0.smithi161.stdout:2/872: chown d8/d1c/d75/dae/de4/cc5 808579 1 2024-01-17T23:47:23.587 INFO:tasks.workunit.client.0.smithi161.stdout:3/944: mknod d0/d5/d9/d17/c12b 0 2024-01-17T23:47:23.606 INFO:tasks.workunit.client.0.smithi161.stdout:3/945: write d0/d5/d9/d38/db3/db4/ffe [1976621,4644] 0 2024-01-17T23:47:23.912 INFO:tasks.workunit.client.0.smithi161.stdout:7/886: truncate da/d34/d5a/d28/f3e 2964426 0 2024-01-17T23:47:24.033 INFO:tasks.workunit.client.0.smithi161.stdout:9/797: creat d0/d8/d14/d87/d9b/d105/f10a x:0 0 0 2024-01-17T23:47:24.118 INFO:tasks.workunit.client.0.smithi161.stdout:2/873: mkdir d8/d67/d6c/d135 0 2024-01-17T23:47:24.179 INFO:tasks.workunit.client.0.smithi161.stdout:3/946: link d0/d5/d9/d17/f36 d0/d5/d9/d17/d32/d102/f12c 0 2024-01-17T23:47:24.211 INFO:tasks.workunit.client.0.smithi161.stdout:3/947: dwrite d0/d5/d9/d1e/d3b/d52/f67 [4194304,4194304] 0 2024-01-17T23:47:24.552 INFO:tasks.workunit.client.0.smithi161.stdout:7/887: dread da/d34/d5a/d68/d8c/fa6 [0,4194304] 0 2024-01-17T23:47:24.650 INFO:tasks.workunit.client.0.smithi161.stdout:9/798: link d0/f51 d0/d8/d14/d56/f10b 0 2024-01-17T23:47:25.121 INFO:tasks.workunit.client.0.smithi161.stdout:1/965: rename d1/d2d/d3b to d1/d20/d26/d32/d143 0 2024-01-17T23:47:25.121 INFO:tasks.workunit.client.0.smithi161.stdout:1/966: chown d1/d2d/f7d 204234 1 2024-01-17T23:47:25.386 INFO:tasks.workunit.client.0.smithi161.stdout:7/888: link da/da7/lea da/db/d7a/da8/dd2/l125 0 2024-01-17T23:47:25.685 INFO:tasks.workunit.client.0.smithi161.stdout:3/948: rmdir d0/d5/d9/d1e/d3b/df4 39 2024-01-17T23:47:25.898 INFO:tasks.workunit.client.0.smithi161.stdout:1/967: rmdir d1/d20/d26/d30/d8f/d9e/dae 39 2024-01-17T23:47:25.933 INFO:tasks.workunit.client.0.smithi161.stdout:1/968: dwrite d1/d20/d26/d30/d8f/d9e/fd2 [0,4194304] 0 2024-01-17T23:47:26.134 INFO:tasks.workunit.client.0.smithi161.stdout:7/889: mkdir da/db/da2/d126 0 2024-01-17T23:47:26.137 INFO:tasks.workunit.client.0.smithi161.stdout:5/851: sync 2024-01-17T23:47:26.137 INFO:tasks.workunit.client.0.smithi161.stdout:5/852: chown dd/d15/d4e/d4f/d77/fc3 3311986 1 2024-01-17T23:47:26.137 INFO:tasks.workunit.client.0.smithi161.stdout:5/853: write dd/d15/d1a/d5d/d64/d7c/f102 [468976,77524] 0 2024-01-17T23:47:26.523 INFO:tasks.workunit.client.0.smithi161.stdout:9/799: rename d0/d8/d31/d73/ffb to d0/d8/d14/d18/d20/d97/dae/f10c 0 2024-01-17T23:47:26.603 INFO:tasks.workunit.client.0.smithi161.stdout:8/920: write d1/df/d13/ff0 [5036091,109045] 0 2024-01-17T23:47:26.884 INFO:tasks.workunit.client.0.smithi161.stdout:7/890: mkdir da/db/d7a/da8/d127 0 2024-01-17T23:47:27.242 INFO:tasks.workunit.client.0.smithi161.stdout:9/800: creat d0/d8/d14/d18/d20/f10d x:0 0 0 2024-01-17T23:47:28.163 INFO:tasks.workunit.client.0.smithi161.stdout:7/891: link da/db/d7a/d8f/fed da/d14/d35/d41/f128 0 2024-01-17T23:47:28.633 INFO:tasks.workunit.client.0.smithi161.stdout:8/921: truncate d1/df/f14 618377 0 2024-01-17T23:47:29.074 INFO:tasks.workunit.client.0.smithi161.stdout:7/892: getdents da/d34/d4a 0 2024-01-17T23:47:29.087 INFO:tasks.workunit.client.0.smithi161.stdout:9/801: rmdir d0/d8/d14/d18/d20/d97/d9e 39 2024-01-17T23:47:29.122 INFO:tasks.workunit.client.0.smithi161.stdout:9/802: dwrite d0/f30 [4194304,4194304] 0 2024-01-17T23:47:29.140 INFO:tasks.workunit.client.0.smithi161.stdout:9/803: write d0/d8/d14/d87/fb9 [2632078,57722] 0 2024-01-17T23:47:29.140 INFO:tasks.workunit.client.0.smithi161.stdout:9/804: readlink d0/d8/d31/l54 0 2024-01-17T23:47:29.263 INFO:tasks.workunit.client.0.smithi161.stdout:8/922: mknod d1/d22/dbd/dce/c13c 0 2024-01-17T23:47:29.506 INFO:tasks.workunit.client.0.smithi161.stdout:9/805: rmdir d0/d8/d14/d18/d20/da2/dcb 39 2024-01-17T23:47:29.585 INFO:tasks.workunit.client.0.smithi161.stdout:6/902: rmdir d6/dfa 39 2024-01-17T23:47:29.586 INFO:tasks.workunit.client.0.smithi161.stdout:6/903: chown d6/d7/dc/d85/d13/f6e 275 1 2024-01-17T23:47:29.843 INFO:tasks.workunit.client.0.smithi161.stdout:7/893: getdents da/d34/d5a/de9 0 2024-01-17T23:47:29.967 INFO:tasks.workunit.client.0.smithi161.stdout:0/907: sync 2024-01-17T23:47:29.972 INFO:tasks.workunit.client.0.smithi161.stdout:0/908: dread d5/df6/db0/f117 [0,4194304] 0 2024-01-17T23:47:30.023 INFO:tasks.workunit.client.0.smithi161.stdout:6/904: dread d6/d7/dc/d43/dde/fec [0,4194304] 0 2024-01-17T23:47:30.202 INFO:tasks.workunit.client.0.smithi161.stdout:7/894: creat da/d34/d5a/da0/df8/d3d/d82/f129 x:0 0 0 2024-01-17T23:47:30.357 INFO:tasks.workunit.client.0.smithi161.stdout:0/909: getdents d5 0 2024-01-17T23:47:30.357 INFO:tasks.workunit.client.0.smithi161.stdout:0/910: fdatasync d5/d34/d20/d2b/f69 0 2024-01-17T23:47:30.357 INFO:tasks.workunit.client.0.smithi161.stdout:0/911: chown d5/d3a/db4/dc1/fed 1246 1 2024-01-17T23:47:30.527 INFO:tasks.workunit.client.0.smithi161.stdout:6/905: mknod d6/d7/dc/d43/dc3/d90/c134 0 2024-01-17T23:47:30.711 INFO:tasks.workunit.client.0.smithi161.stdout:7/895: unlink da/d14/c17 0 2024-01-17T23:47:30.711 INFO:tasks.workunit.client.0.smithi161.stdout:7/896: chown da/faa 3 1 2024-01-17T23:47:30.795 INFO:tasks.workunit.client.0.smithi161.stdout:2/874: write d8/d1c/d57/fd5 [2530799,34268] 0 2024-01-17T23:47:30.922 INFO:tasks.workunit.client.0.smithi161.stdout:6/906: unlink d6/dfa/d10e/d81/lc9 0 2024-01-17T23:47:30.923 INFO:tasks.workunit.client.0.smithi161.stdout:6/907: creat d6/d7/dc/dca/f135 x:0 0 0 2024-01-17T23:47:30.923 INFO:tasks.workunit.client.0.smithi161.stdout:6/908: creat d6/d7/dc/d85/d13/f136 x:0 0 0 2024-01-17T23:47:30.923 INFO:tasks.workunit.client.0.smithi161.stdout:6/909: creat d6/d7/dc/db2/f137 x:0 0 0 2024-01-17T23:47:30.923 INFO:tasks.workunit.client.0.smithi161.stdout:6/910: chown d6/d7/dc/db2/f11c 13751 1 2024-01-17T23:47:30.952 INFO:tasks.workunit.client.0.smithi161.stdout:6/911: dwrite d6/d7/dc/d85/d31/d5d/d55/fae [0,4194304] 0 2024-01-17T23:47:30.958 INFO:tasks.workunit.client.0.smithi161.stdout:6/912: write d6/d7/dc/f5b [4492370,39837] 0 2024-01-17T23:47:31.055 INFO:tasks.workunit.client.0.smithi161.stdout:7/897: creat da/d34/d5a/da0/df8/d3d/d82/db0/f12a x:0 0 0 2024-01-17T23:47:31.097 INFO:tasks.workunit.client.0.smithi161.stdout:7/898: dwrite da/db/d7a/da8/fc9 [0,4194304] 0 2024-01-17T23:47:31.284 INFO:tasks.workunit.client.0.smithi161.stdout:0/912: getdents d5/d34/d8a 0 2024-01-17T23:47:31.284 INFO:tasks.workunit.client.0.smithi161.stdout:0/913: chown d5/d34/d21/fd8 488058 1 2024-01-17T23:47:31.284 INFO:tasks.workunit.client.0.smithi161.stdout:0/914: write d5/d34/d20/d2b/f56 [772316,56898] 0 2024-01-17T23:47:31.366 INFO:tasks.workunit.client.0.smithi161.stdout:2/875: link d8/d1c/d75/dae/de4/l2b d8/d1c/d1e/d80/l136 0 2024-01-17T23:47:32.129 INFO:tasks.workunit.client.0.smithi161.stdout:3/949: sync 2024-01-17T23:47:32.138 INFO:tasks.workunit.client.0.smithi161.stdout:3/950: dread d0/d5/d9/ff0 [4194304,4194304] 0 2024-01-17T23:47:32.138 INFO:tasks.workunit.client.0.smithi161.stdout:3/951: read d0/d5/d9/d17/d32/fec [3046922,9896] 0 2024-01-17T23:47:32.139 INFO:tasks.workunit.client.0.smithi161.stdout:3/952: chown d0/d5/d9/d17/d2d/c105 171395948 1 2024-01-17T23:47:32.139 INFO:tasks.workunit.client.0.smithi161.stdout:3/953: write d0/d5/d9/f53 [339653,79815] 0 2024-01-17T23:47:32.139 INFO:tasks.workunit.client.0.smithi161.stdout:3/954: stat d0/d5/fa 0 2024-01-17T23:47:32.890 INFO:tasks.workunit.client.0.smithi161.stdout:5/854: sync 2024-01-17T23:47:33.075 INFO:tasks.workunit.client.0.smithi161.stdout:0/915: mknod d5/d34/d20/d2b/c123 0 2024-01-17T23:47:33.075 INFO:tasks.workunit.client.0.smithi161.stdout:0/916: creat d5/d34/d20/d2b/dbf/f124 x:0 0 0 2024-01-17T23:47:33.108 INFO:tasks.workunit.client.0.smithi161.stdout:0/917: dwrite d5/d3a/d49/f70 [0,4194304] 0 2024-01-17T23:47:33.196 INFO:tasks.workunit.client.0.smithi161.stdout:2/876: rmdir d8/d1c/d1e 39 2024-01-17T23:47:34.135 INFO:tasks.workunit.client.0.smithi161.stdout:5/855: symlink dd/d15/d1a/d42/da4/l10b 0 2024-01-17T23:47:34.135 INFO:tasks.workunit.client.0.smithi161.stdout:5/856: creat dd/d15/d4e/d4f/f10c x:0 0 0 2024-01-17T23:47:34.135 INFO:tasks.workunit.client.0.smithi161.stdout:5/857: creat dd/d15/d1a/d5d/dc9/dcb/f10d x:0 0 0 2024-01-17T23:47:34.135 INFO:tasks.workunit.client.0.smithi161.stdout:5/858: truncate dd/d15/d1a/d42/da4/fd6 233124 0 2024-01-17T23:47:34.576 INFO:tasks.workunit.client.0.smithi161.stdout:1/969: write d1/d20/d26/d32/d143/f7e [728363,107732] 0 2024-01-17T23:47:34.576 INFO:tasks.workunit.client.0.smithi161.stdout:1/970: readlink d1/d8/d54/d94/d140/l113 0 2024-01-17T23:47:34.577 INFO:tasks.workunit.client.0.smithi161.stdout:1/971: creat d1/d20/d26/d32/f144 x:0 0 0 2024-01-17T23:47:34.577 INFO:tasks.workunit.client.0.smithi161.stdout:0/918: truncate d5/d3a/deb/dee/d35/f82 1833909 0 2024-01-17T23:47:34.604 INFO:tasks.workunit.client.0.smithi161.stdout:0/919: dwrite d5/df6/d6b/fcd [0,4194304] 0 2024-01-17T23:47:35.080 INFO:tasks.workunit.client.0.smithi161.stdout:2/877: symlink d8/d1c/d57/l137 0 2024-01-17T23:47:35.080 INFO:tasks.workunit.client.0.smithi161.stdout:2/878: write d8/d1c/d75/dae/dc3/f53 [3555211,29339] 0 2024-01-17T23:47:35.206 INFO:tasks.workunit.client.0.smithi161.stdout:1/972: mkdir d1/d11/d145 0 2024-01-17T23:47:35.493 INFO:tasks.workunit.client.0.smithi161.stdout:0/920: mknod d5/df6/c125 0 2024-01-17T23:47:35.639 INFO:tasks.workunit.client.0.smithi161.stdout:2/879: truncate d8/f6a 3047953 0 2024-01-17T23:47:35.639 INFO:tasks.workunit.client.0.smithi161.stdout:2/880: dread - d8/d1c/d1e/da6/d35/fec zero size 2024-01-17T23:47:35.712 INFO:tasks.workunit.client.0.smithi161.stdout:1/973: mknod d1/d20/d26/d30/c146 0 2024-01-17T23:47:35.775 INFO:tasks.workunit.client.0.smithi161.stdout:0/921: mknod d5/d34/d21/dd4/c126 0 2024-01-17T23:47:35.796 INFO:tasks.workunit.client.0.smithi161.stdout:0/922: dread d5/d34/d20/d2b/f69 [0,4194304] 0 2024-01-17T23:47:35.797 INFO:tasks.workunit.client.0.smithi161.stdout:0/923: chown d5/d34/d21/d97/dbb/l103 4085645 1 2024-01-17T23:47:35.797 INFO:tasks.workunit.client.0.smithi161.stdout:0/924: chown d5/d3a/deb/dee/d35/f10b 250 1 2024-01-17T23:47:35.975 INFO:tasks.workunit.client.0.smithi161.stdout:8/923: dwrite d1/d3/d19/d1d/d25/d4b/f6b [0,4194304] 0 2024-01-17T23:47:36.003 INFO:tasks.workunit.client.0.smithi161.stdout:8/924: dwrite d1/f58 [0,4194304] 0 2024-01-17T23:47:36.023 INFO:tasks.workunit.client.0.smithi161.stdout:2/881: truncate d8/d1c/d75/dae/dc3/fb7 1159618 0 2024-01-17T23:47:36.037 INFO:tasks.workunit.client.0.smithi161.stdout:2/882: dread d8/d67/dbc/f105 [0,4194304] 0 2024-01-17T23:47:36.037 INFO:tasks.workunit.client.0.smithi161.stdout:2/883: chown d8/d1c/c7d 81 1 2024-01-17T23:47:36.055 INFO:tasks.workunit.client.0.smithi161.stdout:2/884: write d8/d67/fac [3697831,10747] 0 2024-01-17T23:47:36.082 INFO:tasks.workunit.client.0.smithi161.stdout:1/974: symlink d1/d8/d1f/df0/l147 0 2024-01-17T23:47:36.082 INFO:tasks.workunit.client.0.smithi161.stdout:1/975: truncate d1/d8/df1/ff3 1027357 0 2024-01-17T23:47:36.099 INFO:tasks.workunit.client.0.smithi161.stdout:1/976: dread d1/d8/d1f/fe4 [0,4194304] 0 2024-01-17T23:47:36.264 INFO:tasks.workunit.client.0.smithi161.stdout:9/806: write d0/d8/d14/f85 [639508,5523] 0 2024-01-17T23:47:36.611 INFO:tasks.workunit.client.0.smithi161.stdout:2/885: creat d8/d1c/d1e/f138 x:0 0 0 2024-01-17T23:47:36.611 INFO:tasks.workunit.client.0.smithi161.stdout:2/886: chown d8/d1c/d75/dae/de4/da8/l133 4 1 2024-01-17T23:47:36.936 INFO:tasks.workunit.client.0.smithi161.stdout:1/977: rename d1/d31/fca to d1/d20/d26/d30/d41/f148 0 2024-01-17T23:47:36.936 INFO:tasks.workunit.client.0.smithi161.stdout:1/978: dread - d1/d20/d26/d30/d8f/d9e/d10e/f13d zero size 2024-01-17T23:47:36.936 INFO:tasks.workunit.client.0.smithi161.stdout:1/979: truncate d1/d11/d116/f137 876225 0 2024-01-17T23:47:36.936 INFO:tasks.workunit.client.0.smithi161.stdout:9/807: mknod d0/d39/d49/c10e 0 2024-01-17T23:47:36.954 INFO:tasks.workunit.client.0.smithi161.stdout:1/980: dread d1/d20/d26/d30/ff7 [0,4194304] 0 2024-01-17T23:47:37.134 INFO:tasks.workunit.client.0.smithi161.stdout:8/925: creat d1/f13d x:0 0 0 2024-01-17T23:47:37.159 INFO:tasks.workunit.client.0.smithi161.stdout:6/913: write d6/d7/dc/d43/f94 [639560,69516] 0 2024-01-17T23:47:37.160 INFO:tasks.workunit.client.0.smithi161.stdout:6/914: creat d6/d7/dc/d85/da4/f138 x:0 0 0 2024-01-17T23:47:37.466 INFO:tasks.workunit.client.0.smithi161.stdout:7/899: sync 2024-01-17T23:47:37.585 INFO:tasks.workunit.client.0.smithi161.stdout:3/955: sync 2024-01-17T23:47:37.585 INFO:tasks.workunit.client.0.smithi161.stdout:3/956: truncate d0/d5/d9/d38/d4f/d9d/da7/fde 720512 0 2024-01-17T23:47:37.971 INFO:tasks.workunit.client.0.smithi161.stdout:1/981: mkdir d1/d8/dfb/d112/d149 0 2024-01-17T23:47:37.971 INFO:tasks.workunit.client.0.smithi161.stdout:1/982: chown d1/d11/f119 7677 1 2024-01-17T23:47:37.971 INFO:tasks.workunit.client.0.smithi161.stdout:1/983: readlink d1/d8/d9d/l7f 0 2024-01-17T23:47:37.971 INFO:tasks.workunit.client.0.smithi161.stdout:1/984: fsync d1/d11/f119 0 2024-01-17T23:47:37.971 INFO:tasks.workunit.client.0.smithi161.stdout:1/985: fdatasync d1/d11/f76 0 2024-01-17T23:47:38.072 INFO:tasks.workunit.client.0.smithi161.stdout:2/887: rename d8/da/cab to d8/d1c/d75/dc7/de5/c139 0 2024-01-17T23:47:38.209 INFO:tasks.workunit.client.0.smithi161.stdout:8/926: mknod d1/d88/d105/c13e 0 2024-01-17T23:47:38.209 INFO:tasks.workunit.client.0.smithi161.stdout:8/927: fdatasync d1/df/d20/d6a/f109 0 2024-01-17T23:47:38.385 INFO:tasks.workunit.client.0.smithi161.stdout:6/915: mknod d6/d7/dc/d85/d13/dfb/c139 0 2024-01-17T23:47:38.577 INFO:tasks.workunit.client.0.smithi161.stdout:3/957: dread d0/d5/f81 [0,4194304] 0 2024-01-17T23:47:38.936 INFO:tasks.workunit.client.0.smithi161.stdout:8/928: stat d1/d3/d19/d1d/d25/l4f 0 2024-01-17T23:47:39.163 INFO:tasks.workunit.client.0.smithi161.stdout:3/958: unlink d0/d5/d9/d38/d4f/d50/cda 0 2024-01-17T23:47:39.163 INFO:tasks.workunit.client.0.smithi161.stdout:3/959: stat d0/d5/d9/d1e/d3b/d52 0 2024-01-17T23:47:39.179 INFO:tasks.workunit.client.0.smithi161.stdout:3/960: dread d0/d5/d9/d17/d32/f8e [0,4194304] 0 2024-01-17T23:47:39.336 INFO:tasks.workunit.client.0.smithi161.stdout:1/986: truncate d1/d8/fba 1508502 0 2024-01-17T23:47:39.336 INFO:tasks.workunit.client.0.smithi161.stdout:1/987: write d1/d8/d54/d94/f111 [655962,107189] 0 2024-01-17T23:47:39.336 INFO:tasks.workunit.client.0.smithi161.stdout:1/988: read - d1/d11/f119 zero size 2024-01-17T23:47:39.336 INFO:tasks.workunit.client.0.smithi161.stdout:1/989: fdatasync d1/d8/d1c/f69 0 2024-01-17T23:47:39.486 INFO:tasks.workunit.client.0.smithi161.stdout:2/888: mknod d8/d1c/d1e/d80/c13a 0 2024-01-17T23:47:39.602 INFO:tasks.workunit.client.0.smithi161.stdout:8/929: rename d1/df/d20/d2a/f34 to d1/d3/d19/d1d/df3/d134/f13f 0 2024-01-17T23:47:39.643 INFO:tasks.workunit.client.0.smithi161.stdout:5/859: sync 2024-01-17T23:47:39.659 INFO:tasks.workunit.client.0.smithi161.stdout:5/860: write dd/d15/d1a/d5d/d64/f73 [1945960,70504] 0 2024-01-17T23:47:39.659 INFO:tasks.workunit.client.0.smithi161.stdout:5/861: fdatasync dd/d15/d1a/d5d/d64/d7c/fd4 0 2024-01-17T23:47:39.805 INFO:tasks.workunit.client.0.smithi161.stdout:3/961: mkdir d0/d5/d9/d17/d5c/d12d 0 2024-01-17T23:47:40.843 INFO:tasks.workunit.client.0.smithi161.stdout:2/889: dread d8/d68/f7e [0,4194304] 0 2024-01-17T23:47:40.911 INFO:tasks.workunit.client.0.smithi161.stdout:8/930: getdents d1/d3d/d51 0 2024-01-17T23:47:40.911 INFO:tasks.workunit.client.0.smithi161.stdout:8/931: truncate d1/df/d20/d2a/d56/fec 285902 0 2024-01-17T23:47:41.135 INFO:tasks.workunit.client.0.smithi161.stdout:0/925: sync 2024-01-17T23:47:41.135 INFO:tasks.workunit.client.0.smithi161.stdout:0/926: readlink d5/l7f 0 2024-01-17T23:47:41.266 INFO:tasks.workunit.client.0.smithi161.stdout:5/862: creat dd/d15/d1a/d5d/dc9/f10e x:0 0 0 2024-01-17T23:47:41.266 INFO:tasks.workunit.client.0.smithi161.stdout:3/962: unlink d0/d5/d9/d38/f74 0 2024-01-17T23:47:41.266 INFO:tasks.workunit.client.0.smithi161.stdout:3/963: chown d0/d5/d9/d38/d4f/d9d/da7/f79 2 1 2024-01-17T23:47:41.266 INFO:tasks.workunit.client.0.smithi161.stdout:3/964: readlink d0/l4b 0 2024-01-17T23:47:41.279 INFO:tasks.workunit.client.0.smithi161.stdout:3/965: dread d0/d5/d9/d1e/d5a/d8a/f109 [0,4194304] 0 2024-01-17T23:47:41.279 INFO:tasks.workunit.client.0.smithi161.stdout:3/966: truncate d0/d5/d9/d17/fc5 333760 0 2024-01-17T23:47:41.279 INFO:tasks.workunit.client.0.smithi161.stdout:3/967: chown d0/d5/d9/d1e/d3b/f6f 96573522 1 2024-01-17T23:47:41.279 INFO:tasks.workunit.client.0.smithi161.stdout:3/968: chown d0/d5/d9/d38/db3/db4/d10b/f10d 656068 1 2024-01-17T23:47:41.279 INFO:tasks.workunit.client.0.smithi161.stdout:3/969: fsync d0/d5/d9/d17/d2d/fa4 0 2024-01-17T23:47:41.329 INFO:tasks.workunit.client.0.smithi161.stdout:3/970: dwrite d0/d5/d9/d8b/ff3 [0,4194304] 0 2024-01-17T23:47:41.337 INFO:tasks.workunit.client.0.smithi161.stdout:3/971: dread d0/d5/d9/d17/d32/f8e [0,4194304] 0 2024-01-17T23:47:41.712 INFO:tasks.workunit.client.0.smithi161.stdout:2/890: truncate d8/d1c/f31 476501 0 2024-01-17T23:47:41.790 INFO:tasks.workunit.client.0.smithi161.stdout:0/927: mkdir d5/d34/d20/d2b/d64/d127 0 2024-01-17T23:47:41.917 INFO:tasks.workunit.client.0.smithi161.stdout:5/863: getdents dd/d31 0 2024-01-17T23:47:42.192 INFO:tasks.workunit.client.0.smithi161.stdout:3/972: creat d0/d5/d9/d1e/d3b/d52/f12e x:0 0 0 2024-01-17T23:47:42.193 INFO:tasks.workunit.client.0.smithi161.stdout:3/973: dread - d0/d5/d9/d1e/d3b/df4/f120 zero size 2024-01-17T23:47:42.412 INFO:tasks.workunit.client.0.smithi161.stdout:2/891: creat d8/da/f13b x:0 0 0 2024-01-17T23:47:42.670 INFO:tasks.workunit.client.0.smithi161.stdout:0/928: symlink d5/d34/d21/d76/dcb/l128 0 2024-01-17T23:47:42.670 INFO:tasks.workunit.client.0.smithi161.stdout:5/864: mkdir dd/d15/d1a/d42/da4/d10f 0 2024-01-17T23:47:42.685 INFO:tasks.workunit.client.0.smithi161.stdout:5/865: dread dd/d15/f1c [0,4194304] 0 2024-01-17T23:47:42.709 INFO:tasks.workunit.client.0.smithi161.stdout:9/808: rmdir d0/d8/d14/d56 39 2024-01-17T23:47:42.709 INFO:tasks.workunit.client.0.smithi161.stdout:9/809: chown d0/d8/d14/d56/f9f 379 1 2024-01-17T23:47:42.724 INFO:tasks.workunit.client.0.smithi161.stdout:9/810: write d0/d8/d31/d58/fa4 [3184531,121066] 0 2024-01-17T23:47:42.806 INFO:tasks.workunit.client.0.smithi161.stdout:3/974: symlink d0/d5/d9/d17/d32/d102/l12f 0 2024-01-17T23:47:43.188 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:47:43.192 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:47:43.205 INFO:tasks.workunit.client.0.smithi161.stdout:2/892: unlink d8/d68/cfa 0 2024-01-17T23:47:43.341 INFO:tasks.workunit.client.0.smithi161.stdout:0/929: creat d5/d34/d21/d97/dc8/d106/f129 x:0 0 0 2024-01-17T23:47:43.419 INFO:tasks.workunit.client.0.smithi161.stdout:6/916: creat d6/d7/dc/d85/d31/d5d/f13a x:0 0 0 2024-01-17T23:47:43.419 INFO:tasks.workunit.client.0.smithi161.stdout:6/917: chown d6/d7/dc/db2 150 1 2024-01-17T23:47:43.487 INFO:tasks.workunit.client.0.smithi161.stdout:5/866: symlink dd/d15/d1a/d34/l110 0 2024-01-17T23:47:43.762 INFO:tasks.workunit.client.0.smithi161.stdout:9/811: creat d0/d8/f10f x:0 0 0 2024-01-17T23:47:44.243 INFO:tasks.workunit.client.0.smithi161.stdout:2/893: creat d8/d67/d6c/d135/f13c x:0 0 0 2024-01-17T23:47:44.346 INFO:tasks.workunit.client.0.smithi161.stdout:0/930: dread d5/df6/db0/dcc/dfe/f118 [0,4194304] 0 2024-01-17T23:47:44.346 INFO:tasks.workunit.client.0.smithi161.stdout:0/931: fdatasync d5/d34/d20/d2b/dbf/fc4 0 2024-01-17T23:47:44.482 INFO:tasks.workunit.client.0.smithi161.stdout:6/918: link d6/d7/dc/d43/d79/f8a d6/d7/dc/d43/f13b 0 2024-01-17T23:47:44.482 INFO:tasks.workunit.client.0.smithi161.stdout:6/919: creat d6/dfa/d10d/f13c x:0 0 0 2024-01-17T23:47:44.566 INFO:tasks.workunit.client.0.smithi161.stdout:5/867: truncate dd/d15/d1a/d5d/d64/f8d 2953484 0 2024-01-17T23:47:44.590 INFO:tasks.workunit.client.0.smithi161.stdout:5/868: dwrite dd/d15/d51/dbf/ff9 [0,4194304] 0 2024-01-17T23:47:44.615 INFO:tasks.workunit.client.0.smithi161.stdout:5/869: dwrite dd/d31/d3c/ff0 [0,4194304] 0 2024-01-17T23:47:44.616 INFO:tasks.workunit.client.0.smithi161.stdout:5/870: write dd/d31/fff [599516,128710] 0 2024-01-17T23:47:44.619 INFO:tasks.workunit.client.0.smithi161.stdout:5/871: dread dd/d31/d56/f99 [0,4194304] 0 2024-01-17T23:47:44.767 INFO:tasks.workunit.client.0.smithi161.stdout:2/894: dwrite d8/d1c/d1e/da6/d35/fec [0,4194304] 0 2024-01-17T23:47:44.832 INFO:tasks.workunit.client.0.smithi161.stdout:0/932: mknod d5/df6/d6b/da7/c12a 0 2024-01-17T23:47:45.019 INFO:tasks.workunit.client.0.smithi161.stdout:6/920: mkdir d6/d7/dc/d43/dc3/d13d 0 2024-01-17T23:47:45.019 INFO:tasks.workunit.client.0.smithi161.stdout:6/921: fsync d6/d7/dc/d85/fc0 0 2024-01-17T23:47:45.019 INFO:tasks.workunit.client.0.smithi161.stdout:6/922: chown d6/d7/c12 60 1 2024-01-17T23:47:45.020 INFO:tasks.workunit.client.0.smithi161.stdout:6/923: chown d6/d7/dc/dca 34 1 2024-01-17T23:47:45.020 INFO:tasks.workunit.client.0.smithi161.stdout:6/924: stat d6 0 2024-01-17T23:47:45.020 INFO:tasks.workunit.client.0.smithi161.stdout:6/925: stat d6/d7/dc/d43/dc3/d90/ca1 0 2024-01-17T23:47:45.581 INFO:tasks.workunit.client.0.smithi161.stdout:5/872: symlink dd/d15/d1a/d42/da4/l111 0 2024-01-17T23:47:45.581 INFO:tasks.workunit.client.0.smithi161.stdout:5/873: stat dd/d15/d1a/d5d/d64/f79 0 2024-01-17T23:47:46.019 INFO:tasks.workunit.client.0.smithi161.stdout:2/895: mkdir d8/d1c/d1e/d80/dcd/d13d 0 2024-01-17T23:47:46.019 INFO:tasks.workunit.client.0.smithi161.stdout:2/896: creat d8/d4b/d9a/db0/f13e x:0 0 0 2024-01-17T23:47:46.066 INFO:tasks.workunit.client.0.smithi161.stdout:0/933: mkdir d5/d34/d21/d76/d93/da3/d12b 0 2024-01-17T23:47:46.066 INFO:tasks.workunit.client.0.smithi161.stdout:6/926: symlink d6/d7/dc/d85/d13/l13e 0 2024-01-17T23:47:46.066 INFO:tasks.workunit.client.0.smithi161.stdout:0/934: readlink d5/d34/d21/d9e/de9/l36 0 2024-01-17T23:47:46.866 INFO:tasks.workunit.client.0.smithi161.stdout:5/874: symlink dd/d15/d6a/l112 0 2024-01-17T23:47:46.901 INFO:tasks.workunit.client.0.smithi161.stdout:5/875: dwrite dd/d15/d1a/d42/f46 [0,4194304] 0 2024-01-17T23:47:46.901 INFO:tasks.workunit.client.0.smithi161.stdout:5/876: chown dd/d31/d3c/f4c 2 1 2024-01-17T23:47:46.901 INFO:tasks.workunit.client.0.smithi161.stdout:5/877: truncate dd/d31/d7b/d78/f7e 1918779 0 2024-01-17T23:47:47.699 INFO:tasks.workunit.client.0.smithi161.stdout:7/900: creat da/db/f12b x:0 0 0 2024-01-17T23:47:47.699 INFO:tasks.workunit.client.0.smithi161.stdout:7/901: write da/db/d7a/dc0/f10a [305444,24395] 0 2024-01-17T23:47:47.699 INFO:tasks.workunit.client.0.smithi161.stdout:7/902: stat da/d34/d5a/d28/d2b 0 2024-01-17T23:47:48.514 INFO:tasks.workunit.client.0.smithi161.stdout:7/903: link da/db/cd6 da/d34/d5a/de9/d11f/c12c 0 2024-01-17T23:47:48.514 INFO:tasks.workunit.client.0.smithi161.stdout:7/904: readlink da/db/db2/lbf 0 2024-01-17T23:47:48.867 INFO:tasks.workunit.client.0.smithi161.stdout:7/905: stat da/db/d7a/l100 0 2024-01-17T23:47:48.882 INFO:tasks.workunit.client.0.smithi161.stdout:7/906: dread da/d14/d35/fe1 [0,4194304] 0 2024-01-17T23:47:49.120 INFO:tasks.workunit.client.0.smithi161.stdout:5/878: rmdir dd/d15/d1a/d5d/d64 39 2024-01-17T23:47:49.140 INFO:tasks.workunit.client.0.smithi161.stdout:3/975: dwrite d0/d5/d9/d38/f49 [0,4194304] 0 2024-01-17T23:47:49.283 INFO:tasks.workunit.client.0.smithi161.stdout:9/812: write d0/d39/f59 [2163284,9614] 0 2024-01-17T23:47:49.797 INFO:tasks.workunit.client.0.smithi161.stdout:3/976: dread d0/d5/d9/d1e/d5a/f10c [0,4194304] 0 2024-01-17T23:47:49.816 INFO:tasks.workunit.client.0.smithi161.stdout:3/977: write d0/d5/d9/d38/f49 [747412,117743] 0 2024-01-17T23:47:49.816 INFO:tasks.workunit.client.0.smithi161.stdout:3/978: write d0/d5/d9/d17/d32/fec [2609629,55808] 0 2024-01-17T23:47:50.185 INFO:tasks.workunit.client.0.smithi161.stdout:9/813: symlink d0/d39/d49/d107/l110 0 2024-01-17T23:47:50.185 INFO:tasks.workunit.client.0.smithi161.stdout:2/897: write d8/f6a [3688070,38873] 0 2024-01-17T23:47:50.186 INFO:tasks.workunit.client.0.smithi161.stdout:7/907: rename da/d34/d5a/d28/dad/lc3 to da/db/d7a/da8/d127/l12d 0 2024-01-17T23:47:50.210 INFO:tasks.workunit.client.0.smithi161.stdout:6/927: write d6/d7/dc/db2/fbb [1616956,6688] 0 2024-01-17T23:47:50.210 INFO:tasks.workunit.client.0.smithi161.stdout:0/935: write d5/d3a/deb/dee/f112 [4824338,82487] 0 2024-01-17T23:47:50.210 INFO:tasks.workunit.client.0.smithi161.stdout:0/936: stat d5/df6/d6b/lb9 0 2024-01-17T23:47:50.226 INFO:tasks.workunit.client.0.smithi161.stdout:0/937: dread d5/df6/f7d [0,4194304] 0 2024-01-17T23:47:50.239 INFO:tasks.workunit.client.0.smithi161.stdout:6/928: dwrite d6/d7/dc/d43/fd5 [0,4194304] 0 2024-01-17T23:47:50.517 INFO:tasks.workunit.client.0.smithi161.stdout:9/814: creat d0/d101/f111 x:0 0 0 2024-01-17T23:47:50.668 INFO:tasks.workunit.client.0.smithi161.stdout:2/898: mkdir d8/d67/dbc/d13f 0 2024-01-17T23:47:51.112 INFO:tasks.workunit.client.0.smithi161.stdout:6/929: symlink d6/dfa/d10e/l13f 0 2024-01-17T23:47:51.121 INFO:tasks.workunit.client.0.smithi161.stdout:6/930: dread d6/d7/dc/d85/fc0 [0,4194304] 0 2024-01-17T23:47:51.156 INFO:tasks.workunit.client.0.smithi161.stdout:8/932: sync 2024-01-17T23:47:51.156 INFO:tasks.workunit.client.0.smithi161.stdout:1/990: sync 2024-01-17T23:47:51.165 INFO:tasks.workunit.client.0.smithi161.stdout:8/933: dread d1/d22/dbd/dce/ff1 [0,4194304] 0 2024-01-17T23:47:51.165 INFO:tasks.workunit.client.0.smithi161.stdout:8/934: dread - d1/df/d20/d2a/f13a zero size 2024-01-17T23:47:51.165 INFO:tasks.workunit.client.0.smithi161.stdout:8/935: chown d1/df/d16/f8a 0 1 2024-01-17T23:47:51.190 INFO:tasks.workunit.client.0.smithi161.stdout:8/936: dwrite d1/d3d/d51/feb [0,4194304] 0 2024-01-17T23:47:51.214 INFO:tasks.workunit.client.0.smithi161.stdout:8/937: dwrite d1/df/d16/d8c/f12a [0,4194304] 0 2024-01-17T23:47:51.219 INFO:tasks.workunit.client.0.smithi161.stdout:8/938: dread d1/df/d20/f7c [0,4194304] 0 2024-01-17T23:47:51.727 INFO:tasks.workunit.client.0.smithi161.stdout:2/899: creat d8/d4b/d9a/d10e/d11d/f140 x:0 0 0 2024-01-17T23:47:51.727 INFO:tasks.workunit.client.0.smithi161.stdout:7/908: symlink da/d34/d5a/da0/df8/d3d/d82/l12e 0 2024-01-17T23:47:51.981 INFO:tasks.workunit.client.0.smithi161.stdout:6/931: creat d6/d7/dc/d43/dde/d120/f140 x:0 0 0 2024-01-17T23:47:51.981 INFO:tasks.workunit.client.0.smithi161.stdout:6/932: truncate d6/d7/dc/d85/d13/feb 297254 0 2024-01-17T23:47:52.006 INFO:tasks.workunit.client.0.smithi161.stdout:6/933: dwrite d6/d7/dc/db2/fd9 [0,4194304] 0 2024-01-17T23:47:52.006 INFO:tasks.workunit.client.0.smithi161.stdout:6/934: write d6/d7/dc/d43/dc3/dda/ffe [850632,8989] 0 2024-01-17T23:47:52.597 INFO:tasks.workunit.client.0.smithi161.stdout:9/815: mknod d0/d8/d14/c112 0 2024-01-17T23:47:52.617 INFO:tasks.workunit.client.0.smithi161.stdout:9/816: write d0/d8/d14/d56/f93 [714971,75797] 0 2024-01-17T23:47:52.836 INFO:tasks.workunit.client.0.smithi161.stdout:7/909: creat da/db/db2/dbc/f12f x:0 0 0 2024-01-17T23:47:53.769 INFO:tasks.workunit.client.0.smithi161.stdout:0/938: link d5/l41 d5/d3a/l12c 0 2024-01-17T23:47:53.793 INFO:tasks.workunit.client.0.smithi161.stdout:6/935: chown d6/d7/dc/c14 14 1 2024-01-17T23:47:53.849 INFO:tasks.workunit.client.0.smithi161.stdout:1/991: symlink d1/d64/l14a 0 2024-01-17T23:47:53.850 INFO:tasks.workunit.client.0.smithi161.stdout:1/992: chown d1/d8/fba 62100 1 2024-01-17T23:47:54.115 INFO:tasks.workunit.client.0.smithi161.stdout:5/879: write dd/d15/d1a/d5d/d64/f8d [3376611,115556] 0 2024-01-17T23:47:54.115 INFO:tasks.workunit.client.0.smithi161.stdout:9/817: symlink d0/d8/d14/d87/d9b/dd5/l113 0 2024-01-17T23:47:54.135 INFO:tasks.workunit.client.0.smithi161.stdout:7/910: mkdir da/db/da2/d126/d130 0 2024-01-17T23:47:55.161 INFO:tasks.workunit.client.0.smithi161.stdout:8/939: rename d1/d22/d2f/dd6 to d1/dc5/d140 0 2024-01-17T23:47:55.162 INFO:tasks.workunit.client.0.smithi161.stdout:5/880: getdents dd/d15/d1a/d42/da4 0 2024-01-17T23:47:55.162 INFO:tasks.workunit.client.0.smithi161.stdout:8/940: dread - d1/f13d zero size 2024-01-17T23:47:55.162 INFO:tasks.workunit.client.0.smithi161.stdout:5/881: write dd/d15/d1a/d5d/dc9/dde/ffd [634857,7372] 0 2024-01-17T23:47:55.358 INFO:tasks.workunit.client.0.smithi161.stdout:7/911: rename da/d14/d35/c67 to da/db/d7a/da8/dd2/c131 0 2024-01-17T23:47:55.377 INFO:tasks.workunit.client.0.smithi161.stdout:7/912: write da/d34/d5a/d28/d2b/f45 [3057008,28084] 0 2024-01-17T23:47:55.561 INFO:tasks.workunit.client.0.smithi161.stdout:3/979: truncate d0/d5/f113 985651 0 2024-01-17T23:47:55.575 INFO:tasks.workunit.client.0.smithi161.stdout:3/980: dread d0/d5/d9/f53 [0,4194304] 0 2024-01-17T23:47:55.664 INFO:tasks.workunit.client.0.smithi161.stdout:5/882: creat dd/d15/d1a/d5d/d64/d67/f113 x:0 0 0 2024-01-17T23:47:55.793 INFO:tasks.workunit.client.0.smithi161.stdout:7/913: getdents da 0 2024-01-17T23:47:56.110 INFO:tasks.workunit.client.0.smithi161.stdout:7/914: rmdir da/db/d7a/dc7 39 2024-01-17T23:47:56.110 INFO:tasks.workunit.client.0.smithi161.stdout:7/915: chown da/d34/d5a/da0/df8/d3d/d7f/f117 0 1 2024-01-17T23:47:56.110 INFO:tasks.workunit.client.0.smithi161.stdout:5/883: creat dd/d15/d1a/d34/f114 x:0 0 0 2024-01-17T23:47:56.110 INFO:tasks.workunit.client.0.smithi161.stdout:5/884: chown dd/d15/d1a/fb6 44 1 2024-01-17T23:47:56.110 INFO:tasks.workunit.client.0.smithi161.stdout:5/885: chown dd/fbc 23 1 2024-01-17T23:47:56.505 INFO:tasks.workunit.client.0.smithi161.stdout:2/900: dwrite d8/d1c/d75/dae/dc3/fb7 [0,4194304] 0 2024-01-17T23:47:56.891 INFO:tasks.workunit.client.0.smithi161.stdout:5/886: symlink dd/d15/d1a/d5d/d64/d7c/dd9/l115 0 2024-01-17T23:47:56.939 INFO:tasks.workunit.client.0.smithi161.stdout:5/887: dwrite dd/d15/d1a/d5d/d64/d7c/fab [0,4194304] 0 2024-01-17T23:47:57.443 INFO:tasks.workunit.client.0.smithi161.stdout:5/888: rmdir dd/d15/d1a 39 2024-01-17T23:47:57.443 INFO:tasks.workunit.client.0.smithi161.stdout:5/889: getdents dd/d15/d1a/d5d/d64/d7c/d88 0 2024-01-17T23:47:57.703 INFO:tasks.workunit.client.0.smithi161.stdout:0/939: write d5/d3a/d49/f5b [489653,105277] 0 2024-01-17T23:47:57.790 INFO:tasks.workunit.client.0.smithi161.stdout:8/941: write d1/df/f14 [1278968,74444] 0 2024-01-17T23:47:57.790 INFO:tasks.workunit.client.0.smithi161.stdout:8/942: chown d1/df/d20/d2a/d53/l11b 3472506 1 2024-01-17T23:47:57.790 INFO:tasks.workunit.client.0.smithi161.stdout:8/943: write d1/df/d13/ff0 [2354086,53662] 0 2024-01-17T23:47:57.877 INFO:tasks.workunit.client.0.smithi161.stdout:5/890: truncate dd/d15/d1a/d5d/d64/d7c/f8c 3686296 0 2024-01-17T23:47:57.880 INFO:tasks.workunit.client.0.smithi161.stdout:5/891: read dd/d15/d1a/d34/fa7 [1113837,128191] 0 2024-01-17T23:47:58.084 INFO:tasks.workunit.client.0.smithi161.stdout:0/940: mknod d5/d34/d21/d97/dbb/c12d 0 2024-01-17T23:47:58.087 INFO:tasks.workunit.client.0.smithi161.stdout:9/818: sync 2024-01-17T23:47:58.087 INFO:tasks.workunit.client.0.smithi161.stdout:6/936: sync 2024-01-17T23:47:58.087 INFO:tasks.workunit.client.0.smithi161.stdout:1/993: sync 2024-01-17T23:47:58.087 INFO:tasks.workunit.client.0.smithi161.stdout:1/994: readlink d1/la 0 2024-01-17T23:47:58.091 INFO:tasks.workunit.client.0.smithi161.stdout:0/941: dread d5/d3a/f43 [0,4194304] 0 2024-01-17T23:47:58.123 INFO:tasks.workunit.client.0.smithi161.stdout:8/944: unlink d1/d3d/dff/f10e 0 2024-01-17T23:47:58.150 INFO:tasks.workunit.client.0.smithi161.stdout:3/981: dwrite d0/d5/d9/d1e/f7b [0,4194304] 0 2024-01-17T23:47:58.754 INFO:tasks.workunit.client.0.smithi161.stdout:5/892: mkdir dd/d116 0 2024-01-17T23:47:59.332 INFO:tasks.workunit.client.0.smithi161.stdout:9/819: creat d0/d8/d31/f114 x:0 0 0 2024-01-17T23:47:59.332 INFO:tasks.workunit.client.0.smithi161.stdout:1/995: symlink d1/d11/d72/l14b 0 2024-01-17T23:47:59.333 INFO:tasks.workunit.client.0.smithi161.stdout:9/820: chown d0/d39/d49/c96 118011 1 2024-01-17T23:47:59.333 INFO:tasks.workunit.client.0.smithi161.stdout:7/916: write da/db/d7a/d8f/dac/fcd [424297,128804] 0 2024-01-17T23:47:59.464 INFO:tasks.workunit.client.0.smithi161.stdout:0/942: creat d5/d34/d21/d9e/f12e x:0 0 0 2024-01-17T23:47:59.605 INFO:tasks.workunit.client.0.smithi161.stdout:8/945: creat d1/d3/d19/d1d/d25/d4b/f141 x:0 0 0 2024-01-17T23:47:59.605 INFO:tasks.workunit.client.0.smithi161.stdout:8/946: read d1/d3d/f41 [373135,72031] 0 2024-01-17T23:47:59.605 INFO:tasks.workunit.client.0.smithi161.stdout:8/947: read d1/df/d20/f7c [373753,45995] 0 2024-01-17T23:47:59.963 INFO:tasks.workunit.client.0.smithi161.stdout:2/901: sync 2024-01-17T23:47:59.963 INFO:tasks.workunit.client.0.smithi161.stdout:3/982: symlink d0/d5/d9/d38/db3/db4/l130 0 2024-01-17T23:47:59.963 INFO:tasks.workunit.client.0.smithi161.stdout:3/983: fsync d0/d5/d9/d1e/d5a/d8a/ff1 0 2024-01-17T23:47:59.963 INFO:tasks.workunit.client.0.smithi161.stdout:2/902: write d8/d1c/d57/f10c [92854,56622] 0 2024-01-17T23:47:59.979 INFO:tasks.workunit.client.0.smithi161.stdout:3/984: dread d0/f4 [0,4194304] 0 2024-01-17T23:47:59.979 INFO:tasks.workunit.client.0.smithi161.stdout:3/985: fsync d0/d5/d9/d1e/d3b/df4/f120 0 2024-01-17T23:47:59.979 INFO:tasks.workunit.client.0.smithi161.stdout:3/986: fsync d0/d5/d9/d38/db3/db4/d10b/f10d 0 2024-01-17T23:47:59.979 INFO:tasks.workunit.client.0.smithi161.stdout:3/987: fdatasync d0/d5/d9/d8b/fc4 0 2024-01-17T23:48:00.175 INFO:tasks.workunit.client.0.smithi161.stdout:1/996: creat d1/d8/f14c x:0 0 0 2024-01-17T23:48:00.354 INFO:tasks.workunit.client.0.smithi161.stdout:9/821: mkdir d0/d8/d14/d87/d9b/dd5/d115 0 2024-01-17T23:48:00.581 INFO:tasks.workunit.client.0.smithi161.stdout:7/917: symlink da/db/d7a/da8/d127/l132 0 2024-01-17T23:48:00.658 INFO:tasks.workunit.client.0.smithi161.stdout:0/943: unlink d5/d8/c120 0 2024-01-17T23:48:00.658 INFO:tasks.workunit.client.0.smithi161.stdout:0/944: readlink d5/d34/d21/d76/d93/da3/l107 0 2024-01-17T23:48:00.915 INFO:tasks.workunit.client.0.smithi161.stdout:2/903: link d8/d1c/d1e/d80/l64 d8/d1c/d75/dc7/l141 0 2024-01-17T23:48:01.024 INFO:tasks.workunit.client.0.smithi161.stdout:3/988: chown d0/d5/d9/d38/d4f/da5/fb6 3921562 1 2024-01-17T23:48:01.024 INFO:tasks.workunit.client.0.smithi161.stdout:3/989: stat d0/d5/d9/d8b/f103 0 2024-01-17T23:48:01.134 INFO:tasks.workunit.client.0.smithi161.stdout:1/997: mknod d1/d20/d26/d30/d44/c14d 0 2024-01-17T23:48:01.134 INFO:tasks.workunit.client.0.smithi161.stdout:1/998: chown d1/d20 418370 1 2024-01-17T23:48:01.148 INFO:tasks.workunit.client.0.smithi161.stdout:1/999: write d1/d20/d26/d30/f3f [2413767,83624] 0 2024-01-17T23:48:01.467 INFO:tasks.workunit.client.0.smithi161.stdout:7/918: dread da/db/d7a/d8f/fe4 [0,4194304] 0 2024-01-17T23:48:01.467 INFO:tasks.workunit.client.0.smithi161.stdout:7/919: fsync da/d34/d5a/da0/df8/f61 0 2024-01-17T23:48:01.482 INFO:tasks.workunit.client.0.smithi161.stdout:7/920: dread da/d34/f124 [0,4194304] 0 2024-01-17T23:48:01.576 INFO:tasks.workunit.client.0.smithi161.stdout:0/945: mkdir d5/d34/d21/dd4/d12f 0 2024-01-17T23:48:01.576 INFO:tasks.workunit.client.0.smithi161.stdout:0/946: write d5/d34/d8a/fc9 [895451,107609] 0 2024-01-17T23:48:01.576 INFO:tasks.workunit.client.0.smithi161.stdout:0/947: write d5/d3a/db4/dc1/fea [1367847,121545] 0 2024-01-17T23:48:01.882 INFO:tasks.workunit.client.0.smithi161.stdout:3/990: rmdir d0/d5/d9/d38/db3/db4/d10b 39 2024-01-17T23:48:02.058 INFO:tasks.workunit.client.0.smithi161.stdout:9/822: mknod d0/d8/d14/d18/d20/da2/c116 0 2024-01-17T23:48:02.297 INFO:tasks.workunit.client.0.smithi161.stdout:7/921: rename da/db/d7a/d8f/dac/f11c to da/db/d7a/d8f/dde/f133 0 2024-01-17T23:48:02.297 INFO:tasks.workunit.client.0.smithi161.stdout:7/922: creat da/db/db2/f134 x:0 0 0 2024-01-17T23:48:02.297 INFO:tasks.workunit.client.0.smithi161.stdout:7/923: chown da/d34/d4a/d4c/cf4 2573 1 2024-01-17T23:48:02.297 INFO:tasks.workunit.client.0.smithi161.stdout:7/924: read da/d34/d5a/f91 [338213,201] 0 2024-01-17T23:48:02.297 INFO:tasks.workunit.client.0.smithi161.stdout:7/925: readlink da/db/db2/ldf 0 2024-01-17T23:48:02.337 INFO:tasks.workunit.client.0.smithi161.stdout:0/948: mkdir d5/d34/d21/d76/dcb/d130 0 2024-01-17T23:48:02.374 INFO:tasks.workunit.client.0.smithi161.stdout:0/949: dwrite d5/d34/d20/d2b/d64/d88/fa4 [0,4194304] 0 2024-01-17T23:48:02.393 INFO:tasks.workunit.client.0.smithi161.stdout:0/950: dread f2 [4194304,4194304] 0 2024-01-17T23:48:02.393 INFO:tasks.workunit.client.0.smithi161.stdout:0/951: chown d5/df6/d6b/d89 60832679 1 2024-01-17T23:48:02.393 INFO:tasks.workunit.client.0.smithi161.stdout:0/952: stat d5/d8/l95 0 2024-01-17T23:48:02.394 INFO:tasks.workunit.client.0.smithi161.stdout:0/953: creat d5/d34/d21/d9e/f131 x:0 0 0 2024-01-17T23:48:02.403 INFO:tasks.workunit.client.0.smithi161.stdout:0/954: dread d5/d34/d20/d2b/d64/d88/fc2 [0,4194304] 0 2024-01-17T23:48:02.403 INFO:tasks.workunit.client.0.smithi161.stdout:0/955: read - d5/d34/d21/d9e/f12e zero size 2024-01-17T23:48:02.487 INFO:tasks.workunit.client.0.smithi161.stdout:2/904: unlink d8/d4b/d9a/db0/d125/d12b/cba 0 2024-01-17T23:48:02.487 INFO:tasks.workunit.client.0.smithi161.stdout:2/905: chown d8/d4b/d9a/db0/d125/c131 6 1 2024-01-17T23:48:02.582 INFO:tasks.workunit.client.0.smithi161.stdout:6/937: write d6/d7/dc/d43/f9b [884436,11911] 0 2024-01-17T23:48:03.280 INFO:tasks.workunit.client.0.smithi161.stdout:9/823: creat d0/d8/d14/d18/d20/da2/dcb/f117 x:0 0 0 2024-01-17T23:48:03.444 INFO:tasks.workunit.client.0.smithi161.stdout:3/991: rename d0/d5/d9/d38/db3/db4/l130 to d0/d5/d9/d38/db3/l131 0 2024-01-17T23:48:04.208 INFO:tasks.workunit.client.0.smithi161.stdout:0/956: symlink d5/d34/d21/d9e/de9/d8d/l132 0 2024-01-17T23:48:04.500 INFO:tasks.workunit.client.0.smithi161.stdout:9/824: creat d0/d8/d14/d18/d20/f118 x:0 0 0 2024-01-17T23:48:04.507 INFO:tasks.workunit.client.0.smithi161.stdout:6/938: dread d6/f7c [0,4194304] 0 2024-01-17T23:48:04.535 INFO:tasks.workunit.client.0.smithi161.stdout:6/939: dwrite d6/d7/dc/d85/f49 [4194304,4194304] 0 2024-01-17T23:48:04.725 INFO:tasks.workunit.client.0.smithi161.stdout:2/906: rename d8/d1c/d57/f12a to d8/d4b/d9a/db0/d125/f142 0 2024-01-17T23:48:04.725 INFO:tasks.workunit.client.0.smithi161.stdout:3/992: symlink d0/d5/d9/d38/d4f/d9d/df7/l132 0 2024-01-17T23:48:04.897 INFO:tasks.workunit.client.0.smithi161.stdout:7/926: link da/d34/d5a/da0/df8/d3d/d82/ce7 da/da7/c135 0 2024-01-17T23:48:04.897 INFO:tasks.workunit.client.0.smithi161.stdout:7/927: getdents da/d34/d5a/d28 0 2024-01-17T23:48:05.031 INFO:tasks.workunit.client.0.smithi161.stdout:0/957: mkdir d5/d3a/d49/d99/dd7/d133 0 2024-01-17T23:48:05.065 INFO:tasks.workunit.client.0.smithi161.stdout:0/958: dwrite d5/d3a/db4/dc1/f119 [0,4194304] 0 2024-01-17T23:48:05.275 INFO:tasks.workunit.client.0.smithi161.stdout:9/825: getdents d0/d8/d14 0 2024-01-17T23:48:05.520 INFO:tasks.workunit.client.0.smithi161.stdout:5/893: unlink dd/d15/c98 0 2024-01-17T23:48:05.521 INFO:tasks.workunit.client.0.smithi161.stdout:5/894: fsync dd/d15/d1a/d5d/d64/d7c/f102 0 2024-01-17T23:48:05.521 INFO:tasks.workunit.client.0.smithi161.stdout:5/895: stat dd/d15/d1a/d5d/d64/d7c/fab 0 2024-01-17T23:48:05.521 INFO:tasks.workunit.client.0.smithi161.stdout:5/896: stat dd/d15/d1a/d5d/d64/d7c/d88/l96 0 2024-01-17T23:48:05.785 INFO:tasks.workunit.client.0.smithi161.stdout:2/907: unlink d8/d1c/d1e/da6/d35/d3a/f82 0 2024-01-17T23:48:05.806 INFO:tasks.workunit.client.0.smithi161.stdout:2/908: dread d8/da/d8d/f112 [0,4194304] 0 2024-01-17T23:48:05.960 INFO:tasks.workunit.client.0.smithi161.stdout:3/993: symlink d0/d5/d9/d1e/d5a/d8a/d123/d7c/l133 0 2024-01-17T23:48:05.960 INFO:tasks.workunit.client.0.smithi161.stdout:3/994: chown d0/d5/cd9 348 1 2024-01-17T23:48:06.155 INFO:tasks.workunit.client.0.smithi161.stdout:7/928: mknod da/d34/d5a/da0/df8/d3d/d7f/c136 0 2024-01-17T23:48:06.393 INFO:tasks.workunit.client.0.smithi161.stdout:0/959: creat d5/df6/db0/f134 x:0 0 0 2024-01-17T23:48:06.393 INFO:tasks.workunit.client.0.smithi161.stdout:0/960: write d5/d34/d21/d76/f94 [1011708,97829] 0 2024-01-17T23:48:06.393 INFO:tasks.workunit.client.0.smithi161.stdout:0/961: fsync d5/f32 0 2024-01-17T23:48:06.393 INFO:tasks.workunit.client.0.smithi161.stdout:0/962: chown d5/d3a/f43 1 1 2024-01-17T23:48:06.458 INFO:tasks.workunit.client.0.smithi161.stdout:9/826: mknod d0/d8/d14/d18/c119 0 2024-01-17T23:48:06.458 INFO:tasks.workunit.client.0.smithi161.stdout:9/827: dread - d0/d8/f10f zero size 2024-01-17T23:48:06.488 INFO:tasks.workunit.client.0.smithi161.stdout:9/828: dwrite d0/d8/d31/f7c [0,4194304] 0 2024-01-17T23:48:06.488 INFO:tasks.workunit.client.0.smithi161.stdout:9/829: fsync d0/d39/d49/fda 0 2024-01-17T23:48:06.488 INFO:tasks.workunit.client.0.smithi161.stdout:9/830: stat d0/d8/d14/dab/fb7 0 2024-01-17T23:48:06.519 INFO:tasks.workunit.client.0.smithi161.stdout:9/831: dwrite d0/d8/d14/d18/d20/f10d [0,4194304] 0 2024-01-17T23:48:06.619 INFO:tasks.workunit.client.0.smithi161.stdout:5/897: mknod dd/d15/d1a/c117 0 2024-01-17T23:48:06.685 INFO:tasks.workunit.client.0.smithi161.stdout:8/948: truncate d1/d3/d19/d1d/f106 700141 0 2024-01-17T23:48:06.833 INFO:tasks.workunit.client.0.smithi161.stdout:2/909: mkdir d8/d1c/d75/dc7/de5/deb/d143 0 2024-01-17T23:48:06.941 INFO:tasks.workunit.client.0.smithi161.stdout:3/995: creat d0/d5/d9/d38/d4f/f134 x:0 0 0 2024-01-17T23:48:06.946 INFO:tasks.workunit.client.0.smithi161.stdout:3/996: dread d0/d5/d9/f108 [0,4194304] 0 2024-01-17T23:48:06.946 INFO:tasks.workunit.client.0.smithi161.stdout:3/997: chown d0/f12 5294059 1 2024-01-17T23:48:06.952 INFO:tasks.workunit.client.0.smithi161.stdout:3/998: dread d0/d5/d9/d17/d32/fb1 [0,4194304] 0 2024-01-17T23:48:06.958 INFO:tasks.workunit.client.0.smithi161.stdout:3/999: dread d0/d5/d9/d38/d4f/d9d/da7/f79 [0,4194304] 0 2024-01-17T23:48:07.301 INFO:tasks.workunit.client.0.smithi161.stdout:0/963: creat d5/d8/f135 x:0 0 0 2024-01-17T23:48:08.417 INFO:tasks.workunit.client.0.smithi161.stdout:6/940: write d6/d7/dc/d85/d31/fd4 [189128,64999] 0 2024-01-17T23:48:08.594 INFO:tasks.workunit.client.0.smithi161.stdout:9/832: creat d0/d8/d14/d18/d20/d97/f11a x:0 0 0 2024-01-17T23:48:09.215 INFO:tasks.workunit.client.0.smithi161.stdout:2/910: creat d8/d1c/d1e/da6/d35/d3a/f144 x:0 0 0 2024-01-17T23:48:09.227 INFO:tasks.workunit.client.0.smithi161.stdout:2/911: write d8/f18 [1871050,117605] 0 2024-01-17T23:48:09.227 INFO:tasks.workunit.client.0.smithi161.stdout:2/912: readlink d8/d1c/d1e/da6/d35/d3a/ld1 0 2024-01-17T23:48:09.228 INFO:tasks.workunit.client.0.smithi161.stdout:2/913: readlink d8/d1c/d75/dc7/de5/lf3 0 2024-01-17T23:48:09.256 INFO:tasks.workunit.client.0.smithi161.stdout:2/914: dwrite d8/d1c/d1e/da6/d35/f109 [0,4194304] 0 2024-01-17T23:48:09.393 INFO:tasks.workunit.client.0.smithi161.stdout:0/964: symlink d5/d8/l136 0 2024-01-17T23:48:09.585 INFO:tasks.workunit.client.0.smithi161.stdout:6/941: mkdir d6/d7/d12c/d141 0 2024-01-17T23:48:09.615 INFO:tasks.workunit.client.0.smithi161.stdout:6/942: dwrite d6/d7/dc/d85/d13/f22 [0,4194304] 0 2024-01-17T23:48:09.655 INFO:tasks.workunit.client.0.smithi161.stdout:9/833: mknod d0/d8/d14/d56/d100/c11b 0 2024-01-17T23:48:09.781 INFO:tasks.workunit.client.0.smithi161.stdout:5/898: mkdir dd/d15/d1a/d5d/d64/d7c/dd9/d118 0 2024-01-17T23:48:10.590 INFO:tasks.workunit.client.0.smithi161.stdout:0/965: mknod d5/d3a/d49/d99/d96/dbc/d101/c137 0 2024-01-17T23:48:10.590 INFO:tasks.workunit.client.0.smithi161.stdout:0/966: fsync d5/d34/d21/d76/f79 0 2024-01-17T23:48:10.646 INFO:tasks.workunit.client.0.smithi161.stdout:7/929: sync 2024-01-17T23:48:10.794 INFO:tasks.workunit.client.0.smithi161.stdout:6/943: truncate d6/d7/dc/db2/fbb 1429201 0 2024-01-17T23:48:10.922 INFO:tasks.workunit.client.0.smithi161.stdout:5/899: link dd/d15/d51/f62 dd/d15/d51/dbf/f119 0 2024-01-17T23:48:11.271 INFO:tasks.workunit.client.0.smithi161.stdout:8/949: rename d1/df/d20/d2a/d56 to d1/d88/d105/d142 0 2024-01-17T23:48:11.271 INFO:tasks.workunit.client.0.smithi161.stdout:8/950: write d1/d3/d19/d1d/d25/d4b/fd3 [406772,53886] 0 2024-01-17T23:48:11.388 INFO:tasks.workunit.client.0.smithi161.stdout:0/967: getdents d5/d34 0 2024-01-17T23:48:11.619 INFO:tasks.workunit.client.0.smithi161.stdout:7/930: creat da/d34/d5a/de9/f137 x:0 0 0 2024-01-17T23:48:11.644 INFO:tasks.workunit.client.0.smithi161.stdout:7/931: dwrite da/d34/d5a/d68/d8c/fbd [0,4194304] 0 2024-01-17T23:48:11.644 INFO:tasks.workunit.client.0.smithi161.stdout:7/932: getdents da 0 2024-01-17T23:48:11.646 INFO:tasks.workunit.client.0.smithi161.stdout:7/933: dread da/db/d7a/d8f/fe4 [0,4194304] 0 2024-01-17T23:48:11.646 INFO:tasks.workunit.client.0.smithi161.stdout:7/934: write da/db/db2/fe0 [1668906,119063] 0 2024-01-17T23:48:11.886 INFO:tasks.workunit.client.0.smithi161.stdout:6/944: truncate d6/d7/dc/d43/d79/f11a 3323774 0 2024-01-17T23:48:12.181 INFO:tasks.workunit.client.0.smithi161.stdout:8/951: creat d1/d1c/f143 x:0 0 0 2024-01-17T23:48:12.246 INFO:tasks.workunit.client.0.smithi161.stdout:0/968: mknod d5/d34/d21/d76/d93/c138 0 2024-01-17T23:48:12.271 INFO:tasks.workunit.client.0.smithi161.stdout:0/969: dwrite d5/df6/f11a [0,4194304] 0 2024-01-17T23:48:12.677 INFO:tasks.workunit.client.0.smithi161.stdout:7/935: mkdir da/d34/d5a/da0/df8/d3d/d82/db0/d138 0 2024-01-17T23:48:12.677 INFO:tasks.workunit.client.0.smithi161.stdout:7/936: chown da/db/db2/dbc 3884 1 2024-01-17T23:48:12.860 INFO:tasks.workunit.client.0.smithi161.stdout:6/945: creat d6/d7/d12c/f142 x:0 0 0 2024-01-17T23:48:12.860 INFO:tasks.workunit.client.0.smithi161.stdout:6/946: fdatasync d6/d7/dc/d43/dc3/d90/ff7 0 2024-01-17T23:48:13.251 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:48:13.255 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:48:13.269 INFO:tasks.workunit.client.0.smithi161.stdout:0/970: mknod d5/df6/db0/dcc/c139 0 2024-01-17T23:48:13.444 INFO:tasks.workunit.client.0.smithi161.stdout:7/937: creat da/def/f139 x:0 0 0 2024-01-17T23:48:14.055 INFO:tasks.workunit.client.0.smithi161.stdout:9/834: rename d0/d8/d14/d18/d20/d97/d9e to d0/d8/d14/d11c 0 2024-01-17T23:48:14.188 INFO:tasks.workunit.client.0.smithi161.stdout:2/915: sync 2024-01-17T23:48:14.189 INFO:tasks.workunit.client.0.smithi161.stdout:2/916: dread - d8/d1c/d1e/da6/d35/d3a/f144 zero size 2024-01-17T23:48:14.450 INFO:tasks.workunit.client.0.smithi161.stdout:0/971: unlink d5/d3a/deb/dee/d35/l50 0 2024-01-17T23:48:14.459 INFO:tasks.workunit.client.0.smithi161.stdout:0/972: truncate d5/d34/d21/d76/fbd 525493 0 2024-01-17T23:48:14.686 INFO:tasks.workunit.client.0.smithi161.stdout:7/938: rename da/d14/d35/d41/f128 to da/db/d7a/d8f/f13a 0 2024-01-17T23:48:14.799 INFO:tasks.workunit.client.0.smithi161.stdout:9/835: mkdir d0/d8/d14/d87/d9b/d105/d11d 0 2024-01-17T23:48:14.799 INFO:tasks.workunit.client.0.smithi161.stdout:9/836: chown d0/d101/f111 1792727079 1 2024-01-17T23:48:15.683 INFO:tasks.workunit.client.0.smithi161.stdout:0/973: mkdir d5/d34/d20/d2b/dbf/d13a 0 2024-01-17T23:48:15.683 INFO:tasks.workunit.client.0.smithi161.stdout:0/974: fdatasync d5/d3a/d49/f7e 0 2024-01-17T23:48:15.687 INFO:tasks.workunit.client.0.smithi161.stdout:5/900: sync 2024-01-17T23:48:15.687 INFO:tasks.workunit.client.0.smithi161.stdout:5/901: chown dd/d15/d4e/d4f/c10a 107249829 1 2024-01-17T23:48:15.687 INFO:tasks.workunit.client.0.smithi161.stdout:9/837: truncate d0/d8/d14/f3f 1994551 0 2024-01-17T23:48:15.698 INFO:tasks.workunit.client.0.smithi161.stdout:0/975: dread f2 [0,4194304] 0 2024-01-17T23:48:15.718 INFO:tasks.workunit.client.0.smithi161.stdout:9/838: dwrite d0/d8/d14/d18/d20/d97/dae/f10c [0,4194304] 0 2024-01-17T23:48:15.723 INFO:tasks.workunit.client.0.smithi161.stdout:7/939: dwrite da/db/d7a/d8f/dac/dba/fd8 [0,4194304] 0 2024-01-17T23:48:15.724 INFO:tasks.workunit.client.0.smithi161.stdout:7/940: creat da/d34/d5a/da0/df8/d3d/d82/db0/f13b x:0 0 0 2024-01-17T23:48:15.728 INFO:tasks.workunit.client.0.smithi161.stdout:9/839: dread d0/d8/d31/f68 [0,4194304] 0 2024-01-17T23:48:15.748 INFO:tasks.workunit.client.0.smithi161.stdout:7/941: dwrite da/db/db2/fe0 [0,4194304] 0 2024-01-17T23:48:15.931 INFO:tasks.workunit.client.0.smithi161.stdout:8/952: sync 2024-01-17T23:48:15.952 INFO:tasks.workunit.client.0.smithi161.stdout:6/947: dwrite d6/d7/dc/d43/d79/fd6 [0,4194304] 0 2024-01-17T23:48:15.952 INFO:tasks.workunit.client.0.smithi161.stdout:6/948: chown d6/fa 3881 1 2024-01-17T23:48:16.190 INFO:tasks.workunit.client.0.smithi161.stdout:5/902: truncate dd/d15/d1a/d5d/d64/d7c/fd4 2555533 0 2024-01-17T23:48:16.485 INFO:tasks.workunit.client.0.smithi161.stdout:0/976: rmdir d5/d3a/db4/dc1 39 2024-01-17T23:48:16.485 INFO:tasks.workunit.client.0.smithi161.stdout:0/977: write d5/df6/db0/dcc/fdc [172953,127089] 0 2024-01-17T23:48:16.931 INFO:tasks.workunit.client.0.smithi161.stdout:2/917: sync 2024-01-17T23:48:16.931 INFO:tasks.workunit.client.0.smithi161.stdout:2/918: chown d8/d67/d6c/dce/c107 756161 1 2024-01-17T23:48:17.025 INFO:tasks.workunit.client.0.smithi161.stdout:9/840: truncate d0/f30 1370632 0 2024-01-17T23:48:17.026 INFO:tasks.workunit.client.0.smithi161.stdout:9/841: fdatasync d0/d8/d14/d56/fd1 0 2024-01-17T23:48:17.059 INFO:tasks.workunit.client.0.smithi161.stdout:9/842: dwrite d0/d8/d14/f85 [0,4194304] 0 2024-01-17T23:48:17.060 INFO:tasks.workunit.client.0.smithi161.stdout:9/843: chown d0/d8/d14/d18/d63/f6a 270803422 1 2024-01-17T23:48:17.220 INFO:tasks.workunit.client.0.smithi161.stdout:7/942: rename da/d14/l49 to da/d34/d5a/d28/d2b/d93/l13c 0 2024-01-17T23:48:17.407 INFO:tasks.workunit.client.0.smithi161.stdout:8/953: mkdir d1/d3/d19/d144 0 2024-01-17T23:48:17.407 INFO:tasks.workunit.client.0.smithi161.stdout:6/949: truncate d6/d7/dc/d43/f13b 7443591 0 2024-01-17T23:48:17.582 INFO:tasks.workunit.client.0.smithi161.stdout:5/903: symlink dd/d15/d1a/d5d/d64/d7c/l11a 0 2024-01-17T23:48:17.824 INFO:tasks.workunit.client.0.smithi161.stdout:0/978: unlink d5/d34/d12/f1d 0 2024-01-17T23:48:17.856 INFO:tasks.workunit.client.0.smithi161.stdout:0/979: dwrite d5/d3a/deb/dee/f38 [0,4194304] 0 2024-01-17T23:48:17.856 INFO:tasks.workunit.client.0.smithi161.stdout:0/980: read - d5/d34/d21/dd4/fd5 zero size 2024-01-17T23:48:17.872 INFO:tasks.workunit.client.0.smithi161.stdout:0/981: write d5/d3a/deb/dee/d35/f8e [2054250,60848] 0 2024-01-17T23:48:18.051 INFO:tasks.workunit.client.0.smithi161.stdout:9/844: mkdir d0/d8/d14/d87/d9b/dd5/d115/d11e 0 2024-01-17T23:48:18.414 INFO:tasks.workunit.client.0.smithi161.stdout:7/943: mknod da/db/d7a/da8/dd2/c13d 0 2024-01-17T23:48:18.437 INFO:tasks.workunit.client.0.smithi161.stdout:8/954: rename d1/d88/f95 to d1/d3/d19/d1d/df3/d134/f145 0 2024-01-17T23:48:18.693 INFO:tasks.workunit.client.0.smithi161.stdout:5/904: unlink dd/d31/db8/fbd 0 2024-01-17T23:48:19.639 INFO:tasks.workunit.client.0.smithi161.stdout:0/982: dread d5/d34/d12/fd6 [0,4194304] 0 2024-01-17T23:48:19.726 INFO:tasks.workunit.client.0.smithi161.stdout:9/845: creat d0/d8/d14/d18/d20/d97/dae/f11f x:0 0 0 2024-01-17T23:48:19.727 INFO:tasks.workunit.client.0.smithi161.stdout:9/846: creat d0/d8/d31/d73/f120 x:0 0 0 2024-01-17T23:48:19.727 INFO:tasks.workunit.client.0.smithi161.stdout:9/847: truncate d0/d39/d49/d6e/fb2 287680 0 2024-01-17T23:48:19.727 INFO:tasks.workunit.client.0.smithi161.stdout:9/848: creat d0/d8/d14/d18/d20/d97/f121 x:0 0 0 2024-01-17T23:48:19.727 INFO:tasks.workunit.client.0.smithi161.stdout:9/849: write d0/d8/f10f [892685,73859] 0 2024-01-17T23:48:19.755 INFO:tasks.workunit.client.0.smithi161.stdout:9/850: dwrite d0/d39/fe5 [0,4194304] 0 2024-01-17T23:48:19.755 INFO:tasks.workunit.client.0.smithi161.stdout:9/851: dread - d0/d8/d14/d18/d20/ff9 zero size 2024-01-17T23:48:19.755 INFO:tasks.workunit.client.0.smithi161.stdout:9/852: chown d0/d8/d14/d87/d9b/cc7 5 1 2024-01-17T23:48:19.774 INFO:tasks.workunit.client.0.smithi161.stdout:9/853: dread d0/d8/d31/f86 [0,4194304] 0 2024-01-17T23:48:19.774 INFO:tasks.workunit.client.0.smithi161.stdout:9/854: truncate d0/d8/d14/f90 4374316 0 2024-01-17T23:48:19.774 INFO:tasks.workunit.client.0.smithi161.stdout:9/855: dread - d0/d8/d14/d87/fb5 zero size 2024-01-17T23:48:20.134 INFO:tasks.workunit.client.0.smithi161.stdout:7/944: rename da/db/db2/fe0 to da/d34/d5a/de9/f13e 0 2024-01-17T23:48:20.141 INFO:tasks.workunit.client.0.smithi161.stdout:7/945: dread f8 [0,4194304] 0 2024-01-17T23:48:20.317 INFO:tasks.workunit.client.0.smithi161.stdout:5/905: dwrite dd/d15/d1a/d34/fb7 [0,4194304] 0 2024-01-17T23:48:21.454 INFO:tasks.workunit.client.0.smithi161.stdout:2/919: symlink d8/l145 0 2024-01-17T23:48:21.476 INFO:tasks.workunit.client.0.smithi161.stdout:2/920: write d8/d1c/d75/dae/dc3/fb7 [3855325,42278] 0 2024-01-17T23:48:21.476 INFO:tasks.workunit.client.0.smithi161.stdout:2/921: fsync d8/da/f13b 0 2024-01-17T23:48:21.541 INFO:tasks.workunit.client.0.smithi161.stdout:7/946: mknod da/d14/d35/d41/c13f 0 2024-01-17T23:48:21.945 INFO:tasks.workunit.client.0.smithi161.stdout:5/906: creat dd/d15/d1a/d5d/d64/d7c/dd9/d118/f11b x:0 0 0 2024-01-17T23:48:21.961 INFO:tasks.workunit.client.0.smithi161.stdout:5/907: write dd/d31/d3c/ff0 [2067538,27430] 0 2024-01-17T23:48:21.985 INFO:tasks.workunit.client.0.smithi161.stdout:6/950: dwrite d6/d7/dc/d85/d13/f1c [0,4194304] 0 2024-01-17T23:48:21.985 INFO:tasks.workunit.client.0.smithi161.stdout:6/951: creat d6/d7/dc/d43/dde/d120/f143 x:0 0 0 2024-01-17T23:48:21.988 INFO:tasks.workunit.client.0.smithi161.stdout:5/908: write dd/f12 [2473556,71672] 0 2024-01-17T23:48:21.988 INFO:tasks.workunit.client.0.smithi161.stdout:5/909: write dd/d15/d1a/d34/f114 [263273,64529] 0 2024-01-17T23:48:22.008 INFO:tasks.workunit.client.0.smithi161.stdout:6/952: write d6/d7/dc/d85/d13/f1c [4155166,117699] 0 2024-01-17T23:48:22.008 INFO:tasks.workunit.client.0.smithi161.stdout:6/953: readlink d6/d7/dc/db2/d112/l130 0 2024-01-17T23:48:22.216 INFO:tasks.workunit.client.0.smithi161.stdout:0/983: rename d5/d34/c2c to d5/df6/d6b/d89/c13b 0 2024-01-17T23:48:22.243 INFO:tasks.workunit.client.0.smithi161.stdout:0/984: dwrite d5/d3a/db4/dc1/fed [0,4194304] 0 2024-01-17T23:48:22.448 INFO:tasks.workunit.client.0.smithi161.stdout:2/922: mkdir d8/d1c/d1e/d80/dcd/d13d/d146 0 2024-01-17T23:48:22.455 INFO:tasks.workunit.client.0.smithi161.stdout:2/923: write d8/d67/d6c/f12f [146245,46985] 0 2024-01-17T23:48:22.845 INFO:tasks.workunit.client.0.smithi161.stdout:5/910: link dd/d15/d1a/d5d/dc9/dcb/fed dd/d31/d56/f11c 0 2024-01-17T23:48:23.082 INFO:tasks.workunit.client.0.smithi161.stdout:6/954: creat d6/dfc/f144 x:0 0 0 2024-01-17T23:48:23.566 INFO:tasks.workunit.client.0.smithi161.stdout:0/985: unlink d5/d34/d20/d2b/cba 0 2024-01-17T23:48:23.882 INFO:tasks.workunit.client.0.smithi161.stdout:9/856: creat d0/d8/d14/d18/d20/f122 x:0 0 0 2024-01-17T23:48:23.967 INFO:tasks.workunit.client.0.smithi161.stdout:5/911: readlink dd/d15/d1a/d5d/d64/d7c/d86/la2 0 2024-01-17T23:48:24.201 INFO:tasks.workunit.client.0.smithi161.stdout:0/986: mkdir d5/df6/db0/dcc/df1/d13c 0 2024-01-17T23:48:24.271 INFO:tasks.workunit.client.0.smithi161.stdout:2/924: getdents d8/d67/d6c/dce 0 2024-01-17T23:48:24.353 INFO:tasks.workunit.client.0.smithi161.stdout:8/955: write d1/d3/d19/d1d/f9b [953618,25543] 0 2024-01-17T23:48:24.734 INFO:tasks.workunit.client.0.smithi161.stdout:5/912: symlink dd/d15/d1a/d5d/d64/d7c/l11d 0 2024-01-17T23:48:24.816 INFO:tasks.workunit.client.0.smithi161.stdout:0/987: mkdir d5/d34/d21/d9e/d13d 0 2024-01-17T23:48:24.816 INFO:tasks.workunit.client.0.smithi161.stdout:0/988: chown d5/d3a/deb/dee/f38 21121663 1 2024-01-17T23:48:24.825 INFO:tasks.workunit.client.0.smithi161.stdout:0/989: dread d5/d34/d12/fd6 [0,4194304] 0 2024-01-17T23:48:24.927 INFO:tasks.workunit.client.0.smithi161.stdout:2/925: mkdir d8/d1c/d1e/d80/d79/d147 0 2024-01-17T23:48:25.190 INFO:tasks.workunit.client.0.smithi161.stdout:5/913: link dd/d15/d1a/d5d/dc9/dde/ffd dd/d15/d1a/d5d/dd1/f11e 0 2024-01-17T23:48:25.409 INFO:tasks.workunit.client.0.smithi161.stdout:0/990: mknod d5/d3a/deb/df3/c13e 0 2024-01-17T23:48:25.409 INFO:tasks.workunit.client.0.smithi161.stdout:0/991: creat d5/df6/db0/dcc/df1/f13f x:0 0 0 2024-01-17T23:48:26.326 INFO:tasks.workunit.client.0.smithi161.stdout:0/992: symlink d5/d3a/db4/dc1/l140 0 2024-01-17T23:48:26.426 INFO:tasks.workunit.client.0.smithi161.stdout:5/914: unlink dd/d15/d4e/fc6 0 2024-01-17T23:48:26.426 INFO:tasks.workunit.client.0.smithi161.stdout:5/915: write dd/d31/d7b/fe1 [47003,31014] 0 2024-01-17T23:48:26.691 INFO:tasks.workunit.client.0.smithi161.stdout:5/916: truncate dd/d15/d1a/d5d/f65 4142534 0 2024-01-17T23:48:26.691 INFO:tasks.workunit.client.0.smithi161.stdout:5/917: dread - dd/d15/d1a/d5d/f100 zero size 2024-01-17T23:48:26.859 INFO:tasks.workunit.client.0.smithi161.stdout:0/993: symlink d5/df6/d6b/d89/l141 0 2024-01-17T23:48:26.887 INFO:tasks.workunit.client.0.smithi161.stdout:0/994: dwrite d5/d34/d21/f3d [0,4194304] 0 2024-01-17T23:48:26.887 INFO:tasks.workunit.client.0.smithi161.stdout:0/995: readlink d5/d3a/db4/dc1/l140 0 2024-01-17T23:48:26.887 INFO:tasks.workunit.client.0.smithi161.stdout:0/996: chown d5/lf7 1 1 2024-01-17T23:48:26.909 INFO:tasks.workunit.client.0.smithi161.stdout:0/997: dread d5/d8/f9 [0,4194304] 0 2024-01-17T23:48:27.422 INFO:tasks.workunit.client.0.smithi161.stdout:0/998: creat d5/d34/d21/d9e/de9/d8d/d108/f142 x:0 0 0 2024-01-17T23:48:27.422 INFO:tasks.workunit.client.0.smithi161.stdout:0/999: chown d5/d34/d21/d76 4683837 1 2024-01-17T23:48:28.592 INFO:tasks.workunit.client.0.smithi161.stdout:7/947: rename da/db/c64 to da/d34/d5a/da0/df8/d3d/d82/db0/d138/c140 0 2024-01-17T23:48:28.611 INFO:tasks.workunit.client.0.smithi161.stdout:6/955: creat d6/d7/f145 x:0 0 0 2024-01-17T23:48:28.935 INFO:tasks.workunit.client.0.smithi161.stdout:9/857: rename d0/d8/d14/d56/l5e to d0/d8/d14/d18/l123 0 2024-01-17T23:48:28.994 INFO:tasks.workunit.client.0.smithi161.stdout:7/948: symlink da/d34/d5a/d28/d2b/d93/l141 0 2024-01-17T23:48:29.023 INFO:tasks.workunit.client.0.smithi161.stdout:7/949: dwrite da/db/d7a/d8f/dac/fcd [0,4194304] 0 2024-01-17T23:48:29.024 INFO:tasks.workunit.client.0.smithi161.stdout:7/950: truncate da/d34/d5a/d68/f118 764735 0 2024-01-17T23:48:29.327 INFO:tasks.workunit.client.0.smithi161.stdout:8/956: rename d1/d22/d2f/f7a to d1/df/d20/f146 0 2024-01-17T23:48:29.356 INFO:tasks.workunit.client.0.smithi161.stdout:8/957: dwrite d1/d3/d19/d1d/df3/d134/f13f [0,4194304] 0 2024-01-17T23:48:29.399 INFO:tasks.workunit.client.0.smithi161.stdout:9/858: creat d0/d39/d49/d6e/f124 x:0 0 0 2024-01-17T23:48:29.886 INFO:tasks.workunit.client.0.smithi161.stdout:7/951: getdents da/d34/d5a/de9/d11f 0 2024-01-17T23:48:30.233 INFO:tasks.workunit.client.0.smithi161.stdout:8/958: mknod d1/dc5/c147 0 2024-01-17T23:48:30.321 INFO:tasks.workunit.client.0.smithi161.stdout:9/859: truncate d0/d39/f59 1402452 0 2024-01-17T23:48:30.321 INFO:tasks.workunit.client.0.smithi161.stdout:9/860: creat d0/d8/d14/d87/d9b/d105/f125 x:0 0 0 2024-01-17T23:48:30.321 INFO:tasks.workunit.client.0.smithi161.stdout:9/861: dread - d0/d8/d31/f114 zero size 2024-01-17T23:48:30.321 INFO:tasks.workunit.client.0.smithi161.stdout:9/862: read - d0/d8/d31/d73/fc5 zero size 2024-01-17T23:48:30.502 INFO:tasks.workunit.client.0.smithi161.stdout:7/952: stat da/d34/d5a/d28/d2b/l63 0 2024-01-17T23:48:30.502 INFO:tasks.workunit.client.0.smithi161.stdout:7/953: fdatasync da/f102 0 2024-01-17T23:48:30.529 INFO:tasks.workunit.client.0.smithi161.stdout:7/954: write da/d14/d35/f10c [2127252,52812] 0 2024-01-17T23:48:30.529 INFO:tasks.workunit.client.0.smithi161.stdout:7/955: read da/db/d7a/dc0/ff5 [2924565,2857] 0 2024-01-17T23:48:30.529 INFO:tasks.workunit.client.0.smithi161.stdout:7/956: write da/db/d7a/dc0/ff5 [2595708,36014] 0 2024-01-17T23:48:30.552 INFO:tasks.workunit.client.0.smithi161.stdout:7/957: dread da/d14/d35/f10c [0,4194304] 0 2024-01-17T23:48:30.552 INFO:tasks.workunit.client.0.smithi161.stdout:7/958: truncate da/db/d7a/d8f/fed 441718 0 2024-01-17T23:48:30.685 INFO:tasks.workunit.client.0.smithi161.stdout:8/959: link d1/d3/d19/d1d/d25/f39 d1/df/d16/dbf/d125/d137/f148 0 2024-01-17T23:48:30.685 INFO:tasks.workunit.client.0.smithi161.stdout:8/960: fsync d1/d3/d19/d1d/d25/f60 0 2024-01-17T23:48:30.782 INFO:tasks.workunit.client.0.smithi161.stdout:5/918: dwrite dd/d15/d1a/f25 [0,4194304] 0 2024-01-17T23:48:31.020 INFO:tasks.workunit.client.0.smithi161.stdout:2/926: symlink d8/l148 0 2024-01-17T23:48:31.292 INFO:tasks.workunit.client.0.smithi161.stdout:8/961: symlink d1/d3d/d51/d136/l149 0 2024-01-17T23:48:31.292 INFO:tasks.workunit.client.0.smithi161.stdout:8/962: truncate d1/d55/f99 104003 0 2024-01-17T23:48:31.292 INFO:tasks.workunit.client.0.smithi161.stdout:8/963: stat d1/d3/ld 0 2024-01-17T23:48:32.789 INFO:tasks.workunit.client.0.smithi161.stdout:7/959: rename da/db/db2/f134 to da/d34/d5a/d28/dad/f142 0 2024-01-17T23:48:32.789 INFO:tasks.workunit.client.0.smithi161.stdout:7/960: fsync da/faa 0 2024-01-17T23:48:32.799 INFO:tasks.workunit.client.0.smithi161.stdout:7/961: dread da/d34/f124 [0,4194304] 0 2024-01-17T23:48:32.888 INFO:tasks.workunit.client.0.smithi161.stdout:6/956: creat d6/d7/dc/d85/f146 x:0 0 0 2024-01-17T23:48:32.991 INFO:tasks.workunit.client.0.smithi161.stdout:8/964: link d1/d3d/le6 d1/d22/d2f/d86/l14a 0 2024-01-17T23:48:33.467 INFO:tasks.workunit.client.0.smithi161.stdout:7/962: truncate da/d34/d5a/d28/f7b 2327254 0 2024-01-17T23:48:33.467 INFO:tasks.workunit.client.0.smithi161.stdout:7/963: chown da/d14/d35/c96 510 1 2024-01-17T23:48:33.531 INFO:tasks.workunit.client.0.smithi161.stdout:9/863: mkdir d0/d8/d14/d18/d20/d126 0 2024-01-17T23:48:33.531 INFO:tasks.workunit.client.0.smithi161.stdout:9/864: chown d0/d39/d49/d6e/f124 3 1 2024-01-17T23:48:33.531 INFO:tasks.workunit.client.0.smithi161.stdout:9/865: dread - d0/d8/d31/d58/f7d zero size 2024-01-17T23:48:33.562 INFO:tasks.workunit.client.0.smithi161.stdout:9/866: dwrite d0/d8/d31/f7c [0,4194304] 0 2024-01-17T23:48:33.562 INFO:tasks.workunit.client.0.smithi161.stdout:9/867: dread - d0/d8/d31/d73/fc5 zero size 2024-01-17T23:48:33.612 INFO:tasks.workunit.client.0.smithi161.stdout:8/965: mknod d1/d3/d19/d1d/df9/c14b 0 2024-01-17T23:48:33.612 INFO:tasks.workunit.client.0.smithi161.stdout:8/966: chown d1/df/d16/l116 643957 1 2024-01-17T23:48:33.617 INFO:tasks.workunit.client.0.smithi161.stdout:8/967: dread d1/d3/d19/d1d/d25/d4b/fd3 [0,4194304] 0 2024-01-17T23:48:34.088 INFO:tasks.workunit.client.0.smithi161.stdout:7/964: creat da/d34/d5a/da0/df8/db9/f143 x:0 0 0 2024-01-17T23:48:34.502 INFO:tasks.workunit.client.0.smithi161.stdout:8/968: creat d1/d3/f14c x:0 0 0 2024-01-17T23:48:34.592 INFO:tasks.workunit.client.0.smithi161.stdout:7/965: creat da/d34/d5a/f144 x:0 0 0 2024-01-17T23:48:34.592 INFO:tasks.workunit.client.0.smithi161.stdout:7/966: stat da/d14/d35/d41/c13f 0 2024-01-17T23:48:34.625 INFO:tasks.workunit.client.0.smithi161.stdout:7/967: dwrite da/db/d7a/dc0/f10a [0,4194304] 0 2024-01-17T23:48:34.625 INFO:tasks.workunit.client.0.smithi161.stdout:7/968: dread - da/f6c zero size 2024-01-17T23:48:34.625 INFO:tasks.workunit.client.0.smithi161.stdout:7/969: truncate da/d34/d5a/da0/df8/f4b 4604430 0 2024-01-17T23:48:34.625 INFO:tasks.workunit.client.0.smithi161.stdout:7/970: dread - da/d34/d5a/da0/df8/d3d/d82/f129 zero size 2024-01-17T23:48:34.625 INFO:tasks.workunit.client.0.smithi161.stdout:7/971: creat da/def/f145 x:0 0 0 2024-01-17T23:48:34.625 INFO:tasks.workunit.client.0.smithi161.stdout:7/972: readlink da/d34/d5a/ld3 0 2024-01-17T23:48:34.625 INFO:tasks.workunit.client.0.smithi161.stdout:7/973: chown da/d14/d35/f10c 1 1 2024-01-17T23:48:34.893 INFO:tasks.workunit.client.0.smithi161.stdout:8/969: link d1/c12c d1/d55/c14d 0 2024-01-17T23:48:35.261 INFO:tasks.workunit.client.0.smithi161.stdout:7/974: symlink da/db/d7a/l146 0 2024-01-17T23:48:35.261 INFO:tasks.workunit.client.0.smithi161.stdout:7/975: fsync da/d34/d5a/da0/df8/f48 0 2024-01-17T23:48:35.456 INFO:tasks.workunit.client.0.smithi161.stdout:8/970: chown d1/d22/lde 2739 1 2024-01-17T23:48:35.560 INFO:tasks.workunit.client.0.smithi161.stdout:7/976: truncate da/d34/d5a/d68/d8c/fbd 1522975 0 2024-01-17T23:48:35.561 INFO:tasks.workunit.client.0.smithi161.stdout:7/977: write da/d34/d5a/da0/df8/d3d/d7f/f11e [127415,98054] 0 2024-01-17T23:48:35.561 INFO:tasks.workunit.client.0.smithi161.stdout:7/978: write da/db/d7a/dc7/f59 [3565833,85578] 0 2024-01-17T23:48:35.793 INFO:tasks.workunit.client.0.smithi161.stdout:8/971: rename d1/d3d/d51/d136 to d1/d3/d19/d14e 0 2024-01-17T23:48:35.793 INFO:tasks.workunit.client.0.smithi161.stdout:7/979: link da/d34/d5a/da0/df8/d3d/d82/ce7 da/db/d7a/da8/d127/c147 0 2024-01-17T23:48:35.793 INFO:tasks.workunit.client.0.smithi161.stdout:7/980: dread - da/d34/d4a/d4c/f94 zero size 2024-01-17T23:48:36.040 INFO:tasks.workunit.client.0.smithi161.stdout:2/927: write d8/f14 [1914349,96341] 0 2024-01-17T23:48:36.274 INFO:tasks.workunit.client.0.smithi161.stdout:5/919: sync 2024-01-17T23:48:36.275 INFO:tasks.workunit.client.0.smithi161.stdout:5/920: chown dd/d31/fff 10212 1 2024-01-17T23:48:36.275 INFO:tasks.workunit.client.0.smithi161.stdout:5/921: creat dd/d31/d3c/f11f x:0 0 0 2024-01-17T23:48:36.309 INFO:tasks.workunit.client.0.smithi161.stdout:6/957: write d6/d7/dc/d43/d79/f8a [2138789,48841] 0 2024-01-17T23:48:36.334 INFO:tasks.workunit.client.0.smithi161.stdout:9/868: dwrite d0/d8/f66 [0,4194304] 0 2024-01-17T23:48:36.334 INFO:tasks.workunit.client.0.smithi161.stdout:9/869: truncate d0/d8/d14/d18/d20/d97/f11a 26747 0 2024-01-17T23:48:36.334 INFO:tasks.workunit.client.0.smithi161.stdout:9/870: truncate d0/d8/d31/d73/fc5 881721 0 2024-01-17T23:48:36.609 INFO:tasks.workunit.client.0.smithi161.stdout:8/972: rmdir d1/d3/d19/d144 0 2024-01-17T23:48:36.987 INFO:tasks.workunit.client.0.smithi161.stdout:2/928: link d8/c74 d8/d1c/d75/dc7/de5/deb/d143/c149 0 2024-01-17T23:48:37.299 INFO:tasks.workunit.client.0.smithi161.stdout:5/922: truncate dd/d15/d4e/d4f/f8b 274815 0 2024-01-17T23:48:37.299 INFO:tasks.workunit.client.0.smithi161.stdout:5/923: write dd/d31/d7b/f53 [946764,110449] 0 2024-01-17T23:48:37.380 INFO:tasks.workunit.client.0.smithi161.stdout:6/958: symlink d6/dfa/d10e/ddd/l147 0 2024-01-17T23:48:37.528 INFO:tasks.workunit.client.0.smithi161.stdout:9/871: unlink d0/d8/d14/d18/d20/da2/dcb/lfe 0 2024-01-17T23:48:37.528 INFO:tasks.workunit.client.0.smithi161.stdout:9/872: chown d0/d8/d14 270259 1 2024-01-17T23:48:38.143 INFO:tasks.workunit.client.0.smithi161.stdout:8/973: creat d1/d3d/dc7/f14f x:0 0 0 2024-01-17T23:48:38.547 INFO:tasks.workunit.client.0.smithi161.stdout:2/929: symlink d8/d68/d132/l14a 0 2024-01-17T23:48:38.807 INFO:tasks.workunit.client.0.smithi161.stdout:5/924: dread - dd/d15/d6a/f71 zero size 2024-01-17T23:48:38.873 INFO:tasks.workunit.client.0.smithi161.stdout:6/959: rename d6/d7/dc/d43/dde/d120/f140 to d6/d7/dc/d43/dc3/d13d/f148 0 2024-01-17T23:48:38.994 INFO:tasks.workunit.client.0.smithi161.stdout:9/873: truncate d0/d8/d31/f7c 1092263 0 2024-01-17T23:48:38.995 INFO:tasks.workunit.client.0.smithi161.stdout:9/874: write d0/d8/d14/d18/f1d [1128801,91715] 0 2024-01-17T23:48:39.023 INFO:tasks.workunit.client.0.smithi161.stdout:9/875: dwrite d0/d39/d49/fda [0,4194304] 0 2024-01-17T23:48:39.672 INFO:tasks.workunit.client.0.smithi161.stdout:8/974: truncate d1/fe7 3079471 0 2024-01-17T23:48:39.748 INFO:tasks.workunit.client.0.smithi161.stdout:7/981: write da/d34/fa1 [1510378,67220] 0 2024-01-17T23:48:39.817 INFO:tasks.workunit.client.0.smithi161.stdout:2/930: symlink d8/d67/dbc/l14b 0 2024-01-17T23:48:40.195 INFO:tasks.workunit.client.0.smithi161.stdout:5/925: creat dd/d15/d1a/d5d/d64/d7c/dd9/f120 x:0 0 0 2024-01-17T23:48:40.226 INFO:tasks.workunit.client.0.smithi161.stdout:5/926: dwrite dd/d31/fad [0,4194304] 0 2024-01-17T23:48:40.406 INFO:tasks.workunit.client.0.smithi161.stdout:6/960: rename d6/d7/dc/d43/dde/d118 to d6/d7/dc/d85/d13/dfb/d149 0 2024-01-17T23:48:40.406 INFO:tasks.workunit.client.0.smithi161.stdout:6/961: write d6/d7/dc/d43/f111 [991637,47340] 0 2024-01-17T23:48:40.738 INFO:tasks.workunit.client.0.smithi161.stdout:9/876: mknod d0/d8/d14/d18/c127 0 2024-01-17T23:48:40.738 INFO:tasks.workunit.client.0.smithi161.stdout:9/877: fdatasync d0/ff8 0 2024-01-17T23:48:40.994 INFO:tasks.workunit.client.0.smithi161.stdout:8/975: read d1/df/f14 [440220,22999] 0 2024-01-17T23:48:40.995 INFO:tasks.workunit.client.0.smithi161.stdout:8/976: write d1/d3/d19/d1d/f9b [1174795,98249] 0 2024-01-17T23:48:41.073 INFO:tasks.workunit.client.0.smithi161.stdout:7/982: readlink da/db/d7a/d8f/dac/ld7 0 2024-01-17T23:48:41.099 INFO:tasks.workunit.client.0.smithi161.stdout:7/983: dwrite da/d34/d5a/da0/ff0 [0,4194304] 0 2024-01-17T23:48:41.115 INFO:tasks.workunit.client.0.smithi161.stdout:7/984: dread da/d34/d5a/da0/df8/f4b [0,4194304] 0 2024-01-17T23:48:41.115 INFO:tasks.workunit.client.0.smithi161.stdout:7/985: creat da/db/d7a/d8f/dac/dba/f148 x:0 0 0 2024-01-17T23:48:41.270 INFO:tasks.workunit.client.0.smithi161.stdout:2/931: rmdir d8/d1c/d1e/da6 39 2024-01-17T23:48:41.271 INFO:tasks.workunit.client.0.smithi161.stdout:2/932: fsync d8/da/fc6 0 2024-01-17T23:48:41.271 INFO:tasks.workunit.client.0.smithi161.stdout:2/933: readlink d8/d4b/d9a/la9 0 2024-01-17T23:48:41.688 INFO:tasks.workunit.client.0.smithi161.stdout:6/962: creat d6/d7/dc/d85/d13/dfb/d149/f14a x:0 0 0 2024-01-17T23:48:41.695 INFO:tasks.workunit.client.0.smithi161.stdout:6/963: dread d6/d7/dc/d85/f6c [0,4194304] 0 2024-01-17T23:48:41.895 INFO:tasks.workunit.client.0.smithi161.stdout:8/977: mknod d1/df/d16/dbf/c150 0 2024-01-17T23:48:41.895 INFO:tasks.workunit.client.0.smithi161.stdout:8/978: readlink d1/d3/ld 0 2024-01-17T23:48:42.754 INFO:tasks.workunit.client.0.smithi161.stdout:9/878: dwrite d0/d8/d31/f7c [0,4194304] 0 2024-01-17T23:48:42.851 INFO:tasks.workunit.client.0.smithi161.stdout:5/927: rmdir dd/d15/d1a/d42 39 2024-01-17T23:48:42.851 INFO:tasks.workunit.client.0.smithi161.stdout:5/928: write dd/d15/d1a/d5d/d64/d7c/dd9/f120 [490268,15742] 0 2024-01-17T23:48:42.854 INFO:tasks.workunit.client.0.smithi161.stdout:5/929: dread dd/d31/d7b/fe1 [0,4194304] 0 2024-01-17T23:48:42.854 INFO:tasks.workunit.client.0.smithi161.stdout:5/930: dread - dd/d15/d1a/d5d/f100 zero size 2024-01-17T23:48:42.922 INFO:tasks.workunit.client.0.smithi161.stdout:6/964: symlink d6/d7/dc/d85/d13/l14b 0 2024-01-17T23:48:42.983 INFO:tasks.workunit.client.0.smithi161.stdout:8/979: getdents d1/d3/d19/d1d/df3/d134 0 2024-01-17T23:48:43.365 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:48:43.369 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:48:43.753 INFO:tasks.workunit.client.0.smithi161.stdout:9/879: read d0/d39/d49/d6e/fb2 [49880,4460] 0 2024-01-17T23:48:43.855 INFO:tasks.workunit.client.0.smithi161.stdout:5/931: link dd/c3a dd/d15/d1a/d42/c121 0 2024-01-17T23:48:43.855 INFO:tasks.workunit.client.0.smithi161.stdout:5/932: creat dd/d15/d1a/d34/f122 x:0 0 0 2024-01-17T23:48:44.074 INFO:tasks.workunit.client.0.smithi161.stdout:6/965: unlink d6/dfa/d10e/ff1 0 2024-01-17T23:48:44.074 INFO:tasks.workunit.client.0.smithi161.stdout:8/980: link d1/d22/d2f/c33 d1/d22/dbd/c151 0 2024-01-17T23:48:44.097 INFO:tasks.workunit.client.0.smithi161.stdout:8/981: write d1/d3/d19/d1d/d25/d4b/f63 [1835428,68616] 0 2024-01-17T23:48:44.097 INFO:tasks.workunit.client.0.smithi161.stdout:8/982: write d1/df/d46/fa5 [5115429,23834] 0 2024-01-17T23:48:44.301 INFO:tasks.workunit.client.0.smithi161.stdout:9/880: fsync d0/d8/d14/d18/d20/da2/dcb/f117 0 2024-01-17T23:48:44.305 INFO:tasks.workunit.client.0.smithi161.stdout:9/881: dread d0/d8/d14/d87/f8d [0,4194304] 0 2024-01-17T23:48:45.227 INFO:tasks.workunit.client.0.smithi161.stdout:8/983: dwrite d1/d55/f99 [0,4194304] 0 2024-01-17T23:48:45.256 INFO:tasks.workunit.client.0.smithi161.stdout:9/882: fdatasync d0/d8/d14/d18/d20/f10d 0 2024-01-17T23:48:45.342 INFO:tasks.workunit.client.0.smithi161.stdout:9/883: write d0/d8/d14/d87/fb5 [811782,54897] 0 2024-01-17T23:48:45.753 INFO:tasks.workunit.client.0.smithi161.stdout:8/984: creat d1/df/f152 x:0 0 0 2024-01-17T23:48:46.178 INFO:tasks.workunit.client.0.smithi161.stdout:8/985: truncate d1/d3d/f40 98371 0 2024-01-17T23:48:46.178 INFO:tasks.workunit.client.0.smithi161.stdout:7/986: write da/d34/f7d [900107,76497] 0 2024-01-17T23:48:46.231 INFO:tasks.workunit.client.0.smithi161.stdout:8/986: dwrite d1/d55/f99 [0,4194304] 0 2024-01-17T23:48:46.238 INFO:tasks.workunit.client.0.smithi161.stdout:7/987: dwrite da/d34/d5a/da0/df8/f87 [0,4194304] 0 2024-01-17T23:48:46.238 INFO:tasks.workunit.client.0.smithi161.stdout:2/934: dwrite d8/d1c/d75/dae/dc3/f51 [0,4194304] 0 2024-01-17T23:48:46.269 INFO:tasks.workunit.client.0.smithi161.stdout:7/988: dwrite da/d14/d35/fe1 [0,4194304] 0 2024-01-17T23:48:46.269 INFO:tasks.workunit.client.0.smithi161.stdout:7/989: chown da/d34/d4a/d4c/leb 92904595 1 2024-01-17T23:48:47.053 INFO:tasks.workunit.client.0.smithi161.stdout:2/935: unlink d8/d1c/d1e/da6/d35/d3a/ld1 0 2024-01-17T23:48:47.053 INFO:tasks.workunit.client.0.smithi161.stdout:2/936: write d8/d1c/d1e/da6/fdf [2975271,26773] 0 2024-01-17T23:48:47.267 INFO:tasks.workunit.client.0.smithi161.stdout:7/990: creat da/d34/d5a/d28/f149 x:0 0 0 2024-01-17T23:48:47.468 INFO:tasks.workunit.client.0.smithi161.stdout:2/937: symlink d8/d1c/d75/dae/l14c 0 2024-01-17T23:48:47.483 INFO:tasks.workunit.client.0.smithi161.stdout:2/938: dread d8/d1c/d75/dae/de4/f95 [0,4194304] 0 2024-01-17T23:48:47.746 INFO:tasks.workunit.client.0.smithi161.stdout:2/939: dwrite d8/d4b/d9a/db0/d125/d12b/f7c [0,4194304] 0 2024-01-17T23:48:47.825 INFO:tasks.workunit.client.0.smithi161.stdout:7/991: link da/db/d7a/d8f/dac/fcd da/d34/d5a/d28/dad/f14a 0 2024-01-17T23:48:47.825 INFO:tasks.workunit.client.0.smithi161.stdout:7/992: fdatasync da/db/d7a/da8/dd2/f110 0 2024-01-17T23:48:47.825 INFO:tasks.workunit.client.0.smithi161.stdout:7/993: dread - da/d34/d5a/d28/d2b/fe8 zero size 2024-01-17T23:48:48.026 INFO:tasks.workunit.client.0.smithi161.stdout:2/940: symlink d8/d4b/d9a/d10e/l14d 0 2024-01-17T23:48:48.196 INFO:tasks.workunit.client.0.smithi161.stdout:7/994: rename da/d14/d35/d41/c88 to da/def/c14b 0 2024-01-17T23:48:48.197 INFO:tasks.workunit.client.0.smithi161.stdout:7/995: readlink da/d34/d5a/da0/df8/d3d/l9a 0 2024-01-17T23:48:48.307 INFO:tasks.workunit.client.0.smithi161.stdout:5/933: sync 2024-01-17T23:48:48.343 INFO:tasks.workunit.client.0.smithi161.stdout:5/934: dwrite dd/d15/d1a/d5d/d64/d7c/dd9/d118/f11b [0,4194304] 0 2024-01-17T23:48:48.395 INFO:tasks.workunit.client.0.smithi161.stdout:6/966: dwrite d6/d7/dc/f4f [0,4194304] 0 2024-01-17T23:48:49.429 INFO:tasks.workunit.client.0.smithi161.stdout:6/967: dread d6/d7/dc/d85/d31/f4e [0,4194304] 0 2024-01-17T23:48:49.429 INFO:tasks.workunit.client.0.smithi161.stdout:6/968: write d6/dfc/f144 [452846,116461] 0 2024-01-17T23:48:49.429 INFO:tasks.workunit.client.0.smithi161.stdout:6/969: readlink d6/d7/dc/d85/d13/l13e 0 2024-01-17T23:48:49.429 INFO:tasks.workunit.client.0.smithi161.stdout:6/970: fdatasync d6/d7/dc/d85/d31/f92 0 2024-01-17T23:48:49.443 INFO:tasks.workunit.client.0.smithi161.stdout:6/971: dread d6/d7/fab [0,4194304] 0 2024-01-17T23:48:49.450 INFO:tasks.workunit.client.0.smithi161.stdout:6/972: dread d6/d7/dc/d43/dc3/d90/ff7 [0,4194304] 0 2024-01-17T23:48:49.463 INFO:tasks.workunit.client.0.smithi161.stdout:9/884: sync 2024-01-17T23:48:49.463 INFO:tasks.workunit.client.0.smithi161.stdout:9/885: chown d0/d8/d14/d18/c119 78563333 1 2024-01-17T23:48:49.468 INFO:tasks.workunit.client.0.smithi161.stdout:6/973: read d6/d7/dc/d43/f94 [2393357,54772] 0 2024-01-17T23:48:49.468 INFO:tasks.workunit.client.0.smithi161.stdout:6/974: creat d6/d7/dc/d43/dc3/d90/f14c x:0 0 0 2024-01-17T23:48:49.494 INFO:tasks.workunit.client.0.smithi161.stdout:6/975: dwrite d6/d7/dc/d85/d1a/fbd [0,4194304] 0 2024-01-17T23:48:49.682 INFO:tasks.workunit.client.0.smithi161.stdout:8/987: write f0 [2322344,29375] 0 2024-01-17T23:48:50.165 INFO:tasks.workunit.client.0.smithi161.stdout:9/886: dread - d0/d8/d14/d18/d20/fff zero size 2024-01-17T23:48:50.165 INFO:tasks.workunit.client.0.smithi161.stdout:9/887: write d0/d8/d31/f114 [81165,121299] 0 2024-01-17T23:48:50.681 INFO:tasks.workunit.client.0.smithi161.stdout:6/976: symlink d6/d7/dc/d85/d1a/l14d 0 2024-01-17T23:48:50.703 INFO:tasks.workunit.client.0.smithi161.stdout:5/935: dwrite dd/d31/d7b/d78/f87 [0,4194304] 0 2024-01-17T23:48:50.704 INFO:tasks.workunit.client.0.smithi161.stdout:8/988: symlink d1/d3d/dff/l153 0 2024-01-17T23:48:50.743 INFO:tasks.workunit.client.0.smithi161.stdout:5/936: dwrite dd/d15/d1a/d5d/d64/d67/f113 [0,4194304] 0 2024-01-17T23:48:50.823 INFO:tasks.workunit.client.0.smithi161.stdout:9/888: mkdir d0/d8/d14/d87/d9b/dd5/d115/d128 0 2024-01-17T23:48:51.103 INFO:tasks.workunit.client.0.smithi161.stdout:2/941: rmdir d8/d68 39 2024-01-17T23:48:51.188 INFO:tasks.workunit.client.0.smithi161.stdout:6/977: creat d6/d7/dc/d85/d13/dcc/d10c/f14e x:0 0 0 2024-01-17T23:48:51.530 INFO:tasks.workunit.client.0.smithi161.stdout:8/989: mkdir d1/d3d/d154 0 2024-01-17T23:48:51.530 INFO:tasks.workunit.client.0.smithi161.stdout:8/990: getdents d1/d3/d113 0 2024-01-17T23:48:52.804 INFO:tasks.workunit.client.0.smithi161.stdout:2/942: symlink d8/d1c/d75/dc7/de5/deb/d143/l14e 0 2024-01-17T23:48:52.969 INFO:tasks.workunit.client.0.smithi161.stdout:7/996: rmdir da/da7 39 2024-01-17T23:48:52.990 INFO:tasks.workunit.client.0.smithi161.stdout:7/997: write da/d34/d5a/da0/df8/f87 [1525119,79591] 0 2024-01-17T23:48:53.119 INFO:tasks.workunit.client.0.smithi161.stdout:5/937: rename dd/d15/d1a/d5d/d64/d7c/d86/lf4 to dd/d15/d1a/d5d/dc9/dde/l123 0 2024-01-17T23:48:53.201 INFO:tasks.workunit.client.0.smithi161.stdout:2/943: stat d8/db8/dc9/cd2 0 2024-01-17T23:48:53.222 INFO:tasks.workunit.client.0.smithi161.stdout:2/944: write d8/da/f27 [3489678,23662] 0 2024-01-17T23:48:53.430 INFO:tasks.workunit.client.0.smithi161.stdout:7/998: symlink da/d34/d5a/d28/d2b/d93/l14c 0 2024-01-17T23:48:53.515 INFO:tasks.workunit.client.0.smithi161.stdout:8/991: rename d1/d3/d19/d1d/df9/c14b to d1/df/d46/c155 0 2024-01-17T23:48:53.516 INFO:tasks.workunit.client.0.smithi161.stdout:8/992: chown d1/df/f96 5544 1 2024-01-17T23:48:53.557 INFO:tasks.workunit.client.0.smithi161.stdout:8/993: dwrite d1/d22/dbd/dce/ff1 [0,4194304] 0 2024-01-17T23:48:53.655 INFO:tasks.workunit.client.0.smithi161.stdout:5/938: mknod dd/c124 0 2024-01-17T23:48:53.655 INFO:tasks.workunit.client.0.smithi161.stdout:5/939: fsync dd/f11 0 2024-01-17T23:48:53.664 INFO:tasks.workunit.client.0.smithi161.stdout:5/940: dread dd/d31/d3c/ff0 [0,4194304] 0 2024-01-17T23:48:53.664 INFO:tasks.workunit.client.0.smithi161.stdout:5/941: dread - dd/d15/d4e/d4f/d77/fca zero size 2024-01-17T23:48:53.901 INFO:tasks.workunit.client.0.smithi161.stdout:2/945: mknod d8/d1c/d75/dc7/de5/deb/c14f 0 2024-01-17T23:48:53.902 INFO:tasks.workunit.client.0.smithi161.stdout:2/946: write d8/d1c/d57/fd5 [1018241,72543] 0 2024-01-17T23:48:54.308 INFO:tasks.workunit.client.0.smithi161.stdout:8/994: symlink d1/d55/l156 0 2024-01-17T23:48:54.547 INFO:tasks.workunit.client.0.smithi161.stdout:5/942: mkdir dd/d31/db8/d125 0 2024-01-17T23:48:54.619 INFO:tasks.workunit.client.0.smithi161.stdout:2/947: symlink d8/d1c/d1e/da6/l150 0 2024-01-17T23:48:54.619 INFO:tasks.workunit.client.0.smithi161.stdout:2/948: chown d8/d1c/d1e 445390912 1 2024-01-17T23:48:54.619 INFO:tasks.workunit.client.0.smithi161.stdout:2/949: truncate d8/d1c/d75/dc7/de5/f115 365438 0 2024-01-17T23:48:54.619 INFO:tasks.workunit.client.0.smithi161.stdout:2/950: chown d8/db8/c12e 828 1 2024-01-17T23:48:54.671 INFO:tasks.workunit.client.0.smithi161.stdout:2/951: dwrite d8/d4b/d9a/db0/f13e [0,4194304] 0 2024-01-17T23:48:54.722 INFO:tasks.workunit.client.0.smithi161.stdout:2/952: dwrite d8/d4b/d9a/db0/d125/d12b/f7c [4194304,4194304] 0 2024-01-17T23:48:54.722 INFO:tasks.workunit.client.0.smithi161.stdout:2/953: write d8/d67/d6c/f12f [912062,121439] 0 2024-01-17T23:48:54.738 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:51:18.096 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:48:54.740 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:51:18.098 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:48:54.803 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:51:18.161 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:48:54.840 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:51:18.118 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:48:54.843 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:51:18.121 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:48:54.847 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:51:18.125 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:48:54.848 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:51:18.127 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:48:54.929 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:51:18.207 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:48:54.951 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:51:18.230 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:48:55.070 INFO:tasks.workunit.client.0.smithi161.stdout:9/889: sync 2024-01-17T23:48:55.189 INFO:tasks.workunit.client.0.smithi161.stdout:2/954: truncate d8/da/f76 3664278 0 2024-01-17T23:48:55.235 INFO:tasks.workunit.client.0.smithi161.stdout:6/978: sync 2024-01-17T23:48:55.264 INFO:tasks.workunit.client.0.smithi161.stdout:6/979: dwrite d6/d7/dc/d43/dde/d120/f143 [0,4194304] 0 2024-01-17T23:48:55.268 INFO:tasks.workunit.client.0.smithi161.stdout:6/980: dread d6/d7/dc/d43/f60 [0,4194304] 0 2024-01-17T23:48:55.662 INFO:tasks.workunit.client.0.smithi161.stdout:2/955: creat d8/d1c/d75/dae/de4/f151 x:0 0 0 2024-01-17T23:48:56.229 INFO:tasks.workunit.client.0.smithi161.stdout:9/890: mknod d0/d8/d14/d18/d20/d126/c129 0 2024-01-17T23:48:56.252 INFO:tasks.workunit.client.0.smithi161.stdout:7/999: sync 2024-01-17T23:48:56.514 INFO:tasks.workunit.client.0.smithi161.stdout:2/956: mknod d8/db8/c152 0 2024-01-17T23:48:56.788 INFO:tasks.workunit.client.0.smithi161.stdout:9/891: creat d0/d39/f12a x:0 0 0 2024-01-17T23:48:56.813 INFO:tasks.workunit.client.0.smithi161.stdout:9/892: dwrite d0/d8/d14/d18/d20/fff [0,4194304] 0 2024-01-17T23:48:56.813 INFO:tasks.workunit.client.0.smithi161.stdout:9/893: chown d0/d8/d14/d18/d20/da2/dcb/f117 771137254 1 2024-01-17T23:48:56.857 INFO:tasks.workunit.client.0.smithi161.stdout:8/995: dwrite d1/df/d20/f4c [0,4194304] 0 2024-01-17T23:48:56.858 INFO:tasks.workunit.client.0.smithi161.stdout:5/943: dwrite dd/d15/d4e/d4f/f8b [0,4194304] 0 2024-01-17T23:48:56.988 INFO:tasks.workunit.client.0.smithi161.stdout:2/957: mkdir d8/db8/d153 0 2024-01-17T23:48:56.988 INFO:tasks.workunit.client.0.smithi161.stdout:2/958: chown d8/db8/lfd 66297756 1 2024-01-17T23:48:56.988 INFO:tasks.workunit.client.0.smithi161.stdout:2/959: readlink d8/d1c/d75/dae/de4/l7a 0 2024-01-17T23:48:56.988 INFO:tasks.workunit.client.0.smithi161.stdout:2/960: stat d8/d4b/d9a/db0/d125/d12b/ddd 0 2024-01-17T23:48:56.988 INFO:tasks.workunit.client.0.smithi161.stdout:2/961: chown d8 6 1 2024-01-17T23:48:57.875 INFO:tasks.workunit.client.0.smithi161.stdout:8/996: truncate d1/d55/fd0 1522381 0 2024-01-17T23:48:58.065 INFO:tasks.workunit.client.0.smithi161.stdout:5/944: rename dd/d15/d4e/d4f/d97/cb3 to dd/d15/d1a/d5d/dc9/dde/c126 0 2024-01-17T23:48:58.086 INFO:tasks.workunit.client.0.smithi161.stdout:5/945: write dd/d15/d1a/d5d/d64/fac [2398597,8524] 0 2024-01-17T23:48:58.346 INFO:tasks.workunit.client.0.smithi161.stdout:2/962: dwrite d8/d1c/d1e/da6/d35/f89 [0,4194304] 0 2024-01-17T23:48:58.639 INFO:tasks.workunit.client.0.smithi161.stdout:8/997: mknod d1/d88/d105/d142/c157 0 2024-01-17T23:48:59.441 INFO:tasks.workunit.client.0.smithi161.stdout:8/998: mkdir d1/df/d16/d158 0 2024-01-17T23:48:59.779 INFO:tasks.workunit.client.0.smithi161.stdout:5/946: mkdir dd/d15/d6a/d127 0 2024-01-17T23:48:59.783 INFO:tasks.workunit.client.0.smithi161.stdout:5/947: dread dd/d15/d1a/d5d/d64/d7c/dd9/f120 [0,4194304] 0 2024-01-17T23:48:59.783 INFO:tasks.workunit.client.0.smithi161.stdout:5/948: chown dd/d15/d1a/d5d/d64/d7c/ff2 61346454 1 2024-01-17T23:48:59.947 INFO:tasks.workunit.client.0.smithi161.stdout:6/981: rmdir d6/dfc 39 2024-01-17T23:48:59.947 INFO:tasks.workunit.client.0.smithi161.stdout:6/982: chown l4 1023857034 1 2024-01-17T23:49:00.401 INFO:tasks.workunit.client.0.smithi161.stdout:6/983: rename d6/d7/dc/d85/f72 to d6/d7/dc/db2/f14f 0 2024-01-17T23:49:00.966 INFO:tasks.workunit.client.0.smithi161.stdout:6/984: rename d6/d7/dc/d85/d31/l8b to d6/d7/dc/db2/d112/d115/l150 0 2024-01-17T23:49:00.966 INFO:tasks.workunit.client.0.smithi161.stdout:6/985: chown d6/d7/dc/d43/dc3/d13d/f148 465 1 2024-01-17T23:49:00.966 INFO:tasks.workunit.client.0.smithi161.stdout:9/894: rename d0/d8/f66 to d0/d8/f12b 0 2024-01-17T23:49:01.225 INFO:tasks.workunit.client.0.smithi161.stdout:2/963: write d8/d1c/d1e/f6f [778323,115764] 0 2024-01-17T23:49:01.226 INFO:tasks.workunit.client.0.smithi161.stdout:2/964: creat d8/db8/dc9/f154 x:0 0 0 2024-01-17T23:49:01.250 INFO:tasks.workunit.client.0.smithi161.stdout:2/965: dread d8/d4b/d9a/db0/d125/d12b/f7c [0,4194304] 0 2024-01-17T23:49:01.456 INFO:tasks.workunit.client.0.smithi161.stdout:6/986: unlink d6/d7/dc/d43/dde/d120/f143 0 2024-01-17T23:49:01.456 INFO:tasks.workunit.client.0.smithi161.stdout:6/987: readlink d6/d7/lb 0 2024-01-17T23:49:01.456 INFO:tasks.workunit.client.0.smithi161.stdout:6/988: write d6/d7/dc/d43/dc3/d90/f14c [832358,70754] 0 2024-01-17T23:49:01.890 INFO:tasks.workunit.client.0.smithi161.stdout:2/966: creat d8/d4b/d9a/db0/d125/d12b/ddd/f155 x:0 0 0 2024-01-17T23:49:02.131 INFO:tasks.workunit.client.0.smithi161.stdout:6/989: truncate d6/d7/dc/f5b 2050023 0 2024-01-17T23:49:02.131 INFO:tasks.workunit.client.0.smithi161.stdout:6/990: write d6/d7/dc/d43/dc3/fc8 [336199,39788] 0 2024-01-17T23:49:02.131 INFO:tasks.workunit.client.0.smithi161.stdout:6/991: read d6/d7/dc/d43/f74 [5314396,35429] 0 2024-01-17T23:49:02.338 INFO:tasks.workunit.client.0.smithi161.stdout:8/999: write d1/df/d20/d6a/f7b [1371297,20992] 0 2024-01-17T23:49:02.342 INFO:tasks.workunit.client.0.smithi161.stdout:2/967: dread d8/d1c/d1e/f9d [0,4194304] 0 2024-01-17T23:49:02.342 INFO:tasks.workunit.client.0.smithi161.stdout:2/968: stat d8/d67/d6c/dcc/f118 0 2024-01-17T23:49:02.623 INFO:tasks.workunit.client.0.smithi161.stdout:6/992: mknod d6/d7/dc/db2/d112/c151 0 2024-01-17T23:49:02.623 INFO:tasks.workunit.client.0.smithi161.stdout:6/993: read d6/fa [78183,104772] 0 2024-01-17T23:49:02.623 INFO:tasks.workunit.client.0.smithi161.stdout:6/994: chown d6/dfa/d10e/d81/lc4 15192 1 2024-01-17T23:49:02.623 INFO:tasks.workunit.client.0.smithi161.stdout:6/995: stat d6/d7/dc/d43/d79/f11a 0 2024-01-17T23:49:02.764 INFO:tasks.workunit.client.0.smithi161.stdout:9/895: rename d0/d8/d31/d58 to d0/d8/d14/dab/d12c 0 2024-01-17T23:49:03.227 INFO:tasks.workunit.client.0.smithi161.stdout:5/949: write dd/d15/d1a/fdf [707059,20268] 0 2024-01-17T23:49:03.378 INFO:tasks.workunit.client.0.smithi161.stdout:2/969: fsync d8/db8/dc9/f154 0 2024-01-17T23:49:03.470 INFO:tasks.workunit.client.0.smithi161.stdout:9/896: symlink d0/d8/l12d 0 2024-01-17T23:49:03.585 INFO:tasks.workunit.client.0.smithi161.stdout:5/950: getdents dd/d15/d1a/d42/da4 0 2024-01-17T23:49:03.605 INFO:tasks.workunit.client.0.smithi161.stdout:5/951: write dd/d15/d51/f6e [1384268,129523] 0 2024-01-17T23:49:03.758 INFO:tasks.workunit.client.0.smithi161.stdout:2/970: symlink d8/d1c/d75/dc7/de5/deb/l156 0 2024-01-17T23:49:03.862 INFO:tasks.workunit.client.0.smithi161.stdout:9/897: link d0/d39/d49/c7f d0/d8/d14/d87/d9b/dd5/d115/d128/c12e 0 2024-01-17T23:49:04.027 INFO:tasks.workunit.client.0.smithi161.stdout:5/952: creat dd/d31/db8/d125/f128 x:0 0 0 2024-01-17T23:49:04.028 INFO:tasks.workunit.client.0.smithi161.stdout:5/953: truncate dd/d15/d51/dbf/f103 539112 0 2024-01-17T23:49:04.937 INFO:tasks.workunit.client.0.smithi161.stdout:6/996: dwrite d6/d7/dc/f19 [0,4194304] 0 2024-01-17T23:49:04.977 INFO:tasks.workunit.client.0.smithi161.stdout:9/898: read d0/d8/d14/f3f [149022,11130] 0 2024-01-17T23:49:05.288 INFO:tasks.workunit.client.0.smithi161.stdout:9/899: truncate d0/d8/d14/f85 1465659 0 2024-01-17T23:49:05.288 INFO:tasks.workunit.client.0.smithi161.stdout:9/900: truncate d0/d8/d31/d73/fed 1169154 0 2024-01-17T23:49:05.633 INFO:tasks.workunit.client.0.smithi161.stdout:6/997: mknod d6/d7/dc/d43/d79/c152 0 2024-01-17T23:49:05.633 INFO:tasks.workunit.client.0.smithi161.stdout:6/998: creat d6/d7/dc/d1d/f153 x:0 0 0 2024-01-17T23:49:05.633 INFO:tasks.workunit.client.0.smithi161.stdout:9/901: creat d0/d8/d14/d18/d20/f12f x:0 0 0 2024-01-17T23:49:05.633 INFO:tasks.workunit.client.0.smithi161.stdout:6/999: chown d6/d7/dc/d43/d79/fd3 7 1 2024-01-17T23:49:05.633 INFO:tasks.workunit.client.0.smithi161.stdout:9/902: write d0/d8/f10 [4620999,561] 0 2024-01-17T23:49:06.030 INFO:tasks.workunit.client.0.smithi161.stdout:9/903: dread d0/d8/d31/fcd [0,4194304] 0 2024-01-17T23:49:06.599 INFO:tasks.workunit.client.0.smithi161.stdout:9/904: truncate d0/d8/d31/f7c 3149670 0 2024-01-17T23:49:07.003 INFO:tasks.workunit.client.0.smithi161.stdout:2/971: sync 2024-01-17T23:49:07.003 INFO:tasks.workunit.client.0.smithi161.stdout:2/972: chown d8/d1c/d75/dc7/de5/f12c 197 1 2024-01-17T23:49:07.716 INFO:tasks.workunit.client.0.smithi161.stdout:2/973: creat d8/d1c/d1e/d80/d79/d147/f157 x:0 0 0 2024-01-17T23:49:07.744 INFO:tasks.workunit.client.0.smithi161.stdout:2/974: dwrite d8/d1c/d57/f10c [0,4194304] 0 2024-01-17T23:49:07.744 INFO:tasks.workunit.client.0.smithi161.stdout:2/975: write d8/f18 [3318375,123955] 0 2024-01-17T23:49:07.744 INFO:tasks.workunit.client.0.smithi161.stdout:2/976: creat d8/db8/dc9/f158 x:0 0 0 2024-01-17T23:49:07.749 INFO:tasks.workunit.client.0.smithi161.stdout:2/977: dread d8/d1c/d75/dc7/de5/f12c [0,4194304] 0 2024-01-17T23:49:07.749 INFO:tasks.workunit.client.0.smithi161.stdout:2/978: creat d8/d4b/d9a/db0/f159 x:0 0 0 2024-01-17T23:49:07.749 INFO:tasks.workunit.client.0.smithi161.stdout:2/979: stat d8/da/l9f 0 2024-01-17T23:49:07.750 INFO:tasks.workunit.client.0.smithi161.stdout:5/954: write dd/d15/d1a/f59 [217919,31236] 0 2024-01-17T23:49:07.777 INFO:tasks.workunit.client.0.smithi161.stdout:5/955: dread dd/d15/d1a/d5d/dc9/fd8 [0,4194304] 0 2024-01-17T23:49:07.778 INFO:tasks.workunit.client.0.smithi161.stdout:5/956: fdatasync dd/d15/f2e 0 2024-01-17T23:49:07.791 INFO:tasks.workunit.client.0.smithi161.stdout:2/980: dwrite d8/db8/dc9/f154 [0,4194304] 0 2024-01-17T23:49:07.808 INFO:tasks.workunit.client.0.smithi161.stdout:2/981: write d8/d4b/d9a/db0/f13e [2360418,92981] 0 2024-01-17T23:49:07.822 INFO:tasks.workunit.client.0.smithi161.stdout:2/982: dread d8/d4b/d9a/fc0 [0,4194304] 0 2024-01-17T23:49:07.832 INFO:tasks.workunit.client.0.smithi161.stdout:2/983: dread d8/d1c/d1e/da6/d35/fbf [0,4194304] 0 2024-01-17T23:49:07.905 INFO:tasks.workunit.client.0.smithi161.stdout:9/905: dwrite d0/d39/d49/fc8 [0,4194304] 0 2024-01-17T23:49:08.274 INFO:tasks.workunit.client.0.smithi161.stdout:2/984: unlink c0 0 2024-01-17T23:49:08.274 INFO:tasks.workunit.client.0.smithi161.stdout:2/985: chown d8/d1c/d1e/da6/d35/fec 1 1 2024-01-17T23:49:08.422 INFO:tasks.workunit.client.0.smithi161.stdout:9/906: rename d0/d8/d14/d56 to d0/d8/d14/d11c/d130 0 2024-01-17T23:49:08.440 INFO:tasks.workunit.client.0.smithi161.stdout:9/907: write d0/d39/d49/fc8 [2490095,46106] 0 2024-01-17T23:49:08.688 INFO:tasks.workunit.client.0.smithi161.stdout:2/986: stat d8/d4b/d9a/db0/d125/d12b/ddd/c134 0 2024-01-17T23:49:08.717 INFO:tasks.workunit.client.0.smithi161.stdout:2/987: dwrite d8/d1c/d75/dc7/de5/f12c [0,4194304] 0 2024-01-17T23:49:08.831 INFO:tasks.workunit.client.0.smithi161.stdout:9/908: link d0/d39/d49/cac d0/d8/d14/d87/d9b/dd5/d115/d128/c131 0 2024-01-17T23:49:08.831 INFO:tasks.workunit.client.0.smithi161.stdout:9/909: write d0/d8/d14/dab/d12c/fd0 [2362214,105549] 0 2024-01-17T23:49:08.831 INFO:tasks.workunit.client.0.smithi161.stdout:9/910: fdatasync d0/d8/d14/d87/fc6 0 2024-01-17T23:49:09.044 INFO:tasks.workunit.client.0.smithi161.stdout:2/988: write d8/d1c/d1e/da6/fdf [3426146,60045] 0 2024-01-17T23:49:09.044 INFO:tasks.workunit.client.0.smithi161.stdout:2/989: creat d8/d67/d6c/d135/f15a x:0 0 0 2024-01-17T23:49:09.081 INFO:tasks.workunit.client.0.smithi161.stdout:5/957: dwrite dd/d15/d1a/d42/f58 [0,4194304] 0 2024-01-17T23:49:09.320 INFO:tasks.workunit.client.0.smithi161.stdout:9/911: creat d0/d8/d14/d87/d9b/d105/d11d/f132 x:0 0 0 2024-01-17T23:49:09.538 INFO:tasks.workunit.client.0.smithi161.stdout:2/990: unlink d8/d67/ff4 0 2024-01-17T23:49:09.538 INFO:tasks.workunit.client.0.smithi161.stdout:2/991: fdatasync d8/d1c/d75/dc7/de5/f115 0 2024-01-17T23:49:09.610 INFO:tasks.workunit.client.0.smithi161.stdout:5/958: mkdir dd/d31/db8/d129 0 2024-01-17T23:49:10.563 INFO:tasks.workunit.client.0.smithi161.stdout:9/912: link d0/d8/d14/dab/cf4 d0/d39/d49/c133 0 2024-01-17T23:49:10.785 INFO:tasks.workunit.client.0.smithi161.stdout:2/992: unlink d8/d1c/d75/dc7/l141 0 2024-01-17T23:49:11.186 INFO:tasks.workunit.client.0.smithi161.stdout:9/913: mkdir d0/d39/d49/d107/d134 0 2024-01-17T23:49:11.330 INFO:tasks.workunit.client.0.smithi161.stdout:2/993: mkdir d8/d4b/d9a/db0/d125/d15b 0 2024-01-17T23:49:11.360 INFO:tasks.workunit.client.0.smithi161.stdout:2/994: dwrite d8/d4b/d9a/db0/d125/d12b/ddd/f155 [0,4194304] 0 2024-01-17T23:49:11.818 INFO:tasks.workunit.client.0.smithi161.stdout:9/914: rename d0/d8/d14/d11c/d130/d100/c11b to d0/d8/d14/d18/c135 0 2024-01-17T23:49:12.212 INFO:tasks.workunit.client.0.smithi161.stdout:2/995: creat d8/d1c/d1e/d80/dcd/d13d/f15c x:0 0 0 2024-01-17T23:49:12.896 INFO:tasks.workunit.client.0.smithi161.stdout:5/959: write dd/d15/d4e/f8e [1703176,48601] 0 2024-01-17T23:49:12.932 INFO:tasks.workunit.client.0.smithi161.stdout:5/960: dwrite dd/d15/d4e/d4f/de0/fec [0,4194304] 0 2024-01-17T23:49:13.445 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:49:13.449 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:49:13.535 INFO:tasks.workunit.client.0.smithi161.stdout:2/996: write d8/d1c/d1e/d80/dc4/ff8 [458562,31859] 0 2024-01-17T23:49:13.560 INFO:tasks.workunit.client.0.smithi161.stdout:9/915: dwrite d0/f2c [0,4194304] 0 2024-01-17T23:49:13.578 INFO:tasks.workunit.client.0.smithi161.stdout:5/961: dwrite dd/d15/d4e/f8a [0,4194304] 0 2024-01-17T23:49:13.759 INFO:tasks.workunit.client.0.smithi161.stdout:2/997: mknod d8/c15d 0 2024-01-17T23:49:13.787 INFO:tasks.workunit.client.0.smithi161.stdout:2/998: dwrite d8/d4b/d9a/f124 [0,4194304] 0 2024-01-17T23:49:13.787 INFO:tasks.workunit.client.0.smithi161.stdout:2/999: dread - d8/d1c/d75/dae/de4/da8/f127 zero size 2024-01-17T23:49:14.072 INFO:tasks.workunit.client.0.smithi161.stdout:5/962: truncate dd/d15/f22 4302608 0 2024-01-17T23:49:14.149 INFO:tasks.workunit.client.0.smithi161.stdout:5/963: mknod dd/d15/d51/dce/d104/c12a 0 2024-01-17T23:49:14.569 INFO:tasks.workunit.client.0.smithi161.stdout:5/964: rmdir dd/d15/d51/dbf 39 2024-01-17T23:49:14.594 INFO:tasks.workunit.client.0.smithi161.stdout:9/916: sync 2024-01-17T23:49:14.805 INFO:tasks.workunit.client.0.smithi161.stdout:5/965: rename dd/d15/d6a/d80/c94 to dd/d31/d7b/d78/c12b 0 2024-01-17T23:49:15.172 INFO:tasks.workunit.client.0.smithi161.stdout:5/966: write dd/d31/faf [1052049,2268] 0 2024-01-17T23:49:15.393 INFO:tasks.workunit.client.0.smithi161.stdout:9/917: rename d0/d8/d14/d18/d20 to d0/d8/d14/d136 0 2024-01-17T23:49:15.394 INFO:tasks.workunit.client.0.smithi161.stdout:5/967: creat dd/d15/d6a/d127/f12c x:0 0 0 2024-01-17T23:49:15.394 INFO:tasks.workunit.client.0.smithi161.stdout:9/918: write d0/d8/d14/d18/d63/f95 [283039,123781] 0 2024-01-17T23:49:15.420 INFO:tasks.workunit.client.0.smithi161.stdout:9/919: dwrite d0/d8/d14/d136/f12f [0,4194304] 0 2024-01-17T23:49:15.573 INFO:tasks.workunit.client.0.smithi161.stdout:5/968: mknod dd/d15/d1a/d5d/c12d 0 2024-01-17T23:49:15.573 INFO:tasks.workunit.client.0.smithi161.stdout:5/969: chown dd/d15/d1a/d5d/d64/d67/c92 86074 1 2024-01-17T23:49:15.573 INFO:tasks.workunit.client.0.smithi161.stdout:9/920: write d0/d8/d14/d136/da2/dcb/f117 [362274,79139] 0 2024-01-17T23:49:15.573 INFO:tasks.workunit.client.0.smithi161.stdout:9/921: write d0/d39/fe5 [4475501,103745] 0 2024-01-17T23:49:15.593 INFO:tasks.workunit.client.0.smithi161.stdout:9/922: read d0/f51 [315817,101739] 0 2024-01-17T23:49:15.599 INFO:tasks.workunit.client.0.smithi161.stdout:9/923: fdatasync d0/d8/d14/d136/da2/dcb/f117 0 2024-01-17T23:49:15.599 INFO:tasks.workunit.client.0.smithi161.stdout:9/924: fdatasync d0/d39/f59 0 2024-01-17T23:49:15.634 INFO:tasks.workunit.client.0.smithi161.stdout:5/970: unlink dd/d15/d1a/d5d/f108 0 2024-01-17T23:49:15.734 INFO:tasks.workunit.client.0.smithi161.stdout:9/925: creat d0/d8/d14/d11c/d130/f137 x:0 0 0 2024-01-17T23:49:15.844 INFO:tasks.workunit.client.0.smithi161.stdout:5/971: getdents dd/d15/d4e/d4f 0 2024-01-17T23:49:16.336 INFO:tasks.workunit.client.0.smithi161.stdout:5/972: readlink dd/d15/d1a/d42/lf3 0 2024-01-17T23:49:16.446 INFO:tasks.workunit.client.0.smithi161.stdout:9/926: link d0/d8/d14/d87/d9b/d105/f125 d0/f138 0 2024-01-17T23:49:16.575 INFO:tasks.workunit.client.0.smithi161.stdout:5/973: mkdir dd/d31/d7b/d78/d12e 0 2024-01-17T23:49:16.635 INFO:tasks.workunit.client.0.smithi161.stdout:9/927: mknod d0/d8/d14/dab/c139 0 2024-01-17T23:49:16.653 INFO:tasks.workunit.client.0.smithi161.stdout:9/928: dread d0/d8/d14/d18/d63/faa [0,4194304] 0 2024-01-17T23:49:16.653 INFO:tasks.workunit.client.0.smithi161.stdout:9/929: dread - d0/d8/fa0 zero size 2024-01-17T23:49:16.771 INFO:tasks.workunit.client.0.smithi161.stdout:9/930: mknod d0/d8/d14/d87/c13a 0 2024-01-17T23:49:16.771 INFO:tasks.workunit.client.0.smithi161.stdout:9/931: stat d0/d8/d14/d18/fc9 0 2024-01-17T23:49:16.928 INFO:tasks.workunit.client.0.smithi161.stdout:5/974: rename dd/d15/d51/dce/d104 to dd/d31/db8/d125/d12f 0 2024-01-17T23:49:16.932 INFO:tasks.workunit.client.0.smithi161.stdout:5/975: dread dd/d15/d1a/d34/f114 [0,4194304] 0 2024-01-17T23:49:17.646 INFO:tasks.workunit.client.0.smithi161.stdout:9/932: rename d0/d8/d31/l104 to d0/d8/d14/d11c/d130/l13b 0 2024-01-17T23:49:17.646 INFO:tasks.workunit.client.0.smithi161.stdout:5/976: mknod dd/d15/d4e/d4f/d77/c130 0 2024-01-17T23:49:17.803 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:51:41.161 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:49:17.810 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:51:41.167 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:49:17.838 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:51:41.196 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:49:17.840 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:51:41.119 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:49:17.845 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:51:41.122 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:49:17.859 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:51:41.138 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:49:17.862 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:51:41.140 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:49:17.910 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:51:41.187 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:49:17.916 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:51:41.194 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:49:18.185 INFO:tasks.workunit.client.0.smithi161.stdout:5/977: unlink dd/d31/fff 0 2024-01-17T23:49:18.185 INFO:tasks.workunit.client.0.smithi161.stdout:9/933: mkdir d0/d8/d14/d136/da2/d13c 0 2024-01-17T23:49:18.230 INFO:tasks.workunit.client.0.smithi161.stdout:5/978: chown dd/d15/d4e/d4f/d77/fc3 602 1 2024-01-17T23:49:18.230 INFO:tasks.workunit.client.0.smithi161.stdout:5/979: fsync dd/d31/db8/fd2 0 2024-01-17T23:49:18.440 INFO:tasks.workunit.client.0.smithi161.stdout:5/980: rename dd/d15/d1a/d5d/dc9/dde/l123 to dd/d15/d4e/d4f/d97/l131 0 2024-01-17T23:49:18.462 INFO:tasks.workunit.client.0.smithi161.stdout:9/934: rmdir d0/d8/d31 39 2024-01-17T23:49:18.757 INFO:tasks.workunit.client.0.smithi161.stdout:5/981: mkdir dd/d15/d4e/d4f/d77/d132 0 2024-01-17T23:49:18.757 INFO:tasks.workunit.client.0.smithi161.stdout:9/935: symlink d0/l13d 0 2024-01-17T23:49:18.797 INFO:tasks.workunit.client.0.smithi161.stdout:5/982: symlink dd/d31/d7b/l133 0 2024-01-17T23:49:18.808 INFO:tasks.workunit.client.0.smithi161.stdout:5/983: dread dd/d31/f38 [0,4194304] 0 2024-01-17T23:49:18.808 INFO:tasks.workunit.client.0.smithi161.stdout:5/984: chown dd/d15/d6a/d127/f12c 11 1 2024-01-17T23:49:18.847 INFO:tasks.workunit.client.0.smithi161.stdout:9/936: symlink d0/d8/d14/d136/da2/l13e 0 2024-01-17T23:49:18.903 INFO:tasks.workunit.client.0.smithi161.stdout:9/937: write d0/d8/d14/d136/fe4 [1518645,33972] 0 2024-01-17T23:49:18.922 INFO:tasks.workunit.client.0.smithi161.stdout:5/985: dread dd/d15/d51/f62 [0,4194304] 0 2024-01-17T23:49:18.922 INFO:tasks.workunit.client.0.smithi161.stdout:5/986: fsync dd/d15/d1a/d5d/d64/d7c/f8c 0 2024-01-17T23:49:18.985 INFO:tasks.workunit.client.0.smithi161.stdout:9/938: symlink d0/d8/d14/d136/d97/l13f 0 2024-01-17T23:49:19.151 INFO:tasks.workunit.client.0.smithi161.stdout:5/987: mknod dd/d15/d4e/c134 0 2024-01-17T23:49:19.151 INFO:tasks.workunit.client.0.smithi161.stdout:9/939: symlink d0/d39/d49/d107/d134/l140 0 2024-01-17T23:49:19.510 INFO:tasks.workunit.client.0.smithi161.stdout:5/988: getdents dd/d15 0 2024-01-17T23:49:19.512 INFO:tasks.workunit.client.0.smithi161.stdout:9/940: rename d0/d8/d14/dab/d12c to d0/d39/d141 0 2024-01-17T23:49:19.513 INFO:tasks.workunit.client.0.smithi161.stdout:5/989: dread dd/d15/d6a/fc0 [0,4194304] 0 2024-01-17T23:49:19.513 INFO:tasks.workunit.client.0.smithi161.stdout:5/990: chown dd/d15/d1a/d5d/d64/fac 11 1 2024-01-17T23:49:19.534 INFO:tasks.workunit.client.0.smithi161.stdout:9/941: dread d0/d8/d14/d18/d63/f6a [0,4194304] 0 2024-01-17T23:49:19.541 INFO:tasks.workunit.client.0.smithi161.stdout:5/991: dwrite dd/d15/d1a/d5d/f100 [0,4194304] 0 2024-01-17T23:49:19.547 INFO:tasks.workunit.client.0.smithi161.stdout:9/942: dread d0/d8/d14/d18/f55 [0,4194304] 0 2024-01-17T23:49:19.727 INFO:tasks.workunit.client.0.smithi161.stdout:5/992: creat dd/d15/d6a/d80/f135 x:0 0 0 2024-01-17T23:49:19.727 INFO:tasks.workunit.client.0.smithi161.stdout:5/993: readlink dd/d15/d6a/l112 0 2024-01-17T23:49:19.799 INFO:tasks.workunit.client.0.smithi161.stdout:9/943: creat d0/d8/d14/d87/dd6/f142 x:0 0 0 2024-01-17T23:49:20.053 INFO:tasks.workunit.client.0.smithi161.stdout:9/944: creat d0/d8/d14/d87/f143 x:0 0 0 2024-01-17T23:49:20.201 INFO:tasks.workunit.client.0.smithi161.stdout:9/945: link d0/d8/d14/c72 d0/d39/d49/c144 0 2024-01-17T23:49:20.201 INFO:tasks.workunit.client.0.smithi161.stdout:9/946: creat d0/d8/d14/d87/f145 x:0 0 0 2024-01-17T23:49:20.201 INFO:tasks.workunit.client.0.smithi161.stdout:9/947: write d0/d8/d14/d87/d9b/d105/d11d/f132 [875474,17012] 0 2024-01-17T23:49:20.214 INFO:tasks.workunit.client.0.smithi161.stdout:9/948: dread d0/f3a [0,4194304] 0 2024-01-17T23:49:20.334 INFO:tasks.workunit.client.0.smithi161.stdout:5/994: write dd/d15/d1a/d5d/d64/d7c/fd4 [1094750,68651] 0 2024-01-17T23:49:20.520 INFO:tasks.workunit.client.0.smithi161.stdout:9/949: link d0/d8/d31/d73/fed d0/d8/d14/d11c/d130/d100/f146 0 2024-01-17T23:49:20.566 INFO:tasks.workunit.client.0.smithi161.stdout:5/995: mkdir dd/d116/d136 0 2024-01-17T23:49:20.763 INFO:tasks.workunit.client.0.smithi161.stdout:9/950: getdents d0/d39/d49/d6e 0 2024-01-17T23:49:20.763 INFO:tasks.workunit.client.0.smithi161.stdout:9/951: stat d0/d8/d14/cfc 0 2024-01-17T23:49:20.763 INFO:tasks.workunit.client.0.smithi161.stdout:9/952: write d0/f51 [2468008,8312] 0 2024-01-17T23:49:20.822 INFO:tasks.workunit.client.0.smithi161.stdout:5/996: mknod dd/d15/d4e/d4f/d77/c137 0 2024-01-17T23:49:21.603 INFO:tasks.workunit.client.0.smithi161.stdout:9/953: truncate d0/d8/d14/d136/fe4 4111877 0 2024-01-17T23:49:21.604 INFO:tasks.workunit.client.0.smithi161.stdout:9/954: truncate d0/d39/d49/d6e/fd2 307661 0 2024-01-17T23:49:22.002 INFO:tasks.workunit.client.0.smithi161.stdout:9/955: link d0/d8/d14/d18/c135 d0/d8/d14/d136/c147 0 2024-01-17T23:49:22.031 INFO:tasks.workunit.client.0.smithi161.stdout:9/956: dwrite d0/d8/d31/f8f [0,4194304] 0 2024-01-17T23:49:22.031 INFO:tasks.workunit.client.0.smithi161.stdout:9/957: fdatasync d0/d8/d14/d87/fe1 0 2024-01-17T23:49:22.031 INFO:tasks.workunit.client.0.smithi161.stdout:9/958: creat d0/d8/d14/d87/dd6/f148 x:0 0 0 2024-01-17T23:49:22.921 INFO:tasks.workunit.client.0.smithi161.stdout:9/959: mkdir d0/d8/d14/d136/d126/d149 0 2024-01-17T23:49:22.921 INFO:tasks.workunit.client.0.smithi161.stdout:9/960: chown d0/d39/d49/f57 1351 1 2024-01-17T23:49:22.922 INFO:tasks.workunit.client.0.smithi161.stdout:9/961: write d0/d8/d31/f68 [1690967,88771] 0 2024-01-17T23:49:22.924 INFO:tasks.workunit.client.0.smithi161.stdout:5/997: sync 2024-01-17T23:49:22.964 INFO:tasks.workunit.client.0.smithi161.stdout:5/998: dwrite dd/d15/d1a/d5d/d64/f73 [0,4194304] 0 2024-01-17T23:49:23.627 INFO:tasks.workunit.client.0.smithi161.stdout:9/962: sync 2024-01-17T23:49:23.810 INFO:tasks.workunit.client.0.smithi161.stdout:9/963: creat d0/d8/d14/d87/d9b/dd5/d115/d11e/f14a x:0 0 0 2024-01-17T23:49:23.844 INFO:tasks.workunit.client.0.smithi161.stdout:5/999: dwrite dd/d15/d1a/d5d/f65 [0,4194304] 0 2024-01-17T23:49:23.895 INFO:tasks.workunit.client.0.smithi161.stdout:9/964: creat d0/d8/d14/d87/d9b/dd5/f14b x:0 0 0 2024-01-17T23:49:23.895 INFO:tasks.workunit.client.0.smithi161.stdout:9/965: write d0/d39/d141/fd0 [3948038,47109] 0 2024-01-17T23:49:23.952 INFO:tasks.workunit.client.0.smithi161.stdout:9/966: mknod d0/d8/d14/d87/d9b/dd5/d115/d128/c14c 0 2024-01-17T23:49:23.974 INFO:tasks.workunit.client.0.smithi161.stdout:9/967: write d0/d8/f5f [2670516,122408] 0 2024-01-17T23:49:23.974 INFO:tasks.workunit.client.0.smithi161.stdout:9/968: write d0/f64 [581727,109455] 0 2024-01-17T23:49:24.003 INFO:tasks.workunit.client.0.smithi161.stdout:9/969: dwrite d0/d8/d31/f68 [0,4194304] 0 2024-01-17T23:49:24.089 INFO:tasks.workunit.client.0.smithi161.stdout:9/970: unlink d0/d8/d14/d136/d97/dae/f10c 0 2024-01-17T23:49:24.215 INFO:tasks.workunit.client.0.smithi161.stdout:9/971: creat d0/d8/d14/d136/d126/d149/f14d x:0 0 0 2024-01-17T23:49:24.259 INFO:tasks.workunit.client.0.smithi161.stdout:9/972: creat d0/d8/d14/d11c/f14e x:0 0 0 2024-01-17T23:49:24.259 INFO:tasks.workunit.client.0.smithi161.stdout:9/973: chown d0/d39/d49/c8c 2 1 2024-01-17T23:49:24.340 INFO:tasks.workunit.client.0.smithi161.stdout:9/974: creat d0/d8/d14/d136/d97/dae/dfa/f14f x:0 0 0 2024-01-17T23:49:24.425 INFO:tasks.workunit.client.0.smithi161.stdout:9/975: truncate d0/d39/f59 1186771 0 2024-01-17T23:49:24.425 INFO:tasks.workunit.client.0.smithi161.stdout:9/976: dread - d0/d8/d14/dab/ff2 zero size 2024-01-17T23:49:24.426 INFO:tasks.workunit.client.0.smithi161.stdout:9/977: write d0/f51 [3641738,71634] 0 2024-01-17T23:49:24.495 INFO:tasks.workunit.client.0.smithi161.stdout:9/978: mkdir d0/d8/d14/d150 0 2024-01-17T23:49:24.563 INFO:tasks.workunit.client.0.smithi161.stdout:9/979: mknod d0/d8/d14/d136/c151 0 2024-01-17T23:49:24.615 INFO:tasks.workunit.client.0.smithi161.stdout:9/980: mknod d0/d8/d14/dab/c152 0 2024-01-17T23:49:24.647 INFO:tasks.workunit.client.0.smithi161.stdout:9/981: symlink d0/d8/d14/d87/l153 0 2024-01-17T23:49:24.647 INFO:tasks.workunit.client.0.smithi161.stdout:9/982: readlink d0/d39/d141/le2 0 2024-01-17T23:49:24.713 INFO:tasks.workunit.client.0.smithi161.stdout:9/983: mkdir d0/d39/d49/d6e/d154 0 2024-01-17T23:49:25.013 INFO:tasks.workunit.client.0.smithi161.stdout:9/984: write d0/d39/d49/d6e/fb2 [854554,57314] 0 2024-01-17T23:49:25.032 INFO:tasks.workunit.client.0.smithi161.stdout:9/985: write d0/d8/d14/d18/d63/faa [3714646,50912] 0 2024-01-17T23:49:25.032 INFO:tasks.workunit.client.0.smithi161.stdout:9/986: fdatasync d0/d8/d14/d87/d9b/d105/f125 0 2024-01-17T23:49:25.032 INFO:tasks.workunit.client.0.smithi161.stdout:9/987: truncate d0/d8/d14/d18/d63/f89 1551840 0 2024-01-17T23:49:25.170 INFO:tasks.workunit.client.0.smithi161.stdout:9/988: truncate d0/d8/d14/f90 2986524 0 2024-01-17T23:49:25.286 INFO:tasks.workunit.client.0.smithi161.stdout:9/989: link d0/d8/c17 d0/d8/d14/d11c/d130/c155 0 2024-01-17T23:49:25.286 INFO:tasks.workunit.client.0.smithi161.stdout:9/990: fdatasync d0/d8/d14/d11c/fdc 0 2024-01-17T23:49:25.514 INFO:tasks.workunit.client.0.smithi161.stdout:9/991: write d0/d8/d31/fcd [729377,104471] 0 2024-01-17T23:49:25.780 INFO:tasks.workunit.client.0.smithi161.stdout:9/992: dwrite d0/f30 [0,4194304] 0 2024-01-17T23:49:25.809 INFO:tasks.workunit.client.0.smithi161.stdout:9/993: dwrite d0/d8/d14/d87/dd6/f148 [0,4194304] 0 2024-01-17T23:49:26.021 INFO:tasks.workunit.client.0.smithi161.stdout:9/994: mknod d0/d101/c156 0 2024-01-17T23:49:26.067 INFO:tasks.workunit.client.0.smithi161.stdout:9/995: creat d0/d8/d31/f157 x:0 0 0 2024-01-17T23:49:26.262 INFO:tasks.workunit.client.0.smithi161.stdout:9/996: symlink d0/d8/d31/d73/l158 0 2024-01-17T23:49:27.219 INFO:tasks.workunit.client.0.smithi161.stdout:9/997: dwrite d0/d8/d14/d136/da2/dcb/f117 [0,4194304] 0 2024-01-17T23:49:27.340 INFO:tasks.workunit.client.0.smithi161.stdout:9/998: stat d0/d39/d49/c133 0 2024-01-17T23:49:27.344 INFO:tasks.workunit.client.0.smithi161.stdout:9/999: read d0/d8/d14/d87/fb5 [749391,118638] 0 2024-01-17T23:49:27.375 INFO:tasks.workunit.client.0.smithi161.stderr:+ rm -rf -- ./tmp.qsQmKch1e7 2024-01-17T23:49:43.494 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:49:43.497 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:50:13.564 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:50:13.568 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:50:43.662 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:50:43.667 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:51:13.735 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:51:13.739 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:51:43.865 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:51:43.869 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:52:13.954 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:52:13.959 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:52:44.168 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:52:44.171 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:52:45.420 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:55:08.778 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:52:45.427 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:55:08.785 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:52:45.462 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:55:08.740 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:52:45.469 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:55:08.748 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:52:45.474 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:55:08.751 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:52:45.484 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:55:08.762 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:52:45.517 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:55:08.875 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:52:45.627 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:55:08.905 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:52:45.635 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:55:08.914 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:53:14.214 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:53:14.218 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:53:44.370 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:53:44.374 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:54:14.501 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:54:14.505 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:54:44.632 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:54:44.637 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:55:14.736 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:55:14.740 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:55:20.730 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:57:44.088 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:55:20.731 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:57:44.090 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:55:20.817 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:57:44.174 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:55:20.854 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:57:44.133 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:55:20.855 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:57:44.133 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:55:20.859 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:57:44.137 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:55:20.865 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:57:44.143 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:55:20.975 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:57:44.253 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:55:20.988 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:57:44.267 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:55:44.857 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:55:44.861 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:55:50.364 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:58:13.722 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:55:50.368 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:58:13.727 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:55:50.402 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:58:13.760 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:55:50.405 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:58:13.684 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:55:50.411 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:58:13.689 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:55:50.414 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:58:13.693 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:55:50.429 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:58:13.706 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:55:50.480 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:58:13.758 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:55:50.496 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:58:13.775 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:56:14.933 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:56:14.937 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:56:44.985 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:56:44.988 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:57:15.103 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:57:15.107 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:57:16.152 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:59:39.510 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:16.155 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:59:39.513 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:16.197 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:00:59:39.555 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:16.272 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:59:39.550 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:16.274 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:59:39.552 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:16.278 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:59:39.557 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:16.281 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:59:39.559 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:16.340 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:00:59:39.618 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:16.365 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:00:59:39.643 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:45.258 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:57:45.262 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:58:15.347 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:58:15.351 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:58:45.477 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:58:45.481 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:58:59.981 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:01:23.337 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:58:59.984 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:01:23.341 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:59:00.024 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:01:23.302 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:59:00.027 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:01:23.306 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:59:00.030 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:01:23.308 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:59:00.048 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:01:23.326 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:59:00.066 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:01:23.424 27389== Warning: unimplemented fcntl command: 1036 2024-01-17T23:59:00.154 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:01:23.432 27870== Warning: unimplemented fcntl command: 1036 2024-01-17T23:59:00.165 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:01:23.443 27872== Warning: unimplemented fcntl command: 1036 2024-01-17T23:59:15.533 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:59:15.537 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:59:45.599 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:59:45.602 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-18T00:00:01.183 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-18T00:00:01.178+0000 7f5c94000640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34915) UID: 0 2024-01-18T00:00:01.183 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-01-18T00:00:01.178+0000 7f902be00640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34915) UID: 0 2024-01-18T00:00:01.184 INFO:tasks.ceph.osd.0.smithi161.stderr:2024-01-18T00:00:01.178+0000 7f84d7c00640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34915) UID: 0 2024-01-18T00:00:01.184 INFO:tasks.ceph.osd.2.smithi161.stderr:2024-01-18T00:00:01.178+0000 7fcb68a00640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34915) UID: 0 2024-01-18T00:00:01.184 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-01-18T00:00:01.182+0000 7f658a800640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34915) UID: 0 2024-01-18T00:00:01.192 INFO:tasks.ceph.mds.c.smithi161.stderr:2024-01-18T00:00:01.182+0000 b9ce640 -1 Fail to open '/proc/34915/cmdline' error = (2) No such file or directory 2024-01-18T00:00:01.193 INFO:tasks.ceph.mds.a.smithi161.stderr:2024-01-18T00:00:01.182+0000 b9ce640 -1 Fail to open '/proc/34915/cmdline' error = (2) No such file or directory 2024-01-18T00:00:01.193 INFO:tasks.ceph.mds.c.smithi161.stderr:2024-01-18T00:00:01.186+0000 b9ce640 -1 received signal: Hangup from (PID: 34915) UID: 0 2024-01-18T00:00:01.193 INFO:tasks.ceph.mon.a.smithi161.stderr:2024-01-18T00:00:01.182+0000 a369640 -1 Fail to read '/proc/34915/cmdline' error = (3) No such process 2024-01-18T00:00:01.193 INFO:tasks.ceph.mds.e.smithi161.stderr:2024-01-18T00:00:01.182+0000 b9ce640 -1 Fail to open '/proc/34915/cmdline' error = (2) No such file or directory 2024-01-18T00:00:01.194 INFO:tasks.ceph.mon.a.smithi161.stderr:2024-01-18T00:00:01.186+0000 a369640 -1 received signal: Hangup from (PID: 34915) UID: 0 2024-01-18T00:00:01.194 INFO:tasks.ceph.mds.e.smithi161.stderr:2024-01-18T00:00:01.186+0000 b9ce640 -1 received signal: Hangup from (PID: 34915) UID: 0 2024-01-18T00:00:01.194 INFO:tasks.ceph.mon.a.smithi161.stderr:2024-01-18T00:00:01.186+0000 a369640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2024-01-18T00:00:01.195 INFO:tasks.ceph.mds.a.smithi161.stderr:2024-01-18T00:00:01.186+0000 b9ce640 -1 received signal: Hangup from (PID: 34915) UID: 0 2024-01-18T00:00:01.212 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-18T00:00:01.210+0000 7f5c94000640 -1 received signal: Hangup from (PID: 34929) UID: 0 2024-01-18T00:00:01.213 INFO:tasks.ceph.osd.0.smithi161.stderr:2024-01-18T00:00:01.210+0000 7f84d7c00640 -1 received signal: Hangup from (PID: 34929) UID: 0 2024-01-18T00:00:01.213 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-01-18T00:00:01.210+0000 7f902be00640 -1 received signal: Hangup from (PID: 34929) UID: 0 2024-01-18T00:00:01.213 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-01-18T00:00:01.210+0000 7f658a800640 -1 received signal: Hangup from (PID: 34929) UID: 0 2024-01-18T00:00:01.214 INFO:tasks.ceph.osd.2.smithi161.stderr:2024-01-18T00:00:01.210+0000 7fcb68a00640 -1 received signal: Hangup from (PID: 34929) UID: 0 2024-01-18T00:00:01.214 INFO:tasks.ceph.mon.a.smithi161.stderr:2024-01-18T00:00:01.210+0000 a369640 -1 received signal: Hangup from (PID: 34929) UID: 0 2024-01-18T00:00:01.214 INFO:tasks.ceph.mds.e.smithi161.stderr:2024-01-18T00:00:01.210+0000 b9ce640 -1 Fail to open '/proc/34929/cmdline' error = (2) No such file or directory 2024-01-18T00:00:01.214 INFO:tasks.ceph.mon.a.smithi161.stderr:2024-01-18T00:00:01.210+0000 a369640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2024-01-18T00:00:01.215 INFO:tasks.ceph.mds.e.smithi161.stderr:2024-01-18T00:00:01.210+0000 b9ce640 -1 received signal: Hangup from (PID: 34929) UID: 0 2024-01-18T00:00:01.215 INFO:tasks.ceph.mds.c.smithi161.stderr:2024-01-18T00:00:01.210+0000 b9ce640 -1 Fail to read '/proc/34929/cmdline' error = (3) No such process 2024-01-18T00:00:01.215 INFO:tasks.ceph.mds.c.smithi161.stderr:2024-01-18T00:00:01.210+0000 b9ce640 -1 received signal: Hangup from (PID: 34929) UID: 0 2024-01-18T00:00:01.216 INFO:tasks.ceph.mds.a.smithi161.stderr:2024-01-18T00:00:01.210+0000 b9ce640 -1 Fail to read '/proc/34929/cmdline' error = (3) No such process 2024-01-18T00:00:01.216 INFO:tasks.ceph.mds.a.smithi161.stderr:2024-01-18T00:00:01.210+0000 b9ce640 -1 received signal: Hangup from (PID: 34929) UID: 0 2024-01-18T00:00:07.442 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-18T00:00:07.441+0000 7f2407977640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32388) UID: 0 2024-01-18T00:00:07.443 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-01-18T00:00:07.441+0000 7f2d48905640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32388) UID: 0 2024-01-18T00:00:07.443 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-01-18T00:00:07.441+0000 7f096103b640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32388) UID: 0 2024-01-18T00:00:07.444 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-01-18T00:00:07.441+0000 7fb4e66d3640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32388) UID: 0 2024-01-18T00:00:07.444 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-01-18T00:00:07.441+0000 7f145edf7640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32388) UID: 0 2024-01-18T00:00:07.451 INFO:tasks.ceph.mon.c.smithi190.stderr:2024-01-18T00:00:07.445+0000 a369640 -1 Fail to open '/proc/32388/cmdline' error = (2) No such file or directory 2024-01-18T00:00:07.452 INFO:tasks.ceph.mon.c.smithi190.stderr:2024-01-18T00:00:07.445+0000 a369640 -1 received signal: Hangup from (PID: 32388) UID: 0 2024-01-18T00:00:07.452 INFO:tasks.ceph.mon.c.smithi190.stderr:2024-01-18T00:00:07.449+0000 a369640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2024-01-18T00:00:07.452 INFO:tasks.ceph.mon.b.smithi190.stderr:2024-01-18T00:00:07.445+0000 a369640 -1 Fail to open '/proc/32388/cmdline' error = (2) No such file or directory 2024-01-18T00:00:07.453 INFO:tasks.ceph.mds.f.smithi190.stderr:2024-01-18T00:00:07.445+0000 b9ce640 -1 Fail to open '/proc/32388/cmdline' error = (2) No such file or directory 2024-01-18T00:00:07.453 INFO:tasks.ceph.mds.b.smithi190.stderr:2024-01-18T00:00:07.445+0000 b9ce640 -1 Fail to open '/proc/32388/cmdline' error = (2) No such file or directory 2024-01-18T00:00:07.454 INFO:tasks.ceph.mon.b.smithi190.stderr:2024-01-18T00:00:07.445+0000 a369640 -1 received signal: Hangup from (PID: 32388) UID: 0 2024-01-18T00:00:07.454 INFO:tasks.ceph.mon.b.smithi190.stderr:2024-01-18T00:00:07.449+0000 a369640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2024-01-18T00:00:07.454 INFO:tasks.ceph.mds.f.smithi190.stderr:2024-01-18T00:00:07.449+0000 b9ce640 -1 received signal: Hangup from (PID: 32388) UID: 0 2024-01-18T00:00:07.454 INFO:tasks.ceph.mds.b.smithi190.stderr:2024-01-18T00:00:07.449+0000 b9ce640 -1 received signal: Hangup from (PID: 32388) UID: 0 2024-01-18T00:00:07.458 INFO:tasks.ceph.mds.d.smithi190.stderr:2024-01-18T00:00:07.449+0000 b9ce640 -1 Fail to open '/proc/32388/cmdline' error = (2) No such file or directory 2024-01-18T00:00:07.459 INFO:tasks.ceph.mds.d.smithi190.stderr:2024-01-18T00:00:07.453+0000 b9ce640 -1 received signal: Hangup from (PID: 32388) UID: 0 2024-01-18T00:00:07.506 INFO:tasks.ceph.mon.c.smithi190.stderr:2024-01-18T00:00:07.505+0000 a369640 -1 Fail to read '/proc/32390/cmdline' error = (3) No such process 2024-01-18T00:00:07.506 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-01-18T00:00:07.505+0000 7f2407977640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 32390) UID: 0 2024-01-18T00:00:07.507 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-01-18T00:00:07.505+0000 7f2d48905640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 32390) UID: 0 2024-01-18T00:00:07.507 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-01-18T00:00:07.505+0000 7f096103b640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 32390) UID: 0 2024-01-18T00:00:07.507 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-01-18T00:00:07.505+0000 7fb4e66d3640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 32390) UID: 0 2024-01-18T00:00:07.508 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-01-18T00:00:07.505+0000 7f145edf7640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 32390) UID: 0 2024-01-18T00:00:07.508 INFO:tasks.ceph.mon.c.smithi190.stderr:2024-01-18T00:00:07.505+0000 a369640 -1 received signal: Hangup from (PID: 32390) UID: 0 2024-01-18T00:00:07.508 INFO:tasks.ceph.mds.f.smithi190.stderr:2024-01-18T00:00:07.505+0000 b9ce640 -1 Fail to read '/proc/32390/cmdline' error = (3) No such process 2024-01-18T00:00:07.509 INFO:tasks.ceph.mon.c.smithi190.stderr:2024-01-18T00:00:07.505+0000 a369640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2024-01-18T00:00:07.509 INFO:tasks.ceph.mds.f.smithi190.stderr:2024-01-18T00:00:07.505+0000 b9ce640 -1 received signal: Hangup from (PID: 32390) UID: 0 2024-01-18T00:00:07.509 INFO:tasks.ceph.mds.b.smithi190.stderr:2024-01-18T00:00:07.505+0000 b9ce640 -1 Fail to read '/proc/32390/cmdline' error = (3) No such process 2024-01-18T00:00:07.509 INFO:tasks.ceph.mds.b.smithi190.stderr:2024-01-18T00:00:07.505+0000 b9ce640 -1 received signal: Hangup from (PID: 32390) UID: 0 2024-01-18T00:00:07.510 INFO:tasks.ceph.mon.b.smithi190.stderr:2024-01-18T00:00:07.505+0000 a369640 -1 Fail to read '/proc/32390/cmdline' error = (3) No such process 2024-01-18T00:00:07.510 INFO:tasks.ceph.mon.b.smithi190.stderr:2024-01-18T00:00:07.505+0000 a369640 -1 received signal: Hangup from (PID: 32390) UID: 0 2024-01-18T00:00:07.510 INFO:tasks.ceph.mon.b.smithi190.stderr:2024-01-18T00:00:07.505+0000 a369640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2024-01-18T00:00:07.523 INFO:tasks.ceph.mds.d.smithi190.stderr:2024-01-18T00:00:07.513+0000 b9ce640 -1 Fail to open '/proc/32390/cmdline' error = (2) No such file or directory 2024-01-18T00:00:07.523 INFO:tasks.ceph.mds.d.smithi190.stderr:2024-01-18T00:00:07.513+0000 b9ce640 -1 received signal: Hangup from (PID: 32390) UID: 0 2024-01-18T00:00:15.745 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-18T00:00:15.750 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-18T00:00:15.762 INFO:teuthology.orchestra.run.smithi190.stderr:error: state file /var/lib/logrotate/status is already locked 2024-01-18T00:00:15.762 INFO:teuthology.orchestra.run.smithi190.stderr:logrotate does not support parallel execution on the same set of logfiles. 2024-01-18T00:00:15.766 INFO:teuthology.orchestra.run.smithi161.stderr:error: state file /var/lib/logrotate/status is already locked 2024-01-18T00:00:15.766 INFO:teuthology.orchestra.run.smithi161.stderr:logrotate does not support parallel execution on the same set of logfiles. 2024-01-18T00:00:15.767 DEBUG:teuthology.orchestra.run:got remote process result: 3 2024-01-18T00:00:15.768 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi161 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-01-18T00:02:30.043 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:04:53.400 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:02:30.045 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:04:53.403 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:02:30.069 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:04:53.347 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:02:30.076 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:04:53.354 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:02:30.076 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:04:53.354 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:02:30.089 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:04:53.368 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:02:30.139 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:04:53.498 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:02:30.232 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:04:53.510 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:02:30.233 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:04:53.511 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:02:47.093 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:05:10.451 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:02:47.096 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:05:10.455 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:02:47.120 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:05:10.478 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:02:47.215 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:05:10.494 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:02:47.218 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:05:10.497 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:02:47.236 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:05:10.514 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:02:47.240 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:05:10.518 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:02:47.249 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:05:10.527 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:02:47.267 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:05:10.545 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:37.629 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:08:00.987 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:37.645 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:08:01.003 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:37.704 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:08:01.062 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:37.770 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:08:01.048 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:37.775 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:08:01.054 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:37.776 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:08:01.054 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:37.778 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:08:01.056 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:37.854 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:08:01.132 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:37.871 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:08:01.150 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:57.167 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:08:20.525 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:57.170 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:08:20.529 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:57.199 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:08:20.558 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:57.220 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:08:20.498 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:57.230 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:08:20.508 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:57.232 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:08:20.510 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:57.245 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:08:20.524 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:57.291 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:08:20.569 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:57.305 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:08:20.583 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:17.892 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-18T00:07:17.893 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-18T00:09:45.784 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:12:09.141 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:09:45.786 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:12:09.145 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:09:45.800 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:12:09.079 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:09:45.810 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:12:09.088 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:09:45.811 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:12:09.090 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:09:45.816 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:12:09.093 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:09:45.883 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:12:09.242 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:09:45.955 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:12:09.234 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:09:45.976 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:12:09.254 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:11:28.778 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:13:52.136 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:11:28.779 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:13:52.138 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:11:28.830 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:13:52.189 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:11:28.894 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:13:52.172 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:11:28.897 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:13:52.175 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:11:28.904 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:13:52.182 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:11:28.906 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:13:52.185 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:11:28.964 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:13:52.242 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:11:28.972 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:13:52.250 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:13:11.762 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:15:35.120 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:13:11.768 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:15:35.127 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:13:11.798 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:15:35.076 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:13:11.804 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:15:35.082 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:13:11.806 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:15:35.084 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:13:11.811 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:15:35.089 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:13:11.836 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:15:35.193 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:13:11.888 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:15:35.166 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:13:11.933 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:15:35.212 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:14:19.294 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:16:42.652 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:14:19.296 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:16:42.655 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:14:19.329 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:16:42.688 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:14:19.421 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:16:42.699 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:14:19.424 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:16:42.701 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:14:19.430 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:16:42.709 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:14:19.434 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:16:42.713 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:14:19.495 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:16:42.772 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:14:19.497 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:16:42.776 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:16:37.906 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:19:01.264 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:16:37.910 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:19:01.269 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:16:37.941 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:19:01.220 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:16:37.944 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:19:01.222 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:16:37.948 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:19:01.226 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:16:37.951 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:19:01.230 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:16:37.980 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:19:01.339 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:16:38.059 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:19:01.337 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:16:38.084 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:19:01.363 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:19:50.179 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:22:13.537 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:19:50.182 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:22:13.541 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:19:50.261 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:22:13.620 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:19:50.301 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:22:13.579 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:19:50.302 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:22:13.580 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:19:50.306 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:22:13.584 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:19:50.311 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:22:13.590 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:19:50.447 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:22:13.726 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:19:50.452 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:22:13.731 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:20:04.398 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:22:27.757 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:20:04.405 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:22:27.764 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:20:04.429 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:22:27.708 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:20:04.429 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:22:27.788 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:20:04.430 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:22:27.708 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:20:04.434 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:22:27.713 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:20:04.439 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:22:27.717 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:20:04.482 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:22:27.761 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:20:04.485 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:22:27.764 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:22:40.646 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:25:04.004 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:22:40.648 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:25:04.008 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:22:40.699 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:25:04.058 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:22:40.773 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:25:04.052 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:22:40.776 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:25:04.055 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:22:40.779 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:25:04.057 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:22:40.781 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:25:04.059 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:22:40.867 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:25:04.146 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:22:40.869 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:25:04.147 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:23:31.078 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:25:54.437 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:23:31.080 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:25:54.439 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:23:31.112 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:25:54.391 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:23:31.118 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:25:54.478 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:23:31.121 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:25:54.400 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:23:31.122 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:25:54.400 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:23:31.135 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:25:54.413 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:23:31.183 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:25:54.462 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:23:31.191 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:25:54.469 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:26:59.091 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:29:22.449 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:26:59.095 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:29:22.454 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:26:59.133 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:29:22.412 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:26:59.140 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:29:22.418 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:26:59.151 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:29:22.430 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:26:59.162 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:29:22.440 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:26:59.187 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:29:22.546 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:26:59.304 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:29:22.583 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:26:59.325 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:29:22.603 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:28:11.549 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:30:34.908 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:28:11.554 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:30:34.913 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:28:11.596 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:30:34.955 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:28:11.672 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:30:34.950 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:28:11.674 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:30:34.953 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:28:11.686 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:30:34.965 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:28:11.694 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:30:34.973 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:28:11.748 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:30:35.027 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:28:11.751 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:30:35.030 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:30:24.474 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:32:47.832 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:30:24.482 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:32:47.841 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:30:24.498 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:32:47.776 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:30:24.501 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:32:47.780 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:30:24.503 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:32:47.781 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:30:24.507 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:32:47.786 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:30:24.550 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:32:47.909 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:30:24.597 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:32:47.875 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:30:24.615 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:32:47.894 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:31:02.039 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:33:25.397 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:31:02.044 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:33:25.403 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:31:02.070 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:33:25.429 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:31:02.079 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:33:25.358 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:31:02.160 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:33:25.439 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:31:02.163 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:33:25.441 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:31:02.172 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:33:25.451 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:31:02.214 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:33:25.493 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:31:02.229 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:33:25.508 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:33:53.247 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:36:16.605 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:33:53.252 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:36:16.611 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:33:53.280 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:36:16.559 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:33:53.292 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:36:16.570 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:33:53.300 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:36:16.579 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:33:53.308 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:36:16.587 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:33:53.333 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:36:16.692 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:33:53.431 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:36:16.710 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:33:53.444 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:36:16.723 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:36:32.904 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:38:56.262 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:36:32.908 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:38:56.267 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:36:32.978 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:38:56.337 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:36:33.032 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:38:56.310 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:36:33.034 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:38:56.313 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:36:33.037 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:38:56.315 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:36:33.038 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:38:56.317 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:36:33.128 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:38:56.406 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:36:33.132 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:38:56.412 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:37:19.395 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:39:42.754 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:37:19.398 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:39:42.757 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:37:19.417 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:39:42.696 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:37:19.423 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:39:42.702 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:37:19.426 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:39:42.705 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:37:19.435 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:39:42.794 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:37:19.440 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:39:42.718 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:37:19.482 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:39:42.761 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:37:19.509 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:39:42.787 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:39:23.445 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:41:46.803 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:39:23.449 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:41:46.808 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:39:23.495 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:41:46.854 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:39:23.559 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:41:46.837 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:39:23.564 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:41:46.843 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:39:23.564 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:41:46.842 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:39:23.569 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:41:46.847 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:39:23.633 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:41:46.912 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:39:23.645 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:41:46.924 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:40:45.988 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:43:09.346 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:40:45.992 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:43:09.351 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:40:46.033 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:43:09.311 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:40:46.040 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:43:09.399 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:40:46.047 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:43:09.323 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:40:46.047 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:43:09.322 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:40:46.054 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:43:09.333 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:40:46.123 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:43:09.401 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:40:46.127 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:43:09.406 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:44:13.507 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:46:36.865 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:44:13.509 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:46:36.868 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:44:13.534 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:46:36.813 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:44:13.539 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:46:36.818 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:44:13.543 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:46:36.822 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:44:13.556 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:46:36.834 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:44:13.604 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:46:36.963 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:44:13.706 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:46:36.985 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:44:13.720 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:46:36.998 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:44:54.409 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:47:17.767 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:44:54.411 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:47:17.770 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:44:54.462 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:47:17.821 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:44:54.534 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:47:17.812 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:44:54.542 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:47:17.821 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:44:54.544 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:47:17.822 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:44:54.550 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:47:17.829 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:44:54.594 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:47:17.873 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:44:54.605 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:47:17.884 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:09.915 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-01-18T00:47:09.915 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-01-18T00:47:10.760 DEBUG:teuthology.parallel:result is None 2024-01-18T00:47:10.761 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-01-18T00:47:11.272 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-01-18T00:47:11.272 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-01-18T00:47:11.283 INFO:tasks.kclient:Unmounting kernel clients... 2024-01-18T00:47:11.283 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-18T00:47:11.283 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-18T00:47:11.293 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-18T00:47:11.293 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-18T00:47:11.342 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-18T00:47:11.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.519+0000 7f69cce00640 1 Processor -- start 2024-01-18T00:47:11.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.519+0000 7f69cce00640 1 -- start start 2024-01-18T00:47:11.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.523+0000 7f69cce00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69c81517a0 0x7f69c806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:11.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.523+0000 7f69cce00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f69c8157bc0 0x7f69c8158010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:11.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.523+0000 7f69cce00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c8158550 con 0x7f69c806d210 2024-01-18T00:47:11.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.523+0000 7f69cce00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c815b9c0 con 0x7f69c8157bc0 2024-01-18T00:47:11.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.523+0000 7f69cce00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c815ae40 con 0x7f69c81517a0 2024-01-18T00:47:11.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.523+0000 7f69c6800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f69c8157bc0 0x7f69c8158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:11.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.523+0000 7f69c6800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f69c8157bc0 0x7f69c8158010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59704/0 (socket says 172.21.15.161:59704) 2024-01-18T00:47:11.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.523+0000 7f69c6800640 1 -- 172.21.15.161:0/2173725416 learned_addr learned my addr 172.21.15.161:0/2173725416 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:11.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.523+0000 7f69c5e00640 1 --2- 172.21.15.161:0/2173725416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69c81517a0 0x7f69c806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:11.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.527+0000 7f69c6800640 1 -- 172.21.15.161:0/2173725416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69c81517a0 msgr2=0x7f69c806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:11.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.527+0000 7f69c6800640 1 --2- 172.21.15.161:0/2173725416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69c81517a0 0x7f69c806ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:11.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.527+0000 7f69c6800640 1 -- 172.21.15.161:0/2173725416 >> v1:172.21.15.190:6789/0 conn(0x7f69c806d210 legacy=0x7f69c8072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:11.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.527+0000 7f69c6800640 1 -- 172.21.15.161:0/2173725416 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c815b120 con 0x7f69c8157bc0 2024-01-18T00:47:11.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.531+0000 7f69c6800640 1 --2- 172.21.15.161:0/2173725416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69c8157bc0 0x7f69c8158010 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f69c0009e50 tx=0x7f69c001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97fffacded8de99 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:11.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.535+0000 7f69c4a00640 1 -- 172.21.15.161:0/2173725416 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c00a58a0 con 0x7f69c8157bc0 2024-01-18T00:47:11.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.535+0000 7f69c4a00640 1 -- 172.21.15.161:0/2173725416 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c00a5a00 con 0x7f69c8157bc0 2024-01-18T00:47:11.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.535+0000 7f69c4a00640 1 -- 172.21.15.161:0/2173725416 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c00a5d90 con 0x7f69c8157bc0 2024-01-18T00:47:11.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.535+0000 7f69cce00640 1 -- 172.21.15.161:0/2173725416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69c8157bc0 msgr2=0x7f69c8158010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:11.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.535+0000 7f69cce00640 1 --2- 172.21.15.161:0/2173725416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69c8157bc0 0x7f69c8158010 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f69c0009e50 tx=0x7f69c001c9e0 comp rx=0 tx=0).stop 2024-01-18T00:47:11.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.535+0000 7f69cce00640 1 -- 172.21.15.161:0/2173725416 shutdown_connections 2024-01-18T00:47:11.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.535+0000 7f69cce00640 1 --2- 172.21.15.161:0/2173725416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69c8157bc0 0x7f69c8158010 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:11.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.535+0000 7f69cce00640 1 --2- 172.21.15.161:0/2173725416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69c81517a0 0x7f69c806ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:11.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.535+0000 7f69cce00640 1 -- 172.21.15.161:0/2173725416 >> 172.21.15.161:0/2173725416 conn(0x7f69c80cb070 msgr2=0x7f69c80cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:11.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.535+0000 7f69cce00640 1 -- 172.21.15.161:0/2173725416 shutdown_connections 2024-01-18T00:47:11.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.535+0000 7f69cce00640 1 -- 172.21.15.161:0/2173725416 wait complete. 2024-01-18T00:47:11.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.535+0000 7f69cce00640 1 Processor -- start 2024-01-18T00:47:11.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.539+0000 7f69cce00640 1 -- start start 2024-01-18T00:47:11.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.539+0000 7f69cce00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69c806d210 0x7f69c81f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:11.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.539+0000 7f69cce00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69c81517a0 0x7f69c81f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:11.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.539+0000 7f69cce00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69c8157bc0 0x7f69c8071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:11.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.539+0000 7f69cce00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c81f1e80 con 0x7f69c81517a0 2024-01-18T00:47:11.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.539+0000 7f69cce00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c81f2400 con 0x7f69c806d210 2024-01-18T00:47:11.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.539+0000 7f69cce00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c81f2dd0 con 0x7f69c8157bc0 2024-01-18T00:47:11.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.539+0000 7f69c6800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69c8157bc0 0x7f69c8071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:11.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.539+0000 7f69c6800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69c8157bc0 0x7f69c8071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:40692/0 (socket says 172.21.15.161:40692) 2024-01-18T00:47:11.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.539+0000 7f69c6800640 1 -- 172.21.15.161:0/1689169209 learned_addr learned my addr 172.21.15.161:0/1689169209 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:11.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.539+0000 7f69c5400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69c81517a0 0x7f69c81f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:11.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.543+0000 7f69c5e00640 1 --2- 172.21.15.161:0/1689169209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69c806d210 0x7f69c81f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:11.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.547+0000 7f69c5400640 1 -- 172.21.15.161:0/1689169209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69c8157bc0 msgr2=0x7f69c8071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:11.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.547+0000 7f69c5400640 1 --2- 172.21.15.161:0/1689169209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69c8157bc0 0x7f69c8071d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:11.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.547+0000 7f69c5400640 1 -- 172.21.15.161:0/1689169209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69c806d210 msgr2=0x7f69c81f5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:11.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.547+0000 7f69c5400640 1 --2- 172.21.15.161:0/1689169209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69c806d210 0x7f69c81f5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:11.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.547+0000 7f69c5400640 1 -- 172.21.15.161:0/1689169209 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c0009b30 con 0x7f69c81517a0 2024-01-18T00:47:11.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.547+0000 7f69c5400640 1 --2- 172.21.15.161:0/1689169209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69c81517a0 0x7f69c81f2890 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f69b000c3c0 tx=0x7f69b000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:11.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.551+0000 7f69be000640 1 -- 172.21.15.161:0/1689169209 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b00052d0 con 0x7f69c81517a0 2024-01-18T00:47:11.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.551+0000 7f69be000640 1 -- 172.21.15.161:0/1689169209 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b0005430 con 0x7f69c81517a0 2024-01-18T00:47:11.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.551+0000 7f69cce00640 1 -- 172.21.15.161:0/1689169209 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c80c0f90 con 0x7f69c81517a0 2024-01-18T00:47:11.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.551+0000 7f69be000640 1 -- 172.21.15.161:0/1689169209 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b0007260 con 0x7f69c81517a0 2024-01-18T00:47:11.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.551+0000 7f69cce00640 1 -- 172.21.15.161:0/1689169209 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c80c1550 con 0x7f69c81517a0 2024-01-18T00:47:11.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.551+0000 7f69cce00640 1 -- 172.21.15.161:0/1689169209 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c81f6340 con 0x7f69c81517a0 2024-01-18T00:47:11.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.571+0000 7f69be000640 1 -- 172.21.15.161:0/1689169209 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f69b00073c0 con 0x7f69c81517a0 2024-01-18T00:47:11.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.575+0000 7f69be000640 1 --2- 172.21.15.161:0/1689169209 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f69a00668c0 0x7f69a0068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:11.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.575+0000 7f69c5e00640 1 --2- 172.21.15.161:0/1689169209 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f69a00668c0 0x7f69a0068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:11.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.575+0000 7f69c5e00640 1 --2- 172.21.15.161:0/1689169209 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f69a00668c0 0x7f69a0068d80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f69b80079c0 tx=0x7f69b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:11.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.575+0000 7f69be000640 1 -- 172.21.15.161:0/1689169209 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f69b0007670 con 0x7f69c81517a0 2024-01-18T00:47:11.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.811+0000 7f69be000640 1 -- 172.21.15.161:0/1689169209 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f69b0050770 con 0x7f69c81517a0 2024-01-18T00:47:11.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:11.971+0000 7f69cce00640 1 -- 172.21.15.161:0/1689169209 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69c81f6340 con 0x7f69c81517a0 2024-01-18T00:47:12.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.011+0000 7f69be000640 1 -- 172.21.15.161:0/1689169209 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18587 (secure 0 0 0) 0x7f69c81f6340 con 0x7f69c81517a0 2024-01-18T00:47:12.011 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-18T00:47:12.012 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":28,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:59:08.571619+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T22:58:46.757110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T22:58:47.930512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T22:58:53.561624+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.614036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.746767+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.689096+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.706485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.628004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.680048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.571249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]},{"pgid":"4.14","mappings":[{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-18T00:47:12.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.011+0000 7f69cce00640 1 -- 172.21.15.161:0/1689169209 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f69a00668c0 msgr2=0x7f69a0068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:12.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.011+0000 7f69cce00640 1 --2- 172.21.15.161:0/1689169209 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f69a00668c0 0x7f69a0068d80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f69b80079c0 tx=0x7f69b8008040 comp rx=0 tx=0).stop 2024-01-18T00:47:12.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.011+0000 7f69cce00640 1 -- 172.21.15.161:0/1689169209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69c81517a0 msgr2=0x7f69c81f2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:12.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.011+0000 7f69cce00640 1 --2- 172.21.15.161:0/1689169209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69c81517a0 0x7f69c81f2890 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f69b000c3c0 tx=0x7f69b000c880 comp rx=0 tx=0).stop 2024-01-18T00:47:12.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.011+0000 7f69cce00640 1 -- 172.21.15.161:0/1689169209 shutdown_connections 2024-01-18T00:47:12.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.011+0000 7f69cce00640 1 --2- 172.21.15.161:0/1689169209 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f69a00668c0 0x7f69a0068d80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.011+0000 7f69cce00640 1 --2- 172.21.15.161:0/1689169209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69c8157bc0 0x7f69c8071d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.011+0000 7f69cce00640 1 --2- 172.21.15.161:0/1689169209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69c81517a0 0x7f69c81f2890 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.011+0000 7f69cce00640 1 --2- 172.21.15.161:0/1689169209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69c806d210 0x7f69c81f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.011+0000 7f69cce00640 1 -- 172.21.15.161:0/1689169209 >> 172.21.15.161:0/1689169209 conn(0x7f69c80cb070 msgr2=0x7f69c814e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:12.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.011+0000 7f69cce00640 1 -- 172.21.15.161:0/1689169209 shutdown_connections 2024-01-18T00:47:12.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.011+0000 7f69cce00640 1 -- 172.21.15.161:0/1689169209 wait complete. 2024-01-18T00:47:12.035 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-17T22:58:14.876386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-17T22:58:46.757110+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-17T22:58:47.930512+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-17T22:58:53.561624+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-18T00:47:12.036 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-18T00:47:12.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.175+0000 7f529ac00640 1 Processor -- start 2024-01-18T00:47:12.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.175+0000 7f529ac00640 1 -- start start 2024-01-18T00:47:12.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.179+0000 7f529ac00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5294070090 0x7f529406f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:12.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.179+0000 7f529ac00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52940c2ef0 con 0x7f5294153af0 2024-01-18T00:47:12.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.179+0000 7f529ac00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52940c55f0 con 0x7f5294061500 2024-01-18T00:47:12.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.179+0000 7f529ac00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52940c3560 con 0x7f5294070090 2024-01-18T00:47:12.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.179+0000 7f5298c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5294070090 0x7f529406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:12.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.179+0000 7f5293e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f5294153af0 0x7f52940c4ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55152/0 (socket says 172.21.15.161:55152) 2024-01-18T00:47:12.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.179+0000 7f5293e00640 1 -- 172.21.15.161:0/1272582144 learned_addr learned my addr 172.21.15.161:0/1272582144 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-18T00:47:12.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.183+0000 7f5298c00640 1 -- 172.21.15.161:0/1272582144 >> v1:172.21.15.190:6789/0 conn(0x7f5294061500 legacy=0x7f529406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:12.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.183+0000 7f5298c00640 1 -- 172.21.15.161:0/1272582144 >> v1:172.21.15.161:6789/0 conn(0x7f5294153af0 legacy=0x7f52940c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:12.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.183+0000 7f5298c00640 1 -- 172.21.15.161:0/1272582144 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52940c4a50 con 0x7f5294070090 2024-01-18T00:47:12.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.187+0000 7f5298c00640 1 --2- 172.21.15.161:0/1272582144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5294070090 0x7f529406f960 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f528c009d90 tx=0x7f528c01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc2a8ccd6a6647f server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:12.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.191+0000 7f5292a00640 1 -- 172.21.15.161:0/1272582144 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0af600 con 0x7f5294070090 2024-01-18T00:47:12.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.191+0000 7f5292a00640 1 -- 172.21.15.161:0/1272582144 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c0ab050 con 0x7f5294070090 2024-01-18T00:47:12.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.191+0000 7f5292a00640 1 -- 172.21.15.161:0/1272582144 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0af980 con 0x7f5294070090 2024-01-18T00:47:12.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.191+0000 7f529ac00640 1 -- 172.21.15.161:0/1272582144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5294070090 msgr2=0x7f529406f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:12.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.191+0000 7f529ac00640 1 --2- 172.21.15.161:0/1272582144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5294070090 0x7f529406f960 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f528c009d90 tx=0x7f528c01f130 comp rx=0 tx=0).stop 2024-01-18T00:47:12.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.191+0000 7f529ac00640 1 -- 172.21.15.161:0/1272582144 shutdown_connections 2024-01-18T00:47:12.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.191+0000 7f529ac00640 1 --2- 172.21.15.161:0/1272582144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5294070090 0x7f529406f960 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.191+0000 7f529ac00640 1 -- 172.21.15.161:0/1272582144 >> 172.21.15.161:0/1272582144 conn(0x7f52940c82d0 msgr2=0x7f52940c86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:12.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.191+0000 7f529ac00640 1 -- 172.21.15.161:0/1272582144 shutdown_connections 2024-01-18T00:47:12.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.191+0000 7f529ac00640 1 -- 172.21.15.161:0/1272582144 wait complete. 2024-01-18T00:47:12.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.195+0000 7f529ac00640 1 Processor -- start 2024-01-18T00:47:12.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.195+0000 7f529ac00640 1 -- start start 2024-01-18T00:47:12.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.195+0000 7f529ac00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5294061500 0x7f52941e6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:12.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.195+0000 7f529ac00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5294070090 0x7f5294158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:12.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.195+0000 7f529ac00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5294153af0 0x7f529414c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:12.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.195+0000 7f529ac00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529415ad90 con 0x7f5294153af0 2024-01-18T00:47:12.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.195+0000 7f529ac00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529415b030 con 0x7f5294070090 2024-01-18T00:47:12.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.195+0000 7f529ac00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529415b310 con 0x7f5294061500 2024-01-18T00:47:12.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.195+0000 7f5298c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5294153af0 0x7f529414c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:12.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.195+0000 7f5298c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5294153af0 0x7f529414c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43544/0 (socket says 172.21.15.161:43544) 2024-01-18T00:47:12.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.195+0000 7f5298c00640 1 -- 172.21.15.161:0/2916909141 learned_addr learned my addr 172.21.15.161:0/2916909141 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:12.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.195+0000 7f5293400640 1 --2- 172.21.15.161:0/2916909141 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5294070090 0x7f5294158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:12.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.195+0000 7f5293e00640 1 --2- 172.21.15.161:0/2916909141 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5294061500 0x7f52941e6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:12.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.199+0000 7f5298c00640 1 -- 172.21.15.161:0/2916909141 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5294061500 msgr2=0x7f52941e6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:12.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.199+0000 7f5298c00640 1 --2- 172.21.15.161:0/2916909141 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5294061500 0x7f52941e6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.199+0000 7f5298c00640 1 -- 172.21.15.161:0/2916909141 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5294070090 msgr2=0x7f5294158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:12.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.199+0000 7f5298c00640 1 --2- 172.21.15.161:0/2916909141 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5294070090 0x7f5294158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.199+0000 7f5298c00640 1 -- 172.21.15.161:0/2916909141 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528c009a70 con 0x7f5294153af0 2024-01-18T00:47:12.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.203+0000 7f5298c00640 1 --2- 172.21.15.161:0/2916909141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5294153af0 0x7f529414c4f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f528c01cd60 tx=0x7f528c01bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:12.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.203+0000 7f528be00640 1 -- 172.21.15.161:0/2916909141 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0afdb0 con 0x7f5294153af0 2024-01-18T00:47:12.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.203+0000 7f529ac00640 1 -- 172.21.15.161:0/2916909141 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52941efa60 con 0x7f5294153af0 2024-01-18T00:47:12.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.203+0000 7f529ac00640 1 -- 172.21.15.161:0/2916909141 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52941f0020 con 0x7f5294153af0 2024-01-18T00:47:12.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.207+0000 7f528be00640 1 -- 172.21.15.161:0/2916909141 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c0ba420 con 0x7f5294153af0 2024-01-18T00:47:12.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.207+0000 7f528be00640 1 -- 172.21.15.161:0/2916909141 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0ba790 con 0x7f5294153af0 2024-01-18T00:47:12.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.207+0000 7f529ac00640 1 -- 172.21.15.161:0/2916909141 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52941f0210 con 0x7f5294153af0 2024-01-18T00:47:12.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.227+0000 7f528be00640 1 -- 172.21.15.161:0/2916909141 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f528c0ba8f0 con 0x7f5294153af0 2024-01-18T00:47:12.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.227+0000 7f528be00640 1 --2- 172.21.15.161:0/2916909141 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f526c066840 0x7f526c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:12.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.227+0000 7f5293e00640 1 --2- 172.21.15.161:0/2916909141 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f526c066840 0x7f526c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:12.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.227+0000 7f5293e00640 1 --2- 172.21.15.161:0/2916909141 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f526c066840 0x7f526c068d00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5284000f70 tx=0x7f5284007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:12.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.227+0000 7f528be00640 1 -- 172.21.15.161:0/2916909141 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f528c0f3f60 con 0x7f5294153af0 2024-01-18T00:47:12.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.459+0000 7f528be00640 1 -- 172.21.15.161:0/2916909141 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f528c0f02a0 con 0x7f5294153af0 2024-01-18T00:47:12.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.631+0000 7f529ac00640 1 -- 172.21.15.161:0/2916909141 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52940746a0 con 0x7f5294153af0 2024-01-18T00:47:12.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.639+0000 7f528be00640 1 -- 172.21.15.161:0/2916909141 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f528c0c8020 con 0x7f5294153af0 2024-01-18T00:47:12.640 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-01-18T00:47:12.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.643+0000 7f529ac00640 1 -- 172.21.15.161:0/2916909141 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f526c066840 msgr2=0x7f526c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:12.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.643+0000 7f529ac00640 1 --2- 172.21.15.161:0/2916909141 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f526c066840 0x7f526c068d00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5284000f70 tx=0x7f5284007e90 comp rx=0 tx=0).stop 2024-01-18T00:47:12.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.643+0000 7f529ac00640 1 -- 172.21.15.161:0/2916909141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5294153af0 msgr2=0x7f529414c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:12.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.643+0000 7f529ac00640 1 --2- 172.21.15.161:0/2916909141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5294153af0 0x7f529414c4f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f528c01cd60 tx=0x7f528c01bed0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.643+0000 7f529ac00640 1 -- 172.21.15.161:0/2916909141 shutdown_connections 2024-01-18T00:47:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.643+0000 7f529ac00640 1 --2- 172.21.15.161:0/2916909141 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f526c066840 0x7f526c068d00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.643+0000 7f529ac00640 1 --2- 172.21.15.161:0/2916909141 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5294070090 0x7f5294158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.643+0000 7f529ac00640 1 --2- 172.21.15.161:0/2916909141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5294153af0 0x7f529414c4f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.643+0000 7f529ac00640 1 --2- 172.21.15.161:0/2916909141 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5294061500 0x7f52941e6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.643+0000 7f529ac00640 1 -- 172.21.15.161:0/2916909141 >> 172.21.15.161:0/2916909141 conn(0x7f52940c82d0 msgr2=0x7f52940719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.643+0000 7f529ac00640 1 -- 172.21.15.161:0/2916909141 shutdown_connections 2024-01-18T00:47:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.643+0000 7f529ac00640 1 -- 172.21.15.161:0/2916909141 wait complete. 2024-01-18T00:47:12.662 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-18T00:47:12.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.799+0000 7f8838a00640 1 Processor -- start 2024-01-18T00:47:12.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.803+0000 7f8838a00640 1 -- start start 2024-01-18T00:47:12.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.803+0000 7f8838a00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f88300c5a90 0x7f88300c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:12.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.803+0000 7f8838a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88301569b0 con 0x7f88300c1b90 2024-01-18T00:47:12.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.803+0000 7f8838a00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8830155da0 con 0x7f883014fe30 2024-01-18T00:47:12.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.803+0000 7f8838a00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88300c21d0 con 0x7f88300c5a90 2024-01-18T00:47:12.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.803+0000 7f8835600640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f88300c1b90 0x7f8830071e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55162/0 (socket says 172.21.15.161:55162) 2024-01-18T00:47:12.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.803+0000 7f8835600640 1 -- 172.21.15.161:0/2755142079 learned_addr learned my addr 172.21.15.161:0/2755142079 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-18T00:47:12.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.803+0000 7f8836a00640 1 --2- 172.21.15.161:0/2755142079 >> v2:172.21.15.190:3300/0 conn(0x7f88300c5a90 0x7f88300c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:12.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.807+0000 7f8834c00640 1 -- 172.21.15.161:0/2755142079 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671109684 0 0) 0x7f88301569b0 con 0x7f88300c1b90 2024-01-18T00:47:12.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.807+0000 7f8834c00640 1 -- 172.21.15.161:0/2755142079 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8810003530 con 0x7f88300c1b90 2024-01-18T00:47:12.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.811+0000 7f8834c00640 1 -- 172.21.15.161:0/2755142079 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2711059085 0 0) 0x7f8810003530 con 0x7f88300c1b90 2024-01-18T00:47:12.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.811+0000 7f8834c00640 1 -- 172.21.15.161:0/2755142079 >> v2:172.21.15.190:3300/0 conn(0x7f88300c5a90 msgr2=0x7f88300c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:12.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.811+0000 7f8834c00640 1 --2- 172.21.15.161:0/2755142079 >> v2:172.21.15.190:3300/0 conn(0x7f88300c5a90 0x7f88300c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.811+0000 7f8834c00640 1 -- 172.21.15.161:0/2755142079 >> v1:172.21.15.190:6789/0 conn(0x7f883014fe30 legacy=0x7f88300bffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:12.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.811+0000 7f8834c00640 1 -- 172.21.15.161:0/2755142079 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830156080 con 0x7f88300c1b90 2024-01-18T00:47:12.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.811+0000 7f8834c00640 1 -- 172.21.15.161:0/2755142079 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f8818001680 con 0x7f88300c1b90 2024-01-18T00:47:12.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.811+0000 7f8834c00640 1 -- 172.21.15.161:0/2755142079 >> v1:172.21.15.161:6789/0 conn(0x7f88300c1b90 legacy=0x7f8830071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:12.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.811+0000 7f8834c00640 1 --2- 172.21.15.161:0/2755142079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88100039d0 0x7f8810003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:12.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.811+0000 7f8834c00640 1 --2- 172.21.15.161:0/2755142079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88100047d0 0x7f8810004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:12.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.811+0000 7f8834c00640 1 --2- 172.21.15.161:0/2755142079 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8810005190 0x7f881000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:12.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.811+0000 7f8834c00640 1 -- 172.21.15.161:0/2755142079 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88300c21d0 con 0x7f88100047d0 2024-01-18T00:47:12.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.811+0000 7f8834c00640 1 -- 172.21.15.161:0/2755142079 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881000e280 con 0x7f88100039d0 2024-01-18T00:47:12.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.811+0000 7f8834c00640 1 -- 172.21.15.161:0/2755142079 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881000e440 con 0x7f8810005190 2024-01-18T00:47:12.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.811+0000 7f8836a00640 1 --2- 172.21.15.161:0/2755142079 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8810005190 0x7f881000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:12.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.811+0000 7f8835600640 1 --2- 172.21.15.161:0/2755142079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88100047d0 0x7f8810004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:12.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.815+0000 7f8835600640 1 -- 172.21.15.161:0/2755142079 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8810005190 msgr2=0x7f881000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:12.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.815+0000 7f8835600640 1 --2- 172.21.15.161:0/2755142079 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8810005190 0x7f881000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.815+0000 7f8835600640 1 -- 172.21.15.161:0/2755142079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88100039d0 msgr2=0x7f8810003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:12.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.815+0000 7f8835600640 1 --2- 172.21.15.161:0/2755142079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88100039d0 0x7f8810003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.815+0000 7f8835600640 1 -- 172.21.15.161:0/2755142079 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8810003530 con 0x7f88100047d0 2024-01-18T00:47:12.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.815+0000 7f8836a00640 1 -- 172.21.15.161:0/2755142079 reap_dead start 2024-01-18T00:47:12.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.819+0000 7f8835600640 1 --2- 172.21.15.161:0/2755142079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88100047d0 0x7f8810004c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f881800c0e0 tx=0x7f881801cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221ed19ba22bcfbf server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:12.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.823+0000 7f8834c00640 1 -- 172.21.15.161:0/2755142079 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8818005ae0 con 0x7f88100047d0 2024-01-18T00:47:12.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.823+0000 7f8834c00640 1 -- 172.21.15.161:0/2755142079 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8818005c40 con 0x7f88100047d0 2024-01-18T00:47:12.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.823+0000 7f8834c00640 1 -- 172.21.15.161:0/2755142079 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88180a5a20 con 0x7f88100047d0 2024-01-18T00:47:12.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.823+0000 7f8838a00640 1 -- 172.21.15.161:0/2755142079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88100047d0 msgr2=0x7f8810004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:12.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.823+0000 7f8838a00640 1 --2- 172.21.15.161:0/2755142079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88100047d0 0x7f8810004c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f881800c0e0 tx=0x7f881801cae0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.823+0000 7f8838a00640 1 -- 172.21.15.161:0/2755142079 shutdown_connections 2024-01-18T00:47:12.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.823+0000 7f8838a00640 1 --2- 172.21.15.161:0/2755142079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88100047d0 0x7f8810004c50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.823+0000 7f8838a00640 1 -- 172.21.15.161:0/2755142079 >> 172.21.15.161:0/2755142079 conn(0x7f88300c7a90 msgr2=0x7f88300c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:12.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.823+0000 7f8838a00640 1 -- 172.21.15.161:0/2755142079 shutdown_connections 2024-01-18T00:47:12.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.823+0000 7f8838a00640 1 -- 172.21.15.161:0/2755142079 wait complete. 2024-01-18T00:47:12.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.827+0000 7f8838a00640 1 Processor -- start 2024-01-18T00:47:12.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.827+0000 7f8838a00640 1 -- start start 2024-01-18T00:47:12.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.827+0000 7f8838a00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88100047d0 0x7f88301f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:12.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.827+0000 7f8838a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88301f27f0 0x7f883014d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:12.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.827+0000 7f8838a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f883014db80 0x7f88301dfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:12.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.827+0000 7f8838a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88300c1ff0 con 0x7f88301f27f0 2024-01-18T00:47:12.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.827+0000 7f8838a00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88301f0240 con 0x7f88100047d0 2024-01-18T00:47:12.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.827+0000 7f8838a00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88301f3730 con 0x7f883014db80 2024-01-18T00:47:12.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.827+0000 7f8835600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88301f27f0 0x7f883014d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:12.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.827+0000 7f8835600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88301f27f0 0x7f883014d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43556/0 (socket says 172.21.15.161:43556) 2024-01-18T00:47:12.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.827+0000 7f8835600640 1 -- 172.21.15.161:0/2590302366 learned_addr learned my addr 172.21.15.161:0/2590302366 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:12.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.831+0000 7f8836a00640 1 --2- 172.21.15.161:0/2590302366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f883014db80 0x7f88301dfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:12.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.831+0000 7f8836000640 1 --2- 172.21.15.161:0/2590302366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88100047d0 0x7f88301f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:12.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.831+0000 7f8835600640 1 -- 172.21.15.161:0/2590302366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f883014db80 msgr2=0x7f88301dfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:12.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.831+0000 7f8835600640 1 --2- 172.21.15.161:0/2590302366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f883014db80 0x7f88301dfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.831+0000 7f8835600640 1 -- 172.21.15.161:0/2590302366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88100047d0 msgr2=0x7f88301f31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:12.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.831+0000 7f8835600640 1 --2- 172.21.15.161:0/2590302366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88100047d0 0x7f88301f31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:12.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.831+0000 7f8835600640 1 -- 172.21.15.161:0/2590302366 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88301def70 con 0x7f88301f27f0 2024-01-18T00:47:12.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.835+0000 7f8835600640 1 --2- 172.21.15.161:0/2590302366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88301f27f0 0x7f883014d640 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f881800c0e0 tx=0x7f8810005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:12.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.843+0000 7f882e000640 1 -- 172.21.15.161:0/2590302366 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88180b4070 con 0x7f88301f27f0 2024-01-18T00:47:12.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.843+0000 7f882e000640 1 -- 172.21.15.161:0/2590302366 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88180a57e0 con 0x7f88301f27f0 2024-01-18T00:47:12.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.843+0000 7f882e000640 1 -- 172.21.15.161:0/2590302366 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88180a5b90 con 0x7f88301f27f0 2024-01-18T00:47:12.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.843+0000 7f8838a00640 1 -- 172.21.15.161:0/2590302366 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88301ef6c0 con 0x7f88301f27f0 2024-01-18T00:47:12.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.843+0000 7f8838a00640 1 -- 172.21.15.161:0/2590302366 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88301efc80 con 0x7f88301f27f0 2024-01-18T00:47:12.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:12.843+0000 7f8838a00640 1 -- 172.21.15.161:0/2590302366 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88300746a0 con 0x7f88301f27f0 2024-01-18T00:47:13.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.087+0000 7f882e000640 1 -- 172.21.15.161:0/2590302366 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f88180b7070 con 0x7f88301f27f0 2024-01-18T00:47:13.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.087+0000 7f882e000640 1 --2- 172.21.15.161:0/2590302366 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8808066890 0x7f8808068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:13.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.087+0000 7f8836000640 1 --2- 172.21.15.161:0/2590302366 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8808066890 0x7f8808068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:13.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.087+0000 7f8836000640 1 --2- 172.21.15.161:0/2590302366 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8808066890 0x7f8808068d50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f88280016e0 tx=0x7f8828009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:13.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.099+0000 7f882e000640 1 -- 172.21.15.161:0/2590302366 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f88180eed70 con 0x7f88301f27f0 2024-01-18T00:47:13.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.099+0000 7f882e000640 1 -- 172.21.15.161:0/2590302366 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f88180eb0b0 con 0x7f88301f27f0 2024-01-18T00:47:13.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.255+0000 7f8838a00640 1 -- 172.21.15.161:0/2590302366 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f88301e4930 con 0x7f88301f27f0 2024-01-18T00:47:13.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.295+0000 7f882e000640 1 -- 172.21.15.161:0/2590302366 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f88180ee6d0 con 0x7f88301f27f0 2024-01-18T00:47:13.295 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-01-18T00:47:13.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.295+0000 7f8838a00640 1 -- 172.21.15.161:0/2590302366 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8808066890 msgr2=0x7f8808068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:13.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.295+0000 7f8838a00640 1 --2- 172.21.15.161:0/2590302366 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8808066890 0x7f8808068d50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f88280016e0 tx=0x7f8828009040 comp rx=0 tx=0).stop 2024-01-18T00:47:13.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.295+0000 7f8838a00640 1 -- 172.21.15.161:0/2590302366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88301f27f0 msgr2=0x7f883014d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:13.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.295+0000 7f8838a00640 1 --2- 172.21.15.161:0/2590302366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88301f27f0 0x7f883014d640 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f881800c0e0 tx=0x7f8810005800 comp rx=0 tx=0).stop 2024-01-18T00:47:13.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.295+0000 7f8838a00640 1 -- 172.21.15.161:0/2590302366 shutdown_connections 2024-01-18T00:47:13.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.295+0000 7f8838a00640 1 --2- 172.21.15.161:0/2590302366 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8808066890 0x7f8808068d50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:13.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.295+0000 7f8838a00640 1 --2- 172.21.15.161:0/2590302366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f883014db80 0x7f88301dfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:13.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.295+0000 7f8838a00640 1 --2- 172.21.15.161:0/2590302366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88301f27f0 0x7f883014d640 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:13.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.295+0000 7f8838a00640 1 --2- 172.21.15.161:0/2590302366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88100047d0 0x7f88301f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:13.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.295+0000 7f8838a00640 1 -- 172.21.15.161:0/2590302366 >> 172.21.15.161:0/2590302366 conn(0x7f88300c7a90 msgr2=0x7f8830071060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:13.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.295+0000 7f8838a00640 1 -- 172.21.15.161:0/2590302366 shutdown_connections 2024-01-18T00:47:13.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.295+0000 7f8838a00640 1 -- 172.21.15.161:0/2590302366 wait complete. 2024-01-18T00:47:13.317 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-18T00:47:13.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.459+0000 7fb093000640 1 Processor -- start 2024-01-18T00:47:13.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.459+0000 7fb093000640 1 -- start start 2024-01-18T00:47:13.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.459+0000 7fb093000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb08c15a3a0 0x7fb08c157360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:13.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.459+0000 7fb093000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb08c0c2970 0x7fb08c0cd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:13.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.459+0000 7fb093000640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c151890 con 0x7fb08c0cd570 2024-01-18T00:47:13.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.459+0000 7fb093000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08c15a780 con 0x7fb08c15a3a0 2024-01-18T00:47:13.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.459+0000 7fb093000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c158ba0 con 0x7fb08c0c2970 2024-01-18T00:47:13.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.459+0000 7fb08be00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb08c15a3a0 0x7fb08c157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:13.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.463+0000 7fb08be00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb08c15a3a0 0x7fb08c157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43558/0 (socket says 172.21.15.161:43558) 2024-01-18T00:47:13.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.463+0000 7fb08be00640 1 -- 172.21.15.161:0/1563211207 learned_addr learned my addr 172.21.15.161:0/1563211207 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:13.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.463+0000 7fb08b400640 1 --2- 172.21.15.161:0/1563211207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb08c0c2970 0x7fb08c0cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:13.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.463+0000 7fb08be00640 1 -- 172.21.15.161:0/1563211207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb08c0c2970 msgr2=0x7fb08c0cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:13.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.463+0000 7fb08be00640 1 --2- 172.21.15.161:0/1563211207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb08c0c2970 0x7fb08c0cd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:13.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.463+0000 7fb08be00640 1 -- 172.21.15.161:0/1563211207 >> v1:172.21.15.190:6789/0 conn(0x7fb08c0cd570 legacy=0x7fb08c159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:13.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.463+0000 7fb08be00640 1 -- 172.21.15.161:0/1563211207 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c158850 con 0x7fb08c15a3a0 2024-01-18T00:47:13.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.467+0000 7fb08be00640 1 --2- 172.21.15.161:0/1563211207 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb08c15a3a0 0x7fb08c157360 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009870 tx=0x7fb07c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02297ac5da08359 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:13.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.471+0000 7fb08aa00640 1 -- 172.21.15.161:0/1563211207 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0a8a30 con 0x7fb08c15a3a0 2024-01-18T00:47:13.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.471+0000 7fb08aa00640 1 -- 172.21.15.161:0/1563211207 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c0a8b90 con 0x7fb08c15a3a0 2024-01-18T00:47:13.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.471+0000 7fb08aa00640 1 -- 172.21.15.161:0/1563211207 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0b0440 con 0x7fb08c15a3a0 2024-01-18T00:47:13.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.471+0000 7fb093000640 1 -- 172.21.15.161:0/1563211207 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb08c15a3a0 msgr2=0x7fb08c157360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:13.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.471+0000 7fb093000640 1 --2- 172.21.15.161:0/1563211207 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb08c15a3a0 0x7fb08c157360 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009870 tx=0x7fb07c01ed30 comp rx=0 tx=0).stop 2024-01-18T00:47:13.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.475+0000 7fb093000640 1 -- 172.21.15.161:0/1563211207 shutdown_connections 2024-01-18T00:47:13.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.475+0000 7fb093000640 1 --2- 172.21.15.161:0/1563211207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb08c0c2970 0x7fb08c0cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:13.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.475+0000 7fb093000640 1 --2- 172.21.15.161:0/1563211207 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb08c15a3a0 0x7fb08c157360 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:13.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.475+0000 7fb093000640 1 -- 172.21.15.161:0/1563211207 >> 172.21.15.161:0/1563211207 conn(0x7fb08c061100 msgr2=0x7fb08c061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:13.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.475+0000 7fb093000640 1 -- 172.21.15.161:0/1563211207 shutdown_connections 2024-01-18T00:47:13.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.475+0000 7fb093000640 1 -- 172.21.15.161:0/1563211207 wait complete. 2024-01-18T00:47:13.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.475+0000 7fb093000640 1 Processor -- start 2024-01-18T00:47:13.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.475+0000 7fb093000640 1 -- start start 2024-01-18T00:47:13.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.475+0000 7fb093000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb08c0c2970 0x7fb08c156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:13.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.475+0000 7fb093000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb08c0cd570 0x7fb08c14a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:13.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.475+0000 7fb093000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb08c15a3a0 0x7fb08c14a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:13.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.475+0000 7fb093000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c157530 con 0x7fb08c0c2970 2024-01-18T00:47:13.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.475+0000 7fb093000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c155920 con 0x7fb08c15a3a0 2024-01-18T00:47:13.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.475+0000 7fb093000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c155ee0 con 0x7fb08c0cd570 2024-01-18T00:47:13.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.479+0000 7fb08b400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb08c0cd570 0x7fb08c14a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:13.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.479+0000 7fb08b400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb08c0cd570 0x7fb08c14a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:40686/0 (socket says 172.21.15.161:40686) 2024-01-18T00:47:13.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.479+0000 7fb08b400640 1 -- 172.21.15.161:0/3129540419 learned_addr learned my addr 172.21.15.161:0/3129540419 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:13.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.479+0000 7fb08be00640 1 --2- 172.21.15.161:0/3129540419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb08c0c2970 0x7fb08c156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:13.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.479+0000 7fb091000640 1 --2- 172.21.15.161:0/3129540419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb08c15a3a0 0x7fb08c14a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:13.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.483+0000 7fb08be00640 1 -- 172.21.15.161:0/3129540419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb08c0cd570 msgr2=0x7fb08c14a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:13.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.483+0000 7fb08be00640 1 --2- 172.21.15.161:0/3129540419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb08c0cd570 0x7fb08c14a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:13.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.483+0000 7fb08be00640 1 -- 172.21.15.161:0/3129540419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb08c15a3a0 msgr2=0x7fb08c14a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:13.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.483+0000 7fb08be00640 1 --2- 172.21.15.161:0/3129540419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb08c15a3a0 0x7fb08c14a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:13.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.483+0000 7fb08be00640 1 -- 172.21.15.161:0/3129540419 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c0094d0 con 0x7fb08c0c2970 2024-01-18T00:47:13.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.487+0000 7fb08be00640 1 --2- 172.21.15.161:0/3129540419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb08c0c2970 0x7fb08c156370 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0af000 tx=0x7fb07c01bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:13.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.491+0000 7fb083e00640 1 -- 172.21.15.161:0/3129540419 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0be070 con 0x7fb08c0c2970 2024-01-18T00:47:13.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.491+0000 7fb083e00640 1 -- 172.21.15.161:0/3129540419 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c0b1c10 con 0x7fb08c0c2970 2024-01-18T00:47:13.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.491+0000 7fb093000640 1 -- 172.21.15.161:0/3129540419 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c14aec0 con 0x7fb08c0c2970 2024-01-18T00:47:13.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.491+0000 7fb083e00640 1 -- 172.21.15.161:0/3129540419 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0b9440 con 0x7fb08c0c2970 2024-01-18T00:47:13.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.491+0000 7fb093000640 1 -- 172.21.15.161:0/3129540419 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c157780 con 0x7fb08c0c2970 2024-01-18T00:47:13.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.491+0000 7fb093000640 1 -- 172.21.15.161:0/3129540419 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c0746a0 con 0x7fb08c0c2970 2024-01-18T00:47:13.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.515+0000 7fb083e00640 1 -- 172.21.15.161:0/3129540419 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fb07c0b7070 con 0x7fb08c0c2970 2024-01-18T00:47:13.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.515+0000 7fb083e00640 1 --2- 172.21.15.161:0/3129540419 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb064066890 0x7fb064068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:13.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.515+0000 7fb08b400640 1 --2- 172.21.15.161:0/3129540419 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb064066890 0x7fb064068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:13.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.515+0000 7fb08b400640 1 --2- 172.21.15.161:0/3129540419 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb064066890 0x7fb064068d50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb08c1574c0 tx=0x7fb074008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:13.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.751+0000 7fb083e00640 1 -- 172.21.15.161:0/3129540419 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fb07c0f2ba0 con 0x7fb08c0c2970 2024-01-18T00:47:13.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.751+0000 7fb083e00640 1 -- 172.21.15.161:0/3129540419 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fb07c0eeee0 con 0x7fb08c0c2970 2024-01-18T00:47:13.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.903+0000 7fb093000640 1 -- 172.21.15.161:0/3129540419 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb08c0b0360 con 0x7fb08c0c2970 2024-01-18T00:47:13.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.907+0000 7fb083e00640 1 -- 172.21.15.161:0/3129540419 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb07c0b5020 con 0x7fb08c0c2970 2024-01-18T00:47:13.908 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2024-01-18T00:47:13.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.911+0000 7fb093000640 1 -- 172.21.15.161:0/3129540419 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb064066890 msgr2=0x7fb064068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:13.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.911+0000 7fb093000640 1 --2- 172.21.15.161:0/3129540419 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb064066890 0x7fb064068d50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb08c1574c0 tx=0x7fb074008040 comp rx=0 tx=0).stop 2024-01-18T00:47:13.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.911+0000 7fb093000640 1 -- 172.21.15.161:0/3129540419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb08c0c2970 msgr2=0x7fb08c156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:13.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.911+0000 7fb093000640 1 --2- 172.21.15.161:0/3129540419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb08c0c2970 0x7fb08c156370 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0af000 tx=0x7fb07c01bad0 comp rx=0 tx=0).stop 2024-01-18T00:47:13.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.911+0000 7fb093000640 1 -- 172.21.15.161:0/3129540419 shutdown_connections 2024-01-18T00:47:13.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.911+0000 7fb093000640 1 --2- 172.21.15.161:0/3129540419 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb064066890 0x7fb064068d50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:13.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.911+0000 7fb093000640 1 --2- 172.21.15.161:0/3129540419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb08c15a3a0 0x7fb08c14a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:13.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.911+0000 7fb093000640 1 --2- 172.21.15.161:0/3129540419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb08c0cd570 0x7fb08c14a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:13.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.911+0000 7fb093000640 1 --2- 172.21.15.161:0/3129540419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb08c0c2970 0x7fb08c156370 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:13.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.911+0000 7fb093000640 1 -- 172.21.15.161:0/3129540419 >> 172.21.15.161:0/3129540419 conn(0x7fb08c061100 msgr2=0x7fb08c0b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:13.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.911+0000 7fb093000640 1 -- 172.21.15.161:0/3129540419 shutdown_connections 2024-01-18T00:47:13.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:13.911+0000 7fb093000640 1 -- 172.21.15.161:0/3129540419 wait complete. 2024-01-18T00:47:13.931 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-18T00:47:14.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.071+0000 7fbc14800640 1 Processor -- start 2024-01-18T00:47:14.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.071+0000 7fbc14800640 1 -- start start 2024-01-18T00:47:14.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.071+0000 7fbc14800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc0c1516c0 0x7fbc0c06db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:14.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.071+0000 7fbc14800640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbc0c0c6e90 0x7fbc0c0b0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:14.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.071+0000 7fbc14800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc0c0c5cc0 con 0x7fbc0c06e090 2024-01-18T00:47:14.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.071+0000 7fbc14800640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0c158410 con 0x7fbc0c0c6e90 2024-01-18T00:47:14.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.071+0000 7fbc14800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c1573c0 con 0x7fbc0c1516c0 2024-01-18T00:47:14.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.071+0000 7fbc11400640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fbc0c06e090 0x7fbc0c0c6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55166/0 (socket says 172.21.15.161:55166) 2024-01-18T00:47:14.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.071+0000 7fbc11400640 1 -- 172.21.15.161:0/828417937 learned_addr learned my addr 172.21.15.161:0/828417937 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-18T00:47:14.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.071+0000 7fbc11e00640 1 --2- 172.21.15.161:0/828417937 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc0c1516c0 0x7fbc0c06db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:14.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.071+0000 7fbc12800640 1 --2- 172.21.15.161:0/828417937 >> v2:172.21.15.190:3300/0 conn(0x7fbc0c0c6e90 0x7fbc0c0b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:14.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.075+0000 7fbc10a00640 1 -- 172.21.15.161:0/828417937 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511537600 0 0) 0x7fbc0c0c5cc0 con 0x7fbc0c06e090 2024-01-18T00:47:14.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.075+0000 7fbc10a00640 1 -- 172.21.15.161:0/828417937 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbec003530 con 0x7fbc0c06e090 2024-01-18T00:47:14.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.079+0000 7fbc10a00640 1 -- 172.21.15.161:0/828417937 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1680807162 0 0) 0x7fbbec003530 con 0x7fbc0c06e090 2024-01-18T00:47:14.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.079+0000 7fbc10a00640 1 -- 172.21.15.161:0/828417937 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc0c1516c0 msgr2=0x7fbc0c06db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:14.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.079+0000 7fbc10a00640 1 --2- 172.21.15.161:0/828417937 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc0c1516c0 0x7fbc0c06db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:14.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.079+0000 7fbc10a00640 1 -- 172.21.15.161:0/828417937 >> v2:172.21.15.190:3300/0 conn(0x7fbc0c0c6e90 msgr2=0x7fbc0c0b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:14.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.079+0000 7fbc10a00640 1 --2- 172.21.15.161:0/828417937 >> v2:172.21.15.190:3300/0 conn(0x7fbc0c0c6e90 0x7fbc0c0b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:14.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.079+0000 7fbc10a00640 1 -- 172.21.15.161:0/828417937 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0c1575b0 con 0x7fbc0c06e090 2024-01-18T00:47:14.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.079+0000 7fbc10a00640 1 -- 172.21.15.161:0/828417937 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7fbbf4001680 con 0x7fbc0c06e090 2024-01-18T00:47:14.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.079+0000 7fbc10a00640 1 -- 172.21.15.161:0/828417937 >> v1:172.21.15.161:6789/0 conn(0x7fbc0c06e090 legacy=0x7fbc0c0c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:14.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.079+0000 7fbc10a00640 1 --2- 172.21.15.161:0/828417937 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc0c1516c0 0x7fbbec003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:14.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.079+0000 7fbc10a00640 1 --2- 172.21.15.161:0/828417937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbec003f50 0x7fbbec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:14.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.079+0000 7fbc10a00640 1 --2- 172.21.15.161:0/828417937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbec004d10 0x7fbbec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:14.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.079+0000 7fbc10a00640 1 -- 172.21.15.161:0/828417937 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c158410 con 0x7fbbec003f50 2024-01-18T00:47:14.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.079+0000 7fbc10a00640 1 -- 172.21.15.161:0/828417937 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec00b990 con 0x7fbbec004d10 2024-01-18T00:47:14.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.079+0000 7fbc10a00640 1 -- 172.21.15.161:0/828417937 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec00bb50 con 0x7fbc0c1516c0 2024-01-18T00:47:14.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.083+0000 7fbc11400640 1 --2- 172.21.15.161:0/828417937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbec003f50 0x7fbbec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:14.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.083+0000 7fbc11400640 1 -- 172.21.15.161:0/828417937 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc0c1516c0 msgr2=0x7fbbec003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:14.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.083+0000 7fbc11400640 1 --2- 172.21.15.161:0/828417937 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc0c1516c0 0x7fbbec003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:14.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.083+0000 7fbc11400640 1 -- 172.21.15.161:0/828417937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbec004d10 msgr2=0x7fbbec005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:14.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.083+0000 7fbc11400640 1 --2- 172.21.15.161:0/828417937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbec004d10 0x7fbbec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:14.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.083+0000 7fbc11400640 1 -- 172.21.15.161:0/828417937 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec003530 con 0x7fbbec003f50 2024-01-18T00:47:14.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.087+0000 7fbc11400640 1 --2- 172.21.15.161:0/828417937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbec003f50 0x7fbbec0047d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400c0e0 tx=0x7fbbf401cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b26860dcfbcaa05 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:14.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.091+0000 7fbc10a00640 1 -- 172.21.15.161:0/828417937 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40058e0 con 0x7fbbec003f50 2024-01-18T00:47:14.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.091+0000 7fbc10a00640 1 -- 172.21.15.161:0/828417937 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf4005a40 con 0x7fbbec003f50 2024-01-18T00:47:14.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.091+0000 7fbc10a00640 1 -- 172.21.15.161:0/828417937 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4005e30 con 0x7fbbec003f50 2024-01-18T00:47:14.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.095+0000 7fbc14800640 1 -- 172.21.15.161:0/828417937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbec003f50 msgr2=0x7fbbec0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:14.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.095+0000 7fbc14800640 1 --2- 172.21.15.161:0/828417937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbec003f50 0x7fbbec0047d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400c0e0 tx=0x7fbbf401cb60 comp rx=0 tx=0).stop 2024-01-18T00:47:14.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.095+0000 7fbc12800640 1 -- 172.21.15.161:0/828417937 reap_dead start 2024-01-18T00:47:14.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.095+0000 7fbc14800640 1 -- 172.21.15.161:0/828417937 shutdown_connections 2024-01-18T00:47:14.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.095+0000 7fbc14800640 1 -- 172.21.15.161:0/828417937 >> 172.21.15.161:0/828417937 conn(0x7fbc0c0c7a90 msgr2=0x7fbc0c0c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:14.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.095+0000 7fbc14800640 1 -- 172.21.15.161:0/828417937 shutdown_connections 2024-01-18T00:47:14.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.095+0000 7fbc14800640 1 -- 172.21.15.161:0/828417937 wait complete. 2024-01-18T00:47:14.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.095+0000 7fbc14800640 1 Processor -- start 2024-01-18T00:47:14.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.095+0000 7fbc14800640 1 -- start start 2024-01-18T00:47:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.095+0000 7fbc14800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbec003f50 0x7fbc0c152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.095+0000 7fbc14800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc0c1491f0 0x7fbc0c14cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.095+0000 7fbc14800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc0c147890 0x7fbc0c147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.095+0000 7fbc14800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c152cb0 con 0x7fbc0c1491f0 2024-01-18T00:47:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.095+0000 7fbc14800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c1edae0 con 0x7fbbec003f50 2024-01-18T00:47:14.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.095+0000 7fbc14800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c1ecf60 con 0x7fbc0c147890 2024-01-18T00:47:14.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.095+0000 7fbc11400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc0c1491f0 0x7fbc0c14cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:14.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.099+0000 7fbc11400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc0c1491f0 0x7fbc0c14cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43586/0 (socket says 172.21.15.161:43586) 2024-01-18T00:47:14.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.099+0000 7fbc11400640 1 -- 172.21.15.161:0/3480115857 learned_addr learned my addr 172.21.15.161:0/3480115857 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:14.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.099+0000 7fbc12800640 1 --2- 172.21.15.161:0/3480115857 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc0c147890 0x7fbc0c147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:14.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.099+0000 7fbc11e00640 1 --2- 172.21.15.161:0/3480115857 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbec003f50 0x7fbc0c152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:14.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.103+0000 7fbc11400640 1 -- 172.21.15.161:0/3480115857 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc0c147890 msgr2=0x7fbc0c147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:14.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.103+0000 7fbc11400640 1 --2- 172.21.15.161:0/3480115857 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc0c147890 0x7fbc0c147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:14.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.103+0000 7fbc11400640 1 -- 172.21.15.161:0/3480115857 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbec003f50 msgr2=0x7fbc0c152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:14.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.103+0000 7fbc11400640 1 --2- 172.21.15.161:0/3480115857 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbec003f50 0x7fbc0c152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:14.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.103+0000 7fbc11400640 1 -- 172.21.15.161:0/3480115857 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0c1ed240 con 0x7fbc0c1491f0 2024-01-18T00:47:14.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.107+0000 7fbc11400640 1 --2- 172.21.15.161:0/3480115857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc0c1491f0 0x7fbc0c14cd50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbbf401c990 tx=0x7fbbec005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:14.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.111+0000 7fbc0a000640 1 -- 172.21.15.161:0/3480115857 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40a6b00 con 0x7fbc0c1491f0 2024-01-18T00:47:14.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.111+0000 7fbc0a000640 1 -- 172.21.15.161:0/3480115857 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf40a6c80 con 0x7fbc0c1491f0 2024-01-18T00:47:14.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.111+0000 7fbc0a000640 1 -- 172.21.15.161:0/3480115857 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40047f0 con 0x7fbc0c1491f0 2024-01-18T00:47:14.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.111+0000 7fbc14800640 1 -- 172.21.15.161:0/3480115857 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc0c1ed520 con 0x7fbc0c1491f0 2024-01-18T00:47:14.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.111+0000 7fbc14800640 1 -- 172.21.15.161:0/3480115857 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc0c1f0230 con 0x7fbc0c1491f0 2024-01-18T00:47:14.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.111+0000 7fbc14800640 1 -- 172.21.15.161:0/3480115857 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc0c0c8420 con 0x7fbc0c1491f0 2024-01-18T00:47:14.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.131+0000 7fbc0a000640 1 -- 172.21.15.161:0/3480115857 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fbbf4004950 con 0x7fbc0c1491f0 2024-01-18T00:47:14.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.131+0000 7fbc0a000640 1 --2- 172.21.15.161:0/3480115857 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fbbe40668c0 0x7fbbe4068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:14.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.131+0000 7fbc11e00640 1 --2- 172.21.15.161:0/3480115857 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fbbe40668c0 0x7fbbe4068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:14.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.131+0000 7fbc11e00640 1 --2- 172.21.15.161:0/3480115857 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fbbe40668c0 0x7fbbe4068d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc009a80 tx=0x7fbbfc0094c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:14.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.363+0000 7fbc0a000640 1 -- 172.21.15.161:0/3480115857 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fbbf40ef5e0 con 0x7fbc0c1491f0 2024-01-18T00:47:14.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.363+0000 7fbc0a000640 1 -- 172.21.15.161:0/3480115857 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fbbf40eb220 con 0x7fbc0c1491f0 2024-01-18T00:47:14.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.539+0000 7fbc14800640 1 -- 172.21.15.161:0/3480115857 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbc0c0746a0 con 0x7fbc0c1491f0 2024-01-18T00:47:14.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.543+0000 7fbc0a000640 1 -- 172.21.15.161:0/3480115857 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbbf40bc0a0 con 0x7fbc0c1491f0 2024-01-18T00:47:14.543 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-01-18T00:47:14.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.543+0000 7fbc14800640 1 -- 172.21.15.161:0/3480115857 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fbbe40668c0 msgr2=0x7fbbe4068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:14.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.543+0000 7fbc14800640 1 --2- 172.21.15.161:0/3480115857 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fbbe40668c0 0x7fbbe4068d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc009a80 tx=0x7fbbfc0094c0 comp rx=0 tx=0).stop 2024-01-18T00:47:14.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.543+0000 7fbc14800640 1 -- 172.21.15.161:0/3480115857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc0c1491f0 msgr2=0x7fbc0c14cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:14.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.543+0000 7fbc14800640 1 --2- 172.21.15.161:0/3480115857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc0c1491f0 0x7fbc0c14cd50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbbf401c990 tx=0x7fbbec005800 comp rx=0 tx=0).stop 2024-01-18T00:47:14.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.547+0000 7fbc14800640 1 -- 172.21.15.161:0/3480115857 shutdown_connections 2024-01-18T00:47:14.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.547+0000 7fbc14800640 1 --2- 172.21.15.161:0/3480115857 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fbbe40668c0 0x7fbbe4068d80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:14.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.547+0000 7fbc14800640 1 --2- 172.21.15.161:0/3480115857 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc0c147890 0x7fbc0c147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:14.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.547+0000 7fbc14800640 1 --2- 172.21.15.161:0/3480115857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc0c1491f0 0x7fbc0c14cd50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:14.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.547+0000 7fbc14800640 1 --2- 172.21.15.161:0/3480115857 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbec003f50 0x7fbc0c152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:14.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.547+0000 7fbc14800640 1 -- 172.21.15.161:0/3480115857 >> 172.21.15.161:0/3480115857 conn(0x7fbc0c0c7a90 msgr2=0x7fbc0c06e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:14.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.547+0000 7fbc14800640 1 -- 172.21.15.161:0/3480115857 shutdown_connections 2024-01-18T00:47:14.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.547+0000 7fbc14800640 1 -- 172.21.15.161:0/3480115857 wait complete. 2024-01-18T00:47:14.567 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-18T00:47:14.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.707+0000 7f05f3e00640 1 Processor -- start 2024-01-18T00:47:14.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.707+0000 7f05f3e00640 1 -- start start 2024-01-18T00:47:14.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.707+0000 7f05f3e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f05ec0c79c0 0x7f05ec061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:14.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.707+0000 7f05f3e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05ec061640 0x7f05ec15d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:14.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.707+0000 7f05f3e00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ec0c9890 con 0x7f05ec1539a0 2024-01-18T00:47:14.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.707+0000 7f05f3e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ec06d570 con 0x7f05ec0c79c0 2024-01-18T00:47:14.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.707+0000 7f05f3e00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec159bf0 con 0x7f05ec061640 2024-01-18T00:47:14.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.707+0000 7f05f1e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05ec061640 0x7f05ec15d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:14.710 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.711+0000 7f05f1400640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f05ec1539a0 0x7f05ec0ca410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.161:36256/0 (socket says 172.21.15.161:36256) 2024-01-18T00:47:14.710 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.711+0000 7f05f1400640 1 -- 172.21.15.161:0/4035582274 learned_addr learned my addr 172.21.15.161:0/4035582274 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-18T00:47:14.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.715+0000 7f05f1e00640 1 -- 172.21.15.161:0/4035582274 >> v2:172.21.15.161:3300/0 conn(0x7f05ec0c79c0 msgr2=0x7f05ec061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:14.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.715+0000 7f05f1e00640 1 --2- 172.21.15.161:0/4035582274 >> v2:172.21.15.161:3300/0 conn(0x7f05ec0c79c0 0x7f05ec061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:14.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.715+0000 7f05f1e00640 1 -- 172.21.15.161:0/4035582274 >> v1:172.21.15.190:6789/0 conn(0x7f05ec1539a0 legacy=0x7f05ec0ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:14.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.715+0000 7f05f1e00640 1 -- 172.21.15.161:0/4035582274 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec159eb0 con 0x7f05ec061640 2024-01-18T00:47:14.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.723+0000 7f05f1e00640 1 --2- 172.21.15.161:0/4035582274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05ec061640 0x7f05ec15d3f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f05e4009d90 tx=0x7f05e401c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=702e5f72a840e9e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:14.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.731+0000 7f05ebe00640 1 -- 172.21.15.161:0/4035582274 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e40a5980 con 0x7f05ec061640 2024-01-18T00:47:14.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.731+0000 7f05ebe00640 1 -- 172.21.15.161:0/4035582274 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e40a5ae0 con 0x7f05ec061640 2024-01-18T00:47:14.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.731+0000 7f05ebe00640 1 -- 172.21.15.161:0/4035582274 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e40a5e70 con 0x7f05ec061640 2024-01-18T00:47:14.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.735+0000 7f05f3e00640 1 -- 172.21.15.161:0/4035582274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05ec061640 msgr2=0x7f05ec15d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:14.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.735+0000 7f05f3e00640 1 --2- 172.21.15.161:0/4035582274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05ec061640 0x7f05ec15d3f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f05e4009d90 tx=0x7f05e401c8c0 comp rx=0 tx=0).stop 2024-01-18T00:47:14.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.735+0000 7f05f3e00640 1 -- 172.21.15.161:0/4035582274 shutdown_connections 2024-01-18T00:47:14.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.735+0000 7f05f3e00640 1 --2- 172.21.15.161:0/4035582274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05ec061640 0x7f05ec15d3f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:14.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.735+0000 7f05f3e00640 1 --2- 172.21.15.161:0/4035582274 >> v2:172.21.15.161:3300/0 conn(0x7f05ec0c79c0 0x7f05ec061100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:14.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.735+0000 7f05f3e00640 1 -- 172.21.15.161:0/4035582274 >> 172.21.15.161:0/4035582274 conn(0x7f05ec06ad40 msgr2=0x7f05ec06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:14.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.735+0000 7f05f3e00640 1 -- 172.21.15.161:0/4035582274 shutdown_connections 2024-01-18T00:47:14.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.735+0000 7f05f3e00640 1 -- 172.21.15.161:0/4035582274 wait complete. 2024-01-18T00:47:14.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.735+0000 7f05f3e00640 1 Processor -- start 2024-01-18T00:47:14.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.735+0000 7f05f3e00640 1 -- start start 2024-01-18T00:47:14.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.735+0000 7f05f3e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05ec061640 0x7f05ec0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:14.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.735+0000 7f05f3e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05ec0c79c0 0x7f05ec1eb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:14.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.735+0000 7f05f3e00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05ec1539a0 0x7f05ec15c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:14.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.735+0000 7f05f3e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec149730 con 0x7f05ec061640 2024-01-18T00:47:14.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.735+0000 7f05f3e00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec0ccc40 con 0x7f05ec1539a0 2024-01-18T00:47:14.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.735+0000 7f05f3e00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec1f5690 con 0x7f05ec0c79c0 2024-01-18T00:47:14.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.739+0000 7f05f1e00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05ec1539a0 0x7f05ec15c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:14.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.739+0000 7f05f1e00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05ec1539a0 0x7f05ec15c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:39382/0 (socket says 172.21.15.161:39382) 2024-01-18T00:47:14.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.739+0000 7f05f1e00640 1 -- 172.21.15.161:0/645640343 learned_addr learned my addr 172.21.15.161:0/645640343 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:14.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.739+0000 7f05f1400640 1 --2- 172.21.15.161:0/645640343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05ec061640 0x7f05ec0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:14.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.747+0000 7f05f0a00640 1 --2- 172.21.15.161:0/645640343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05ec0c79c0 0x7f05ec1eb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:14.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.747+0000 7f05f1400640 1 -- 172.21.15.161:0/645640343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05ec0c79c0 msgr2=0x7f05ec1eb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:14.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.747+0000 7f05f1400640 1 --2- 172.21.15.161:0/645640343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05ec0c79c0 0x7f05ec1eb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:14.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.747+0000 7f05f1400640 1 -- 172.21.15.161:0/645640343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05ec1539a0 msgr2=0x7f05ec15c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:14.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.747+0000 7f05f1400640 1 --2- 172.21.15.161:0/645640343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05ec1539a0 0x7f05ec15c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:14.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.747+0000 7f05f1400640 1 -- 172.21.15.161:0/645640343 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e4009a70 con 0x7f05ec061640 2024-01-18T00:47:14.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.747+0000 7f05f1400640 1 --2- 172.21.15.161:0/645640343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05ec061640 0x7f05ec0ccf00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00c390 tx=0x7f05dc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:14.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.751+0000 7f05e9600640 1 -- 172.21.15.161:0/645640343 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc005cf0 con 0x7f05ec061640 2024-01-18T00:47:14.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.751+0000 7f05e9600640 1 -- 172.21.15.161:0/645640343 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05dc005e50 con 0x7f05ec061640 2024-01-18T00:47:14.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.751+0000 7f05e9600640 1 -- 172.21.15.161:0/645640343 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc007310 con 0x7f05ec061640 2024-01-18T00:47:14.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.751+0000 7f05f3e00640 1 -- 172.21.15.161:0/645640343 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ec0cd560 con 0x7f05ec061640 2024-01-18T00:47:14.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.751+0000 7f05f3e00640 1 -- 172.21.15.161:0/645640343 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ec1f5c10 con 0x7f05ec061640 2024-01-18T00:47:14.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.755+0000 7f05f3e00640 1 -- 172.21.15.161:0/645640343 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ec0746a0 con 0x7f05ec061640 2024-01-18T00:47:14.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.771+0000 7f05e9600640 1 -- 172.21.15.161:0/645640343 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f05dc007470 con 0x7f05ec061640 2024-01-18T00:47:14.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.775+0000 7f05e9600640 1 --2- 172.21.15.161:0/645640343 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f05c4066840 0x7f05c4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:14.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.775+0000 7f05f0a00640 1 --2- 172.21.15.161:0/645640343 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f05c4066840 0x7f05c4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:14.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.775+0000 7f05f0a00640 1 --2- 172.21.15.161:0/645640343 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f05c4066840 0x7f05c4068d00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f05ec15cea0 tx=0x7f05d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:14.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:14.775+0000 7f05e9600640 1 -- 172.21.15.161:0/645640343 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f05dc007720 con 0x7f05ec061640 2024-01-18T00:47:15.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:15.003+0000 7f05e9600640 1 -- 172.21.15.161:0/645640343 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f05dc050d70 con 0x7f05ec061640 2024-01-18T00:47:15.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:15.167+0000 7f05f3e00640 1 -- 172.21.15.161:0/645640343 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f05ec14cc20 con 0x7f05ec061640 2024-01-18T00:47:15.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:15.175+0000 7f05e9600640 1 -- 172.21.15.161:0/645640343 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f05dc017020 con 0x7f05ec061640 2024-01-18T00:47:15.174 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2024-01-18T00:47:15.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:15.175+0000 7f05f3e00640 1 -- 172.21.15.161:0/645640343 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f05c4066840 msgr2=0x7f05c4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:15.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:15.175+0000 7f05f3e00640 1 --2- 172.21.15.161:0/645640343 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f05c4066840 0x7f05c4068d00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f05ec15cea0 tx=0x7f05d4008040 comp rx=0 tx=0).stop 2024-01-18T00:47:15.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:15.175+0000 7f05f3e00640 1 -- 172.21.15.161:0/645640343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05ec061640 msgr2=0x7f05ec0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:15.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:15.175+0000 7f05f3e00640 1 --2- 172.21.15.161:0/645640343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05ec061640 0x7f05ec0ccf00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00c390 tx=0x7f05dc00c850 comp rx=0 tx=0).stop 2024-01-18T00:47:15.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:15.175+0000 7f05f3e00640 1 -- 172.21.15.161:0/645640343 shutdown_connections 2024-01-18T00:47:15.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:15.175+0000 7f05f3e00640 1 --2- 172.21.15.161:0/645640343 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f05c4066840 0x7f05c4068d00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:15.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:15.175+0000 7f05f3e00640 1 --2- 172.21.15.161:0/645640343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05ec1539a0 0x7f05ec15c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:15.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:15.175+0000 7f05f3e00640 1 --2- 172.21.15.161:0/645640343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05ec0c79c0 0x7f05ec1eb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:15.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:15.175+0000 7f05f3e00640 1 --2- 172.21.15.161:0/645640343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05ec061640 0x7f05ec0ccf00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:15.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:15.175+0000 7f05f3e00640 1 -- 172.21.15.161:0/645640343 >> 172.21.15.161:0/645640343 conn(0x7f05ec06ad40 msgr2=0x7f05ec152d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:15.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:15.175+0000 7f05f3e00640 1 -- 172.21.15.161:0/645640343 shutdown_connections 2024-01-18T00:47:15.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:15.175+0000 7f05f3e00640 1 -- 172.21.15.161:0/645640343 wait complete. 2024-01-18T00:47:15.197 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-18T00:47:15.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-18T00:47:15.197 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-18T00:47:15.699 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2024-01-18T00:47:15.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-18T00:47:15.700 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-18T00:47:15.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-18T00:47:15.709 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-01-18T00:47:15.763 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-18T00:47:15.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-18T00:47:15.764 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-18T00:47:15.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-18T00:47:15.832 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2024-01-18T00:47:16.024 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-18T00:47:16.035 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-18T00:47:16.035 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-18T00:47:16.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.171+0000 7f2e1d000640 1 Processor -- start 2024-01-18T00:47:16.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.171+0000 7f2e1d000640 1 -- start start 2024-01-18T00:47:16.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.171+0000 7f2e1d000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e181515a0 0x7f2e180c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:16.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.171+0000 7f2e1d000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2e180b0ff0 0x7f2e18157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:16.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.171+0000 7f2e1d000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e18158510 con 0x7f2e180cd560 2024-01-18T00:47:16.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.171+0000 7f2e1d000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e180cd370 con 0x7f2e180b0ff0 2024-01-18T00:47:16.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.171+0000 7f2e1d000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e180c2260 con 0x7f2e181515a0 2024-01-18T00:47:16.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.171+0000 7f2e16800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2e180b0ff0 0x7f2e18157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:16.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.175+0000 7f2e16800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2e180b0ff0 0x7f2e18157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43596/0 (socket says 172.21.15.161:43596) 2024-01-18T00:47:16.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.175+0000 7f2e16800640 1 -- 172.21.15.161:0/3333402588 learned_addr learned my addr 172.21.15.161:0/3333402588 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:16.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.175+0000 7f2e15e00640 1 --2- 172.21.15.161:0/3333402588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e181515a0 0x7f2e180c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:16.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.175+0000 7f2e16800640 1 -- 172.21.15.161:0/3333402588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e181515a0 msgr2=0x7f2e180c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:16.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.175+0000 7f2e16800640 1 --2- 172.21.15.161:0/3333402588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e181515a0 0x7f2e180c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:16.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.175+0000 7f2e16800640 1 -- 172.21.15.161:0/3333402588 >> v1:172.21.15.161:6789/0 conn(0x7f2e180cd560 legacy=0x7f2e180c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:16.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.175+0000 7f2e16800640 1 -- 172.21.15.161:0/3333402588 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e180c33a0 con 0x7f2e180b0ff0 2024-01-18T00:47:16.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.179+0000 7f2e16800640 1 --2- 172.21.15.161:0/3333402588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e180b0ff0 0x7f2e18157fd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009e50 tx=0x7f2e1001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6419af141432673 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:16.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.183+0000 7f2e14a00640 1 -- 172.21.15.161:0/3333402588 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e100af400 con 0x7f2e180b0ff0 2024-01-18T00:47:16.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.183+0000 7f2e14a00640 1 -- 172.21.15.161:0/3333402588 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e100ab050 con 0x7f2e180b0ff0 2024-01-18T00:47:16.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.183+0000 7f2e14a00640 1 -- 172.21.15.161:0/3333402588 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e100af780 con 0x7f2e180b0ff0 2024-01-18T00:47:16.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.183+0000 7f2e1d000640 1 -- 172.21.15.161:0/3333402588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e180b0ff0 msgr2=0x7f2e18157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:16.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.183+0000 7f2e1d000640 1 --2- 172.21.15.161:0/3333402588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e180b0ff0 0x7f2e18157fd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009e50 tx=0x7f2e1001f1c0 comp rx=0 tx=0).stop 2024-01-18T00:47:16.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.183+0000 7f2e1d000640 1 -- 172.21.15.161:0/3333402588 shutdown_connections 2024-01-18T00:47:16.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.183+0000 7f2e1d000640 1 --2- 172.21.15.161:0/3333402588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e180b0ff0 0x7f2e18157fd0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:16.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.183+0000 7f2e1d000640 1 --2- 172.21.15.161:0/3333402588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e181515a0 0x7f2e180c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:16.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.183+0000 7f2e1d000640 1 -- 172.21.15.161:0/3333402588 >> 172.21.15.161:0/3333402588 conn(0x7f2e18061100 msgr2=0x7f2e18061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:16.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.187+0000 7f2e1d000640 1 -- 172.21.15.161:0/3333402588 shutdown_connections 2024-01-18T00:47:16.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.187+0000 7f2e1d000640 1 -- 172.21.15.161:0/3333402588 wait complete. 2024-01-18T00:47:16.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.187+0000 7f2e1d000640 1 Processor -- start 2024-01-18T00:47:16.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.187+0000 7f2e1d000640 1 -- start start 2024-01-18T00:47:16.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.187+0000 7f2e1d000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e180b0ff0 0x7f2e18150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:16.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.187+0000 7f2e1d000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e180cd560 0x7f2e181562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:16.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.187+0000 7f2e1d000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e181515a0 0x7f2e181567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:16.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.187+0000 7f2e1d000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e180c5ed0 con 0x7f2e180b0ff0 2024-01-18T00:47:16.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.187+0000 7f2e1d000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e180c61b0 con 0x7f2e181515a0 2024-01-18T00:47:16.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.187+0000 7f2e1d000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e180c4560 con 0x7f2e180cd560 2024-01-18T00:47:16.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.187+0000 7f2e15e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e180b0ff0 0x7f2e18150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:16.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.191+0000 7f2e15e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e180b0ff0 0x7f2e18150080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43608/0 (socket says 172.21.15.161:43608) 2024-01-18T00:47:16.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.191+0000 7f2e15e00640 1 -- 172.21.15.161:0/429151116 learned_addr learned my addr 172.21.15.161:0/429151116 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:16.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.191+0000 7f2e15400640 1 --2- 172.21.15.161:0/429151116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e180cd560 0x7f2e181562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:16.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.191+0000 7f2e16800640 1 --2- 172.21.15.161:0/429151116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e181515a0 0x7f2e181567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:16.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.191+0000 7f2e15e00640 1 -- 172.21.15.161:0/429151116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e180cd560 msgr2=0x7f2e181562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:16.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.191+0000 7f2e15e00640 1 --2- 172.21.15.161:0/429151116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e180cd560 0x7f2e181562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:16.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.191+0000 7f2e15e00640 1 -- 172.21.15.161:0/429151116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e181515a0 msgr2=0x7f2e181567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:16.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.191+0000 7f2e15e00640 1 --2- 172.21.15.161:0/429151116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e181515a0 0x7f2e181567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:16.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.191+0000 7f2e15e00640 1 -- 172.21.15.161:0/429151116 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e10009b30 con 0x7f2e180b0ff0 2024-01-18T00:47:16.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.195+0000 7f2e15e00640 1 --2- 172.21.15.161:0/429151116 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e180b0ff0 0x7f2e18150080 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800e870 tx=0x7f2e0800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:16.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.199+0000 7f2e0e000640 1 -- 172.21.15.161:0/429151116 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08009530 con 0x7f2e180b0ff0 2024-01-18T00:47:16.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.199+0000 7f2e1d000640 1 -- 172.21.15.161:0/429151116 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e180c4840 con 0x7f2e180b0ff0 2024-01-18T00:47:16.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.199+0000 7f2e1d000640 1 -- 172.21.15.161:0/429151116 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e180c6490 con 0x7f2e180b0ff0 2024-01-18T00:47:16.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.199+0000 7f2e0e000640 1 -- 172.21.15.161:0/429151116 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e080059a0 con 0x7f2e180b0ff0 2024-01-18T00:47:16.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.199+0000 7f2e0e000640 1 -- 172.21.15.161:0/429151116 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08005d10 con 0x7f2e180b0ff0 2024-01-18T00:47:16.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.199+0000 7f2e1d000640 1 -- 172.21.15.161:0/429151116 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de80052a0 con 0x7f2e180b0ff0 2024-01-18T00:47:16.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.219+0000 7f2e0e000640 1 -- 172.21.15.161:0/429151116 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f2e0800c940 con 0x7f2e180b0ff0 2024-01-18T00:47:16.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.219+0000 7f2e0e000640 1 --2- 172.21.15.161:0/429151116 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2df0066840 0x7f2df0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:16.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.219+0000 7f2e15400640 1 --2- 172.21.15.161:0/429151116 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2df0066840 0x7f2df0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:16.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.219+0000 7f2e15400640 1 --2- 172.21.15.161:0/429151116 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2df0066840 0x7f2df0068d00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2e181f3d80 tx=0x7f2e00009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:16.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.219+0000 7f2e0e000640 1 -- 172.21.15.161:0/429151116 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f2e080554e0 con 0x7f2e180b0ff0 2024-01-18T00:47:16.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.471+0000 7f2e0e000640 1 -- 172.21.15.161:0/429151116 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f2e08051820 con 0x7f2e180b0ff0 2024-01-18T00:47:16.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.631+0000 7f2e1d000640 1 -- 172.21.15.161:0/429151116 --> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2de8000bd0 con 0x7f2df0066840 2024-01-18T00:47:16.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.643+0000 7f2e0e000640 1 -- 172.21.15.161:0/429151116 <== mgr.4110 v2:172.21.15.161:6800/272458188 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371378 (secure 0 0 0) 0x7f2de8000bd0 con 0x7f2df0066840 2024-01-18T00:47:16.646 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-18T00:47:16.649 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-01-18T00:47:16.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.647+0000 7f2e1d000640 1 -- 172.21.15.161:0/429151116 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2df0066840 msgr2=0x7f2df0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:16.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.647+0000 7f2e1d000640 1 --2- 172.21.15.161:0/429151116 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2df0066840 0x7f2df0068d00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2e181f3d80 tx=0x7f2e00009040 comp rx=0 tx=0).stop 2024-01-18T00:47:16.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.647+0000 7f2e1d000640 1 -- 172.21.15.161:0/429151116 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e180b0ff0 msgr2=0x7f2e18150080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:16.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.647+0000 7f2e1d000640 1 --2- 172.21.15.161:0/429151116 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e180b0ff0 0x7f2e18150080 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800e870 tx=0x7f2e0800ed30 comp rx=0 tx=0).stop 2024-01-18T00:47:16.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.647+0000 7f2e1d000640 1 -- 172.21.15.161:0/429151116 shutdown_connections 2024-01-18T00:47:16.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.647+0000 7f2e1d000640 1 --2- 172.21.15.161:0/429151116 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2df0066840 0x7f2df0068d00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:16.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.647+0000 7f2e1d000640 1 --2- 172.21.15.161:0/429151116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e181515a0 0x7f2e181567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:16.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.647+0000 7f2e1d000640 1 --2- 172.21.15.161:0/429151116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e180cd560 0x7f2e181562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:16.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.647+0000 7f2e1d000640 1 --2- 172.21.15.161:0/429151116 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e180b0ff0 0x7f2e18150080 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:16.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.647+0000 7f2e1d000640 1 -- 172.21.15.161:0/429151116 >> 172.21.15.161:0/429151116 conn(0x7f2e18061100 msgr2=0x7f2e180b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:16.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.647+0000 7f2e1d000640 1 -- 172.21.15.161:0/429151116 shutdown_connections 2024-01-18T00:47:16.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.647+0000 7f2e1d000640 1 -- 172.21.15.161:0/429151116 wait complete. 2024-01-18T00:47:16.667 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":3292,"stamp":"2024-01-18T00:47:16.475115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":198926073,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":3054,"num_read_kb":3537766,"num_write":47079,"num_write_kb":4540401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59999,"ondisk_log_size":59999,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":964748,"kb_used_data":179916,"kb_used_omap":12,"kb_used_meta":784755,"kb_avail":754009972,"statfs":{"total":773094113280,"available":772106211328,"internally_reserved":0,"allocated":184233984,"data_stored":398813629,"data_compressed":51124606,"data_compressed_allocated":68771840,"data_compressed_original":284901376,"omap_allocated":12751,"internal_metadata":803589681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-274572,"num_objects":-66,"num_object_clones":0,"num_object_copies":-264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-66,"num_whiteouts":0,"num_read":6,"num_read_kb":11,"num_write":109,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002706"},"pg_stats":[{"pgid":"2.1f","version":"28'401","reported_seq":472,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.101129+0000","last_change":"2024-01-17T22:58:48.328193+0000","last_active":"2024-01-18T00:47:09.101129+0000","last_peered":"2024-01-18T00:47:09.101129+0000","last_clean":"2024-01-18T00:47:09.101129+0000","last_became_active":"2024-01-17T22:58:48.327340+0000","last_became_peered":"2024-01-17T22:58:48.327340+0000","last_unstale":"2024-01-18T00:47:09.101129+0000","last_undegraded":"2024-01-18T00:47:09.101129+0000","last_fullsized":"2024-01-18T00:47:09.101129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:56.524325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":8350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'183","reported_seq":254,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.312429+0000","last_change":"2024-01-17T22:58:49.351609+0000","last_active":"2024-01-18T00:47:04.312429+0000","last_peered":"2024-01-18T00:47:04.312429+0000","last_clean":"2024-01-18T00:47:04.312429+0000","last_became_active":"2024-01-17T22:58:49.350812+0000","last_became_peered":"2024-01-17T22:58:49.350812+0000","last_unstale":"2024-01-18T00:47:04.312429+0000","last_undegraded":"2024-01-18T00:47:04.312429+0000","last_fullsized":"2024-01-18T00:47:04.312429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:02:07.535209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'754","reported_seq":836,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:43.925020+0000","last_change":"2024-01-17T22:58:55.903757+0000","last_active":"2024-01-18T00:46:43.925020+0000","last_peered":"2024-01-18T00:46:43.925020+0000","last_clean":"2024-01-18T00:46:43.925020+0000","last_became_active":"2024-01-17T22:58:55.903167+0000","last_became_peered":"2024-01-17T22:58:55.903167+0000","last_unstale":"2024-01-18T00:46:43.925020+0000","last_undegraded":"2024-01-18T00:46:43.925020+0000","last_fullsized":"2024-01-18T00:46:43.925020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:22.127961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":69175,"num_write":737,"num_write_kb":101027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'515","reported_seq":587,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:34.183193+0000","last_change":"2024-01-17T22:58:48.373068+0000","last_active":"2024-01-18T00:46:34.183193+0000","last_peered":"2024-01-18T00:46:34.183193+0000","last_clean":"2024-01-18T00:46:34.183193+0000","last_became_active":"2024-01-17T22:58:48.372582+0000","last_became_peered":"2024-01-17T22:58:48.372582+0000","last_unstale":"2024-01-18T00:46:34.183193+0000","last_undegraded":"2024-01-18T00:46:34.183193+0000","last_fullsized":"2024-01-18T00:46:34.183193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:10:59.139723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":8429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'177","reported_seq":247,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.597454+0000","last_change":"2024-01-17T22:58:49.511918+0000","last_active":"2024-01-18T00:47:04.597454+0000","last_peered":"2024-01-18T00:47:04.597454+0000","last_clean":"2024-01-18T00:47:04.597454+0000","last_became_active":"2024-01-17T22:58:49.511303+0000","last_became_peered":"2024-01-17T22:58:49.511303+0000","last_unstale":"2024-01-18T00:47:04.597454+0000","last_undegraded":"2024-01-18T00:47:04.597454+0000","last_fullsized":"2024-01-18T00:47:04.597454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:13:09.466879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'814","reported_seq":911,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.934585+0000","last_change":"2024-01-17T22:58:55.878752+0000","last_active":"2024-01-18T00:47:04.934585+0000","last_peered":"2024-01-18T00:47:04.934585+0000","last_clean":"2024-01-18T00:47:04.934585+0000","last_became_active":"2024-01-17T22:58:55.878263+0000","last_became_peered":"2024-01-17T22:58:55.878263+0000","last_unstale":"2024-01-18T00:47:04.934585+0000","last_undegraded":"2024-01-18T00:47:04.934585+0000","last_fullsized":"2024-01-18T00:47:04.934585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:19:49.420559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":109513,"num_write":800,"num_write_kb":160118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1138","reported_seq":1200,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:13.376579+0000","last_change":"2024-01-17T22:58:48.346724+0000","last_active":"2024-01-18T00:45:13.376579+0000","last_peered":"2024-01-18T00:45:13.376579+0000","last_clean":"2024-01-18T00:45:13.376579+0000","last_became_active":"2024-01-17T22:58:48.346411+0000","last_became_peered":"2024-01-17T22:58:48.346411+0000","last_unstale":"2024-01-18T00:45:13.376579+0000","last_undegraded":"2024-01-18T00:45:13.376579+0000","last_fullsized":"2024-01-18T00:45:13.376579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1138,"log_dups_size":0,"ondisk_log_size":1138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:03:04.691978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1083,"num_write_kb":12791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'196","reported_seq":256,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.694627+0000","last_change":"2024-01-17T22:58:49.517981+0000","last_active":"2024-01-18T00:47:15.694627+0000","last_peered":"2024-01-18T00:47:15.694627+0000","last_clean":"2024-01-18T00:47:15.694627+0000","last_became_active":"2024-01-17T22:58:49.517710+0000","last_became_peered":"2024-01-17T22:58:49.517710+0000","last_unstale":"2024-01-18T00:47:15.694627+0000","last_undegraded":"2024-01-18T00:47:15.694627+0000","last_fullsized":"2024-01-18T00:47:15.694627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'731","reported_seq":809,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.699271+0000","last_change":"2024-01-17T22:58:55.847347+0000","last_active":"2024-01-18T00:47:08.699271+0000","last_peered":"2024-01-18T00:47:08.699271+0000","last_clean":"2024-01-18T00:47:08.699271+0000","last_became_active":"2024-01-17T22:58:55.846773+0000","last_became_peered":"2024-01-17T22:58:55.846773+0000","last_unstale":"2024-01-18T00:47:08.699271+0000","last_undegraded":"2024-01-18T00:47:08.699271+0000","last_fullsized":"2024-01-18T00:47:08.699271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:31:43.629750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":46045,"num_write":714,"num_write_kb":72807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'767","reported_seq":829,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:20.108287+0000","last_change":"2024-01-17T22:58:48.346483+0000","last_active":"2024-01-18T00:46:20.108287+0000","last_peered":"2024-01-18T00:46:20.108287+0000","last_clean":"2024-01-18T00:46:20.108287+0000","last_became_active":"2024-01-17T22:58:48.345749+0000","last_became_peered":"2024-01-17T22:58:48.345749+0000","last_unstale":"2024-01-18T00:46:20.108287+0000","last_undegraded":"2024-01-18T00:46:20.108287+0000","last_fullsized":"2024-01-18T00:46:20.108287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:22:41.169668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'208","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660482+0000","last_change":"2024-01-17T22:58:49.371509+0000","last_active":"2024-01-18T00:47:15.660482+0000","last_peered":"2024-01-18T00:47:15.660482+0000","last_clean":"2024-01-18T00:47:15.660482+0000","last_became_active":"2024-01-17T22:58:49.370010+0000","last_became_peered":"2024-01-17T22:58:49.370010+0000","last_unstale":"2024-01-18T00:47:15.660482+0000","last_undegraded":"2024-01-18T00:47:15.660482+0000","last_fullsized":"2024-01-18T00:47:15.660482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:36:24.817716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'752","reported_seq":834,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.279912+0000","last_change":"2024-01-17T22:58:55.886223+0000","last_active":"2024-01-18T00:47:04.279912+0000","last_peered":"2024-01-18T00:47:04.279912+0000","last_clean":"2024-01-18T00:47:04.279912+0000","last_became_active":"2024-01-17T22:58:55.885739+0000","last_became_peered":"2024-01-17T22:58:55.885739+0000","last_unstale":"2024-01-18T00:47:04.279912+0000","last_undegraded":"2024-01-18T00:47:04.279912+0000","last_fullsized":"2024-01-18T00:47:04.279912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:49:18.835647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":79345,"num_write":732,"num_write_kb":104824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'223","reported_seq":290,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660356+0000","last_change":"2024-01-17T22:58:49.514565+0000","last_active":"2024-01-18T00:47:15.660356+0000","last_peered":"2024-01-18T00:47:15.660356+0000","last_clean":"2024-01-18T00:47:15.660356+0000","last_became_active":"2024-01-17T22:58:49.514310+0000","last_became_peered":"2024-01-17T22:58:49.514310+0000","last_unstale":"2024-01-18T00:47:15.660356+0000","last_undegraded":"2024-01-18T00:47:15.660356+0000","last_fullsized":"2024-01-18T00:47:15.660356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:01:32.364167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1137","reported_seq":1204,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:22.872524+0000","last_change":"2024-01-17T22:58:48.341961+0000","last_active":"2024-01-18T00:45:22.872524+0000","last_peered":"2024-01-18T00:45:22.872524+0000","last_clean":"2024-01-18T00:45:22.872524+0000","last_became_active":"2024-01-17T22:58:48.341498+0000","last_became_peered":"2024-01-17T22:58:48.341498+0000","last_unstale":"2024-01-18T00:45:22.872524+0000","last_undegraded":"2024-01-18T00:45:22.872524+0000","last_fullsized":"2024-01-18T00:45:22.872524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1137,"log_dups_size":0,"ondisk_log_size":1137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:56.524325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1075,"num_write_kb":12808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'783","reported_seq":874,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:58.933650+0000","last_change":"2024-01-17T22:58:55.915918+0000","last_active":"2024-01-18T00:46:58.933650+0000","last_peered":"2024-01-18T00:46:58.933650+0000","last_clean":"2024-01-18T00:46:58.933650+0000","last_became_active":"2024-01-17T22:58:55.915556+0000","last_became_peered":"2024-01-17T22:58:55.915556+0000","last_unstale":"2024-01-18T00:46:58.933650+0000","last_undegraded":"2024-01-18T00:46:58.933650+0000","last_fullsized":"2024-01-18T00:46:58.933650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:22:21.478703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":102943,"num_write":764,"num_write_kb":130404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'216","reported_seq":282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.678115+0000","last_change":"2024-01-17T22:58:49.388237+0000","last_active":"2024-01-18T00:47:15.678115+0000","last_peered":"2024-01-18T00:47:15.678115+0000","last_clean":"2024-01-18T00:47:15.678115+0000","last_became_active":"2024-01-17T22:58:49.387500+0000","last_became_peered":"2024-01-17T22:58:49.387500+0000","last_unstale":"2024-01-18T00:47:15.678115+0000","last_undegraded":"2024-01-18T00:47:15.678115+0000","last_fullsized":"2024-01-18T00:47:15.678115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'1206","reported_seq":1274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:36.387266+0000","last_change":"2024-01-17T22:58:48.346215+0000","last_active":"2024-01-18T00:45:36.387266+0000","last_peered":"2024-01-18T00:45:36.387266+0000","last_clean":"2024-01-18T00:45:36.387266+0000","last_became_active":"2024-01-17T22:58:48.345584+0000","last_became_peered":"2024-01-17T22:58:48.345584+0000","last_unstale":"2024-01-18T00:45:36.387266+0000","last_undegraded":"2024-01-18T00:45:36.387266+0000","last_fullsized":"2024-01-18T00:45:36.387266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1206,"log_dups_size":0,"ondisk_log_size":1206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":8782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'818","reported_seq":903,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:55.111757+0000","last_change":"2024-01-17T22:58:55.904518+0000","last_active":"2024-01-18T00:46:55.111757+0000","last_peered":"2024-01-18T00:46:55.111757+0000","last_clean":"2024-01-18T00:46:55.111757+0000","last_became_active":"2024-01-17T22:58:55.904182+0000","last_became_peered":"2024-01-17T22:58:55.904182+0000","last_unstale":"2024-01-18T00:46:55.111757+0000","last_undegraded":"2024-01-18T00:46:55.111757+0000","last_fullsized":"2024-01-18T00:46:55.111757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:24:43.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":69224,"num_write":805,"num_write_kb":98188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'208","reported_seq":276,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651670+0000","last_change":"2024-01-17T22:58:49.417907+0000","last_active":"2024-01-18T00:47:15.651670+0000","last_peered":"2024-01-18T00:47:15.651670+0000","last_clean":"2024-01-18T00:47:15.651670+0000","last_became_active":"2024-01-17T22:58:49.417440+0000","last_became_peered":"2024-01-17T22:58:49.417440+0000","last_unstale":"2024-01-18T00:47:15.651670+0000","last_undegraded":"2024-01-18T00:47:15.651670+0000","last_fullsized":"2024-01-18T00:47:15.651670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:59.773063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'353","reported_seq":422,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:11.404319+0000","last_change":"2024-01-17T22:58:48.332092+0000","last_active":"2024-01-18T00:47:11.404319+0000","last_peered":"2024-01-18T00:47:11.404319+0000","last_clean":"2024-01-18T00:47:11.404319+0000","last_became_active":"2024-01-17T22:58:48.331435+0000","last_became_peered":"2024-01-17T22:58:48.331435+0000","last_unstale":"2024-01-18T00:47:11.404319+0000","last_undegraded":"2024-01-18T00:47:11.404319+0000","last_fullsized":"2024-01-18T00:47:11.404319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:41:24.117738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":286,"num_write_kb":4220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'749","reported_seq":841,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:49.663655+0000","last_change":"2024-01-17T22:59:09.254564+0000","last_active":"2024-01-18T00:46:49.663655+0000","last_peered":"2024-01-18T00:46:49.663655+0000","last_clean":"2024-01-18T00:46:49.663655+0000","last_became_active":"2024-01-17T22:59:09.254084+0000","last_became_peered":"2024-01-17T22:59:09.254084+0000","last_unstale":"2024-01-18T00:46:49.663655+0000","last_undegraded":"2024-01-18T00:46:49.663655+0000","last_fullsized":"2024-01-18T00:46:49.663655+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:04:05.785891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":86272,"num_write":735,"num_write_kb":127812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2,3],"acting":[0,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"28'213","reported_seq":281,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.654480+0000","last_change":"2024-01-17T22:58:49.416963+0000","last_active":"2024-01-18T00:47:15.654480+0000","last_peered":"2024-01-18T00:47:15.654480+0000","last_clean":"2024-01-18T00:47:15.654480+0000","last_became_active":"2024-01-17T22:58:49.416757+0000","last_became_peered":"2024-01-17T22:58:49.416757+0000","last_unstale":"2024-01-18T00:47:15.654480+0000","last_undegraded":"2024-01-18T00:47:15.654480+0000","last_fullsized":"2024-01-18T00:47:15.654480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:08.763719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'203","reported_seq":272,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:10.113056+0000","last_change":"2024-01-17T22:58:48.341728+0000","last_active":"2024-01-18T00:47:10.113056+0000","last_peered":"2024-01-18T00:47:10.113056+0000","last_clean":"2024-01-18T00:47:10.113056+0000","last_became_active":"2024-01-17T22:58:48.341359+0000","last_became_peered":"2024-01-17T22:58:48.341359+0000","last_unstale":"2024-01-18T00:47:10.113056+0000","last_undegraded":"2024-01-18T00:47:10.113056+0000","last_fullsized":"2024-01-18T00:47:10.113056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:20:07.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'713","reported_seq":816,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:58.802459+0000","last_change":"2024-01-17T22:58:55.913996+0000","last_active":"2024-01-18T00:46:58.802459+0000","last_peered":"2024-01-18T00:46:58.802459+0000","last_clean":"2024-01-18T00:46:58.802459+0000","last_became_active":"2024-01-17T22:58:55.913645+0000","last_became_peered":"2024-01-17T22:58:55.913645+0000","last_unstale":"2024-01-18T00:46:58.802459+0000","last_undegraded":"2024-01-18T00:46:58.802459+0000","last_fullsized":"2024-01-18T00:46:58.802459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":136231,"num_write":693,"num_write_kb":114548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'226","reported_seq":294,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651590+0000","last_change":"2024-01-17T22:58:49.417874+0000","last_active":"2024-01-18T00:47:15.651590+0000","last_peered":"2024-01-18T00:47:15.651590+0000","last_clean":"2024-01-18T00:47:15.651590+0000","last_became_active":"2024-01-17T22:58:49.417385+0000","last_became_peered":"2024-01-17T22:58:49.417385+0000","last_unstale":"2024-01-18T00:47:15.651590+0000","last_undegraded":"2024-01-18T00:47:15.651590+0000","last_fullsized":"2024-01-18T00:47:15.651590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:41.515981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'330","reported_seq":399,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:11.382366+0000","last_change":"2024-01-17T22:58:48.340052+0000","last_active":"2024-01-18T00:47:11.382366+0000","last_peered":"2024-01-18T00:47:11.382366+0000","last_clean":"2024-01-18T00:47:11.382366+0000","last_became_active":"2024-01-17T22:58:48.339738+0000","last_became_peered":"2024-01-17T22:58:48.339738+0000","last_unstale":"2024-01-18T00:47:11.382366+0000","last_undegraded":"2024-01-18T00:47:11.382366+0000","last_fullsized":"2024-01-18T00:47:11.382366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:58.517904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'778","reported_seq":883,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.935092+0000","last_change":"2024-01-17T22:58:55.904749+0000","last_active":"2024-01-18T00:47:04.935092+0000","last_peered":"2024-01-18T00:47:04.935092+0000","last_clean":"2024-01-18T00:47:04.935092+0000","last_became_active":"2024-01-17T22:58:55.904417+0000","last_became_peered":"2024-01-17T22:58:55.904417+0000","last_unstale":"2024-01-18T00:47:04.935092+0000","last_undegraded":"2024-01-18T00:47:04.935092+0000","last_fullsized":"2024-01-18T00:47:04.935092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:22:32.504064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":109858,"num_write":759,"num_write_kb":103009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'181","reported_seq":249,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:11.404434+0000","last_change":"2024-01-17T22:58:49.411284+0000","last_active":"2024-01-18T00:47:11.404434+0000","last_peered":"2024-01-18T00:47:11.404434+0000","last_clean":"2024-01-18T00:47:11.404434+0000","last_became_active":"2024-01-17T22:58:49.410830+0000","last_became_peered":"2024-01-17T22:58:49.410830+0000","last_unstale":"2024-01-18T00:47:11.404434+0000","last_undegraded":"2024-01-18T00:47:11.404434+0000","last_fullsized":"2024-01-18T00:47:11.404434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:17:04.832847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'1208","reported_seq":1277,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:11.404416+0000","last_change":"2024-01-17T22:58:48.339919+0000","last_active":"2024-01-18T00:47:11.404416+0000","last_peered":"2024-01-18T00:47:11.404416+0000","last_clean":"2024-01-18T00:47:11.404416+0000","last_became_active":"2024-01-17T22:58:48.338928+0000","last_became_peered":"2024-01-17T22:58:48.338928+0000","last_unstale":"2024-01-18T00:47:11.404416+0000","last_undegraded":"2024-01-18T00:47:11.404416+0000","last_fullsized":"2024-01-18T00:47:11.404416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1208,"log_dups_size":0,"ondisk_log_size":1208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:21.699809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3220,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'817","reported_seq":928,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.691889+0000","last_change":"2024-01-17T22:58:55.909140+0000","last_active":"2024-01-18T00:47:04.691889+0000","last_peered":"2024-01-18T00:47:04.691889+0000","last_clean":"2024-01-18T00:47:04.691889+0000","last_became_active":"2024-01-17T22:58:55.908232+0000","last_became_peered":"2024-01-17T22:58:55.908232+0000","last_unstale":"2024-01-18T00:47:04.691889+0000","last_undegraded":"2024-01-18T00:47:04.691889+0000","last_fullsized":"2024-01-18T00:47:04.691889+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":152093,"num_write":804,"num_write_kb":135389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'198","reported_seq":268,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.835195+0000","last_change":"2024-01-17T22:58:49.370201+0000","last_active":"2024-01-18T00:47:15.835195+0000","last_peered":"2024-01-18T00:47:15.835195+0000","last_clean":"2024-01-18T00:47:15.835195+0000","last_became_active":"2024-01-17T22:58:49.369598+0000","last_became_peered":"2024-01-17T22:58:49.369598+0000","last_unstale":"2024-01-18T00:47:15.835195+0000","last_undegraded":"2024-01-18T00:47:15.835195+0000","last_fullsized":"2024-01-18T00:47:15.835195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:15.814647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'819","reported_seq":889,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:14.849761+0000","last_change":"2024-01-17T22:58:48.338556+0000","last_active":"2024-01-18T00:46:14.849761+0000","last_peered":"2024-01-18T00:46:14.849761+0000","last_clean":"2024-01-18T00:46:14.849761+0000","last_became_active":"2024-01-17T22:58:48.338225+0000","last_became_peered":"2024-01-17T22:58:48.338225+0000","last_unstale":"2024-01-18T00:46:14.849761+0000","last_undegraded":"2024-01-18T00:46:14.849761+0000","last_fullsized":"2024-01-18T00:46:14.849761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:47.210049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":8593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'758","reported_seq":863,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.960696+0000","last_change":"2024-01-17T22:58:55.872734+0000","last_active":"2024-01-18T00:47:08.960696+0000","last_peered":"2024-01-18T00:47:08.960696+0000","last_clean":"2024-01-18T00:47:08.960696+0000","last_became_active":"2024-01-17T22:58:55.872356+0000","last_became_peered":"2024-01-17T22:58:55.872356+0000","last_unstale":"2024-01-18T00:47:08.960696+0000","last_undegraded":"2024-01-18T00:47:08.960696+0000","last_fullsized":"2024-01-18T00:47:08.960696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:22:32.504064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":100834,"num_write":740,"num_write_kb":155893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'214","reported_seq":282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.652987+0000","last_change":"2024-01-17T22:58:49.369806+0000","last_active":"2024-01-18T00:47:15.652987+0000","last_peered":"2024-01-18T00:47:15.652987+0000","last_clean":"2024-01-18T00:47:15.652987+0000","last_became_active":"2024-01-17T22:58:49.369487+0000","last_became_peered":"2024-01-17T22:58:49.369487+0000","last_unstale":"2024-01-18T00:47:15.652987+0000","last_undegraded":"2024-01-18T00:47:15.652987+0000","last_fullsized":"2024-01-18T00:47:15.652987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:25.515983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'276","reported_seq":347,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.606730+0000","last_change":"2024-01-17T22:58:48.341854+0000","last_active":"2024-01-18T00:46:53.606730+0000","last_peered":"2024-01-18T00:46:53.606730+0000","last_clean":"2024-01-18T00:46:53.606730+0000","last_became_active":"2024-01-17T22:58:48.339996+0000","last_became_peered":"2024-01-17T22:58:48.339996+0000","last_unstale":"2024-01-18T00:46:53.606730+0000","last_undegraded":"2024-01-18T00:46:53.606730+0000","last_fullsized":"2024-01-18T00:46:53.606730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:55:52.894278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'763","reported_seq":861,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.274913+0000","last_change":"2024-01-17T22:58:55.877637+0000","last_active":"2024-01-18T00:47:09.274913+0000","last_peered":"2024-01-18T00:47:09.274913+0000","last_clean":"2024-01-18T00:47:09.274913+0000","last_became_active":"2024-01-17T22:58:55.877118+0000","last_became_peered":"2024-01-17T22:58:55.877118+0000","last_unstale":"2024-01-18T00:47:09.274913+0000","last_undegraded":"2024-01-18T00:47:09.274913+0000","last_fullsized":"2024-01-18T00:47:09.274913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:08.327495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":97013,"num_write":742,"num_write_kb":97416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'191","reported_seq":261,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.647543+0000","last_change":"2024-01-17T22:58:49.352845+0000","last_active":"2024-01-18T00:47:08.647543+0000","last_peered":"2024-01-18T00:47:08.647543+0000","last_clean":"2024-01-18T00:47:08.647543+0000","last_became_active":"2024-01-17T22:58:49.352563+0000","last_became_peered":"2024-01-17T22:58:49.352563+0000","last_unstale":"2024-01-18T00:47:08.647543+0000","last_undegraded":"2024-01-18T00:47:08.647543+0000","last_fullsized":"2024-01-18T00:47:08.647543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:43.516572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'1018","reported_seq":1089,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:38.492655+0000","last_change":"2024-01-17T22:58:48.343658+0000","last_active":"2024-01-18T00:45:38.492655+0000","last_peered":"2024-01-18T00:45:38.492655+0000","last_clean":"2024-01-18T00:45:38.492655+0000","last_became_active":"2024-01-17T22:58:48.343060+0000","last_became_peered":"2024-01-17T22:58:48.343060+0000","last_unstale":"2024-01-18T00:45:38.492655+0000","last_undegraded":"2024-01-18T00:45:38.492655+0000","last_fullsized":"2024-01-18T00:45:38.492655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:42.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":955,"num_write_kb":8650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'732","reported_seq":829,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:49.510439+0000","last_change":"2024-01-17T22:58:55.881076+0000","last_active":"2024-01-18T00:46:49.510439+0000","last_peered":"2024-01-18T00:46:49.510439+0000","last_clean":"2024-01-18T00:46:49.510439+0000","last_became_active":"2024-01-17T22:58:55.880665+0000","last_became_peered":"2024-01-17T22:58:55.880665+0000","last_unstale":"2024-01-18T00:46:49.510439+0000","last_undegraded":"2024-01-18T00:46:49.510439+0000","last_fullsized":"2024-01-18T00:46:49.510439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:37:20.317014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":93731,"num_write":720,"num_write_kb":118971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'198","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.692105+0000","last_change":"2024-01-17T22:58:49.385682+0000","last_active":"2024-01-18T00:47:04.692105+0000","last_peered":"2024-01-18T00:47:04.692105+0000","last_clean":"2024-01-18T00:47:04.692105+0000","last_became_active":"2024-01-17T22:58:49.384655+0000","last_became_peered":"2024-01-17T22:58:49.384655+0000","last_unstale":"2024-01-18T00:47:04.692105+0000","last_undegraded":"2024-01-18T00:47:04.692105+0000","last_fullsized":"2024-01-18T00:47:04.692105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:22:51.592384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'1859","reported_seq":3718,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:13.468415+0000","last_change":"2024-01-17T22:58:48.375527+0000","last_active":"2024-01-18T00:47:13.468415+0000","last_peered":"2024-01-18T00:47:13.468415+0000","last_clean":"2024-01-18T00:47:13.468415+0000","last_became_active":"2024-01-17T22:58:48.375210+0000","last_became_peered":"2024-01-17T22:58:48.375210+0000","last_unstale":"2024-01-18T00:47:13.468415+0000","last_undegraded":"2024-01-18T00:47:13.468415+0000","last_fullsized":"2024-01-18T00:47:13.468415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1859,"log_dups_size":0,"ondisk_log_size":1859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:51:00.037407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1556390,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1788,"num_read_kb":2847,"num_write":1794,"num_write_kb":2850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'738","reported_seq":827,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.666387+0000","last_change":"2024-01-17T22:58:55.903437+0000","last_active":"2024-01-18T00:47:08.666387+0000","last_peered":"2024-01-18T00:47:08.666387+0000","last_clean":"2024-01-18T00:47:08.666387+0000","last_became_active":"2024-01-17T22:58:55.902881+0000","last_became_peered":"2024-01-17T22:58:55.902881+0000","last_unstale":"2024-01-18T00:47:08.666387+0000","last_undegraded":"2024-01-18T00:47:08.666387+0000","last_fullsized":"2024-01-18T00:47:08.666387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":79403,"num_write":724,"num_write_kb":135108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'196","reported_seq":266,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.833898+0000","last_change":"2024-01-17T22:58:49.367932+0000","last_active":"2024-01-18T00:47:15.833898+0000","last_peered":"2024-01-18T00:47:15.833898+0000","last_clean":"2024-01-18T00:47:15.833898+0000","last_became_active":"2024-01-17T22:58:49.367236+0000","last_became_peered":"2024-01-17T22:58:49.367236+0000","last_unstale":"2024-01-18T00:47:15.833898+0000","last_undegraded":"2024-01-18T00:47:15.833898+0000","last_fullsized":"2024-01-18T00:47:15.833898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:06.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'617","reported_seq":689,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:47.617658+0000","last_change":"2024-01-17T22:58:48.338730+0000","last_active":"2024-01-18T00:45:47.617658+0000","last_peered":"2024-01-18T00:45:47.617658+0000","last_clean":"2024-01-18T00:45:47.617658+0000","last_became_active":"2024-01-17T22:58:48.337500+0000","last_became_peered":"2024-01-17T22:58:48.337500+0000","last_unstale":"2024-01-18T00:45:47.617658+0000","last_undegraded":"2024-01-18T00:45:47.617658+0000","last_fullsized":"2024-01-18T00:45:47.617658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:54.141445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":12559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'904","reported_seq":1025,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.855106+0000","last_change":"2024-01-17T22:58:55.900298+0000","last_active":"2024-01-18T00:46:53.855106+0000","last_peered":"2024-01-18T00:46:53.855106+0000","last_clean":"2024-01-18T00:46:53.855106+0000","last_became_active":"2024-01-17T22:58:55.899657+0000","last_became_peered":"2024-01-17T22:58:55.899657+0000","last_unstale":"2024-01-18T00:46:53.855106+0000","last_undegraded":"2024-01-18T00:46:53.855106+0000","last_fullsized":"2024-01-18T00:46:53.855106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:30:03.955178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":184022,"num_write":887,"num_write_kb":259108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'189","reported_seq":259,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.652198+0000","last_change":"2024-01-17T22:58:49.412701+0000","last_active":"2024-01-18T00:47:15.652198+0000","last_peered":"2024-01-18T00:47:15.652198+0000","last_clean":"2024-01-18T00:47:15.652198+0000","last_became_active":"2024-01-17T22:58:49.411848+0000","last_became_peered":"2024-01-17T22:58:49.411848+0000","last_unstale":"2024-01-18T00:47:15.652198+0000","last_undegraded":"2024-01-18T00:47:15.652198+0000","last_fullsized":"2024-01-18T00:47:15.652198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:55:47.020055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'293","reported_seq":364,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.802453+0000","last_change":"2024-01-17T22:58:48.341769+0000","last_active":"2024-01-18T00:47:04.802453+0000","last_peered":"2024-01-18T00:47:04.802453+0000","last_clean":"2024-01-18T00:47:04.802453+0000","last_became_active":"2024-01-17T22:58:48.340963+0000","last_became_peered":"2024-01-17T22:58:48.340963+0000","last_unstale":"2024-01-18T00:47:04.802453+0000","last_undegraded":"2024-01-18T00:47:04.802453+0000","last_fullsized":"2024-01-18T00:47:04.802453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:15:16.672836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":4212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'161","reported_seq":278,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:44:51.424884+0000","last_change":"2024-01-17T22:58:17.322374+0000","last_active":"2024-01-18T00:44:51.424884+0000","last_peered":"2024-01-18T00:44:51.424884+0000","last_clean":"2024-01-18T00:44:51.424884+0000","last_became_active":"2024-01-17T22:58:17.321097+0000","last_became_peered":"2024-01-17T22:58:17.321097+0000","last_unstale":"2024-01-18T00:44:51.424884+0000","last_undegraded":"2024-01-18T00:44:51.424884+0000","last_fullsized":"2024-01-18T00:44:51.424884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:15.452106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:15.452106+0000","last_clean_scrub_stamp":"2024-01-17T22:58:15.452106+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:55:58.924319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'806","reported_seq":938,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:59.053289+0000","last_change":"2024-01-17T22:58:55.909509+0000","last_active":"2024-01-18T00:46:59.053289+0000","last_peered":"2024-01-18T00:46:59.053289+0000","last_clean":"2024-01-18T00:46:59.053289+0000","last_became_active":"2024-01-17T22:58:55.909055+0000","last_became_peered":"2024-01-17T22:58:55.909055+0000","last_unstale":"2024-01-18T00:46:59.053289+0000","last_undegraded":"2024-01-18T00:46:59.053289+0000","last_fullsized":"2024-01-18T00:46:59.053289+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:11:12.388395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":230974,"num_write":789,"num_write_kb":193453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'203","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:59.050211+0000","last_change":"2024-01-17T22:58:49.516198+0000","last_active":"2024-01-18T00:46:59.050211+0000","last_peered":"2024-01-18T00:46:59.050211+0000","last_clean":"2024-01-18T00:46:59.050211+0000","last_became_active":"2024-01-17T22:58:49.515941+0000","last_became_peered":"2024-01-17T22:58:49.515941+0000","last_unstale":"2024-01-18T00:46:59.050211+0000","last_undegraded":"2024-01-18T00:46:59.050211+0000","last_fullsized":"2024-01-18T00:46:59.050211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:54:07.128744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'363","reported_seq":430,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:51.399606+0000","last_change":"2024-01-17T22:58:48.344998+0000","last_active":"2024-01-18T00:46:51.399606+0000","last_peered":"2024-01-18T00:46:51.399606+0000","last_clean":"2024-01-18T00:46:51.399606+0000","last_became_active":"2024-01-17T22:58:48.344402+0000","last_became_peered":"2024-01-17T22:58:48.344402+0000","last_unstale":"2024-01-18T00:46:51.399606+0000","last_undegraded":"2024-01-18T00:46:51.399606+0000","last_fullsized":"2024-01-18T00:46:51.399606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:01:21.629083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'821","reported_seq":920,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.698709+0000","last_change":"2024-01-17T22:58:55.886258+0000","last_active":"2024-01-18T00:47:08.698709+0000","last_peered":"2024-01-18T00:47:08.698709+0000","last_clean":"2024-01-18T00:47:08.698709+0000","last_became_active":"2024-01-17T22:58:55.885809+0000","last_became_peered":"2024-01-17T22:58:55.885809+0000","last_unstale":"2024-01-18T00:47:08.698709+0000","last_undegraded":"2024-01-18T00:47:08.698709+0000","last_fullsized":"2024-01-18T00:47:08.698709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:08.327495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":121383,"num_write":812,"num_write_kb":179977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'216","reported_seq":274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651394+0000","last_change":"2024-01-17T22:59:08.654953+0000","last_active":"2024-01-18T00:47:15.651394+0000","last_peered":"2024-01-18T00:47:15.651394+0000","last_clean":"2024-01-18T00:47:15.651394+0000","last_became_active":"2024-01-17T22:59:08.654136+0000","last_became_peered":"2024-01-17T22:59:08.654136+0000","last_unstale":"2024-01-18T00:47:15.651394+0000","last_undegraded":"2024-01-18T00:47:15.651394+0000","last_fullsized":"2024-01-18T00:47:15.651394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:19:02.000223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"28'404","reported_seq":471,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:47.632062+0000","last_change":"2024-01-17T22:58:48.338206+0000","last_active":"2024-01-18T00:45:47.632062+0000","last_peered":"2024-01-18T00:45:47.632062+0000","last_clean":"2024-01-18T00:45:47.632062+0000","last_became_active":"2024-01-17T22:58:48.337489+0000","last_became_peered":"2024-01-17T22:58:48.337489+0000","last_unstale":"2024-01-18T00:45:47.632062+0000","last_undegraded":"2024-01-18T00:45:47.632062+0000","last_fullsized":"2024-01-18T00:45:47.632062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:09:04.579374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'799","reported_seq":898,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.976358+0000","last_change":"2024-01-17T22:58:55.903435+0000","last_active":"2024-01-18T00:47:08.976358+0000","last_peered":"2024-01-18T00:47:08.976358+0000","last_clean":"2024-01-18T00:47:08.976358+0000","last_became_active":"2024-01-17T22:58:55.902857+0000","last_became_peered":"2024-01-17T22:58:55.902857+0000","last_unstale":"2024-01-18T00:47:08.976358+0000","last_undegraded":"2024-01-18T00:47:08.976358+0000","last_fullsized":"2024-01-18T00:47:08.976358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:24:43.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":124542,"num_write":790,"num_write_kb":159708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'183","reported_seq":248,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:44.335190+0000","last_change":"2024-01-17T22:58:49.519307+0000","last_active":"2024-01-18T00:46:44.335190+0000","last_peered":"2024-01-18T00:46:44.335190+0000","last_clean":"2024-01-18T00:46:44.335190+0000","last_became_active":"2024-01-17T22:58:49.519060+0000","last_became_peered":"2024-01-17T22:58:49.519060+0000","last_unstale":"2024-01-18T00:46:44.335190+0000","last_undegraded":"2024-01-18T00:46:44.335190+0000","last_fullsized":"2024-01-18T00:46:44.335190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:48.025499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'863","reported_seq":930,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:33.712846+0000","last_change":"2024-01-17T22:58:48.341584+0000","last_active":"2024-01-18T00:46:33.712846+0000","last_peered":"2024-01-18T00:46:33.712846+0000","last_clean":"2024-01-18T00:46:33.712846+0000","last_became_active":"2024-01-17T22:58:48.339433+0000","last_became_peered":"2024-01-17T22:58:48.339433+0000","last_unstale":"2024-01-18T00:46:33.712846+0000","last_undegraded":"2024-01-18T00:46:33.712846+0000","last_fullsized":"2024-01-18T00:46:33.712846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:01:09.060396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":4462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'819","reported_seq":915,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:13.497911+0000","last_change":"2024-01-17T22:58:55.905118+0000","last_active":"2024-01-18T00:47:13.497911+0000","last_peered":"2024-01-18T00:47:13.497911+0000","last_clean":"2024-01-18T00:47:13.497911+0000","last_became_active":"2024-01-17T22:58:55.904690+0000","last_became_peered":"2024-01-17T22:58:55.904690+0000","last_unstale":"2024-01-18T00:47:13.497911+0000","last_undegraded":"2024-01-18T00:47:13.497911+0000","last_fullsized":"2024-01-18T00:47:13.497911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:45:30.212764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":82183,"num_write":809,"num_write_kb":113772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'190","reported_seq":255,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.654446+0000","last_change":"2024-01-17T22:58:49.352993+0000","last_active":"2024-01-18T00:47:15.654446+0000","last_peered":"2024-01-18T00:47:15.654446+0000","last_clean":"2024-01-18T00:47:15.654446+0000","last_became_active":"2024-01-17T22:58:49.352744+0000","last_became_peered":"2024-01-17T22:58:49.352744+0000","last_unstale":"2024-01-18T00:47:15.654446+0000","last_undegraded":"2024-01-18T00:47:15.654446+0000","last_fullsized":"2024-01-18T00:47:15.654446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:06.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'869","reported_seq":935,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:10.101153+0000","last_change":"2024-01-17T22:58:48.343793+0000","last_active":"2024-01-18T00:45:10.101153+0000","last_peered":"2024-01-18T00:45:10.101153+0000","last_clean":"2024-01-18T00:45:10.101153+0000","last_became_active":"2024-01-17T22:58:48.343435+0000","last_became_peered":"2024-01-17T22:58:48.343435+0000","last_unstale":"2024-01-18T00:45:10.101153+0000","last_undegraded":"2024-01-18T00:45:10.101153+0000","last_fullsized":"2024-01-18T00:45:10.101153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:50:50.592551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":940,"num_write_kb":4497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'797","reported_seq":904,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.109379+0000","last_change":"2024-01-17T22:58:55.913690+0000","last_active":"2024-01-18T00:47:09.109379+0000","last_peered":"2024-01-18T00:47:09.109379+0000","last_clean":"2024-01-18T00:47:09.109379+0000","last_became_active":"2024-01-17T22:58:55.913197+0000","last_became_peered":"2024-01-17T22:58:55.913197+0000","last_unstale":"2024-01-18T00:47:09.109379+0000","last_undegraded":"2024-01-18T00:47:09.109379+0000","last_fullsized":"2024-01-18T00:47:09.109379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:31.829297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":146211,"num_write":781,"num_write_kb":158858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'235","reported_seq":299,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.639362+0000","last_change":"2024-01-17T22:58:49.368242+0000","last_active":"2024-01-18T00:47:15.639362+0000","last_peered":"2024-01-18T00:47:15.639362+0000","last_clean":"2024-01-18T00:47:15.639362+0000","last_became_active":"2024-01-17T22:58:49.368018+0000","last_became_peered":"2024-01-17T22:58:49.368018+0000","last_unstale":"2024-01-18T00:47:15.639362+0000","last_undegraded":"2024-01-18T00:47:15.639362+0000","last_fullsized":"2024-01-18T00:47:15.639362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:49:55.661543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'701","reported_seq":766,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:28.455439+0000","last_change":"2024-01-17T22:58:48.374293+0000","last_active":"2024-01-18T00:46:28.455439+0000","last_peered":"2024-01-18T00:46:28.455439+0000","last_clean":"2024-01-18T00:46:28.455439+0000","last_became_active":"2024-01-17T22:58:48.373287+0000","last_became_peered":"2024-01-17T22:58:48.373287+0000","last_unstale":"2024-01-18T00:46:28.455439+0000","last_undegraded":"2024-01-18T00:46:28.455439+0000","last_fullsized":"2024-01-18T00:46:28.455439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":649,"num_write_kb":8541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'825","reported_seq":940,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.758998+0000","last_change":"2024-01-17T22:58:55.909679+0000","last_active":"2024-01-18T00:46:53.758998+0000","last_peered":"2024-01-18T00:46:53.758998+0000","last_clean":"2024-01-18T00:46:53.758998+0000","last_became_active":"2024-01-17T22:58:55.909139+0000","last_became_peered":"2024-01-17T22:58:55.909139+0000","last_unstale":"2024-01-18T00:46:53.758998+0000","last_undegraded":"2024-01-18T00:46:53.758998+0000","last_fullsized":"2024-01-18T00:46:53.758998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:39:50.993158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":204092,"num_write":802,"num_write_kb":163340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'217","reported_seq":280,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.760302+0000","last_change":"2024-01-17T22:58:49.515761+0000","last_active":"2024-01-18T00:47:15.760302+0000","last_peered":"2024-01-18T00:47:15.760302+0000","last_clean":"2024-01-18T00:47:15.760302+0000","last_became_active":"2024-01-17T22:58:49.514776+0000","last_became_peered":"2024-01-17T22:58:49.514776+0000","last_unstale":"2024-01-18T00:47:15.760302+0000","last_undegraded":"2024-01-18T00:47:15.760302+0000","last_fullsized":"2024-01-18T00:47:15.760302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'64","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:32.504506+0000","last_change":"2024-01-17T22:58:48.349505+0000","last_active":"2024-01-18T00:45:32.504506+0000","last_peered":"2024-01-18T00:45:32.504506+0000","last_clean":"2024-01-18T00:45:32.504506+0000","last_became_active":"2024-01-17T22:58:48.349193+0000","last_became_peered":"2024-01-17T22:58:48.349193+0000","last_unstale":"2024-01-18T00:45:32.504506+0000","last_undegraded":"2024-01-18T00:45:32.504506+0000","last_fullsized":"2024-01-18T00:45:32.504506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:10:59.139723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":842,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'809","reported_seq":919,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.381754+0000","last_change":"2024-01-17T22:58:55.911280+0000","last_active":"2024-01-18T00:47:04.381754+0000","last_peered":"2024-01-18T00:47:04.381754+0000","last_clean":"2024-01-18T00:47:04.381754+0000","last_became_active":"2024-01-17T22:58:55.910147+0000","last_became_peered":"2024-01-17T22:58:55.910147+0000","last_unstale":"2024-01-18T00:47:04.381754+0000","last_undegraded":"2024-01-18T00:47:04.381754+0000","last_fullsized":"2024-01-18T00:47:04.381754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:29:01.453903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":124212,"num_write":791,"num_write_kb":164591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'198","reported_seq":262,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660494+0000","last_change":"2024-01-17T22:58:49.366332+0000","last_active":"2024-01-18T00:47:15.660494+0000","last_peered":"2024-01-18T00:47:15.660494+0000","last_clean":"2024-01-18T00:47:15.660494+0000","last_became_active":"2024-01-17T22:58:49.366055+0000","last_became_peered":"2024-01-17T22:58:49.366055+0000","last_unstale":"2024-01-18T00:47:15.660494+0000","last_undegraded":"2024-01-18T00:47:15.660494+0000","last_fullsized":"2024-01-18T00:47:15.660494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:44:30.888903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'54","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:11.376150+0000","last_change":"2024-01-17T22:58:48.378008+0000","last_active":"2024-01-18T00:46:11.376150+0000","last_peered":"2024-01-18T00:46:11.376150+0000","last_clean":"2024-01-18T00:46:11.376150+0000","last_became_active":"2024-01-17T22:58:48.377732+0000","last_became_peered":"2024-01-17T22:58:48.377732+0000","last_unstale":"2024-01-18T00:46:11.376150+0000","last_undegraded":"2024-01-18T00:46:11.376150+0000","last_fullsized":"2024-01-18T00:46:11.376150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:05.032134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'664","reported_seq":748,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:58.927643+0000","last_change":"2024-01-17T22:59:09.245915+0000","last_active":"2024-01-18T00:46:58.927643+0000","last_peered":"2024-01-18T00:46:58.927643+0000","last_clean":"2024-01-18T00:46:58.927643+0000","last_became_active":"2024-01-17T22:59:09.244621+0000","last_became_peered":"2024-01-17T22:59:09.244621+0000","last_unstale":"2024-01-18T00:46:58.927643+0000","last_undegraded":"2024-01-18T00:46:58.927643+0000","last_fullsized":"2024-01-18T00:46:58.927643+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:01:38.677481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":44179,"num_write":651,"num_write_kb":63897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,5],"acting":[6,4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'209","reported_seq":273,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.828129+0000","last_change":"2024-01-17T22:58:49.368620+0000","last_active":"2024-01-18T00:47:15.828129+0000","last_peered":"2024-01-18T00:47:15.828129+0000","last_clean":"2024-01-18T00:47:15.828129+0000","last_became_active":"2024-01-17T22:58:49.367258+0000","last_became_peered":"2024-01-17T22:58:49.367258+0000","last_unstale":"2024-01-18T00:47:15.828129+0000","last_undegraded":"2024-01-18T00:47:15.828129+0000","last_fullsized":"2024-01-18T00:47:15.828129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:25.515983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'368","reported_seq":433,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:43.489636+0000","last_change":"2024-01-17T22:58:48.371378+0000","last_active":"2024-01-18T00:45:43.489636+0000","last_peered":"2024-01-18T00:45:43.489636+0000","last_clean":"2024-01-18T00:45:43.489636+0000","last_became_active":"2024-01-17T22:58:48.370691+0000","last_became_peered":"2024-01-17T22:58:48.370691+0000","last_unstale":"2024-01-18T00:45:43.489636+0000","last_undegraded":"2024-01-18T00:45:43.489636+0000","last_fullsized":"2024-01-18T00:45:43.489636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:01:21.629083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":8326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'675","reported_seq":751,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:54.053556+0000","last_change":"2024-01-17T22:58:55.846853+0000","last_active":"2024-01-18T00:46:54.053556+0000","last_peered":"2024-01-18T00:46:54.053556+0000","last_clean":"2024-01-18T00:46:54.053556+0000","last_became_active":"2024-01-17T22:58:55.846382+0000","last_became_peered":"2024-01-17T22:58:55.846382+0000","last_unstale":"2024-01-18T00:46:54.053556+0000","last_undegraded":"2024-01-18T00:46:54.053556+0000","last_fullsized":"2024-01-18T00:46:54.053556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:00:22.788812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":43277,"num_write":656,"num_write_kb":56099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'187","reported_seq":249,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:33.722425+0000","last_change":"2024-01-17T22:58:49.367642+0000","last_active":"2024-01-18T00:46:33.722425+0000","last_peered":"2024-01-18T00:46:33.722425+0000","last_clean":"2024-01-18T00:46:33.722425+0000","last_became_active":"2024-01-17T22:58:49.367370+0000","last_became_peered":"2024-01-17T22:58:49.367370+0000","last_unstale":"2024-01-18T00:46:33.722425+0000","last_undegraded":"2024-01-18T00:46:33.722425+0000","last_fullsized":"2024-01-18T00:46:33.722425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:24:43.594840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'1300","reported_seq":1364,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:51.758158+0000","last_change":"2024-01-17T22:58:48.346833+0000","last_active":"2024-01-18T00:46:51.758158+0000","last_peered":"2024-01-18T00:46:51.758158+0000","last_clean":"2024-01-18T00:46:51.758158+0000","last_became_active":"2024-01-17T22:58:48.346574+0000","last_became_peered":"2024-01-17T22:58:48.346574+0000","last_unstale":"2024-01-18T00:46:51.758158+0000","last_undegraded":"2024-01-18T00:46:51.758158+0000","last_fullsized":"2024-01-18T00:46:51.758158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1300,"log_dups_size":0,"ondisk_log_size":1300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:55:23.055396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":13137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'811","reported_seq":915,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.691930+0000","last_change":"2024-01-17T22:58:55.832183+0000","last_active":"2024-01-18T00:47:04.691930+0000","last_peered":"2024-01-18T00:47:04.691930+0000","last_clean":"2024-01-18T00:47:04.691930+0000","last_became_active":"2024-01-17T22:58:55.831090+0000","last_became_peered":"2024-01-17T22:58:55.831090+0000","last_unstale":"2024-01-18T00:47:04.691930+0000","last_undegraded":"2024-01-18T00:47:04.691930+0000","last_fullsized":"2024-01-18T00:47:04.691930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:15.077032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":127549,"num_write":788,"num_write_kb":160232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'198","reported_seq":262,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.664502+0000","last_change":"2024-01-17T22:58:49.366048+0000","last_active":"2024-01-18T00:47:15.664502+0000","last_peered":"2024-01-18T00:47:15.664502+0000","last_clean":"2024-01-18T00:47:15.664502+0000","last_became_active":"2024-01-17T22:58:49.365846+0000","last_became_peered":"2024-01-17T22:58:49.365846+0000","last_unstale":"2024-01-18T00:47:15.664502+0000","last_undegraded":"2024-01-18T00:47:15.664502+0000","last_fullsized":"2024-01-18T00:47:15.664502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:19:02.000223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'1446","reported_seq":1509,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.419203+0000","last_change":"2024-01-17T22:58:48.376099+0000","last_active":"2024-01-18T00:47:09.419203+0000","last_peered":"2024-01-18T00:47:09.419203+0000","last_clean":"2024-01-18T00:47:09.419203+0000","last_became_active":"2024-01-17T22:58:48.375504+0000","last_became_peered":"2024-01-17T22:58:48.375504+0000","last_unstale":"2024-01-18T00:47:09.419203+0000","last_undegraded":"2024-01-18T00:47:09.419203+0000","last_fullsized":"2024-01-18T00:47:09.419203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1446,"log_dups_size":0,"ondisk_log_size":1446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1379,"num_write_kb":5332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'771","reported_seq":867,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.139685+0000","last_change":"2024-01-17T22:58:55.906751+0000","last_active":"2024-01-18T00:47:09.139685+0000","last_peered":"2024-01-18T00:47:09.139685+0000","last_clean":"2024-01-18T00:47:09.139685+0000","last_became_active":"2024-01-17T22:58:55.906429+0000","last_became_peered":"2024-01-17T22:58:55.906429+0000","last_unstale":"2024-01-18T00:47:09.139685+0000","last_undegraded":"2024-01-18T00:47:09.139685+0000","last_fullsized":"2024-01-18T00:47:09.139685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:37:20.317014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":103553,"num_write":751,"num_write_kb":113909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'194","reported_seq":256,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:49.621926+0000","last_change":"2024-01-17T22:58:49.361059+0000","last_active":"2024-01-18T00:46:49.621926+0000","last_peered":"2024-01-18T00:46:49.621926+0000","last_clean":"2024-01-18T00:46:49.621926+0000","last_became_active":"2024-01-17T22:58:49.360282+0000","last_became_peered":"2024-01-17T22:58:49.360282+0000","last_unstale":"2024-01-18T00:46:49.621926+0000","last_undegraded":"2024-01-18T00:46:49.621926+0000","last_fullsized":"2024-01-18T00:46:49.621926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:10:15.673364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'183","reported_seq":246,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:13.525813+0000","last_change":"2024-01-17T22:58:48.349585+0000","last_active":"2024-01-18T00:45:13.525813+0000","last_peered":"2024-01-18T00:45:13.525813+0000","last_clean":"2024-01-18T00:45:13.525813+0000","last_became_active":"2024-01-17T22:58:48.349262+0000","last_became_peered":"2024-01-17T22:58:48.349262+0000","last_unstale":"2024-01-18T00:45:13.525813+0000","last_undegraded":"2024-01-18T00:45:13.525813+0000","last_fullsized":"2024-01-18T00:45:13.525813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:32:48.765965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'853","reported_seq":942,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.911679+0000","last_change":"2024-01-17T22:58:55.899604+0000","last_active":"2024-01-18T00:47:04.911679+0000","last_peered":"2024-01-18T00:47:04.911679+0000","last_clean":"2024-01-18T00:47:04.911679+0000","last_became_active":"2024-01-17T22:58:55.899176+0000","last_became_peered":"2024-01-17T22:58:55.899176+0000","last_unstale":"2024-01-18T00:47:04.911679+0000","last_undegraded":"2024-01-18T00:47:04.911679+0000","last_fullsized":"2024-01-18T00:47:04.911679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:47.829295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":85515,"num_write":843,"num_write_kb":192821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'218","reported_seq":279,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651074+0000","last_change":"2024-01-17T22:58:49.364258+0000","last_active":"2024-01-18T00:47:15.651074+0000","last_peered":"2024-01-18T00:47:15.651074+0000","last_clean":"2024-01-18T00:47:15.651074+0000","last_became_active":"2024-01-17T22:58:49.363979+0000","last_became_peered":"2024-01-17T22:58:49.363979+0000","last_unstale":"2024-01-18T00:47:15.651074+0000","last_undegraded":"2024-01-18T00:47:15.651074+0000","last_fullsized":"2024-01-18T00:47:15.651074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:15:17.927996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'57","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:19.024164+0000","last_change":"2024-01-17T22:58:48.321573+0000","last_active":"2024-01-18T00:46:19.024164+0000","last_peered":"2024-01-18T00:46:19.024164+0000","last_clean":"2024-01-18T00:46:19.024164+0000","last_became_active":"2024-01-17T22:58:48.321379+0000","last_became_peered":"2024-01-17T22:58:48.321379+0000","last_unstale":"2024-01-18T00:46:19.024164+0000","last_undegraded":"2024-01-18T00:46:19.024164+0000","last_fullsized":"2024-01-18T00:46:19.024164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:55:23.055396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'867","reported_seq":978,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.750269+0000","last_change":"2024-01-17T22:58:55.873529+0000","last_active":"2024-01-18T00:47:08.750269+0000","last_peered":"2024-01-18T00:47:08.750269+0000","last_clean":"2024-01-18T00:47:08.750269+0000","last_became_active":"2024-01-17T22:58:55.872885+0000","last_became_peered":"2024-01-17T22:58:55.872885+0000","last_unstale":"2024-01-18T00:47:08.750269+0000","last_undegraded":"2024-01-18T00:47:08.750269+0000","last_fullsized":"2024-01-18T00:47:08.750269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:50:01.974857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":173952,"num_write":855,"num_write_kb":180962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'734","reported_seq":837,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.313232+0000","last_change":"2024-01-17T22:58:55.903620+0000","last_active":"2024-01-18T00:47:04.313232+0000","last_peered":"2024-01-18T00:47:04.313232+0000","last_clean":"2024-01-18T00:47:04.313232+0000","last_became_active":"2024-01-17T22:58:55.902860+0000","last_became_peered":"2024-01-17T22:58:55.902860+0000","last_unstale":"2024-01-18T00:47:04.313232+0000","last_undegraded":"2024-01-18T00:47:04.313232+0000","last_fullsized":"2024-01-18T00:47:04.313232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:33:56.437178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":112144,"num_write":721,"num_write_kb":109826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'202","reported_seq":264,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.652277+0000","last_change":"2024-01-17T22:58:49.515108+0000","last_active":"2024-01-18T00:47:15.652277+0000","last_peered":"2024-01-18T00:47:15.652277+0000","last_clean":"2024-01-18T00:47:15.652277+0000","last_became_active":"2024-01-17T22:58:49.514297+0000","last_became_peered":"2024-01-17T22:58:49.514297+0000","last_unstale":"2024-01-18T00:47:15.652277+0000","last_undegraded":"2024-01-18T00:47:15.652277+0000","last_fullsized":"2024-01-18T00:47:15.652277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:15.814647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'1279","reported_seq":1342,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:11.369763+0000","last_change":"2024-01-17T22:58:48.331952+0000","last_active":"2024-01-18T00:45:11.369763+0000","last_peered":"2024-01-18T00:45:11.369763+0000","last_clean":"2024-01-18T00:45:11.369763+0000","last_became_active":"2024-01-17T22:58:48.331645+0000","last_became_peered":"2024-01-17T22:58:48.331645+0000","last_unstale":"2024-01-18T00:45:11.369763+0000","last_undegraded":"2024-01-18T00:45:11.369763+0000","last_fullsized":"2024-01-18T00:45:11.369763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1279,"log_dups_size":0,"ondisk_log_size":1279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:24.260824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":12872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'696","reported_seq":781,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.985592+0000","last_change":"2024-01-17T22:58:55.906062+0000","last_active":"2024-01-18T00:47:08.985592+0000","last_peered":"2024-01-18T00:47:08.985592+0000","last_clean":"2024-01-18T00:47:08.985592+0000","last_became_active":"2024-01-17T22:58:55.905743+0000","last_became_peered":"2024-01-17T22:58:55.905743+0000","last_unstale":"2024-01-18T00:47:08.985592+0000","last_undegraded":"2024-01-18T00:47:08.985592+0000","last_fullsized":"2024-01-18T00:47:08.985592+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:19:20.308367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":59282,"num_write":679,"num_write_kb":96928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'229","reported_seq":291,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.925040+0000","last_change":"2024-01-17T22:58:49.369540+0000","last_active":"2024-01-18T00:47:04.925040+0000","last_peered":"2024-01-18T00:47:04.925040+0000","last_clean":"2024-01-18T00:47:04.925040+0000","last_became_active":"2024-01-17T22:58:49.366692+0000","last_became_peered":"2024-01-17T22:58:49.366692+0000","last_unstale":"2024-01-18T00:47:04.925040+0000","last_undegraded":"2024-01-18T00:47:04.925040+0000","last_fullsized":"2024-01-18T00:47:04.925040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:39:54.814019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'170","reported_seq":233,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.968197+0000","last_change":"2024-01-17T22:58:48.345003+0000","last_active":"2024-01-18T00:46:53.968197+0000","last_peered":"2024-01-18T00:46:53.968197+0000","last_clean":"2024-01-18T00:46:53.968197+0000","last_became_active":"2024-01-17T22:58:48.344271+0000","last_became_peered":"2024-01-17T22:58:48.344271+0000","last_unstale":"2024-01-18T00:46:53.968197+0000","last_undegraded":"2024-01-18T00:46:53.968197+0000","last_fullsized":"2024-01-18T00:46:53.968197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:51:00.037407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'1514","reported_seq":1576,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.329841+0000","last_change":"2024-01-17T22:58:48.342292+0000","last_active":"2024-01-18T00:47:15.329841+0000","last_peered":"2024-01-18T00:47:15.329841+0000","last_clean":"2024-01-18T00:47:15.329841+0000","last_became_active":"2024-01-17T22:58:48.339364+0000","last_became_peered":"2024-01-17T22:58:48.339364+0000","last_unstale":"2024-01-18T00:47:15.329841+0000","last_undegraded":"2024-01-18T00:47:15.329841+0000","last_fullsized":"2024-01-18T00:47:15.329841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1514,"log_dups_size":0,"ondisk_log_size":1514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:51.848489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16419543,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1459,"num_write_kb":16764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'186","reported_seq":247,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.645647+0000","last_change":"2024-01-17T22:58:49.414836+0000","last_active":"2024-01-18T00:47:15.645647+0000","last_peered":"2024-01-18T00:47:15.645647+0000","last_clean":"2024-01-18T00:47:15.645647+0000","last_became_active":"2024-01-17T22:58:49.414163+0000","last_became_peered":"2024-01-17T22:58:49.414163+0000","last_unstale":"2024-01-18T00:47:15.645647+0000","last_undegraded":"2024-01-18T00:47:15.645647+0000","last_fullsized":"2024-01-18T00:47:15.645647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:24.988174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'765","reported_seq":855,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:44.182734+0000","last_change":"2024-01-17T22:58:55.880197+0000","last_active":"2024-01-18T00:46:44.182734+0000","last_peered":"2024-01-18T00:46:44.182734+0000","last_clean":"2024-01-18T00:46:44.182734+0000","last_became_active":"2024-01-17T22:58:55.879263+0000","last_became_peered":"2024-01-17T22:58:55.879263+0000","last_unstale":"2024-01-18T00:46:44.182734+0000","last_undegraded":"2024-01-18T00:46:44.182734+0000","last_fullsized":"2024-01-18T00:46:44.182734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:47:02.273099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":97351,"num_write":747,"num_write_kb":155607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'207","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:19.012190+0000","last_change":"2024-01-17T22:58:48.339419+0000","last_active":"2024-01-18T00:46:19.012190+0000","last_peered":"2024-01-18T00:46:19.012190+0000","last_clean":"2024-01-18T00:46:19.012190+0000","last_became_active":"2024-01-17T22:58:48.338809+0000","last_became_peered":"2024-01-17T22:58:48.338809+0000","last_unstale":"2024-01-18T00:46:19.012190+0000","last_undegraded":"2024-01-18T00:46:19.012190+0000","last_fullsized":"2024-01-18T00:46:19.012190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:20:07.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'206","reported_seq":266,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.760461+0000","last_change":"2024-01-17T22:58:49.518469+0000","last_active":"2024-01-18T00:47:15.760461+0000","last_peered":"2024-01-18T00:47:15.760461+0000","last_clean":"2024-01-18T00:47:15.760461+0000","last_became_active":"2024-01-17T22:58:49.518211+0000","last_became_peered":"2024-01-17T22:58:49.518211+0000","last_unstale":"2024-01-18T00:47:15.760461+0000","last_undegraded":"2024-01-18T00:47:15.760461+0000","last_fullsized":"2024-01-18T00:47:15.760461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:22.954968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'779","reported_seq":879,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:44.254665+0000","last_change":"2024-01-17T22:58:55.913601+0000","last_active":"2024-01-18T00:46:44.254665+0000","last_peered":"2024-01-18T00:46:44.254665+0000","last_clean":"2024-01-18T00:46:44.254665+0000","last_became_active":"2024-01-17T22:58:55.912825+0000","last_became_peered":"2024-01-17T22:58:55.912825+0000","last_unstale":"2024-01-18T00:46:44.254665+0000","last_undegraded":"2024-01-18T00:46:44.254665+0000","last_fullsized":"2024-01-18T00:46:44.254665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:36.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":138691,"num_write":762,"num_write_kb":151906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'221","reported_seq":290,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651529+0000","last_change":"2024-01-17T22:58:49.371282+0000","last_active":"2024-01-18T00:47:15.651529+0000","last_peered":"2024-01-18T00:47:15.651529+0000","last_clean":"2024-01-18T00:47:15.651529+0000","last_became_active":"2024-01-17T22:58:49.371125+0000","last_became_peered":"2024-01-17T22:58:49.371125+0000","last_unstale":"2024-01-18T00:47:15.651529+0000","last_undegraded":"2024-01-18T00:47:15.651529+0000","last_fullsized":"2024-01-18T00:47:15.651529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'215","reported_seq":285,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.682799+0000","last_change":"2024-01-17T22:58:49.510490+0000","last_active":"2024-01-18T00:47:15.682799+0000","last_peered":"2024-01-18T00:47:15.682799+0000","last_clean":"2024-01-18T00:47:15.682799+0000","last_became_active":"2024-01-17T22:58:49.509690+0000","last_became_peered":"2024-01-17T22:58:49.509690+0000","last_unstale":"2024-01-18T00:47:15.682799+0000","last_undegraded":"2024-01-18T00:47:15.682799+0000","last_fullsized":"2024-01-18T00:47:15.682799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'233","reported_seq":303,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.659973+0000","last_change":"2024-01-17T22:58:49.371326+0000","last_active":"2024-01-18T00:47:15.659973+0000","last_peered":"2024-01-18T00:47:15.659973+0000","last_clean":"2024-01-18T00:47:15.659973+0000","last_became_active":"2024-01-17T22:58:49.370511+0000","last_became_peered":"2024-01-17T22:58:49.370511+0000","last_unstale":"2024-01-18T00:47:15.659973+0000","last_undegraded":"2024-01-18T00:47:15.659973+0000","last_fullsized":"2024-01-18T00:47:15.659973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:46:55.959786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'202","reported_seq":271,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.827677+0000","last_change":"2024-01-17T22:58:49.385500+0000","last_active":"2024-01-18T00:46:53.827677+0000","last_peered":"2024-01-18T00:46:53.827677+0000","last_clean":"2024-01-18T00:46:53.827677+0000","last_became_active":"2024-01-17T22:58:49.384397+0000","last_became_peered":"2024-01-17T22:58:49.384397+0000","last_unstale":"2024-01-18T00:46:53.827677+0000","last_undegraded":"2024-01-18T00:46:53.827677+0000","last_fullsized":"2024-01-18T00:46:53.827677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:18.563360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'188","reported_seq":256,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.834261+0000","last_change":"2024-01-17T22:58:49.369750+0000","last_active":"2024-01-18T00:47:15.834261+0000","last_peered":"2024-01-18T00:47:15.834261+0000","last_clean":"2024-01-18T00:47:15.834261+0000","last_became_active":"2024-01-17T22:58:49.368591+0000","last_became_peered":"2024-01-17T22:58:49.368591+0000","last_unstale":"2024-01-18T00:47:15.834261+0000","last_undegraded":"2024-01-18T00:47:15.834261+0000","last_fullsized":"2024-01-18T00:47:15.834261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:59.773063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'203","reported_seq":271,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.827054+0000","last_change":"2024-01-17T22:58:49.380275+0000","last_active":"2024-01-18T00:47:15.827054+0000","last_peered":"2024-01-18T00:47:15.827054+0000","last_clean":"2024-01-18T00:47:15.827054+0000","last_became_active":"2024-01-17T22:58:49.379560+0000","last_became_peered":"2024-01-17T22:58:49.379560+0000","last_unstale":"2024-01-18T00:47:15.827054+0000","last_undegraded":"2024-01-18T00:47:15.827054+0000","last_fullsized":"2024-01-18T00:47:15.827054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:41.515981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'241","reported_seq":308,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651008+0000","last_change":"2024-01-17T22:58:49.368509+0000","last_active":"2024-01-18T00:47:15.651008+0000","last_peered":"2024-01-18T00:47:15.651008+0000","last_clean":"2024-01-18T00:47:15.651008+0000","last_became_active":"2024-01-17T22:58:49.367330+0000","last_became_peered":"2024-01-17T22:58:49.367330+0000","last_unstale":"2024-01-18T00:47:15.651008+0000","last_undegraded":"2024-01-18T00:47:15.651008+0000","last_fullsized":"2024-01-18T00:47:15.651008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'192","reported_seq":260,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.697801+0000","last_change":"2024-01-17T22:58:49.514419+0000","last_active":"2024-01-18T00:47:08.697801+0000","last_peered":"2024-01-18T00:47:08.697801+0000","last_clean":"2024-01-18T00:47:08.697801+0000","last_became_active":"2024-01-17T22:58:49.513924+0000","last_became_peered":"2024-01-17T22:58:49.513924+0000","last_unstale":"2024-01-18T00:47:08.697801+0000","last_undegraded":"2024-01-18T00:47:08.697801+0000","last_fullsized":"2024-01-18T00:47:08.697801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:24:43.594840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'222","reported_seq":289,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660244+0000","last_change":"2024-01-17T22:58:49.371064+0000","last_active":"2024-01-18T00:47:15.660244+0000","last_peered":"2024-01-18T00:47:15.660244+0000","last_clean":"2024-01-18T00:47:15.660244+0000","last_became_active":"2024-01-17T22:58:49.370808+0000","last_became_peered":"2024-01-17T22:58:49.370808+0000","last_unstale":"2024-01-18T00:47:15.660244+0000","last_undegraded":"2024-01-18T00:47:15.660244+0000","last_fullsized":"2024-01-18T00:47:15.660244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:39.502451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'195","reported_seq":261,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.757041+0000","last_change":"2024-01-17T22:58:49.350539+0000","last_active":"2024-01-18T00:46:53.757041+0000","last_peered":"2024-01-18T00:46:53.757041+0000","last_clean":"2024-01-18T00:46:53.757041+0000","last_became_active":"2024-01-17T22:58:49.350057+0000","last_became_peered":"2024-01-17T22:58:49.350057+0000","last_unstale":"2024-01-18T00:46:53.757041+0000","last_undegraded":"2024-01-18T00:46:53.757041+0000","last_fullsized":"2024-01-18T00:46:53.757041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:43.516572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'209","reported_seq":274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.697094+0000","last_change":"2024-01-17T22:58:49.517955+0000","last_active":"2024-01-18T00:47:15.697094+0000","last_peered":"2024-01-18T00:47:15.697094+0000","last_clean":"2024-01-18T00:47:15.697094+0000","last_became_active":"2024-01-17T22:58:49.517631+0000","last_became_peered":"2024-01-17T22:58:49.517631+0000","last_unstale":"2024-01-18T00:47:15.697094+0000","last_undegraded":"2024-01-18T00:47:15.697094+0000","last_fullsized":"2024-01-18T00:47:15.697094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:41:25.372897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'203","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.656287+0000","last_change":"2024-01-17T22:58:49.412901+0000","last_active":"2024-01-18T00:47:15.656287+0000","last_peered":"2024-01-18T00:47:15.656287+0000","last_clean":"2024-01-18T00:47:15.656287+0000","last_became_active":"2024-01-17T22:58:49.411772+0000","last_became_peered":"2024-01-17T22:58:49.411772+0000","last_unstale":"2024-01-18T00:47:15.656287+0000","last_undegraded":"2024-01-18T00:47:15.656287+0000","last_fullsized":"2024-01-18T00:47:15.656287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:30.366002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'220","reported_seq":278,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.681236+0000","last_change":"2024-01-17T22:59:08.750879+0000","last_active":"2024-01-18T00:47:15.681236+0000","last_peered":"2024-01-18T00:47:15.681236+0000","last_clean":"2024-01-18T00:47:15.681236+0000","last_became_active":"2024-01-17T22:59:08.750082+0000","last_became_peered":"2024-01-17T22:59:08.750082+0000","last_unstale":"2024-01-18T00:47:15.681236+0000","last_undegraded":"2024-01-18T00:47:15.681236+0000","last_fullsized":"2024-01-18T00:47:15.681236+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:49:12.522334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"28'209","reported_seq":274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660224+0000","last_change":"2024-01-17T22:58:49.415138+0000","last_active":"2024-01-18T00:47:15.660224+0000","last_peered":"2024-01-18T00:47:15.660224+0000","last_clean":"2024-01-18T00:47:15.660224+0000","last_became_active":"2024-01-17T22:58:49.414598+0000","last_became_peered":"2024-01-17T22:58:49.414598+0000","last_unstale":"2024-01-18T00:47:15.660224+0000","last_undegraded":"2024-01-18T00:47:15.660224+0000","last_fullsized":"2024-01-18T00:47:15.660224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:40.477976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'191","reported_seq":255,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.676927+0000","last_change":"2024-01-17T22:58:49.388702+0000","last_active":"2024-01-18T00:47:15.676927+0000","last_peered":"2024-01-18T00:47:15.676927+0000","last_clean":"2024-01-18T00:47:15.676927+0000","last_became_active":"2024-01-17T22:58:49.388096+0000","last_became_peered":"2024-01-17T22:58:49.388096+0000","last_unstale":"2024-01-18T00:47:15.676927+0000","last_undegraded":"2024-01-18T00:47:15.676927+0000","last_fullsized":"2024-01-18T00:47:15.676927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'199","reported_seq":263,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.656730+0000","last_change":"2024-01-17T22:58:49.370433+0000","last_active":"2024-01-18T00:47:15.656730+0000","last_peered":"2024-01-18T00:47:15.656730+0000","last_clean":"2024-01-18T00:47:15.656730+0000","last_became_active":"2024-01-17T22:58:49.369959+0000","last_became_peered":"2024-01-17T22:58:49.369959+0000","last_unstale":"2024-01-18T00:47:15.656730+0000","last_undegraded":"2024-01-18T00:47:15.656730+0000","last_fullsized":"2024-01-18T00:47:15.656730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:41:09.206436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'218","reported_seq":282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660310+0000","last_change":"2024-01-17T22:58:49.366356+0000","last_active":"2024-01-18T00:47:15.660310+0000","last_peered":"2024-01-18T00:47:15.660310+0000","last_clean":"2024-01-18T00:47:15.660310+0000","last_became_active":"2024-01-17T22:58:49.366122+0000","last_became_peered":"2024-01-17T22:58:49.366122+0000","last_unstale":"2024-01-18T00:47:15.660310+0000","last_undegraded":"2024-01-18T00:47:15.660310+0000","last_fullsized":"2024-01-18T00:47:15.660310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:33:50.123865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'207","reported_seq":271,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.757756+0000","last_change":"2024-01-17T22:58:49.349380+0000","last_active":"2024-01-18T00:46:53.757756+0000","last_peered":"2024-01-18T00:46:53.757756+0000","last_clean":"2024-01-18T00:46:53.757756+0000","last_became_active":"2024-01-17T22:58:49.348630+0000","last_became_peered":"2024-01-17T22:58:49.348630+0000","last_unstale":"2024-01-18T00:46:53.757756+0000","last_undegraded":"2024-01-18T00:46:53.757756+0000","last_fullsized":"2024-01-18T00:46:53.757756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:59:07.405202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'210","reported_seq":274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.831144+0000","last_change":"2024-01-17T22:58:49.383079+0000","last_active":"2024-01-18T00:47:15.831144+0000","last_peered":"2024-01-18T00:47:15.831144+0000","last_clean":"2024-01-18T00:47:15.831144+0000","last_became_active":"2024-01-17T22:58:49.382454+0000","last_became_peered":"2024-01-17T22:58:49.382454+0000","last_unstale":"2024-01-18T00:47:15.831144+0000","last_undegraded":"2024-01-18T00:47:15.831144+0000","last_fullsized":"2024-01-18T00:47:15.831144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:48.465209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'196","reported_seq":258,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.832951+0000","last_change":"2024-01-17T22:58:49.366078+0000","last_active":"2024-01-18T00:47:15.832951+0000","last_peered":"2024-01-18T00:47:15.832951+0000","last_clean":"2024-01-18T00:47:15.832951+0000","last_became_active":"2024-01-17T22:58:49.364509+0000","last_became_peered":"2024-01-17T22:58:49.364509+0000","last_unstale":"2024-01-18T00:47:15.832951+0000","last_undegraded":"2024-01-18T00:47:15.832951+0000","last_fullsized":"2024-01-18T00:47:15.832951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:44.036981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'164","reported_seq":226,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:09.454399+0000","last_change":"2024-01-17T22:58:49.518204+0000","last_active":"2024-01-18T00:46:09.454399+0000","last_peered":"2024-01-18T00:46:09.454399+0000","last_clean":"2024-01-18T00:46:09.454399+0000","last_became_active":"2024-01-17T22:58:49.517927+0000","last_became_peered":"2024-01-17T22:58:49.517927+0000","last_unstale":"2024-01-18T00:46:09.454399+0000","last_undegraded":"2024-01-18T00:46:09.454399+0000","last_fullsized":"2024-01-18T00:46:09.454399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:04:38.588573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'169","reported_seq":231,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.884153+0000","last_change":"2024-01-17T22:58:49.364080+0000","last_active":"2024-01-18T00:46:53.884153+0000","last_peered":"2024-01-18T00:46:53.884153+0000","last_clean":"2024-01-18T00:46:53.884153+0000","last_became_active":"2024-01-17T22:58:49.363804+0000","last_became_peered":"2024-01-17T22:58:49.363804+0000","last_unstale":"2024-01-18T00:46:53.884153+0000","last_undegraded":"2024-01-18T00:46:53.884153+0000","last_fullsized":"2024-01-18T00:46:53.884153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:59:07.405202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"28'200","reported_seq":262,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:39.696311+0000","last_change":"2024-01-17T22:58:49.352782+0000","last_active":"2024-01-18T00:46:39.696311+0000","last_peered":"2024-01-18T00:46:39.696311+0000","last_clean":"2024-01-18T00:46:39.696311+0000","last_became_active":"2024-01-17T22:58:49.352513+0000","last_became_peered":"2024-01-17T22:58:49.352513+0000","last_unstale":"2024-01-18T00:46:39.696311+0000","last_undegraded":"2024-01-18T00:46:39.696311+0000","last_fullsized":"2024-01-18T00:46:39.696311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:39:54.814019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'213","reported_seq":274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.759028+0000","last_change":"2024-01-17T22:58:49.519775+0000","last_active":"2024-01-18T00:47:15.759028+0000","last_peered":"2024-01-18T00:47:15.759028+0000","last_clean":"2024-01-18T00:47:15.759028+0000","last_became_active":"2024-01-17T22:58:49.518646+0000","last_became_peered":"2024-01-17T22:58:49.518646+0000","last_unstale":"2024-01-18T00:47:15.759028+0000","last_undegraded":"2024-01-18T00:47:15.759028+0000","last_fullsized":"2024-01-18T00:47:15.759028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'189","reported_seq":250,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:39.599658+0000","last_change":"2024-01-17T22:58:49.349737+0000","last_active":"2024-01-18T00:46:39.599658+0000","last_peered":"2024-01-18T00:46:39.599658+0000","last_clean":"2024-01-18T00:46:39.599658+0000","last_became_active":"2024-01-17T22:58:49.349021+0000","last_became_peered":"2024-01-17T22:58:49.349021+0000","last_unstale":"2024-01-18T00:46:39.599658+0000","last_undegraded":"2024-01-18T00:46:39.599658+0000","last_fullsized":"2024-01-18T00:46:39.599658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:42:24.949957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'197","reported_seq":258,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:43.876345+0000","last_change":"2024-01-17T22:58:49.415068+0000","last_active":"2024-01-18T00:46:43.876345+0000","last_peered":"2024-01-18T00:46:43.876345+0000","last_clean":"2024-01-18T00:46:43.876345+0000","last_became_active":"2024-01-17T22:58:49.414856+0000","last_became_peered":"2024-01-17T22:58:49.414856+0000","last_unstale":"2024-01-18T00:46:43.876345+0000","last_undegraded":"2024-01-18T00:46:43.876345+0000","last_fullsized":"2024-01-18T00:46:43.876345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:02:07.535209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'190","reported_seq":250,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.653814+0000","last_change":"2024-01-17T22:58:49.414783+0000","last_active":"2024-01-18T00:47:15.653814+0000","last_peered":"2024-01-18T00:47:15.653814+0000","last_clean":"2024-01-18T00:47:15.653814+0000","last_became_active":"2024-01-17T22:58:49.414446+0000","last_became_peered":"2024-01-17T22:58:49.414446+0000","last_unstale":"2024-01-18T00:47:15.653814+0000","last_undegraded":"2024-01-18T00:47:15.653814+0000","last_fullsized":"2024-01-18T00:47:15.653814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'204","reported_seq":265,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:59.142292+0000","last_change":"2024-01-17T22:58:49.357264+0000","last_active":"2024-01-18T00:46:59.142292+0000","last_peered":"2024-01-18T00:46:59.142292+0000","last_clean":"2024-01-18T00:46:59.142292+0000","last_became_active":"2024-01-17T22:58:49.357085+0000","last_became_peered":"2024-01-17T22:58:49.357085+0000","last_unstale":"2024-01-18T00:46:59.142292+0000","last_undegraded":"2024-01-18T00:46:59.142292+0000","last_fullsized":"2024-01-18T00:46:59.142292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:13:09.466879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'196","reported_seq":266,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.654962+0000","last_change":"2024-01-17T22:58:49.414726+0000","last_active":"2024-01-18T00:47:15.654962+0000","last_peered":"2024-01-18T00:47:15.654962+0000","last_clean":"2024-01-18T00:47:15.654962+0000","last_became_active":"2024-01-17T22:58:49.414490+0000","last_became_peered":"2024-01-17T22:58:49.414490+0000","last_unstale":"2024-01-18T00:47:15.654962+0000","last_undegraded":"2024-01-18T00:47:15.654962+0000","last_fullsized":"2024-01-18T00:47:15.654962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:48.465209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'189","reported_seq":259,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.975642+0000","last_change":"2024-01-17T22:58:49.413155+0000","last_active":"2024-01-18T00:47:08.975642+0000","last_peered":"2024-01-18T00:47:08.975642+0000","last_clean":"2024-01-18T00:47:08.975642+0000","last_became_active":"2024-01-17T22:58:49.412382+0000","last_became_peered":"2024-01-17T22:58:49.412382+0000","last_unstale":"2024-01-18T00:47:08.975642+0000","last_undegraded":"2024-01-18T00:47:08.975642+0000","last_fullsized":"2024-01-18T00:47:08.975642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:04:38.588573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'197","reported_seq":267,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:58.956101+0000","last_change":"2024-01-17T22:58:49.368686+0000","last_active":"2024-01-18T00:46:58.956101+0000","last_peered":"2024-01-18T00:46:58.956101+0000","last_clean":"2024-01-18T00:46:58.956101+0000","last_became_active":"2024-01-17T22:58:49.367979+0000","last_became_peered":"2024-01-17T22:58:49.367979+0000","last_unstale":"2024-01-18T00:46:58.956101+0000","last_undegraded":"2024-01-18T00:46:58.956101+0000","last_fullsized":"2024-01-18T00:46:58.956101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:02:12.309297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'191","reported_seq":261,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.049586+0000","last_change":"2024-01-17T22:58:49.364561+0000","last_active":"2024-01-18T00:47:09.049586+0000","last_peered":"2024-01-18T00:47:09.049586+0000","last_clean":"2024-01-18T00:47:09.049586+0000","last_became_active":"2024-01-17T22:58:49.363810+0000","last_became_peered":"2024-01-17T22:58:49.363810+0000","last_unstale":"2024-01-18T00:47:09.049586+0000","last_undegraded":"2024-01-18T00:47:09.049586+0000","last_fullsized":"2024-01-18T00:47:09.049586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:02:12.309297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1120,"num_read_kb":3534792,"num_write":24383,"num_write_kb":4330508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24895,"ondisk_log_size":24895,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12961,"ondisk_log_size":12961,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":198335705,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":1788,"num_read_kb":2847,"num_write":22487,"num_write_kb":206431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":181751808,"data_stored":396665421,"data_compressed":51062148,"data_compressed_allocated":68689920,"data_compressed_original":283754496,"omap_allocated":0,"internal_metadata":0},"log_size":21982,"ondisk_log_size":21982,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":62458,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510752,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124208,"kb_used_data":12584,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94247632,"statfs":{"total":96636764160,"available":96509575168,"internally_reserved":0,"allocated":12886016,"data_stored":31038270,"data_compressed":4325598,"data_compressed_allocated":5689344,"data_compressed_original":24039424,"omap_allocated":1590,"internal_metadata":114293194},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.89200000000000002,"15min":0.88600000000000001},"min":{"1min":0.54800000000000004,"5min":0.42899999999999999,"15min":0.35399999999999998},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.84699999999999998,"15min":0.85299999999999998},"min":{"1min":0.66900000000000004,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.306,"5min":1.3240000000000001,"15min":1.603},"last":0.91300000000000003}]},{"osd":1,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.92700000000000005,"15min":0.90600000000000003},"min":{"1min":0.626,"5min":0.46500000000000002,"15min":0.41499999999999998},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":0.625},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.90700000000000003,"15min":0.89300000000000002},"min":{"1min":0.68100000000000005,"5min":0.44600000000000001,"15min":0.28899999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.722},"last":0.78400000000000003}]},{"osd":2,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.58899999999999997,"5min":0.45400000000000001,"15min":0.441},"max":{"1min":1.1970000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.169,"5min":1.038,"15min":0.98099999999999998},"min":{"1min":0.86399999999999999,"5min":0.50600000000000001,"15min":0.45800000000000002},"max":{"1min":2.7370000000000001,"5min":2.7370000000000001,"15min":2.7370000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.89400000000000002,"15min":0.90300000000000002},"min":{"1min":0.60099999999999998,"5min":0.54000000000000004,"15min":0.48099999999999998},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.872},{"interface":"front","average":{"1min":1.123,"5min":1.0609999999999999,"15min":1.0449999999999999},"min":{"1min":0.80400000000000005,"5min":0.54700000000000004,"15min":0.5},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":0.83699999999999997}]},{"osd":4,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.999,"15min":1.018},"min":{"1min":0.59699999999999998,"5min":0.40100000000000002,"15min":0.32900000000000001},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.837},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0089999999999999,"15min":1.03},"min":{"1min":0.54700000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.0029999999999999}]},{"osd":5,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.171,"15min":1.159},"min":{"1min":0.54500000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":1.079},{"interface":"front","average":{"1min":1.179,"5min":1.141,"15min":1.1619999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.435},"max":{"1min":1.859,"5min":1.859,"15min":1.9159999999999999},"last":1.1639999999999999}]},{"osd":6,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.1839999999999999,"15min":1.196},"min":{"1min":0.54200000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.889,"5min":1.889,"15min":2.0209999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.1519999999999999,"15min":1.1679999999999999},"min":{"1min":0.86399999999999999,"5min":0.53000000000000003,"15min":0.50900000000000001},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.052}]}]},{"osd":6,"up_from":15,"seq":64424510751,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83092,"kb_used_data":15820,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94288748,"statfs":{"total":96636764160,"available":96551677952,"internally_reserved":0,"allocated":16199680,"data_stored":33676965,"data_compressed":4280237,"data_compressed_allocated":5771264,"data_compressed_original":23433216,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85999999999999999,"15min":0.84799999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.44},"max":{"1min":1.2849999999999999,"5min":1.5580000000000001,"15min":1.788},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.878,"15min":0.84899999999999998},"min":{"1min":0.52500000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.96099999999999997}]},{"osd":1,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.83699999999999997,"15min":0.82199999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.45800000000000002},"max":{"1min":1.167,"5min":1.478,"15min":1.8540000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.018,"5min":0.93200000000000005,"15min":0.89500000000000002},"min":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.42999999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.641},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.95199999999999996,"15min":0.94099999999999995},"min":{"1min":0.59799999999999998,"5min":0.54300000000000004,"15min":0.496},"max":{"1min":1.7030000000000001,"5min":1.766,"15min":1.766},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.96199999999999997,"15min":0.94399999999999995},"min":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.48499999999999999},"max":{"1min":1.4750000000000001,"5min":1.5629999999999999,"15min":2.1619999999999999},"last":0.71499999999999997}]},{"osd":3,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.012,"15min":0.98399999999999999},"min":{"1min":0.76400000000000001,"5min":0.622,"15min":0.53900000000000003},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.997,"15min":0.93899999999999995},"min":{"1min":0.67600000000000005,"5min":0.66900000000000004,"15min":0.52300000000000002},"max":{"1min":1.1870000000000001,"5min":1.633,"15min":1.98},"last":0.81100000000000005}]},{"osd":4,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.139,"15min":1.081},"min":{"1min":0.627,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":3.4969999999999999,"5min":3.4969999999999999,"15min":3.4969999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.179,"15min":1.1359999999999999},"min":{"1min":0.66000000000000003,"5min":0.52700000000000002,"15min":0.46000000000000002},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":1.054}]},{"osd":5,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.145,"15min":1.079},"min":{"1min":0.56699999999999995,"5min":0.49099999999999999,"15min":0.47499999999999998},"max":{"1min":3.8490000000000002,"5min":3.8490000000000002,"15min":3.8490000000000002},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2230000000000001,"15min":1.177},"min":{"1min":0.78300000000000003,"5min":0.60999999999999999,"15min":0.54200000000000004},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.284,"15min":1.2250000000000001},"min":{"1min":0.75700000000000001,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":4.2910000000000004,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.153,"5min":1.254,"15min":1.2},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.56799999999999995},"max":{"1min":1.534,"5min":2.0649999999999999,"15min":2.129},"last":1.105}]}]},{"osd":4,"up_from":15,"seq":64424510751,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121324,"kb_used_data":22180,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94250516,"statfs":{"total":96636764160,"available":96512528384,"internally_reserved":0,"allocated":22712320,"data_stored":50454822,"data_compressed":6935579,"data_compressed_allocated":9256960,"data_compressed_original":37212160,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86299999999999999,"15min":0.84499999999999997},"min":{"1min":0.52800000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.6879999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.83499999999999996,"15min":0.84199999999999997},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.42799999999999999},"max":{"1min":1.464,"5min":1.464,"15min":2.2410000000000001},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.90500000000000003,"15min":0.89000000000000001},"min":{"1min":0.63,"5min":0.47399999999999998,"15min":0.36199999999999999},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.89200000000000002,"15min":0.90700000000000003},"min":{"1min":0.499,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4179999999999999,"5min":2.097,"15min":2.097},"last":0.875}]},{"osd":2,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.88200000000000001,"15min":0.91200000000000003},"min":{"1min":0.68700000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.96499999999999997,"15min":0.95799999999999996},"min":{"1min":0.65000000000000002,"5min":0.55500000000000005,"15min":0.34300000000000003},"max":{"1min":1.4510000000000001,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.109}]},{"osd":3,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.90500000000000003,"15min":0.93200000000000005},"min":{"1min":0.54700000000000004,"5min":0.54000000000000004,"15min":0.41099999999999998},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":2.335},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.0800000000000001,"5min":0.98899999999999999,"15min":1.004},"min":{"1min":0.67300000000000004,"5min":0.60799999999999998,"15min":0.45300000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.044,"15min":1.0840000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.35999999999999999},"max":{"1min":1.518,"5min":2.403,"15min":2.9249999999999998},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.04,"15min":1.075},"min":{"1min":0.66700000000000004,"5min":0.55200000000000005,"15min":0.38200000000000001},"max":{"1min":1.7909999999999999,"5min":1.804,"15min":2.4289999999999998},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1020000000000001,"15min":1.1339999999999999},"min":{"1min":0.57699999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.1110000000000002,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.181,"15min":1.202},"min":{"1min":0.56499999999999995,"5min":0.45800000000000002,"15min":0.38100000000000001},"max":{"1min":1.7989999999999999,"5min":2.4740000000000002,"15min":3.101},"last":1.218}]},{"osd":7,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.1639999999999999,"15min":1.1830000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.841,"5min":4.25,"15min":4.25},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2110000000000001,"15min":1.2549999999999999},"min":{"1min":0.59199999999999997,"5min":0.503,"15min":0.40200000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.5110000000000001},"last":1.0720000000000001}]}]},{"osd":3,"up_from":15,"seq":64424510751,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160572,"kb_used_data":39220,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94211268,"statfs":{"total":96636764160,"available":96472338432,"internally_reserved":0,"allocated":40161280,"data_stored":87845266,"data_compressed":11483169,"data_compressed_allocated":15335424,"data_compressed_original":63209472,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44,"15min":0.42899999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.23000000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45800000000000002,"15min":0.46300000000000002},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.25600000000000001},"max":{"1min":0.58299999999999996,"5min":0.72799999999999998,"15min":0.753},"last":0.38}]},{"osd":1,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.29399999999999998,"5min":0.28100000000000003,"15min":0.27500000000000002},"max":{"1min":0.61499999999999999,"5min":0.751,"15min":0.78000000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.502,"15min":0.496},"min":{"1min":0.318,"5min":0.313,"15min":0.27300000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.314},"max":{"1min":0.66700000000000004,"5min":0.79700000000000004,"15min":0.84299999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.39000000000000001,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.68400000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.496}]},{"osd":4,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.42099999999999999},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78300000000000003,"15min":0.76500000000000001},"min":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.105,"5min":1.325,"15min":1.325},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.76800000000000002},"min":{"1min":0.54200000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.1160000000000001,"5min":1.1559999999999999,"15min":1.1970000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.754},"min":{"1min":0.52400000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0269999999999999,"5min":1.1539999999999999,"15min":1.2150000000000001},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82299999999999995,"15min":0.80900000000000005},"min":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.48899999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2150000000000001},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.80300000000000005,"15min":0.79900000000000004},"min":{"1min":0.51100000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.24,"5min":1.248,"15min":1.337},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.83399999999999996,"15min":0.82199999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.42099999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.69899999999999995}]}]},{"osd":2,"up_from":15,"seq":64424510751,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94904,"kb_used_data":13808,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94276936,"statfs":{"total":96636764160,"available":96539582464,"internally_reserved":0,"allocated":14139392,"data_stored":33676072,"data_compressed":4580308,"data_compressed_allocated":5976064,"data_compressed_original":25698304,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42099999999999999,"15min":0.432},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.24299999999999999},"max":{"1min":0.58599999999999997,"5min":0.65300000000000002,"15min":1.095},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26300000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":1.355},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.47599999999999998},"min":{"1min":0.36299999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64400000000000002,"5min":0.97699999999999998,"15min":1.026},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.503},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.308},"max":{"1min":0.67400000000000004,"5min":1.032,"15min":1.194},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.28599999999999998},"max":{"1min":0.754,"5min":0.77000000000000002,"15min":0.995},"last":0.437},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53800000000000003},"min":{"1min":0.36099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70499999999999996,"5min":0.90500000000000003,"15min":0.96999999999999997},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.75,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.46300000000000002,"15min":0.44700000000000001},"max":{"1min":1.014,"5min":1.155,"15min":1.502},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72299999999999998,"15min":0.752},"min":{"1min":0.46899999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.96899999999999997,"5min":1.0660000000000001,"15min":1.282},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.751,"15min":0.753},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":1.099,"15min":1.1479999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.79000000000000004},"min":{"1min":0.61299999999999999,"5min":0.48899999999999999,"15min":0.48099999999999998},"max":{"1min":1.0649999999999999,"5min":4.343,"15min":4.343},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.46600000000000003},"max":{"1min":0.95899999999999996,"5min":1.075,"15min":1.528},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79900000000000004,"15min":0.81200000000000006},"min":{"1min":0.52900000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1379999999999999,"5min":1.1599999999999999,"15min":3.9159999999999999},"last":0.81799999999999995}]},{"osd":7,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80400000000000005,"15min":0.80200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.499},"max":{"1min":1.1040000000000001,"5min":1.248,"15min":1.248},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.54500000000000004,"15min":0.51300000000000001},"max":{"1min":1.1160000000000001,"5min":3.9060000000000001,"15min":5.7370000000000001},"last":0.88}]}]},{"osd":1,"up_from":15,"seq":64424510751,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108440,"kb_used_data":19024,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94263400,"statfs":{"total":96636764160,"available":96525721600,"internally_reserved":0,"allocated":19480576,"data_stored":38460198,"data_compressed":4277353,"data_compressed_allocated":5976064,"data_compressed_original":25141248,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.46400000000000002,"15min":0.439},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.39000000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69899999999999995,"5min":0.70299999999999996,"15min":0.73099999999999998},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.47299999999999998,"15min":0.46000000000000002},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.27800000000000002},"max":{"1min":0.629,"5min":0.70399999999999996,"15min":0.73099999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51700000000000002,"15min":0.51000000000000001},"min":{"1min":0.42199999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71699999999999997,"5min":0.77400000000000002,"15min":0.85099999999999998},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.55000000000000004},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.36799999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.79900000000000004},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.71599999999999997},"min":{"1min":0.53500000000000003,"5min":0.442,"15min":0.38700000000000001},"max":{"1min":0.89600000000000002,"5min":1.0549999999999999,"15min":1.103},"last":22.641999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77200000000000002,"15min":0.78100000000000003},"min":{"1min":0.60299999999999998,"5min":0.47099999999999997,"15min":0.439},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.5700000000000001},"last":2.9409999999999998}]},{"osd":5,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76200000000000001,"15min":0.76000000000000001},"min":{"1min":0.53000000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1299999999999999,"5min":1.1439999999999999,"15min":2.8069999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79000000000000004,"15min":0.77600000000000002},"min":{"1min":0.58599999999999997,"5min":0.46400000000000002,"15min":0.45400000000000001},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.27},"last":2.5760000000000001}]},{"osd":6,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.79400000000000004},"min":{"1min":0.64600000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.0660000000000001,"5min":1.242,"15min":1.395},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.73699999999999999,"5min":0.5,"15min":0.46400000000000002},"max":{"1min":0.996,"5min":1.1279999999999999,"15min":1.1830000000000001},"last":5.7869999999999999}]},{"osd":7,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.85099999999999998,"15min":0.83699999999999997},"min":{"1min":0.76900000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":3.9009999999999998},"last":1.895},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.622,"5min":0.55700000000000005,"15min":0.50800000000000001},"max":{"1min":1.1379999999999999,"5min":1.2270000000000001,"15min":1.3999999999999999},"last":2.476}]}]},{"osd":0,"up_from":14,"seq":60129543454,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143116,"kb_used_data":31492,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94228724,"statfs":{"total":96636764160,"available":96490213376,"internally_reserved":0,"allocated":32247808,"data_stored":71061728,"data_compressed":8958305,"data_compressed_allocated":12132352,"data_compressed_original":51142656,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44500000000000001,"15min":0.42899999999999999},"min":{"1min":0.29199999999999998,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.64500000000000002,"5min":0.66600000000000004,"15min":0.68400000000000005},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47899999999999998,"15min":0.47199999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.26700000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.502,"15min":0.496},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.28199999999999997},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.84999999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.311,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67900000000000005,"5min":0.69599999999999995,"15min":0.80200000000000005},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.49399999999999999,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.308,"15min":0.30499999999999999},"max":{"1min":0.72499999999999998,"5min":0.73999999999999999,"15min":0.81799999999999995},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.377},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72199999999999998,"15min":0.73399999999999999},"min":{"1min":0.57899999999999996,"5min":0.46500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89500000000000002,"5min":1.3620000000000001,"15min":2.1779999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.745,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.505,"15min":0.44400000000000001},"max":{"1min":1.0149999999999999,"5min":1.159,"15min":1.159},"last":0.874}]},{"osd":5,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76900000000000002,"15min":0.76500000000000001},"min":{"1min":0.58799999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97199999999999998,"5min":1.423,"15min":1.423},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.59199999999999997,"5min":0.47599999999999998,"15min":0.42399999999999999},"max":{"1min":1.03,"5min":1.623,"15min":1.623},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.84699999999999998,"15min":0.82399999999999995},"min":{"1min":0.64300000000000002,"5min":0.52600000000000002,"15min":0.49099999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.84899999999999998,"15min":0.82699999999999996},"min":{"1min":0.57399999999999995,"5min":0.49099999999999999,"15min":0.46200000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.29},"last":1.034}]},{"osd":7,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.82299999999999995,"15min":0.81799999999999995},"min":{"1min":0.64400000000000002,"5min":0.48299999999999998,"15min":0.44400000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.86799999999999999,"15min":0.85799999999999998},"min":{"1min":0.64800000000000002,"5min":0.61099999999999999,"15min":0.47899999999999998},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.73999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834576160,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":129092,"kb_used_data":25788,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94242748,"statfs":{"total":96636764160,"available":96504573952,"internally_reserved":0,"allocated":26406912,"data_stored":52600308,"data_compressed":6284057,"data_compressed_allocated":8634368,"data_compressed_original":35024896,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.81999999999999995,"15min":0.86399999999999999},"min":{"1min":0.52800000000000002,"5min":0.40100000000000002,"15min":0.36699999999999999},"max":{"1min":1.2729999999999999,"5min":1.3560000000000001,"15min":1.5409999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84099999999999997,"15min":0.85899999999999999},"min":{"1min":0.498,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.173,"5min":1.2170000000000001,"15min":1.7569999999999999},"last":0.81299999999999994}]},{"osd":1,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.88100000000000001,"15min":0.90600000000000003},"min":{"1min":0.498,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2430000000000001,"5min":1.323,"15min":1.6299999999999999},"last":1.194},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89400000000000002,"15min":0.91500000000000004},"min":{"1min":0.48799999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.5049999999999999},"last":1.026}]},{"osd":2,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.84999999999999998,"15min":0.84799999999999998},"min":{"1min":0.55500000000000005,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.95999999999999996,"15min":0.98099999999999998},"min":{"1min":0.66700000000000004,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2430000000000001,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.3240000000000001}]},{"osd":3,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.98499999999999999,"15min":0.998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2849999999999999,"5min":1.613,"15min":2.1499999999999999},"last":1.117},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.94199999999999995,"15min":0.95699999999999996},"min":{"1min":0.63400000000000001,"5min":0.41099999999999998,"15min":0.40500000000000003},"max":{"1min":1.552,"5min":1.552,"15min":1.9430000000000001},"last":0.91600000000000004}]},{"osd":4,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.073,"15min":1.085},"min":{"1min":0.56399999999999995,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.5089999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.383},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.137,"15min":1.1319999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.607,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.409}]},{"osd":6,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.105,"15min":1.079},"min":{"1min":0.76000000000000001,"5min":0.55100000000000005,"15min":0.51800000000000002},"max":{"1min":1.659,"5min":1.659,"15min":1.8640000000000001},"last":1.357},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1699999999999999,"15min":1.1839999999999999},"min":{"1min":0.80500000000000005,"5min":0.69099999999999995,"15min":0.46999999999999997},"max":{"1min":1.5129999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":1.4890000000000001}]},{"osd":7,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.25,"15min":1.2350000000000001},"min":{"1min":0.66800000000000004,"5min":0.65900000000000003,"15min":0.57799999999999996},"max":{"1min":1.732,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.514},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.228,"15min":1.2170000000000001},"min":{"1min":0.73499999999999999,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.456}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31229,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31229,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31952896,"data_stored":70940794,"data_compressed":8958305,"data_compressed_allocated":12132352,"data_compressed_original":51142656,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19124224,"data_stored":37748896,"data_compressed":4246124,"data_compressed_allocated":5935104,"data_compressed_original":24567808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13844480,"data_stored":33555138,"data_compressed":4580308,"data_compressed_allocated":5976064,"data_compressed_original":25698304,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39866368,"data_stored":87724332,"data_compressed":11483169,"data_compressed_allocated":15335424,"data_compressed_original":63209472,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22417408,"data_stored":50333888,"data_compressed":6935579,"data_compressed_allocated":9256960,"data_compressed_original":37212160,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26050560,"data_stored":51889006,"data_compressed":6252828,"data_compressed_allocated":8593408,"data_compressed_original":34451456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15904768,"data_stored":33556031,"data_compressed":4280237,"data_compressed_allocated":5771264,"data_compressed_original":23433216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12591104,"data_stored":30917336,"data_compressed":4325598,"data_compressed_allocated":5689344,"data_compressed_original":24039424,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-18T00:47:16.674 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-18T00:47:16.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.847+0000 7f3924400640 1 Processor -- start 2024-01-18T00:47:16.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.847+0000 7f3924400640 1 -- start start 2024-01-18T00:47:16.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.851+0000 7f3924400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f391c1539c0 0x7f391c159e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:16.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.851+0000 7f3924400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f391c15cc20 0x7f391c0c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:16.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.851+0000 7f3924400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391c06b110 con 0x7f391c15a3d0 2024-01-18T00:47:16.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.851+0000 7f3924400640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c0c1720 con 0x7f391c15cc20 2024-01-18T00:47:16.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.851+0000 7f3924400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0c8440 con 0x7f391c1539c0 2024-01-18T00:47:16.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.851+0000 7f3921000640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f391c15a3d0 0x7f391c0cc1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55174/0 (socket says 172.21.15.161:55174) 2024-01-18T00:47:16.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.851+0000 7f3921000640 1 -- 172.21.15.161:0/4025054428 learned_addr learned my addr 172.21.15.161:0/4025054428 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-18T00:47:16.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.851+0000 7f3921a00640 1 --2- 172.21.15.161:0/4025054428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f391c1539c0 0x7f391c159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:16.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.851+0000 7f3922400640 1 --2- 172.21.15.161:0/4025054428 >> v2:172.21.15.190:3300/0 conn(0x7f391c15cc20 0x7f391c0c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:16.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.855+0000 7f391be00640 1 -- 172.21.15.161:0/4025054428 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627328301 0 0) 0x7f391c06b110 con 0x7f391c15a3d0 2024-01-18T00:47:16.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.855+0000 7f391be00640 1 -- 172.21.15.161:0/4025054428 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38fc003530 con 0x7f391c15a3d0 2024-01-18T00:47:16.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.855+0000 7f391be00640 1 -- 172.21.15.161:0/4025054428 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4154131318 0 0) 0x7f38fc003530 con 0x7f391c15a3d0 2024-01-18T00:47:16.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.855+0000 7f391be00640 1 -- 172.21.15.161:0/4025054428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f391c1539c0 msgr2=0x7f391c159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:16.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.855+0000 7f391be00640 1 --2- 172.21.15.161:0/4025054428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f391c1539c0 0x7f391c159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:16.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.855+0000 7f391be00640 1 -- 172.21.15.161:0/4025054428 >> v2:172.21.15.190:3300/0 conn(0x7f391c15cc20 msgr2=0x7f391c0c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:16.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.855+0000 7f391be00640 1 --2- 172.21.15.161:0/4025054428 >> v2:172.21.15.190:3300/0 conn(0x7f391c15cc20 0x7f391c0c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:16.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.855+0000 7f391be00640 1 -- 172.21.15.161:0/4025054428 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c1596b0 con 0x7f391c15a3d0 2024-01-18T00:47:16.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.855+0000 7f391be00640 1 -- 172.21.15.161:0/4025054428 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f3904001680 con 0x7f391c15a3d0 2024-01-18T00:47:16.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.855+0000 7f391be00640 1 -- 172.21.15.161:0/4025054428 >> v1:172.21.15.161:6789/0 conn(0x7f391c15a3d0 legacy=0x7f391c0cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:16.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.855+0000 7f391be00640 1 --2- 172.21.15.161:0/4025054428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f391c1539c0 0x7f38fc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:16.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.855+0000 7f391be00640 1 --2- 172.21.15.161:0/4025054428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38fc003f50 0x7f38fc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:16.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.855+0000 7f391be00640 1 --2- 172.21.15.161:0/4025054428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38fc004d10 0x7f38fc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:16.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.855+0000 7f391be00640 1 -- 172.21.15.161:0/4025054428 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0c8440 con 0x7f38fc003f50 2024-01-18T00:47:16.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.855+0000 7f391be00640 1 -- 172.21.15.161:0/4025054428 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc00b990 con 0x7f38fc004d10 2024-01-18T00:47:16.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.855+0000 7f391be00640 1 -- 172.21.15.161:0/4025054428 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc00bb50 con 0x7f391c1539c0 2024-01-18T00:47:16.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.859+0000 7f3921000640 1 --2- 172.21.15.161:0/4025054428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38fc003f50 0x7f38fc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:16.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.863+0000 7f3921000640 1 -- 172.21.15.161:0/4025054428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f391c1539c0 msgr2=0x7f38fc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:16.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.863+0000 7f3921000640 1 --2- 172.21.15.161:0/4025054428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f391c1539c0 0x7f38fc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:16.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.863+0000 7f3921000640 1 -- 172.21.15.161:0/4025054428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38fc004d10 msgr2=0x7f38fc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:16.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.863+0000 7f3921000640 1 --2- 172.21.15.161:0/4025054428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38fc004d10 0x7f38fc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:16.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.863+0000 7f3921000640 1 -- 172.21.15.161:0/4025054428 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc003530 con 0x7f38fc003f50 2024-01-18T00:47:16.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.867+0000 7f3921000640 1 --2- 172.21.15.161:0/4025054428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38fc003f50 0x7f38fc0047d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f390400c160 tx=0x7f390401cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935ba0b87bbd4187 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:16.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.871+0000 7f391be00640 1 -- 172.21.15.161:0/4025054428 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39040058e0 con 0x7f38fc003f50 2024-01-18T00:47:16.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.871+0000 7f391be00640 1 -- 172.21.15.161:0/4025054428 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3904005a40 con 0x7f38fc003f50 2024-01-18T00:47:16.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.871+0000 7f391be00640 1 -- 172.21.15.161:0/4025054428 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904005e70 con 0x7f38fc003f50 2024-01-18T00:47:16.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.871+0000 7f3924400640 1 -- 172.21.15.161:0/4025054428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38fc003f50 msgr2=0x7f38fc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:16.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.871+0000 7f3924400640 1 --2- 172.21.15.161:0/4025054428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38fc003f50 0x7f38fc0047d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f390400c160 tx=0x7f390401cb80 comp rx=0 tx=0).stop 2024-01-18T00:47:16.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.871+0000 7f3922400640 1 -- 172.21.15.161:0/4025054428 reap_dead start 2024-01-18T00:47:16.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.871+0000 7f3924400640 1 -- 172.21.15.161:0/4025054428 shutdown_connections 2024-01-18T00:47:16.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.871+0000 7f3924400640 1 -- 172.21.15.161:0/4025054428 >> 172.21.15.161:0/4025054428 conn(0x7f391c06e0e0 msgr2=0x7f391c06e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:16.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.871+0000 7f3924400640 1 -- 172.21.15.161:0/4025054428 shutdown_connections 2024-01-18T00:47:16.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.871+0000 7f3924400640 1 -- 172.21.15.161:0/4025054428 wait complete. 2024-01-18T00:47:16.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.871+0000 7f3924400640 1 Processor -- start 2024-01-18T00:47:16.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.871+0000 7f3924400640 1 -- start start 2024-01-18T00:47:16.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.875+0000 7f3924400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f38fc003f50 0x7f391c0adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:16.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.875+0000 7f3924400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f391c15c290 0x7f391c151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:16.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.875+0000 7f3924400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f391c151f30 0x7f391c1518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:16.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.875+0000 7f3924400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c15b800 con 0x7f391c15c290 2024-01-18T00:47:16.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.875+0000 7f3924400640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c15a8b0 con 0x7f391c151f30 2024-01-18T00:47:16.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.875+0000 7f3924400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c15ab90 con 0x7f38fc003f50 2024-01-18T00:47:16.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.875+0000 7f3921000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f391c15c290 0x7f391c151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:16.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.875+0000 7f3921000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f391c15c290 0x7f391c151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43634/0 (socket says 172.21.15.161:43634) 2024-01-18T00:47:16.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.875+0000 7f3921000640 1 -- 172.21.15.161:0/3534698243 learned_addr learned my addr 172.21.15.161:0/3534698243 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:16.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.875+0000 7f3922400640 1 --2- 172.21.15.161:0/3534698243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f391c151f30 0x7f391c1518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:16.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.875+0000 7f3921a00640 1 --2- 172.21.15.161:0/3534698243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f38fc003f50 0x7f391c0adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:16.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.879+0000 7f3921000640 1 -- 172.21.15.161:0/3534698243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f38fc003f50 msgr2=0x7f391c0adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:16.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.879+0000 7f3921000640 1 --2- 172.21.15.161:0/3534698243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f38fc003f50 0x7f391c0adb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:16.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.879+0000 7f3921000640 1 -- 172.21.15.161:0/3534698243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f391c151f30 msgr2=0x7f391c1518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:16.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.879+0000 7f3921000640 1 --2- 172.21.15.161:0/3534698243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f391c151f30 0x7f391c1518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:16.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.879+0000 7f3921000640 1 -- 172.21.15.161:0/3534698243 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c15ae70 con 0x7f391c15c290 2024-01-18T00:47:16.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.879+0000 7f3921000640 1 --2- 172.21.15.161:0/3534698243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f391c15c290 0x7f391c151360 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f390401c9b0 tx=0x7f38fc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:16.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.883+0000 7f3919600640 1 -- 172.21.15.161:0/3534698243 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39040a6b20 con 0x7f391c15c290 2024-01-18T00:47:16.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.883+0000 7f3919600640 1 -- 172.21.15.161:0/3534698243 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39040a6c80 con 0x7f391c15c290 2024-01-18T00:47:16.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.883+0000 7f3919600640 1 -- 172.21.15.161:0/3534698243 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39040047f0 con 0x7f391c15c290 2024-01-18T00:47:16.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.883+0000 7f3924400640 1 -- 172.21.15.161:0/3534698243 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c15b150 con 0x7f391c15c290 2024-01-18T00:47:16.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.883+0000 7f3924400640 1 -- 172.21.15.161:0/3534698243 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c15c950 con 0x7f391c15c290 2024-01-18T00:47:16.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.887+0000 7f3924400640 1 -- 172.21.15.161:0/3534698243 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391c15acd0 con 0x7f391c15c290 2024-01-18T00:47:16.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.907+0000 7f3919600640 1 -- 172.21.15.161:0/3534698243 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f3904004950 con 0x7f391c15c290 2024-01-18T00:47:16.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.907+0000 7f3919600640 1 --2- 172.21.15.161:0/3534698243 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f38f4066890 0x7f38f4068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:16.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.907+0000 7f3921a00640 1 --2- 172.21.15.161:0/3534698243 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f38f4066890 0x7f38f4068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:16.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.907+0000 7f3921a00640 1 --2- 172.21.15.161:0/3534698243 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f38f4066890 0x7f38f4068d50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f390c009a80 tx=0x7f390c0094c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:16.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:16.907+0000 7f3919600640 1 -- 172.21.15.161:0/3534698243 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f39040ef580 con 0x7f391c15c290 2024-01-18T00:47:17.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.135+0000 7f3919600640 1 -- 172.21.15.161:0/3534698243 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f39040eb1c0 con 0x7f391c15c290 2024-01-18T00:47:17.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.291+0000 7f3924400640 1 -- 172.21.15.161:0/3534698243 --> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f391c15d6d0 con 0x7f38f4066890 2024-01-18T00:47:17.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.299+0000 7f3919600640 1 -- 172.21.15.161:0/3534698243 <== mgr.4110 v2:172.21.15.161:6800/272458188 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371378 (secure 0 0 0) 0x7f390c011980 con 0x7f38f4066890 2024-01-18T00:47:17.305 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-18T00:47:17.307 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-01-18T00:47:17.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.303+0000 7f3924400640 1 -- 172.21.15.161:0/3534698243 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f38f4066890 msgr2=0x7f38f4068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:17.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.303+0000 7f3924400640 1 --2- 172.21.15.161:0/3534698243 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f38f4066890 0x7f38f4068d50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f390c009a80 tx=0x7f390c0094c0 comp rx=0 tx=0).stop 2024-01-18T00:47:17.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.303+0000 7f3924400640 1 -- 172.21.15.161:0/3534698243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f391c15c290 msgr2=0x7f391c151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:17.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.303+0000 7f3924400640 1 --2- 172.21.15.161:0/3534698243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f391c15c290 0x7f391c151360 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f390401c9b0 tx=0x7f38fc005800 comp rx=0 tx=0).stop 2024-01-18T00:47:17.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.303+0000 7f3924400640 1 -- 172.21.15.161:0/3534698243 shutdown_connections 2024-01-18T00:47:17.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.303+0000 7f3924400640 1 --2- 172.21.15.161:0/3534698243 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f38f4066890 0x7f38f4068d50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:17.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.303+0000 7f3924400640 1 --2- 172.21.15.161:0/3534698243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f391c151f30 0x7f391c1518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:17.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.303+0000 7f3924400640 1 --2- 172.21.15.161:0/3534698243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f391c15c290 0x7f391c151360 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:17.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.303+0000 7f3924400640 1 --2- 172.21.15.161:0/3534698243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f38fc003f50 0x7f391c0adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:17.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.303+0000 7f3924400640 1 -- 172.21.15.161:0/3534698243 >> 172.21.15.161:0/3534698243 conn(0x7f391c06e0e0 msgr2=0x7f391c0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:17.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.307+0000 7f3924400640 1 -- 172.21.15.161:0/3534698243 shutdown_connections 2024-01-18T00:47:17.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.307+0000 7f3924400640 1 -- 172.21.15.161:0/3534698243 wait complete. 2024-01-18T00:47:17.325 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":3292,"stamp":"2024-01-18T00:47:16.475115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":198926073,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":3054,"num_read_kb":3537766,"num_write":47079,"num_write_kb":4540401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59999,"ondisk_log_size":59999,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":964748,"kb_used_data":179916,"kb_used_omap":12,"kb_used_meta":784755,"kb_avail":754009972,"statfs":{"total":773094113280,"available":772106211328,"internally_reserved":0,"allocated":184233984,"data_stored":398813629,"data_compressed":51124606,"data_compressed_allocated":68771840,"data_compressed_original":284901376,"omap_allocated":12751,"internal_metadata":803589681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-274572,"num_objects":-66,"num_object_clones":0,"num_object_copies":-264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-66,"num_whiteouts":0,"num_read":6,"num_read_kb":11,"num_write":109,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002706"},"pg_stats":[{"pgid":"2.1f","version":"28'401","reported_seq":472,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.101129+0000","last_change":"2024-01-17T22:58:48.328193+0000","last_active":"2024-01-18T00:47:09.101129+0000","last_peered":"2024-01-18T00:47:09.101129+0000","last_clean":"2024-01-18T00:47:09.101129+0000","last_became_active":"2024-01-17T22:58:48.327340+0000","last_became_peered":"2024-01-17T22:58:48.327340+0000","last_unstale":"2024-01-18T00:47:09.101129+0000","last_undegraded":"2024-01-18T00:47:09.101129+0000","last_fullsized":"2024-01-18T00:47:09.101129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:56.524325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":8350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'183","reported_seq":254,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.312429+0000","last_change":"2024-01-17T22:58:49.351609+0000","last_active":"2024-01-18T00:47:04.312429+0000","last_peered":"2024-01-18T00:47:04.312429+0000","last_clean":"2024-01-18T00:47:04.312429+0000","last_became_active":"2024-01-17T22:58:49.350812+0000","last_became_peered":"2024-01-17T22:58:49.350812+0000","last_unstale":"2024-01-18T00:47:04.312429+0000","last_undegraded":"2024-01-18T00:47:04.312429+0000","last_fullsized":"2024-01-18T00:47:04.312429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:02:07.535209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'754","reported_seq":836,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:43.925020+0000","last_change":"2024-01-17T22:58:55.903757+0000","last_active":"2024-01-18T00:46:43.925020+0000","last_peered":"2024-01-18T00:46:43.925020+0000","last_clean":"2024-01-18T00:46:43.925020+0000","last_became_active":"2024-01-17T22:58:55.903167+0000","last_became_peered":"2024-01-17T22:58:55.903167+0000","last_unstale":"2024-01-18T00:46:43.925020+0000","last_undegraded":"2024-01-18T00:46:43.925020+0000","last_fullsized":"2024-01-18T00:46:43.925020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:22.127961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":69175,"num_write":737,"num_write_kb":101027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'515","reported_seq":587,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:34.183193+0000","last_change":"2024-01-17T22:58:48.373068+0000","last_active":"2024-01-18T00:46:34.183193+0000","last_peered":"2024-01-18T00:46:34.183193+0000","last_clean":"2024-01-18T00:46:34.183193+0000","last_became_active":"2024-01-17T22:58:48.372582+0000","last_became_peered":"2024-01-17T22:58:48.372582+0000","last_unstale":"2024-01-18T00:46:34.183193+0000","last_undegraded":"2024-01-18T00:46:34.183193+0000","last_fullsized":"2024-01-18T00:46:34.183193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:10:59.139723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":8429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'177","reported_seq":247,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.597454+0000","last_change":"2024-01-17T22:58:49.511918+0000","last_active":"2024-01-18T00:47:04.597454+0000","last_peered":"2024-01-18T00:47:04.597454+0000","last_clean":"2024-01-18T00:47:04.597454+0000","last_became_active":"2024-01-17T22:58:49.511303+0000","last_became_peered":"2024-01-17T22:58:49.511303+0000","last_unstale":"2024-01-18T00:47:04.597454+0000","last_undegraded":"2024-01-18T00:47:04.597454+0000","last_fullsized":"2024-01-18T00:47:04.597454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:13:09.466879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'814","reported_seq":911,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.934585+0000","last_change":"2024-01-17T22:58:55.878752+0000","last_active":"2024-01-18T00:47:04.934585+0000","last_peered":"2024-01-18T00:47:04.934585+0000","last_clean":"2024-01-18T00:47:04.934585+0000","last_became_active":"2024-01-17T22:58:55.878263+0000","last_became_peered":"2024-01-17T22:58:55.878263+0000","last_unstale":"2024-01-18T00:47:04.934585+0000","last_undegraded":"2024-01-18T00:47:04.934585+0000","last_fullsized":"2024-01-18T00:47:04.934585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:19:49.420559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":109513,"num_write":800,"num_write_kb":160118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1138","reported_seq":1200,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:13.376579+0000","last_change":"2024-01-17T22:58:48.346724+0000","last_active":"2024-01-18T00:45:13.376579+0000","last_peered":"2024-01-18T00:45:13.376579+0000","last_clean":"2024-01-18T00:45:13.376579+0000","last_became_active":"2024-01-17T22:58:48.346411+0000","last_became_peered":"2024-01-17T22:58:48.346411+0000","last_unstale":"2024-01-18T00:45:13.376579+0000","last_undegraded":"2024-01-18T00:45:13.376579+0000","last_fullsized":"2024-01-18T00:45:13.376579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1138,"log_dups_size":0,"ondisk_log_size":1138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:03:04.691978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1083,"num_write_kb":12791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'196","reported_seq":256,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.694627+0000","last_change":"2024-01-17T22:58:49.517981+0000","last_active":"2024-01-18T00:47:15.694627+0000","last_peered":"2024-01-18T00:47:15.694627+0000","last_clean":"2024-01-18T00:47:15.694627+0000","last_became_active":"2024-01-17T22:58:49.517710+0000","last_became_peered":"2024-01-17T22:58:49.517710+0000","last_unstale":"2024-01-18T00:47:15.694627+0000","last_undegraded":"2024-01-18T00:47:15.694627+0000","last_fullsized":"2024-01-18T00:47:15.694627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'731","reported_seq":809,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.699271+0000","last_change":"2024-01-17T22:58:55.847347+0000","last_active":"2024-01-18T00:47:08.699271+0000","last_peered":"2024-01-18T00:47:08.699271+0000","last_clean":"2024-01-18T00:47:08.699271+0000","last_became_active":"2024-01-17T22:58:55.846773+0000","last_became_peered":"2024-01-17T22:58:55.846773+0000","last_unstale":"2024-01-18T00:47:08.699271+0000","last_undegraded":"2024-01-18T00:47:08.699271+0000","last_fullsized":"2024-01-18T00:47:08.699271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:31:43.629750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":46045,"num_write":714,"num_write_kb":72807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'767","reported_seq":829,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:20.108287+0000","last_change":"2024-01-17T22:58:48.346483+0000","last_active":"2024-01-18T00:46:20.108287+0000","last_peered":"2024-01-18T00:46:20.108287+0000","last_clean":"2024-01-18T00:46:20.108287+0000","last_became_active":"2024-01-17T22:58:48.345749+0000","last_became_peered":"2024-01-17T22:58:48.345749+0000","last_unstale":"2024-01-18T00:46:20.108287+0000","last_undegraded":"2024-01-18T00:46:20.108287+0000","last_fullsized":"2024-01-18T00:46:20.108287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:22:41.169668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'208","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660482+0000","last_change":"2024-01-17T22:58:49.371509+0000","last_active":"2024-01-18T00:47:15.660482+0000","last_peered":"2024-01-18T00:47:15.660482+0000","last_clean":"2024-01-18T00:47:15.660482+0000","last_became_active":"2024-01-17T22:58:49.370010+0000","last_became_peered":"2024-01-17T22:58:49.370010+0000","last_unstale":"2024-01-18T00:47:15.660482+0000","last_undegraded":"2024-01-18T00:47:15.660482+0000","last_fullsized":"2024-01-18T00:47:15.660482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:36:24.817716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'752","reported_seq":834,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.279912+0000","last_change":"2024-01-17T22:58:55.886223+0000","last_active":"2024-01-18T00:47:04.279912+0000","last_peered":"2024-01-18T00:47:04.279912+0000","last_clean":"2024-01-18T00:47:04.279912+0000","last_became_active":"2024-01-17T22:58:55.885739+0000","last_became_peered":"2024-01-17T22:58:55.885739+0000","last_unstale":"2024-01-18T00:47:04.279912+0000","last_undegraded":"2024-01-18T00:47:04.279912+0000","last_fullsized":"2024-01-18T00:47:04.279912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:49:18.835647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":79345,"num_write":732,"num_write_kb":104824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'223","reported_seq":290,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660356+0000","last_change":"2024-01-17T22:58:49.514565+0000","last_active":"2024-01-18T00:47:15.660356+0000","last_peered":"2024-01-18T00:47:15.660356+0000","last_clean":"2024-01-18T00:47:15.660356+0000","last_became_active":"2024-01-17T22:58:49.514310+0000","last_became_peered":"2024-01-17T22:58:49.514310+0000","last_unstale":"2024-01-18T00:47:15.660356+0000","last_undegraded":"2024-01-18T00:47:15.660356+0000","last_fullsized":"2024-01-18T00:47:15.660356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:01:32.364167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1137","reported_seq":1204,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:22.872524+0000","last_change":"2024-01-17T22:58:48.341961+0000","last_active":"2024-01-18T00:45:22.872524+0000","last_peered":"2024-01-18T00:45:22.872524+0000","last_clean":"2024-01-18T00:45:22.872524+0000","last_became_active":"2024-01-17T22:58:48.341498+0000","last_became_peered":"2024-01-17T22:58:48.341498+0000","last_unstale":"2024-01-18T00:45:22.872524+0000","last_undegraded":"2024-01-18T00:45:22.872524+0000","last_fullsized":"2024-01-18T00:45:22.872524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1137,"log_dups_size":0,"ondisk_log_size":1137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:56.524325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1075,"num_write_kb":12808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'783","reported_seq":874,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:58.933650+0000","last_change":"2024-01-17T22:58:55.915918+0000","last_active":"2024-01-18T00:46:58.933650+0000","last_peered":"2024-01-18T00:46:58.933650+0000","last_clean":"2024-01-18T00:46:58.933650+0000","last_became_active":"2024-01-17T22:58:55.915556+0000","last_became_peered":"2024-01-17T22:58:55.915556+0000","last_unstale":"2024-01-18T00:46:58.933650+0000","last_undegraded":"2024-01-18T00:46:58.933650+0000","last_fullsized":"2024-01-18T00:46:58.933650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:22:21.478703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":102943,"num_write":764,"num_write_kb":130404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'216","reported_seq":282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.678115+0000","last_change":"2024-01-17T22:58:49.388237+0000","last_active":"2024-01-18T00:47:15.678115+0000","last_peered":"2024-01-18T00:47:15.678115+0000","last_clean":"2024-01-18T00:47:15.678115+0000","last_became_active":"2024-01-17T22:58:49.387500+0000","last_became_peered":"2024-01-17T22:58:49.387500+0000","last_unstale":"2024-01-18T00:47:15.678115+0000","last_undegraded":"2024-01-18T00:47:15.678115+0000","last_fullsized":"2024-01-18T00:47:15.678115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'1206","reported_seq":1274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:36.387266+0000","last_change":"2024-01-17T22:58:48.346215+0000","last_active":"2024-01-18T00:45:36.387266+0000","last_peered":"2024-01-18T00:45:36.387266+0000","last_clean":"2024-01-18T00:45:36.387266+0000","last_became_active":"2024-01-17T22:58:48.345584+0000","last_became_peered":"2024-01-17T22:58:48.345584+0000","last_unstale":"2024-01-18T00:45:36.387266+0000","last_undegraded":"2024-01-18T00:45:36.387266+0000","last_fullsized":"2024-01-18T00:45:36.387266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1206,"log_dups_size":0,"ondisk_log_size":1206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":8782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'818","reported_seq":903,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:55.111757+0000","last_change":"2024-01-17T22:58:55.904518+0000","last_active":"2024-01-18T00:46:55.111757+0000","last_peered":"2024-01-18T00:46:55.111757+0000","last_clean":"2024-01-18T00:46:55.111757+0000","last_became_active":"2024-01-17T22:58:55.904182+0000","last_became_peered":"2024-01-17T22:58:55.904182+0000","last_unstale":"2024-01-18T00:46:55.111757+0000","last_undegraded":"2024-01-18T00:46:55.111757+0000","last_fullsized":"2024-01-18T00:46:55.111757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:24:43.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":69224,"num_write":805,"num_write_kb":98188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'208","reported_seq":276,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651670+0000","last_change":"2024-01-17T22:58:49.417907+0000","last_active":"2024-01-18T00:47:15.651670+0000","last_peered":"2024-01-18T00:47:15.651670+0000","last_clean":"2024-01-18T00:47:15.651670+0000","last_became_active":"2024-01-17T22:58:49.417440+0000","last_became_peered":"2024-01-17T22:58:49.417440+0000","last_unstale":"2024-01-18T00:47:15.651670+0000","last_undegraded":"2024-01-18T00:47:15.651670+0000","last_fullsized":"2024-01-18T00:47:15.651670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:59.773063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'353","reported_seq":422,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:11.404319+0000","last_change":"2024-01-17T22:58:48.332092+0000","last_active":"2024-01-18T00:47:11.404319+0000","last_peered":"2024-01-18T00:47:11.404319+0000","last_clean":"2024-01-18T00:47:11.404319+0000","last_became_active":"2024-01-17T22:58:48.331435+0000","last_became_peered":"2024-01-17T22:58:48.331435+0000","last_unstale":"2024-01-18T00:47:11.404319+0000","last_undegraded":"2024-01-18T00:47:11.404319+0000","last_fullsized":"2024-01-18T00:47:11.404319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:41:24.117738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":286,"num_write_kb":4220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'749","reported_seq":841,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:49.663655+0000","last_change":"2024-01-17T22:59:09.254564+0000","last_active":"2024-01-18T00:46:49.663655+0000","last_peered":"2024-01-18T00:46:49.663655+0000","last_clean":"2024-01-18T00:46:49.663655+0000","last_became_active":"2024-01-17T22:59:09.254084+0000","last_became_peered":"2024-01-17T22:59:09.254084+0000","last_unstale":"2024-01-18T00:46:49.663655+0000","last_undegraded":"2024-01-18T00:46:49.663655+0000","last_fullsized":"2024-01-18T00:46:49.663655+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:04:05.785891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":86272,"num_write":735,"num_write_kb":127812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2,3],"acting":[0,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"28'213","reported_seq":281,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.654480+0000","last_change":"2024-01-17T22:58:49.416963+0000","last_active":"2024-01-18T00:47:15.654480+0000","last_peered":"2024-01-18T00:47:15.654480+0000","last_clean":"2024-01-18T00:47:15.654480+0000","last_became_active":"2024-01-17T22:58:49.416757+0000","last_became_peered":"2024-01-17T22:58:49.416757+0000","last_unstale":"2024-01-18T00:47:15.654480+0000","last_undegraded":"2024-01-18T00:47:15.654480+0000","last_fullsized":"2024-01-18T00:47:15.654480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:08.763719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'203","reported_seq":272,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:10.113056+0000","last_change":"2024-01-17T22:58:48.341728+0000","last_active":"2024-01-18T00:47:10.113056+0000","last_peered":"2024-01-18T00:47:10.113056+0000","last_clean":"2024-01-18T00:47:10.113056+0000","last_became_active":"2024-01-17T22:58:48.341359+0000","last_became_peered":"2024-01-17T22:58:48.341359+0000","last_unstale":"2024-01-18T00:47:10.113056+0000","last_undegraded":"2024-01-18T00:47:10.113056+0000","last_fullsized":"2024-01-18T00:47:10.113056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:20:07.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'713","reported_seq":816,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:58.802459+0000","last_change":"2024-01-17T22:58:55.913996+0000","last_active":"2024-01-18T00:46:58.802459+0000","last_peered":"2024-01-18T00:46:58.802459+0000","last_clean":"2024-01-18T00:46:58.802459+0000","last_became_active":"2024-01-17T22:58:55.913645+0000","last_became_peered":"2024-01-17T22:58:55.913645+0000","last_unstale":"2024-01-18T00:46:58.802459+0000","last_undegraded":"2024-01-18T00:46:58.802459+0000","last_fullsized":"2024-01-18T00:46:58.802459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":136231,"num_write":693,"num_write_kb":114548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'226","reported_seq":294,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651590+0000","last_change":"2024-01-17T22:58:49.417874+0000","last_active":"2024-01-18T00:47:15.651590+0000","last_peered":"2024-01-18T00:47:15.651590+0000","last_clean":"2024-01-18T00:47:15.651590+0000","last_became_active":"2024-01-17T22:58:49.417385+0000","last_became_peered":"2024-01-17T22:58:49.417385+0000","last_unstale":"2024-01-18T00:47:15.651590+0000","last_undegraded":"2024-01-18T00:47:15.651590+0000","last_fullsized":"2024-01-18T00:47:15.651590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:41.515981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'330","reported_seq":399,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:11.382366+0000","last_change":"2024-01-17T22:58:48.340052+0000","last_active":"2024-01-18T00:47:11.382366+0000","last_peered":"2024-01-18T00:47:11.382366+0000","last_clean":"2024-01-18T00:47:11.382366+0000","last_became_active":"2024-01-17T22:58:48.339738+0000","last_became_peered":"2024-01-17T22:58:48.339738+0000","last_unstale":"2024-01-18T00:47:11.382366+0000","last_undegraded":"2024-01-18T00:47:11.382366+0000","last_fullsized":"2024-01-18T00:47:11.382366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:58.517904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'778","reported_seq":883,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.935092+0000","last_change":"2024-01-17T22:58:55.904749+0000","last_active":"2024-01-18T00:47:04.935092+0000","last_peered":"2024-01-18T00:47:04.935092+0000","last_clean":"2024-01-18T00:47:04.935092+0000","last_became_active":"2024-01-17T22:58:55.904417+0000","last_became_peered":"2024-01-17T22:58:55.904417+0000","last_unstale":"2024-01-18T00:47:04.935092+0000","last_undegraded":"2024-01-18T00:47:04.935092+0000","last_fullsized":"2024-01-18T00:47:04.935092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:22:32.504064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":109858,"num_write":759,"num_write_kb":103009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'181","reported_seq":249,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:11.404434+0000","last_change":"2024-01-17T22:58:49.411284+0000","last_active":"2024-01-18T00:47:11.404434+0000","last_peered":"2024-01-18T00:47:11.404434+0000","last_clean":"2024-01-18T00:47:11.404434+0000","last_became_active":"2024-01-17T22:58:49.410830+0000","last_became_peered":"2024-01-17T22:58:49.410830+0000","last_unstale":"2024-01-18T00:47:11.404434+0000","last_undegraded":"2024-01-18T00:47:11.404434+0000","last_fullsized":"2024-01-18T00:47:11.404434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:17:04.832847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'1208","reported_seq":1277,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:11.404416+0000","last_change":"2024-01-17T22:58:48.339919+0000","last_active":"2024-01-18T00:47:11.404416+0000","last_peered":"2024-01-18T00:47:11.404416+0000","last_clean":"2024-01-18T00:47:11.404416+0000","last_became_active":"2024-01-17T22:58:48.338928+0000","last_became_peered":"2024-01-17T22:58:48.338928+0000","last_unstale":"2024-01-18T00:47:11.404416+0000","last_undegraded":"2024-01-18T00:47:11.404416+0000","last_fullsized":"2024-01-18T00:47:11.404416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1208,"log_dups_size":0,"ondisk_log_size":1208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:21.699809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3220,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'817","reported_seq":928,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.691889+0000","last_change":"2024-01-17T22:58:55.909140+0000","last_active":"2024-01-18T00:47:04.691889+0000","last_peered":"2024-01-18T00:47:04.691889+0000","last_clean":"2024-01-18T00:47:04.691889+0000","last_became_active":"2024-01-17T22:58:55.908232+0000","last_became_peered":"2024-01-17T22:58:55.908232+0000","last_unstale":"2024-01-18T00:47:04.691889+0000","last_undegraded":"2024-01-18T00:47:04.691889+0000","last_fullsized":"2024-01-18T00:47:04.691889+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":152093,"num_write":804,"num_write_kb":135389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'198","reported_seq":268,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.835195+0000","last_change":"2024-01-17T22:58:49.370201+0000","last_active":"2024-01-18T00:47:15.835195+0000","last_peered":"2024-01-18T00:47:15.835195+0000","last_clean":"2024-01-18T00:47:15.835195+0000","last_became_active":"2024-01-17T22:58:49.369598+0000","last_became_peered":"2024-01-17T22:58:49.369598+0000","last_unstale":"2024-01-18T00:47:15.835195+0000","last_undegraded":"2024-01-18T00:47:15.835195+0000","last_fullsized":"2024-01-18T00:47:15.835195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:15.814647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'819","reported_seq":889,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:14.849761+0000","last_change":"2024-01-17T22:58:48.338556+0000","last_active":"2024-01-18T00:46:14.849761+0000","last_peered":"2024-01-18T00:46:14.849761+0000","last_clean":"2024-01-18T00:46:14.849761+0000","last_became_active":"2024-01-17T22:58:48.338225+0000","last_became_peered":"2024-01-17T22:58:48.338225+0000","last_unstale":"2024-01-18T00:46:14.849761+0000","last_undegraded":"2024-01-18T00:46:14.849761+0000","last_fullsized":"2024-01-18T00:46:14.849761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:47.210049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":8593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'758","reported_seq":863,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.960696+0000","last_change":"2024-01-17T22:58:55.872734+0000","last_active":"2024-01-18T00:47:08.960696+0000","last_peered":"2024-01-18T00:47:08.960696+0000","last_clean":"2024-01-18T00:47:08.960696+0000","last_became_active":"2024-01-17T22:58:55.872356+0000","last_became_peered":"2024-01-17T22:58:55.872356+0000","last_unstale":"2024-01-18T00:47:08.960696+0000","last_undegraded":"2024-01-18T00:47:08.960696+0000","last_fullsized":"2024-01-18T00:47:08.960696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:22:32.504064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":100834,"num_write":740,"num_write_kb":155893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'214","reported_seq":282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.652987+0000","last_change":"2024-01-17T22:58:49.369806+0000","last_active":"2024-01-18T00:47:15.652987+0000","last_peered":"2024-01-18T00:47:15.652987+0000","last_clean":"2024-01-18T00:47:15.652987+0000","last_became_active":"2024-01-17T22:58:49.369487+0000","last_became_peered":"2024-01-17T22:58:49.369487+0000","last_unstale":"2024-01-18T00:47:15.652987+0000","last_undegraded":"2024-01-18T00:47:15.652987+0000","last_fullsized":"2024-01-18T00:47:15.652987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:25.515983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'276","reported_seq":347,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.606730+0000","last_change":"2024-01-17T22:58:48.341854+0000","last_active":"2024-01-18T00:46:53.606730+0000","last_peered":"2024-01-18T00:46:53.606730+0000","last_clean":"2024-01-18T00:46:53.606730+0000","last_became_active":"2024-01-17T22:58:48.339996+0000","last_became_peered":"2024-01-17T22:58:48.339996+0000","last_unstale":"2024-01-18T00:46:53.606730+0000","last_undegraded":"2024-01-18T00:46:53.606730+0000","last_fullsized":"2024-01-18T00:46:53.606730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:55:52.894278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'763","reported_seq":861,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.274913+0000","last_change":"2024-01-17T22:58:55.877637+0000","last_active":"2024-01-18T00:47:09.274913+0000","last_peered":"2024-01-18T00:47:09.274913+0000","last_clean":"2024-01-18T00:47:09.274913+0000","last_became_active":"2024-01-17T22:58:55.877118+0000","last_became_peered":"2024-01-17T22:58:55.877118+0000","last_unstale":"2024-01-18T00:47:09.274913+0000","last_undegraded":"2024-01-18T00:47:09.274913+0000","last_fullsized":"2024-01-18T00:47:09.274913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:08.327495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":97013,"num_write":742,"num_write_kb":97416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'191","reported_seq":261,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.647543+0000","last_change":"2024-01-17T22:58:49.352845+0000","last_active":"2024-01-18T00:47:08.647543+0000","last_peered":"2024-01-18T00:47:08.647543+0000","last_clean":"2024-01-18T00:47:08.647543+0000","last_became_active":"2024-01-17T22:58:49.352563+0000","last_became_peered":"2024-01-17T22:58:49.352563+0000","last_unstale":"2024-01-18T00:47:08.647543+0000","last_undegraded":"2024-01-18T00:47:08.647543+0000","last_fullsized":"2024-01-18T00:47:08.647543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:43.516572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'1018","reported_seq":1089,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:38.492655+0000","last_change":"2024-01-17T22:58:48.343658+0000","last_active":"2024-01-18T00:45:38.492655+0000","last_peered":"2024-01-18T00:45:38.492655+0000","last_clean":"2024-01-18T00:45:38.492655+0000","last_became_active":"2024-01-17T22:58:48.343060+0000","last_became_peered":"2024-01-17T22:58:48.343060+0000","last_unstale":"2024-01-18T00:45:38.492655+0000","last_undegraded":"2024-01-18T00:45:38.492655+0000","last_fullsized":"2024-01-18T00:45:38.492655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:42.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":955,"num_write_kb":8650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'732","reported_seq":829,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:49.510439+0000","last_change":"2024-01-17T22:58:55.881076+0000","last_active":"2024-01-18T00:46:49.510439+0000","last_peered":"2024-01-18T00:46:49.510439+0000","last_clean":"2024-01-18T00:46:49.510439+0000","last_became_active":"2024-01-17T22:58:55.880665+0000","last_became_peered":"2024-01-17T22:58:55.880665+0000","last_unstale":"2024-01-18T00:46:49.510439+0000","last_undegraded":"2024-01-18T00:46:49.510439+0000","last_fullsized":"2024-01-18T00:46:49.510439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:37:20.317014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":93731,"num_write":720,"num_write_kb":118971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'198","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.692105+0000","last_change":"2024-01-17T22:58:49.385682+0000","last_active":"2024-01-18T00:47:04.692105+0000","last_peered":"2024-01-18T00:47:04.692105+0000","last_clean":"2024-01-18T00:47:04.692105+0000","last_became_active":"2024-01-17T22:58:49.384655+0000","last_became_peered":"2024-01-17T22:58:49.384655+0000","last_unstale":"2024-01-18T00:47:04.692105+0000","last_undegraded":"2024-01-18T00:47:04.692105+0000","last_fullsized":"2024-01-18T00:47:04.692105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:22:51.592384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'1859","reported_seq":3718,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:13.468415+0000","last_change":"2024-01-17T22:58:48.375527+0000","last_active":"2024-01-18T00:47:13.468415+0000","last_peered":"2024-01-18T00:47:13.468415+0000","last_clean":"2024-01-18T00:47:13.468415+0000","last_became_active":"2024-01-17T22:58:48.375210+0000","last_became_peered":"2024-01-17T22:58:48.375210+0000","last_unstale":"2024-01-18T00:47:13.468415+0000","last_undegraded":"2024-01-18T00:47:13.468415+0000","last_fullsized":"2024-01-18T00:47:13.468415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1859,"log_dups_size":0,"ondisk_log_size":1859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:51:00.037407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1556390,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1788,"num_read_kb":2847,"num_write":1794,"num_write_kb":2850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'738","reported_seq":827,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.666387+0000","last_change":"2024-01-17T22:58:55.903437+0000","last_active":"2024-01-18T00:47:08.666387+0000","last_peered":"2024-01-18T00:47:08.666387+0000","last_clean":"2024-01-18T00:47:08.666387+0000","last_became_active":"2024-01-17T22:58:55.902881+0000","last_became_peered":"2024-01-17T22:58:55.902881+0000","last_unstale":"2024-01-18T00:47:08.666387+0000","last_undegraded":"2024-01-18T00:47:08.666387+0000","last_fullsized":"2024-01-18T00:47:08.666387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":79403,"num_write":724,"num_write_kb":135108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'196","reported_seq":266,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.833898+0000","last_change":"2024-01-17T22:58:49.367932+0000","last_active":"2024-01-18T00:47:15.833898+0000","last_peered":"2024-01-18T00:47:15.833898+0000","last_clean":"2024-01-18T00:47:15.833898+0000","last_became_active":"2024-01-17T22:58:49.367236+0000","last_became_peered":"2024-01-17T22:58:49.367236+0000","last_unstale":"2024-01-18T00:47:15.833898+0000","last_undegraded":"2024-01-18T00:47:15.833898+0000","last_fullsized":"2024-01-18T00:47:15.833898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:06.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'617","reported_seq":689,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:47.617658+0000","last_change":"2024-01-17T22:58:48.338730+0000","last_active":"2024-01-18T00:45:47.617658+0000","last_peered":"2024-01-18T00:45:47.617658+0000","last_clean":"2024-01-18T00:45:47.617658+0000","last_became_active":"2024-01-17T22:58:48.337500+0000","last_became_peered":"2024-01-17T22:58:48.337500+0000","last_unstale":"2024-01-18T00:45:47.617658+0000","last_undegraded":"2024-01-18T00:45:47.617658+0000","last_fullsized":"2024-01-18T00:45:47.617658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:54.141445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":12559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'904","reported_seq":1025,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.855106+0000","last_change":"2024-01-17T22:58:55.900298+0000","last_active":"2024-01-18T00:46:53.855106+0000","last_peered":"2024-01-18T00:46:53.855106+0000","last_clean":"2024-01-18T00:46:53.855106+0000","last_became_active":"2024-01-17T22:58:55.899657+0000","last_became_peered":"2024-01-17T22:58:55.899657+0000","last_unstale":"2024-01-18T00:46:53.855106+0000","last_undegraded":"2024-01-18T00:46:53.855106+0000","last_fullsized":"2024-01-18T00:46:53.855106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:30:03.955178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":184022,"num_write":887,"num_write_kb":259108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'189","reported_seq":259,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.652198+0000","last_change":"2024-01-17T22:58:49.412701+0000","last_active":"2024-01-18T00:47:15.652198+0000","last_peered":"2024-01-18T00:47:15.652198+0000","last_clean":"2024-01-18T00:47:15.652198+0000","last_became_active":"2024-01-17T22:58:49.411848+0000","last_became_peered":"2024-01-17T22:58:49.411848+0000","last_unstale":"2024-01-18T00:47:15.652198+0000","last_undegraded":"2024-01-18T00:47:15.652198+0000","last_fullsized":"2024-01-18T00:47:15.652198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:55:47.020055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'293","reported_seq":364,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.802453+0000","last_change":"2024-01-17T22:58:48.341769+0000","last_active":"2024-01-18T00:47:04.802453+0000","last_peered":"2024-01-18T00:47:04.802453+0000","last_clean":"2024-01-18T00:47:04.802453+0000","last_became_active":"2024-01-17T22:58:48.340963+0000","last_became_peered":"2024-01-17T22:58:48.340963+0000","last_unstale":"2024-01-18T00:47:04.802453+0000","last_undegraded":"2024-01-18T00:47:04.802453+0000","last_fullsized":"2024-01-18T00:47:04.802453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:15:16.672836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":4212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'161","reported_seq":278,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:44:51.424884+0000","last_change":"2024-01-17T22:58:17.322374+0000","last_active":"2024-01-18T00:44:51.424884+0000","last_peered":"2024-01-18T00:44:51.424884+0000","last_clean":"2024-01-18T00:44:51.424884+0000","last_became_active":"2024-01-17T22:58:17.321097+0000","last_became_peered":"2024-01-17T22:58:17.321097+0000","last_unstale":"2024-01-18T00:44:51.424884+0000","last_undegraded":"2024-01-18T00:44:51.424884+0000","last_fullsized":"2024-01-18T00:44:51.424884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:15.452106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:15.452106+0000","last_clean_scrub_stamp":"2024-01-17T22:58:15.452106+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:55:58.924319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'806","reported_seq":938,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:59.053289+0000","last_change":"2024-01-17T22:58:55.909509+0000","last_active":"2024-01-18T00:46:59.053289+0000","last_peered":"2024-01-18T00:46:59.053289+0000","last_clean":"2024-01-18T00:46:59.053289+0000","last_became_active":"2024-01-17T22:58:55.909055+0000","last_became_peered":"2024-01-17T22:58:55.909055+0000","last_unstale":"2024-01-18T00:46:59.053289+0000","last_undegraded":"2024-01-18T00:46:59.053289+0000","last_fullsized":"2024-01-18T00:46:59.053289+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:11:12.388395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":230974,"num_write":789,"num_write_kb":193453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'203","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:59.050211+0000","last_change":"2024-01-17T22:58:49.516198+0000","last_active":"2024-01-18T00:46:59.050211+0000","last_peered":"2024-01-18T00:46:59.050211+0000","last_clean":"2024-01-18T00:46:59.050211+0000","last_became_active":"2024-01-17T22:58:49.515941+0000","last_became_peered":"2024-01-17T22:58:49.515941+0000","last_unstale":"2024-01-18T00:46:59.050211+0000","last_undegraded":"2024-01-18T00:46:59.050211+0000","last_fullsized":"2024-01-18T00:46:59.050211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:54:07.128744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'363","reported_seq":430,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:51.399606+0000","last_change":"2024-01-17T22:58:48.344998+0000","last_active":"2024-01-18T00:46:51.399606+0000","last_peered":"2024-01-18T00:46:51.399606+0000","last_clean":"2024-01-18T00:46:51.399606+0000","last_became_active":"2024-01-17T22:58:48.344402+0000","last_became_peered":"2024-01-17T22:58:48.344402+0000","last_unstale":"2024-01-18T00:46:51.399606+0000","last_undegraded":"2024-01-18T00:46:51.399606+0000","last_fullsized":"2024-01-18T00:46:51.399606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:01:21.629083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'821","reported_seq":920,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.698709+0000","last_change":"2024-01-17T22:58:55.886258+0000","last_active":"2024-01-18T00:47:08.698709+0000","last_peered":"2024-01-18T00:47:08.698709+0000","last_clean":"2024-01-18T00:47:08.698709+0000","last_became_active":"2024-01-17T22:58:55.885809+0000","last_became_peered":"2024-01-17T22:58:55.885809+0000","last_unstale":"2024-01-18T00:47:08.698709+0000","last_undegraded":"2024-01-18T00:47:08.698709+0000","last_fullsized":"2024-01-18T00:47:08.698709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:08.327495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":121383,"num_write":812,"num_write_kb":179977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'216","reported_seq":274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651394+0000","last_change":"2024-01-17T22:59:08.654953+0000","last_active":"2024-01-18T00:47:15.651394+0000","last_peered":"2024-01-18T00:47:15.651394+0000","last_clean":"2024-01-18T00:47:15.651394+0000","last_became_active":"2024-01-17T22:59:08.654136+0000","last_became_peered":"2024-01-17T22:59:08.654136+0000","last_unstale":"2024-01-18T00:47:15.651394+0000","last_undegraded":"2024-01-18T00:47:15.651394+0000","last_fullsized":"2024-01-18T00:47:15.651394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:19:02.000223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"28'404","reported_seq":471,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:47.632062+0000","last_change":"2024-01-17T22:58:48.338206+0000","last_active":"2024-01-18T00:45:47.632062+0000","last_peered":"2024-01-18T00:45:47.632062+0000","last_clean":"2024-01-18T00:45:47.632062+0000","last_became_active":"2024-01-17T22:58:48.337489+0000","last_became_peered":"2024-01-17T22:58:48.337489+0000","last_unstale":"2024-01-18T00:45:47.632062+0000","last_undegraded":"2024-01-18T00:45:47.632062+0000","last_fullsized":"2024-01-18T00:45:47.632062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:09:04.579374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'799","reported_seq":898,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.976358+0000","last_change":"2024-01-17T22:58:55.903435+0000","last_active":"2024-01-18T00:47:08.976358+0000","last_peered":"2024-01-18T00:47:08.976358+0000","last_clean":"2024-01-18T00:47:08.976358+0000","last_became_active":"2024-01-17T22:58:55.902857+0000","last_became_peered":"2024-01-17T22:58:55.902857+0000","last_unstale":"2024-01-18T00:47:08.976358+0000","last_undegraded":"2024-01-18T00:47:08.976358+0000","last_fullsized":"2024-01-18T00:47:08.976358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:24:43.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":124542,"num_write":790,"num_write_kb":159708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'183","reported_seq":248,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:44.335190+0000","last_change":"2024-01-17T22:58:49.519307+0000","last_active":"2024-01-18T00:46:44.335190+0000","last_peered":"2024-01-18T00:46:44.335190+0000","last_clean":"2024-01-18T00:46:44.335190+0000","last_became_active":"2024-01-17T22:58:49.519060+0000","last_became_peered":"2024-01-17T22:58:49.519060+0000","last_unstale":"2024-01-18T00:46:44.335190+0000","last_undegraded":"2024-01-18T00:46:44.335190+0000","last_fullsized":"2024-01-18T00:46:44.335190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:48.025499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'863","reported_seq":930,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:33.712846+0000","last_change":"2024-01-17T22:58:48.341584+0000","last_active":"2024-01-18T00:46:33.712846+0000","last_peered":"2024-01-18T00:46:33.712846+0000","last_clean":"2024-01-18T00:46:33.712846+0000","last_became_active":"2024-01-17T22:58:48.339433+0000","last_became_peered":"2024-01-17T22:58:48.339433+0000","last_unstale":"2024-01-18T00:46:33.712846+0000","last_undegraded":"2024-01-18T00:46:33.712846+0000","last_fullsized":"2024-01-18T00:46:33.712846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:01:09.060396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":4462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'819","reported_seq":915,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:13.497911+0000","last_change":"2024-01-17T22:58:55.905118+0000","last_active":"2024-01-18T00:47:13.497911+0000","last_peered":"2024-01-18T00:47:13.497911+0000","last_clean":"2024-01-18T00:47:13.497911+0000","last_became_active":"2024-01-17T22:58:55.904690+0000","last_became_peered":"2024-01-17T22:58:55.904690+0000","last_unstale":"2024-01-18T00:47:13.497911+0000","last_undegraded":"2024-01-18T00:47:13.497911+0000","last_fullsized":"2024-01-18T00:47:13.497911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:45:30.212764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":82183,"num_write":809,"num_write_kb":113772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'190","reported_seq":255,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.654446+0000","last_change":"2024-01-17T22:58:49.352993+0000","last_active":"2024-01-18T00:47:15.654446+0000","last_peered":"2024-01-18T00:47:15.654446+0000","last_clean":"2024-01-18T00:47:15.654446+0000","last_became_active":"2024-01-17T22:58:49.352744+0000","last_became_peered":"2024-01-17T22:58:49.352744+0000","last_unstale":"2024-01-18T00:47:15.654446+0000","last_undegraded":"2024-01-18T00:47:15.654446+0000","last_fullsized":"2024-01-18T00:47:15.654446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:06.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'869","reported_seq":935,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:10.101153+0000","last_change":"2024-01-17T22:58:48.343793+0000","last_active":"2024-01-18T00:45:10.101153+0000","last_peered":"2024-01-18T00:45:10.101153+0000","last_clean":"2024-01-18T00:45:10.101153+0000","last_became_active":"2024-01-17T22:58:48.343435+0000","last_became_peered":"2024-01-17T22:58:48.343435+0000","last_unstale":"2024-01-18T00:45:10.101153+0000","last_undegraded":"2024-01-18T00:45:10.101153+0000","last_fullsized":"2024-01-18T00:45:10.101153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:50:50.592551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":940,"num_write_kb":4497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'797","reported_seq":904,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.109379+0000","last_change":"2024-01-17T22:58:55.913690+0000","last_active":"2024-01-18T00:47:09.109379+0000","last_peered":"2024-01-18T00:47:09.109379+0000","last_clean":"2024-01-18T00:47:09.109379+0000","last_became_active":"2024-01-17T22:58:55.913197+0000","last_became_peered":"2024-01-17T22:58:55.913197+0000","last_unstale":"2024-01-18T00:47:09.109379+0000","last_undegraded":"2024-01-18T00:47:09.109379+0000","last_fullsized":"2024-01-18T00:47:09.109379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:31.829297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":146211,"num_write":781,"num_write_kb":158858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'235","reported_seq":299,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.639362+0000","last_change":"2024-01-17T22:58:49.368242+0000","last_active":"2024-01-18T00:47:15.639362+0000","last_peered":"2024-01-18T00:47:15.639362+0000","last_clean":"2024-01-18T00:47:15.639362+0000","last_became_active":"2024-01-17T22:58:49.368018+0000","last_became_peered":"2024-01-17T22:58:49.368018+0000","last_unstale":"2024-01-18T00:47:15.639362+0000","last_undegraded":"2024-01-18T00:47:15.639362+0000","last_fullsized":"2024-01-18T00:47:15.639362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:49:55.661543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'701","reported_seq":766,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:28.455439+0000","last_change":"2024-01-17T22:58:48.374293+0000","last_active":"2024-01-18T00:46:28.455439+0000","last_peered":"2024-01-18T00:46:28.455439+0000","last_clean":"2024-01-18T00:46:28.455439+0000","last_became_active":"2024-01-17T22:58:48.373287+0000","last_became_peered":"2024-01-17T22:58:48.373287+0000","last_unstale":"2024-01-18T00:46:28.455439+0000","last_undegraded":"2024-01-18T00:46:28.455439+0000","last_fullsized":"2024-01-18T00:46:28.455439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":649,"num_write_kb":8541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'825","reported_seq":940,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.758998+0000","last_change":"2024-01-17T22:58:55.909679+0000","last_active":"2024-01-18T00:46:53.758998+0000","last_peered":"2024-01-18T00:46:53.758998+0000","last_clean":"2024-01-18T00:46:53.758998+0000","last_became_active":"2024-01-17T22:58:55.909139+0000","last_became_peered":"2024-01-17T22:58:55.909139+0000","last_unstale":"2024-01-18T00:46:53.758998+0000","last_undegraded":"2024-01-18T00:46:53.758998+0000","last_fullsized":"2024-01-18T00:46:53.758998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:39:50.993158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":204092,"num_write":802,"num_write_kb":163340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'217","reported_seq":280,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.760302+0000","last_change":"2024-01-17T22:58:49.515761+0000","last_active":"2024-01-18T00:47:15.760302+0000","last_peered":"2024-01-18T00:47:15.760302+0000","last_clean":"2024-01-18T00:47:15.760302+0000","last_became_active":"2024-01-17T22:58:49.514776+0000","last_became_peered":"2024-01-17T22:58:49.514776+0000","last_unstale":"2024-01-18T00:47:15.760302+0000","last_undegraded":"2024-01-18T00:47:15.760302+0000","last_fullsized":"2024-01-18T00:47:15.760302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'64","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:32.504506+0000","last_change":"2024-01-17T22:58:48.349505+0000","last_active":"2024-01-18T00:45:32.504506+0000","last_peered":"2024-01-18T00:45:32.504506+0000","last_clean":"2024-01-18T00:45:32.504506+0000","last_became_active":"2024-01-17T22:58:48.349193+0000","last_became_peered":"2024-01-17T22:58:48.349193+0000","last_unstale":"2024-01-18T00:45:32.504506+0000","last_undegraded":"2024-01-18T00:45:32.504506+0000","last_fullsized":"2024-01-18T00:45:32.504506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:10:59.139723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":842,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'809","reported_seq":919,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.381754+0000","last_change":"2024-01-17T22:58:55.911280+0000","last_active":"2024-01-18T00:47:04.381754+0000","last_peered":"2024-01-18T00:47:04.381754+0000","last_clean":"2024-01-18T00:47:04.381754+0000","last_became_active":"2024-01-17T22:58:55.910147+0000","last_became_peered":"2024-01-17T22:58:55.910147+0000","last_unstale":"2024-01-18T00:47:04.381754+0000","last_undegraded":"2024-01-18T00:47:04.381754+0000","last_fullsized":"2024-01-18T00:47:04.381754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:29:01.453903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":124212,"num_write":791,"num_write_kb":164591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'198","reported_seq":262,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660494+0000","last_change":"2024-01-17T22:58:49.366332+0000","last_active":"2024-01-18T00:47:15.660494+0000","last_peered":"2024-01-18T00:47:15.660494+0000","last_clean":"2024-01-18T00:47:15.660494+0000","last_became_active":"2024-01-17T22:58:49.366055+0000","last_became_peered":"2024-01-17T22:58:49.366055+0000","last_unstale":"2024-01-18T00:47:15.660494+0000","last_undegraded":"2024-01-18T00:47:15.660494+0000","last_fullsized":"2024-01-18T00:47:15.660494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:44:30.888903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'54","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:11.376150+0000","last_change":"2024-01-17T22:58:48.378008+0000","last_active":"2024-01-18T00:46:11.376150+0000","last_peered":"2024-01-18T00:46:11.376150+0000","last_clean":"2024-01-18T00:46:11.376150+0000","last_became_active":"2024-01-17T22:58:48.377732+0000","last_became_peered":"2024-01-17T22:58:48.377732+0000","last_unstale":"2024-01-18T00:46:11.376150+0000","last_undegraded":"2024-01-18T00:46:11.376150+0000","last_fullsized":"2024-01-18T00:46:11.376150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:05.032134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'664","reported_seq":748,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:58.927643+0000","last_change":"2024-01-17T22:59:09.245915+0000","last_active":"2024-01-18T00:46:58.927643+0000","last_peered":"2024-01-18T00:46:58.927643+0000","last_clean":"2024-01-18T00:46:58.927643+0000","last_became_active":"2024-01-17T22:59:09.244621+0000","last_became_peered":"2024-01-17T22:59:09.244621+0000","last_unstale":"2024-01-18T00:46:58.927643+0000","last_undegraded":"2024-01-18T00:46:58.927643+0000","last_fullsized":"2024-01-18T00:46:58.927643+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:01:38.677481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":44179,"num_write":651,"num_write_kb":63897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,5],"acting":[6,4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'209","reported_seq":273,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.828129+0000","last_change":"2024-01-17T22:58:49.368620+0000","last_active":"2024-01-18T00:47:15.828129+0000","last_peered":"2024-01-18T00:47:15.828129+0000","last_clean":"2024-01-18T00:47:15.828129+0000","last_became_active":"2024-01-17T22:58:49.367258+0000","last_became_peered":"2024-01-17T22:58:49.367258+0000","last_unstale":"2024-01-18T00:47:15.828129+0000","last_undegraded":"2024-01-18T00:47:15.828129+0000","last_fullsized":"2024-01-18T00:47:15.828129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:25.515983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'368","reported_seq":433,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:43.489636+0000","last_change":"2024-01-17T22:58:48.371378+0000","last_active":"2024-01-18T00:45:43.489636+0000","last_peered":"2024-01-18T00:45:43.489636+0000","last_clean":"2024-01-18T00:45:43.489636+0000","last_became_active":"2024-01-17T22:58:48.370691+0000","last_became_peered":"2024-01-17T22:58:48.370691+0000","last_unstale":"2024-01-18T00:45:43.489636+0000","last_undegraded":"2024-01-18T00:45:43.489636+0000","last_fullsized":"2024-01-18T00:45:43.489636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:01:21.629083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":8326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'675","reported_seq":751,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:54.053556+0000","last_change":"2024-01-17T22:58:55.846853+0000","last_active":"2024-01-18T00:46:54.053556+0000","last_peered":"2024-01-18T00:46:54.053556+0000","last_clean":"2024-01-18T00:46:54.053556+0000","last_became_active":"2024-01-17T22:58:55.846382+0000","last_became_peered":"2024-01-17T22:58:55.846382+0000","last_unstale":"2024-01-18T00:46:54.053556+0000","last_undegraded":"2024-01-18T00:46:54.053556+0000","last_fullsized":"2024-01-18T00:46:54.053556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:00:22.788812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":43277,"num_write":656,"num_write_kb":56099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'187","reported_seq":249,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:33.722425+0000","last_change":"2024-01-17T22:58:49.367642+0000","last_active":"2024-01-18T00:46:33.722425+0000","last_peered":"2024-01-18T00:46:33.722425+0000","last_clean":"2024-01-18T00:46:33.722425+0000","last_became_active":"2024-01-17T22:58:49.367370+0000","last_became_peered":"2024-01-17T22:58:49.367370+0000","last_unstale":"2024-01-18T00:46:33.722425+0000","last_undegraded":"2024-01-18T00:46:33.722425+0000","last_fullsized":"2024-01-18T00:46:33.722425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:24:43.594840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'1300","reported_seq":1364,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:51.758158+0000","last_change":"2024-01-17T22:58:48.346833+0000","last_active":"2024-01-18T00:46:51.758158+0000","last_peered":"2024-01-18T00:46:51.758158+0000","last_clean":"2024-01-18T00:46:51.758158+0000","last_became_active":"2024-01-17T22:58:48.346574+0000","last_became_peered":"2024-01-17T22:58:48.346574+0000","last_unstale":"2024-01-18T00:46:51.758158+0000","last_undegraded":"2024-01-18T00:46:51.758158+0000","last_fullsized":"2024-01-18T00:46:51.758158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1300,"log_dups_size":0,"ondisk_log_size":1300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:55:23.055396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":13137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'811","reported_seq":915,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.691930+0000","last_change":"2024-01-17T22:58:55.832183+0000","last_active":"2024-01-18T00:47:04.691930+0000","last_peered":"2024-01-18T00:47:04.691930+0000","last_clean":"2024-01-18T00:47:04.691930+0000","last_became_active":"2024-01-17T22:58:55.831090+0000","last_became_peered":"2024-01-17T22:58:55.831090+0000","last_unstale":"2024-01-18T00:47:04.691930+0000","last_undegraded":"2024-01-18T00:47:04.691930+0000","last_fullsized":"2024-01-18T00:47:04.691930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:15.077032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":127549,"num_write":788,"num_write_kb":160232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'198","reported_seq":262,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.664502+0000","last_change":"2024-01-17T22:58:49.366048+0000","last_active":"2024-01-18T00:47:15.664502+0000","last_peered":"2024-01-18T00:47:15.664502+0000","last_clean":"2024-01-18T00:47:15.664502+0000","last_became_active":"2024-01-17T22:58:49.365846+0000","last_became_peered":"2024-01-17T22:58:49.365846+0000","last_unstale":"2024-01-18T00:47:15.664502+0000","last_undegraded":"2024-01-18T00:47:15.664502+0000","last_fullsized":"2024-01-18T00:47:15.664502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:19:02.000223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'1446","reported_seq":1509,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.419203+0000","last_change":"2024-01-17T22:58:48.376099+0000","last_active":"2024-01-18T00:47:09.419203+0000","last_peered":"2024-01-18T00:47:09.419203+0000","last_clean":"2024-01-18T00:47:09.419203+0000","last_became_active":"2024-01-17T22:58:48.375504+0000","last_became_peered":"2024-01-17T22:58:48.375504+0000","last_unstale":"2024-01-18T00:47:09.419203+0000","last_undegraded":"2024-01-18T00:47:09.419203+0000","last_fullsized":"2024-01-18T00:47:09.419203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1446,"log_dups_size":0,"ondisk_log_size":1446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1379,"num_write_kb":5332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'771","reported_seq":867,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.139685+0000","last_change":"2024-01-17T22:58:55.906751+0000","last_active":"2024-01-18T00:47:09.139685+0000","last_peered":"2024-01-18T00:47:09.139685+0000","last_clean":"2024-01-18T00:47:09.139685+0000","last_became_active":"2024-01-17T22:58:55.906429+0000","last_became_peered":"2024-01-17T22:58:55.906429+0000","last_unstale":"2024-01-18T00:47:09.139685+0000","last_undegraded":"2024-01-18T00:47:09.139685+0000","last_fullsized":"2024-01-18T00:47:09.139685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:37:20.317014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":103553,"num_write":751,"num_write_kb":113909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'194","reported_seq":256,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:49.621926+0000","last_change":"2024-01-17T22:58:49.361059+0000","last_active":"2024-01-18T00:46:49.621926+0000","last_peered":"2024-01-18T00:46:49.621926+0000","last_clean":"2024-01-18T00:46:49.621926+0000","last_became_active":"2024-01-17T22:58:49.360282+0000","last_became_peered":"2024-01-17T22:58:49.360282+0000","last_unstale":"2024-01-18T00:46:49.621926+0000","last_undegraded":"2024-01-18T00:46:49.621926+0000","last_fullsized":"2024-01-18T00:46:49.621926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:10:15.673364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'183","reported_seq":246,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:13.525813+0000","last_change":"2024-01-17T22:58:48.349585+0000","last_active":"2024-01-18T00:45:13.525813+0000","last_peered":"2024-01-18T00:45:13.525813+0000","last_clean":"2024-01-18T00:45:13.525813+0000","last_became_active":"2024-01-17T22:58:48.349262+0000","last_became_peered":"2024-01-17T22:58:48.349262+0000","last_unstale":"2024-01-18T00:45:13.525813+0000","last_undegraded":"2024-01-18T00:45:13.525813+0000","last_fullsized":"2024-01-18T00:45:13.525813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:32:48.765965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'853","reported_seq":942,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.911679+0000","last_change":"2024-01-17T22:58:55.899604+0000","last_active":"2024-01-18T00:47:04.911679+0000","last_peered":"2024-01-18T00:47:04.911679+0000","last_clean":"2024-01-18T00:47:04.911679+0000","last_became_active":"2024-01-17T22:58:55.899176+0000","last_became_peered":"2024-01-17T22:58:55.899176+0000","last_unstale":"2024-01-18T00:47:04.911679+0000","last_undegraded":"2024-01-18T00:47:04.911679+0000","last_fullsized":"2024-01-18T00:47:04.911679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:47.829295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":85515,"num_write":843,"num_write_kb":192821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'218","reported_seq":279,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651074+0000","last_change":"2024-01-17T22:58:49.364258+0000","last_active":"2024-01-18T00:47:15.651074+0000","last_peered":"2024-01-18T00:47:15.651074+0000","last_clean":"2024-01-18T00:47:15.651074+0000","last_became_active":"2024-01-17T22:58:49.363979+0000","last_became_peered":"2024-01-17T22:58:49.363979+0000","last_unstale":"2024-01-18T00:47:15.651074+0000","last_undegraded":"2024-01-18T00:47:15.651074+0000","last_fullsized":"2024-01-18T00:47:15.651074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:15:17.927996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'57","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:19.024164+0000","last_change":"2024-01-17T22:58:48.321573+0000","last_active":"2024-01-18T00:46:19.024164+0000","last_peered":"2024-01-18T00:46:19.024164+0000","last_clean":"2024-01-18T00:46:19.024164+0000","last_became_active":"2024-01-17T22:58:48.321379+0000","last_became_peered":"2024-01-17T22:58:48.321379+0000","last_unstale":"2024-01-18T00:46:19.024164+0000","last_undegraded":"2024-01-18T00:46:19.024164+0000","last_fullsized":"2024-01-18T00:46:19.024164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:55:23.055396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'867","reported_seq":978,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.750269+0000","last_change":"2024-01-17T22:58:55.873529+0000","last_active":"2024-01-18T00:47:08.750269+0000","last_peered":"2024-01-18T00:47:08.750269+0000","last_clean":"2024-01-18T00:47:08.750269+0000","last_became_active":"2024-01-17T22:58:55.872885+0000","last_became_peered":"2024-01-17T22:58:55.872885+0000","last_unstale":"2024-01-18T00:47:08.750269+0000","last_undegraded":"2024-01-18T00:47:08.750269+0000","last_fullsized":"2024-01-18T00:47:08.750269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:50:01.974857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":173952,"num_write":855,"num_write_kb":180962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'734","reported_seq":837,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.313232+0000","last_change":"2024-01-17T22:58:55.903620+0000","last_active":"2024-01-18T00:47:04.313232+0000","last_peered":"2024-01-18T00:47:04.313232+0000","last_clean":"2024-01-18T00:47:04.313232+0000","last_became_active":"2024-01-17T22:58:55.902860+0000","last_became_peered":"2024-01-17T22:58:55.902860+0000","last_unstale":"2024-01-18T00:47:04.313232+0000","last_undegraded":"2024-01-18T00:47:04.313232+0000","last_fullsized":"2024-01-18T00:47:04.313232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:33:56.437178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":112144,"num_write":721,"num_write_kb":109826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'202","reported_seq":264,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.652277+0000","last_change":"2024-01-17T22:58:49.515108+0000","last_active":"2024-01-18T00:47:15.652277+0000","last_peered":"2024-01-18T00:47:15.652277+0000","last_clean":"2024-01-18T00:47:15.652277+0000","last_became_active":"2024-01-17T22:58:49.514297+0000","last_became_peered":"2024-01-17T22:58:49.514297+0000","last_unstale":"2024-01-18T00:47:15.652277+0000","last_undegraded":"2024-01-18T00:47:15.652277+0000","last_fullsized":"2024-01-18T00:47:15.652277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:15.814647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'1279","reported_seq":1342,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:11.369763+0000","last_change":"2024-01-17T22:58:48.331952+0000","last_active":"2024-01-18T00:45:11.369763+0000","last_peered":"2024-01-18T00:45:11.369763+0000","last_clean":"2024-01-18T00:45:11.369763+0000","last_became_active":"2024-01-17T22:58:48.331645+0000","last_became_peered":"2024-01-17T22:58:48.331645+0000","last_unstale":"2024-01-18T00:45:11.369763+0000","last_undegraded":"2024-01-18T00:45:11.369763+0000","last_fullsized":"2024-01-18T00:45:11.369763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1279,"log_dups_size":0,"ondisk_log_size":1279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:24.260824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":12872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'696","reported_seq":781,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.985592+0000","last_change":"2024-01-17T22:58:55.906062+0000","last_active":"2024-01-18T00:47:08.985592+0000","last_peered":"2024-01-18T00:47:08.985592+0000","last_clean":"2024-01-18T00:47:08.985592+0000","last_became_active":"2024-01-17T22:58:55.905743+0000","last_became_peered":"2024-01-17T22:58:55.905743+0000","last_unstale":"2024-01-18T00:47:08.985592+0000","last_undegraded":"2024-01-18T00:47:08.985592+0000","last_fullsized":"2024-01-18T00:47:08.985592+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:19:20.308367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":59282,"num_write":679,"num_write_kb":96928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'229","reported_seq":291,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.925040+0000","last_change":"2024-01-17T22:58:49.369540+0000","last_active":"2024-01-18T00:47:04.925040+0000","last_peered":"2024-01-18T00:47:04.925040+0000","last_clean":"2024-01-18T00:47:04.925040+0000","last_became_active":"2024-01-17T22:58:49.366692+0000","last_became_peered":"2024-01-17T22:58:49.366692+0000","last_unstale":"2024-01-18T00:47:04.925040+0000","last_undegraded":"2024-01-18T00:47:04.925040+0000","last_fullsized":"2024-01-18T00:47:04.925040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:39:54.814019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'170","reported_seq":233,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.968197+0000","last_change":"2024-01-17T22:58:48.345003+0000","last_active":"2024-01-18T00:46:53.968197+0000","last_peered":"2024-01-18T00:46:53.968197+0000","last_clean":"2024-01-18T00:46:53.968197+0000","last_became_active":"2024-01-17T22:58:48.344271+0000","last_became_peered":"2024-01-17T22:58:48.344271+0000","last_unstale":"2024-01-18T00:46:53.968197+0000","last_undegraded":"2024-01-18T00:46:53.968197+0000","last_fullsized":"2024-01-18T00:46:53.968197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:51:00.037407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'1514","reported_seq":1576,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.329841+0000","last_change":"2024-01-17T22:58:48.342292+0000","last_active":"2024-01-18T00:47:15.329841+0000","last_peered":"2024-01-18T00:47:15.329841+0000","last_clean":"2024-01-18T00:47:15.329841+0000","last_became_active":"2024-01-17T22:58:48.339364+0000","last_became_peered":"2024-01-17T22:58:48.339364+0000","last_unstale":"2024-01-18T00:47:15.329841+0000","last_undegraded":"2024-01-18T00:47:15.329841+0000","last_fullsized":"2024-01-18T00:47:15.329841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1514,"log_dups_size":0,"ondisk_log_size":1514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:51.848489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16419543,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1459,"num_write_kb":16764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'186","reported_seq":247,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.645647+0000","last_change":"2024-01-17T22:58:49.414836+0000","last_active":"2024-01-18T00:47:15.645647+0000","last_peered":"2024-01-18T00:47:15.645647+0000","last_clean":"2024-01-18T00:47:15.645647+0000","last_became_active":"2024-01-17T22:58:49.414163+0000","last_became_peered":"2024-01-17T22:58:49.414163+0000","last_unstale":"2024-01-18T00:47:15.645647+0000","last_undegraded":"2024-01-18T00:47:15.645647+0000","last_fullsized":"2024-01-18T00:47:15.645647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:24.988174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'765","reported_seq":855,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:44.182734+0000","last_change":"2024-01-17T22:58:55.880197+0000","last_active":"2024-01-18T00:46:44.182734+0000","last_peered":"2024-01-18T00:46:44.182734+0000","last_clean":"2024-01-18T00:46:44.182734+0000","last_became_active":"2024-01-17T22:58:55.879263+0000","last_became_peered":"2024-01-17T22:58:55.879263+0000","last_unstale":"2024-01-18T00:46:44.182734+0000","last_undegraded":"2024-01-18T00:46:44.182734+0000","last_fullsized":"2024-01-18T00:46:44.182734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:47:02.273099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":97351,"num_write":747,"num_write_kb":155607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'207","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:19.012190+0000","last_change":"2024-01-17T22:58:48.339419+0000","last_active":"2024-01-18T00:46:19.012190+0000","last_peered":"2024-01-18T00:46:19.012190+0000","last_clean":"2024-01-18T00:46:19.012190+0000","last_became_active":"2024-01-17T22:58:48.338809+0000","last_became_peered":"2024-01-17T22:58:48.338809+0000","last_unstale":"2024-01-18T00:46:19.012190+0000","last_undegraded":"2024-01-18T00:46:19.012190+0000","last_fullsized":"2024-01-18T00:46:19.012190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:20:07.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'206","reported_seq":266,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.760461+0000","last_change":"2024-01-17T22:58:49.518469+0000","last_active":"2024-01-18T00:47:15.760461+0000","last_peered":"2024-01-18T00:47:15.760461+0000","last_clean":"2024-01-18T00:47:15.760461+0000","last_became_active":"2024-01-17T22:58:49.518211+0000","last_became_peered":"2024-01-17T22:58:49.518211+0000","last_unstale":"2024-01-18T00:47:15.760461+0000","last_undegraded":"2024-01-18T00:47:15.760461+0000","last_fullsized":"2024-01-18T00:47:15.760461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:22.954968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'779","reported_seq":879,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:44.254665+0000","last_change":"2024-01-17T22:58:55.913601+0000","last_active":"2024-01-18T00:46:44.254665+0000","last_peered":"2024-01-18T00:46:44.254665+0000","last_clean":"2024-01-18T00:46:44.254665+0000","last_became_active":"2024-01-17T22:58:55.912825+0000","last_became_peered":"2024-01-17T22:58:55.912825+0000","last_unstale":"2024-01-18T00:46:44.254665+0000","last_undegraded":"2024-01-18T00:46:44.254665+0000","last_fullsized":"2024-01-18T00:46:44.254665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:36.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":138691,"num_write":762,"num_write_kb":151906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'221","reported_seq":290,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651529+0000","last_change":"2024-01-17T22:58:49.371282+0000","last_active":"2024-01-18T00:47:15.651529+0000","last_peered":"2024-01-18T00:47:15.651529+0000","last_clean":"2024-01-18T00:47:15.651529+0000","last_became_active":"2024-01-17T22:58:49.371125+0000","last_became_peered":"2024-01-17T22:58:49.371125+0000","last_unstale":"2024-01-18T00:47:15.651529+0000","last_undegraded":"2024-01-18T00:47:15.651529+0000","last_fullsized":"2024-01-18T00:47:15.651529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'215","reported_seq":285,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.682799+0000","last_change":"2024-01-17T22:58:49.510490+0000","last_active":"2024-01-18T00:47:15.682799+0000","last_peered":"2024-01-18T00:47:15.682799+0000","last_clean":"2024-01-18T00:47:15.682799+0000","last_became_active":"2024-01-17T22:58:49.509690+0000","last_became_peered":"2024-01-17T22:58:49.509690+0000","last_unstale":"2024-01-18T00:47:15.682799+0000","last_undegraded":"2024-01-18T00:47:15.682799+0000","last_fullsized":"2024-01-18T00:47:15.682799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'233","reported_seq":303,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.659973+0000","last_change":"2024-01-17T22:58:49.371326+0000","last_active":"2024-01-18T00:47:15.659973+0000","last_peered":"2024-01-18T00:47:15.659973+0000","last_clean":"2024-01-18T00:47:15.659973+0000","last_became_active":"2024-01-17T22:58:49.370511+0000","last_became_peered":"2024-01-17T22:58:49.370511+0000","last_unstale":"2024-01-18T00:47:15.659973+0000","last_undegraded":"2024-01-18T00:47:15.659973+0000","last_fullsized":"2024-01-18T00:47:15.659973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:46:55.959786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'202","reported_seq":271,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.827677+0000","last_change":"2024-01-17T22:58:49.385500+0000","last_active":"2024-01-18T00:46:53.827677+0000","last_peered":"2024-01-18T00:46:53.827677+0000","last_clean":"2024-01-18T00:46:53.827677+0000","last_became_active":"2024-01-17T22:58:49.384397+0000","last_became_peered":"2024-01-17T22:58:49.384397+0000","last_unstale":"2024-01-18T00:46:53.827677+0000","last_undegraded":"2024-01-18T00:46:53.827677+0000","last_fullsized":"2024-01-18T00:46:53.827677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:18.563360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'188","reported_seq":256,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.834261+0000","last_change":"2024-01-17T22:58:49.369750+0000","last_active":"2024-01-18T00:47:15.834261+0000","last_peered":"2024-01-18T00:47:15.834261+0000","last_clean":"2024-01-18T00:47:15.834261+0000","last_became_active":"2024-01-17T22:58:49.368591+0000","last_became_peered":"2024-01-17T22:58:49.368591+0000","last_unstale":"2024-01-18T00:47:15.834261+0000","last_undegraded":"2024-01-18T00:47:15.834261+0000","last_fullsized":"2024-01-18T00:47:15.834261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:59.773063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'203","reported_seq":271,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.827054+0000","last_change":"2024-01-17T22:58:49.380275+0000","last_active":"2024-01-18T00:47:15.827054+0000","last_peered":"2024-01-18T00:47:15.827054+0000","last_clean":"2024-01-18T00:47:15.827054+0000","last_became_active":"2024-01-17T22:58:49.379560+0000","last_became_peered":"2024-01-17T22:58:49.379560+0000","last_unstale":"2024-01-18T00:47:15.827054+0000","last_undegraded":"2024-01-18T00:47:15.827054+0000","last_fullsized":"2024-01-18T00:47:15.827054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:41.515981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'241","reported_seq":308,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651008+0000","last_change":"2024-01-17T22:58:49.368509+0000","last_active":"2024-01-18T00:47:15.651008+0000","last_peered":"2024-01-18T00:47:15.651008+0000","last_clean":"2024-01-18T00:47:15.651008+0000","last_became_active":"2024-01-17T22:58:49.367330+0000","last_became_peered":"2024-01-17T22:58:49.367330+0000","last_unstale":"2024-01-18T00:47:15.651008+0000","last_undegraded":"2024-01-18T00:47:15.651008+0000","last_fullsized":"2024-01-18T00:47:15.651008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'192","reported_seq":260,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.697801+0000","last_change":"2024-01-17T22:58:49.514419+0000","last_active":"2024-01-18T00:47:08.697801+0000","last_peered":"2024-01-18T00:47:08.697801+0000","last_clean":"2024-01-18T00:47:08.697801+0000","last_became_active":"2024-01-17T22:58:49.513924+0000","last_became_peered":"2024-01-17T22:58:49.513924+0000","last_unstale":"2024-01-18T00:47:08.697801+0000","last_undegraded":"2024-01-18T00:47:08.697801+0000","last_fullsized":"2024-01-18T00:47:08.697801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:24:43.594840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'222","reported_seq":289,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660244+0000","last_change":"2024-01-17T22:58:49.371064+0000","last_active":"2024-01-18T00:47:15.660244+0000","last_peered":"2024-01-18T00:47:15.660244+0000","last_clean":"2024-01-18T00:47:15.660244+0000","last_became_active":"2024-01-17T22:58:49.370808+0000","last_became_peered":"2024-01-17T22:58:49.370808+0000","last_unstale":"2024-01-18T00:47:15.660244+0000","last_undegraded":"2024-01-18T00:47:15.660244+0000","last_fullsized":"2024-01-18T00:47:15.660244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:39.502451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'195","reported_seq":261,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.757041+0000","last_change":"2024-01-17T22:58:49.350539+0000","last_active":"2024-01-18T00:46:53.757041+0000","last_peered":"2024-01-18T00:46:53.757041+0000","last_clean":"2024-01-18T00:46:53.757041+0000","last_became_active":"2024-01-17T22:58:49.350057+0000","last_became_peered":"2024-01-17T22:58:49.350057+0000","last_unstale":"2024-01-18T00:46:53.757041+0000","last_undegraded":"2024-01-18T00:46:53.757041+0000","last_fullsized":"2024-01-18T00:46:53.757041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:43.516572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'209","reported_seq":274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.697094+0000","last_change":"2024-01-17T22:58:49.517955+0000","last_active":"2024-01-18T00:47:15.697094+0000","last_peered":"2024-01-18T00:47:15.697094+0000","last_clean":"2024-01-18T00:47:15.697094+0000","last_became_active":"2024-01-17T22:58:49.517631+0000","last_became_peered":"2024-01-17T22:58:49.517631+0000","last_unstale":"2024-01-18T00:47:15.697094+0000","last_undegraded":"2024-01-18T00:47:15.697094+0000","last_fullsized":"2024-01-18T00:47:15.697094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:41:25.372897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'203","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.656287+0000","last_change":"2024-01-17T22:58:49.412901+0000","last_active":"2024-01-18T00:47:15.656287+0000","last_peered":"2024-01-18T00:47:15.656287+0000","last_clean":"2024-01-18T00:47:15.656287+0000","last_became_active":"2024-01-17T22:58:49.411772+0000","last_became_peered":"2024-01-17T22:58:49.411772+0000","last_unstale":"2024-01-18T00:47:15.656287+0000","last_undegraded":"2024-01-18T00:47:15.656287+0000","last_fullsized":"2024-01-18T00:47:15.656287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:30.366002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'220","reported_seq":278,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.681236+0000","last_change":"2024-01-17T22:59:08.750879+0000","last_active":"2024-01-18T00:47:15.681236+0000","last_peered":"2024-01-18T00:47:15.681236+0000","last_clean":"2024-01-18T00:47:15.681236+0000","last_became_active":"2024-01-17T22:59:08.750082+0000","last_became_peered":"2024-01-17T22:59:08.750082+0000","last_unstale":"2024-01-18T00:47:15.681236+0000","last_undegraded":"2024-01-18T00:47:15.681236+0000","last_fullsized":"2024-01-18T00:47:15.681236+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:49:12.522334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"28'209","reported_seq":274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660224+0000","last_change":"2024-01-17T22:58:49.415138+0000","last_active":"2024-01-18T00:47:15.660224+0000","last_peered":"2024-01-18T00:47:15.660224+0000","last_clean":"2024-01-18T00:47:15.660224+0000","last_became_active":"2024-01-17T22:58:49.414598+0000","last_became_peered":"2024-01-17T22:58:49.414598+0000","last_unstale":"2024-01-18T00:47:15.660224+0000","last_undegraded":"2024-01-18T00:47:15.660224+0000","last_fullsized":"2024-01-18T00:47:15.660224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:40.477976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'191","reported_seq":255,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.676927+0000","last_change":"2024-01-17T22:58:49.388702+0000","last_active":"2024-01-18T00:47:15.676927+0000","last_peered":"2024-01-18T00:47:15.676927+0000","last_clean":"2024-01-18T00:47:15.676927+0000","last_became_active":"2024-01-17T22:58:49.388096+0000","last_became_peered":"2024-01-17T22:58:49.388096+0000","last_unstale":"2024-01-18T00:47:15.676927+0000","last_undegraded":"2024-01-18T00:47:15.676927+0000","last_fullsized":"2024-01-18T00:47:15.676927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'199","reported_seq":263,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.656730+0000","last_change":"2024-01-17T22:58:49.370433+0000","last_active":"2024-01-18T00:47:15.656730+0000","last_peered":"2024-01-18T00:47:15.656730+0000","last_clean":"2024-01-18T00:47:15.656730+0000","last_became_active":"2024-01-17T22:58:49.369959+0000","last_became_peered":"2024-01-17T22:58:49.369959+0000","last_unstale":"2024-01-18T00:47:15.656730+0000","last_undegraded":"2024-01-18T00:47:15.656730+0000","last_fullsized":"2024-01-18T00:47:15.656730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:41:09.206436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'218","reported_seq":282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660310+0000","last_change":"2024-01-17T22:58:49.366356+0000","last_active":"2024-01-18T00:47:15.660310+0000","last_peered":"2024-01-18T00:47:15.660310+0000","last_clean":"2024-01-18T00:47:15.660310+0000","last_became_active":"2024-01-17T22:58:49.366122+0000","last_became_peered":"2024-01-17T22:58:49.366122+0000","last_unstale":"2024-01-18T00:47:15.660310+0000","last_undegraded":"2024-01-18T00:47:15.660310+0000","last_fullsized":"2024-01-18T00:47:15.660310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:33:50.123865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'207","reported_seq":271,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.757756+0000","last_change":"2024-01-17T22:58:49.349380+0000","last_active":"2024-01-18T00:46:53.757756+0000","last_peered":"2024-01-18T00:46:53.757756+0000","last_clean":"2024-01-18T00:46:53.757756+0000","last_became_active":"2024-01-17T22:58:49.348630+0000","last_became_peered":"2024-01-17T22:58:49.348630+0000","last_unstale":"2024-01-18T00:46:53.757756+0000","last_undegraded":"2024-01-18T00:46:53.757756+0000","last_fullsized":"2024-01-18T00:46:53.757756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:59:07.405202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'210","reported_seq":274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.831144+0000","last_change":"2024-01-17T22:58:49.383079+0000","last_active":"2024-01-18T00:47:15.831144+0000","last_peered":"2024-01-18T00:47:15.831144+0000","last_clean":"2024-01-18T00:47:15.831144+0000","last_became_active":"2024-01-17T22:58:49.382454+0000","last_became_peered":"2024-01-17T22:58:49.382454+0000","last_unstale":"2024-01-18T00:47:15.831144+0000","last_undegraded":"2024-01-18T00:47:15.831144+0000","last_fullsized":"2024-01-18T00:47:15.831144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:48.465209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'196","reported_seq":258,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.832951+0000","last_change":"2024-01-17T22:58:49.366078+0000","last_active":"2024-01-18T00:47:15.832951+0000","last_peered":"2024-01-18T00:47:15.832951+0000","last_clean":"2024-01-18T00:47:15.832951+0000","last_became_active":"2024-01-17T22:58:49.364509+0000","last_became_peered":"2024-01-17T22:58:49.364509+0000","last_unstale":"2024-01-18T00:47:15.832951+0000","last_undegraded":"2024-01-18T00:47:15.832951+0000","last_fullsized":"2024-01-18T00:47:15.832951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:44.036981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'164","reported_seq":226,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:09.454399+0000","last_change":"2024-01-17T22:58:49.518204+0000","last_active":"2024-01-18T00:46:09.454399+0000","last_peered":"2024-01-18T00:46:09.454399+0000","last_clean":"2024-01-18T00:46:09.454399+0000","last_became_active":"2024-01-17T22:58:49.517927+0000","last_became_peered":"2024-01-17T22:58:49.517927+0000","last_unstale":"2024-01-18T00:46:09.454399+0000","last_undegraded":"2024-01-18T00:46:09.454399+0000","last_fullsized":"2024-01-18T00:46:09.454399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:04:38.588573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'169","reported_seq":231,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.884153+0000","last_change":"2024-01-17T22:58:49.364080+0000","last_active":"2024-01-18T00:46:53.884153+0000","last_peered":"2024-01-18T00:46:53.884153+0000","last_clean":"2024-01-18T00:46:53.884153+0000","last_became_active":"2024-01-17T22:58:49.363804+0000","last_became_peered":"2024-01-17T22:58:49.363804+0000","last_unstale":"2024-01-18T00:46:53.884153+0000","last_undegraded":"2024-01-18T00:46:53.884153+0000","last_fullsized":"2024-01-18T00:46:53.884153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:59:07.405202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"28'200","reported_seq":262,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:39.696311+0000","last_change":"2024-01-17T22:58:49.352782+0000","last_active":"2024-01-18T00:46:39.696311+0000","last_peered":"2024-01-18T00:46:39.696311+0000","last_clean":"2024-01-18T00:46:39.696311+0000","last_became_active":"2024-01-17T22:58:49.352513+0000","last_became_peered":"2024-01-17T22:58:49.352513+0000","last_unstale":"2024-01-18T00:46:39.696311+0000","last_undegraded":"2024-01-18T00:46:39.696311+0000","last_fullsized":"2024-01-18T00:46:39.696311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:39:54.814019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'213","reported_seq":274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.759028+0000","last_change":"2024-01-17T22:58:49.519775+0000","last_active":"2024-01-18T00:47:15.759028+0000","last_peered":"2024-01-18T00:47:15.759028+0000","last_clean":"2024-01-18T00:47:15.759028+0000","last_became_active":"2024-01-17T22:58:49.518646+0000","last_became_peered":"2024-01-17T22:58:49.518646+0000","last_unstale":"2024-01-18T00:47:15.759028+0000","last_undegraded":"2024-01-18T00:47:15.759028+0000","last_fullsized":"2024-01-18T00:47:15.759028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'189","reported_seq":250,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:39.599658+0000","last_change":"2024-01-17T22:58:49.349737+0000","last_active":"2024-01-18T00:46:39.599658+0000","last_peered":"2024-01-18T00:46:39.599658+0000","last_clean":"2024-01-18T00:46:39.599658+0000","last_became_active":"2024-01-17T22:58:49.349021+0000","last_became_peered":"2024-01-17T22:58:49.349021+0000","last_unstale":"2024-01-18T00:46:39.599658+0000","last_undegraded":"2024-01-18T00:46:39.599658+0000","last_fullsized":"2024-01-18T00:46:39.599658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:42:24.949957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'197","reported_seq":258,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:43.876345+0000","last_change":"2024-01-17T22:58:49.415068+0000","last_active":"2024-01-18T00:46:43.876345+0000","last_peered":"2024-01-18T00:46:43.876345+0000","last_clean":"2024-01-18T00:46:43.876345+0000","last_became_active":"2024-01-17T22:58:49.414856+0000","last_became_peered":"2024-01-17T22:58:49.414856+0000","last_unstale":"2024-01-18T00:46:43.876345+0000","last_undegraded":"2024-01-18T00:46:43.876345+0000","last_fullsized":"2024-01-18T00:46:43.876345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:02:07.535209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'190","reported_seq":250,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.653814+0000","last_change":"2024-01-17T22:58:49.414783+0000","last_active":"2024-01-18T00:47:15.653814+0000","last_peered":"2024-01-18T00:47:15.653814+0000","last_clean":"2024-01-18T00:47:15.653814+0000","last_became_active":"2024-01-17T22:58:49.414446+0000","last_became_peered":"2024-01-17T22:58:49.414446+0000","last_unstale":"2024-01-18T00:47:15.653814+0000","last_undegraded":"2024-01-18T00:47:15.653814+0000","last_fullsized":"2024-01-18T00:47:15.653814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'204","reported_seq":265,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:59.142292+0000","last_change":"2024-01-17T22:58:49.357264+0000","last_active":"2024-01-18T00:46:59.142292+0000","last_peered":"2024-01-18T00:46:59.142292+0000","last_clean":"2024-01-18T00:46:59.142292+0000","last_became_active":"2024-01-17T22:58:49.357085+0000","last_became_peered":"2024-01-17T22:58:49.357085+0000","last_unstale":"2024-01-18T00:46:59.142292+0000","last_undegraded":"2024-01-18T00:46:59.142292+0000","last_fullsized":"2024-01-18T00:46:59.142292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:13:09.466879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'196","reported_seq":266,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.654962+0000","last_change":"2024-01-17T22:58:49.414726+0000","last_active":"2024-01-18T00:47:15.654962+0000","last_peered":"2024-01-18T00:47:15.654962+0000","last_clean":"2024-01-18T00:47:15.654962+0000","last_became_active":"2024-01-17T22:58:49.414490+0000","last_became_peered":"2024-01-17T22:58:49.414490+0000","last_unstale":"2024-01-18T00:47:15.654962+0000","last_undegraded":"2024-01-18T00:47:15.654962+0000","last_fullsized":"2024-01-18T00:47:15.654962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:48.465209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'189","reported_seq":259,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.975642+0000","last_change":"2024-01-17T22:58:49.413155+0000","last_active":"2024-01-18T00:47:08.975642+0000","last_peered":"2024-01-18T00:47:08.975642+0000","last_clean":"2024-01-18T00:47:08.975642+0000","last_became_active":"2024-01-17T22:58:49.412382+0000","last_became_peered":"2024-01-17T22:58:49.412382+0000","last_unstale":"2024-01-18T00:47:08.975642+0000","last_undegraded":"2024-01-18T00:47:08.975642+0000","last_fullsized":"2024-01-18T00:47:08.975642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:04:38.588573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'197","reported_seq":267,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:58.956101+0000","last_change":"2024-01-17T22:58:49.368686+0000","last_active":"2024-01-18T00:46:58.956101+0000","last_peered":"2024-01-18T00:46:58.956101+0000","last_clean":"2024-01-18T00:46:58.956101+0000","last_became_active":"2024-01-17T22:58:49.367979+0000","last_became_peered":"2024-01-17T22:58:49.367979+0000","last_unstale":"2024-01-18T00:46:58.956101+0000","last_undegraded":"2024-01-18T00:46:58.956101+0000","last_fullsized":"2024-01-18T00:46:58.956101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:02:12.309297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'191","reported_seq":261,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.049586+0000","last_change":"2024-01-17T22:58:49.364561+0000","last_active":"2024-01-18T00:47:09.049586+0000","last_peered":"2024-01-18T00:47:09.049586+0000","last_clean":"2024-01-18T00:47:09.049586+0000","last_became_active":"2024-01-17T22:58:49.363810+0000","last_became_peered":"2024-01-17T22:58:49.363810+0000","last_unstale":"2024-01-18T00:47:09.049586+0000","last_undegraded":"2024-01-18T00:47:09.049586+0000","last_fullsized":"2024-01-18T00:47:09.049586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:02:12.309297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1120,"num_read_kb":3534792,"num_write":24383,"num_write_kb":4330508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24895,"ondisk_log_size":24895,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12961,"ondisk_log_size":12961,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":198335705,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":1788,"num_read_kb":2847,"num_write":22487,"num_write_kb":206431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":181751808,"data_stored":396665421,"data_compressed":51062148,"data_compressed_allocated":68689920,"data_compressed_original":283754496,"omap_allocated":0,"internal_metadata":0},"log_size":21982,"ondisk_log_size":21982,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":62458,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510752,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124208,"kb_used_data":12584,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94247632,"statfs":{"total":96636764160,"available":96509575168,"internally_reserved":0,"allocated":12886016,"data_stored":31038270,"data_compressed":4325598,"data_compressed_allocated":5689344,"data_compressed_original":24039424,"omap_allocated":1590,"internal_metadata":114293194},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.89200000000000002,"15min":0.88600000000000001},"min":{"1min":0.54800000000000004,"5min":0.42899999999999999,"15min":0.35399999999999998},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.84699999999999998,"15min":0.85299999999999998},"min":{"1min":0.66900000000000004,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.306,"5min":1.3240000000000001,"15min":1.603},"last":0.91300000000000003}]},{"osd":1,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.92700000000000005,"15min":0.90600000000000003},"min":{"1min":0.626,"5min":0.46500000000000002,"15min":0.41499999999999998},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":0.625},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.90700000000000003,"15min":0.89300000000000002},"min":{"1min":0.68100000000000005,"5min":0.44600000000000001,"15min":0.28899999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.722},"last":0.78400000000000003}]},{"osd":2,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.58899999999999997,"5min":0.45400000000000001,"15min":0.441},"max":{"1min":1.1970000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.169,"5min":1.038,"15min":0.98099999999999998},"min":{"1min":0.86399999999999999,"5min":0.50600000000000001,"15min":0.45800000000000002},"max":{"1min":2.7370000000000001,"5min":2.7370000000000001,"15min":2.7370000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.89400000000000002,"15min":0.90300000000000002},"min":{"1min":0.60099999999999998,"5min":0.54000000000000004,"15min":0.48099999999999998},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.872},{"interface":"front","average":{"1min":1.123,"5min":1.0609999999999999,"15min":1.0449999999999999},"min":{"1min":0.80400000000000005,"5min":0.54700000000000004,"15min":0.5},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":0.83699999999999997}]},{"osd":4,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.999,"15min":1.018},"min":{"1min":0.59699999999999998,"5min":0.40100000000000002,"15min":0.32900000000000001},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.837},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0089999999999999,"15min":1.03},"min":{"1min":0.54700000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.0029999999999999}]},{"osd":5,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.171,"15min":1.159},"min":{"1min":0.54500000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":1.079},{"interface":"front","average":{"1min":1.179,"5min":1.141,"15min":1.1619999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.435},"max":{"1min":1.859,"5min":1.859,"15min":1.9159999999999999},"last":1.1639999999999999}]},{"osd":6,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.1839999999999999,"15min":1.196},"min":{"1min":0.54200000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.889,"5min":1.889,"15min":2.0209999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.1519999999999999,"15min":1.1679999999999999},"min":{"1min":0.86399999999999999,"5min":0.53000000000000003,"15min":0.50900000000000001},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.052}]}]},{"osd":6,"up_from":15,"seq":64424510751,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83092,"kb_used_data":15820,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94288748,"statfs":{"total":96636764160,"available":96551677952,"internally_reserved":0,"allocated":16199680,"data_stored":33676965,"data_compressed":4280237,"data_compressed_allocated":5771264,"data_compressed_original":23433216,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85999999999999999,"15min":0.84799999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.44},"max":{"1min":1.2849999999999999,"5min":1.5580000000000001,"15min":1.788},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.878,"15min":0.84899999999999998},"min":{"1min":0.52500000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.96099999999999997}]},{"osd":1,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.83699999999999997,"15min":0.82199999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.45800000000000002},"max":{"1min":1.167,"5min":1.478,"15min":1.8540000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.018,"5min":0.93200000000000005,"15min":0.89500000000000002},"min":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.42999999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.641},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.95199999999999996,"15min":0.94099999999999995},"min":{"1min":0.59799999999999998,"5min":0.54300000000000004,"15min":0.496},"max":{"1min":1.7030000000000001,"5min":1.766,"15min":1.766},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.96199999999999997,"15min":0.94399999999999995},"min":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.48499999999999999},"max":{"1min":1.4750000000000001,"5min":1.5629999999999999,"15min":2.1619999999999999},"last":0.71499999999999997}]},{"osd":3,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.012,"15min":0.98399999999999999},"min":{"1min":0.76400000000000001,"5min":0.622,"15min":0.53900000000000003},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.997,"15min":0.93899999999999995},"min":{"1min":0.67600000000000005,"5min":0.66900000000000004,"15min":0.52300000000000002},"max":{"1min":1.1870000000000001,"5min":1.633,"15min":1.98},"last":0.81100000000000005}]},{"osd":4,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.139,"15min":1.081},"min":{"1min":0.627,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":3.4969999999999999,"5min":3.4969999999999999,"15min":3.4969999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.179,"15min":1.1359999999999999},"min":{"1min":0.66000000000000003,"5min":0.52700000000000002,"15min":0.46000000000000002},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":1.054}]},{"osd":5,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.145,"15min":1.079},"min":{"1min":0.56699999999999995,"5min":0.49099999999999999,"15min":0.47499999999999998},"max":{"1min":3.8490000000000002,"5min":3.8490000000000002,"15min":3.8490000000000002},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2230000000000001,"15min":1.177},"min":{"1min":0.78300000000000003,"5min":0.60999999999999999,"15min":0.54200000000000004},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.284,"15min":1.2250000000000001},"min":{"1min":0.75700000000000001,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":4.2910000000000004,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.153,"5min":1.254,"15min":1.2},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.56799999999999995},"max":{"1min":1.534,"5min":2.0649999999999999,"15min":2.129},"last":1.105}]}]},{"osd":4,"up_from":15,"seq":64424510751,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121324,"kb_used_data":22180,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94250516,"statfs":{"total":96636764160,"available":96512528384,"internally_reserved":0,"allocated":22712320,"data_stored":50454822,"data_compressed":6935579,"data_compressed_allocated":9256960,"data_compressed_original":37212160,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86299999999999999,"15min":0.84499999999999997},"min":{"1min":0.52800000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.6879999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.83499999999999996,"15min":0.84199999999999997},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.42799999999999999},"max":{"1min":1.464,"5min":1.464,"15min":2.2410000000000001},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.90500000000000003,"15min":0.89000000000000001},"min":{"1min":0.63,"5min":0.47399999999999998,"15min":0.36199999999999999},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.89200000000000002,"15min":0.90700000000000003},"min":{"1min":0.499,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4179999999999999,"5min":2.097,"15min":2.097},"last":0.875}]},{"osd":2,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.88200000000000001,"15min":0.91200000000000003},"min":{"1min":0.68700000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.96499999999999997,"15min":0.95799999999999996},"min":{"1min":0.65000000000000002,"5min":0.55500000000000005,"15min":0.34300000000000003},"max":{"1min":1.4510000000000001,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.109}]},{"osd":3,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.90500000000000003,"15min":0.93200000000000005},"min":{"1min":0.54700000000000004,"5min":0.54000000000000004,"15min":0.41099999999999998},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":2.335},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.0800000000000001,"5min":0.98899999999999999,"15min":1.004},"min":{"1min":0.67300000000000004,"5min":0.60799999999999998,"15min":0.45300000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.044,"15min":1.0840000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.35999999999999999},"max":{"1min":1.518,"5min":2.403,"15min":2.9249999999999998},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.04,"15min":1.075},"min":{"1min":0.66700000000000004,"5min":0.55200000000000005,"15min":0.38200000000000001},"max":{"1min":1.7909999999999999,"5min":1.804,"15min":2.4289999999999998},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1020000000000001,"15min":1.1339999999999999},"min":{"1min":0.57699999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.1110000000000002,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.181,"15min":1.202},"min":{"1min":0.56499999999999995,"5min":0.45800000000000002,"15min":0.38100000000000001},"max":{"1min":1.7989999999999999,"5min":2.4740000000000002,"15min":3.101},"last":1.218}]},{"osd":7,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.1639999999999999,"15min":1.1830000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.841,"5min":4.25,"15min":4.25},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2110000000000001,"15min":1.2549999999999999},"min":{"1min":0.59199999999999997,"5min":0.503,"15min":0.40200000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.5110000000000001},"last":1.0720000000000001}]}]},{"osd":3,"up_from":15,"seq":64424510751,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160572,"kb_used_data":39220,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94211268,"statfs":{"total":96636764160,"available":96472338432,"internally_reserved":0,"allocated":40161280,"data_stored":87845266,"data_compressed":11483169,"data_compressed_allocated":15335424,"data_compressed_original":63209472,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44,"15min":0.42899999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.23000000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45800000000000002,"15min":0.46300000000000002},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.25600000000000001},"max":{"1min":0.58299999999999996,"5min":0.72799999999999998,"15min":0.753},"last":0.38}]},{"osd":1,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.29399999999999998,"5min":0.28100000000000003,"15min":0.27500000000000002},"max":{"1min":0.61499999999999999,"5min":0.751,"15min":0.78000000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.502,"15min":0.496},"min":{"1min":0.318,"5min":0.313,"15min":0.27300000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.314},"max":{"1min":0.66700000000000004,"5min":0.79700000000000004,"15min":0.84299999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.39000000000000001,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.68400000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.496}]},{"osd":4,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.42099999999999999},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78300000000000003,"15min":0.76500000000000001},"min":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.105,"5min":1.325,"15min":1.325},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.76800000000000002},"min":{"1min":0.54200000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.1160000000000001,"5min":1.1559999999999999,"15min":1.1970000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.754},"min":{"1min":0.52400000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0269999999999999,"5min":1.1539999999999999,"15min":1.2150000000000001},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82299999999999995,"15min":0.80900000000000005},"min":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.48899999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2150000000000001},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.80300000000000005,"15min":0.79900000000000004},"min":{"1min":0.51100000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.24,"5min":1.248,"15min":1.337},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.83399999999999996,"15min":0.82199999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.42099999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.69899999999999995}]}]},{"osd":2,"up_from":15,"seq":64424510751,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94904,"kb_used_data":13808,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94276936,"statfs":{"total":96636764160,"available":96539582464,"internally_reserved":0,"allocated":14139392,"data_stored":33676072,"data_compressed":4580308,"data_compressed_allocated":5976064,"data_compressed_original":25698304,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42099999999999999,"15min":0.432},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.24299999999999999},"max":{"1min":0.58599999999999997,"5min":0.65300000000000002,"15min":1.095},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26300000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":1.355},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.47599999999999998},"min":{"1min":0.36299999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64400000000000002,"5min":0.97699999999999998,"15min":1.026},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.503},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.308},"max":{"1min":0.67400000000000004,"5min":1.032,"15min":1.194},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.28599999999999998},"max":{"1min":0.754,"5min":0.77000000000000002,"15min":0.995},"last":0.437},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53800000000000003},"min":{"1min":0.36099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70499999999999996,"5min":0.90500000000000003,"15min":0.96999999999999997},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.75,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.46300000000000002,"15min":0.44700000000000001},"max":{"1min":1.014,"5min":1.155,"15min":1.502},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72299999999999998,"15min":0.752},"min":{"1min":0.46899999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.96899999999999997,"5min":1.0660000000000001,"15min":1.282},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.751,"15min":0.753},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":1.099,"15min":1.1479999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.79000000000000004},"min":{"1min":0.61299999999999999,"5min":0.48899999999999999,"15min":0.48099999999999998},"max":{"1min":1.0649999999999999,"5min":4.343,"15min":4.343},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.46600000000000003},"max":{"1min":0.95899999999999996,"5min":1.075,"15min":1.528},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79900000000000004,"15min":0.81200000000000006},"min":{"1min":0.52900000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1379999999999999,"5min":1.1599999999999999,"15min":3.9159999999999999},"last":0.81799999999999995}]},{"osd":7,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80400000000000005,"15min":0.80200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.499},"max":{"1min":1.1040000000000001,"5min":1.248,"15min":1.248},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.54500000000000004,"15min":0.51300000000000001},"max":{"1min":1.1160000000000001,"5min":3.9060000000000001,"15min":5.7370000000000001},"last":0.88}]}]},{"osd":1,"up_from":15,"seq":64424510751,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108440,"kb_used_data":19024,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94263400,"statfs":{"total":96636764160,"available":96525721600,"internally_reserved":0,"allocated":19480576,"data_stored":38460198,"data_compressed":4277353,"data_compressed_allocated":5976064,"data_compressed_original":25141248,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.46400000000000002,"15min":0.439},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.39000000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69899999999999995,"5min":0.70299999999999996,"15min":0.73099999999999998},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.47299999999999998,"15min":0.46000000000000002},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.27800000000000002},"max":{"1min":0.629,"5min":0.70399999999999996,"15min":0.73099999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51700000000000002,"15min":0.51000000000000001},"min":{"1min":0.42199999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71699999999999997,"5min":0.77400000000000002,"15min":0.85099999999999998},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.55000000000000004},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.36799999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.79900000000000004},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.71599999999999997},"min":{"1min":0.53500000000000003,"5min":0.442,"15min":0.38700000000000001},"max":{"1min":0.89600000000000002,"5min":1.0549999999999999,"15min":1.103},"last":22.641999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77200000000000002,"15min":0.78100000000000003},"min":{"1min":0.60299999999999998,"5min":0.47099999999999997,"15min":0.439},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.5700000000000001},"last":2.9409999999999998}]},{"osd":5,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76200000000000001,"15min":0.76000000000000001},"min":{"1min":0.53000000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1299999999999999,"5min":1.1439999999999999,"15min":2.8069999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79000000000000004,"15min":0.77600000000000002},"min":{"1min":0.58599999999999997,"5min":0.46400000000000002,"15min":0.45400000000000001},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.27},"last":2.5760000000000001}]},{"osd":6,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.79400000000000004},"min":{"1min":0.64600000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.0660000000000001,"5min":1.242,"15min":1.395},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.73699999999999999,"5min":0.5,"15min":0.46400000000000002},"max":{"1min":0.996,"5min":1.1279999999999999,"15min":1.1830000000000001},"last":5.7869999999999999}]},{"osd":7,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.85099999999999998,"15min":0.83699999999999997},"min":{"1min":0.76900000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":3.9009999999999998},"last":1.895},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.622,"5min":0.55700000000000005,"15min":0.50800000000000001},"max":{"1min":1.1379999999999999,"5min":1.2270000000000001,"15min":1.3999999999999999},"last":2.476}]}]},{"osd":0,"up_from":14,"seq":60129543454,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143116,"kb_used_data":31492,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94228724,"statfs":{"total":96636764160,"available":96490213376,"internally_reserved":0,"allocated":32247808,"data_stored":71061728,"data_compressed":8958305,"data_compressed_allocated":12132352,"data_compressed_original":51142656,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44500000000000001,"15min":0.42899999999999999},"min":{"1min":0.29199999999999998,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.64500000000000002,"5min":0.66600000000000004,"15min":0.68400000000000005},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47899999999999998,"15min":0.47199999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.26700000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.502,"15min":0.496},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.28199999999999997},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.84999999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.311,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67900000000000005,"5min":0.69599999999999995,"15min":0.80200000000000005},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.49399999999999999,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.308,"15min":0.30499999999999999},"max":{"1min":0.72499999999999998,"5min":0.73999999999999999,"15min":0.81799999999999995},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.377},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72199999999999998,"15min":0.73399999999999999},"min":{"1min":0.57899999999999996,"5min":0.46500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89500000000000002,"5min":1.3620000000000001,"15min":2.1779999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.745,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.505,"15min":0.44400000000000001},"max":{"1min":1.0149999999999999,"5min":1.159,"15min":1.159},"last":0.874}]},{"osd":5,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76900000000000002,"15min":0.76500000000000001},"min":{"1min":0.58799999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97199999999999998,"5min":1.423,"15min":1.423},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.59199999999999997,"5min":0.47599999999999998,"15min":0.42399999999999999},"max":{"1min":1.03,"5min":1.623,"15min":1.623},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.84699999999999998,"15min":0.82399999999999995},"min":{"1min":0.64300000000000002,"5min":0.52600000000000002,"15min":0.49099999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.84899999999999998,"15min":0.82699999999999996},"min":{"1min":0.57399999999999995,"5min":0.49099999999999999,"15min":0.46200000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.29},"last":1.034}]},{"osd":7,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.82299999999999995,"15min":0.81799999999999995},"min":{"1min":0.64400000000000002,"5min":0.48299999999999998,"15min":0.44400000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.86799999999999999,"15min":0.85799999999999998},"min":{"1min":0.64800000000000002,"5min":0.61099999999999999,"15min":0.47899999999999998},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.73999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834576160,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":129092,"kb_used_data":25788,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94242748,"statfs":{"total":96636764160,"available":96504573952,"internally_reserved":0,"allocated":26406912,"data_stored":52600308,"data_compressed":6284057,"data_compressed_allocated":8634368,"data_compressed_original":35024896,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.81999999999999995,"15min":0.86399999999999999},"min":{"1min":0.52800000000000002,"5min":0.40100000000000002,"15min":0.36699999999999999},"max":{"1min":1.2729999999999999,"5min":1.3560000000000001,"15min":1.5409999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84099999999999997,"15min":0.85899999999999999},"min":{"1min":0.498,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.173,"5min":1.2170000000000001,"15min":1.7569999999999999},"last":0.81299999999999994}]},{"osd":1,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.88100000000000001,"15min":0.90600000000000003},"min":{"1min":0.498,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2430000000000001,"5min":1.323,"15min":1.6299999999999999},"last":1.194},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89400000000000002,"15min":0.91500000000000004},"min":{"1min":0.48799999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.5049999999999999},"last":1.026}]},{"osd":2,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.84999999999999998,"15min":0.84799999999999998},"min":{"1min":0.55500000000000005,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.95999999999999996,"15min":0.98099999999999998},"min":{"1min":0.66700000000000004,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2430000000000001,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.3240000000000001}]},{"osd":3,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.98499999999999999,"15min":0.998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2849999999999999,"5min":1.613,"15min":2.1499999999999999},"last":1.117},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.94199999999999995,"15min":0.95699999999999996},"min":{"1min":0.63400000000000001,"5min":0.41099999999999998,"15min":0.40500000000000003},"max":{"1min":1.552,"5min":1.552,"15min":1.9430000000000001},"last":0.91600000000000004}]},{"osd":4,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.073,"15min":1.085},"min":{"1min":0.56399999999999995,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.5089999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.383},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.137,"15min":1.1319999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.607,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.409}]},{"osd":6,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.105,"15min":1.079},"min":{"1min":0.76000000000000001,"5min":0.55100000000000005,"15min":0.51800000000000002},"max":{"1min":1.659,"5min":1.659,"15min":1.8640000000000001},"last":1.357},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1699999999999999,"15min":1.1839999999999999},"min":{"1min":0.80500000000000005,"5min":0.69099999999999995,"15min":0.46999999999999997},"max":{"1min":1.5129999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":1.4890000000000001}]},{"osd":7,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.25,"15min":1.2350000000000001},"min":{"1min":0.66800000000000004,"5min":0.65900000000000003,"15min":0.57799999999999996},"max":{"1min":1.732,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.514},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.228,"15min":1.2170000000000001},"min":{"1min":0.73499999999999999,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.456}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31229,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31229,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31952896,"data_stored":70940794,"data_compressed":8958305,"data_compressed_allocated":12132352,"data_compressed_original":51142656,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19124224,"data_stored":37748896,"data_compressed":4246124,"data_compressed_allocated":5935104,"data_compressed_original":24567808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13844480,"data_stored":33555138,"data_compressed":4580308,"data_compressed_allocated":5976064,"data_compressed_original":25698304,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39866368,"data_stored":87724332,"data_compressed":11483169,"data_compressed_allocated":15335424,"data_compressed_original":63209472,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22417408,"data_stored":50333888,"data_compressed":6935579,"data_compressed_allocated":9256960,"data_compressed_original":37212160,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26050560,"data_stored":51889006,"data_compressed":6252828,"data_compressed_allocated":8593408,"data_compressed_original":34451456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15904768,"data_stored":33556031,"data_compressed":4280237,"data_compressed_allocated":5771264,"data_compressed_original":23433216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12591104,"data_stored":30917336,"data_compressed":4325598,"data_compressed_allocated":5689344,"data_compressed_original":24039424,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-18T00:47:17.331 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-18T00:47:17.331 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-18T00:47:17.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.499+0000 7fe82c600640 1 Processor -- start 2024-01-18T00:47:17.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.499+0000 7fe82c600640 1 -- start start 2024-01-18T00:47:17.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.503+0000 7fe82c600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8241517f0 0x7fe82415b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:17.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.503+0000 7fe82c600640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe8240ca3a0 0x7fe824061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:17.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.503+0000 7fe82c600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8240c7d10 con 0x7fe8240ca780 2024-01-18T00:47:17.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.503+0000 7fe82c600640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8241576d0 con 0x7fe8240ca3a0 2024-01-18T00:47:17.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.503+0000 7fe82c600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe824157970 con 0x7fe8241517f0 2024-01-18T00:47:17.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.503+0000 7fe82a600640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fe8240ca780 0x7fe8240c8a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55176/0 (socket says 172.21.15.161:55176) 2024-01-18T00:47:17.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.503+0000 7fe82a600640 1 -- 172.21.15.161:0/4256344997 learned_addr learned my addr 172.21.15.161:0/4256344997 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-18T00:47:17.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.503+0000 7fe829c00640 1 --2- 172.21.15.161:0/4256344997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8241517f0 0x7fe82415b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:17.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.503+0000 7fe829200640 1 --2- 172.21.15.161:0/4256344997 >> v2:172.21.15.190:3300/0 conn(0x7fe8240ca3a0 0x7fe824061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:17.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.507+0000 7fe823e00640 1 -- 172.21.15.161:0/4256344997 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153412657 0 0) 0x7fe8240c7d10 con 0x7fe8240ca780 2024-01-18T00:47:17.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.507+0000 7fe823e00640 1 -- 172.21.15.161:0/4256344997 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe804003530 con 0x7fe8240ca780 2024-01-18T00:47:17.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.507+0000 7fe823e00640 1 -- 172.21.15.161:0/4256344997 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3515976729 0 0) 0x7fe804003530 con 0x7fe8240ca780 2024-01-18T00:47:17.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.511+0000 7fe823e00640 1 -- 172.21.15.161:0/4256344997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8241517f0 msgr2=0x7fe82415b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:17.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.511+0000 7fe823e00640 1 --2- 172.21.15.161:0/4256344997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8241517f0 0x7fe82415b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:17.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.511+0000 7fe823e00640 1 -- 172.21.15.161:0/4256344997 >> v2:172.21.15.190:3300/0 conn(0x7fe8240ca3a0 msgr2=0x7fe824061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:17.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.511+0000 7fe823e00640 1 --2- 172.21.15.161:0/4256344997 >> v2:172.21.15.190:3300/0 conn(0x7fe8240ca3a0 0x7fe824061100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:17.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.511+0000 7fe823e00640 1 -- 172.21.15.161:0/4256344997 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe824157c50 con 0x7fe8240ca780 2024-01-18T00:47:17.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.511+0000 7fe823e00640 1 -- 172.21.15.161:0/4256344997 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7fe81c001a00 con 0x7fe8240ca780 2024-01-18T00:47:17.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.511+0000 7fe823e00640 1 -- 172.21.15.161:0/4256344997 >> v1:172.21.15.161:6789/0 conn(0x7fe8240ca780 legacy=0x7fe8240c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:17.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.511+0000 7fe823e00640 1 --2- 172.21.15.161:0/4256344997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe804003980 0x7fe804003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:17.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.511+0000 7fe823e00640 1 --2- 172.21.15.161:0/4256344997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8040047d0 0x7fe804004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:17.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.511+0000 7fe823e00640 1 --2- 172.21.15.161:0/4256344997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8241517f0 0x7fe804005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:17.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.511+0000 7fe823e00640 1 -- 172.21.15.161:0/4256344997 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8241576d0 con 0x7fe8040047d0 2024-01-18T00:47:17.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.511+0000 7fe823e00640 1 -- 172.21.15.161:0/4256344997 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe824157970 con 0x7fe804003980 2024-01-18T00:47:17.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.511+0000 7fe823e00640 1 -- 172.21.15.161:0/4256344997 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80400b990 con 0x7fe8241517f0 2024-01-18T00:47:17.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.511+0000 7fe829200640 1 --2- 172.21.15.161:0/4256344997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8040047d0 0x7fe804004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:17.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.515+0000 7fe829200640 1 -- 172.21.15.161:0/4256344997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8241517f0 msgr2=0x7fe804005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:17.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.515+0000 7fe829200640 1 --2- 172.21.15.161:0/4256344997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8241517f0 0x7fe804005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:17.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.515+0000 7fe829200640 1 -- 172.21.15.161:0/4256344997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe804003980 msgr2=0x7fe804003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:17.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.515+0000 7fe829200640 1 --2- 172.21.15.161:0/4256344997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe804003980 0x7fe804003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:17.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.515+0000 7fe829200640 1 -- 172.21.15.161:0/4256344997 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe804003530 con 0x7fe8040047d0 2024-01-18T00:47:17.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.519+0000 7fe829200640 1 --2- 172.21.15.161:0/4256344997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8040047d0 0x7fe804004c50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009ae0 tx=0x7fe80c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c303c0114a6ddf9 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:17.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.523+0000 7fe823e00640 1 -- 172.21.15.161:0/4256344997 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c0a55a0 con 0x7fe8040047d0 2024-01-18T00:47:17.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.523+0000 7fe823e00640 1 -- 172.21.15.161:0/4256344997 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c0a5700 con 0x7fe8040047d0 2024-01-18T00:47:17.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.523+0000 7fe823e00640 1 -- 172.21.15.161:0/4256344997 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c0a5ab0 con 0x7fe8040047d0 2024-01-18T00:47:17.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.523+0000 7fe82c600640 1 -- 172.21.15.161:0/4256344997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8040047d0 msgr2=0x7fe804004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:17.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.523+0000 7fe82c600640 1 --2- 172.21.15.161:0/4256344997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8040047d0 0x7fe804004c50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009ae0 tx=0x7fe80c01ca30 comp rx=0 tx=0).stop 2024-01-18T00:47:17.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.523+0000 7fe82a600640 1 -- 172.21.15.161:0/4256344997 reap_dead start 2024-01-18T00:47:17.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.523+0000 7fe82c600640 1 -- 172.21.15.161:0/4256344997 shutdown_connections 2024-01-18T00:47:17.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.523+0000 7fe82c600640 1 -- 172.21.15.161:0/4256344997 >> 172.21.15.161:0/4256344997 conn(0x7fe82406ad40 msgr2=0x7fe82406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:17.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.523+0000 7fe82c600640 1 -- 172.21.15.161:0/4256344997 shutdown_connections 2024-01-18T00:47:17.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.523+0000 7fe82c600640 1 -- 172.21.15.161:0/4256344997 wait complete. 2024-01-18T00:47:17.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.527+0000 7fe82c600640 1 Processor -- start 2024-01-18T00:47:17.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.527+0000 7fe82c600640 1 -- start start 2024-01-18T00:47:17.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.527+0000 7fe82c600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8040047d0 0x7fe824153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:17.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.527+0000 7fe82c600640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8240cb330 0x7fe8241ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:17.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.527+0000 7fe82c600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8240cc8a0 0x7fe8241f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:17.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.527+0000 7fe82c600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe824153880 con 0x7fe8240cc8a0 2024-01-18T00:47:17.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.527+0000 7fe82c600640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8241efc20 con 0x7fe8240cb330 2024-01-18T00:47:17.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.527+0000 7fe82c600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8241f3150 con 0x7fe8040047d0 2024-01-18T00:47:17.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.527+0000 7fe82a600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8240cc8a0 0x7fe8241f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:17.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.527+0000 7fe82a600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8240cc8a0 0x7fe8241f2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43666/0 (socket says 172.21.15.161:43666) 2024-01-18T00:47:17.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.527+0000 7fe82a600640 1 -- 172.21.15.161:0/3740310023 learned_addr learned my addr 172.21.15.161:0/3740310023 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:17.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.527+0000 7fe829c00640 1 --2- 172.21.15.161:0/3740310023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8040047d0 0x7fe824153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:17.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.527+0000 7fe829200640 1 --2- 172.21.15.161:0/3740310023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8240cb330 0x7fe8241ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:17.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.531+0000 7fe82a600640 1 -- 172.21.15.161:0/3740310023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8040047d0 msgr2=0x7fe824153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:17.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.531+0000 7fe82a600640 1 --2- 172.21.15.161:0/3740310023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8040047d0 0x7fe824153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:17.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.531+0000 7fe82a600640 1 -- 172.21.15.161:0/3740310023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8240cb330 msgr2=0x7fe8241ef6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:17.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.531+0000 7fe82a600640 1 --2- 172.21.15.161:0/3740310023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8240cb330 0x7fe8241ef6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:17.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.531+0000 7fe82a600640 1 -- 172.21.15.161:0/3740310023 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8241eec90 con 0x7fe8240cc8a0 2024-01-18T00:47:17.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.535+0000 7fe82a600640 1 --2- 172.21.15.161:0/3740310023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8240cc8a0 0x7fe8241f2c10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe8240c98f0 tx=0x7fe81c00ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:17.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.535+0000 7fe821600640 1 -- 172.21.15.161:0/3740310023 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c00da80 con 0x7fe8240cc8a0 2024-01-18T00:47:17.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.535+0000 7fe82c600640 1 -- 172.21.15.161:0/3740310023 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8241ef250 con 0x7fe8240cc8a0 2024-01-18T00:47:17.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.535+0000 7fe82c600640 1 -- 172.21.15.161:0/3740310023 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8240cba80 con 0x7fe8240cc8a0 2024-01-18T00:47:17.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.539+0000 7fe821600640 1 -- 172.21.15.161:0/3740310023 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81c00dbe0 con 0x7fe8240cc8a0 2024-01-18T00:47:17.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.539+0000 7fe821600640 1 -- 172.21.15.161:0/3740310023 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c017420 con 0x7fe8240cc8a0 2024-01-18T00:47:17.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.539+0000 7fe82c600640 1 -- 172.21.15.161:0/3740310023 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f40052a0 con 0x7fe8240cc8a0 2024-01-18T00:47:17.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.555+0000 7fe821600640 1 -- 172.21.15.161:0/3740310023 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fe81c017580 con 0x7fe8240cc8a0 2024-01-18T00:47:17.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.559+0000 7fe821600640 1 --2- 172.21.15.161:0/3740310023 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe7fc066840 0x7fe7fc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:17.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.559+0000 7fe829c00640 1 --2- 172.21.15.161:0/3740310023 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe7fc066840 0x7fe7fc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:17.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.559+0000 7fe829c00640 1 --2- 172.21.15.161:0/3740310023 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe7fc066840 0x7fe7fc068d00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe8140093f0 tx=0x7fe8140094c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:17.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.559+0000 7fe821600640 1 -- 172.21.15.161:0/3740310023 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fe81c058380 con 0x7fe8240cc8a0 2024-01-18T00:47:17.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.803+0000 7fe821600640 1 -- 172.21.15.161:0/3740310023 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fe81c0546c0 con 0x7fe8240cc8a0 2024-01-18T00:47:17.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.955+0000 7fe82c600640 1 -- 172.21.15.161:0/3740310023 --> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7f4000bd0 con 0x7fe7fc066840 2024-01-18T00:47:17.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.963+0000 7fe821600640 1 -- 172.21.15.161:0/3740310023 <== mgr.4110 v2:172.21.15.161:6800/272458188 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371378 (secure 0 0 0) 0x7fe7f4000bd0 con 0x7fe7fc066840 2024-01-18T00:47:17.970 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-18T00:47:17.972 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-01-18T00:47:17.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.971+0000 7fe82c600640 1 -- 172.21.15.161:0/3740310023 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe7fc066840 msgr2=0x7fe7fc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:17.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.971+0000 7fe82c600640 1 --2- 172.21.15.161:0/3740310023 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe7fc066840 0x7fe7fc068d00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe8140093f0 tx=0x7fe8140094c0 comp rx=0 tx=0).stop 2024-01-18T00:47:17.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.971+0000 7fe82c600640 1 -- 172.21.15.161:0/3740310023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8240cc8a0 msgr2=0x7fe8241f2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:17.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.971+0000 7fe82c600640 1 --2- 172.21.15.161:0/3740310023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8240cc8a0 0x7fe8241f2c10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe8240c98f0 tx=0x7fe81c00ff00 comp rx=0 tx=0).stop 2024-01-18T00:47:17.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.971+0000 7fe82c600640 1 -- 172.21.15.161:0/3740310023 shutdown_connections 2024-01-18T00:47:17.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.971+0000 7fe82c600640 1 --2- 172.21.15.161:0/3740310023 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe7fc066840 0x7fe7fc068d00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:17.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.971+0000 7fe82c600640 1 --2- 172.21.15.161:0/3740310023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8240cb330 0x7fe8241ef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:17.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.971+0000 7fe82c600640 1 --2- 172.21.15.161:0/3740310023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8240cc8a0 0x7fe8241f2c10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:17.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.971+0000 7fe82c600640 1 --2- 172.21.15.161:0/3740310023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8040047d0 0x7fe824153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:17.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.971+0000 7fe82c600640 1 -- 172.21.15.161:0/3740310023 >> 172.21.15.161:0/3740310023 conn(0x7fe82406ad40 msgr2=0x7fe8240c8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:17.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.971+0000 7fe82c600640 1 -- 172.21.15.161:0/3740310023 shutdown_connections 2024-01-18T00:47:17.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:17.971+0000 7fe82c600640 1 -- 172.21.15.161:0/3740310023 wait complete. 2024-01-18T00:47:17.990 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":3292,"stamp":"2024-01-18T00:47:16.475115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":198926073,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":3054,"num_read_kb":3537766,"num_write":47079,"num_write_kb":4540401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59999,"ondisk_log_size":59999,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":964748,"kb_used_data":179916,"kb_used_omap":12,"kb_used_meta":784755,"kb_avail":754009972,"statfs":{"total":773094113280,"available":772106211328,"internally_reserved":0,"allocated":184233984,"data_stored":398813629,"data_compressed":51124606,"data_compressed_allocated":68771840,"data_compressed_original":284901376,"omap_allocated":12751,"internal_metadata":803589681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-274572,"num_objects":-66,"num_object_clones":0,"num_object_copies":-264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-66,"num_whiteouts":0,"num_read":6,"num_read_kb":11,"num_write":109,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002706"},"pg_stats":[{"pgid":"2.1f","version":"28'401","reported_seq":472,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.101129+0000","last_change":"2024-01-17T22:58:48.328193+0000","last_active":"2024-01-18T00:47:09.101129+0000","last_peered":"2024-01-18T00:47:09.101129+0000","last_clean":"2024-01-18T00:47:09.101129+0000","last_became_active":"2024-01-17T22:58:48.327340+0000","last_became_peered":"2024-01-17T22:58:48.327340+0000","last_unstale":"2024-01-18T00:47:09.101129+0000","last_undegraded":"2024-01-18T00:47:09.101129+0000","last_fullsized":"2024-01-18T00:47:09.101129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:56.524325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":8350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'183","reported_seq":254,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.312429+0000","last_change":"2024-01-17T22:58:49.351609+0000","last_active":"2024-01-18T00:47:04.312429+0000","last_peered":"2024-01-18T00:47:04.312429+0000","last_clean":"2024-01-18T00:47:04.312429+0000","last_became_active":"2024-01-17T22:58:49.350812+0000","last_became_peered":"2024-01-17T22:58:49.350812+0000","last_unstale":"2024-01-18T00:47:04.312429+0000","last_undegraded":"2024-01-18T00:47:04.312429+0000","last_fullsized":"2024-01-18T00:47:04.312429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:02:07.535209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'754","reported_seq":836,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:43.925020+0000","last_change":"2024-01-17T22:58:55.903757+0000","last_active":"2024-01-18T00:46:43.925020+0000","last_peered":"2024-01-18T00:46:43.925020+0000","last_clean":"2024-01-18T00:46:43.925020+0000","last_became_active":"2024-01-17T22:58:55.903167+0000","last_became_peered":"2024-01-17T22:58:55.903167+0000","last_unstale":"2024-01-18T00:46:43.925020+0000","last_undegraded":"2024-01-18T00:46:43.925020+0000","last_fullsized":"2024-01-18T00:46:43.925020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:22.127961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":69175,"num_write":737,"num_write_kb":101027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'515","reported_seq":587,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:34.183193+0000","last_change":"2024-01-17T22:58:48.373068+0000","last_active":"2024-01-18T00:46:34.183193+0000","last_peered":"2024-01-18T00:46:34.183193+0000","last_clean":"2024-01-18T00:46:34.183193+0000","last_became_active":"2024-01-17T22:58:48.372582+0000","last_became_peered":"2024-01-17T22:58:48.372582+0000","last_unstale":"2024-01-18T00:46:34.183193+0000","last_undegraded":"2024-01-18T00:46:34.183193+0000","last_fullsized":"2024-01-18T00:46:34.183193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:10:59.139723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":8429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'177","reported_seq":247,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.597454+0000","last_change":"2024-01-17T22:58:49.511918+0000","last_active":"2024-01-18T00:47:04.597454+0000","last_peered":"2024-01-18T00:47:04.597454+0000","last_clean":"2024-01-18T00:47:04.597454+0000","last_became_active":"2024-01-17T22:58:49.511303+0000","last_became_peered":"2024-01-17T22:58:49.511303+0000","last_unstale":"2024-01-18T00:47:04.597454+0000","last_undegraded":"2024-01-18T00:47:04.597454+0000","last_fullsized":"2024-01-18T00:47:04.597454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:13:09.466879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'814","reported_seq":911,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.934585+0000","last_change":"2024-01-17T22:58:55.878752+0000","last_active":"2024-01-18T00:47:04.934585+0000","last_peered":"2024-01-18T00:47:04.934585+0000","last_clean":"2024-01-18T00:47:04.934585+0000","last_became_active":"2024-01-17T22:58:55.878263+0000","last_became_peered":"2024-01-17T22:58:55.878263+0000","last_unstale":"2024-01-18T00:47:04.934585+0000","last_undegraded":"2024-01-18T00:47:04.934585+0000","last_fullsized":"2024-01-18T00:47:04.934585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:19:49.420559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":109513,"num_write":800,"num_write_kb":160118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1138","reported_seq":1200,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:13.376579+0000","last_change":"2024-01-17T22:58:48.346724+0000","last_active":"2024-01-18T00:45:13.376579+0000","last_peered":"2024-01-18T00:45:13.376579+0000","last_clean":"2024-01-18T00:45:13.376579+0000","last_became_active":"2024-01-17T22:58:48.346411+0000","last_became_peered":"2024-01-17T22:58:48.346411+0000","last_unstale":"2024-01-18T00:45:13.376579+0000","last_undegraded":"2024-01-18T00:45:13.376579+0000","last_fullsized":"2024-01-18T00:45:13.376579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1138,"log_dups_size":0,"ondisk_log_size":1138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:03:04.691978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1083,"num_write_kb":12791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'196","reported_seq":256,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.694627+0000","last_change":"2024-01-17T22:58:49.517981+0000","last_active":"2024-01-18T00:47:15.694627+0000","last_peered":"2024-01-18T00:47:15.694627+0000","last_clean":"2024-01-18T00:47:15.694627+0000","last_became_active":"2024-01-17T22:58:49.517710+0000","last_became_peered":"2024-01-17T22:58:49.517710+0000","last_unstale":"2024-01-18T00:47:15.694627+0000","last_undegraded":"2024-01-18T00:47:15.694627+0000","last_fullsized":"2024-01-18T00:47:15.694627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'731","reported_seq":809,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.699271+0000","last_change":"2024-01-17T22:58:55.847347+0000","last_active":"2024-01-18T00:47:08.699271+0000","last_peered":"2024-01-18T00:47:08.699271+0000","last_clean":"2024-01-18T00:47:08.699271+0000","last_became_active":"2024-01-17T22:58:55.846773+0000","last_became_peered":"2024-01-17T22:58:55.846773+0000","last_unstale":"2024-01-18T00:47:08.699271+0000","last_undegraded":"2024-01-18T00:47:08.699271+0000","last_fullsized":"2024-01-18T00:47:08.699271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:31:43.629750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":46045,"num_write":714,"num_write_kb":72807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'767","reported_seq":829,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:20.108287+0000","last_change":"2024-01-17T22:58:48.346483+0000","last_active":"2024-01-18T00:46:20.108287+0000","last_peered":"2024-01-18T00:46:20.108287+0000","last_clean":"2024-01-18T00:46:20.108287+0000","last_became_active":"2024-01-17T22:58:48.345749+0000","last_became_peered":"2024-01-17T22:58:48.345749+0000","last_unstale":"2024-01-18T00:46:20.108287+0000","last_undegraded":"2024-01-18T00:46:20.108287+0000","last_fullsized":"2024-01-18T00:46:20.108287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:22:41.169668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'208","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660482+0000","last_change":"2024-01-17T22:58:49.371509+0000","last_active":"2024-01-18T00:47:15.660482+0000","last_peered":"2024-01-18T00:47:15.660482+0000","last_clean":"2024-01-18T00:47:15.660482+0000","last_became_active":"2024-01-17T22:58:49.370010+0000","last_became_peered":"2024-01-17T22:58:49.370010+0000","last_unstale":"2024-01-18T00:47:15.660482+0000","last_undegraded":"2024-01-18T00:47:15.660482+0000","last_fullsized":"2024-01-18T00:47:15.660482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:36:24.817716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'752","reported_seq":834,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.279912+0000","last_change":"2024-01-17T22:58:55.886223+0000","last_active":"2024-01-18T00:47:04.279912+0000","last_peered":"2024-01-18T00:47:04.279912+0000","last_clean":"2024-01-18T00:47:04.279912+0000","last_became_active":"2024-01-17T22:58:55.885739+0000","last_became_peered":"2024-01-17T22:58:55.885739+0000","last_unstale":"2024-01-18T00:47:04.279912+0000","last_undegraded":"2024-01-18T00:47:04.279912+0000","last_fullsized":"2024-01-18T00:47:04.279912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:49:18.835647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":79345,"num_write":732,"num_write_kb":104824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'223","reported_seq":290,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660356+0000","last_change":"2024-01-17T22:58:49.514565+0000","last_active":"2024-01-18T00:47:15.660356+0000","last_peered":"2024-01-18T00:47:15.660356+0000","last_clean":"2024-01-18T00:47:15.660356+0000","last_became_active":"2024-01-17T22:58:49.514310+0000","last_became_peered":"2024-01-17T22:58:49.514310+0000","last_unstale":"2024-01-18T00:47:15.660356+0000","last_undegraded":"2024-01-18T00:47:15.660356+0000","last_fullsized":"2024-01-18T00:47:15.660356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:01:32.364167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1137","reported_seq":1204,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:22.872524+0000","last_change":"2024-01-17T22:58:48.341961+0000","last_active":"2024-01-18T00:45:22.872524+0000","last_peered":"2024-01-18T00:45:22.872524+0000","last_clean":"2024-01-18T00:45:22.872524+0000","last_became_active":"2024-01-17T22:58:48.341498+0000","last_became_peered":"2024-01-17T22:58:48.341498+0000","last_unstale":"2024-01-18T00:45:22.872524+0000","last_undegraded":"2024-01-18T00:45:22.872524+0000","last_fullsized":"2024-01-18T00:45:22.872524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1137,"log_dups_size":0,"ondisk_log_size":1137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:56.524325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1075,"num_write_kb":12808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'783","reported_seq":874,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:58.933650+0000","last_change":"2024-01-17T22:58:55.915918+0000","last_active":"2024-01-18T00:46:58.933650+0000","last_peered":"2024-01-18T00:46:58.933650+0000","last_clean":"2024-01-18T00:46:58.933650+0000","last_became_active":"2024-01-17T22:58:55.915556+0000","last_became_peered":"2024-01-17T22:58:55.915556+0000","last_unstale":"2024-01-18T00:46:58.933650+0000","last_undegraded":"2024-01-18T00:46:58.933650+0000","last_fullsized":"2024-01-18T00:46:58.933650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:22:21.478703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":102943,"num_write":764,"num_write_kb":130404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'216","reported_seq":282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.678115+0000","last_change":"2024-01-17T22:58:49.388237+0000","last_active":"2024-01-18T00:47:15.678115+0000","last_peered":"2024-01-18T00:47:15.678115+0000","last_clean":"2024-01-18T00:47:15.678115+0000","last_became_active":"2024-01-17T22:58:49.387500+0000","last_became_peered":"2024-01-17T22:58:49.387500+0000","last_unstale":"2024-01-18T00:47:15.678115+0000","last_undegraded":"2024-01-18T00:47:15.678115+0000","last_fullsized":"2024-01-18T00:47:15.678115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'1206","reported_seq":1274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:36.387266+0000","last_change":"2024-01-17T22:58:48.346215+0000","last_active":"2024-01-18T00:45:36.387266+0000","last_peered":"2024-01-18T00:45:36.387266+0000","last_clean":"2024-01-18T00:45:36.387266+0000","last_became_active":"2024-01-17T22:58:48.345584+0000","last_became_peered":"2024-01-17T22:58:48.345584+0000","last_unstale":"2024-01-18T00:45:36.387266+0000","last_undegraded":"2024-01-18T00:45:36.387266+0000","last_fullsized":"2024-01-18T00:45:36.387266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1206,"log_dups_size":0,"ondisk_log_size":1206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":8782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'818","reported_seq":903,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:55.111757+0000","last_change":"2024-01-17T22:58:55.904518+0000","last_active":"2024-01-18T00:46:55.111757+0000","last_peered":"2024-01-18T00:46:55.111757+0000","last_clean":"2024-01-18T00:46:55.111757+0000","last_became_active":"2024-01-17T22:58:55.904182+0000","last_became_peered":"2024-01-17T22:58:55.904182+0000","last_unstale":"2024-01-18T00:46:55.111757+0000","last_undegraded":"2024-01-18T00:46:55.111757+0000","last_fullsized":"2024-01-18T00:46:55.111757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:24:43.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":69224,"num_write":805,"num_write_kb":98188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'208","reported_seq":276,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651670+0000","last_change":"2024-01-17T22:58:49.417907+0000","last_active":"2024-01-18T00:47:15.651670+0000","last_peered":"2024-01-18T00:47:15.651670+0000","last_clean":"2024-01-18T00:47:15.651670+0000","last_became_active":"2024-01-17T22:58:49.417440+0000","last_became_peered":"2024-01-17T22:58:49.417440+0000","last_unstale":"2024-01-18T00:47:15.651670+0000","last_undegraded":"2024-01-18T00:47:15.651670+0000","last_fullsized":"2024-01-18T00:47:15.651670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:59.773063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'353","reported_seq":422,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:11.404319+0000","last_change":"2024-01-17T22:58:48.332092+0000","last_active":"2024-01-18T00:47:11.404319+0000","last_peered":"2024-01-18T00:47:11.404319+0000","last_clean":"2024-01-18T00:47:11.404319+0000","last_became_active":"2024-01-17T22:58:48.331435+0000","last_became_peered":"2024-01-17T22:58:48.331435+0000","last_unstale":"2024-01-18T00:47:11.404319+0000","last_undegraded":"2024-01-18T00:47:11.404319+0000","last_fullsized":"2024-01-18T00:47:11.404319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:41:24.117738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":286,"num_write_kb":4220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'749","reported_seq":841,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:49.663655+0000","last_change":"2024-01-17T22:59:09.254564+0000","last_active":"2024-01-18T00:46:49.663655+0000","last_peered":"2024-01-18T00:46:49.663655+0000","last_clean":"2024-01-18T00:46:49.663655+0000","last_became_active":"2024-01-17T22:59:09.254084+0000","last_became_peered":"2024-01-17T22:59:09.254084+0000","last_unstale":"2024-01-18T00:46:49.663655+0000","last_undegraded":"2024-01-18T00:46:49.663655+0000","last_fullsized":"2024-01-18T00:46:49.663655+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:04:05.785891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":86272,"num_write":735,"num_write_kb":127812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2,3],"acting":[0,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"28'213","reported_seq":281,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.654480+0000","last_change":"2024-01-17T22:58:49.416963+0000","last_active":"2024-01-18T00:47:15.654480+0000","last_peered":"2024-01-18T00:47:15.654480+0000","last_clean":"2024-01-18T00:47:15.654480+0000","last_became_active":"2024-01-17T22:58:49.416757+0000","last_became_peered":"2024-01-17T22:58:49.416757+0000","last_unstale":"2024-01-18T00:47:15.654480+0000","last_undegraded":"2024-01-18T00:47:15.654480+0000","last_fullsized":"2024-01-18T00:47:15.654480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:08.763719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'203","reported_seq":272,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:10.113056+0000","last_change":"2024-01-17T22:58:48.341728+0000","last_active":"2024-01-18T00:47:10.113056+0000","last_peered":"2024-01-18T00:47:10.113056+0000","last_clean":"2024-01-18T00:47:10.113056+0000","last_became_active":"2024-01-17T22:58:48.341359+0000","last_became_peered":"2024-01-17T22:58:48.341359+0000","last_unstale":"2024-01-18T00:47:10.113056+0000","last_undegraded":"2024-01-18T00:47:10.113056+0000","last_fullsized":"2024-01-18T00:47:10.113056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:20:07.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'713","reported_seq":816,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:58.802459+0000","last_change":"2024-01-17T22:58:55.913996+0000","last_active":"2024-01-18T00:46:58.802459+0000","last_peered":"2024-01-18T00:46:58.802459+0000","last_clean":"2024-01-18T00:46:58.802459+0000","last_became_active":"2024-01-17T22:58:55.913645+0000","last_became_peered":"2024-01-17T22:58:55.913645+0000","last_unstale":"2024-01-18T00:46:58.802459+0000","last_undegraded":"2024-01-18T00:46:58.802459+0000","last_fullsized":"2024-01-18T00:46:58.802459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":136231,"num_write":693,"num_write_kb":114548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'226","reported_seq":294,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651590+0000","last_change":"2024-01-17T22:58:49.417874+0000","last_active":"2024-01-18T00:47:15.651590+0000","last_peered":"2024-01-18T00:47:15.651590+0000","last_clean":"2024-01-18T00:47:15.651590+0000","last_became_active":"2024-01-17T22:58:49.417385+0000","last_became_peered":"2024-01-17T22:58:49.417385+0000","last_unstale":"2024-01-18T00:47:15.651590+0000","last_undegraded":"2024-01-18T00:47:15.651590+0000","last_fullsized":"2024-01-18T00:47:15.651590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:41.515981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'330","reported_seq":399,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:11.382366+0000","last_change":"2024-01-17T22:58:48.340052+0000","last_active":"2024-01-18T00:47:11.382366+0000","last_peered":"2024-01-18T00:47:11.382366+0000","last_clean":"2024-01-18T00:47:11.382366+0000","last_became_active":"2024-01-17T22:58:48.339738+0000","last_became_peered":"2024-01-17T22:58:48.339738+0000","last_unstale":"2024-01-18T00:47:11.382366+0000","last_undegraded":"2024-01-18T00:47:11.382366+0000","last_fullsized":"2024-01-18T00:47:11.382366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:58.517904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'778","reported_seq":883,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.935092+0000","last_change":"2024-01-17T22:58:55.904749+0000","last_active":"2024-01-18T00:47:04.935092+0000","last_peered":"2024-01-18T00:47:04.935092+0000","last_clean":"2024-01-18T00:47:04.935092+0000","last_became_active":"2024-01-17T22:58:55.904417+0000","last_became_peered":"2024-01-17T22:58:55.904417+0000","last_unstale":"2024-01-18T00:47:04.935092+0000","last_undegraded":"2024-01-18T00:47:04.935092+0000","last_fullsized":"2024-01-18T00:47:04.935092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:22:32.504064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":109858,"num_write":759,"num_write_kb":103009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'181","reported_seq":249,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:11.404434+0000","last_change":"2024-01-17T22:58:49.411284+0000","last_active":"2024-01-18T00:47:11.404434+0000","last_peered":"2024-01-18T00:47:11.404434+0000","last_clean":"2024-01-18T00:47:11.404434+0000","last_became_active":"2024-01-17T22:58:49.410830+0000","last_became_peered":"2024-01-17T22:58:49.410830+0000","last_unstale":"2024-01-18T00:47:11.404434+0000","last_undegraded":"2024-01-18T00:47:11.404434+0000","last_fullsized":"2024-01-18T00:47:11.404434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:17:04.832847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'1208","reported_seq":1277,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:11.404416+0000","last_change":"2024-01-17T22:58:48.339919+0000","last_active":"2024-01-18T00:47:11.404416+0000","last_peered":"2024-01-18T00:47:11.404416+0000","last_clean":"2024-01-18T00:47:11.404416+0000","last_became_active":"2024-01-17T22:58:48.338928+0000","last_became_peered":"2024-01-17T22:58:48.338928+0000","last_unstale":"2024-01-18T00:47:11.404416+0000","last_undegraded":"2024-01-18T00:47:11.404416+0000","last_fullsized":"2024-01-18T00:47:11.404416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1208,"log_dups_size":0,"ondisk_log_size":1208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:21.699809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3220,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'817","reported_seq":928,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.691889+0000","last_change":"2024-01-17T22:58:55.909140+0000","last_active":"2024-01-18T00:47:04.691889+0000","last_peered":"2024-01-18T00:47:04.691889+0000","last_clean":"2024-01-18T00:47:04.691889+0000","last_became_active":"2024-01-17T22:58:55.908232+0000","last_became_peered":"2024-01-17T22:58:55.908232+0000","last_unstale":"2024-01-18T00:47:04.691889+0000","last_undegraded":"2024-01-18T00:47:04.691889+0000","last_fullsized":"2024-01-18T00:47:04.691889+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":152093,"num_write":804,"num_write_kb":135389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'198","reported_seq":268,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.835195+0000","last_change":"2024-01-17T22:58:49.370201+0000","last_active":"2024-01-18T00:47:15.835195+0000","last_peered":"2024-01-18T00:47:15.835195+0000","last_clean":"2024-01-18T00:47:15.835195+0000","last_became_active":"2024-01-17T22:58:49.369598+0000","last_became_peered":"2024-01-17T22:58:49.369598+0000","last_unstale":"2024-01-18T00:47:15.835195+0000","last_undegraded":"2024-01-18T00:47:15.835195+0000","last_fullsized":"2024-01-18T00:47:15.835195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:15.814647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'819","reported_seq":889,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:14.849761+0000","last_change":"2024-01-17T22:58:48.338556+0000","last_active":"2024-01-18T00:46:14.849761+0000","last_peered":"2024-01-18T00:46:14.849761+0000","last_clean":"2024-01-18T00:46:14.849761+0000","last_became_active":"2024-01-17T22:58:48.338225+0000","last_became_peered":"2024-01-17T22:58:48.338225+0000","last_unstale":"2024-01-18T00:46:14.849761+0000","last_undegraded":"2024-01-18T00:46:14.849761+0000","last_fullsized":"2024-01-18T00:46:14.849761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:47.210049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":8593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'758","reported_seq":863,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.960696+0000","last_change":"2024-01-17T22:58:55.872734+0000","last_active":"2024-01-18T00:47:08.960696+0000","last_peered":"2024-01-18T00:47:08.960696+0000","last_clean":"2024-01-18T00:47:08.960696+0000","last_became_active":"2024-01-17T22:58:55.872356+0000","last_became_peered":"2024-01-17T22:58:55.872356+0000","last_unstale":"2024-01-18T00:47:08.960696+0000","last_undegraded":"2024-01-18T00:47:08.960696+0000","last_fullsized":"2024-01-18T00:47:08.960696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:22:32.504064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":100834,"num_write":740,"num_write_kb":155893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'214","reported_seq":282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.652987+0000","last_change":"2024-01-17T22:58:49.369806+0000","last_active":"2024-01-18T00:47:15.652987+0000","last_peered":"2024-01-18T00:47:15.652987+0000","last_clean":"2024-01-18T00:47:15.652987+0000","last_became_active":"2024-01-17T22:58:49.369487+0000","last_became_peered":"2024-01-17T22:58:49.369487+0000","last_unstale":"2024-01-18T00:47:15.652987+0000","last_undegraded":"2024-01-18T00:47:15.652987+0000","last_fullsized":"2024-01-18T00:47:15.652987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:25.515983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'276","reported_seq":347,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.606730+0000","last_change":"2024-01-17T22:58:48.341854+0000","last_active":"2024-01-18T00:46:53.606730+0000","last_peered":"2024-01-18T00:46:53.606730+0000","last_clean":"2024-01-18T00:46:53.606730+0000","last_became_active":"2024-01-17T22:58:48.339996+0000","last_became_peered":"2024-01-17T22:58:48.339996+0000","last_unstale":"2024-01-18T00:46:53.606730+0000","last_undegraded":"2024-01-18T00:46:53.606730+0000","last_fullsized":"2024-01-18T00:46:53.606730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:55:52.894278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'763","reported_seq":861,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.274913+0000","last_change":"2024-01-17T22:58:55.877637+0000","last_active":"2024-01-18T00:47:09.274913+0000","last_peered":"2024-01-18T00:47:09.274913+0000","last_clean":"2024-01-18T00:47:09.274913+0000","last_became_active":"2024-01-17T22:58:55.877118+0000","last_became_peered":"2024-01-17T22:58:55.877118+0000","last_unstale":"2024-01-18T00:47:09.274913+0000","last_undegraded":"2024-01-18T00:47:09.274913+0000","last_fullsized":"2024-01-18T00:47:09.274913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:08.327495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":97013,"num_write":742,"num_write_kb":97416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'191","reported_seq":261,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.647543+0000","last_change":"2024-01-17T22:58:49.352845+0000","last_active":"2024-01-18T00:47:08.647543+0000","last_peered":"2024-01-18T00:47:08.647543+0000","last_clean":"2024-01-18T00:47:08.647543+0000","last_became_active":"2024-01-17T22:58:49.352563+0000","last_became_peered":"2024-01-17T22:58:49.352563+0000","last_unstale":"2024-01-18T00:47:08.647543+0000","last_undegraded":"2024-01-18T00:47:08.647543+0000","last_fullsized":"2024-01-18T00:47:08.647543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:43.516572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'1018","reported_seq":1089,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:38.492655+0000","last_change":"2024-01-17T22:58:48.343658+0000","last_active":"2024-01-18T00:45:38.492655+0000","last_peered":"2024-01-18T00:45:38.492655+0000","last_clean":"2024-01-18T00:45:38.492655+0000","last_became_active":"2024-01-17T22:58:48.343060+0000","last_became_peered":"2024-01-17T22:58:48.343060+0000","last_unstale":"2024-01-18T00:45:38.492655+0000","last_undegraded":"2024-01-18T00:45:38.492655+0000","last_fullsized":"2024-01-18T00:45:38.492655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:42.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":955,"num_write_kb":8650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'732","reported_seq":829,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:49.510439+0000","last_change":"2024-01-17T22:58:55.881076+0000","last_active":"2024-01-18T00:46:49.510439+0000","last_peered":"2024-01-18T00:46:49.510439+0000","last_clean":"2024-01-18T00:46:49.510439+0000","last_became_active":"2024-01-17T22:58:55.880665+0000","last_became_peered":"2024-01-17T22:58:55.880665+0000","last_unstale":"2024-01-18T00:46:49.510439+0000","last_undegraded":"2024-01-18T00:46:49.510439+0000","last_fullsized":"2024-01-18T00:46:49.510439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:37:20.317014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":93731,"num_write":720,"num_write_kb":118971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'198","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.692105+0000","last_change":"2024-01-17T22:58:49.385682+0000","last_active":"2024-01-18T00:47:04.692105+0000","last_peered":"2024-01-18T00:47:04.692105+0000","last_clean":"2024-01-18T00:47:04.692105+0000","last_became_active":"2024-01-17T22:58:49.384655+0000","last_became_peered":"2024-01-17T22:58:49.384655+0000","last_unstale":"2024-01-18T00:47:04.692105+0000","last_undegraded":"2024-01-18T00:47:04.692105+0000","last_fullsized":"2024-01-18T00:47:04.692105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:22:51.592384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'1859","reported_seq":3718,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:13.468415+0000","last_change":"2024-01-17T22:58:48.375527+0000","last_active":"2024-01-18T00:47:13.468415+0000","last_peered":"2024-01-18T00:47:13.468415+0000","last_clean":"2024-01-18T00:47:13.468415+0000","last_became_active":"2024-01-17T22:58:48.375210+0000","last_became_peered":"2024-01-17T22:58:48.375210+0000","last_unstale":"2024-01-18T00:47:13.468415+0000","last_undegraded":"2024-01-18T00:47:13.468415+0000","last_fullsized":"2024-01-18T00:47:13.468415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1859,"log_dups_size":0,"ondisk_log_size":1859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:51:00.037407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1556390,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1788,"num_read_kb":2847,"num_write":1794,"num_write_kb":2850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'738","reported_seq":827,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.666387+0000","last_change":"2024-01-17T22:58:55.903437+0000","last_active":"2024-01-18T00:47:08.666387+0000","last_peered":"2024-01-18T00:47:08.666387+0000","last_clean":"2024-01-18T00:47:08.666387+0000","last_became_active":"2024-01-17T22:58:55.902881+0000","last_became_peered":"2024-01-17T22:58:55.902881+0000","last_unstale":"2024-01-18T00:47:08.666387+0000","last_undegraded":"2024-01-18T00:47:08.666387+0000","last_fullsized":"2024-01-18T00:47:08.666387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:45.815765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":79403,"num_write":724,"num_write_kb":135108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'196","reported_seq":266,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.833898+0000","last_change":"2024-01-17T22:58:49.367932+0000","last_active":"2024-01-18T00:47:15.833898+0000","last_peered":"2024-01-18T00:47:15.833898+0000","last_clean":"2024-01-18T00:47:15.833898+0000","last_became_active":"2024-01-17T22:58:49.367236+0000","last_became_peered":"2024-01-17T22:58:49.367236+0000","last_unstale":"2024-01-18T00:47:15.833898+0000","last_undegraded":"2024-01-18T00:47:15.833898+0000","last_fullsized":"2024-01-18T00:47:15.833898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:06.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'617","reported_seq":689,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:47.617658+0000","last_change":"2024-01-17T22:58:48.338730+0000","last_active":"2024-01-18T00:45:47.617658+0000","last_peered":"2024-01-18T00:45:47.617658+0000","last_clean":"2024-01-18T00:45:47.617658+0000","last_became_active":"2024-01-17T22:58:48.337500+0000","last_became_peered":"2024-01-17T22:58:48.337500+0000","last_unstale":"2024-01-18T00:45:47.617658+0000","last_undegraded":"2024-01-18T00:45:47.617658+0000","last_fullsized":"2024-01-18T00:45:47.617658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:54.141445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":12559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'904","reported_seq":1025,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.855106+0000","last_change":"2024-01-17T22:58:55.900298+0000","last_active":"2024-01-18T00:46:53.855106+0000","last_peered":"2024-01-18T00:46:53.855106+0000","last_clean":"2024-01-18T00:46:53.855106+0000","last_became_active":"2024-01-17T22:58:55.899657+0000","last_became_peered":"2024-01-17T22:58:55.899657+0000","last_unstale":"2024-01-18T00:46:53.855106+0000","last_undegraded":"2024-01-18T00:46:53.855106+0000","last_fullsized":"2024-01-18T00:46:53.855106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:30:03.955178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":184022,"num_write":887,"num_write_kb":259108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'189","reported_seq":259,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.652198+0000","last_change":"2024-01-17T22:58:49.412701+0000","last_active":"2024-01-18T00:47:15.652198+0000","last_peered":"2024-01-18T00:47:15.652198+0000","last_clean":"2024-01-18T00:47:15.652198+0000","last_became_active":"2024-01-17T22:58:49.411848+0000","last_became_peered":"2024-01-17T22:58:49.411848+0000","last_unstale":"2024-01-18T00:47:15.652198+0000","last_undegraded":"2024-01-18T00:47:15.652198+0000","last_fullsized":"2024-01-18T00:47:15.652198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:55:47.020055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'293","reported_seq":364,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.802453+0000","last_change":"2024-01-17T22:58:48.341769+0000","last_active":"2024-01-18T00:47:04.802453+0000","last_peered":"2024-01-18T00:47:04.802453+0000","last_clean":"2024-01-18T00:47:04.802453+0000","last_became_active":"2024-01-17T22:58:48.340963+0000","last_became_peered":"2024-01-17T22:58:48.340963+0000","last_unstale":"2024-01-18T00:47:04.802453+0000","last_undegraded":"2024-01-18T00:47:04.802453+0000","last_fullsized":"2024-01-18T00:47:04.802453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:15:16.672836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":4212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'161","reported_seq":278,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:44:51.424884+0000","last_change":"2024-01-17T22:58:17.322374+0000","last_active":"2024-01-18T00:44:51.424884+0000","last_peered":"2024-01-18T00:44:51.424884+0000","last_clean":"2024-01-18T00:44:51.424884+0000","last_became_active":"2024-01-17T22:58:17.321097+0000","last_became_peered":"2024-01-17T22:58:17.321097+0000","last_unstale":"2024-01-18T00:44:51.424884+0000","last_undegraded":"2024-01-18T00:44:51.424884+0000","last_fullsized":"2024-01-18T00:44:51.424884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:15.452106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:15.452106+0000","last_clean_scrub_stamp":"2024-01-17T22:58:15.452106+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:55:58.924319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'806","reported_seq":938,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:59.053289+0000","last_change":"2024-01-17T22:58:55.909509+0000","last_active":"2024-01-18T00:46:59.053289+0000","last_peered":"2024-01-18T00:46:59.053289+0000","last_clean":"2024-01-18T00:46:59.053289+0000","last_became_active":"2024-01-17T22:58:55.909055+0000","last_became_peered":"2024-01-17T22:58:55.909055+0000","last_unstale":"2024-01-18T00:46:59.053289+0000","last_undegraded":"2024-01-18T00:46:59.053289+0000","last_fullsized":"2024-01-18T00:46:59.053289+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:11:12.388395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":230974,"num_write":789,"num_write_kb":193453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'203","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:59.050211+0000","last_change":"2024-01-17T22:58:49.516198+0000","last_active":"2024-01-18T00:46:59.050211+0000","last_peered":"2024-01-18T00:46:59.050211+0000","last_clean":"2024-01-18T00:46:59.050211+0000","last_became_active":"2024-01-17T22:58:49.515941+0000","last_became_peered":"2024-01-17T22:58:49.515941+0000","last_unstale":"2024-01-18T00:46:59.050211+0000","last_undegraded":"2024-01-18T00:46:59.050211+0000","last_fullsized":"2024-01-18T00:46:59.050211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:54:07.128744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'363","reported_seq":430,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:51.399606+0000","last_change":"2024-01-17T22:58:48.344998+0000","last_active":"2024-01-18T00:46:51.399606+0000","last_peered":"2024-01-18T00:46:51.399606+0000","last_clean":"2024-01-18T00:46:51.399606+0000","last_became_active":"2024-01-17T22:58:48.344402+0000","last_became_peered":"2024-01-17T22:58:48.344402+0000","last_unstale":"2024-01-18T00:46:51.399606+0000","last_undegraded":"2024-01-18T00:46:51.399606+0000","last_fullsized":"2024-01-18T00:46:51.399606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:01:21.629083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'821","reported_seq":920,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.698709+0000","last_change":"2024-01-17T22:58:55.886258+0000","last_active":"2024-01-18T00:47:08.698709+0000","last_peered":"2024-01-18T00:47:08.698709+0000","last_clean":"2024-01-18T00:47:08.698709+0000","last_became_active":"2024-01-17T22:58:55.885809+0000","last_became_peered":"2024-01-17T22:58:55.885809+0000","last_unstale":"2024-01-18T00:47:08.698709+0000","last_undegraded":"2024-01-18T00:47:08.698709+0000","last_fullsized":"2024-01-18T00:47:08.698709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:08.327495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":121383,"num_write":812,"num_write_kb":179977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'216","reported_seq":274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651394+0000","last_change":"2024-01-17T22:59:08.654953+0000","last_active":"2024-01-18T00:47:15.651394+0000","last_peered":"2024-01-18T00:47:15.651394+0000","last_clean":"2024-01-18T00:47:15.651394+0000","last_became_active":"2024-01-17T22:59:08.654136+0000","last_became_peered":"2024-01-17T22:59:08.654136+0000","last_unstale":"2024-01-18T00:47:15.651394+0000","last_undegraded":"2024-01-18T00:47:15.651394+0000","last_fullsized":"2024-01-18T00:47:15.651394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:19:02.000223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"28'404","reported_seq":471,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:47.632062+0000","last_change":"2024-01-17T22:58:48.338206+0000","last_active":"2024-01-18T00:45:47.632062+0000","last_peered":"2024-01-18T00:45:47.632062+0000","last_clean":"2024-01-18T00:45:47.632062+0000","last_became_active":"2024-01-17T22:58:48.337489+0000","last_became_peered":"2024-01-17T22:58:48.337489+0000","last_unstale":"2024-01-18T00:45:47.632062+0000","last_undegraded":"2024-01-18T00:45:47.632062+0000","last_fullsized":"2024-01-18T00:45:47.632062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:09:04.579374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'799","reported_seq":898,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.976358+0000","last_change":"2024-01-17T22:58:55.903435+0000","last_active":"2024-01-18T00:47:08.976358+0000","last_peered":"2024-01-18T00:47:08.976358+0000","last_clean":"2024-01-18T00:47:08.976358+0000","last_became_active":"2024-01-17T22:58:55.902857+0000","last_became_peered":"2024-01-17T22:58:55.902857+0000","last_unstale":"2024-01-18T00:47:08.976358+0000","last_undegraded":"2024-01-18T00:47:08.976358+0000","last_fullsized":"2024-01-18T00:47:08.976358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:24:43.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":124542,"num_write":790,"num_write_kb":159708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'183","reported_seq":248,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:44.335190+0000","last_change":"2024-01-17T22:58:49.519307+0000","last_active":"2024-01-18T00:46:44.335190+0000","last_peered":"2024-01-18T00:46:44.335190+0000","last_clean":"2024-01-18T00:46:44.335190+0000","last_became_active":"2024-01-17T22:58:49.519060+0000","last_became_peered":"2024-01-17T22:58:49.519060+0000","last_unstale":"2024-01-18T00:46:44.335190+0000","last_undegraded":"2024-01-18T00:46:44.335190+0000","last_fullsized":"2024-01-18T00:46:44.335190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:48.025499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'863","reported_seq":930,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:33.712846+0000","last_change":"2024-01-17T22:58:48.341584+0000","last_active":"2024-01-18T00:46:33.712846+0000","last_peered":"2024-01-18T00:46:33.712846+0000","last_clean":"2024-01-18T00:46:33.712846+0000","last_became_active":"2024-01-17T22:58:48.339433+0000","last_became_peered":"2024-01-17T22:58:48.339433+0000","last_unstale":"2024-01-18T00:46:33.712846+0000","last_undegraded":"2024-01-18T00:46:33.712846+0000","last_fullsized":"2024-01-18T00:46:33.712846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:01:09.060396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":4462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'819","reported_seq":915,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:13.497911+0000","last_change":"2024-01-17T22:58:55.905118+0000","last_active":"2024-01-18T00:47:13.497911+0000","last_peered":"2024-01-18T00:47:13.497911+0000","last_clean":"2024-01-18T00:47:13.497911+0000","last_became_active":"2024-01-17T22:58:55.904690+0000","last_became_peered":"2024-01-17T22:58:55.904690+0000","last_unstale":"2024-01-18T00:47:13.497911+0000","last_undegraded":"2024-01-18T00:47:13.497911+0000","last_fullsized":"2024-01-18T00:47:13.497911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:45:30.212764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":82183,"num_write":809,"num_write_kb":113772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'190","reported_seq":255,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.654446+0000","last_change":"2024-01-17T22:58:49.352993+0000","last_active":"2024-01-18T00:47:15.654446+0000","last_peered":"2024-01-18T00:47:15.654446+0000","last_clean":"2024-01-18T00:47:15.654446+0000","last_became_active":"2024-01-17T22:58:49.352744+0000","last_became_peered":"2024-01-17T22:58:49.352744+0000","last_unstale":"2024-01-18T00:47:15.654446+0000","last_undegraded":"2024-01-18T00:47:15.654446+0000","last_fullsized":"2024-01-18T00:47:15.654446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:06.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'869","reported_seq":935,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:10.101153+0000","last_change":"2024-01-17T22:58:48.343793+0000","last_active":"2024-01-18T00:45:10.101153+0000","last_peered":"2024-01-18T00:45:10.101153+0000","last_clean":"2024-01-18T00:45:10.101153+0000","last_became_active":"2024-01-17T22:58:48.343435+0000","last_became_peered":"2024-01-17T22:58:48.343435+0000","last_unstale":"2024-01-18T00:45:10.101153+0000","last_undegraded":"2024-01-18T00:45:10.101153+0000","last_fullsized":"2024-01-18T00:45:10.101153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:50:50.592551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":940,"num_write_kb":4497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'797","reported_seq":904,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.109379+0000","last_change":"2024-01-17T22:58:55.913690+0000","last_active":"2024-01-18T00:47:09.109379+0000","last_peered":"2024-01-18T00:47:09.109379+0000","last_clean":"2024-01-18T00:47:09.109379+0000","last_became_active":"2024-01-17T22:58:55.913197+0000","last_became_peered":"2024-01-17T22:58:55.913197+0000","last_unstale":"2024-01-18T00:47:09.109379+0000","last_undegraded":"2024-01-18T00:47:09.109379+0000","last_fullsized":"2024-01-18T00:47:09.109379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:31.829297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":146211,"num_write":781,"num_write_kb":158858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'235","reported_seq":299,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.639362+0000","last_change":"2024-01-17T22:58:49.368242+0000","last_active":"2024-01-18T00:47:15.639362+0000","last_peered":"2024-01-18T00:47:15.639362+0000","last_clean":"2024-01-18T00:47:15.639362+0000","last_became_active":"2024-01-17T22:58:49.368018+0000","last_became_peered":"2024-01-17T22:58:49.368018+0000","last_unstale":"2024-01-18T00:47:15.639362+0000","last_undegraded":"2024-01-18T00:47:15.639362+0000","last_fullsized":"2024-01-18T00:47:15.639362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:49:55.661543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'701","reported_seq":766,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:28.455439+0000","last_change":"2024-01-17T22:58:48.374293+0000","last_active":"2024-01-18T00:46:28.455439+0000","last_peered":"2024-01-18T00:46:28.455439+0000","last_clean":"2024-01-18T00:46:28.455439+0000","last_became_active":"2024-01-17T22:58:48.373287+0000","last_became_peered":"2024-01-17T22:58:48.373287+0000","last_unstale":"2024-01-18T00:46:28.455439+0000","last_undegraded":"2024-01-18T00:46:28.455439+0000","last_fullsized":"2024-01-18T00:46:28.455439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":649,"num_write_kb":8541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'825","reported_seq":940,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.758998+0000","last_change":"2024-01-17T22:58:55.909679+0000","last_active":"2024-01-18T00:46:53.758998+0000","last_peered":"2024-01-18T00:46:53.758998+0000","last_clean":"2024-01-18T00:46:53.758998+0000","last_became_active":"2024-01-17T22:58:55.909139+0000","last_became_peered":"2024-01-17T22:58:55.909139+0000","last_unstale":"2024-01-18T00:46:53.758998+0000","last_undegraded":"2024-01-18T00:46:53.758998+0000","last_fullsized":"2024-01-18T00:46:53.758998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:39:50.993158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":204092,"num_write":802,"num_write_kb":163340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'217","reported_seq":280,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.760302+0000","last_change":"2024-01-17T22:58:49.515761+0000","last_active":"2024-01-18T00:47:15.760302+0000","last_peered":"2024-01-18T00:47:15.760302+0000","last_clean":"2024-01-18T00:47:15.760302+0000","last_became_active":"2024-01-17T22:58:49.514776+0000","last_became_peered":"2024-01-17T22:58:49.514776+0000","last_unstale":"2024-01-18T00:47:15.760302+0000","last_undegraded":"2024-01-18T00:47:15.760302+0000","last_fullsized":"2024-01-18T00:47:15.760302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'64","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:32.504506+0000","last_change":"2024-01-17T22:58:48.349505+0000","last_active":"2024-01-18T00:45:32.504506+0000","last_peered":"2024-01-18T00:45:32.504506+0000","last_clean":"2024-01-18T00:45:32.504506+0000","last_became_active":"2024-01-17T22:58:48.349193+0000","last_became_peered":"2024-01-17T22:58:48.349193+0000","last_unstale":"2024-01-18T00:45:32.504506+0000","last_undegraded":"2024-01-18T00:45:32.504506+0000","last_fullsized":"2024-01-18T00:45:32.504506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:10:59.139723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":842,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'809","reported_seq":919,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.381754+0000","last_change":"2024-01-17T22:58:55.911280+0000","last_active":"2024-01-18T00:47:04.381754+0000","last_peered":"2024-01-18T00:47:04.381754+0000","last_clean":"2024-01-18T00:47:04.381754+0000","last_became_active":"2024-01-17T22:58:55.910147+0000","last_became_peered":"2024-01-17T22:58:55.910147+0000","last_unstale":"2024-01-18T00:47:04.381754+0000","last_undegraded":"2024-01-18T00:47:04.381754+0000","last_fullsized":"2024-01-18T00:47:04.381754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:29:01.453903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":124212,"num_write":791,"num_write_kb":164591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'198","reported_seq":262,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660494+0000","last_change":"2024-01-17T22:58:49.366332+0000","last_active":"2024-01-18T00:47:15.660494+0000","last_peered":"2024-01-18T00:47:15.660494+0000","last_clean":"2024-01-18T00:47:15.660494+0000","last_became_active":"2024-01-17T22:58:49.366055+0000","last_became_peered":"2024-01-17T22:58:49.366055+0000","last_unstale":"2024-01-18T00:47:15.660494+0000","last_undegraded":"2024-01-18T00:47:15.660494+0000","last_fullsized":"2024-01-18T00:47:15.660494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:44:30.888903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'54","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:11.376150+0000","last_change":"2024-01-17T22:58:48.378008+0000","last_active":"2024-01-18T00:46:11.376150+0000","last_peered":"2024-01-18T00:46:11.376150+0000","last_clean":"2024-01-18T00:46:11.376150+0000","last_became_active":"2024-01-17T22:58:48.377732+0000","last_became_peered":"2024-01-17T22:58:48.377732+0000","last_unstale":"2024-01-18T00:46:11.376150+0000","last_undegraded":"2024-01-18T00:46:11.376150+0000","last_fullsized":"2024-01-18T00:46:11.376150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:35:05.032134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'664","reported_seq":748,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:58.927643+0000","last_change":"2024-01-17T22:59:09.245915+0000","last_active":"2024-01-18T00:46:58.927643+0000","last_peered":"2024-01-18T00:46:58.927643+0000","last_clean":"2024-01-18T00:46:58.927643+0000","last_became_active":"2024-01-17T22:59:09.244621+0000","last_became_peered":"2024-01-17T22:59:09.244621+0000","last_unstale":"2024-01-18T00:46:58.927643+0000","last_undegraded":"2024-01-18T00:46:58.927643+0000","last_fullsized":"2024-01-18T00:46:58.927643+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:01:38.677481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":44179,"num_write":651,"num_write_kb":63897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,5],"acting":[6,4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'209","reported_seq":273,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.828129+0000","last_change":"2024-01-17T22:58:49.368620+0000","last_active":"2024-01-18T00:47:15.828129+0000","last_peered":"2024-01-18T00:47:15.828129+0000","last_clean":"2024-01-18T00:47:15.828129+0000","last_became_active":"2024-01-17T22:58:49.367258+0000","last_became_peered":"2024-01-17T22:58:49.367258+0000","last_unstale":"2024-01-18T00:47:15.828129+0000","last_undegraded":"2024-01-18T00:47:15.828129+0000","last_fullsized":"2024-01-18T00:47:15.828129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:25.515983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'368","reported_seq":433,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:43.489636+0000","last_change":"2024-01-17T22:58:48.371378+0000","last_active":"2024-01-18T00:45:43.489636+0000","last_peered":"2024-01-18T00:45:43.489636+0000","last_clean":"2024-01-18T00:45:43.489636+0000","last_became_active":"2024-01-17T22:58:48.370691+0000","last_became_peered":"2024-01-17T22:58:48.370691+0000","last_unstale":"2024-01-18T00:45:43.489636+0000","last_undegraded":"2024-01-18T00:45:43.489636+0000","last_fullsized":"2024-01-18T00:45:43.489636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:01:21.629083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":8326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'675","reported_seq":751,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:54.053556+0000","last_change":"2024-01-17T22:58:55.846853+0000","last_active":"2024-01-18T00:46:54.053556+0000","last_peered":"2024-01-18T00:46:54.053556+0000","last_clean":"2024-01-18T00:46:54.053556+0000","last_became_active":"2024-01-17T22:58:55.846382+0000","last_became_peered":"2024-01-17T22:58:55.846382+0000","last_unstale":"2024-01-18T00:46:54.053556+0000","last_undegraded":"2024-01-18T00:46:54.053556+0000","last_fullsized":"2024-01-18T00:46:54.053556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:00:22.788812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":43277,"num_write":656,"num_write_kb":56099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'187","reported_seq":249,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:33.722425+0000","last_change":"2024-01-17T22:58:49.367642+0000","last_active":"2024-01-18T00:46:33.722425+0000","last_peered":"2024-01-18T00:46:33.722425+0000","last_clean":"2024-01-18T00:46:33.722425+0000","last_became_active":"2024-01-17T22:58:49.367370+0000","last_became_peered":"2024-01-17T22:58:49.367370+0000","last_unstale":"2024-01-18T00:46:33.722425+0000","last_undegraded":"2024-01-18T00:46:33.722425+0000","last_fullsized":"2024-01-18T00:46:33.722425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:24:43.594840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'1300","reported_seq":1364,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:51.758158+0000","last_change":"2024-01-17T22:58:48.346833+0000","last_active":"2024-01-18T00:46:51.758158+0000","last_peered":"2024-01-18T00:46:51.758158+0000","last_clean":"2024-01-18T00:46:51.758158+0000","last_became_active":"2024-01-17T22:58:48.346574+0000","last_became_peered":"2024-01-17T22:58:48.346574+0000","last_unstale":"2024-01-18T00:46:51.758158+0000","last_undegraded":"2024-01-18T00:46:51.758158+0000","last_fullsized":"2024-01-18T00:46:51.758158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1300,"log_dups_size":0,"ondisk_log_size":1300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:55:23.055396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":13137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'811","reported_seq":915,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.691930+0000","last_change":"2024-01-17T22:58:55.832183+0000","last_active":"2024-01-18T00:47:04.691930+0000","last_peered":"2024-01-18T00:47:04.691930+0000","last_clean":"2024-01-18T00:47:04.691930+0000","last_became_active":"2024-01-17T22:58:55.831090+0000","last_became_peered":"2024-01-17T22:58:55.831090+0000","last_unstale":"2024-01-18T00:47:04.691930+0000","last_undegraded":"2024-01-18T00:47:04.691930+0000","last_fullsized":"2024-01-18T00:47:04.691930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:15.077032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":127549,"num_write":788,"num_write_kb":160232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'198","reported_seq":262,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.664502+0000","last_change":"2024-01-17T22:58:49.366048+0000","last_active":"2024-01-18T00:47:15.664502+0000","last_peered":"2024-01-18T00:47:15.664502+0000","last_clean":"2024-01-18T00:47:15.664502+0000","last_became_active":"2024-01-17T22:58:49.365846+0000","last_became_peered":"2024-01-17T22:58:49.365846+0000","last_unstale":"2024-01-18T00:47:15.664502+0000","last_undegraded":"2024-01-18T00:47:15.664502+0000","last_fullsized":"2024-01-18T00:47:15.664502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:19:02.000223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'1446","reported_seq":1509,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.419203+0000","last_change":"2024-01-17T22:58:48.376099+0000","last_active":"2024-01-18T00:47:09.419203+0000","last_peered":"2024-01-18T00:47:09.419203+0000","last_clean":"2024-01-18T00:47:09.419203+0000","last_became_active":"2024-01-17T22:58:48.375504+0000","last_became_peered":"2024-01-17T22:58:48.375504+0000","last_unstale":"2024-01-18T00:47:09.419203+0000","last_undegraded":"2024-01-18T00:47:09.419203+0000","last_fullsized":"2024-01-18T00:47:09.419203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1446,"log_dups_size":0,"ondisk_log_size":1446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1379,"num_write_kb":5332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'771","reported_seq":867,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.139685+0000","last_change":"2024-01-17T22:58:55.906751+0000","last_active":"2024-01-18T00:47:09.139685+0000","last_peered":"2024-01-18T00:47:09.139685+0000","last_clean":"2024-01-18T00:47:09.139685+0000","last_became_active":"2024-01-17T22:58:55.906429+0000","last_became_peered":"2024-01-17T22:58:55.906429+0000","last_unstale":"2024-01-18T00:47:09.139685+0000","last_undegraded":"2024-01-18T00:47:09.139685+0000","last_fullsized":"2024-01-18T00:47:09.139685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:37:20.317014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":103553,"num_write":751,"num_write_kb":113909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'194","reported_seq":256,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:49.621926+0000","last_change":"2024-01-17T22:58:49.361059+0000","last_active":"2024-01-18T00:46:49.621926+0000","last_peered":"2024-01-18T00:46:49.621926+0000","last_clean":"2024-01-18T00:46:49.621926+0000","last_became_active":"2024-01-17T22:58:49.360282+0000","last_became_peered":"2024-01-17T22:58:49.360282+0000","last_unstale":"2024-01-18T00:46:49.621926+0000","last_undegraded":"2024-01-18T00:46:49.621926+0000","last_fullsized":"2024-01-18T00:46:49.621926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:10:15.673364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'183","reported_seq":246,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:13.525813+0000","last_change":"2024-01-17T22:58:48.349585+0000","last_active":"2024-01-18T00:45:13.525813+0000","last_peered":"2024-01-18T00:45:13.525813+0000","last_clean":"2024-01-18T00:45:13.525813+0000","last_became_active":"2024-01-17T22:58:48.349262+0000","last_became_peered":"2024-01-17T22:58:48.349262+0000","last_unstale":"2024-01-18T00:45:13.525813+0000","last_undegraded":"2024-01-18T00:45:13.525813+0000","last_fullsized":"2024-01-18T00:45:13.525813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:32:48.765965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'853","reported_seq":942,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.911679+0000","last_change":"2024-01-17T22:58:55.899604+0000","last_active":"2024-01-18T00:47:04.911679+0000","last_peered":"2024-01-18T00:47:04.911679+0000","last_clean":"2024-01-18T00:47:04.911679+0000","last_became_active":"2024-01-17T22:58:55.899176+0000","last_became_peered":"2024-01-17T22:58:55.899176+0000","last_unstale":"2024-01-18T00:47:04.911679+0000","last_undegraded":"2024-01-18T00:47:04.911679+0000","last_fullsized":"2024-01-18T00:47:04.911679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:47.829295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":85515,"num_write":843,"num_write_kb":192821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'218","reported_seq":279,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651074+0000","last_change":"2024-01-17T22:58:49.364258+0000","last_active":"2024-01-18T00:47:15.651074+0000","last_peered":"2024-01-18T00:47:15.651074+0000","last_clean":"2024-01-18T00:47:15.651074+0000","last_became_active":"2024-01-17T22:58:49.363979+0000","last_became_peered":"2024-01-17T22:58:49.363979+0000","last_unstale":"2024-01-18T00:47:15.651074+0000","last_undegraded":"2024-01-18T00:47:15.651074+0000","last_fullsized":"2024-01-18T00:47:15.651074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:15:17.927996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'57","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:19.024164+0000","last_change":"2024-01-17T22:58:48.321573+0000","last_active":"2024-01-18T00:46:19.024164+0000","last_peered":"2024-01-18T00:46:19.024164+0000","last_clean":"2024-01-18T00:46:19.024164+0000","last_became_active":"2024-01-17T22:58:48.321379+0000","last_became_peered":"2024-01-17T22:58:48.321379+0000","last_unstale":"2024-01-18T00:46:19.024164+0000","last_undegraded":"2024-01-18T00:46:19.024164+0000","last_fullsized":"2024-01-18T00:46:19.024164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:55:23.055396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'867","reported_seq":978,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.750269+0000","last_change":"2024-01-17T22:58:55.873529+0000","last_active":"2024-01-18T00:47:08.750269+0000","last_peered":"2024-01-18T00:47:08.750269+0000","last_clean":"2024-01-18T00:47:08.750269+0000","last_became_active":"2024-01-17T22:58:55.872885+0000","last_became_peered":"2024-01-17T22:58:55.872885+0000","last_unstale":"2024-01-18T00:47:08.750269+0000","last_undegraded":"2024-01-18T00:47:08.750269+0000","last_fullsized":"2024-01-18T00:47:08.750269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:50:01.974857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":173952,"num_write":855,"num_write_kb":180962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'734","reported_seq":837,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.313232+0000","last_change":"2024-01-17T22:58:55.903620+0000","last_active":"2024-01-18T00:47:04.313232+0000","last_peered":"2024-01-18T00:47:04.313232+0000","last_clean":"2024-01-18T00:47:04.313232+0000","last_became_active":"2024-01-17T22:58:55.902860+0000","last_became_peered":"2024-01-17T22:58:55.902860+0000","last_unstale":"2024-01-18T00:47:04.313232+0000","last_undegraded":"2024-01-18T00:47:04.313232+0000","last_fullsized":"2024-01-18T00:47:04.313232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:33:56.437178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":112144,"num_write":721,"num_write_kb":109826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'202","reported_seq":264,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.652277+0000","last_change":"2024-01-17T22:58:49.515108+0000","last_active":"2024-01-18T00:47:15.652277+0000","last_peered":"2024-01-18T00:47:15.652277+0000","last_clean":"2024-01-18T00:47:15.652277+0000","last_became_active":"2024-01-17T22:58:49.514297+0000","last_became_peered":"2024-01-17T22:58:49.514297+0000","last_unstale":"2024-01-18T00:47:15.652277+0000","last_undegraded":"2024-01-18T00:47:15.652277+0000","last_fullsized":"2024-01-18T00:47:15.652277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:15.814647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'1279","reported_seq":1342,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:11.369763+0000","last_change":"2024-01-17T22:58:48.331952+0000","last_active":"2024-01-18T00:45:11.369763+0000","last_peered":"2024-01-18T00:45:11.369763+0000","last_clean":"2024-01-18T00:45:11.369763+0000","last_became_active":"2024-01-17T22:58:48.331645+0000","last_became_peered":"2024-01-17T22:58:48.331645+0000","last_unstale":"2024-01-18T00:45:11.369763+0000","last_undegraded":"2024-01-18T00:45:11.369763+0000","last_fullsized":"2024-01-18T00:45:11.369763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1279,"log_dups_size":0,"ondisk_log_size":1279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:57:24.260824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":12872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'696","reported_seq":781,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.985592+0000","last_change":"2024-01-17T22:58:55.906062+0000","last_active":"2024-01-18T00:47:08.985592+0000","last_peered":"2024-01-18T00:47:08.985592+0000","last_clean":"2024-01-18T00:47:08.985592+0000","last_became_active":"2024-01-17T22:58:55.905743+0000","last_became_peered":"2024-01-17T22:58:55.905743+0000","last_unstale":"2024-01-18T00:47:08.985592+0000","last_undegraded":"2024-01-18T00:47:08.985592+0000","last_fullsized":"2024-01-18T00:47:08.985592+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:19:20.308367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":59282,"num_write":679,"num_write_kb":96928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'229","reported_seq":291,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.925040+0000","last_change":"2024-01-17T22:58:49.369540+0000","last_active":"2024-01-18T00:47:04.925040+0000","last_peered":"2024-01-18T00:47:04.925040+0000","last_clean":"2024-01-18T00:47:04.925040+0000","last_became_active":"2024-01-17T22:58:49.366692+0000","last_became_peered":"2024-01-17T22:58:49.366692+0000","last_unstale":"2024-01-18T00:47:04.925040+0000","last_undegraded":"2024-01-18T00:47:04.925040+0000","last_fullsized":"2024-01-18T00:47:04.925040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:39:54.814019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'170","reported_seq":233,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.968197+0000","last_change":"2024-01-17T22:58:48.345003+0000","last_active":"2024-01-18T00:46:53.968197+0000","last_peered":"2024-01-18T00:46:53.968197+0000","last_clean":"2024-01-18T00:46:53.968197+0000","last_became_active":"2024-01-17T22:58:48.344271+0000","last_became_peered":"2024-01-17T22:58:48.344271+0000","last_unstale":"2024-01-18T00:46:53.968197+0000","last_undegraded":"2024-01-18T00:46:53.968197+0000","last_fullsized":"2024-01-18T00:46:53.968197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:51:00.037407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'1514","reported_seq":1576,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.329841+0000","last_change":"2024-01-17T22:58:48.342292+0000","last_active":"2024-01-18T00:47:15.329841+0000","last_peered":"2024-01-18T00:47:15.329841+0000","last_clean":"2024-01-18T00:47:15.329841+0000","last_became_active":"2024-01-17T22:58:48.339364+0000","last_became_peered":"2024-01-17T22:58:48.339364+0000","last_unstale":"2024-01-18T00:47:15.329841+0000","last_undegraded":"2024-01-18T00:47:15.329841+0000","last_fullsized":"2024-01-18T00:47:15.329841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1514,"log_dups_size":0,"ondisk_log_size":1514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:51.848489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16419543,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1459,"num_write_kb":16764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'186","reported_seq":247,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.645647+0000","last_change":"2024-01-17T22:58:49.414836+0000","last_active":"2024-01-18T00:47:15.645647+0000","last_peered":"2024-01-18T00:47:15.645647+0000","last_clean":"2024-01-18T00:47:15.645647+0000","last_became_active":"2024-01-17T22:58:49.414163+0000","last_became_peered":"2024-01-17T22:58:49.414163+0000","last_unstale":"2024-01-18T00:47:15.645647+0000","last_undegraded":"2024-01-18T00:47:15.645647+0000","last_fullsized":"2024-01-18T00:47:15.645647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:24.988174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'765","reported_seq":855,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:44.182734+0000","last_change":"2024-01-17T22:58:55.880197+0000","last_active":"2024-01-18T00:46:44.182734+0000","last_peered":"2024-01-18T00:46:44.182734+0000","last_clean":"2024-01-18T00:46:44.182734+0000","last_became_active":"2024-01-17T22:58:55.879263+0000","last_became_peered":"2024-01-17T22:58:55.879263+0000","last_unstale":"2024-01-18T00:46:44.182734+0000","last_undegraded":"2024-01-18T00:46:44.182734+0000","last_fullsized":"2024-01-18T00:46:44.182734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:47:02.273099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":97351,"num_write":747,"num_write_kb":155607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'207","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:19.012190+0000","last_change":"2024-01-17T22:58:48.339419+0000","last_active":"2024-01-18T00:46:19.012190+0000","last_peered":"2024-01-18T00:46:19.012190+0000","last_clean":"2024-01-18T00:46:19.012190+0000","last_became_active":"2024-01-17T22:58:48.338809+0000","last_became_peered":"2024-01-17T22:58:48.338809+0000","last_unstale":"2024-01-18T00:46:19.012190+0000","last_undegraded":"2024-01-18T00:46:19.012190+0000","last_fullsized":"2024-01-18T00:46:19.012190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:20:07.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'206","reported_seq":266,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.760461+0000","last_change":"2024-01-17T22:58:49.518469+0000","last_active":"2024-01-18T00:47:15.760461+0000","last_peered":"2024-01-18T00:47:15.760461+0000","last_clean":"2024-01-18T00:47:15.760461+0000","last_became_active":"2024-01-17T22:58:49.518211+0000","last_became_peered":"2024-01-17T22:58:49.518211+0000","last_unstale":"2024-01-18T00:47:15.760461+0000","last_undegraded":"2024-01-18T00:47:15.760461+0000","last_fullsized":"2024-01-18T00:47:15.760461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:22.954968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'779","reported_seq":879,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:44.254665+0000","last_change":"2024-01-17T22:58:55.913601+0000","last_active":"2024-01-18T00:46:44.254665+0000","last_peered":"2024-01-18T00:46:44.254665+0000","last_clean":"2024-01-18T00:46:44.254665+0000","last_became_active":"2024-01-17T22:58:55.912825+0000","last_became_peered":"2024-01-17T22:58:55.912825+0000","last_unstale":"2024-01-18T00:46:44.254665+0000","last_undegraded":"2024-01-18T00:46:44.254665+0000","last_fullsized":"2024-01-18T00:46:44.254665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:36.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":138691,"num_write":762,"num_write_kb":151906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'221","reported_seq":290,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651529+0000","last_change":"2024-01-17T22:58:49.371282+0000","last_active":"2024-01-18T00:47:15.651529+0000","last_peered":"2024-01-18T00:47:15.651529+0000","last_clean":"2024-01-18T00:47:15.651529+0000","last_became_active":"2024-01-17T22:58:49.371125+0000","last_became_peered":"2024-01-17T22:58:49.371125+0000","last_unstale":"2024-01-18T00:47:15.651529+0000","last_undegraded":"2024-01-18T00:47:15.651529+0000","last_fullsized":"2024-01-18T00:47:15.651529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'215","reported_seq":285,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.682799+0000","last_change":"2024-01-17T22:58:49.510490+0000","last_active":"2024-01-18T00:47:15.682799+0000","last_peered":"2024-01-18T00:47:15.682799+0000","last_clean":"2024-01-18T00:47:15.682799+0000","last_became_active":"2024-01-17T22:58:49.509690+0000","last_became_peered":"2024-01-17T22:58:49.509690+0000","last_unstale":"2024-01-18T00:47:15.682799+0000","last_undegraded":"2024-01-18T00:47:15.682799+0000","last_fullsized":"2024-01-18T00:47:15.682799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'233","reported_seq":303,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.659973+0000","last_change":"2024-01-17T22:58:49.371326+0000","last_active":"2024-01-18T00:47:15.659973+0000","last_peered":"2024-01-18T00:47:15.659973+0000","last_clean":"2024-01-18T00:47:15.659973+0000","last_became_active":"2024-01-17T22:58:49.370511+0000","last_became_peered":"2024-01-17T22:58:49.370511+0000","last_unstale":"2024-01-18T00:47:15.659973+0000","last_undegraded":"2024-01-18T00:47:15.659973+0000","last_fullsized":"2024-01-18T00:47:15.659973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:46:55.959786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'202","reported_seq":271,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.827677+0000","last_change":"2024-01-17T22:58:49.385500+0000","last_active":"2024-01-18T00:46:53.827677+0000","last_peered":"2024-01-18T00:46:53.827677+0000","last_clean":"2024-01-18T00:46:53.827677+0000","last_became_active":"2024-01-17T22:58:49.384397+0000","last_became_peered":"2024-01-17T22:58:49.384397+0000","last_unstale":"2024-01-18T00:46:53.827677+0000","last_undegraded":"2024-01-18T00:46:53.827677+0000","last_fullsized":"2024-01-18T00:46:53.827677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:18.563360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'188","reported_seq":256,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.834261+0000","last_change":"2024-01-17T22:58:49.369750+0000","last_active":"2024-01-18T00:47:15.834261+0000","last_peered":"2024-01-18T00:47:15.834261+0000","last_clean":"2024-01-18T00:47:15.834261+0000","last_became_active":"2024-01-17T22:58:49.368591+0000","last_became_peered":"2024-01-17T22:58:49.368591+0000","last_unstale":"2024-01-18T00:47:15.834261+0000","last_undegraded":"2024-01-18T00:47:15.834261+0000","last_fullsized":"2024-01-18T00:47:15.834261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:59.773063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'203","reported_seq":271,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.827054+0000","last_change":"2024-01-17T22:58:49.380275+0000","last_active":"2024-01-18T00:47:15.827054+0000","last_peered":"2024-01-18T00:47:15.827054+0000","last_clean":"2024-01-18T00:47:15.827054+0000","last_became_active":"2024-01-17T22:58:49.379560+0000","last_became_peered":"2024-01-17T22:58:49.379560+0000","last_unstale":"2024-01-18T00:47:15.827054+0000","last_undegraded":"2024-01-18T00:47:15.827054+0000","last_fullsized":"2024-01-18T00:47:15.827054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:41.515981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'241","reported_seq":308,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651008+0000","last_change":"2024-01-17T22:58:49.368509+0000","last_active":"2024-01-18T00:47:15.651008+0000","last_peered":"2024-01-18T00:47:15.651008+0000","last_clean":"2024-01-18T00:47:15.651008+0000","last_became_active":"2024-01-17T22:58:49.367330+0000","last_became_peered":"2024-01-17T22:58:49.367330+0000","last_unstale":"2024-01-18T00:47:15.651008+0000","last_undegraded":"2024-01-18T00:47:15.651008+0000","last_fullsized":"2024-01-18T00:47:15.651008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'192","reported_seq":260,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.697801+0000","last_change":"2024-01-17T22:58:49.514419+0000","last_active":"2024-01-18T00:47:08.697801+0000","last_peered":"2024-01-18T00:47:08.697801+0000","last_clean":"2024-01-18T00:47:08.697801+0000","last_became_active":"2024-01-17T22:58:49.513924+0000","last_became_peered":"2024-01-17T22:58:49.513924+0000","last_unstale":"2024-01-18T00:47:08.697801+0000","last_undegraded":"2024-01-18T00:47:08.697801+0000","last_fullsized":"2024-01-18T00:47:08.697801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:24:43.594840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'222","reported_seq":289,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660244+0000","last_change":"2024-01-17T22:58:49.371064+0000","last_active":"2024-01-18T00:47:15.660244+0000","last_peered":"2024-01-18T00:47:15.660244+0000","last_clean":"2024-01-18T00:47:15.660244+0000","last_became_active":"2024-01-17T22:58:49.370808+0000","last_became_peered":"2024-01-17T22:58:49.370808+0000","last_unstale":"2024-01-18T00:47:15.660244+0000","last_undegraded":"2024-01-18T00:47:15.660244+0000","last_fullsized":"2024-01-18T00:47:15.660244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:39.502451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'195","reported_seq":261,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.757041+0000","last_change":"2024-01-17T22:58:49.350539+0000","last_active":"2024-01-18T00:46:53.757041+0000","last_peered":"2024-01-18T00:46:53.757041+0000","last_clean":"2024-01-18T00:46:53.757041+0000","last_became_active":"2024-01-17T22:58:49.350057+0000","last_became_peered":"2024-01-17T22:58:49.350057+0000","last_unstale":"2024-01-18T00:46:53.757041+0000","last_undegraded":"2024-01-18T00:46:53.757041+0000","last_fullsized":"2024-01-18T00:46:53.757041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:43.516572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'209","reported_seq":274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.697094+0000","last_change":"2024-01-17T22:58:49.517955+0000","last_active":"2024-01-18T00:47:15.697094+0000","last_peered":"2024-01-18T00:47:15.697094+0000","last_clean":"2024-01-18T00:47:15.697094+0000","last_became_active":"2024-01-17T22:58:49.517631+0000","last_became_peered":"2024-01-17T22:58:49.517631+0000","last_unstale":"2024-01-18T00:47:15.697094+0000","last_undegraded":"2024-01-18T00:47:15.697094+0000","last_fullsized":"2024-01-18T00:47:15.697094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:41:25.372897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'203","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.656287+0000","last_change":"2024-01-17T22:58:49.412901+0000","last_active":"2024-01-18T00:47:15.656287+0000","last_peered":"2024-01-18T00:47:15.656287+0000","last_clean":"2024-01-18T00:47:15.656287+0000","last_became_active":"2024-01-17T22:58:49.411772+0000","last_became_peered":"2024-01-17T22:58:49.411772+0000","last_unstale":"2024-01-18T00:47:15.656287+0000","last_undegraded":"2024-01-18T00:47:15.656287+0000","last_fullsized":"2024-01-18T00:47:15.656287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:30.366002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'220","reported_seq":278,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.681236+0000","last_change":"2024-01-17T22:59:08.750879+0000","last_active":"2024-01-18T00:47:15.681236+0000","last_peered":"2024-01-18T00:47:15.681236+0000","last_clean":"2024-01-18T00:47:15.681236+0000","last_became_active":"2024-01-17T22:59:08.750082+0000","last_became_peered":"2024-01-17T22:59:08.750082+0000","last_unstale":"2024-01-18T00:47:15.681236+0000","last_undegraded":"2024-01-18T00:47:15.681236+0000","last_fullsized":"2024-01-18T00:47:15.681236+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:49:12.522334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"28'209","reported_seq":274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660224+0000","last_change":"2024-01-17T22:58:49.415138+0000","last_active":"2024-01-18T00:47:15.660224+0000","last_peered":"2024-01-18T00:47:15.660224+0000","last_clean":"2024-01-18T00:47:15.660224+0000","last_became_active":"2024-01-17T22:58:49.414598+0000","last_became_peered":"2024-01-17T22:58:49.414598+0000","last_unstale":"2024-01-18T00:47:15.660224+0000","last_undegraded":"2024-01-18T00:47:15.660224+0000","last_fullsized":"2024-01-18T00:47:15.660224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:40.477976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'191","reported_seq":255,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.676927+0000","last_change":"2024-01-17T22:58:49.388702+0000","last_active":"2024-01-18T00:47:15.676927+0000","last_peered":"2024-01-18T00:47:15.676927+0000","last_clean":"2024-01-18T00:47:15.676927+0000","last_became_active":"2024-01-17T22:58:49.388096+0000","last_became_peered":"2024-01-17T22:58:49.388096+0000","last_unstale":"2024-01-18T00:47:15.676927+0000","last_undegraded":"2024-01-18T00:47:15.676927+0000","last_fullsized":"2024-01-18T00:47:15.676927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'199","reported_seq":263,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.656730+0000","last_change":"2024-01-17T22:58:49.370433+0000","last_active":"2024-01-18T00:47:15.656730+0000","last_peered":"2024-01-18T00:47:15.656730+0000","last_clean":"2024-01-18T00:47:15.656730+0000","last_became_active":"2024-01-17T22:58:49.369959+0000","last_became_peered":"2024-01-17T22:58:49.369959+0000","last_unstale":"2024-01-18T00:47:15.656730+0000","last_undegraded":"2024-01-18T00:47:15.656730+0000","last_fullsized":"2024-01-18T00:47:15.656730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:41:09.206436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'218","reported_seq":282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660310+0000","last_change":"2024-01-17T22:58:49.366356+0000","last_active":"2024-01-18T00:47:15.660310+0000","last_peered":"2024-01-18T00:47:15.660310+0000","last_clean":"2024-01-18T00:47:15.660310+0000","last_became_active":"2024-01-17T22:58:49.366122+0000","last_became_peered":"2024-01-17T22:58:49.366122+0000","last_unstale":"2024-01-18T00:47:15.660310+0000","last_undegraded":"2024-01-18T00:47:15.660310+0000","last_fullsized":"2024-01-18T00:47:15.660310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:33:50.123865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'207","reported_seq":271,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.757756+0000","last_change":"2024-01-17T22:58:49.349380+0000","last_active":"2024-01-18T00:46:53.757756+0000","last_peered":"2024-01-18T00:46:53.757756+0000","last_clean":"2024-01-18T00:46:53.757756+0000","last_became_active":"2024-01-17T22:58:49.348630+0000","last_became_peered":"2024-01-17T22:58:49.348630+0000","last_unstale":"2024-01-18T00:46:53.757756+0000","last_undegraded":"2024-01-18T00:46:53.757756+0000","last_fullsized":"2024-01-18T00:46:53.757756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:59:07.405202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'210","reported_seq":274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.831144+0000","last_change":"2024-01-17T22:58:49.383079+0000","last_active":"2024-01-18T00:47:15.831144+0000","last_peered":"2024-01-18T00:47:15.831144+0000","last_clean":"2024-01-18T00:47:15.831144+0000","last_became_active":"2024-01-17T22:58:49.382454+0000","last_became_peered":"2024-01-17T22:58:49.382454+0000","last_unstale":"2024-01-18T00:47:15.831144+0000","last_undegraded":"2024-01-18T00:47:15.831144+0000","last_fullsized":"2024-01-18T00:47:15.831144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:48.465209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'196","reported_seq":258,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.832951+0000","last_change":"2024-01-17T22:58:49.366078+0000","last_active":"2024-01-18T00:47:15.832951+0000","last_peered":"2024-01-18T00:47:15.832951+0000","last_clean":"2024-01-18T00:47:15.832951+0000","last_became_active":"2024-01-17T22:58:49.364509+0000","last_became_peered":"2024-01-17T22:58:49.364509+0000","last_unstale":"2024-01-18T00:47:15.832951+0000","last_undegraded":"2024-01-18T00:47:15.832951+0000","last_fullsized":"2024-01-18T00:47:15.832951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:44.036981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'164","reported_seq":226,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:09.454399+0000","last_change":"2024-01-17T22:58:49.518204+0000","last_active":"2024-01-18T00:46:09.454399+0000","last_peered":"2024-01-18T00:46:09.454399+0000","last_clean":"2024-01-18T00:46:09.454399+0000","last_became_active":"2024-01-17T22:58:49.517927+0000","last_became_peered":"2024-01-17T22:58:49.517927+0000","last_unstale":"2024-01-18T00:46:09.454399+0000","last_undegraded":"2024-01-18T00:46:09.454399+0000","last_fullsized":"2024-01-18T00:46:09.454399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:04:38.588573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'169","reported_seq":231,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.884153+0000","last_change":"2024-01-17T22:58:49.364080+0000","last_active":"2024-01-18T00:46:53.884153+0000","last_peered":"2024-01-18T00:46:53.884153+0000","last_clean":"2024-01-18T00:46:53.884153+0000","last_became_active":"2024-01-17T22:58:49.363804+0000","last_became_peered":"2024-01-17T22:58:49.363804+0000","last_unstale":"2024-01-18T00:46:53.884153+0000","last_undegraded":"2024-01-18T00:46:53.884153+0000","last_fullsized":"2024-01-18T00:46:53.884153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:59:07.405202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"28'200","reported_seq":262,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:39.696311+0000","last_change":"2024-01-17T22:58:49.352782+0000","last_active":"2024-01-18T00:46:39.696311+0000","last_peered":"2024-01-18T00:46:39.696311+0000","last_clean":"2024-01-18T00:46:39.696311+0000","last_became_active":"2024-01-17T22:58:49.352513+0000","last_became_peered":"2024-01-17T22:58:49.352513+0000","last_unstale":"2024-01-18T00:46:39.696311+0000","last_undegraded":"2024-01-18T00:46:39.696311+0000","last_fullsized":"2024-01-18T00:46:39.696311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:39:54.814019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'213","reported_seq":274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.759028+0000","last_change":"2024-01-17T22:58:49.519775+0000","last_active":"2024-01-18T00:47:15.759028+0000","last_peered":"2024-01-18T00:47:15.759028+0000","last_clean":"2024-01-18T00:47:15.759028+0000","last_became_active":"2024-01-17T22:58:49.518646+0000","last_became_peered":"2024-01-17T22:58:49.518646+0000","last_unstale":"2024-01-18T00:47:15.759028+0000","last_undegraded":"2024-01-18T00:47:15.759028+0000","last_fullsized":"2024-01-18T00:47:15.759028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'189","reported_seq":250,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:39.599658+0000","last_change":"2024-01-17T22:58:49.349737+0000","last_active":"2024-01-18T00:46:39.599658+0000","last_peered":"2024-01-18T00:46:39.599658+0000","last_clean":"2024-01-18T00:46:39.599658+0000","last_became_active":"2024-01-17T22:58:49.349021+0000","last_became_peered":"2024-01-17T22:58:49.349021+0000","last_unstale":"2024-01-18T00:46:39.599658+0000","last_undegraded":"2024-01-18T00:46:39.599658+0000","last_fullsized":"2024-01-18T00:46:39.599658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:42:24.949957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'197","reported_seq":258,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:43.876345+0000","last_change":"2024-01-17T22:58:49.415068+0000","last_active":"2024-01-18T00:46:43.876345+0000","last_peered":"2024-01-18T00:46:43.876345+0000","last_clean":"2024-01-18T00:46:43.876345+0000","last_became_active":"2024-01-17T22:58:49.414856+0000","last_became_peered":"2024-01-17T22:58:49.414856+0000","last_unstale":"2024-01-18T00:46:43.876345+0000","last_undegraded":"2024-01-18T00:46:43.876345+0000","last_fullsized":"2024-01-18T00:46:43.876345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:02:07.535209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'190","reported_seq":250,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.653814+0000","last_change":"2024-01-17T22:58:49.414783+0000","last_active":"2024-01-18T00:47:15.653814+0000","last_peered":"2024-01-18T00:47:15.653814+0000","last_clean":"2024-01-18T00:47:15.653814+0000","last_became_active":"2024-01-17T22:58:49.414446+0000","last_became_peered":"2024-01-17T22:58:49.414446+0000","last_unstale":"2024-01-18T00:47:15.653814+0000","last_undegraded":"2024-01-18T00:47:15.653814+0000","last_fullsized":"2024-01-18T00:47:15.653814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'204","reported_seq":265,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:59.142292+0000","last_change":"2024-01-17T22:58:49.357264+0000","last_active":"2024-01-18T00:46:59.142292+0000","last_peered":"2024-01-18T00:46:59.142292+0000","last_clean":"2024-01-18T00:46:59.142292+0000","last_became_active":"2024-01-17T22:58:49.357085+0000","last_became_peered":"2024-01-17T22:58:49.357085+0000","last_unstale":"2024-01-18T00:46:59.142292+0000","last_undegraded":"2024-01-18T00:46:59.142292+0000","last_fullsized":"2024-01-18T00:46:59.142292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:13:09.466879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'196","reported_seq":266,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.654962+0000","last_change":"2024-01-17T22:58:49.414726+0000","last_active":"2024-01-18T00:47:15.654962+0000","last_peered":"2024-01-18T00:47:15.654962+0000","last_clean":"2024-01-18T00:47:15.654962+0000","last_became_active":"2024-01-17T22:58:49.414490+0000","last_became_peered":"2024-01-17T22:58:49.414490+0000","last_unstale":"2024-01-18T00:47:15.654962+0000","last_undegraded":"2024-01-18T00:47:15.654962+0000","last_fullsized":"2024-01-18T00:47:15.654962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:31:48.465209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'189","reported_seq":259,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.975642+0000","last_change":"2024-01-17T22:58:49.413155+0000","last_active":"2024-01-18T00:47:08.975642+0000","last_peered":"2024-01-18T00:47:08.975642+0000","last_clean":"2024-01-18T00:47:08.975642+0000","last_became_active":"2024-01-17T22:58:49.412382+0000","last_became_peered":"2024-01-17T22:58:49.412382+0000","last_unstale":"2024-01-18T00:47:08.975642+0000","last_undegraded":"2024-01-18T00:47:08.975642+0000","last_fullsized":"2024-01-18T00:47:08.975642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:04:38.588573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'197","reported_seq":267,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:58.956101+0000","last_change":"2024-01-17T22:58:49.368686+0000","last_active":"2024-01-18T00:46:58.956101+0000","last_peered":"2024-01-18T00:46:58.956101+0000","last_clean":"2024-01-18T00:46:58.956101+0000","last_became_active":"2024-01-17T22:58:49.367979+0000","last_became_peered":"2024-01-17T22:58:49.367979+0000","last_unstale":"2024-01-18T00:46:58.956101+0000","last_undegraded":"2024-01-18T00:46:58.956101+0000","last_fullsized":"2024-01-18T00:46:58.956101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:02:12.309297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'191","reported_seq":261,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.049586+0000","last_change":"2024-01-17T22:58:49.364561+0000","last_active":"2024-01-18T00:47:09.049586+0000","last_peered":"2024-01-18T00:47:09.049586+0000","last_clean":"2024-01-18T00:47:09.049586+0000","last_became_active":"2024-01-17T22:58:49.363810+0000","last_became_peered":"2024-01-17T22:58:49.363810+0000","last_unstale":"2024-01-18T00:47:09.049586+0000","last_undegraded":"2024-01-18T00:47:09.049586+0000","last_fullsized":"2024-01-18T00:47:09.049586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:02:12.309297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1120,"num_read_kb":3534792,"num_write":24383,"num_write_kb":4330508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24895,"ondisk_log_size":24895,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12961,"ondisk_log_size":12961,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":198335705,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":1788,"num_read_kb":2847,"num_write":22487,"num_write_kb":206431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":181751808,"data_stored":396665421,"data_compressed":51062148,"data_compressed_allocated":68689920,"data_compressed_original":283754496,"omap_allocated":0,"internal_metadata":0},"log_size":21982,"ondisk_log_size":21982,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":62458,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510752,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124208,"kb_used_data":12584,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94247632,"statfs":{"total":96636764160,"available":96509575168,"internally_reserved":0,"allocated":12886016,"data_stored":31038270,"data_compressed":4325598,"data_compressed_allocated":5689344,"data_compressed_original":24039424,"omap_allocated":1590,"internal_metadata":114293194},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.89200000000000002,"15min":0.88600000000000001},"min":{"1min":0.54800000000000004,"5min":0.42899999999999999,"15min":0.35399999999999998},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.84699999999999998,"15min":0.85299999999999998},"min":{"1min":0.66900000000000004,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.306,"5min":1.3240000000000001,"15min":1.603},"last":0.91300000000000003}]},{"osd":1,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.92700000000000005,"15min":0.90600000000000003},"min":{"1min":0.626,"5min":0.46500000000000002,"15min":0.41499999999999998},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":0.625},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.90700000000000003,"15min":0.89300000000000002},"min":{"1min":0.68100000000000005,"5min":0.44600000000000001,"15min":0.28899999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.722},"last":0.78400000000000003}]},{"osd":2,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.58899999999999997,"5min":0.45400000000000001,"15min":0.441},"max":{"1min":1.1970000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.169,"5min":1.038,"15min":0.98099999999999998},"min":{"1min":0.86399999999999999,"5min":0.50600000000000001,"15min":0.45800000000000002},"max":{"1min":2.7370000000000001,"5min":2.7370000000000001,"15min":2.7370000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.89400000000000002,"15min":0.90300000000000002},"min":{"1min":0.60099999999999998,"5min":0.54000000000000004,"15min":0.48099999999999998},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.872},{"interface":"front","average":{"1min":1.123,"5min":1.0609999999999999,"15min":1.0449999999999999},"min":{"1min":0.80400000000000005,"5min":0.54700000000000004,"15min":0.5},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":0.83699999999999997}]},{"osd":4,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.999,"15min":1.018},"min":{"1min":0.59699999999999998,"5min":0.40100000000000002,"15min":0.32900000000000001},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.837},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0089999999999999,"15min":1.03},"min":{"1min":0.54700000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.0029999999999999}]},{"osd":5,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.171,"15min":1.159},"min":{"1min":0.54500000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":1.079},{"interface":"front","average":{"1min":1.179,"5min":1.141,"15min":1.1619999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.435},"max":{"1min":1.859,"5min":1.859,"15min":1.9159999999999999},"last":1.1639999999999999}]},{"osd":6,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.1839999999999999,"15min":1.196},"min":{"1min":0.54200000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.889,"5min":1.889,"15min":2.0209999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.1519999999999999,"15min":1.1679999999999999},"min":{"1min":0.86399999999999999,"5min":0.53000000000000003,"15min":0.50900000000000001},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.052}]}]},{"osd":6,"up_from":15,"seq":64424510751,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83092,"kb_used_data":15820,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94288748,"statfs":{"total":96636764160,"available":96551677952,"internally_reserved":0,"allocated":16199680,"data_stored":33676965,"data_compressed":4280237,"data_compressed_allocated":5771264,"data_compressed_original":23433216,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85999999999999999,"15min":0.84799999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.44},"max":{"1min":1.2849999999999999,"5min":1.5580000000000001,"15min":1.788},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.878,"15min":0.84899999999999998},"min":{"1min":0.52500000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.96099999999999997}]},{"osd":1,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.83699999999999997,"15min":0.82199999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.45800000000000002},"max":{"1min":1.167,"5min":1.478,"15min":1.8540000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.018,"5min":0.93200000000000005,"15min":0.89500000000000002},"min":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.42999999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.641},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.95199999999999996,"15min":0.94099999999999995},"min":{"1min":0.59799999999999998,"5min":0.54300000000000004,"15min":0.496},"max":{"1min":1.7030000000000001,"5min":1.766,"15min":1.766},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.96199999999999997,"15min":0.94399999999999995},"min":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.48499999999999999},"max":{"1min":1.4750000000000001,"5min":1.5629999999999999,"15min":2.1619999999999999},"last":0.71499999999999997}]},{"osd":3,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.012,"15min":0.98399999999999999},"min":{"1min":0.76400000000000001,"5min":0.622,"15min":0.53900000000000003},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.997,"15min":0.93899999999999995},"min":{"1min":0.67600000000000005,"5min":0.66900000000000004,"15min":0.52300000000000002},"max":{"1min":1.1870000000000001,"5min":1.633,"15min":1.98},"last":0.81100000000000005}]},{"osd":4,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.139,"15min":1.081},"min":{"1min":0.627,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":3.4969999999999999,"5min":3.4969999999999999,"15min":3.4969999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.179,"15min":1.1359999999999999},"min":{"1min":0.66000000000000003,"5min":0.52700000000000002,"15min":0.46000000000000002},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":1.054}]},{"osd":5,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.145,"15min":1.079},"min":{"1min":0.56699999999999995,"5min":0.49099999999999999,"15min":0.47499999999999998},"max":{"1min":3.8490000000000002,"5min":3.8490000000000002,"15min":3.8490000000000002},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2230000000000001,"15min":1.177},"min":{"1min":0.78300000000000003,"5min":0.60999999999999999,"15min":0.54200000000000004},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.284,"15min":1.2250000000000001},"min":{"1min":0.75700000000000001,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":4.2910000000000004,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.153,"5min":1.254,"15min":1.2},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.56799999999999995},"max":{"1min":1.534,"5min":2.0649999999999999,"15min":2.129},"last":1.105}]}]},{"osd":4,"up_from":15,"seq":64424510751,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121324,"kb_used_data":22180,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94250516,"statfs":{"total":96636764160,"available":96512528384,"internally_reserved":0,"allocated":22712320,"data_stored":50454822,"data_compressed":6935579,"data_compressed_allocated":9256960,"data_compressed_original":37212160,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86299999999999999,"15min":0.84499999999999997},"min":{"1min":0.52800000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.6879999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.83499999999999996,"15min":0.84199999999999997},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.42799999999999999},"max":{"1min":1.464,"5min":1.464,"15min":2.2410000000000001},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.90500000000000003,"15min":0.89000000000000001},"min":{"1min":0.63,"5min":0.47399999999999998,"15min":0.36199999999999999},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.89200000000000002,"15min":0.90700000000000003},"min":{"1min":0.499,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4179999999999999,"5min":2.097,"15min":2.097},"last":0.875}]},{"osd":2,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.88200000000000001,"15min":0.91200000000000003},"min":{"1min":0.68700000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.96499999999999997,"15min":0.95799999999999996},"min":{"1min":0.65000000000000002,"5min":0.55500000000000005,"15min":0.34300000000000003},"max":{"1min":1.4510000000000001,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.109}]},{"osd":3,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.90500000000000003,"15min":0.93200000000000005},"min":{"1min":0.54700000000000004,"5min":0.54000000000000004,"15min":0.41099999999999998},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":2.335},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.0800000000000001,"5min":0.98899999999999999,"15min":1.004},"min":{"1min":0.67300000000000004,"5min":0.60799999999999998,"15min":0.45300000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.044,"15min":1.0840000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.35999999999999999},"max":{"1min":1.518,"5min":2.403,"15min":2.9249999999999998},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.04,"15min":1.075},"min":{"1min":0.66700000000000004,"5min":0.55200000000000005,"15min":0.38200000000000001},"max":{"1min":1.7909999999999999,"5min":1.804,"15min":2.4289999999999998},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1020000000000001,"15min":1.1339999999999999},"min":{"1min":0.57699999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.1110000000000002,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.181,"15min":1.202},"min":{"1min":0.56499999999999995,"5min":0.45800000000000002,"15min":0.38100000000000001},"max":{"1min":1.7989999999999999,"5min":2.4740000000000002,"15min":3.101},"last":1.218}]},{"osd":7,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.1639999999999999,"15min":1.1830000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.841,"5min":4.25,"15min":4.25},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2110000000000001,"15min":1.2549999999999999},"min":{"1min":0.59199999999999997,"5min":0.503,"15min":0.40200000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.5110000000000001},"last":1.0720000000000001}]}]},{"osd":3,"up_from":15,"seq":64424510751,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160572,"kb_used_data":39220,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94211268,"statfs":{"total":96636764160,"available":96472338432,"internally_reserved":0,"allocated":40161280,"data_stored":87845266,"data_compressed":11483169,"data_compressed_allocated":15335424,"data_compressed_original":63209472,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44,"15min":0.42899999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.23000000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45800000000000002,"15min":0.46300000000000002},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.25600000000000001},"max":{"1min":0.58299999999999996,"5min":0.72799999999999998,"15min":0.753},"last":0.38}]},{"osd":1,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.29399999999999998,"5min":0.28100000000000003,"15min":0.27500000000000002},"max":{"1min":0.61499999999999999,"5min":0.751,"15min":0.78000000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.502,"15min":0.496},"min":{"1min":0.318,"5min":0.313,"15min":0.27300000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.314},"max":{"1min":0.66700000000000004,"5min":0.79700000000000004,"15min":0.84299999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.39000000000000001,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.68400000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.496}]},{"osd":4,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.42099999999999999},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78300000000000003,"15min":0.76500000000000001},"min":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.105,"5min":1.325,"15min":1.325},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.76800000000000002},"min":{"1min":0.54200000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.1160000000000001,"5min":1.1559999999999999,"15min":1.1970000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.754},"min":{"1min":0.52400000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0269999999999999,"5min":1.1539999999999999,"15min":1.2150000000000001},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82299999999999995,"15min":0.80900000000000005},"min":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.48899999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2150000000000001},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.80300000000000005,"15min":0.79900000000000004},"min":{"1min":0.51100000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.24,"5min":1.248,"15min":1.337},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.83399999999999996,"15min":0.82199999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.42099999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.69899999999999995}]}]},{"osd":2,"up_from":15,"seq":64424510751,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94904,"kb_used_data":13808,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94276936,"statfs":{"total":96636764160,"available":96539582464,"internally_reserved":0,"allocated":14139392,"data_stored":33676072,"data_compressed":4580308,"data_compressed_allocated":5976064,"data_compressed_original":25698304,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42099999999999999,"15min":0.432},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.24299999999999999},"max":{"1min":0.58599999999999997,"5min":0.65300000000000002,"15min":1.095},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26300000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":1.355},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.47599999999999998},"min":{"1min":0.36299999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64400000000000002,"5min":0.97699999999999998,"15min":1.026},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.503},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.308},"max":{"1min":0.67400000000000004,"5min":1.032,"15min":1.194},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.28599999999999998},"max":{"1min":0.754,"5min":0.77000000000000002,"15min":0.995},"last":0.437},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53800000000000003},"min":{"1min":0.36099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70499999999999996,"5min":0.90500000000000003,"15min":0.96999999999999997},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.75,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.46300000000000002,"15min":0.44700000000000001},"max":{"1min":1.014,"5min":1.155,"15min":1.502},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72299999999999998,"15min":0.752},"min":{"1min":0.46899999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.96899999999999997,"5min":1.0660000000000001,"15min":1.282},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.751,"15min":0.753},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":1.099,"15min":1.1479999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.79000000000000004},"min":{"1min":0.61299999999999999,"5min":0.48899999999999999,"15min":0.48099999999999998},"max":{"1min":1.0649999999999999,"5min":4.343,"15min":4.343},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.46600000000000003},"max":{"1min":0.95899999999999996,"5min":1.075,"15min":1.528},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79900000000000004,"15min":0.81200000000000006},"min":{"1min":0.52900000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1379999999999999,"5min":1.1599999999999999,"15min":3.9159999999999999},"last":0.81799999999999995}]},{"osd":7,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80400000000000005,"15min":0.80200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.499},"max":{"1min":1.1040000000000001,"5min":1.248,"15min":1.248},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.54500000000000004,"15min":0.51300000000000001},"max":{"1min":1.1160000000000001,"5min":3.9060000000000001,"15min":5.7370000000000001},"last":0.88}]}]},{"osd":1,"up_from":15,"seq":64424510751,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108440,"kb_used_data":19024,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94263400,"statfs":{"total":96636764160,"available":96525721600,"internally_reserved":0,"allocated":19480576,"data_stored":38460198,"data_compressed":4277353,"data_compressed_allocated":5976064,"data_compressed_original":25141248,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.46400000000000002,"15min":0.439},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.39000000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69899999999999995,"5min":0.70299999999999996,"15min":0.73099999999999998},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.47299999999999998,"15min":0.46000000000000002},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.27800000000000002},"max":{"1min":0.629,"5min":0.70399999999999996,"15min":0.73099999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51700000000000002,"15min":0.51000000000000001},"min":{"1min":0.42199999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71699999999999997,"5min":0.77400000000000002,"15min":0.85099999999999998},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.55000000000000004},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.36799999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.79900000000000004},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.71599999999999997},"min":{"1min":0.53500000000000003,"5min":0.442,"15min":0.38700000000000001},"max":{"1min":0.89600000000000002,"5min":1.0549999999999999,"15min":1.103},"last":22.641999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77200000000000002,"15min":0.78100000000000003},"min":{"1min":0.60299999999999998,"5min":0.47099999999999997,"15min":0.439},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.5700000000000001},"last":2.9409999999999998}]},{"osd":5,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76200000000000001,"15min":0.76000000000000001},"min":{"1min":0.53000000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1299999999999999,"5min":1.1439999999999999,"15min":2.8069999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79000000000000004,"15min":0.77600000000000002},"min":{"1min":0.58599999999999997,"5min":0.46400000000000002,"15min":0.45400000000000001},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.27},"last":2.5760000000000001}]},{"osd":6,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.79400000000000004},"min":{"1min":0.64600000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.0660000000000001,"5min":1.242,"15min":1.395},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.73699999999999999,"5min":0.5,"15min":0.46400000000000002},"max":{"1min":0.996,"5min":1.1279999999999999,"15min":1.1830000000000001},"last":5.7869999999999999}]},{"osd":7,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.85099999999999998,"15min":0.83699999999999997},"min":{"1min":0.76900000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":3.9009999999999998},"last":1.895},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.622,"5min":0.55700000000000005,"15min":0.50800000000000001},"max":{"1min":1.1379999999999999,"5min":1.2270000000000001,"15min":1.3999999999999999},"last":2.476}]}]},{"osd":0,"up_from":14,"seq":60129543454,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143116,"kb_used_data":31492,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94228724,"statfs":{"total":96636764160,"available":96490213376,"internally_reserved":0,"allocated":32247808,"data_stored":71061728,"data_compressed":8958305,"data_compressed_allocated":12132352,"data_compressed_original":51142656,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44500000000000001,"15min":0.42899999999999999},"min":{"1min":0.29199999999999998,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.64500000000000002,"5min":0.66600000000000004,"15min":0.68400000000000005},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47899999999999998,"15min":0.47199999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.26700000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.502,"15min":0.496},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.28199999999999997},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.84999999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.311,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67900000000000005,"5min":0.69599999999999995,"15min":0.80200000000000005},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.49399999999999999,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.308,"15min":0.30499999999999999},"max":{"1min":0.72499999999999998,"5min":0.73999999999999999,"15min":0.81799999999999995},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.377},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72199999999999998,"15min":0.73399999999999999},"min":{"1min":0.57899999999999996,"5min":0.46500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89500000000000002,"5min":1.3620000000000001,"15min":2.1779999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.745,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.505,"15min":0.44400000000000001},"max":{"1min":1.0149999999999999,"5min":1.159,"15min":1.159},"last":0.874}]},{"osd":5,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76900000000000002,"15min":0.76500000000000001},"min":{"1min":0.58799999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97199999999999998,"5min":1.423,"15min":1.423},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.59199999999999997,"5min":0.47599999999999998,"15min":0.42399999999999999},"max":{"1min":1.03,"5min":1.623,"15min":1.623},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.84699999999999998,"15min":0.82399999999999995},"min":{"1min":0.64300000000000002,"5min":0.52600000000000002,"15min":0.49099999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.84899999999999998,"15min":0.82699999999999996},"min":{"1min":0.57399999999999995,"5min":0.49099999999999999,"15min":0.46200000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.29},"last":1.034}]},{"osd":7,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.82299999999999995,"15min":0.81799999999999995},"min":{"1min":0.64400000000000002,"5min":0.48299999999999998,"15min":0.44400000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.86799999999999999,"15min":0.85799999999999998},"min":{"1min":0.64800000000000002,"5min":0.61099999999999999,"15min":0.47899999999999998},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.73999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834576160,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":129092,"kb_used_data":25788,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94242748,"statfs":{"total":96636764160,"available":96504573952,"internally_reserved":0,"allocated":26406912,"data_stored":52600308,"data_compressed":6284057,"data_compressed_allocated":8634368,"data_compressed_original":35024896,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.81999999999999995,"15min":0.86399999999999999},"min":{"1min":0.52800000000000002,"5min":0.40100000000000002,"15min":0.36699999999999999},"max":{"1min":1.2729999999999999,"5min":1.3560000000000001,"15min":1.5409999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84099999999999997,"15min":0.85899999999999999},"min":{"1min":0.498,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.173,"5min":1.2170000000000001,"15min":1.7569999999999999},"last":0.81299999999999994}]},{"osd":1,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.88100000000000001,"15min":0.90600000000000003},"min":{"1min":0.498,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2430000000000001,"5min":1.323,"15min":1.6299999999999999},"last":1.194},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89400000000000002,"15min":0.91500000000000004},"min":{"1min":0.48799999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.5049999999999999},"last":1.026}]},{"osd":2,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.84999999999999998,"15min":0.84799999999999998},"min":{"1min":0.55500000000000005,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.95999999999999996,"15min":0.98099999999999998},"min":{"1min":0.66700000000000004,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2430000000000001,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.3240000000000001}]},{"osd":3,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.98499999999999999,"15min":0.998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2849999999999999,"5min":1.613,"15min":2.1499999999999999},"last":1.117},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.94199999999999995,"15min":0.95699999999999996},"min":{"1min":0.63400000000000001,"5min":0.41099999999999998,"15min":0.40500000000000003},"max":{"1min":1.552,"5min":1.552,"15min":1.9430000000000001},"last":0.91600000000000004}]},{"osd":4,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.073,"15min":1.085},"min":{"1min":0.56399999999999995,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.5089999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.383},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.137,"15min":1.1319999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.607,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.409}]},{"osd":6,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.105,"15min":1.079},"min":{"1min":0.76000000000000001,"5min":0.55100000000000005,"15min":0.51800000000000002},"max":{"1min":1.659,"5min":1.659,"15min":1.8640000000000001},"last":1.357},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1699999999999999,"15min":1.1839999999999999},"min":{"1min":0.80500000000000005,"5min":0.69099999999999995,"15min":0.46999999999999997},"max":{"1min":1.5129999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":1.4890000000000001}]},{"osd":7,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.25,"15min":1.2350000000000001},"min":{"1min":0.66800000000000004,"5min":0.65900000000000003,"15min":0.57799999999999996},"max":{"1min":1.732,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.514},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.228,"15min":1.2170000000000001},"min":{"1min":0.73499999999999999,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.456}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31229,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31229,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31952896,"data_stored":70940794,"data_compressed":8958305,"data_compressed_allocated":12132352,"data_compressed_original":51142656,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19124224,"data_stored":37748896,"data_compressed":4246124,"data_compressed_allocated":5935104,"data_compressed_original":24567808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13844480,"data_stored":33555138,"data_compressed":4580308,"data_compressed_allocated":5976064,"data_compressed_original":25698304,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39866368,"data_stored":87724332,"data_compressed":11483169,"data_compressed_allocated":15335424,"data_compressed_original":63209472,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22417408,"data_stored":50333888,"data_compressed":6935579,"data_compressed_allocated":9256960,"data_compressed_original":37212160,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26050560,"data_stored":51889006,"data_compressed":6252828,"data_compressed_allocated":8593408,"data_compressed_original":34451456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15904768,"data_stored":33556031,"data_compressed":4280237,"data_compressed_allocated":5771264,"data_compressed_original":23433216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12591104,"data_stored":30917336,"data_compressed":4325598,"data_compressed_allocated":5689344,"data_compressed_original":24039424,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-18T00:47:17.995 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-18T00:47:18.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.171+0000 7ff572200640 1 Processor -- start 2024-01-18T00:47:18.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.171+0000 7ff572200640 1 -- start start 2024-01-18T00:47:18.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.171+0000 7ff572200640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff56c0caee0 0x7ff56c06bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:18.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.171+0000 7ff572200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff56c06c460 0x7ff56c153420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:18.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.171+0000 7ff572200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c0c9910 con 0x7ff56c0cb690 2024-01-18T00:47:18.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.171+0000 7ff572200640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c0b44d0 con 0x7ff56c0caee0 2024-01-18T00:47:18.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.171+0000 7ff572200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0c9ed0 con 0x7ff56c06c460 2024-01-18T00:47:18.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.171+0000 7ff56b400640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff56c0cb690 0x7ff56c0cba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55180/0 (socket says 172.21.15.161:55180) 2024-01-18T00:47:18.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.171+0000 7ff56b400640 1 -- 172.21.15.161:0/511820738 learned_addr learned my addr 172.21.15.161:0/511820738 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-18T00:47:18.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.171+0000 7ff56aa00640 1 --2- 172.21.15.161:0/511820738 >> v2:172.21.15.190:3300/0 conn(0x7ff56c0caee0 0x7ff56c06bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:18.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.171+0000 7ff56be00640 1 --2- 172.21.15.161:0/511820738 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff56c06c460 0x7ff56c153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:18.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.175+0000 7ff56a000640 1 -- 172.21.15.161:0/511820738 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844712194 0 0) 0x7ff56c0c9910 con 0x7ff56c0cb690 2024-01-18T00:47:18.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.175+0000 7ff56a000640 1 -- 172.21.15.161:0/511820738 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff54c003530 con 0x7ff56c0cb690 2024-01-18T00:47:18.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.179+0000 7ff56a000640 1 -- 172.21.15.161:0/511820738 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1697531904 0 0) 0x7ff54c003530 con 0x7ff56c0cb690 2024-01-18T00:47:18.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.179+0000 7ff56a000640 1 -- 172.21.15.161:0/511820738 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff56c06c460 msgr2=0x7ff56c153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:18.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.179+0000 7ff56a000640 1 --2- 172.21.15.161:0/511820738 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff56c06c460 0x7ff56c153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:18.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.179+0000 7ff56a000640 1 -- 172.21.15.161:0/511820738 >> v2:172.21.15.190:3300/0 conn(0x7ff56c0caee0 msgr2=0x7ff56c06bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:18.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.179+0000 7ff56a000640 1 --2- 172.21.15.161:0/511820738 >> v2:172.21.15.190:3300/0 conn(0x7ff56c0caee0 0x7ff56c06bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:18.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.179+0000 7ff56a000640 1 -- 172.21.15.161:0/511820738 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c06c8f0 con 0x7ff56c0cb690 2024-01-18T00:47:18.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.179+0000 7ff56a000640 1 -- 172.21.15.161:0/511820738 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7ff55c001680 con 0x7ff56c0cb690 2024-01-18T00:47:18.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.179+0000 7ff56a000640 1 -- 172.21.15.161:0/511820738 >> v1:172.21.15.161:6789/0 conn(0x7ff56c0cb690 legacy=0x7ff56c0cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:18.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.179+0000 7ff56a000640 1 --2- 172.21.15.161:0/511820738 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff56c06c460 0x7ff54c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:18.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.179+0000 7ff56a000640 1 --2- 172.21.15.161:0/511820738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff54c003f70 0x7ff54c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:18.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.179+0000 7ff56a000640 1 --2- 172.21.15.161:0/511820738 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff54c004d10 0x7ff54c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:18.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.179+0000 7ff56a000640 1 -- 172.21.15.161:0/511820738 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0b44d0 con 0x7ff54c004d10 2024-01-18T00:47:18.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.179+0000 7ff56a000640 1 -- 172.21.15.161:0/511820738 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0c9ed0 con 0x7ff54c003f70 2024-01-18T00:47:18.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.179+0000 7ff56a000640 1 -- 172.21.15.161:0/511820738 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c00ba40 con 0x7ff56c06c460 2024-01-18T00:47:18.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.179+0000 7ff56be00640 1 --2- 172.21.15.161:0/511820738 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff54c004d10 0x7ff54c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:18.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.183+0000 7ff56be00640 1 -- 172.21.15.161:0/511820738 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff56c06c460 msgr2=0x7ff54c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:18.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.183+0000 7ff56be00640 1 --2- 172.21.15.161:0/511820738 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff56c06c460 0x7ff54c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:18.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.183+0000 7ff56be00640 1 -- 172.21.15.161:0/511820738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff54c003f70 msgr2=0x7ff54c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:18.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.183+0000 7ff56be00640 1 --2- 172.21.15.161:0/511820738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff54c003f70 0x7ff54c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:18.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.183+0000 7ff56be00640 1 -- 172.21.15.161:0/511820738 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54c003530 con 0x7ff54c004d10 2024-01-18T00:47:18.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.187+0000 7ff56be00640 1 --2- 172.21.15.161:0/511820738 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff54c004d10 0x7ff54c005190 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff564009fc0 tx=0x7ff56401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980e260fb1939824 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:18.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.191+0000 7ff56a000640 1 -- 172.21.15.161:0/511820738 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5640a5cb0 con 0x7ff54c004d10 2024-01-18T00:47:18.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.191+0000 7ff56a000640 1 -- 172.21.15.161:0/511820738 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56400f040 con 0x7ff54c004d10 2024-01-18T00:47:18.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.191+0000 7ff56a000640 1 -- 172.21.15.161:0/511820738 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5640ad680 con 0x7ff54c004d10 2024-01-18T00:47:18.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.191+0000 7ff572200640 1 -- 172.21.15.161:0/511820738 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff54c004d10 msgr2=0x7ff54c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:18.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.191+0000 7ff572200640 1 --2- 172.21.15.161:0/511820738 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff54c004d10 0x7ff54c005190 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff564009fc0 tx=0x7ff56401cca0 comp rx=0 tx=0).stop 2024-01-18T00:47:18.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.191+0000 7ff56be00640 1 -- 172.21.15.161:0/511820738 reap_dead start 2024-01-18T00:47:18.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.191+0000 7ff572200640 1 -- 172.21.15.161:0/511820738 shutdown_connections 2024-01-18T00:47:18.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.191+0000 7ff572200640 1 -- 172.21.15.161:0/511820738 >> 172.21.15.161:0/511820738 conn(0x7ff56c08b6f0 msgr2=0x7ff56c061100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:18.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.191+0000 7ff572200640 1 -- 172.21.15.161:0/511820738 shutdown_connections 2024-01-18T00:47:18.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.191+0000 7ff572200640 1 -- 172.21.15.161:0/511820738 wait complete. 2024-01-18T00:47:18.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.195+0000 7ff572200640 1 Processor -- start 2024-01-18T00:47:18.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.195+0000 7ff572200640 1 -- start start 2024-01-18T00:47:18.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.195+0000 7ff572200640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff54c004d10 0x7ff56c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:18.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.195+0000 7ff572200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff56c14c300 0x7ff56c157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:18.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.195+0000 7ff572200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff56c1495b0 0x7ff56c149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:18.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.195+0000 7ff572200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c1e32c0 con 0x7ff56c1495b0 2024-01-18T00:47:18.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.195+0000 7ff572200640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c1e4940 con 0x7ff54c004d10 2024-01-18T00:47:18.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.195+0000 7ff572200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c157e90 con 0x7ff56c14c300 2024-01-18T00:47:18.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.195+0000 7ff56be00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff56c1495b0 0x7ff56c149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:18.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.195+0000 7ff56be00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff56c1495b0 0x7ff56c149a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43686/0 (socket says 172.21.15.161:43686) 2024-01-18T00:47:18.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.195+0000 7ff56be00640 1 -- 172.21.15.161:0/233984994 learned_addr learned my addr 172.21.15.161:0/233984994 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:18.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.195+0000 7ff56b400640 1 --2- 172.21.15.161:0/233984994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff54c004d10 0x7ff56c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:18.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.195+0000 7ff56aa00640 1 --2- 172.21.15.161:0/233984994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff56c14c300 0x7ff56c157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:18.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.199+0000 7ff56be00640 1 -- 172.21.15.161:0/233984994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff56c14c300 msgr2=0x7ff56c157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:18.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.199+0000 7ff56be00640 1 --2- 172.21.15.161:0/233984994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff56c14c300 0x7ff56c157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:18.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.199+0000 7ff56be00640 1 -- 172.21.15.161:0/233984994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff54c004d10 msgr2=0x7ff56c14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:18.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.199+0000 7ff56be00640 1 --2- 172.21.15.161:0/233984994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff54c004d10 0x7ff56c14ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:18.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.199+0000 7ff56be00640 1 -- 172.21.15.161:0/233984994 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c149f70 con 0x7ff56c1495b0 2024-01-18T00:47:18.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.203+0000 7ff56be00640 1 --2- 172.21.15.161:0/233984994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff56c1495b0 0x7ff56c149a30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff564002240 tx=0x7ff564009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:18.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.207+0000 7ff563400640 1 -- 172.21.15.161:0/233984994 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5640039a0 con 0x7ff56c1495b0 2024-01-18T00:47:18.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.207+0000 7ff563400640 1 -- 172.21.15.161:0/233984994 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff564003b00 con 0x7ff56c1495b0 2024-01-18T00:47:18.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.207+0000 7ff563400640 1 -- 172.21.15.161:0/233984994 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5640ad710 con 0x7ff56c1495b0 2024-01-18T00:47:18.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.207+0000 7ff572200640 1 -- 172.21.15.161:0/233984994 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56c1e3d30 con 0x7ff56c1495b0 2024-01-18T00:47:18.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.207+0000 7ff572200640 1 -- 172.21.15.161:0/233984994 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56c1e42f0 con 0x7ff56c1495b0 2024-01-18T00:47:18.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.211+0000 7ff572200640 1 -- 172.21.15.161:0/233984994 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56c067c90 con 0x7ff56c1495b0 2024-01-18T00:47:18.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.227+0000 7ff563400640 1 -- 172.21.15.161:0/233984994 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7ff5640b4040 con 0x7ff56c1495b0 2024-01-18T00:47:18.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.231+0000 7ff563400640 1 --2- 172.21.15.161:0/233984994 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7ff544066890 0x7ff544068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:18.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.231+0000 7ff56b400640 1 --2- 172.21.15.161:0/233984994 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7ff544066890 0x7ff544068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:18.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.231+0000 7ff56b400640 1 --2- 172.21.15.161:0/233984994 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7ff544066890 0x7ff544068d50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff55c004880 tx=0x7ff56c0b2540 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:18.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.459+0000 7ff563400640 1 -- 172.21.15.161:0/233984994 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7ff5640ef270 con 0x7ff56c1495b0 2024-01-18T00:47:18.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.459+0000 7ff563400640 1 -- 172.21.15.161:0/233984994 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7ff5640eb5b0 con 0x7ff56c1495b0 2024-01-18T00:47:18.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.615+0000 7ff572200640 1 -- 172.21.15.161:0/233984994 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff56c0746a0 con 0x7ff56c1495b0 2024-01-18T00:47:18.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.655+0000 7ff563400640 1 -- 172.21.15.161:0/233984994 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18587 (secure 0 0 0) 0x7ff5640b2070 con 0x7ff56c1495b0 2024-01-18T00:47:18.657 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-18T00:47:18.657 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":28,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:59:08.571619+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T22:58:46.757110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T22:58:47.930512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T22:58:53.561624+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.614036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.746767+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.689096+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.706485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.628004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.680048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.571249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]},{"pgid":"4.14","mappings":[{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-18T00:47:18.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.659+0000 7ff572200640 1 -- 172.21.15.161:0/233984994 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7ff544066890 msgr2=0x7ff544068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:18.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.659+0000 7ff572200640 1 --2- 172.21.15.161:0/233984994 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7ff544066890 0x7ff544068d50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff55c004880 tx=0x7ff56c0b2540 comp rx=0 tx=0).stop 2024-01-18T00:47:18.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.659+0000 7ff572200640 1 -- 172.21.15.161:0/233984994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff56c1495b0 msgr2=0x7ff56c149a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:18.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.659+0000 7ff572200640 1 --2- 172.21.15.161:0/233984994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff56c1495b0 0x7ff56c149a30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff564002240 tx=0x7ff564009750 comp rx=0 tx=0).stop 2024-01-18T00:47:18.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.659+0000 7ff572200640 1 -- 172.21.15.161:0/233984994 shutdown_connections 2024-01-18T00:47:18.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.659+0000 7ff572200640 1 --2- 172.21.15.161:0/233984994 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7ff544066890 0x7ff544068d50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:18.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.659+0000 7ff572200640 1 --2- 172.21.15.161:0/233984994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff56c1495b0 0x7ff56c149a30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:18.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.659+0000 7ff572200640 1 --2- 172.21.15.161:0/233984994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff56c14c300 0x7ff56c157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:18.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.659+0000 7ff572200640 1 --2- 172.21.15.161:0/233984994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff54c004d10 0x7ff56c14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:18.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.659+0000 7ff572200640 1 -- 172.21.15.161:0/233984994 >> 172.21.15.161:0/233984994 conn(0x7ff56c08b6f0 msgr2=0x7ff56c14f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:18.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.659+0000 7ff572200640 1 -- 172.21.15.161:0/233984994 shutdown_connections 2024-01-18T00:47:18.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:18.659+0000 7ff572200640 1 -- 172.21.15.161:0/233984994 wait complete. 2024-01-18T00:47:19.681 INFO:tasks.ceph:Scrubbing osd.0 2024-01-18T00:47:19.681 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-18T00:47:19.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.823+0000 7f2959000640 1 Processor -- start 2024-01-18T00:47:19.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.823+0000 7f2959000640 1 -- start start 2024-01-18T00:47:19.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.827+0000 7f2959000640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f29541518e0 0x7f29540c6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:19.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.827+0000 7f2959000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29540c66d0 0x7f29540cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:19.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.827+0000 7f2959000640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29541578c0 con 0x7f29540cb8d0 2024-01-18T00:47:19.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.827+0000 7f2959000640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29540c7770 con 0x7f29541518e0 2024-01-18T00:47:19.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.827+0000 7f2959000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2954157b80 con 0x7f29540c66d0 2024-01-18T00:47:19.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.859+0000 7f2951e00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f29541518e0 0x7f29540c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:19.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.859+0000 7f2951e00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f29541518e0 0x7f29540c6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:39474/0 (socket says 172.21.15.161:39474) 2024-01-18T00:47:19.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.859+0000 7f2951e00640 1 -- 172.21.15.161:0/3698255004 learned_addr learned my addr 172.21.15.161:0/3698255004 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:19.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.863+0000 7f2951e00640 1 -- 172.21.15.161:0/3698255004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29540c66d0 msgr2=0x7f29540cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:19.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.863+0000 7f2951e00640 1 --2- 172.21.15.161:0/3698255004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29540c66d0 0x7f29540cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:19.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.863+0000 7f2951e00640 1 -- 172.21.15.161:0/3698255004 >> v1:172.21.15.190:6789/0 conn(0x7f29540cb8d0 legacy=0x7f295406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:19.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.863+0000 7f2951e00640 1 -- 172.21.15.161:0/3698255004 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2954157e60 con 0x7f29541518e0 2024-01-18T00:47:19.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.875+0000 7f2951e00640 1 --2- 172.21.15.161:0/3698255004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29541518e0 0x7f29540c6190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2944009870 tx=0x7f294401c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2679c4c16f1dcc0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:19.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.879+0000 7f2950a00640 1 -- 172.21.15.161:0/3698255004 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29440aa5f0 con 0x7f29541518e0 2024-01-18T00:47:19.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.879+0000 7f2950a00640 1 -- 172.21.15.161:0/3698255004 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29440aa750 con 0x7f29541518e0 2024-01-18T00:47:19.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.879+0000 7f2950a00640 1 -- 172.21.15.161:0/3698255004 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29440aaae0 con 0x7f29541518e0 2024-01-18T00:47:19.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.879+0000 7f2959000640 1 -- 172.21.15.161:0/3698255004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29541518e0 msgr2=0x7f29540c6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:19.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.879+0000 7f2959000640 1 --2- 172.21.15.161:0/3698255004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29541518e0 0x7f29540c6190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2944009870 tx=0x7f294401c4d0 comp rx=0 tx=0).stop 2024-01-18T00:47:19.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.879+0000 7f2959000640 1 -- 172.21.15.161:0/3698255004 shutdown_connections 2024-01-18T00:47:19.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.879+0000 7f2959000640 1 --2- 172.21.15.161:0/3698255004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29540c66d0 0x7f29540cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:19.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.879+0000 7f2959000640 1 --2- 172.21.15.161:0/3698255004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29541518e0 0x7f29540c6190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:19.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.879+0000 7f2959000640 1 -- 172.21.15.161:0/3698255004 >> 172.21.15.161:0/3698255004 conn(0x7f295406aae0 msgr2=0x7f295406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:19.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.879+0000 7f2959000640 1 -- 172.21.15.161:0/3698255004 shutdown_connections 2024-01-18T00:47:19.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.879+0000 7f2959000640 1 -- 172.21.15.161:0/3698255004 wait complete. 2024-01-18T00:47:19.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.883+0000 7f2959000640 1 Processor -- start 2024-01-18T00:47:19.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.883+0000 7f2959000640 1 -- start start 2024-01-18T00:47:19.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.883+0000 7f2959000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29540c66d0 0x7f2954142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:19.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.883+0000 7f2959000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29540cb8d0 0x7f29540c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:19.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.883+0000 7f2959000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29541518e0 0x7f29540bffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:19.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.883+0000 7f2959000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29540ca150 con 0x7f29540c66d0 2024-01-18T00:47:19.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.883+0000 7f2959000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29540c1ad0 con 0x7f29541518e0 2024-01-18T00:47:19.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.883+0000 7f2959000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29540b0470 con 0x7f29540cb8d0 2024-01-18T00:47:19.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.883+0000 7f2951e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29540c66d0 0x7f2954142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:19.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.883+0000 7f2951e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29540c66d0 0x7f2954142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43698/0 (socket says 172.21.15.161:43698) 2024-01-18T00:47:19.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.883+0000 7f2951e00640 1 -- 172.21.15.161:0/3270046508 learned_addr learned my addr 172.21.15.161:0/3270046508 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:19.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.883+0000 7f2951400640 1 --2- 172.21.15.161:0/3270046508 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29540cb8d0 0x7f29540c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:19.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.883+0000 7f2952800640 1 --2- 172.21.15.161:0/3270046508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29541518e0 0x7f29540bffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:19.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.887+0000 7f2951e00640 1 -- 172.21.15.161:0/3270046508 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29540cb8d0 msgr2=0x7f29540c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:19.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.887+0000 7f2951e00640 1 --2- 172.21.15.161:0/3270046508 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29540cb8d0 0x7f29540c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:19.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.887+0000 7f2951e00640 1 -- 172.21.15.161:0/3270046508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29541518e0 msgr2=0x7f29540bffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:19.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.887+0000 7f2951e00640 1 --2- 172.21.15.161:0/3270046508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29541518e0 0x7f29540bffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:19.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.887+0000 7f2951e00640 1 -- 172.21.15.161:0/3270046508 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29440094d0 con 0x7f29540c66d0 2024-01-18T00:47:19.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.891+0000 7f2951e00640 1 --2- 172.21.15.161:0/3270046508 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29540c66d0 0x7f2954142490 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f29440ac040 tx=0x7f294401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:19.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.895+0000 7f294a000640 1 -- 172.21.15.161:0/3270046508 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29440b3800 con 0x7f29540c66d0 2024-01-18T00:47:19.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.895+0000 7f2959000640 1 -- 172.21.15.161:0/3270046508 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29540c9540 con 0x7f29540c66d0 2024-01-18T00:47:19.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.895+0000 7f2959000640 1 -- 172.21.15.161:0/3270046508 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29540b0190 con 0x7f29540c66d0 2024-01-18T00:47:19.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.895+0000 7f294a000640 1 -- 172.21.15.161:0/3270046508 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29440b3960 con 0x7f29540c66d0 2024-01-18T00:47:19.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.895+0000 7f294a000640 1 -- 172.21.15.161:0/3270046508 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29440b3cd0 con 0x7f29540c66d0 2024-01-18T00:47:19.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.895+0000 7f2959000640 1 -- 172.21.15.161:0/3270046508 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2954151cc0 con 0x7f29540c66d0 2024-01-18T00:47:19.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.915+0000 7f294a000640 1 -- 172.21.15.161:0/3270046508 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f29440bd3f0 con 0x7f29540c66d0 2024-01-18T00:47:19.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.915+0000 7f294a000640 1 --2- 172.21.15.161:0/3270046508 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f292c066840 0x7f292c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:19.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.915+0000 7f2951400640 1 --2- 172.21.15.161:0/3270046508 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f292c066840 0x7f292c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:19.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.915+0000 7f2951400640 1 --2- 172.21.15.161:0/3270046508 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f292c066840 0x7f292c068d00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f29540723c0 tx=0x7f293c009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:19.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.915+0000 7f294a000640 1 -- 172.21.15.161:0/3270046508 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f29440a7070 con 0x7f29540c66d0 2024-01-18T00:47:19.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.915+0000 7f294a000640 1 --2- 172.21.15.161:0/3270046508 >> [v2:172.21.15.161:6802/2733858976,v1:172.21.15.161:6803/2733858976] conn(0x7f292c06fea0 0x7f292c072340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:19.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.915+0000 7f294a000640 1 -- 172.21.15.161:0/3270046508 --> [v2:172.21.15.161:6802/2733858976,v1:172.21.15.161:6803/2733858976] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f292c072a10 con 0x7f292c06fea0 2024-01-18T00:47:19.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.915+0000 7f294a000640 1 -- 172.21.15.161:0/3270046508 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29440ebfd0 con 0x7f29540c66d0 2024-01-18T00:47:19.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.919+0000 7f2952800640 1 --2- 172.21.15.161:0/3270046508 >> [v2:172.21.15.161:6802/2733858976,v1:172.21.15.161:6803/2733858976] conn(0x7f292c06fea0 0x7f292c072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:19.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.919+0000 7f2952800640 1 --2- 172.21.15.161:0/3270046508 >> [v2:172.21.15.161:6802/2733858976,v1:172.21.15.161:6803/2733858976] conn(0x7f292c06fea0 0x7f292c072340 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:19.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.919+0000 7f294a000640 1 -- 172.21.15.161:0/3270046508 <== osd.0 v2:172.21.15.161:6802/2733858976 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f292c072a10 con 0x7f292c06fea0 2024-01-18T00:47:19.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.931+0000 7f2959000640 1 -- 172.21.15.161:0/3270046508 --> [v2:172.21.15.161:6802/2733858976,v1:172.21.15.161:6803/2733858976] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f29540c5c70 con 0x7f292c06fea0 2024-01-18T00:47:19.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.931+0000 7f294a000640 1 -- 172.21.15.161:0/3270046508 <== osd.0 v2:172.21.15.161:6802/2733858976 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f294c001af0 con 0x7f292c06fea0 2024-01-18T00:47:19.933 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-01-18T00:47:19.933 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-18T00:47:19.933 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-01-18T00:47:19.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.931+0000 7f2959000640 1 -- 172.21.15.161:0/3270046508 >> [v2:172.21.15.161:6802/2733858976,v1:172.21.15.161:6803/2733858976] conn(0x7f292c06fea0 msgr2=0x7f292c072340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:19.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.931+0000 7f2959000640 1 --2- 172.21.15.161:0/3270046508 >> [v2:172.21.15.161:6802/2733858976,v1:172.21.15.161:6803/2733858976] conn(0x7f292c06fea0 0x7f292c072340 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:19.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.931+0000 7f2959000640 1 -- 172.21.15.161:0/3270046508 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f292c066840 msgr2=0x7f292c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:19.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.931+0000 7f2959000640 1 --2- 172.21.15.161:0/3270046508 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f292c066840 0x7f292c068d00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f29540723c0 tx=0x7f293c009110 comp rx=0 tx=0).stop 2024-01-18T00:47:19.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.931+0000 7f2959000640 1 -- 172.21.15.161:0/3270046508 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29540c66d0 msgr2=0x7f2954142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:19.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.931+0000 7f2959000640 1 --2- 172.21.15.161:0/3270046508 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29540c66d0 0x7f2954142490 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f29440ac040 tx=0x7f294401ad10 comp rx=0 tx=0).stop 2024-01-18T00:47:19.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.931+0000 7f2952800640 1 -- 172.21.15.161:0/3270046508 reap_dead start 2024-01-18T00:47:19.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.935+0000 7f2959000640 1 -- 172.21.15.161:0/3270046508 shutdown_connections 2024-01-18T00:47:19.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.935+0000 7f2959000640 1 -- 172.21.15.161:0/3270046508 >> 172.21.15.161:0/3270046508 conn(0x7f295406aae0 msgr2=0x7f2954147c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:19.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.935+0000 7f2959000640 1 -- 172.21.15.161:0/3270046508 shutdown_connections 2024-01-18T00:47:19.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:19.935+0000 7f2959000640 1 -- 172.21.15.161:0/3270046508 wait complete. 2024-01-18T00:47:19.952 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-18T00:47:20.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.099+0000 7f411b000640 1 Processor -- start 2024-01-18T00:47:20.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.099+0000 7f411b000640 1 -- start start 2024-01-18T00:47:20.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.099+0000 7f411b000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f41140c79c0 0x7f4114061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.099+0000 7f411b000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41140c9890 con 0x7f41141539a0 2024-01-18T00:47:20.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.099+0000 7f411b000640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4114159bf0 con 0x7f4114061640 2024-01-18T00:47:20.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.099+0000 7f411b000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411406d570 con 0x7f41140c79c0 2024-01-18T00:47:20.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.103+0000 7f4113400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f41140c79c0 0x7f4114061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.103+0000 7f4113400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f41140c79c0 0x7f4114061100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43706/0 (socket says 172.21.15.161:43706) 2024-01-18T00:47:20.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.103+0000 7f4113400640 1 -- 172.21.15.161:0/1817732782 learned_addr learned my addr 172.21.15.161:0/1817732782 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:20.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.103+0000 7f4113400640 1 -- 172.21.15.161:0/1817732782 >> v1:172.21.15.190:6789/0 conn(0x7f4114061640 legacy=0x7f411415d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:20.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.103+0000 7f4113400640 1 -- 172.21.15.161:0/1817732782 >> v1:172.21.15.161:6789/0 conn(0x7f41141539a0 legacy=0x7f41140ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:20.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.103+0000 7f4113400640 1 -- 172.21.15.161:0/1817732782 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4114159eb0 con 0x7f41140c79c0 2024-01-18T00:47:20.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.107+0000 7f4113400640 1 --2- 172.21.15.161:0/1817732782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41140c79c0 0x7f4114061100 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4114159de0 tx=0x7f40fc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975a6098ff909e05 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:20.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.111+0000 7f4112a00640 1 -- 172.21.15.161:0/1817732782 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc0ab610 con 0x7f41140c79c0 2024-01-18T00:47:20.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.111+0000 7f4112a00640 1 -- 172.21.15.161:0/1817732782 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40fc0ab770 con 0x7f41140c79c0 2024-01-18T00:47:20.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.111+0000 7f4112a00640 1 -- 172.21.15.161:0/1817732782 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc0abb00 con 0x7f41140c79c0 2024-01-18T00:47:20.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.115+0000 7f411b000640 1 -- 172.21.15.161:0/1817732782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41140c79c0 msgr2=0x7f4114061100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:20.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.115+0000 7f411b000640 1 --2- 172.21.15.161:0/1817732782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41140c79c0 0x7f4114061100 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4114159de0 tx=0x7f40fc01c410 comp rx=0 tx=0).stop 2024-01-18T00:47:20.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.115+0000 7f411b000640 1 -- 172.21.15.161:0/1817732782 shutdown_connections 2024-01-18T00:47:20.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.115+0000 7f411b000640 1 --2- 172.21.15.161:0/1817732782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41140c79c0 0x7f4114061100 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.115+0000 7f411b000640 1 -- 172.21.15.161:0/1817732782 >> 172.21.15.161:0/1817732782 conn(0x7f411406ad40 msgr2=0x7f411406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:20.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.115+0000 7f411b000640 1 -- 172.21.15.161:0/1817732782 shutdown_connections 2024-01-18T00:47:20.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.115+0000 7f411b000640 1 -- 172.21.15.161:0/1817732782 wait complete. 2024-01-18T00:47:20.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.115+0000 7f411b000640 1 Processor -- start 2024-01-18T00:47:20.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.115+0000 7f411b000640 1 -- start start 2024-01-18T00:47:20.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.115+0000 7f411b000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4114061640 0x7f4114151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.115+0000 7f411b000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41140c79c0 0x7f411406bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.115+0000 7f411b000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41141539a0 0x7f41141f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.115+0000 7f411b000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4114153350 con 0x7f41140c79c0 2024-01-18T00:47:20.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.115+0000 7f411b000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4114154350 con 0x7f41141539a0 2024-01-18T00:47:20.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.115+0000 7f411b000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4114151980 con 0x7f4114061640 2024-01-18T00:47:20.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.119+0000 7f4113400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41140c79c0 0x7f411406bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.119+0000 7f4113400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41140c79c0 0x7f411406bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43722/0 (socket says 172.21.15.161:43722) 2024-01-18T00:47:20.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.119+0000 7f4113400640 1 -- 172.21.15.161:0/2387412601 learned_addr learned my addr 172.21.15.161:0/2387412601 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:20.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.119+0000 7f4119000640 1 --2- 172.21.15.161:0/2387412601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41141539a0 0x7f41141f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.123+0000 7f4113400640 1 -- 172.21.15.161:0/2387412601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4114061640 msgr2=0x7f4114151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:20.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.123+0000 7f4113400640 1 --2- 172.21.15.161:0/2387412601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4114061640 0x7f4114151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.123+0000 7f4113400640 1 -- 172.21.15.161:0/2387412601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41141539a0 msgr2=0x7f41141f38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:20.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.123+0000 7f4113400640 1 --2- 172.21.15.161:0/2387412601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41141539a0 0x7f41141f38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.123+0000 7f4113400640 1 -- 172.21.15.161:0/2387412601 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc0094d0 con 0x7f41140c79c0 2024-01-18T00:47:20.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.127+0000 7f4113400640 1 --2- 172.21.15.161:0/2387412601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41140c79c0 0x7f411406bac0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f40fc01a040 tx=0x7f40fc01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:20.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.131+0000 7f410be00640 1 -- 172.21.15.161:0/2387412601 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc0b4800 con 0x7f41140c79c0 2024-01-18T00:47:20.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.131+0000 7f410be00640 1 -- 172.21.15.161:0/2387412601 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40fc0b4980 con 0x7f41140c79c0 2024-01-18T00:47:20.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.131+0000 7f410be00640 1 -- 172.21.15.161:0/2387412601 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc0b4d30 con 0x7f41140c79c0 2024-01-18T00:47:20.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.131+0000 7f411b000640 1 -- 172.21.15.161:0/2387412601 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41141599c0 con 0x7f41140c79c0 2024-01-18T00:47:20.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.131+0000 7f411b000640 1 -- 172.21.15.161:0/2387412601 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41141f3450 con 0x7f41140c79c0 2024-01-18T00:47:20.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.131+0000 7f411b000640 1 -- 172.21.15.161:0/2387412601 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411406b620 con 0x7f41140c79c0 2024-01-18T00:47:20.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.151+0000 7f410be00640 1 -- 172.21.15.161:0/2387412601 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f40fc0c8420 con 0x7f41140c79c0 2024-01-18T00:47:20.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.151+0000 7f410be00640 1 --2- 172.21.15.161:0/2387412601 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f40ec066890 0x7f40ec068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.151+0000 7f4113e00640 1 --2- 172.21.15.161:0/2387412601 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f40ec066890 0x7f40ec068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.155+0000 7f4113e00640 1 --2- 172.21.15.161:0/2387412601 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f40ec066890 0x7f40ec068d50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4104009650 tx=0x7f4104006bb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:20.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.155+0000 7f410be00640 1 -- 172.21.15.161:0/2387412601 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f40fc0f0250 con 0x7f41140c79c0 2024-01-18T00:47:20.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.383+0000 7f410be00640 1 -- 172.21.15.161:0/2387412601 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f40fc0ebe90 con 0x7f41140c79c0 2024-01-18T00:47:20.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.551+0000 7f411b000640 1 -- 172.21.15.161:0/2387412601 --> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f411415a750 con 0x7f40ec066890 2024-01-18T00:47:20.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.551+0000 7f410be00640 1 -- 172.21.15.161:0/2387412601 <== mgr.4110 v2:172.21.15.161:6800/272458188 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4104009280 con 0x7f40ec066890 2024-01-18T00:47:20.550 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 0 to deep-scrub 2024-01-18T00:47:20.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.551+0000 7f411b000640 1 -- 172.21.15.161:0/2387412601 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f40ec066890 msgr2=0x7f40ec068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:20.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.551+0000 7f411b000640 1 --2- 172.21.15.161:0/2387412601 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f40ec066890 0x7f40ec068d50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4104009650 tx=0x7f4104006bb0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.551+0000 7f411b000640 1 -- 172.21.15.161:0/2387412601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41140c79c0 msgr2=0x7f411406bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:20.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.551+0000 7f411b000640 1 --2- 172.21.15.161:0/2387412601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41140c79c0 0x7f411406bac0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f40fc01a040 tx=0x7f40fc01ac50 comp rx=0 tx=0).stop 2024-01-18T00:47:20.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.551+0000 7f411b000640 1 -- 172.21.15.161:0/2387412601 shutdown_connections 2024-01-18T00:47:20.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.551+0000 7f411b000640 1 --2- 172.21.15.161:0/2387412601 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f40ec066890 0x7f40ec068d50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.551+0000 7f411b000640 1 --2- 172.21.15.161:0/2387412601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41141539a0 0x7f41141f38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.551+0000 7f411b000640 1 --2- 172.21.15.161:0/2387412601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41140c79c0 0x7f411406bac0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.551+0000 7f411b000640 1 --2- 172.21.15.161:0/2387412601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4114061640 0x7f4114151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.551+0000 7f411b000640 1 -- 172.21.15.161:0/2387412601 >> 172.21.15.161:0/2387412601 conn(0x7f411406ad40 msgr2=0x7f41140b1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:20.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.551+0000 7f411b000640 1 -- 172.21.15.161:0/2387412601 shutdown_connections 2024-01-18T00:47:20.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.551+0000 7f411b000640 1 -- 172.21.15.161:0/2387412601 wait complete. 2024-01-18T00:47:20.574 INFO:tasks.ceph:Scrubbing osd.1 2024-01-18T00:47:20.574 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-18T00:47:20.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.715+0000 7f0f7cc00640 1 Processor -- start 2024-01-18T00:47:20.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.715+0000 7f0f7cc00640 1 -- start start 2024-01-18T00:47:20.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.715+0000 7f0f7cc00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f78153a00 0x7f0f781596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.715+0000 7f0f7cc00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0f7806e280 0x7f0f780c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.715+0000 7f0f7cc00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0f7806af10 0x7f0f780cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.715+0000 7f0f7cc00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7806ebd0 con 0x7f0f7806af10 2024-01-18T00:47:20.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.715+0000 7f0f7cc00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f780c8e80 con 0x7f0f7806e280 2024-01-18T00:47:20.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.715+0000 7f0f7cc00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f78159cd0 con 0x7f0f78153a00 2024-01-18T00:47:20.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.715+0000 7f0f76800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0f7806af10 0x7f0f780cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.715+0000 7f0f76800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0f7806af10 0x7f0f780cbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43726/0 (socket says 172.21.15.161:43726) 2024-01-18T00:47:20.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.715+0000 7f0f76800640 1 -- 172.21.15.161:0/1165190820 learned_addr learned my addr 172.21.15.161:0/1165190820 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:20.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.719+0000 7f0f75e00640 1 --2- 172.21.15.161:0/1165190820 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f78153a00 0x7f0f781596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.719+0000 7f0f75400640 1 --2- 172.21.15.161:0/1165190820 >> v2:172.21.15.190:3300/0 conn(0x7f0f7806e280 0x7f0f780c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.719+0000 7f0f76800640 1 -- 172.21.15.161:0/1165190820 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f78153a00 msgr2=0x7f0f781596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:20.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.719+0000 7f0f76800640 1 --2- 172.21.15.161:0/1165190820 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f78153a00 0x7f0f781596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.719+0000 7f0f76800640 1 -- 172.21.15.161:0/1165190820 >> v2:172.21.15.190:3300/0 conn(0x7f0f7806e280 msgr2=0x7f0f780c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:20.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.719+0000 7f0f76800640 1 --2- 172.21.15.161:0/1165190820 >> v2:172.21.15.190:3300/0 conn(0x7f0f7806e280 0x7f0f780c9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.719+0000 7f0f76800640 1 -- 172.21.15.161:0/1165190820 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f78153de0 con 0x7f0f7806af10 2024-01-18T00:47:20.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.723+0000 7f0f76800640 1 --2- 172.21.15.161:0/1165190820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f7806af10 0x7f0f780cbfe0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0f78071b50 tx=0x7f0f7001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a0e418933b258e server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:20.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.727+0000 7f0f74a00640 1 -- 172.21.15.161:0/1165190820 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f700a56a0 con 0x7f0f7806af10 2024-01-18T00:47:20.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.727+0000 7f0f74a00640 1 -- 172.21.15.161:0/1165190820 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f700a5800 con 0x7f0f7806af10 2024-01-18T00:47:20.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.727+0000 7f0f74a00640 1 -- 172.21.15.161:0/1165190820 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f700a5b90 con 0x7f0f7806af10 2024-01-18T00:47:20.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.727+0000 7f0f7cc00640 1 -- 172.21.15.161:0/1165190820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f7806af10 msgr2=0x7f0f780cbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:20.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.727+0000 7f0f7cc00640 1 --2- 172.21.15.161:0/1165190820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f7806af10 0x7f0f780cbfe0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0f78071b50 tx=0x7f0f7001c910 comp rx=0 tx=0).stop 2024-01-18T00:47:20.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.727+0000 7f0f7cc00640 1 -- 172.21.15.161:0/1165190820 shutdown_connections 2024-01-18T00:47:20.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.727+0000 7f0f7cc00640 1 --2- 172.21.15.161:0/1165190820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f7806af10 0x7f0f780cbfe0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.727+0000 7f0f7cc00640 1 --2- 172.21.15.161:0/1165190820 >> v2:172.21.15.190:3300/0 conn(0x7f0f7806e280 0x7f0f780c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.727+0000 7f0f7cc00640 1 --2- 172.21.15.161:0/1165190820 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f78153a00 0x7f0f781596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.727+0000 7f0f7cc00640 1 -- 172.21.15.161:0/1165190820 >> 172.21.15.161:0/1165190820 conn(0x7f0f7806b7f0 msgr2=0x7f0f7806bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:20.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.727+0000 7f0f7cc00640 1 -- 172.21.15.161:0/1165190820 shutdown_connections 2024-01-18T00:47:20.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.727+0000 7f0f7cc00640 1 -- 172.21.15.161:0/1165190820 wait complete. 2024-01-18T00:47:20.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.731+0000 7f0f7cc00640 1 Processor -- start 2024-01-18T00:47:20.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.731+0000 7f0f7cc00640 1 -- start start 2024-01-18T00:47:20.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.731+0000 7f0f7cc00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f7806af10 0x7f0f781596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.731+0000 7f0f7cc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f7806e280 0x7f0f780c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.731+0000 7f0f7cc00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f78153a00 0x7f0f780c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.731+0000 7f0f7cc00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7814eff0 con 0x7f0f7806e280 2024-01-18T00:47:20.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.731+0000 7f0f7cc00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f780c5670 con 0x7f0f78153a00 2024-01-18T00:47:20.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.731+0000 7f0f7cc00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7814e6e0 con 0x7f0f7806af10 2024-01-18T00:47:20.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.731+0000 7f0f75400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f7806e280 0x7f0f780c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.731+0000 7f0f75400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f7806e280 0x7f0f780c5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43738/0 (socket says 172.21.15.161:43738) 2024-01-18T00:47:20.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.731+0000 7f0f75400640 1 -- 172.21.15.161:0/1824186760 learned_addr learned my addr 172.21.15.161:0/1824186760 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:20.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.735+0000 7f0f76800640 1 --2- 172.21.15.161:0/1824186760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f78153a00 0x7f0f780c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.735+0000 7f0f75e00640 1 --2- 172.21.15.161:0/1824186760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f7806af10 0x7f0f781596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.735+0000 7f0f75400640 1 -- 172.21.15.161:0/1824186760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f7806af10 msgr2=0x7f0f781596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:20.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.735+0000 7f0f75400640 1 --2- 172.21.15.161:0/1824186760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f7806af10 0x7f0f781596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.735+0000 7f0f75400640 1 -- 172.21.15.161:0/1824186760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f78153a00 msgr2=0x7f0f780c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:20.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.735+0000 7f0f75400640 1 --2- 172.21.15.161:0/1824186760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f78153a00 0x7f0f780c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.735+0000 7f0f75400640 1 -- 172.21.15.161:0/1824186760 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f70009b30 con 0x7f0f7806e280 2024-01-18T00:47:20.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.739+0000 7f0f75400640 1 --2- 172.21.15.161:0/1824186760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f7806e280 0x7f0f780c5930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000c820 tx=0x7f0f6000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:20.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.743+0000 7f0f6e000640 1 -- 172.21.15.161:0/1824186760 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f600079d0 con 0x7f0f7806e280 2024-01-18T00:47:20.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.743+0000 7f0f6e000640 1 -- 172.21.15.161:0/1824186760 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f60007b30 con 0x7f0f7806e280 2024-01-18T00:47:20.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.743+0000 7f0f6e000640 1 -- 172.21.15.161:0/1824186760 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6000ce10 con 0x7f0f7806e280 2024-01-18T00:47:20.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.743+0000 7f0f7cc00640 1 -- 172.21.15.161:0/1824186760 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f780c5f90 con 0x7f0f7806e280 2024-01-18T00:47:20.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.743+0000 7f0f7cc00640 1 -- 172.21.15.161:0/1824186760 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7814e930 con 0x7f0f7806e280 2024-01-18T00:47:20.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.743+0000 7f0f7cc00640 1 -- 172.21.15.161:0/1824186760 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f780c6a80 con 0x7f0f7806e280 2024-01-18T00:47:20.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.763+0000 7f0f6e000640 1 -- 172.21.15.161:0/1824186760 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f0f600113f0 con 0x7f0f7806e280 2024-01-18T00:47:20.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.763+0000 7f0f6e000640 1 --2- 172.21.15.161:0/1824186760 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0f500668c0 0x7f0f50068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.763+0000 7f0f75e00640 1 --2- 172.21.15.161:0/1824186760 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0f500668c0 0x7f0f50068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.767+0000 7f0f75e00640 1 --2- 172.21.15.161:0/1824186760 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0f500668c0 0x7f0f50068d80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0f68006fd0 tx=0x7f0f68008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:20.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.767+0000 7f0f6e000640 1 -- 172.21.15.161:0/1824186760 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f0f60025e50 con 0x7f0f7806e280 2024-01-18T00:47:20.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.767+0000 7f0f6e000640 1 --2- 172.21.15.161:0/1824186760 >> [v2:172.21.15.161:6826/1566364308,v1:172.21.15.161:6827/1566364308] conn(0x7f0f5006ffa0 0x7f0f50072440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.767+0000 7f0f6e000640 1 -- 172.21.15.161:0/1824186760 --> [v2:172.21.15.161:6826/1566364308,v1:172.21.15.161:6827/1566364308] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f50072b10 con 0x7f0f5006ffa0 2024-01-18T00:47:20.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.767+0000 7f0f76800640 1 --2- 172.21.15.161:0/1824186760 >> [v2:172.21.15.161:6826/1566364308,v1:172.21.15.161:6827/1566364308] conn(0x7f0f5006ffa0 0x7f0f50072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.767+0000 7f0f6e000640 1 -- 172.21.15.161:0/1824186760 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f6000a3c0 con 0x7f0f7806e280 2024-01-18T00:47:20.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.767+0000 7f0f76800640 1 --2- 172.21.15.161:0/1824186760 >> [v2:172.21.15.161:6826/1566364308,v1:172.21.15.161:6827/1566364308] conn(0x7f0f5006ffa0 0x7f0f50072440 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:20.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.767+0000 7f0f6e000640 1 -- 172.21.15.161:0/1824186760 <== osd.1 v2:172.21.15.161:6826/1566364308 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0f50072b10 con 0x7f0f5006ffa0 2024-01-18T00:47:20.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.779+0000 7f0f7cc00640 1 -- 172.21.15.161:0/1824186760 --> [v2:172.21.15.161:6826/1566364308,v1:172.21.15.161:6827/1566364308] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0f7806c7e0 con 0x7f0f5006ffa0 2024-01-18T00:47:20.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.779+0000 7f0f6e000640 1 -- 172.21.15.161:0/1824186760 <== osd.1 v2:172.21.15.161:6826/1566364308 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0f7806c7e0 con 0x7f0f5006ffa0 2024-01-18T00:47:20.782 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-01-18T00:47:20.782 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-18T00:47:20.782 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-01-18T00:47:20.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.783+0000 7f0f7cc00640 1 -- 172.21.15.161:0/1824186760 >> [v2:172.21.15.161:6826/1566364308,v1:172.21.15.161:6827/1566364308] conn(0x7f0f5006ffa0 msgr2=0x7f0f50072440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:20.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.783+0000 7f0f7cc00640 1 --2- 172.21.15.161:0/1824186760 >> [v2:172.21.15.161:6826/1566364308,v1:172.21.15.161:6827/1566364308] conn(0x7f0f5006ffa0 0x7f0f50072440 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.783+0000 7f0f7cc00640 1 -- 172.21.15.161:0/1824186760 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0f500668c0 msgr2=0x7f0f50068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:20.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.783+0000 7f0f7cc00640 1 --2- 172.21.15.161:0/1824186760 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0f500668c0 0x7f0f50068d80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0f68006fd0 tx=0x7f0f68008040 comp rx=0 tx=0).stop 2024-01-18T00:47:20.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.783+0000 7f0f7cc00640 1 -- 172.21.15.161:0/1824186760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f7806e280 msgr2=0x7f0f780c5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:20.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.783+0000 7f0f7cc00640 1 --2- 172.21.15.161:0/1824186760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f7806e280 0x7f0f780c5930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000c820 tx=0x7f0f6000cce0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.783+0000 7f0f76800640 1 -- 172.21.15.161:0/1824186760 reap_dead start 2024-01-18T00:47:20.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.783+0000 7f0f7cc00640 1 -- 172.21.15.161:0/1824186760 shutdown_connections 2024-01-18T00:47:20.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.783+0000 7f0f7cc00640 1 -- 172.21.15.161:0/1824186760 >> 172.21.15.161:0/1824186760 conn(0x7f0f7806b7f0 msgr2=0x7f0f7806bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:20.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.783+0000 7f0f7cc00640 1 -- 172.21.15.161:0/1824186760 shutdown_connections 2024-01-18T00:47:20.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.783+0000 7f0f7cc00640 1 -- 172.21.15.161:0/1824186760 wait complete. 2024-01-18T00:47:20.802 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-18T00:47:20.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.939+0000 7efee9c00640 1 Processor -- start 2024-01-18T00:47:20.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.939+0000 7efee9c00640 1 -- start start 2024-01-18T00:47:20.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.939+0000 7efee9c00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efee41539a0 0x7efee40ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.939+0000 7efee9c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee40c9890 con 0x7efee40c79c0 2024-01-18T00:47:20.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.939+0000 7efee9c00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee4159bf0 con 0x7efee415d3f0 2024-01-18T00:47:20.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.939+0000 7efee9c00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee406d570 con 0x7efee41539a0 2024-01-18T00:47:20.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.939+0000 7efee2000640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7efee40c79c0 0x7efee4061100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55196/0 (socket says 172.21.15.161:55196) 2024-01-18T00:47:20.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.939+0000 7efee2000640 1 -- 172.21.15.161:0/2934248445 learned_addr learned my addr 172.21.15.161:0/2934248445 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-18T00:47:20.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.939+0000 7efee2a00640 1 --2- 172.21.15.161:0/2934248445 >> v2:172.21.15.190:3300/0 conn(0x7efee41539a0 0x7efee40ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.943+0000 7efee1600640 1 -- 172.21.15.161:0/2934248445 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396541235 0 0) 0x7efee40c9890 con 0x7efee40c79c0 2024-01-18T00:47:20.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.943+0000 7efee1600640 1 -- 172.21.15.161:0/2934248445 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec4003530 con 0x7efee40c79c0 2024-01-18T00:47:20.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.947+0000 7efee1600640 1 -- 172.21.15.161:0/2934248445 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2014087589 0 0) 0x7efec4003530 con 0x7efee40c79c0 2024-01-18T00:47:20.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.947+0000 7efee1600640 1 -- 172.21.15.161:0/2934248445 >> v2:172.21.15.190:3300/0 conn(0x7efee41539a0 msgr2=0x7efee40ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:20.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.947+0000 7efee1600640 1 --2- 172.21.15.161:0/2934248445 >> v2:172.21.15.190:3300/0 conn(0x7efee41539a0 0x7efee40ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.947+0000 7efee1600640 1 -- 172.21.15.161:0/2934248445 >> v1:172.21.15.190:6789/0 conn(0x7efee415d3f0 legacy=0x7efee415d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:20.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.947+0000 7efee1600640 1 -- 172.21.15.161:0/2934248445 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee4159eb0 con 0x7efee40c79c0 2024-01-18T00:47:20.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.947+0000 7efee1600640 1 -- 172.21.15.161:0/2934248445 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7efecc001680 con 0x7efee40c79c0 2024-01-18T00:47:20.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.947+0000 7efee1600640 1 -- 172.21.15.161:0/2934248445 >> v1:172.21.15.161:6789/0 conn(0x7efee40c79c0 legacy=0x7efee4061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:20.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.947+0000 7efee1600640 1 --2- 172.21.15.161:0/2934248445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec40039d0 0x7efec4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.947+0000 7efee1600640 1 --2- 172.21.15.161:0/2934248445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efec40047d0 0x7efec4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.947+0000 7efee1600640 1 --2- 172.21.15.161:0/2934248445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec4005190 0x7efec400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.947+0000 7efee1600640 1 -- 172.21.15.161:0/2934248445 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec400c060 con 0x7efec40047d0 2024-01-18T00:47:20.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.947+0000 7efee1600640 1 -- 172.21.15.161:0/2934248445 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec400c1a0 con 0x7efec4005190 2024-01-18T00:47:20.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.947+0000 7efee1600640 1 -- 172.21.15.161:0/2934248445 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec400c360 con 0x7efec40039d0 2024-01-18T00:47:20.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.947+0000 7efee2a00640 1 --2- 172.21.15.161:0/2934248445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec40039d0 0x7efec4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.951+0000 7efee2000640 1 --2- 172.21.15.161:0/2934248445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efec40047d0 0x7efec4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.951+0000 7efee2000640 1 -- 172.21.15.161:0/2934248445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec40039d0 msgr2=0x7efec4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:20.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.951+0000 7efee2000640 1 --2- 172.21.15.161:0/2934248445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec40039d0 0x7efec4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.951+0000 7efee2000640 1 -- 172.21.15.161:0/2934248445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec4005190 msgr2=0x7efec400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:20.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.951+0000 7efee2000640 1 --2- 172.21.15.161:0/2934248445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec4005190 0x7efec400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.951+0000 7efee2000640 1 -- 172.21.15.161:0/2934248445 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec4003530 con 0x7efec40047d0 2024-01-18T00:47:20.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.951+0000 7efee3400640 1 -- 172.21.15.161:0/2934248445 reap_dead start 2024-01-18T00:47:20.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.955+0000 7efee2000640 1 --2- 172.21.15.161:0/2934248445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efec40047d0 0x7efec4004c50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efecc00c110 tx=0x7efecc01f2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a17aad6c780dc5 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:20.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.959+0000 7efee1600640 1 -- 172.21.15.161:0/2934248445 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc0058e0 con 0x7efec40047d0 2024-01-18T00:47:20.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.959+0000 7efee1600640 1 -- 172.21.15.161:0/2934248445 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc005a40 con 0x7efec40047d0 2024-01-18T00:47:20.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.959+0000 7efee1600640 1 -- 172.21.15.161:0/2934248445 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc005e70 con 0x7efec40047d0 2024-01-18T00:47:20.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.963+0000 7efee9c00640 1 -- 172.21.15.161:0/2934248445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efec40047d0 msgr2=0x7efec4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:20.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.963+0000 7efee9c00640 1 --2- 172.21.15.161:0/2934248445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efec40047d0 0x7efec4004c50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efecc00c110 tx=0x7efecc01f2b0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.963+0000 7efee9c00640 1 -- 172.21.15.161:0/2934248445 shutdown_connections 2024-01-18T00:47:20.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.963+0000 7efee9c00640 1 --2- 172.21.15.161:0/2934248445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efec40047d0 0x7efec4004c50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.963+0000 7efee9c00640 1 -- 172.21.15.161:0/2934248445 >> 172.21.15.161:0/2934248445 conn(0x7efee406ad40 msgr2=0x7efee406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:20.963 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.963+0000 7efee9c00640 1 -- 172.21.15.161:0/2934248445 shutdown_connections 2024-01-18T00:47:20.963 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.963+0000 7efee9c00640 1 -- 172.21.15.161:0/2934248445 wait complete. 2024-01-18T00:47:20.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.963+0000 7efee9c00640 1 Processor -- start 2024-01-18T00:47:20.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.963+0000 7efee9c00640 1 -- start start 2024-01-18T00:47:20.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.963+0000 7efee9c00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec40047d0 0x7efee40b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.963+0000 7efee9c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee40cce50 0x7efee4150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.963+0000 7efee9c00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efee4147830 0x7efee4147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.963+0000 7efee9c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee40aff60 con 0x7efee40cce50 2024-01-18T00:47:20.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.963+0000 7efee9c00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee414beb0 con 0x7efee4147830 2024-01-18T00:47:20.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.963+0000 7efee9c00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee40b1100 con 0x7efec40047d0 2024-01-18T00:47:20.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.967+0000 7efee2000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee40cce50 0x7efee4150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.967+0000 7efee2000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee40cce50 0x7efee4150560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43744/0 (socket says 172.21.15.161:43744) 2024-01-18T00:47:20.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.967+0000 7efee2000640 1 -- 172.21.15.161:0/1421803708 learned_addr learned my addr 172.21.15.161:0/1421803708 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:20.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.967+0000 7efee2a00640 1 --2- 172.21.15.161:0/1421803708 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec40047d0 0x7efee40b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.967+0000 7efee3400640 1 --2- 172.21.15.161:0/1421803708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efee4147830 0x7efee4147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.971+0000 7efee2000640 1 -- 172.21.15.161:0/1421803708 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec40047d0 msgr2=0x7efee40b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:20.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.971+0000 7efee2000640 1 --2- 172.21.15.161:0/1421803708 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec40047d0 0x7efee40b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.971+0000 7efee2000640 1 -- 172.21.15.161:0/1421803708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efee4147830 msgr2=0x7efee4147cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:20.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.971+0000 7efee2000640 1 --2- 172.21.15.161:0/1421803708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efee4147830 0x7efee4147cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:20.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.971+0000 7efee2000640 1 -- 172.21.15.161:0/1421803708 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee40b0170 con 0x7efee40cce50 2024-01-18T00:47:20.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.971+0000 7efee2000640 1 --2- 172.21.15.161:0/1421803708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee40cce50 0x7efee4150560 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efecc00c110 tx=0x7efec4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:20.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.975+0000 7efedaa00640 1 -- 172.21.15.161:0/1421803708 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc0b7070 con 0x7efee40cce50 2024-01-18T00:47:20.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.975+0000 7efedaa00640 1 -- 172.21.15.161:0/1421803708 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc001440 con 0x7efee40cce50 2024-01-18T00:47:20.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.975+0000 7efee9c00640 1 -- 172.21.15.161:0/1421803708 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee40cc370 con 0x7efee40cce50 2024-01-18T00:47:20.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.975+0000 7efedaa00640 1 -- 172.21.15.161:0/1421803708 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc005bb0 con 0x7efee40cce50 2024-01-18T00:47:20.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.975+0000 7efee9c00640 1 -- 172.21.15.161:0/1421803708 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee40cc930 con 0x7efee40cce50 2024-01-18T00:47:20.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.975+0000 7efee9c00640 1 -- 172.21.15.161:0/1421803708 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee406b620 con 0x7efee40cce50 2024-01-18T00:47:20.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.995+0000 7efedaa00640 1 -- 172.21.15.161:0/1421803708 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7efecc005d30 con 0x7efee40cce50 2024-01-18T00:47:20.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.999+0000 7efedaa00640 1 --2- 172.21.15.161:0/1421803708 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efebc066890 0x7efebc068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:20.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.999+0000 7efee2a00640 1 --2- 172.21.15.161:0/1421803708 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efebc066890 0x7efebc068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:20.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.999+0000 7efee2a00640 1 --2- 172.21.15.161:0/1421803708 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efebc066890 0x7efebc068d50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efee4067e20 tx=0x7efed4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:21.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:20.999+0000 7efedaa00640 1 -- 172.21.15.161:0/1421803708 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7efecc0f2bb0 con 0x7efee40cce50 2024-01-18T00:47:21.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.227+0000 7efedaa00640 1 -- 172.21.15.161:0/1421803708 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7efecc0ee7f0 con 0x7efee40cce50 2024-01-18T00:47:21.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.383+0000 7efee9c00640 1 -- 172.21.15.161:0/1421803708 --> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7efee40c8010 con 0x7efebc066890 2024-01-18T00:47:21.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.383+0000 7efedaa00640 1 -- 172.21.15.161:0/1421803708 <== mgr.4110 v2:172.21.15.161:6800/272458188 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efee40c8010 con 0x7efebc066890 2024-01-18T00:47:21.385 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 1 to deep-scrub 2024-01-18T00:47:21.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.387+0000 7efee9c00640 1 -- 172.21.15.161:0/1421803708 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efebc066890 msgr2=0x7efebc068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:21.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.387+0000 7efee9c00640 1 --2- 172.21.15.161:0/1421803708 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efebc066890 0x7efebc068d50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efee4067e20 tx=0x7efed4009190 comp rx=0 tx=0).stop 2024-01-18T00:47:21.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.387+0000 7efee9c00640 1 -- 172.21.15.161:0/1421803708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee40cce50 msgr2=0x7efee4150560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:21.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.387+0000 7efee9c00640 1 --2- 172.21.15.161:0/1421803708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee40cce50 0x7efee4150560 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efecc00c110 tx=0x7efec4005800 comp rx=0 tx=0).stop 2024-01-18T00:47:21.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.387+0000 7efee9c00640 1 -- 172.21.15.161:0/1421803708 shutdown_connections 2024-01-18T00:47:21.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.387+0000 7efee9c00640 1 --2- 172.21.15.161:0/1421803708 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efebc066890 0x7efebc068d50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:21.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.387+0000 7efee9c00640 1 --2- 172.21.15.161:0/1421803708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efee4147830 0x7efee4147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:21.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.387+0000 7efee9c00640 1 --2- 172.21.15.161:0/1421803708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee40cce50 0x7efee4150560 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:21.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.387+0000 7efee9c00640 1 --2- 172.21.15.161:0/1421803708 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec40047d0 0x7efee40b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:21.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.387+0000 7efee9c00640 1 -- 172.21.15.161:0/1421803708 >> 172.21.15.161:0/1421803708 conn(0x7efee406ad40 msgr2=0x7efee4073e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:21.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.387+0000 7efee9c00640 1 -- 172.21.15.161:0/1421803708 shutdown_connections 2024-01-18T00:47:21.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.387+0000 7efee9c00640 1 -- 172.21.15.161:0/1421803708 wait complete. 2024-01-18T00:47:21.408 INFO:tasks.ceph:Scrubbing osd.2 2024-01-18T00:47:21.408 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-18T00:47:21.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.551+0000 7f53bc600640 1 Processor -- start 2024-01-18T00:47:21.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.551+0000 7f53bc600640 1 -- start start 2024-01-18T00:47:21.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.555+0000 7f53bc600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b41518e0 0x7f53b40c6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:21.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.555+0000 7f53bc600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f53b40c66d0 0x7f53b40cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:21.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.555+0000 7f53bc600640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f53b40cb8d0 0x7f53b406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:21.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.555+0000 7f53bc600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b41578c0 con 0x7f53b40c66d0 2024-01-18T00:47:21.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.555+0000 7f53bc600640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b40c7770 con 0x7f53b40cb8d0 2024-01-18T00:47:21.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.555+0000 7f53bc600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b4157b80 con 0x7f53b41518e0 2024-01-18T00:47:21.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.555+0000 7f53b9c00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b41518e0 0x7f53b40c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:21.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.555+0000 7f53ba600640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f53b40cb8d0 0x7f53b406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:21.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.555+0000 7f53b9200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f53b40c66d0 0x7f53b40cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:21.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.555+0000 7f53b9c00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b41518e0 0x7f53b40c6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:40922/0 (socket says 172.21.15.161:40922) 2024-01-18T00:47:21.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.555+0000 7f53b9c00640 1 -- 172.21.15.161:0/1027064377 learned_addr learned my addr 172.21.15.161:0/1027064377 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:21.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.559+0000 7f53b9200640 1 -- 172.21.15.161:0/1027064377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b41518e0 msgr2=0x7f53b40c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:21.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.559+0000 7f53b9200640 1 --2- 172.21.15.161:0/1027064377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b41518e0 0x7f53b40c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:21.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.559+0000 7f53b9200640 1 -- 172.21.15.161:0/1027064377 >> v2:172.21.15.190:3300/0 conn(0x7f53b40cb8d0 msgr2=0x7f53b406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:21.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.559+0000 7f53b9200640 1 --2- 172.21.15.161:0/1027064377 >> v2:172.21.15.190:3300/0 conn(0x7f53b40cb8d0 0x7f53b406dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:21.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.559+0000 7f53b9200640 1 -- 172.21.15.161:0/1027064377 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b4157e60 con 0x7f53b40c66d0 2024-01-18T00:47:21.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.563+0000 7f53b9200640 1 --2- 172.21.15.161:0/1027064377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53b40c66d0 0x7f53b40cb390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f53b406fc80 tx=0x7f539c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8125e6d63a168be0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:21.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.567+0000 7f53b3e00640 1 -- 172.21.15.161:0/1027064377 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c0ab600 con 0x7f53b40c66d0 2024-01-18T00:47:21.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.567+0000 7f53b3e00640 1 -- 172.21.15.161:0/1027064377 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c0a7050 con 0x7f53b40c66d0 2024-01-18T00:47:21.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.567+0000 7f53b3e00640 1 -- 172.21.15.161:0/1027064377 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c0ab980 con 0x7f53b40c66d0 2024-01-18T00:47:21.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.567+0000 7f53bc600640 1 -- 172.21.15.161:0/1027064377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53b40c66d0 msgr2=0x7f53b40cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:21.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.567+0000 7f53bc600640 1 --2- 172.21.15.161:0/1027064377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53b40c66d0 0x7f53b40cb390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f53b406fc80 tx=0x7f539c01c430 comp rx=0 tx=0).stop 2024-01-18T00:47:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.567+0000 7f53bc600640 1 -- 172.21.15.161:0/1027064377 shutdown_connections 2024-01-18T00:47:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.567+0000 7f53bc600640 1 --2- 172.21.15.161:0/1027064377 >> v2:172.21.15.190:3300/0 conn(0x7f53b40cb8d0 0x7f53b406dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.567+0000 7f53bc600640 1 --2- 172.21.15.161:0/1027064377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53b40c66d0 0x7f53b40cb390 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.567+0000 7f53bc600640 1 --2- 172.21.15.161:0/1027064377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b41518e0 0x7f53b40c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.567+0000 7f53bc600640 1 -- 172.21.15.161:0/1027064377 >> 172.21.15.161:0/1027064377 conn(0x7f53b406aae0 msgr2=0x7f53b406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.567+0000 7f53bc600640 1 -- 172.21.15.161:0/1027064377 shutdown_connections 2024-01-18T00:47:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.567+0000 7f53bc600640 1 -- 172.21.15.161:0/1027064377 wait complete. 2024-01-18T00:47:21.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.571+0000 7f53bc600640 1 Processor -- start 2024-01-18T00:47:21.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.571+0000 7f53bc600640 1 -- start start 2024-01-18T00:47:21.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.571+0000 7f53bc600640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53b40c66d0 0x7f53b414d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:21.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.571+0000 7f53bc600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b40cb8d0 0x7f53b414d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:21.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.571+0000 7f53bc600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53b41518e0 0x7f53b4160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:21.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.571+0000 7f53bc600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b40c7220 con 0x7f53b41518e0 2024-01-18T00:47:21.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.571+0000 7f53bc600640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b41f1e80 con 0x7f53b40c66d0 2024-01-18T00:47:21.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.571+0000 7f53bc600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b4160020 con 0x7f53b40cb8d0 2024-01-18T00:47:21.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.571+0000 7f53ba600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53b41518e0 0x7f53b4160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:21.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.571+0000 7f53ba600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53b41518e0 0x7f53b4160800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43748/0 (socket says 172.21.15.161:43748) 2024-01-18T00:47:21.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.571+0000 7f53ba600640 1 -- 172.21.15.161:0/3693885483 learned_addr learned my addr 172.21.15.161:0/3693885483 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:21.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.575+0000 7f53ba600640 1 -- 172.21.15.161:0/3693885483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b40cb8d0 msgr2=0x7f53b414d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:21.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.575+0000 7f53ba600640 1 --2- 172.21.15.161:0/3693885483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53b40cb8d0 0x7f53b414d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:21.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.575+0000 7f53ba600640 1 -- 172.21.15.161:0/3693885483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53b40c66d0 msgr2=0x7f53b414d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:21.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.575+0000 7f53ba600640 1 --2- 172.21.15.161:0/3693885483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53b40c66d0 0x7f53b414d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:21.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.575+0000 7f53ba600640 1 -- 172.21.15.161:0/3693885483 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c009420 con 0x7f53b41518e0 2024-01-18T00:47:21.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.579+0000 7f53ba600640 1 --2- 172.21.15.161:0/3693885483 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53b41518e0 0x7f53b4160800 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f53ac00efc0 tx=0x7f53ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:21.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.583+0000 7f53b1600640 1 -- 172.21.15.161:0/3693885483 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac014480 con 0x7f53b41518e0 2024-01-18T00:47:21.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.583+0000 7f53b1600640 1 -- 172.21.15.161:0/3693885483 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac00f040 con 0x7f53b41518e0 2024-01-18T00:47:21.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.583+0000 7f53b1600640 1 -- 172.21.15.161:0/3693885483 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac014820 con 0x7f53b41518e0 2024-01-18T00:47:21.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.583+0000 7f53bc600640 1 -- 172.21.15.161:0/3693885483 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b4147d90 con 0x7f53b41518e0 2024-01-18T00:47:21.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.583+0000 7f53bc600640 1 -- 172.21.15.161:0/3693885483 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b41602e0 con 0x7f53b41518e0 2024-01-18T00:47:21.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.583+0000 7f53bc600640 1 -- 172.21.15.161:0/3693885483 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f53b40c5c70 con 0x7f53b41518e0 2024-01-18T00:47:21.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.603+0000 7f53b1600640 1 -- 172.21.15.161:0/3693885483 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f53ac014980 con 0x7f53b41518e0 2024-01-18T00:47:21.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.603+0000 7f53b1600640 1 --2- 172.21.15.161:0/3693885483 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f538c0668c0 0x7f538c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:21.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.603+0000 7f53b9c00640 1 --2- 172.21.15.161:0/3693885483 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f538c0668c0 0x7f538c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:21.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.603+0000 7f53b9c00640 1 --2- 172.21.15.161:0/3693885483 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f538c0668c0 0x7f538c068d80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f53a4006aa0 tx=0x7f53a4006a30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:21.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.603+0000 7f53b1600640 1 -- 172.21.15.161:0/3693885483 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f53ac0569a0 con 0x7f53b41518e0 2024-01-18T00:47:21.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.603+0000 7f53b1600640 1 --2- 172.21.15.161:0/3693885483 >> [v2:172.21.15.161:6810/3517914982,v1:172.21.15.161:6812/3517914982] conn(0x7f538c06ffa0 0x7f538c072440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:21.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.603+0000 7f53b1600640 1 -- 172.21.15.161:0/3693885483 --> [v2:172.21.15.161:6810/3517914982,v1:172.21.15.161:6812/3517914982] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f538c072b10 con 0x7f538c06ffa0 2024-01-18T00:47:21.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.603+0000 7f53b9200640 1 --2- 172.21.15.161:0/3693885483 >> [v2:172.21.15.161:6810/3517914982,v1:172.21.15.161:6812/3517914982] conn(0x7f538c06ffa0 0x7f538c072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:21.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.607+0000 7f53b1600640 1 -- 172.21.15.161:0/3693885483 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53ac0525e0 con 0x7f53b41518e0 2024-01-18T00:47:21.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.607+0000 7f53b9200640 1 --2- 172.21.15.161:0/3693885483 >> [v2:172.21.15.161:6810/3517914982,v1:172.21.15.161:6812/3517914982] conn(0x7f538c06ffa0 0x7f538c072440 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:21.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.607+0000 7f53b1600640 1 -- 172.21.15.161:0/3693885483 <== osd.2 v2:172.21.15.161:6810/3517914982 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f538c072b10 con 0x7f538c06ffa0 2024-01-18T00:47:21.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.619+0000 7f53bc600640 1 -- 172.21.15.161:0/3693885483 --> [v2:172.21.15.161:6810/3517914982,v1:172.21.15.161:6812/3517914982] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f53b406e590 con 0x7f538c06ffa0 2024-01-18T00:47:21.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.619+0000 7f53b1600640 1 -- 172.21.15.161:0/3693885483 <== osd.2 v2:172.21.15.161:6810/3517914982 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f539c0ab640 con 0x7f538c06ffa0 2024-01-18T00:47:21.620 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-01-18T00:47:21.621 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-18T00:47:21.621 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-01-18T00:47:21.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.619+0000 7f53bc600640 1 -- 172.21.15.161:0/3693885483 >> [v2:172.21.15.161:6810/3517914982,v1:172.21.15.161:6812/3517914982] conn(0x7f538c06ffa0 msgr2=0x7f538c072440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:21.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.619+0000 7f53bc600640 1 --2- 172.21.15.161:0/3693885483 >> [v2:172.21.15.161:6810/3517914982,v1:172.21.15.161:6812/3517914982] conn(0x7f538c06ffa0 0x7f538c072440 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:21.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.619+0000 7f53bc600640 1 -- 172.21.15.161:0/3693885483 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f538c0668c0 msgr2=0x7f538c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:21.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.619+0000 7f53bc600640 1 --2- 172.21.15.161:0/3693885483 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f538c0668c0 0x7f538c068d80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f53a4006aa0 tx=0x7f53a4006a30 comp rx=0 tx=0).stop 2024-01-18T00:47:21.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.619+0000 7f53bc600640 1 -- 172.21.15.161:0/3693885483 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53b41518e0 msgr2=0x7f53b4160800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:21.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.619+0000 7f53bc600640 1 --2- 172.21.15.161:0/3693885483 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53b41518e0 0x7f53b4160800 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f53ac00efc0 tx=0x7f53ac00c490 comp rx=0 tx=0).stop 2024-01-18T00:47:21.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.619+0000 7f53ba600640 1 -- 172.21.15.161:0/3693885483 reap_dead start 2024-01-18T00:47:21.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.619+0000 7f53bc600640 1 -- 172.21.15.161:0/3693885483 shutdown_connections 2024-01-18T00:47:21.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.619+0000 7f53bc600640 1 -- 172.21.15.161:0/3693885483 >> 172.21.15.161:0/3693885483 conn(0x7f53b406aae0 msgr2=0x7f53b4156d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:21.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.619+0000 7f53bc600640 1 -- 172.21.15.161:0/3693885483 shutdown_connections 2024-01-18T00:47:21.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.619+0000 7f53bc600640 1 -- 172.21.15.161:0/3693885483 wait complete. 2024-01-18T00:47:21.640 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-18T00:47:21.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.779+0000 7f561ee00640 1 Processor -- start 2024-01-18T00:47:21.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.779+0000 7f561ee00640 1 -- start start 2024-01-18T00:47:21.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.779+0000 7f561ee00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5618072300 0x7f5618072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:21.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.779+0000 7f561ee00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561815b9c0 con 0x7f56181517a0 2024-01-18T00:47:21.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.779+0000 7f561ee00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561815ae40 con 0x7f5618157bc0 2024-01-18T00:47:21.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.779+0000 7f561ee00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f561815b120 con 0x7f5618072300 2024-01-18T00:47:21.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.779+0000 7f5617400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5618072300 0x7f5618072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:21.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.779+0000 7f5617400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5618072300 0x7f5618072770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39288/0 (socket says 172.21.15.161:39288) 2024-01-18T00:47:21.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.779+0000 7f5617400640 1 -- 172.21.15.161:0/3877095040 learned_addr learned my addr 172.21.15.161:0/3877095040 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:21.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.783+0000 7f5617400640 1 -- 172.21.15.161:0/3877095040 >> v1:172.21.15.190:6789/0 conn(0x7f5618157bc0 legacy=0x7f5618157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:21.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.783+0000 7f5617400640 1 -- 172.21.15.161:0/3877095040 >> v1:172.21.15.161:6789/0 conn(0x7f56181517a0 legacy=0x7f561806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:21.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.783+0000 7f5617400640 1 -- 172.21.15.161:0/3877095040 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561815b400 con 0x7f5618072300 2024-01-18T00:47:21.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.787+0000 7f5617400640 1 --2- 172.21.15.161:0/3877095040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5618072300 0x7f5618072770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5600009870 tx=0x7f560001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1787e27cd62dc8ec server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:21.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.791+0000 7f5616a00640 1 -- 172.21.15.161:0/3877095040 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56000aa430 con 0x7f5618072300 2024-01-18T00:47:21.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.791+0000 7f5616a00640 1 -- 172.21.15.161:0/3877095040 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56000aa590 con 0x7f5618072300 2024-01-18T00:47:21.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.791+0000 7f5616a00640 1 -- 172.21.15.161:0/3877095040 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56000aa920 con 0x7f5618072300 2024-01-18T00:47:21.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.791+0000 7f561ee00640 1 -- 172.21.15.161:0/3877095040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5618072300 msgr2=0x7f5618072770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:21.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.791+0000 7f561ee00640 1 --2- 172.21.15.161:0/3877095040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5618072300 0x7f5618072770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5600009870 tx=0x7f560001c4d0 comp rx=0 tx=0).stop 2024-01-18T00:47:21.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.791+0000 7f561ee00640 1 -- 172.21.15.161:0/3877095040 shutdown_connections 2024-01-18T00:47:21.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.791+0000 7f561ee00640 1 --2- 172.21.15.161:0/3877095040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5618072300 0x7f5618072770 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:21.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.791+0000 7f561ee00640 1 -- 172.21.15.161:0/3877095040 >> 172.21.15.161:0/3877095040 conn(0x7f56180cb070 msgr2=0x7f56180cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:21.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.791+0000 7f561ee00640 1 -- 172.21.15.161:0/3877095040 shutdown_connections 2024-01-18T00:47:21.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.791+0000 7f561ee00640 1 -- 172.21.15.161:0/3877095040 wait complete. 2024-01-18T00:47:21.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.795+0000 7f561ee00640 1 Processor -- start 2024-01-18T00:47:21.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.795+0000 7f561ee00640 1 -- start start 2024-01-18T00:47:21.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.795+0000 7f561ee00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5618072300 0x7f5618140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:21.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.795+0000 7f561ee00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56181517a0 0x7f56180711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:21.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.795+0000 7f561ee00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5618157bc0 0x7f5618071710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:21.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.795+0000 7f561ee00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5618161ab0 con 0x7f5618157bc0 2024-01-18T00:47:21.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.795+0000 7f561ee00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5618144c30 con 0x7f5618072300 2024-01-18T00:47:21.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.795+0000 7f561ee00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56180c96f0 con 0x7f56181517a0 2024-01-18T00:47:21.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.795+0000 7f561ce00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5618157bc0 0x7f5618071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:21.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.795+0000 7f561ce00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5618157bc0 0x7f5618071710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39300/0 (socket says 172.21.15.161:39300) 2024-01-18T00:47:21.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.795+0000 7f561ce00640 1 -- 172.21.15.161:0/1268578684 learned_addr learned my addr 172.21.15.161:0/1268578684 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:21.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.799+0000 7f5617e00640 1 --2- 172.21.15.161:0/1268578684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5618072300 0x7f5618140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:21.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.799+0000 7f5617400640 1 --2- 172.21.15.161:0/1268578684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56181517a0 0x7f56180711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:21.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.799+0000 7f561ce00640 1 -- 172.21.15.161:0/1268578684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56181517a0 msgr2=0x7f56180711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:21.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.799+0000 7f561ce00640 1 --2- 172.21.15.161:0/1268578684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56181517a0 0x7f56180711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:21.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.799+0000 7f561ce00640 1 -- 172.21.15.161:0/1268578684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5618072300 msgr2=0x7f5618140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:21.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.799+0000 7f561ce00640 1 --2- 172.21.15.161:0/1268578684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5618072300 0x7f5618140580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:21.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.799+0000 7f561ce00640 1 -- 172.21.15.161:0/1268578684 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56000094d0 con 0x7f5618157bc0 2024-01-18T00:47:21.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.803+0000 7f561ce00640 1 --2- 172.21.15.161:0/1268578684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5618157bc0 0x7f5618071710 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f561000c730 tx=0x7f561000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:21.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.807+0000 7f560fe00640 1 -- 172.21.15.161:0/1268578684 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5610003b80 con 0x7f5618157bc0 2024-01-18T00:47:21.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.807+0000 7f561ee00640 1 -- 172.21.15.161:0/1268578684 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56181443d0 con 0x7f5618157bc0 2024-01-18T00:47:21.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.807+0000 7f561ee00640 1 -- 172.21.15.161:0/1268578684 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56181614e0 con 0x7f5618157bc0 2024-01-18T00:47:21.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.807+0000 7f560fe00640 1 -- 172.21.15.161:0/1268578684 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561000ce40 con 0x7f5618157bc0 2024-01-18T00:47:21.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.807+0000 7f560fe00640 1 -- 172.21.15.161:0/1268578684 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561000a7f0 con 0x7f5618157bc0 2024-01-18T00:47:21.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.807+0000 7f561ee00640 1 -- 172.21.15.161:0/1268578684 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56180746a0 con 0x7f5618157bc0 2024-01-18T00:47:21.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.827+0000 7f560fe00640 1 -- 172.21.15.161:0/1268578684 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f561000aa10 con 0x7f5618157bc0 2024-01-18T00:47:21.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.827+0000 7f560fe00640 1 --2- 172.21.15.161:0/1268578684 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f55f0066840 0x7f55f0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:21.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.827+0000 7f5617e00640 1 --2- 172.21.15.161:0/1268578684 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f55f0066840 0x7f55f0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:21.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:21.827+0000 7f5617e00640 1 --2- 172.21.15.161:0/1268578684 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f55f0066840 0x7f55f0068d00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5608007fd0 tx=0x7f5608009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:22.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.063+0000 7f560fe00640 1 -- 172.21.15.161:0/1268578684 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f5610055900 con 0x7f5618157bc0 2024-01-18T00:47:22.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.063+0000 7f560fe00640 1 -- 172.21.15.161:0/1268578684 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f5610051c40 con 0x7f5618157bc0 2024-01-18T00:47:22.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.215+0000 7f561ee00640 1 -- 172.21.15.161:0/1268578684 --> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f561806d3e0 con 0x7f55f0066840 2024-01-18T00:47:22.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.215+0000 7f560fe00640 1 -- 172.21.15.161:0/1268578684 <== mgr.4110 v2:172.21.15.161:6800/272458188 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5608001490 con 0x7f55f0066840 2024-01-18T00:47:22.217 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 2 to deep-scrub 2024-01-18T00:47:22.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.219+0000 7f561ee00640 1 -- 172.21.15.161:0/1268578684 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f55f0066840 msgr2=0x7f55f0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:22.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.219+0000 7f561ee00640 1 --2- 172.21.15.161:0/1268578684 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f55f0066840 0x7f55f0068d00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5608007fd0 tx=0x7f5608009040 comp rx=0 tx=0).stop 2024-01-18T00:47:22.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.219+0000 7f561ee00640 1 -- 172.21.15.161:0/1268578684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5618157bc0 msgr2=0x7f5618071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:22.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.219+0000 7f561ee00640 1 --2- 172.21.15.161:0/1268578684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5618157bc0 0x7f5618071710 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f561000c730 tx=0x7f561000cbf0 comp rx=0 tx=0).stop 2024-01-18T00:47:22.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.219+0000 7f561ee00640 1 -- 172.21.15.161:0/1268578684 shutdown_connections 2024-01-18T00:47:22.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.219+0000 7f561ee00640 1 --2- 172.21.15.161:0/1268578684 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f55f0066840 0x7f55f0068d00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:22.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.219+0000 7f561ee00640 1 --2- 172.21.15.161:0/1268578684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5618157bc0 0x7f5618071710 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:22.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.219+0000 7f561ee00640 1 --2- 172.21.15.161:0/1268578684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56181517a0 0x7f56180711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:22.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.219+0000 7f561ee00640 1 --2- 172.21.15.161:0/1268578684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5618072300 0x7f5618140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:22.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.219+0000 7f561ee00640 1 -- 172.21.15.161:0/1268578684 >> 172.21.15.161:0/1268578684 conn(0x7f56180cb070 msgr2=0x7f561806ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:22.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.219+0000 7f561ee00640 1 -- 172.21.15.161:0/1268578684 shutdown_connections 2024-01-18T00:47:22.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.219+0000 7f561ee00640 1 -- 172.21.15.161:0/1268578684 wait complete. 2024-01-18T00:47:22.241 INFO:tasks.ceph:Scrubbing osd.3 2024-01-18T00:47:22.241 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-18T00:47:22.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.379+0000 7f0fc6600640 1 Processor -- start 2024-01-18T00:47:22.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.379+0000 7f0fc6600640 1 -- start start 2024-01-18T00:47:22.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.379+0000 7f0fc6600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0fc006b760 0x7f0fc015d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:22.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.379+0000 7f0fc6600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc00c8490 0x7f0fc00c8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:22.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.379+0000 7f0fc6600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc0159730 con 0x7f0fc0153c80 2024-01-18T00:47:22.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.379+0000 7f0fc6600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc015dbf0 con 0x7f0fc006b760 2024-01-18T00:47:22.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.379+0000 7f0fc6600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc006af10 con 0x7f0fc00c8490 2024-01-18T00:47:22.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.379+0000 7f0fbea00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0fc006b760 0x7f0fc015d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:22.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.383+0000 7f0fbea00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0fc006b760 0x7f0fc015d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39310/0 (socket says 172.21.15.161:39310) 2024-01-18T00:47:22.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.383+0000 7f0fbea00640 1 -- 172.21.15.161:0/4034543861 learned_addr learned my addr 172.21.15.161:0/4034543861 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:22.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.383+0000 7f0fbfe00640 1 --2- 172.21.15.161:0/4034543861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc00c8490 0x7f0fc00c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:22.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.387+0000 7f0fbfe00640 1 -- 172.21.15.161:0/4034543861 >> v2:172.21.15.161:3300/0 conn(0x7f0fc006b760 msgr2=0x7f0fc015d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:22.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.387+0000 7f0fbfe00640 1 --2- 172.21.15.161:0/4034543861 >> v2:172.21.15.161:3300/0 conn(0x7f0fc006b760 0x7f0fc015d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:22.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.387+0000 7f0fbfe00640 1 -- 172.21.15.161:0/4034543861 >> v1:172.21.15.161:6789/0 conn(0x7f0fc0153c80 legacy=0x7f0fc00c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:22.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.387+0000 7f0fbfe00640 1 -- 172.21.15.161:0/4034543861 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc006b1f0 con 0x7f0fc00c8490 2024-01-18T00:47:22.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.395+0000 7f0fbfe00640 1 --2- 172.21.15.161:0/4034543861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc00c8490 0x7f0fc00c8900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8009d90 tx=0x7f0fb801f100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ca5a87b2d1b5c3e server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:22.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.403+0000 7f0fbe000640 1 -- 172.21.15.161:0/4034543861 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb80b0440 con 0x7f0fc00c8490 2024-01-18T00:47:22.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.403+0000 7f0fbe000640 1 -- 172.21.15.161:0/4034543861 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb80b05a0 con 0x7f0fc00c8490 2024-01-18T00:47:22.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.403+0000 7f0fbe000640 1 -- 172.21.15.161:0/4034543861 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb80b0930 con 0x7f0fc00c8490 2024-01-18T00:47:22.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.407+0000 7f0fc6600640 1 -- 172.21.15.161:0/4034543861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc00c8490 msgr2=0x7f0fc00c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:22.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.407+0000 7f0fc6600640 1 --2- 172.21.15.161:0/4034543861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc00c8490 0x7f0fc00c8900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8009d90 tx=0x7f0fb801f100 comp rx=0 tx=0).stop 2024-01-18T00:47:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.407+0000 7f0fc6600640 1 -- 172.21.15.161:0/4034543861 shutdown_connections 2024-01-18T00:47:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.407+0000 7f0fc6600640 1 --2- 172.21.15.161:0/4034543861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc00c8490 0x7f0fc00c8900 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.407+0000 7f0fc6600640 1 --2- 172.21.15.161:0/4034543861 >> v2:172.21.15.161:3300/0 conn(0x7f0fc006b760 0x7f0fc015d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.407+0000 7f0fc6600640 1 -- 172.21.15.161:0/4034543861 >> 172.21.15.161:0/4034543861 conn(0x7f0fc006f6c0 msgr2=0x7f0fc006fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.407+0000 7f0fc6600640 1 -- 172.21.15.161:0/4034543861 shutdown_connections 2024-01-18T00:47:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.407+0000 7f0fc6600640 1 -- 172.21.15.161:0/4034543861 wait complete. 2024-01-18T00:47:22.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.407+0000 7f0fc6600640 1 Processor -- start 2024-01-18T00:47:22.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.407+0000 7f0fc6600640 1 -- start start 2024-01-18T00:47:22.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.407+0000 7f0fc6600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc006b760 0x7f0fc00c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:22.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.407+0000 7f0fc6600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fc00c8490 0x7f0fc014b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:22.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.407+0000 7f0fc6600640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fc0153c80 0x7f0fc014b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:22.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.407+0000 7f0fc6600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc01f05c0 con 0x7f0fc00c8490 2024-01-18T00:47:22.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.407+0000 7f0fc6600640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc01ef760 con 0x7f0fc0153c80 2024-01-18T00:47:22.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.407+0000 7f0fc6600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc01efa40 con 0x7f0fc006b760 2024-01-18T00:47:22.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.411+0000 7f0fbea00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fc00c8490 0x7f0fc014b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:22.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.411+0000 7f0fbf400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc006b760 0x7f0fc00c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:22.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.411+0000 7f0fbea00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fc00c8490 0x7f0fc014b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39326/0 (socket says 172.21.15.161:39326) 2024-01-18T00:47:22.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.411+0000 7f0fbea00640 1 -- 172.21.15.161:0/1431981874 learned_addr learned my addr 172.21.15.161:0/1431981874 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:22.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.411+0000 7f0fbfe00640 1 --2- 172.21.15.161:0/1431981874 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fc0153c80 0x7f0fc014b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:22.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.415+0000 7f0fbea00640 1 -- 172.21.15.161:0/1431981874 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc006b760 msgr2=0x7f0fc00c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:22.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.415+0000 7f0fbea00640 1 --2- 172.21.15.161:0/1431981874 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc006b760 0x7f0fc00c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:22.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.415+0000 7f0fbea00640 1 -- 172.21.15.161:0/1431981874 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fc0153c80 msgr2=0x7f0fc014b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:22.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.415+0000 7f0fbea00640 1 --2- 172.21.15.161:0/1431981874 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fc0153c80 0x7f0fc014b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:22.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.415+0000 7f0fbea00640 1 -- 172.21.15.161:0/1431981874 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb8009a70 con 0x7f0fc00c8490 2024-01-18T00:47:22.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.415+0000 7f0fbea00640 1 --2- 172.21.15.161:0/1431981874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fc00c8490 0x7f0fc014b090 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800e890 tx=0x7f0fa800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:22.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.423+0000 7f0fb7400640 1 -- 172.21.15.161:0/1431981874 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8009620 con 0x7f0fc00c8490 2024-01-18T00:47:22.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.423+0000 7f0fb7400640 1 -- 172.21.15.161:0/1431981874 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa800c940 con 0x7f0fc00c8490 2024-01-18T00:47:22.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.423+0000 7f0fb7400640 1 -- 172.21.15.161:0/1431981874 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa800ccf0 con 0x7f0fc00c8490 2024-01-18T00:47:22.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.423+0000 7f0fc6600640 1 -- 172.21.15.161:0/1431981874 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc01efd20 con 0x7f0fc00c8490 2024-01-18T00:47:22.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.423+0000 7f0fc6600640 1 -- 172.21.15.161:0/1431981874 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc01f02e0 con 0x7f0fc00c8490 2024-01-18T00:47:22.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.423+0000 7f0fc6600640 1 -- 172.21.15.161:0/1431981874 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0fc01532b0 con 0x7f0fc00c8490 2024-01-18T00:47:22.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.447+0000 7f0fb7400640 1 -- 172.21.15.161:0/1431981874 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f0fa8013470 con 0x7f0fc00c8490 2024-01-18T00:47:22.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.447+0000 7f0fb7400640 1 --2- 172.21.15.161:0/1431981874 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0f98066890 0x7f0f98068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:22.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.447+0000 7f0fbf400640 1 --2- 172.21.15.161:0/1431981874 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0f98066890 0x7f0f98068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:22.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.447+0000 7f0fbf400640 1 --2- 172.21.15.161:0/1431981874 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0f98066890 0x7f0f98068d50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00098e0 tx=0x7f0fb0009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:22.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.451+0000 7f0fb7400640 1 -- 172.21.15.161:0/1431981874 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f0fa80555f0 con 0x7f0fc00c8490 2024-01-18T00:47:22.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.451+0000 7f0fb7400640 1 --2- 172.21.15.161:0/1431981874 >> [v2:172.21.15.161:6811/607538014,v1:172.21.15.161:6813/607538014] conn(0x7f0f9806fff0 0x7f0f98072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:22.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.451+0000 7f0fb7400640 1 -- 172.21.15.161:0/1431981874 --> [v2:172.21.15.161:6811/607538014,v1:172.21.15.161:6813/607538014] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f98072b60 con 0x7f0f9806fff0 2024-01-18T00:47:22.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.451+0000 7f0fb7400640 1 -- 172.21.15.161:0/1431981874 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fa8051930 con 0x7f0fc00c8490 2024-01-18T00:47:22.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.451+0000 7f0fbfe00640 1 --2- 172.21.15.161:0/1431981874 >> [v2:172.21.15.161:6811/607538014,v1:172.21.15.161:6813/607538014] conn(0x7f0f9806fff0 0x7f0f98072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:22.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.451+0000 7f0fbfe00640 1 --2- 172.21.15.161:0/1431981874 >> [v2:172.21.15.161:6811/607538014,v1:172.21.15.161:6813/607538014] conn(0x7f0f9806fff0 0x7f0f98072490 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:22.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.451+0000 7f0fb7400640 1 -- 172.21.15.161:0/1431981874 <== osd.3 v2:172.21.15.161:6811/607538014 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0f98072b60 con 0x7f0f9806fff0 2024-01-18T00:47:22.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.467+0000 7f0fc6600640 1 -- 172.21.15.161:0/1431981874 --> [v2:172.21.15.161:6811/607538014,v1:172.21.15.161:6813/607538014] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0fc0159fb0 con 0x7f0f9806fff0 2024-01-18T00:47:22.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.467+0000 7f0fb7400640 1 -- 172.21.15.161:0/1431981874 <== osd.3 v2:172.21.15.161:6811/607538014 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0fb80b08b0 con 0x7f0f9806fff0 2024-01-18T00:47:22.468 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-01-18T00:47:22.468 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-18T00:47:22.468 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-01-18T00:47:22.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.467+0000 7f0fc6600640 1 -- 172.21.15.161:0/1431981874 >> [v2:172.21.15.161:6811/607538014,v1:172.21.15.161:6813/607538014] conn(0x7f0f9806fff0 msgr2=0x7f0f98072490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:22.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.467+0000 7f0fc6600640 1 --2- 172.21.15.161:0/1431981874 >> [v2:172.21.15.161:6811/607538014,v1:172.21.15.161:6813/607538014] conn(0x7f0f9806fff0 0x7f0f98072490 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:22.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.467+0000 7f0fc6600640 1 -- 172.21.15.161:0/1431981874 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0f98066890 msgr2=0x7f0f98068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:22.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.467+0000 7f0fc6600640 1 --2- 172.21.15.161:0/1431981874 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f0f98066890 0x7f0f98068d50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00098e0 tx=0x7f0fb0009060 comp rx=0 tx=0).stop 2024-01-18T00:47:22.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.467+0000 7f0fc6600640 1 -- 172.21.15.161:0/1431981874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fc00c8490 msgr2=0x7f0fc014b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:22.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.467+0000 7f0fc6600640 1 --2- 172.21.15.161:0/1431981874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fc00c8490 0x7f0fc014b090 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800e890 tx=0x7f0fa800ed50 comp rx=0 tx=0).stop 2024-01-18T00:47:22.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.467+0000 7f0fbfe00640 1 -- 172.21.15.161:0/1431981874 reap_dead start 2024-01-18T00:47:22.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.467+0000 7f0fc6600640 1 -- 172.21.15.161:0/1431981874 shutdown_connections 2024-01-18T00:47:22.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.467+0000 7f0fc6600640 1 -- 172.21.15.161:0/1431981874 >> 172.21.15.161:0/1431981874 conn(0x7f0fc006f6c0 msgr2=0x7f0fc014d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:22.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.467+0000 7f0fc6600640 1 -- 172.21.15.161:0/1431981874 shutdown_connections 2024-01-18T00:47:22.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.467+0000 7f0fc6600640 1 -- 172.21.15.161:0/1431981874 wait complete. 2024-01-18T00:47:22.488 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-18T00:47:22.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.627+0000 7f4cf9800640 1 Processor -- start 2024-01-18T00:47:22.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.627+0000 7f4cf9800640 1 -- start start 2024-01-18T00:47:22.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.631+0000 7f4cf9800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf40c5a70 0x7f4cf4156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:22.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.631+0000 7f4cf9800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4cf40c0090 0x7f4cf4159910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:22.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.631+0000 7f4cf9800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf406dc10 con 0x7f4cf4150560 2024-01-18T00:47:22.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.631+0000 7f4cf9800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf406d7e0 con 0x7f4cf40c0090 2024-01-18T00:47:22.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.631+0000 7f4cf9800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf41564c0 con 0x7f4cf40c5a70 2024-01-18T00:47:22.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.631+0000 7f4cf3400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4cf40c0090 0x7f4cf4159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:22.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.631+0000 7f4cf3400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4cf40c0090 0x7f4cf4159910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39332/0 (socket says 172.21.15.161:39332) 2024-01-18T00:47:22.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.631+0000 7f4cf3400640 1 -- 172.21.15.161:0/434484895 learned_addr learned my addr 172.21.15.161:0/434484895 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:22.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.631+0000 7f4cf2000640 1 --2- 172.21.15.161:0/434484895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf40c5a70 0x7f4cf4156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:22.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.635+0000 7f4cf3400640 1 -- 172.21.15.161:0/434484895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf40c5a70 msgr2=0x7f4cf4156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:22.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.635+0000 7f4cf3400640 1 --2- 172.21.15.161:0/434484895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf40c5a70 0x7f4cf4156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:22.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.635+0000 7f4cf3400640 1 -- 172.21.15.161:0/434484895 >> v1:172.21.15.161:6789/0 conn(0x7f4cf4150560 legacy=0x7f4cf40722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:22.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.635+0000 7f4cf3400640 1 -- 172.21.15.161:0/434484895 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf406d220 con 0x7f4cf40c0090 2024-01-18T00:47:22.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.639+0000 7f4cf3400640 1 --2- 172.21.15.161:0/434484895 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf40c0090 0x7f4cf4159910 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00d150 tx=0x7f4cec01ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ff3e8c98cbecb server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:22.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.643+0000 7f4cf1600640 1 -- 172.21.15.161:0/434484895 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec00b2d0 con 0x7f4cf40c0090 2024-01-18T00:47:22.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.643+0000 7f4cf1600640 1 -- 172.21.15.161:0/434484895 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec00b430 con 0x7f4cf40c0090 2024-01-18T00:47:22.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.643+0000 7f4cf1600640 1 -- 172.21.15.161:0/434484895 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec0a7a90 con 0x7f4cf40c0090 2024-01-18T00:47:22.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.643+0000 7f4cf9800640 1 -- 172.21.15.161:0/434484895 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf40c0090 msgr2=0x7f4cf4159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:22.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.643+0000 7f4cf9800640 1 --2- 172.21.15.161:0/434484895 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf40c0090 0x7f4cf4159910 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00d150 tx=0x7f4cec01ebd0 comp rx=0 tx=0).stop 2024-01-18T00:47:22.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.643+0000 7f4cf9800640 1 -- 172.21.15.161:0/434484895 shutdown_connections 2024-01-18T00:47:22.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.643+0000 7f4cf9800640 1 --2- 172.21.15.161:0/434484895 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf40c0090 0x7f4cf4159910 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:22.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.643+0000 7f4cf9800640 1 --2- 172.21.15.161:0/434484895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf40c5a70 0x7f4cf4156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:22.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.643+0000 7f4cf9800640 1 -- 172.21.15.161:0/434484895 >> 172.21.15.161:0/434484895 conn(0x7f4cf40cb070 msgr2=0x7f4cf40cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:22.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.643+0000 7f4cf9800640 1 -- 172.21.15.161:0/434484895 shutdown_connections 2024-01-18T00:47:22.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.643+0000 7f4cf9800640 1 -- 172.21.15.161:0/434484895 wait complete. 2024-01-18T00:47:22.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.643+0000 7f4cf9800640 1 Processor -- start 2024-01-18T00:47:22.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.643+0000 7f4cf9800640 1 -- start start 2024-01-18T00:47:22.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.647+0000 7f4cf9800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf40c0090 0x7f4cf41f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:22.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.647+0000 7f4cf9800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cf40c5a70 0x7f4cf4158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:22.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.647+0000 7f4cf9800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf4150560 0x7f4cf41438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:22.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.647+0000 7f4cf9800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf41f3100 con 0x7f4cf4150560 2024-01-18T00:47:22.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.647+0000 7f4cf9800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf41f2140 con 0x7f4cf40c5a70 2024-01-18T00:47:22.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.647+0000 7f4cf9800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf414dd00 con 0x7f4cf40c0090 2024-01-18T00:47:22.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.647+0000 7f4cf3400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf4150560 0x7f4cf41438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:22.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.647+0000 7f4cf3400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf4150560 0x7f4cf41438c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39338/0 (socket says 172.21.15.161:39338) 2024-01-18T00:47:22.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.647+0000 7f4cf3400640 1 -- 172.21.15.161:0/21180622 learned_addr learned my addr 172.21.15.161:0/21180622 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:22.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.647+0000 7f4cf2a00640 1 --2- 172.21.15.161:0/21180622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf40c0090 0x7f4cf41f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:22.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.647+0000 7f4cf2000640 1 --2- 172.21.15.161:0/21180622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cf40c5a70 0x7f4cf4158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:22.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.651+0000 7f4cf3400640 1 -- 172.21.15.161:0/21180622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf40c0090 msgr2=0x7f4cf41f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:22.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.651+0000 7f4cf3400640 1 --2- 172.21.15.161:0/21180622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf40c0090 0x7f4cf41f2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:22.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.651+0000 7f4cf3400640 1 -- 172.21.15.161:0/21180622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cf40c5a70 msgr2=0x7f4cf4158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:22.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.651+0000 7f4cf3400640 1 --2- 172.21.15.161:0/21180622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cf40c5a70 0x7f4cf4158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:22.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.651+0000 7f4cf3400640 1 -- 172.21.15.161:0/21180622 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec00bd40 con 0x7f4cf4150560 2024-01-18T00:47:22.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.655+0000 7f4cf3400640 1 --2- 172.21.15.161:0/21180622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf4150560 0x7f4cf41438c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4cec01d280 tx=0x7f4cec01b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:22.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.659+0000 7f4ceaa00640 1 -- 172.21.15.161:0/21180622 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec009800 con 0x7f4cf4150560 2024-01-18T00:47:22.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.659+0000 7f4ceaa00640 1 -- 172.21.15.161:0/21180622 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec009960 con 0x7f4cf4150560 2024-01-18T00:47:22.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.659+0000 7f4ceaa00640 1 -- 172.21.15.161:0/21180622 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec009d10 con 0x7f4cf4150560 2024-01-18T00:47:22.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.659+0000 7f4cf9800640 1 -- 172.21.15.161:0/21180622 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf414dfe0 con 0x7f4cf4150560 2024-01-18T00:47:22.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.659+0000 7f4cf9800640 1 -- 172.21.15.161:0/21180622 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf41f26a0 con 0x7f4cf4150560 2024-01-18T00:47:22.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.659+0000 7f4cf9800640 1 -- 172.21.15.161:0/21180622 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf414fe20 con 0x7f4cf4150560 2024-01-18T00:47:22.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.691+0000 7f4ceaa00640 1 -- 172.21.15.161:0/21180622 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f4cec0c3460 con 0x7f4cf4150560 2024-01-18T00:47:22.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.691+0000 7f4ceaa00640 1 --2- 172.21.15.161:0/21180622 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4ccc066890 0x7f4ccc068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:22.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.691+0000 7f4cf2a00640 1 --2- 172.21.15.161:0/21180622 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4ccc066890 0x7f4ccc068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:22.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.691+0000 7f4cf2a00640 1 --2- 172.21.15.161:0/21180622 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4ccc066890 0x7f4ccc068d50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4ce40098e0 tx=0x7f4ce4009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:22.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.723+0000 7f4ceaa00640 1 -- 172.21.15.161:0/21180622 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f4cec0f1100 con 0x7f4cf4150560 2024-01-18T00:47:22.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:22.919+0000 7f4ceaa00640 1 -- 172.21.15.161:0/21180622 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f4cec0ed440 con 0x7f4cf4150560 2024-01-18T00:47:23.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.079+0000 7f4cf9800640 1 -- 172.21.15.161:0/21180622 --> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cf40719e0 con 0x7f4ccc066890 2024-01-18T00:47:23.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.079+0000 7f4ceaa00640 1 -- 172.21.15.161:0/21180622 <== mgr.4110 v2:172.21.15.161:6800/272458188 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4ce4009530 con 0x7f4ccc066890 2024-01-18T00:47:23.080 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 3 to deep-scrub 2024-01-18T00:47:23.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.083+0000 7f4cf9800640 1 -- 172.21.15.161:0/21180622 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4ccc066890 msgr2=0x7f4ccc068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:23.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.083+0000 7f4cf9800640 1 --2- 172.21.15.161:0/21180622 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4ccc066890 0x7f4ccc068d50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4ce40098e0 tx=0x7f4ce4009060 comp rx=0 tx=0).stop 2024-01-18T00:47:23.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.083+0000 7f4cf9800640 1 -- 172.21.15.161:0/21180622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf4150560 msgr2=0x7f4cf41438c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:23.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.083+0000 7f4cf9800640 1 --2- 172.21.15.161:0/21180622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf4150560 0x7f4cf41438c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4cec01d280 tx=0x7f4cec01b970 comp rx=0 tx=0).stop 2024-01-18T00:47:23.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.083+0000 7f4cf9800640 1 -- 172.21.15.161:0/21180622 shutdown_connections 2024-01-18T00:47:23.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.083+0000 7f4cf9800640 1 --2- 172.21.15.161:0/21180622 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4ccc066890 0x7f4ccc068d50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:23.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.083+0000 7f4cf9800640 1 --2- 172.21.15.161:0/21180622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cf40c5a70 0x7f4cf4158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:23.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.083+0000 7f4cf9800640 1 --2- 172.21.15.161:0/21180622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf4150560 0x7f4cf41438c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:23.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.083+0000 7f4cf9800640 1 --2- 172.21.15.161:0/21180622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf40c0090 0x7f4cf41f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:23.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.083+0000 7f4cf9800640 1 -- 172.21.15.161:0/21180622 >> 172.21.15.161:0/21180622 conn(0x7f4cf40cb070 msgr2=0x7f4cf40722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:23.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.083+0000 7f4cf9800640 1 -- 172.21.15.161:0/21180622 shutdown_connections 2024-01-18T00:47:23.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.083+0000 7f4cf9800640 1 -- 172.21.15.161:0/21180622 wait complete. 2024-01-18T00:47:23.103 INFO:tasks.ceph:Scrubbing osd.4 2024-01-18T00:47:23.103 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-18T00:47:23.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.243+0000 7f63dba00640 1 Processor -- start 2024-01-18T00:47:23.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.243+0000 7f63dba00640 1 -- start start 2024-01-18T00:47:23.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.243+0000 7f63dba00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f63d41539b0 0x7f63d40c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:23.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.243+0000 7f63dba00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d40ca2b0 0x7f63d4070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:23.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.243+0000 7f63dba00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d415a5e0 con 0x7f63d4071220 2024-01-18T00:47:23.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.243+0000 7f63dba00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d415ce40 con 0x7f63d41539b0 2024-01-18T00:47:23.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.243+0000 7f63dba00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d4153d90 con 0x7f63d40ca2b0 2024-01-18T00:47:23.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.247+0000 7f63d9000640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f63d41539b0 0x7f63d40c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:23.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.247+0000 7f63d3e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d40ca2b0 0x7f63d4070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:23.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.247+0000 7f63d9000640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f63d41539b0 0x7f63d40c93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:55828/0 (socket says 172.21.15.161:55828) 2024-01-18T00:47:23.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.247+0000 7f63d9000640 1 -- 172.21.15.161:0/3403599909 learned_addr learned my addr 172.21.15.161:0/3403599909 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:23.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.255+0000 7f63d3e00640 1 -- 172.21.15.161:0/3403599909 >> v2:172.21.15.190:3300/0 conn(0x7f63d41539b0 msgr2=0x7f63d40c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:23.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.255+0000 7f63d3e00640 1 --2- 172.21.15.161:0/3403599909 >> v2:172.21.15.190:3300/0 conn(0x7f63d41539b0 0x7f63d40c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:23.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.255+0000 7f63d3e00640 1 -- 172.21.15.161:0/3403599909 >> v1:172.21.15.190:6789/0 conn(0x7f63d4071220 legacy=0x7f63d415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:23.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.255+0000 7f63d3e00640 1 -- 172.21.15.161:0/3403599909 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d40c7900 con 0x7f63d40ca2b0 2024-01-18T00:47:23.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.259+0000 7f63d3e00640 1 --2- 172.21.15.161:0/3403599909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d40ca2b0 0x7f63d4070ce0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0097c0 tx=0x7f63bc01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4134c2c958ee7295 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:23.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.271+0000 7f63d3400640 1 -- 172.21.15.161:0/3403599909 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc0ad640 con 0x7f63d40ca2b0 2024-01-18T00:47:23.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.271+0000 7f63d3400640 1 -- 172.21.15.161:0/3403599909 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63bc0ad7a0 con 0x7f63d40ca2b0 2024-01-18T00:47:23.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.271+0000 7f63d3400640 1 -- 172.21.15.161:0/3403599909 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc0adb30 con 0x7f63d40ca2b0 2024-01-18T00:47:23.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.271+0000 7f63dba00640 1 -- 172.21.15.161:0/3403599909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d40ca2b0 msgr2=0x7f63d4070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:23.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.271+0000 7f63dba00640 1 --2- 172.21.15.161:0/3403599909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d40ca2b0 0x7f63d4070ce0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0097c0 tx=0x7f63bc01c480 comp rx=0 tx=0).stop 2024-01-18T00:47:23.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.271+0000 7f63dba00640 1 -- 172.21.15.161:0/3403599909 shutdown_connections 2024-01-18T00:47:23.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.271+0000 7f63dba00640 1 --2- 172.21.15.161:0/3403599909 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d40ca2b0 0x7f63d4070ce0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:23.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.271+0000 7f63dba00640 1 --2- 172.21.15.161:0/3403599909 >> v2:172.21.15.190:3300/0 conn(0x7f63d41539b0 0x7f63d40c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:23.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.271+0000 7f63dba00640 1 -- 172.21.15.161:0/3403599909 >> 172.21.15.161:0/3403599909 conn(0x7f63d406ad40 msgr2=0x7f63d406f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:23.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.271+0000 7f63dba00640 1 -- 172.21.15.161:0/3403599909 shutdown_connections 2024-01-18T00:47:23.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.271+0000 7f63dba00640 1 -- 172.21.15.161:0/3403599909 wait complete. 2024-01-18T00:47:23.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.275+0000 7f63dba00640 1 Processor -- start 2024-01-18T00:47:23.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.275+0000 7f63dba00640 1 -- start start 2024-01-18T00:47:23.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.275+0000 7f63dba00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63d4071220 0x7f63d40cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:23.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.275+0000 7f63dba00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d40ca2b0 0x7f63d415a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:23.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.275+0000 7f63dba00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63d41539b0 0x7f63d414e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:23.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.275+0000 7f63dba00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d41f6380 con 0x7f63d4071220 2024-01-18T00:47:23.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.275+0000 7f63dba00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d4152be0 con 0x7f63d41539b0 2024-01-18T00:47:23.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.275+0000 7f63dba00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d4152ec0 con 0x7f63d40ca2b0 2024-01-18T00:47:23.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.275+0000 7f63d9000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63d4071220 0x7f63d40cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:23.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.275+0000 7f63d9000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63d4071220 0x7f63d40cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39342/0 (socket says 172.21.15.161:39342) 2024-01-18T00:47:23.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.275+0000 7f63d9000640 1 -- 172.21.15.161:0/755313238 learned_addr learned my addr 172.21.15.161:0/755313238 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:23.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.275+0000 7f63d3e00640 1 --2- 172.21.15.161:0/755313238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d40ca2b0 0x7f63d415a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:23.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.279+0000 7f63d9a00640 1 --2- 172.21.15.161:0/755313238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63d41539b0 0x7f63d414e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:23.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.279+0000 7f63d9000640 1 -- 172.21.15.161:0/755313238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d40ca2b0 msgr2=0x7f63d415a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:23.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.279+0000 7f63d9000640 1 --2- 172.21.15.161:0/755313238 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d40ca2b0 0x7f63d415a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:23.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.279+0000 7f63d9000640 1 -- 172.21.15.161:0/755313238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63d41539b0 msgr2=0x7f63d414e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:23.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.279+0000 7f63d9000640 1 --2- 172.21.15.161:0/755313238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63d41539b0 0x7f63d414e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:23.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.279+0000 7f63d9000640 1 -- 172.21.15.161:0/755313238 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63bc009420 con 0x7f63d4071220 2024-01-18T00:47:23.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.283+0000 7f63d9000640 1 --2- 172.21.15.161:0/755313238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63d4071220 0x7f63d40cc180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f63c400e7f0 tx=0x7f63c400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:23.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.287+0000 7f63d0c00640 1 -- 172.21.15.161:0/755313238 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4009580 con 0x7f63d4071220 2024-01-18T00:47:23.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.287+0000 7f63d0c00640 1 -- 172.21.15.161:0/755313238 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c400c940 con 0x7f63d4071220 2024-01-18T00:47:23.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.287+0000 7f63d0c00640 1 -- 172.21.15.161:0/755313238 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c400ccf0 con 0x7f63d4071220 2024-01-18T00:47:23.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.287+0000 7f63dba00640 1 -- 172.21.15.161:0/755313238 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d40cbc60 con 0x7f63d4071220 2024-01-18T00:47:23.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.287+0000 7f63dba00640 1 -- 172.21.15.161:0/755313238 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d414eea0 con 0x7f63d4071220 2024-01-18T00:47:23.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.287+0000 7f63dba00640 1 -- 172.21.15.161:0/755313238 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f63d406cc80 con 0x7f63d4071220 2024-01-18T00:47:23.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.307+0000 7f63d0c00640 1 -- 172.21.15.161:0/755313238 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f63c4013470 con 0x7f63d4071220 2024-01-18T00:47:23.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.307+0000 7f63d0c00640 1 --2- 172.21.15.161:0/755313238 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f63ac066890 0x7f63ac068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:23.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.307+0000 7f63d3e00640 1 --2- 172.21.15.161:0/755313238 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f63ac066890 0x7f63ac068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:23.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.307+0000 7f63d0c00640 1 -- 172.21.15.161:0/755313238 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f63c40554c0 con 0x7f63d4071220 2024-01-18T00:47:23.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.307+0000 7f63d0c00640 1 --2- 172.21.15.161:0/755313238 >> [v2:172.21.15.190:6800/1815468048,v1:172.21.15.190:6801/1815468048] conn(0x7f63ac06fff0 0x7f63ac072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:23.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.307+0000 7f63d0c00640 1 -- 172.21.15.161:0/755313238 --> [v2:172.21.15.190:6800/1815468048,v1:172.21.15.190:6801/1815468048] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f63ac072b60 con 0x7f63ac06fff0 2024-01-18T00:47:23.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.311+0000 7f63d3e00640 1 --2- 172.21.15.161:0/755313238 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f63ac066890 0x7f63ac068d50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0af000 tx=0x7f63bc0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:23.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.311+0000 7f63d9a00640 1 --2- 172.21.15.161:0/755313238 >> [v2:172.21.15.190:6800/1815468048,v1:172.21.15.190:6801/1815468048] conn(0x7f63ac06fff0 0x7f63ac072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:23.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.311+0000 7f63d9a00640 1 --2- 172.21.15.161:0/755313238 >> [v2:172.21.15.190:6800/1815468048,v1:172.21.15.190:6801/1815468048] conn(0x7f63ac06fff0 0x7f63ac072490 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:23.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.311+0000 7f63d0c00640 1 -- 172.21.15.161:0/755313238 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63c4051800 con 0x7f63d4071220 2024-01-18T00:47:23.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.311+0000 7f63d0c00640 1 -- 172.21.15.161:0/755313238 <== osd.4 v2:172.21.15.190:6800/1815468048 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f63ac072b60 con 0x7f63ac06fff0 2024-01-18T00:47:23.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.323+0000 7f63dba00640 1 -- 172.21.15.161:0/755313238 --> [v2:172.21.15.190:6800/1815468048,v1:172.21.15.190:6801/1815468048] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f63d415a300 con 0x7f63ac06fff0 2024-01-18T00:47:23.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.327+0000 7f63d0c00640 1 -- 172.21.15.161:0/755313238 <== osd.4 v2:172.21.15.190:6800/1815468048 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f63cc001b40 con 0x7f63ac06fff0 2024-01-18T00:47:23.327 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-01-18T00:47:23.327 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-18T00:47:23.327 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-01-18T00:47:23.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.327+0000 7f63dba00640 1 -- 172.21.15.161:0/755313238 >> [v2:172.21.15.190:6800/1815468048,v1:172.21.15.190:6801/1815468048] conn(0x7f63ac06fff0 msgr2=0x7f63ac072490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:23.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.327+0000 7f63dba00640 1 --2- 172.21.15.161:0/755313238 >> [v2:172.21.15.190:6800/1815468048,v1:172.21.15.190:6801/1815468048] conn(0x7f63ac06fff0 0x7f63ac072490 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:23.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.327+0000 7f63dba00640 1 -- 172.21.15.161:0/755313238 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f63ac066890 msgr2=0x7f63ac068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:23.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.327+0000 7f63dba00640 1 --2- 172.21.15.161:0/755313238 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f63ac066890 0x7f63ac068d50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0af000 tx=0x7f63bc0a7070 comp rx=0 tx=0).stop 2024-01-18T00:47:23.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.327+0000 7f63dba00640 1 -- 172.21.15.161:0/755313238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63d4071220 msgr2=0x7f63d40cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:23.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.327+0000 7f63dba00640 1 --2- 172.21.15.161:0/755313238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63d4071220 0x7f63d40cc180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f63c400e7f0 tx=0x7f63c400ecb0 comp rx=0 tx=0).stop 2024-01-18T00:47:23.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.327+0000 7f63d9a00640 1 -- 172.21.15.161:0/755313238 reap_dead start 2024-01-18T00:47:23.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.327+0000 7f63dba00640 1 -- 172.21.15.161:0/755313238 shutdown_connections 2024-01-18T00:47:23.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.327+0000 7f63dba00640 1 -- 172.21.15.161:0/755313238 >> 172.21.15.161:0/755313238 conn(0x7f63d406ad40 msgr2=0x7f63d4157450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:23.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.327+0000 7f63dba00640 1 -- 172.21.15.161:0/755313238 shutdown_connections 2024-01-18T00:47:23.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.327+0000 7f63dba00640 1 -- 172.21.15.161:0/755313238 wait complete. 2024-01-18T00:47:23.346 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-18T00:47:23.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.487+0000 7f2b3c000640 1 Processor -- start 2024-01-18T00:47:23.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.487+0000 7f2b3c000640 1 -- start start 2024-01-18T00:47:23.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.487+0000 7f2b3c000640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2b34153860 0x7f2b3406b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:23.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.487+0000 7f2b3c000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b34159ff0 0x7f2b340c6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:23.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.487+0000 7f2b3c000640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3415a4c0 con 0x7f2b34061530 2024-01-18T00:47:23.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.487+0000 7f2b3c000640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b3406a780 con 0x7f2b34153860 2024-01-18T00:47:23.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.487+0000 7f2b3c000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3406aa60 con 0x7f2b34159ff0 2024-01-18T00:47:23.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.507+0000 7f2b39600640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2b34153860 0x7f2b3406b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:23.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.507+0000 7f2b38c00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b34159ff0 0x7f2b340c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:23.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.511+0000 7f2b3a000640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f2b34061530 0x7f2b3406f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.161:35756/0 (socket says 172.21.15.161:35756) 2024-01-18T00:47:23.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.511+0000 7f2b3a000640 1 -- 172.21.15.161:0/510591183 learned_addr learned my addr 172.21.15.161:0/510591183 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-18T00:47:23.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.519+0000 7f2b38c00640 1 -- 172.21.15.161:0/510591183 >> v2:172.21.15.190:3300/0 conn(0x7f2b34153860 msgr2=0x7f2b3406b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:23.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.519+0000 7f2b38c00640 1 --2- 172.21.15.161:0/510591183 >> v2:172.21.15.190:3300/0 conn(0x7f2b34153860 0x7f2b3406b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:23.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.519+0000 7f2b38c00640 1 -- 172.21.15.161:0/510591183 >> v1:172.21.15.190:6789/0 conn(0x7f2b34061530 legacy=0x7f2b3406f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:23.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.519+0000 7f2b38c00640 1 -- 172.21.15.161:0/510591183 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3406ad40 con 0x7f2b34159ff0 2024-01-18T00:47:23.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.611+0000 7f2b38c00640 1 --2- 172.21.15.161:0/510591183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b34159ff0 0x7f2b340c6730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c0097c0 tx=0x7f2b1c01ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f4f74d8d5c48c26 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:23.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.619+0000 7f2b33e00640 1 -- 172.21.15.161:0/510591183 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c0a8970 con 0x7f2b34159ff0 2024-01-18T00:47:23.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.619+0000 7f2b33e00640 1 -- 172.21.15.161:0/510591183 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1c0a8ad0 con 0x7f2b34159ff0 2024-01-18T00:47:23.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.619+0000 7f2b33e00640 1 -- 172.21.15.161:0/510591183 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c0a8e60 con 0x7f2b34159ff0 2024-01-18T00:47:23.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.619+0000 7f2b3c000640 1 -- 172.21.15.161:0/510591183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b34159ff0 msgr2=0x7f2b340c6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:23.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.619+0000 7f2b3c000640 1 --2- 172.21.15.161:0/510591183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b34159ff0 0x7f2b340c6730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c0097c0 tx=0x7f2b1c01ec70 comp rx=0 tx=0).stop 2024-01-18T00:47:23.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.619+0000 7f2b3c000640 1 -- 172.21.15.161:0/510591183 shutdown_connections 2024-01-18T00:47:23.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.619+0000 7f2b3c000640 1 --2- 172.21.15.161:0/510591183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b34159ff0 0x7f2b340c6730 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:23.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.619+0000 7f2b3c000640 1 --2- 172.21.15.161:0/510591183 >> v2:172.21.15.190:3300/0 conn(0x7f2b34153860 0x7f2b3406b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:23.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.619+0000 7f2b3c000640 1 -- 172.21.15.161:0/510591183 >> 172.21.15.161:0/510591183 conn(0x7f2b340c8160 msgr2=0x7f2b340c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:23.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.619+0000 7f2b3c000640 1 -- 172.21.15.161:0/510591183 shutdown_connections 2024-01-18T00:47:23.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.619+0000 7f2b3c000640 1 -- 172.21.15.161:0/510591183 wait complete. 2024-01-18T00:47:23.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.623+0000 7f2b3c000640 1 Processor -- start 2024-01-18T00:47:23.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.623+0000 7f2b3c000640 1 -- start start 2024-01-18T00:47:23.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.623+0000 7f2b3c000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b34061530 0x7f2b3414df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:23.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.623+0000 7f2b3c000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b34153860 0x7f2b34156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:23.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.623+0000 7f2b3c000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b34159ff0 0x7f2b341f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:23.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.623+0000 7f2b3c000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b34154930 con 0x7f2b34061530 2024-01-18T00:47:23.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.623+0000 7f2b3c000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b34155400 con 0x7f2b34159ff0 2024-01-18T00:47:23.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.623+0000 7f2b3c000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b34154d50 con 0x7f2b34153860 2024-01-18T00:47:23.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.623+0000 7f2b39600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b34061530 0x7f2b3414df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:23.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.623+0000 7f2b39600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b34061530 0x7f2b3414df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39352/0 (socket says 172.21.15.161:39352) 2024-01-18T00:47:23.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.623+0000 7f2b39600640 1 -- 172.21.15.161:0/3403875082 learned_addr learned my addr 172.21.15.161:0/3403875082 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:23.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.627+0000 7f2b39600640 1 -- 172.21.15.161:0/3403875082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b34153860 msgr2=0x7f2b34156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:23.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.627+0000 7f2b39600640 1 --2- 172.21.15.161:0/3403875082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b34153860 0x7f2b34156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:23.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.627+0000 7f2b39600640 1 -- 172.21.15.161:0/3403875082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b34159ff0 msgr2=0x7f2b341f3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:23.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.627+0000 7f2b39600640 1 --2- 172.21.15.161:0/3403875082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b34159ff0 0x7f2b341f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:23.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.627+0000 7f2b39600640 1 -- 172.21.15.161:0/3403875082 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c009420 con 0x7f2b34061530 2024-01-18T00:47:23.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.631+0000 7f2b39600640 1 --2- 172.21.15.161:0/3403875082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b34061530 0x7f2b3414df70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400e990 tx=0x7f2b2400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:23.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.635+0000 7f2b31600640 1 -- 172.21.15.161:0/3403875082 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400c9e0 con 0x7f2b34061530 2024-01-18T00:47:23.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.635+0000 7f2b31600640 1 -- 172.21.15.161:0/3403875082 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2400cb40 con 0x7f2b34061530 2024-01-18T00:47:23.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.635+0000 7f2b31600640 1 -- 172.21.15.161:0/3403875082 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400ceb0 con 0x7f2b34061530 2024-01-18T00:47:23.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.635+0000 7f2b3c000640 1 -- 172.21.15.161:0/3403875082 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b34156ec0 con 0x7f2b34061530 2024-01-18T00:47:23.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.635+0000 7f2b3c000640 1 -- 172.21.15.161:0/3403875082 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b34153f90 con 0x7f2b34061530 2024-01-18T00:47:23.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.635+0000 7f2b3c000640 1 -- 172.21.15.161:0/3403875082 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b340746a0 con 0x7f2b34061530 2024-01-18T00:47:23.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.879+0000 7f2b31600640 1 -- 172.21.15.161:0/3403875082 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f2b24013470 con 0x7f2b34061530 2024-01-18T00:47:23.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.883+0000 7f2b31600640 1 --2- 172.21.15.161:0/3403875082 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2b0c0668c0 0x7f2b0c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:23.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.883+0000 7f2b38c00640 1 --2- 172.21.15.161:0/3403875082 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2b0c0668c0 0x7f2b0c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:23.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.883+0000 7f2b38c00640 1 --2- 172.21.15.161:0/3403875082 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2b0c0668c0 0x7f2b0c068d80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c0b2000 tx=0x7f2b1c004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:23.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.899+0000 7f2b31600640 1 -- 172.21.15.161:0/3403875082 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f2b240561a0 con 0x7f2b34061530 2024-01-18T00:47:23.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:23.899+0000 7f2b31600640 1 -- 172.21.15.161:0/3403875082 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f2b24051de0 con 0x7f2b34061530 2024-01-18T00:47:24.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.051+0000 7f2b3c000640 1 -- 172.21.15.161:0/3403875082 --> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b3406b300 con 0x7f2b0c0668c0 2024-01-18T00:47:24.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.051+0000 7f2b31600640 1 -- 172.21.15.161:0/3403875082 <== mgr.4110 v2:172.21.15.161:6800/272458188 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2b1c0a8950 con 0x7f2b0c0668c0 2024-01-18T00:47:24.054 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 4 to deep-scrub 2024-01-18T00:47:24.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.055+0000 7f2b3c000640 1 -- 172.21.15.161:0/3403875082 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2b0c0668c0 msgr2=0x7f2b0c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:24.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.055+0000 7f2b3c000640 1 --2- 172.21.15.161:0/3403875082 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2b0c0668c0 0x7f2b0c068d80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c0b2000 tx=0x7f2b1c004740 comp rx=0 tx=0).stop 2024-01-18T00:47:24.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.055+0000 7f2b3c000640 1 -- 172.21.15.161:0/3403875082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b34061530 msgr2=0x7f2b3414df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:24.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.055+0000 7f2b3c000640 1 --2- 172.21.15.161:0/3403875082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b34061530 0x7f2b3414df70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400e990 tx=0x7f2b2400ee50 comp rx=0 tx=0).stop 2024-01-18T00:47:24.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.055+0000 7f2b3c000640 1 -- 172.21.15.161:0/3403875082 shutdown_connections 2024-01-18T00:47:24.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.055+0000 7f2b3c000640 1 --2- 172.21.15.161:0/3403875082 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f2b0c0668c0 0x7f2b0c068d80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:24.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.055+0000 7f2b3c000640 1 --2- 172.21.15.161:0/3403875082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b34159ff0 0x7f2b341f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:24.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.055+0000 7f2b3c000640 1 --2- 172.21.15.161:0/3403875082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b34153860 0x7f2b34156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:24.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.055+0000 7f2b3c000640 1 --2- 172.21.15.161:0/3403875082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b34061530 0x7f2b3414df70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:24.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.055+0000 7f2b3c000640 1 -- 172.21.15.161:0/3403875082 >> 172.21.15.161:0/3403875082 conn(0x7f2b340c8160 msgr2=0x7f2b3414f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:24.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.055+0000 7f2b3c000640 1 -- 172.21.15.161:0/3403875082 shutdown_connections 2024-01-18T00:47:24.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.055+0000 7f2b3c000640 1 -- 172.21.15.161:0/3403875082 wait complete. 2024-01-18T00:47:24.078 INFO:tasks.ceph:Scrubbing osd.5 2024-01-18T00:47:24.078 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-18T00:47:24.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.219+0000 7fe70aa00640 1 Processor -- start 2024-01-18T00:47:24.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.219+0000 7fe70aa00640 1 -- start start 2024-01-18T00:47:24.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.219+0000 7fe70aa00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe704153890 0x7fe7041595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:24.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.219+0000 7fe70aa00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7040c83c0 0x7fe70415d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:24.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.219+0000 7fe70aa00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70415a590 con 0x7fe7040cb390 2024-01-18T00:47:24.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.219+0000 7fe70aa00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe704159b10 con 0x7fe704153890 2024-01-18T00:47:24.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.219+0000 7fe70aa00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70415d060 con 0x7fe7040c83c0 2024-01-18T00:47:24.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.223+0000 7fe703e00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe704153890 0x7fe7041595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:24.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.223+0000 7fe703400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7040c83c0 0x7fe70415d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:24.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.223+0000 7fe703e00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe704153890 0x7fe7041595d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:55860/0 (socket says 172.21.15.161:55860) 2024-01-18T00:47:24.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.223+0000 7fe703e00640 1 -- 172.21.15.161:0/901848755 learned_addr learned my addr 172.21.15.161:0/901848755 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:24.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.231+0000 7fe703400640 1 -- 172.21.15.161:0/901848755 >> v2:172.21.15.190:3300/0 conn(0x7fe704153890 msgr2=0x7fe7041595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:24.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.231+0000 7fe703400640 1 --2- 172.21.15.161:0/901848755 >> v2:172.21.15.190:3300/0 conn(0x7fe704153890 0x7fe7041595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:24.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.231+0000 7fe703400640 1 -- 172.21.15.161:0/901848755 >> v1:172.21.15.190:6789/0 conn(0x7fe7040cb390 legacy=0x7fe7040710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:24.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.231+0000 7fe703400640 1 -- 172.21.15.161:0/901848755 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe704159cf0 con 0x7fe7040c83c0 2024-01-18T00:47:24.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.239+0000 7fe703400640 1 --2- 172.21.15.161:0/901848755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7040c83c0 0x7fe70415d4f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0097c0 tx=0x7fe6ec01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c411e46fd517428 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:24.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.251+0000 7fe702a00640 1 -- 172.21.15.161:0/901848755 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0ab650 con 0x7fe7040c83c0 2024-01-18T00:47:24.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.251+0000 7fe702a00640 1 -- 172.21.15.161:0/901848755 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0ab7b0 con 0x7fe7040c83c0 2024-01-18T00:47:24.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.251+0000 7fe702a00640 1 -- 172.21.15.161:0/901848755 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0abb40 con 0x7fe7040c83c0 2024-01-18T00:47:24.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.251+0000 7fe70aa00640 1 -- 172.21.15.161:0/901848755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7040c83c0 msgr2=0x7fe70415d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:24.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.251+0000 7fe70aa00640 1 --2- 172.21.15.161:0/901848755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7040c83c0 0x7fe70415d4f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0097c0 tx=0x7fe6ec01c450 comp rx=0 tx=0).stop 2024-01-18T00:47:24.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.251+0000 7fe70aa00640 1 -- 172.21.15.161:0/901848755 shutdown_connections 2024-01-18T00:47:24.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.251+0000 7fe70aa00640 1 --2- 172.21.15.161:0/901848755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7040c83c0 0x7fe70415d4f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:24.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.251+0000 7fe70aa00640 1 --2- 172.21.15.161:0/901848755 >> v2:172.21.15.190:3300/0 conn(0x7fe704153890 0x7fe7041595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:24.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.251+0000 7fe70aa00640 1 -- 172.21.15.161:0/901848755 >> 172.21.15.161:0/901848755 conn(0x7fe70406aae0 msgr2=0x7fe70406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:24.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.251+0000 7fe70aa00640 1 -- 172.21.15.161:0/901848755 shutdown_connections 2024-01-18T00:47:24.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.251+0000 7fe70aa00640 1 -- 172.21.15.161:0/901848755 wait complete. 2024-01-18T00:47:24.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.251+0000 7fe70aa00640 1 Processor -- start 2024-01-18T00:47:24.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.251+0000 7fe70aa00640 1 -- start start 2024-01-18T00:47:24.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.255+0000 7fe70aa00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7040c83c0 0x7fe70414bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:24.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.255+0000 7fe70aa00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7040cb390 0x7fe7040adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:24.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.255+0000 7fe70aa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe704153890 0x7fe7040acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:24.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.255+0000 7fe70aa00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe704152bd0 con 0x7fe704153890 2024-01-18T00:47:24.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.255+0000 7fe70aa00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe704164db0 con 0x7fe7040cb390 2024-01-18T00:47:24.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.255+0000 7fe70aa00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe704153060 con 0x7fe7040c83c0 2024-01-18T00:47:24.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.255+0000 7fe708a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe704153890 0x7fe7040acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:24.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.255+0000 7fe708a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe704153890 0x7fe7040acf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39368/0 (socket says 172.21.15.161:39368) 2024-01-18T00:47:24.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.255+0000 7fe708a00640 1 -- 172.21.15.161:0/2823807804 learned_addr learned my addr 172.21.15.161:0/2823807804 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:24.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.255+0000 7fe703400640 1 --2- 172.21.15.161:0/2823807804 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7040cb390 0x7fe7040adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:24.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.255+0000 7fe703e00640 1 --2- 172.21.15.161:0/2823807804 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7040c83c0 0x7fe70414bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:24.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.259+0000 7fe708a00640 1 -- 172.21.15.161:0/2823807804 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7040c83c0 msgr2=0x7fe70414bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:24.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.259+0000 7fe708a00640 1 --2- 172.21.15.161:0/2823807804 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7040c83c0 0x7fe70414bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:24.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.259+0000 7fe708a00640 1 -- 172.21.15.161:0/2823807804 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7040cb390 msgr2=0x7fe7040adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:24.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.259+0000 7fe708a00640 1 --2- 172.21.15.161:0/2823807804 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7040cb390 0x7fe7040adc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:24.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.259+0000 7fe708a00640 1 -- 172.21.15.161:0/2823807804 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec009420 con 0x7fe704153890 2024-01-18T00:47:24.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.259+0000 7fe708a00640 1 --2- 172.21.15.161:0/2823807804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe704153890 0x7fe7040acf20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00c710 tx=0x7fe6fc00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:24.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.263+0000 7fe6fbe00640 1 -- 172.21.15.161:0/2823807804 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc006d60 con 0x7fe704153890 2024-01-18T00:47:24.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.263+0000 7fe6fbe00640 1 -- 172.21.15.161:0/2823807804 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc00ce20 con 0x7fe704153890 2024-01-18T00:47:24.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.263+0000 7fe6fbe00640 1 -- 172.21.15.161:0/2823807804 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc003bc0 con 0x7fe704153890 2024-01-18T00:47:24.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.263+0000 7fe70aa00640 1 -- 172.21.15.161:0/2823807804 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe704164ad0 con 0x7fe704153890 2024-01-18T00:47:24.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.267+0000 7fe70aa00640 1 -- 172.21.15.161:0/2823807804 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe704152580 con 0x7fe704153890 2024-01-18T00:47:24.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.267+0000 7fe70aa00640 1 -- 172.21.15.161:0/2823807804 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe7040c87e0 con 0x7fe704153890 2024-01-18T00:47:24.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.287+0000 7fe6fbe00640 1 -- 172.21.15.161:0/2823807804 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fe6fc003d20 con 0x7fe704153890 2024-01-18T00:47:24.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.287+0000 7fe6fbe00640 1 --2- 172.21.15.161:0/2823807804 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe6dc066890 0x7fe6dc068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:24.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.287+0000 7fe703e00640 1 --2- 172.21.15.161:0/2823807804 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe6dc066890 0x7fe6dc068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:24.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.287+0000 7fe703e00640 1 --2- 172.21.15.161:0/2823807804 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe6dc066890 0x7fe6dc068d50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009ab0 tx=0x7fe6f4009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:24.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.287+0000 7fe6fbe00640 1 -- 172.21.15.161:0/2823807804 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fe6fc0558d0 con 0x7fe704153890 2024-01-18T00:47:24.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.291+0000 7fe6fbe00640 1 --2- 172.21.15.161:0/2823807804 >> [v2:172.21.15.190:6816/3551605927,v1:172.21.15.190:6817/3551605927] conn(0x7fe6dc06ff70 0x7fe6dc072410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:24.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.291+0000 7fe6fbe00640 1 -- 172.21.15.161:0/2823807804 --> [v2:172.21.15.190:6816/3551605927,v1:172.21.15.190:6817/3551605927] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6dc072ae0 con 0x7fe6dc06ff70 2024-01-18T00:47:24.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.291+0000 7fe703400640 1 --2- 172.21.15.161:0/2823807804 >> [v2:172.21.15.190:6816/3551605927,v1:172.21.15.190:6817/3551605927] conn(0x7fe6dc06ff70 0x7fe6dc072410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:24.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.291+0000 7fe6fbe00640 1 -- 172.21.15.161:0/2823807804 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6fc051c10 con 0x7fe704153890 2024-01-18T00:47:24.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.291+0000 7fe703400640 1 --2- 172.21.15.161:0/2823807804 >> [v2:172.21.15.190:6816/3551605927,v1:172.21.15.190:6817/3551605927] conn(0x7fe6dc06ff70 0x7fe6dc072410 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:24.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.291+0000 7fe6fbe00640 1 -- 172.21.15.161:0/2823807804 <== osd.5 v2:172.21.15.190:6816/3551605927 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe6dc072ae0 con 0x7fe6dc06ff70 2024-01-18T00:47:24.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.307+0000 7fe70aa00640 1 -- 172.21.15.161:0/2823807804 --> [v2:172.21.15.190:6816/3551605927,v1:172.21.15.190:6817/3551605927] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe7040cbbb0 con 0x7fe6dc06ff70 2024-01-18T00:47:24.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.307+0000 7fe6fbe00640 1 -- 172.21.15.161:0/2823807804 <== osd.5 v2:172.21.15.190:6816/3551605927 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe6ec0ab920 con 0x7fe6dc06ff70 2024-01-18T00:47:24.307 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-01-18T00:47:24.307 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-18T00:47:24.307 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-01-18T00:47:24.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.307+0000 7fe70aa00640 1 -- 172.21.15.161:0/2823807804 >> [v2:172.21.15.190:6816/3551605927,v1:172.21.15.190:6817/3551605927] conn(0x7fe6dc06ff70 msgr2=0x7fe6dc072410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:24.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.307+0000 7fe70aa00640 1 --2- 172.21.15.161:0/2823807804 >> [v2:172.21.15.190:6816/3551605927,v1:172.21.15.190:6817/3551605927] conn(0x7fe6dc06ff70 0x7fe6dc072410 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:24.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.307+0000 7fe70aa00640 1 -- 172.21.15.161:0/2823807804 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe6dc066890 msgr2=0x7fe6dc068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:24.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.307+0000 7fe70aa00640 1 --2- 172.21.15.161:0/2823807804 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe6dc066890 0x7fe6dc068d50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009ab0 tx=0x7fe6f4009240 comp rx=0 tx=0).stop 2024-01-18T00:47:24.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.307+0000 7fe70aa00640 1 -- 172.21.15.161:0/2823807804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe704153890 msgr2=0x7fe7040acf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:24.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.307+0000 7fe70aa00640 1 --2- 172.21.15.161:0/2823807804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe704153890 0x7fe7040acf20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00c710 tx=0x7fe6fc00cbd0 comp rx=0 tx=0).stop 2024-01-18T00:47:24.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.307+0000 7fe708a00640 1 -- 172.21.15.161:0/2823807804 reap_dead start 2024-01-18T00:47:24.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.307+0000 7fe70aa00640 1 -- 172.21.15.161:0/2823807804 shutdown_connections 2024-01-18T00:47:24.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.307+0000 7fe70aa00640 1 -- 172.21.15.161:0/2823807804 >> 172.21.15.161:0/2823807804 conn(0x7fe70406aae0 msgr2=0x7fe70415b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:24.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.307+0000 7fe70aa00640 1 -- 172.21.15.161:0/2823807804 shutdown_connections 2024-01-18T00:47:24.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.307+0000 7fe70aa00640 1 -- 172.21.15.161:0/2823807804 wait complete. 2024-01-18T00:47:24.329 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-18T00:47:24.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.467+0000 7f918a000640 1 Processor -- start 2024-01-18T00:47:24.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.467+0000 7f918a000640 1 -- start start 2024-01-18T00:47:24.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.467+0000 7f918a000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9184150560 0x7f9184156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:24.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.467+0000 7f918a000640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f91840c5a70 0x7f9184159910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:24.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.467+0000 7f918a000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918406dc10 con 0x7f91840c0090 2024-01-18T00:47:24.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.467+0000 7f918a000640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f918406d7e0 con 0x7f91840c5a70 2024-01-18T00:47:24.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.467+0000 7f918a000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91841564c0 con 0x7f9184150560 2024-01-18T00:47:24.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.467+0000 7f9183e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f91840c0090 0x7f91840722e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:57368/0 (socket says 172.21.15.161:57368) 2024-01-18T00:47:24.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.467+0000 7f9183e00640 1 -- 172.21.15.161:0/1306111774 learned_addr learned my addr 172.21.15.161:0/1306111774 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-18T00:47:24.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.467+0000 7f9183400640 1 --2- 172.21.15.161:0/1306111774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9184150560 0x7f9184156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:24.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.467+0000 7f9182a00640 1 --2- 172.21.15.161:0/1306111774 >> v2:172.21.15.190:3300/0 conn(0x7f91840c5a70 0x7f9184159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:24.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.471+0000 7f9182000640 1 -- 172.21.15.161:0/1306111774 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275547763 0 0) 0x7f918406dc10 con 0x7f91840c0090 2024-01-18T00:47:24.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.471+0000 7f9182000640 1 -- 172.21.15.161:0/1306111774 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9164003530 con 0x7f91840c0090 2024-01-18T00:47:24.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.475+0000 7f9182000640 1 -- 172.21.15.161:0/1306111774 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1354645076 0 0) 0x7f9164003530 con 0x7f91840c0090 2024-01-18T00:47:24.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.475+0000 7f9182000640 1 -- 172.21.15.161:0/1306111774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9184150560 msgr2=0x7f9184156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:24.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.475+0000 7f9182000640 1 --2- 172.21.15.161:0/1306111774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9184150560 0x7f9184156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:24.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.475+0000 7f9182000640 1 -- 172.21.15.161:0/1306111774 >> v2:172.21.15.190:3300/0 conn(0x7f91840c5a70 msgr2=0x7f9184159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:24.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.475+0000 7f9182000640 1 --2- 172.21.15.161:0/1306111774 >> v2:172.21.15.190:3300/0 conn(0x7f91840c5a70 0x7f9184159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:24.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.475+0000 7f9182000640 1 -- 172.21.15.161:0/1306111774 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918406d220 con 0x7f91840c0090 2024-01-18T00:47:24.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.475+0000 7f9182000640 1 -- 172.21.15.161:0/1306111774 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f917c001a20 con 0x7f91840c0090 2024-01-18T00:47:24.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.475+0000 7f9182000640 1 -- 172.21.15.161:0/1306111774 >> v1:172.21.15.161:6789/0 conn(0x7f91840c0090 legacy=0x7f91840722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:24.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.475+0000 7f9182000640 1 --2- 172.21.15.161:0/1306111774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9164003980 0x7f9164003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:24.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.475+0000 7f9182000640 1 --2- 172.21.15.161:0/1306111774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91640047d0 0x7f9164004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:24.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.475+0000 7f9182000640 1 --2- 172.21.15.161:0/1306111774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9184150560 0x7f9164005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:24.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.475+0000 7f9182000640 1 -- 172.21.15.161:0/1306111774 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918406d7e0 con 0x7f9164003980 2024-01-18T00:47:24.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.475+0000 7f9182000640 1 -- 172.21.15.161:0/1306111774 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91841564c0 con 0x7f91640047d0 2024-01-18T00:47:24.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.475+0000 7f9182000640 1 -- 172.21.15.161:0/1306111774 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916400b9e0 con 0x7f9184150560 2024-01-18T00:47:24.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.487+0000 7f9183e00640 1 --2- 172.21.15.161:0/1306111774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9184150560 0x7f9164005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:24.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.487+0000 7f9182a00640 1 --2- 172.21.15.161:0/1306111774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91640047d0 0x7f9164004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:24.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.495+0000 7f9183400640 1 --2- 172.21.15.161:0/1306111774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9164003980 0x7f9164003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:24.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.495+0000 7f9183e00640 1 -- 172.21.15.161:0/1306111774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91640047d0 msgr2=0x7f9164004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:24.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.495+0000 7f9183e00640 1 --2- 172.21.15.161:0/1306111774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91640047d0 0x7f9164004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:24.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.495+0000 7f9183e00640 1 -- 172.21.15.161:0/1306111774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9164003980 msgr2=0x7f9164003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:24.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.495+0000 7f9183e00640 1 --2- 172.21.15.161:0/1306111774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9164003980 0x7f9164003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:24.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.495+0000 7f9183e00640 1 -- 172.21.15.161:0/1306111774 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9164003530 con 0x7f9184150560 2024-01-18T00:47:24.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.503+0000 7f9183e00640 1 --2- 172.21.15.161:0/1306111774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9184150560 0x7f9164005190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f917c00a7b0 tx=0x7f917c01d260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72a4a40d638c123e server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:24.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.523+0000 7f9182000640 1 -- 172.21.15.161:0/1306111774 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c0ad630 con 0x7f9184150560 2024-01-18T00:47:24.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.523+0000 7f9182000640 1 -- 172.21.15.161:0/1306111774 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917c0a8070 con 0x7f9184150560 2024-01-18T00:47:24.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.523+0000 7f9182000640 1 -- 172.21.15.161:0/1306111774 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c0ada70 con 0x7f9184150560 2024-01-18T00:47:24.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.523+0000 7f918a000640 1 -- 172.21.15.161:0/1306111774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9184150560 msgr2=0x7f9164005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:24.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.523+0000 7f918a000640 1 --2- 172.21.15.161:0/1306111774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9184150560 0x7f9164005190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f917c00a7b0 tx=0x7f917c01d260 comp rx=0 tx=0).stop 2024-01-18T00:47:24.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.523+0000 7f9183e00640 1 -- 172.21.15.161:0/1306111774 reap_dead start 2024-01-18T00:47:24.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.523+0000 7f918a000640 1 -- 172.21.15.161:0/1306111774 shutdown_connections 2024-01-18T00:47:24.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.523+0000 7f918a000640 1 -- 172.21.15.161:0/1306111774 >> 172.21.15.161:0/1306111774 conn(0x7f91840cb070 msgr2=0x7f91840cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:24.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.523+0000 7f918a000640 1 -- 172.21.15.161:0/1306111774 shutdown_connections 2024-01-18T00:47:24.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.523+0000 7f918a000640 1 -- 172.21.15.161:0/1306111774 wait complete. 2024-01-18T00:47:24.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.527+0000 7f918a000640 1 Processor -- start 2024-01-18T00:47:24.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.527+0000 7f918a000640 1 -- start start 2024-01-18T00:47:24.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.527+0000 7f918a000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9184150560 0x7f91840ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:24.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.527+0000 7f918a000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f918415cc80 0x7f9184149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:24.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.527+0000 7f918a000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9184160050 0x7f91841604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:24.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.527+0000 7f918a000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91840adb80 con 0x7f9184160050 2024-01-18T00:47:24.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.527+0000 7f918a000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918414a360 con 0x7f918415cc80 2024-01-18T00:47:24.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.527+0000 7f918a000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91840cac30 con 0x7f9184150560 2024-01-18T00:47:24.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.531+0000 7f9182a00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f918415cc80 0x7f9184149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:24.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.531+0000 7f9183400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9184150560 0x7f91840ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:24.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.531+0000 7f9182a00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f918415cc80 0x7f9184149e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:55900/0 (socket says 172.21.15.161:55900) 2024-01-18T00:47:24.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.531+0000 7f9182a00640 1 -- 172.21.15.161:0/2277172562 learned_addr learned my addr 172.21.15.161:0/2277172562 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:24.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.539+0000 7f9183e00640 1 --2- 172.21.15.161:0/2277172562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9184160050 0x7f91841604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:24.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.543+0000 7f9182a00640 1 -- 172.21.15.161:0/2277172562 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9184150560 msgr2=0x7f91840ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:24.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.543+0000 7f9182a00640 1 --2- 172.21.15.161:0/2277172562 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9184150560 0x7f91840ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:24.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.543+0000 7f9182a00640 1 -- 172.21.15.161:0/2277172562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9184160050 msgr2=0x7f91841604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:24.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.543+0000 7f9182a00640 1 --2- 172.21.15.161:0/2277172562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9184160050 0x7f91841604d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:24.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.543+0000 7f9182a00640 1 -- 172.21.15.161:0/2277172562 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91841f2a60 con 0x7f918415cc80 2024-01-18T00:47:24.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.551+0000 7f9182a00640 1 --2- 172.21.15.161:0/2277172562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f918415cc80 0x7f9184149e20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f916c0119d0 tx=0x7f916c011e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:24.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.563+0000 7f917b400640 1 -- 172.21.15.161:0/2277172562 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00fb50 con 0x7f918415cc80 2024-01-18T00:47:24.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.563+0000 7f917b400640 1 -- 172.21.15.161:0/2277172562 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c00fcb0 con 0x7f918415cc80 2024-01-18T00:47:24.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.563+0000 7f917b400640 1 -- 172.21.15.161:0/2277172562 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c014440 con 0x7f918415cc80 2024-01-18T00:47:24.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.563+0000 7f918a000640 1 -- 172.21.15.161:0/2277172562 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91841f2d40 con 0x7f918415cc80 2024-01-18T00:47:24.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.563+0000 7f918a000640 1 -- 172.21.15.161:0/2277172562 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91841f3300 con 0x7f918415cc80 2024-01-18T00:47:24.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.563+0000 7f918a000640 1 -- 172.21.15.161:0/2277172562 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91840711b0 con 0x7f918415cc80 2024-01-18T00:47:24.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.991+0000 7f917b400640 1 -- 172.21.15.161:0/2277172562 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f916c01d400 con 0x7f918415cc80 2024-01-18T00:47:24.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.991+0000 7f917b400640 1 --2- 172.21.15.161:0/2277172562 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f915c066830 0x7f915c068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:24.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.991+0000 7f9183400640 1 --2- 172.21.15.161:0/2277172562 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f915c066830 0x7f915c068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:24.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.995+0000 7f9183400640 1 --2- 172.21.15.161:0/2277172562 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f915c066830 0x7f915c068cf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9174009ae0 tx=0x7f9174008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:25.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:24.999+0000 7f917b400640 1 -- 172.21.15.161:0/2277172562 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f916c055b00 con 0x7f918415cc80 2024-01-18T00:47:25.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.027+0000 7f917b400640 1 -- 172.21.15.161:0/2277172562 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f916c051e40 con 0x7f918415cc80 2024-01-18T00:47:25.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.183+0000 7f918a000640 1 -- 172.21.15.161:0/2277172562 --> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f91840711b0 con 0x7f915c066830 2024-01-18T00:47:25.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.183+0000 7f917b400640 1 -- 172.21.15.161:0/2277172562 <== mgr.4110 v2:172.21.15.161:6800/272458188 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f91840711b0 con 0x7f915c066830 2024-01-18T00:47:25.184 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 5 to deep-scrub 2024-01-18T00:47:25.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.187+0000 7f918a000640 1 -- 172.21.15.161:0/2277172562 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f915c066830 msgr2=0x7f915c068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:25.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.187+0000 7f918a000640 1 --2- 172.21.15.161:0/2277172562 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f915c066830 0x7f915c068cf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9174009ae0 tx=0x7f9174008040 comp rx=0 tx=0).stop 2024-01-18T00:47:25.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.187+0000 7f918a000640 1 -- 172.21.15.161:0/2277172562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f918415cc80 msgr2=0x7f9184149e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:25.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.187+0000 7f918a000640 1 --2- 172.21.15.161:0/2277172562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f918415cc80 0x7f9184149e20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f916c0119d0 tx=0x7f916c011e90 comp rx=0 tx=0).stop 2024-01-18T00:47:25.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.187+0000 7f918a000640 1 -- 172.21.15.161:0/2277172562 shutdown_connections 2024-01-18T00:47:25.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.187+0000 7f918a000640 1 --2- 172.21.15.161:0/2277172562 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f915c066830 0x7f915c068cf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:25.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.187+0000 7f918a000640 1 --2- 172.21.15.161:0/2277172562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f918415cc80 0x7f9184149e20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:25.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.187+0000 7f918a000640 1 --2- 172.21.15.161:0/2277172562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9184160050 0x7f91841604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:25.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.187+0000 7f918a000640 1 --2- 172.21.15.161:0/2277172562 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9184150560 0x7f91840ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:25.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.187+0000 7f918a000640 1 -- 172.21.15.161:0/2277172562 >> 172.21.15.161:0/2277172562 conn(0x7f91840cb070 msgr2=0x7f91840c06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:25.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.187+0000 7f918a000640 1 -- 172.21.15.161:0/2277172562 shutdown_connections 2024-01-18T00:47:25.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.187+0000 7f918a000640 1 -- 172.21.15.161:0/2277172562 wait complete. 2024-01-18T00:47:25.206 INFO:tasks.ceph:Scrubbing osd.6 2024-01-18T00:47:25.206 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-18T00:47:25.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.347+0000 7fc862800640 1 Processor -- start 2024-01-18T00:47:25.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.347+0000 7fc862800640 1 -- start start 2024-01-18T00:47:25.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.347+0000 7fc862800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc85c0c93a0 0x7fc85c164fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:25.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.347+0000 7fc862800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c15a5e0 con 0x7fc85c0ca2b0 2024-01-18T00:47:25.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.347+0000 7fc862800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c153d90 con 0x7fc85c1539b0 2024-01-18T00:47:25.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.347+0000 7fc862800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c15ce40 con 0x7fc85c0c93a0 2024-01-18T00:47:25.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.351+0000 7fc85aa00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc85c0ca2b0 0x7fc85c15d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:57376/0 (socket says 172.21.15.161:57376) 2024-01-18T00:47:25.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.351+0000 7fc85aa00640 1 -- 172.21.15.161:0/3292074357 learned_addr learned my addr 172.21.15.161:0/3292074357 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-18T00:47:25.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.351+0000 7fc85a000640 1 -- 172.21.15.161:0/3292074357 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80293709 0 0) 0x7fc85c15a5e0 con 0x7fc85c0ca2b0 2024-01-18T00:47:25.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.351+0000 7fc85a000640 1 -- 172.21.15.161:0/3292074357 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc83c003530 con 0x7fc85c0ca2b0 2024-01-18T00:47:25.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.355+0000 7fc85a000640 1 -- 172.21.15.161:0/3292074357 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1290544221 0 0) 0x7fc83c003530 con 0x7fc85c0ca2b0 2024-01-18T00:47:25.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.355+0000 7fc85a000640 1 -- 172.21.15.161:0/3292074357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc85c0c93a0 msgr2=0x7fc85c164fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:25.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.355+0000 7fc85a000640 1 --2- 172.21.15.161:0/3292074357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc85c0c93a0 0x7fc85c164fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:25.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.355+0000 7fc85a000640 1 -- 172.21.15.161:0/3292074357 >> v1:172.21.15.190:6789/0 conn(0x7fc85c1539b0 legacy=0x7fc85c070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:25.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.355+0000 7fc85a000640 1 -- 172.21.15.161:0/3292074357 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c0c7900 con 0x7fc85c0ca2b0 2024-01-18T00:47:25.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.355+0000 7fc85a000640 1 -- 172.21.15.161:0/3292074357 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7fc844001680 con 0x7fc85c0ca2b0 2024-01-18T00:47:25.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.355+0000 7fc85a000640 1 -- 172.21.15.161:0/3292074357 >> v1:172.21.15.161:6789/0 conn(0x7fc85c0ca2b0 legacy=0x7fc85c15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:25.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.355+0000 7fc85a000640 1 --2- 172.21.15.161:0/3292074357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc83c0039b0 0x7fc83c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:25.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.355+0000 7fc85a000640 1 --2- 172.21.15.161:0/3292074357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc83c0047d0 0x7fc83c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:25.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.355+0000 7fc85a000640 1 --2- 172.21.15.161:0/3292074357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc83c0052b0 0x7fc83c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:25.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.355+0000 7fc85a000640 1 -- 172.21.15.161:0/3292074357 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c15ce40 con 0x7fc83c0052b0 2024-01-18T00:47:25.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.355+0000 7fc85a000640 1 -- 172.21.15.161:0/3292074357 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c00c160 con 0x7fc83c0039b0 2024-01-18T00:47:25.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.355+0000 7fc85a000640 1 -- 172.21.15.161:0/3292074357 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c00c320 con 0x7fc83c0047d0 2024-01-18T00:47:25.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.359+0000 7fc85be00640 1 --2- 172.21.15.161:0/3292074357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc83c0052b0 0x7fc83c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:25.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.363+0000 7fc85aa00640 1 --2- 172.21.15.161:0/3292074357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc83c0047d0 0x7fc83c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:25.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.363+0000 7fc85be00640 1 -- 172.21.15.161:0/3292074357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc83c0047d0 msgr2=0x7fc83c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:25.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.363+0000 7fc85be00640 1 --2- 172.21.15.161:0/3292074357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc83c0047d0 0x7fc83c004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:25.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.363+0000 7fc85be00640 1 -- 172.21.15.161:0/3292074357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc83c0039b0 msgr2=0x7fc83c003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:25.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.363+0000 7fc85be00640 1 --2- 172.21.15.161:0/3292074357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc83c0039b0 0x7fc83c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:25.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.363+0000 7fc85be00640 1 -- 172.21.15.161:0/3292074357 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c003530 con 0x7fc83c0052b0 2024-01-18T00:47:25.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.367+0000 7fc85be00640 1 --2- 172.21.15.161:0/3292074357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc83c0052b0 0x7fc83c00b990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc85c071820 tx=0x7fc85401cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a444199554c959c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:25.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.371+0000 7fc85a000640 1 -- 172.21.15.161:0/3292074357 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8540a5d20 con 0x7fc83c0052b0 2024-01-18T00:47:25.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.371+0000 7fc85a000640 1 -- 172.21.15.161:0/3292074357 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8540ad440 con 0x7fc83c0052b0 2024-01-18T00:47:25.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.371+0000 7fc85a000640 1 -- 172.21.15.161:0/3292074357 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8540a5ea0 con 0x7fc83c0052b0 2024-01-18T00:47:25.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.371+0000 7fc862800640 1 -- 172.21.15.161:0/3292074357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc83c0052b0 msgr2=0x7fc83c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:25.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.371+0000 7fc862800640 1 --2- 172.21.15.161:0/3292074357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc83c0052b0 0x7fc83c00b990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc85c071820 tx=0x7fc85401cd10 comp rx=0 tx=0).stop 2024-01-18T00:47:25.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.371+0000 7fc85be00640 1 -- 172.21.15.161:0/3292074357 reap_dead start 2024-01-18T00:47:25.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.371+0000 7fc862800640 1 -- 172.21.15.161:0/3292074357 shutdown_connections 2024-01-18T00:47:25.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.371+0000 7fc862800640 1 -- 172.21.15.161:0/3292074357 >> 172.21.15.161:0/3292074357 conn(0x7fc85c06ad40 msgr2=0x7fc85c06f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:25.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.371+0000 7fc862800640 1 -- 172.21.15.161:0/3292074357 shutdown_connections 2024-01-18T00:47:25.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.371+0000 7fc862800640 1 -- 172.21.15.161:0/3292074357 wait complete. 2024-01-18T00:47:25.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.375+0000 7fc862800640 1 Processor -- start 2024-01-18T00:47:25.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.375+0000 7fc862800640 1 -- start start 2024-01-18T00:47:25.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.375+0000 7fc862800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc83c0052b0 0x7fc85c1522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:25.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.375+0000 7fc862800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc85c1f2a10 0x7fc85c0cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:25.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.375+0000 7fc862800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc85c0c6e60 0x7fc85c0cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:25.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.375+0000 7fc862800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c1f0910 con 0x7fc85c1f2a10 2024-01-18T00:47:25.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.375+0000 7fc862800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c1f0bf0 con 0x7fc83c0052b0 2024-01-18T00:47:25.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.375+0000 7fc862800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c1543e0 con 0x7fc85c0c6e60 2024-01-18T00:47:25.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.375+0000 7fc85aa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc85c1f2a10 0x7fc85c0cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:25.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.375+0000 7fc85aa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc85c1f2a10 0x7fc85c0cabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39412/0 (socket says 172.21.15.161:39412) 2024-01-18T00:47:25.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.375+0000 7fc85aa00640 1 -- 172.21.15.161:0/1406469979 learned_addr learned my addr 172.21.15.161:0/1406469979 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:25.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.375+0000 7fc85b400640 1 --2- 172.21.15.161:0/1406469979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc83c0052b0 0x7fc85c1522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:25.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.375+0000 7fc85be00640 1 --2- 172.21.15.161:0/1406469979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc85c0c6e60 0x7fc85c0cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:25.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.379+0000 7fc85aa00640 1 -- 172.21.15.161:0/1406469979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc85c0c6e60 msgr2=0x7fc85c0cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:25.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.379+0000 7fc85aa00640 1 --2- 172.21.15.161:0/1406469979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc85c0c6e60 0x7fc85c0cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:25.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.379+0000 7fc85aa00640 1 -- 172.21.15.161:0/1406469979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc83c0052b0 msgr2=0x7fc85c1522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:25.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.379+0000 7fc85aa00640 1 --2- 172.21.15.161:0/1406469979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc83c0052b0 0x7fc85c1522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:25.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.379+0000 7fc85aa00640 1 -- 172.21.15.161:0/1406469979 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c1f2f50 con 0x7fc85c1f2a10 2024-01-18T00:47:25.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.383+0000 7fc85aa00640 1 --2- 172.21.15.161:0/1406469979 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc85c1f2a10 0x7fc85c0cabb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc84400d7d0 tx=0x7fc84400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:25.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.383+0000 7fc853400640 1 -- 172.21.15.161:0/1406469979 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8440074e0 con 0x7fc85c1f2a10 2024-01-18T00:47:25.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.387+0000 7fc853400640 1 -- 172.21.15.161:0/1406469979 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc844007640 con 0x7fc85c1f2a10 2024-01-18T00:47:25.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.387+0000 7fc862800640 1 -- 172.21.15.161:0/1406469979 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85c1f3230 con 0x7fc85c1f2a10 2024-01-18T00:47:25.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.387+0000 7fc853400640 1 -- 172.21.15.161:0/1406469979 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844004a10 con 0x7fc85c1f2a10 2024-01-18T00:47:25.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.387+0000 7fc862800640 1 -- 172.21.15.161:0/1406469979 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85c1f37f0 con 0x7fc85c1f2a10 2024-01-18T00:47:25.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.387+0000 7fc862800640 1 -- 172.21.15.161:0/1406469979 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc85c15a020 con 0x7fc85c1f2a10 2024-01-18T00:47:25.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.407+0000 7fc853400640 1 -- 172.21.15.161:0/1406469979 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fc84400b6b0 con 0x7fc85c1f2a10 2024-01-18T00:47:25.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.407+0000 7fc853400640 1 --2- 172.21.15.161:0/1406469979 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc834066840 0x7fc834068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:25.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.407+0000 7fc85b400640 1 --2- 172.21.15.161:0/1406469979 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc834066840 0x7fc834068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:25.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.407+0000 7fc853400640 1 -- 172.21.15.161:0/1406469979 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fc844055440 con 0x7fc85c1f2a10 2024-01-18T00:47:25.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.407+0000 7fc85b400640 1 --2- 172.21.15.161:0/1406469979 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc834066840 0x7fc834068d00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc84c007fd0 tx=0x7fc84c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:25.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.407+0000 7fc853400640 1 --2- 172.21.15.161:0/1406469979 >> [v2:172.21.15.190:6808/3291452378,v1:172.21.15.190:6809/3291452378] conn(0x7fc83406ff20 0x7fc8340723c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:25.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.407+0000 7fc853400640 1 -- 172.21.15.161:0/1406469979 --> [v2:172.21.15.190:6808/3291452378,v1:172.21.15.190:6809/3291452378] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc834072a90 con 0x7fc83406ff20 2024-01-18T00:47:25.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.407+0000 7fc85be00640 1 --2- 172.21.15.161:0/1406469979 >> [v2:172.21.15.190:6808/3291452378,v1:172.21.15.190:6809/3291452378] conn(0x7fc83406ff20 0x7fc8340723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:25.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.407+0000 7fc85be00640 1 --2- 172.21.15.161:0/1406469979 >> [v2:172.21.15.190:6808/3291452378,v1:172.21.15.190:6809/3291452378] conn(0x7fc83406ff20 0x7fc8340723c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:25.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.407+0000 7fc853400640 1 -- 172.21.15.161:0/1406469979 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc844051780 con 0x7fc85c1f2a10 2024-01-18T00:47:25.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.411+0000 7fc853400640 1 -- 172.21.15.161:0/1406469979 <== osd.6 v2:172.21.15.190:6808/3291452378 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc834072a90 con 0x7fc83406ff20 2024-01-18T00:47:25.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.423+0000 7fc862800640 1 -- 172.21.15.161:0/1406469979 --> [v2:172.21.15.190:6808/3291452378,v1:172.21.15.190:6809/3291452378] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc85c159d40 con 0x7fc83406ff20 2024-01-18T00:47:25.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.423+0000 7fc853400640 1 -- 172.21.15.161:0/1406469979 <== osd.6 v2:172.21.15.190:6808/3291452378 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc8540ad5b0 con 0x7fc83406ff20 2024-01-18T00:47:25.425 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-01-18T00:47:25.425 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-18T00:47:25.426 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-01-18T00:47:25.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.423+0000 7fc862800640 1 -- 172.21.15.161:0/1406469979 >> [v2:172.21.15.190:6808/3291452378,v1:172.21.15.190:6809/3291452378] conn(0x7fc83406ff20 msgr2=0x7fc8340723c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:25.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.423+0000 7fc862800640 1 --2- 172.21.15.161:0/1406469979 >> [v2:172.21.15.190:6808/3291452378,v1:172.21.15.190:6809/3291452378] conn(0x7fc83406ff20 0x7fc8340723c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.427+0000 7fc862800640 1 -- 172.21.15.161:0/1406469979 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc834066840 msgr2=0x7fc834068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.427+0000 7fc862800640 1 --2- 172.21.15.161:0/1406469979 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fc834066840 0x7fc834068d00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc84c007fd0 tx=0x7fc84c009040 comp rx=0 tx=0).stop 2024-01-18T00:47:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.427+0000 7fc862800640 1 -- 172.21.15.161:0/1406469979 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc85c1f2a10 msgr2=0x7fc85c0cabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.427+0000 7fc862800640 1 --2- 172.21.15.161:0/1406469979 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc85c1f2a10 0x7fc85c0cabb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc84400d7d0 tx=0x7fc84400dc90 comp rx=0 tx=0).stop 2024-01-18T00:47:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.427+0000 7fc85be00640 1 -- 172.21.15.161:0/1406469979 reap_dead start 2024-01-18T00:47:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.427+0000 7fc862800640 1 -- 172.21.15.161:0/1406469979 shutdown_connections 2024-01-18T00:47:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.427+0000 7fc862800640 1 -- 172.21.15.161:0/1406469979 >> 172.21.15.161:0/1406469979 conn(0x7fc85c06ad40 msgr2=0x7fc85c1580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.427+0000 7fc862800640 1 -- 172.21.15.161:0/1406469979 shutdown_connections 2024-01-18T00:47:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.427+0000 7fc862800640 1 -- 172.21.15.161:0/1406469979 wait complete. 2024-01-18T00:47:25.445 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-18T00:47:25.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.599+0000 7f443e000640 1 Processor -- start 2024-01-18T00:47:25.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.599+0000 7f443e000640 1 -- start start 2024-01-18T00:47:25.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.599+0000 7f443e000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f44381508d0 0x7f443806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:25.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.599+0000 7f443e000640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4438156b80 0x7f4438157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:25.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.599+0000 7f443e000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44380c1450 con 0x7f4438156fe0 2024-01-18T00:47:25.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.599+0000 7f443e000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4438159820 con 0x7f44381508d0 2024-01-18T00:47:25.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.599+0000 7f443e000640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44380c1730 con 0x7f4438156b80 2024-01-18T00:47:25.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.615+0000 7f4437400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f44381508d0 0x7f443806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:25.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.619+0000 7f4437400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f44381508d0 0x7f443806e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39422/0 (socket says 172.21.15.161:39422) 2024-01-18T00:47:25.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.619+0000 7f4437400640 1 -- 172.21.15.161:0/4011032123 learned_addr learned my addr 172.21.15.161:0/4011032123 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:25.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.627+0000 7f4437400640 1 -- 172.21.15.161:0/4011032123 >> v2:172.21.15.190:3300/0 conn(0x7f4438156b80 msgr2=0x7f4438157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:25.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.627+0000 7f4437400640 1 --2- 172.21.15.161:0/4011032123 >> v2:172.21.15.190:3300/0 conn(0x7f4438156b80 0x7f4438157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:25.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.627+0000 7f4437400640 1 -- 172.21.15.161:0/4011032123 >> v1:172.21.15.161:6789/0 conn(0x7f4438156fe0 legacy=0x7f4438156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:25.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.627+0000 7f4437400640 1 -- 172.21.15.161:0/4011032123 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44380c1a10 con 0x7f44381508d0 2024-01-18T00:47:25.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.631+0000 7f4437400640 1 --2- 172.21.15.161:0/4011032123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44381508d0 0x7f443806e980 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4438071f00 tx=0x7f442801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ac32700b983a0f server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:25.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.635+0000 7f4436000640 1 -- 172.21.15.161:0/4011032123 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44280a89b0 con 0x7f44381508d0 2024-01-18T00:47:25.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.635+0000 7f4436000640 1 -- 172.21.15.161:0/4011032123 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44280a8b10 con 0x7f44381508d0 2024-01-18T00:47:25.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.635+0000 7f4436000640 1 -- 172.21.15.161:0/4011032123 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44280a8ea0 con 0x7f44381508d0 2024-01-18T00:47:25.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.635+0000 7f443e000640 1 -- 172.21.15.161:0/4011032123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44381508d0 msgr2=0x7f443806e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:25.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.635+0000 7f443e000640 1 --2- 172.21.15.161:0/4011032123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44381508d0 0x7f443806e980 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4438071f00 tx=0x7f442801ecb0 comp rx=0 tx=0).stop 2024-01-18T00:47:25.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.635+0000 7f443e000640 1 -- 172.21.15.161:0/4011032123 shutdown_connections 2024-01-18T00:47:25.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.635+0000 7f443e000640 1 --2- 172.21.15.161:0/4011032123 >> v2:172.21.15.190:3300/0 conn(0x7f4438156b80 0x7f4438157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:25.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.635+0000 7f443e000640 1 --2- 172.21.15.161:0/4011032123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44381508d0 0x7f443806e980 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:25.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.635+0000 7f443e000640 1 -- 172.21.15.161:0/4011032123 >> 172.21.15.161:0/4011032123 conn(0x7f443806fc50 msgr2=0x7f4438070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:25.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.635+0000 7f443e000640 1 -- 172.21.15.161:0/4011032123 shutdown_connections 2024-01-18T00:47:25.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.635+0000 7f443e000640 1 -- 172.21.15.161:0/4011032123 wait complete. 2024-01-18T00:47:25.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.635+0000 7f443e000640 1 Processor -- start 2024-01-18T00:47:25.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.639+0000 7f443e000640 1 -- start start 2024-01-18T00:47:25.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.639+0000 7f443e000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44381508d0 0x7f44380c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:25.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.639+0000 7f443e000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4438156fe0 0x7f44381f07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:25.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.639+0000 7f443e000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4438150de0 0x7f44381455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:25.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.639+0000 7f443e000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44381f1550 con 0x7f44381508d0 2024-01-18T00:47:25.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.639+0000 7f443e000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443814d660 con 0x7f4438156fe0 2024-01-18T00:47:25.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.639+0000 7f443e000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44380c9040 con 0x7f4438150de0 2024-01-18T00:47:25.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.639+0000 7f4437400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44381508d0 0x7f44380c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:25.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.639+0000 7f4437400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44381508d0 0x7f44380c8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39424/0 (socket says 172.21.15.161:39424) 2024-01-18T00:47:25.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.639+0000 7f4437400640 1 -- 172.21.15.161:0/2936098011 learned_addr learned my addr 172.21.15.161:0/2936098011 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:25.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.643+0000 7f4437400640 1 -- 172.21.15.161:0/2936098011 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4438150de0 msgr2=0x7f44381455c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:25.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.643+0000 7f4437400640 1 --2- 172.21.15.161:0/2936098011 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4438150de0 0x7f44381455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:25.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.643+0000 7f4437400640 1 -- 172.21.15.161:0/2936098011 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4438156fe0 msgr2=0x7f44381f07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:25.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.643+0000 7f4437400640 1 --2- 172.21.15.161:0/2936098011 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4438156fe0 0x7f44381f07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:25.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.643+0000 7f4437400640 1 -- 172.21.15.161:0/2936098011 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44280094d0 con 0x7f44381508d0 2024-01-18T00:47:25.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.647+0000 7f4437400640 1 --2- 172.21.15.161:0/2936098011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44381508d0 0x7f44380c8b00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f442801b8c0 tx=0x7f442801ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:25.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.651+0000 7f442f400640 1 -- 172.21.15.161:0/2936098011 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44280b0e20 con 0x7f44381508d0 2024-01-18T00:47:25.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.651+0000 7f442f400640 1 -- 172.21.15.161:0/2936098011 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44280ba440 con 0x7f44381508d0 2024-01-18T00:47:25.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.651+0000 7f443e000640 1 -- 172.21.15.161:0/2936098011 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4438159280 con 0x7f44381508d0 2024-01-18T00:47:25.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.651+0000 7f442f400640 1 -- 172.21.15.161:0/2936098011 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44280ba7f0 con 0x7f44381508d0 2024-01-18T00:47:25.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.651+0000 7f443e000640 1 -- 172.21.15.161:0/2936098011 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44381f1270 con 0x7f44381508d0 2024-01-18T00:47:25.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.655+0000 7f443e000640 1 -- 172.21.15.161:0/2936098011 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44380746a0 con 0x7f44381508d0 2024-01-18T00:47:25.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.895+0000 7f442f400640 1 -- 172.21.15.161:0/2936098011 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f44280ba950 con 0x7f44381508d0 2024-01-18T00:47:25.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.895+0000 7f442f400640 1 --2- 172.21.15.161:0/2936098011 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4410066870 0x7f4410068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:25.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.895+0000 7f4436a00640 1 --2- 172.21.15.161:0/2936098011 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4410066870 0x7f4410068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:25.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.895+0000 7f4436a00640 1 --2- 172.21.15.161:0/2936098011 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4410066870 0x7f4410068d30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f44381569f0 tx=0x7f4420006bb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:25.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.915+0000 7f442f400640 1 -- 172.21.15.161:0/2936098011 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f44280f4280 con 0x7f44381508d0 2024-01-18T00:47:25.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:25.915+0000 7f442f400640 1 -- 172.21.15.161:0/2936098011 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f44280efec0 con 0x7f44381508d0 2024-01-18T00:47:26.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.067+0000 7f443e000640 1 -- 172.21.15.161:0/2936098011 --> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f44380c1fd0 con 0x7f4410066870 2024-01-18T00:47:26.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.071+0000 7f442f400640 1 -- 172.21.15.161:0/2936098011 <== mgr.4110 v2:172.21.15.161:6800/272458188 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4420009280 con 0x7f4410066870 2024-01-18T00:47:26.070 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 6 to deep-scrub 2024-01-18T00:47:26.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.071+0000 7f443e000640 1 -- 172.21.15.161:0/2936098011 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4410066870 msgr2=0x7f4410068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:26.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.071+0000 7f443e000640 1 --2- 172.21.15.161:0/2936098011 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4410066870 0x7f4410068d30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f44381569f0 tx=0x7f4420006bb0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.071+0000 7f443e000640 1 -- 172.21.15.161:0/2936098011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44381508d0 msgr2=0x7f44380c8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:26.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.071+0000 7f443e000640 1 --2- 172.21.15.161:0/2936098011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44381508d0 0x7f44380c8b00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f442801b8c0 tx=0x7f442801ba50 comp rx=0 tx=0).stop 2024-01-18T00:47:26.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.071+0000 7f443e000640 1 -- 172.21.15.161:0/2936098011 shutdown_connections 2024-01-18T00:47:26.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.071+0000 7f443e000640 1 --2- 172.21.15.161:0/2936098011 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f4410066870 0x7f4410068d30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.071+0000 7f443e000640 1 --2- 172.21.15.161:0/2936098011 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4438156fe0 0x7f44381f07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.071+0000 7f443e000640 1 --2- 172.21.15.161:0/2936098011 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4438150de0 0x7f44381455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.071+0000 7f443e000640 1 --2- 172.21.15.161:0/2936098011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44381508d0 0x7f44380c8b00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.071+0000 7f443e000640 1 -- 172.21.15.161:0/2936098011 >> 172.21.15.161:0/2936098011 conn(0x7f443806fc50 msgr2=0x7f4438159960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:26.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.071+0000 7f443e000640 1 -- 172.21.15.161:0/2936098011 shutdown_connections 2024-01-18T00:47:26.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.071+0000 7f443e000640 1 -- 172.21.15.161:0/2936098011 wait complete. 2024-01-18T00:47:26.092 INFO:tasks.ceph:Scrubbing osd.7 2024-01-18T00:47:26.092 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-18T00:47:26.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.235+0000 7fe6ea200640 1 Processor -- start 2024-01-18T00:47:26.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.235+0000 7fe6ea200640 1 -- start start 2024-01-18T00:47:26.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.235+0000 7fe6ea200640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe6e4153a00 0x7fe6e41596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:26.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.235+0000 7fe6ea200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e406e280 0x7fe6e40c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:26.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.235+0000 7fe6ea200640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e40c8e80 con 0x7fe6e406af10 2024-01-18T00:47:26.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.235+0000 7fe6ea200640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e406ebd0 con 0x7fe6e4153a00 2024-01-18T00:47:26.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.235+0000 7fe6ea200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e4159cd0 con 0x7fe6e406e280 2024-01-18T00:47:26.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.235+0000 7fe6e3400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe6e4153a00 0x7fe6e41596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:26.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.235+0000 7fe6e2a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e406e280 0x7fe6e40c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:26.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.239+0000 7fe6e3400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe6e4153a00 0x7fe6e41596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:55962/0 (socket says 172.21.15.161:55962) 2024-01-18T00:47:26.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.239+0000 7fe6e3400640 1 -- 172.21.15.161:0/3667898282 learned_addr learned my addr 172.21.15.161:0/3667898282 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:26.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.243+0000 7fe6e2a00640 1 -- 172.21.15.161:0/3667898282 >> v2:172.21.15.190:3300/0 conn(0x7fe6e4153a00 msgr2=0x7fe6e41596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:26.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.243+0000 7fe6e2a00640 1 --2- 172.21.15.161:0/3667898282 >> v2:172.21.15.190:3300/0 conn(0x7fe6e4153a00 0x7fe6e41596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.243+0000 7fe6e2a00640 1 -- 172.21.15.161:0/3667898282 >> v1:172.21.15.190:6789/0 conn(0x7fe6e406af10 legacy=0x7fe6e40cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:26.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.243+0000 7fe6e2a00640 1 -- 172.21.15.161:0/3667898282 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e4153de0 con 0x7fe6e406e280 2024-01-18T00:47:26.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.251+0000 7fe6e2a00640 1 --2- 172.21.15.161:0/3667898282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e406e280 0x7fe6e40c9310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0097c0 tx=0x7fe6cc01c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cae5d18440a87cc4 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:26.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.263+0000 7fe6e2000640 1 -- 172.21.15.161:0/3667898282 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc0ab600 con 0x7fe6e406e280 2024-01-18T00:47:26.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.263+0000 7fe6e2000640 1 -- 172.21.15.161:0/3667898282 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6cc0a7050 con 0x7fe6e406e280 2024-01-18T00:47:26.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.263+0000 7fe6e2000640 1 -- 172.21.15.161:0/3667898282 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc0ab980 con 0x7fe6e406e280 2024-01-18T00:47:26.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.263+0000 7fe6ea200640 1 -- 172.21.15.161:0/3667898282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e406e280 msgr2=0x7fe6e40c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:26.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.263+0000 7fe6ea200640 1 --2- 172.21.15.161:0/3667898282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e406e280 0x7fe6e40c9310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0097c0 tx=0x7fe6cc01c380 comp rx=0 tx=0).stop 2024-01-18T00:47:26.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.263+0000 7fe6ea200640 1 -- 172.21.15.161:0/3667898282 shutdown_connections 2024-01-18T00:47:26.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.263+0000 7fe6ea200640 1 --2- 172.21.15.161:0/3667898282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e406e280 0x7fe6e40c9310 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.263+0000 7fe6ea200640 1 --2- 172.21.15.161:0/3667898282 >> v2:172.21.15.190:3300/0 conn(0x7fe6e4153a00 0x7fe6e41596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.263+0000 7fe6ea200640 1 -- 172.21.15.161:0/3667898282 >> 172.21.15.161:0/3667898282 conn(0x7fe6e406b7f0 msgr2=0x7fe6e406bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:26.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.263+0000 7fe6ea200640 1 -- 172.21.15.161:0/3667898282 shutdown_connections 2024-01-18T00:47:26.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.263+0000 7fe6ea200640 1 -- 172.21.15.161:0/3667898282 wait complete. 2024-01-18T00:47:26.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.267+0000 7fe6ea200640 1 Processor -- start 2024-01-18T00:47:26.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.267+0000 7fe6ea200640 1 -- start start 2024-01-18T00:47:26.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.267+0000 7fe6ea200640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e406af10 0x7fe6e4154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:26.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.267+0000 7fe6ea200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6e406e280 0x7fe6e414b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:26.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.267+0000 7fe6ea200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e4153a00 0x7fe6e40c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:26.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.267+0000 7fe6ea200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e4155260 con 0x7fe6e406e280 2024-01-18T00:47:26.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.267+0000 7fe6ea200640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e41f1a40 con 0x7fe6e406af10 2024-01-18T00:47:26.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.267+0000 7fe6ea200640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40b0e60 con 0x7fe6e4153a00 2024-01-18T00:47:26.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.267+0000 7fe6e2a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6e406e280 0x7fe6e414b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:26.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.267+0000 7fe6e2a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6e406e280 0x7fe6e414b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39438/0 (socket says 172.21.15.161:39438) 2024-01-18T00:47:26.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.267+0000 7fe6e2a00640 1 -- 172.21.15.161:0/3994280046 learned_addr learned my addr 172.21.15.161:0/3994280046 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:26.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.267+0000 7fe6e3400640 1 --2- 172.21.15.161:0/3994280046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e406af10 0x7fe6e4154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:26.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.271+0000 7fe6e3e00640 1 --2- 172.21.15.161:0/3994280046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e4153a00 0x7fe6e40c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:26.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.271+0000 7fe6e2a00640 1 -- 172.21.15.161:0/3994280046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e4153a00 msgr2=0x7fe6e40c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:26.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.271+0000 7fe6e2a00640 1 --2- 172.21.15.161:0/3994280046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e4153a00 0x7fe6e40c55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.271+0000 7fe6e2a00640 1 -- 172.21.15.161:0/3994280046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e406af10 msgr2=0x7fe6e4154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:26.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.271+0000 7fe6e2a00640 1 --2- 172.21.15.161:0/3994280046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e406af10 0x7fe6e4154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.271+0000 7fe6e2a00640 1 -- 172.21.15.161:0/3994280046 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc009420 con 0x7fe6e406e280 2024-01-18T00:47:26.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.275+0000 7fe6e2a00640 1 --2- 172.21.15.161:0/3994280046 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6e406e280 0x7fe6e414b0f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc01aa30 tx=0x7fe6cc01abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:26.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.279+0000 7fe6db400640 1 -- 172.21.15.161:0/3994280046 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc0b7450 con 0x7fe6e406e280 2024-01-18T00:47:26.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.279+0000 7fe6db400640 1 -- 172.21.15.161:0/3994280046 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6cc0b75b0 con 0x7fe6e406e280 2024-01-18T00:47:26.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.279+0000 7fe6db400640 1 -- 172.21.15.161:0/3994280046 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc0b7920 con 0x7fe6e406e280 2024-01-18T00:47:26.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.279+0000 7fe6ea200640 1 -- 172.21.15.161:0/3994280046 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e4155b70 con 0x7fe6e406e280 2024-01-18T00:47:26.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.279+0000 7fe6ea200640 1 -- 172.21.15.161:0/3994280046 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e4155dc0 con 0x7fe6e406e280 2024-01-18T00:47:26.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.279+0000 7fe6ea200640 1 -- 172.21.15.161:0/3994280046 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe6e40c6a80 con 0x7fe6e406e280 2024-01-18T00:47:26.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.299+0000 7fe6db400640 1 -- 172.21.15.161:0/3994280046 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fe6cc0b7a80 con 0x7fe6e406e280 2024-01-18T00:47:26.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.299+0000 7fe6db400640 1 --2- 172.21.15.161:0/3994280046 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe6bc066840 0x7fe6bc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:26.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.299+0000 7fe6e3400640 1 --2- 172.21.15.161:0/3994280046 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe6bc066840 0x7fe6bc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:26.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.299+0000 7fe6e3400640 1 --2- 172.21.15.161:0/3994280046 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe6bc066840 0x7fe6bc068d00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009ae0 tx=0x7fe6d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:26.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.303+0000 7fe6db400640 1 -- 172.21.15.161:0/3994280046 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fe6cc0f0720 con 0x7fe6e406e280 2024-01-18T00:47:26.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.303+0000 7fe6db400640 1 --2- 172.21.15.161:0/3994280046 >> [v2:172.21.15.190:6818/2131748209,v1:172.21.15.190:6820/2131748209] conn(0x7fe6bc06ff20 0x7fe6bc0723c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:26.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.303+0000 7fe6db400640 1 -- 172.21.15.161:0/3994280046 --> [v2:172.21.15.190:6818/2131748209,v1:172.21.15.190:6820/2131748209] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6bc072a90 con 0x7fe6bc06ff20 2024-01-18T00:47:26.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.303+0000 7fe6db400640 1 -- 172.21.15.161:0/3994280046 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6cc0ec360 con 0x7fe6e406e280 2024-01-18T00:47:26.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.303+0000 7fe6e3e00640 1 --2- 172.21.15.161:0/3994280046 >> [v2:172.21.15.190:6818/2131748209,v1:172.21.15.190:6820/2131748209] conn(0x7fe6bc06ff20 0x7fe6bc0723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:26.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.303+0000 7fe6e3e00640 1 --2- 172.21.15.161:0/3994280046 >> [v2:172.21.15.190:6818/2131748209,v1:172.21.15.190:6820/2131748209] conn(0x7fe6bc06ff20 0x7fe6bc0723c0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:26.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.307+0000 7fe6db400640 1 -- 172.21.15.161:0/3994280046 <== osd.7 v2:172.21.15.190:6818/2131748209 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe6bc072a90 con 0x7fe6bc06ff20 2024-01-18T00:47:26.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.319+0000 7fe6ea200640 1 -- 172.21.15.161:0/3994280046 --> [v2:172.21.15.190:6818/2131748209,v1:172.21.15.190:6820/2131748209] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe6e40c8b10 con 0x7fe6bc06ff20 2024-01-18T00:47:26.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.319+0000 7fe6db400640 1 -- 172.21.15.161:0/3994280046 <== osd.7 v2:172.21.15.190:6818/2131748209 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe6dc009b30 con 0x7fe6bc06ff20 2024-01-18T00:47:26.321 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-01-18T00:47:26.321 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-18T00:47:26.321 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-01-18T00:47:26.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.319+0000 7fe6ea200640 1 -- 172.21.15.161:0/3994280046 >> [v2:172.21.15.190:6818/2131748209,v1:172.21.15.190:6820/2131748209] conn(0x7fe6bc06ff20 msgr2=0x7fe6bc0723c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:26.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.319+0000 7fe6ea200640 1 --2- 172.21.15.161:0/3994280046 >> [v2:172.21.15.190:6818/2131748209,v1:172.21.15.190:6820/2131748209] conn(0x7fe6bc06ff20 0x7fe6bc0723c0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.319+0000 7fe6ea200640 1 -- 172.21.15.161:0/3994280046 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe6bc066840 msgr2=0x7fe6bc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:26.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.319+0000 7fe6ea200640 1 --2- 172.21.15.161:0/3994280046 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fe6bc066840 0x7fe6bc068d00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009ae0 tx=0x7fe6d4008040 comp rx=0 tx=0).stop 2024-01-18T00:47:26.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.319+0000 7fe6ea200640 1 -- 172.21.15.161:0/3994280046 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6e406e280 msgr2=0x7fe6e414b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:26.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.319+0000 7fe6ea200640 1 --2- 172.21.15.161:0/3994280046 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6e406e280 0x7fe6e414b0f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc01aa30 tx=0x7fe6cc01abc0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.319+0000 7fe6e3e00640 1 -- 172.21.15.161:0/3994280046 reap_dead start 2024-01-18T00:47:26.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.319+0000 7fe6ea200640 1 -- 172.21.15.161:0/3994280046 shutdown_connections 2024-01-18T00:47:26.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.319+0000 7fe6ea200640 1 -- 172.21.15.161:0/3994280046 >> 172.21.15.161:0/3994280046 conn(0x7fe6e406b7f0 msgr2=0x7fe6e406bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:26.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.319+0000 7fe6ea200640 1 -- 172.21.15.161:0/3994280046 shutdown_connections 2024-01-18T00:47:26.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.323+0000 7fe6ea200640 1 -- 172.21.15.161:0/3994280046 wait complete. 2024-01-18T00:47:26.342 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-18T00:47:26.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.479+0000 7f65b0400640 1 Processor -- start 2024-01-18T00:47:26.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.479+0000 7f65b0400640 1 -- start start 2024-01-18T00:47:26.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.483+0000 7f65b0400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f65a8156b80 0x7f65a8157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:26.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.483+0000 7f65b0400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a80c1450 con 0x7f65a8156fe0 2024-01-18T00:47:26.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.483+0000 7f65b0400640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a80c1730 con 0x7f65a81508d0 2024-01-18T00:47:26.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.483+0000 7f65b0400640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a8159820 con 0x7f65a8156b80 2024-01-18T00:47:26.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.483+0000 7f65ae400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f65a8156b80 0x7f65a8157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:26.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.483+0000 7f65ada00640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f65a81508d0 0x7f65a806e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.161:35806/0 (socket says 172.21.15.161:35806) 2024-01-18T00:47:26.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.483+0000 7f65ada00640 1 -- 172.21.15.161:0/2138330397 learned_addr learned my addr 172.21.15.161:0/2138330397 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-18T00:47:26.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.491+0000 7f65ae400640 1 -- 172.21.15.161:0/2138330397 >> v1:172.21.15.190:6789/0 conn(0x7f65a81508d0 legacy=0x7f65a806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:26.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.491+0000 7f65ae400640 1 -- 172.21.15.161:0/2138330397 >> v1:172.21.15.161:6789/0 conn(0x7f65a8156fe0 legacy=0x7f65a8156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:26.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.491+0000 7f65ae400640 1 -- 172.21.15.161:0/2138330397 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a80c1a10 con 0x7f65a8156b80 2024-01-18T00:47:26.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.499+0000 7f65ae400640 1 --2- 172.21.15.161:0/2138330397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65a8156b80 0x7f65a8157ec0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f65a0009d90 tx=0x7f65a001f100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d004f86eac96103 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:26.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.511+0000 7f65a7e00640 1 -- 172.21.15.161:0/2138330397 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a00af600 con 0x7f65a8156b80 2024-01-18T00:47:26.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.511+0000 7f65a7e00640 1 -- 172.21.15.161:0/2138330397 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a00ab050 con 0x7f65a8156b80 2024-01-18T00:47:26.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.511+0000 7f65a7e00640 1 -- 172.21.15.161:0/2138330397 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a00af980 con 0x7f65a8156b80 2024-01-18T00:47:26.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.511+0000 7f65b0400640 1 -- 172.21.15.161:0/2138330397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65a8156b80 msgr2=0x7f65a8157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:26.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.511+0000 7f65b0400640 1 --2- 172.21.15.161:0/2138330397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65a8156b80 0x7f65a8157ec0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f65a0009d90 tx=0x7f65a001f100 comp rx=0 tx=0).stop 2024-01-18T00:47:26.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.511+0000 7f65b0400640 1 -- 172.21.15.161:0/2138330397 shutdown_connections 2024-01-18T00:47:26.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.511+0000 7f65b0400640 1 --2- 172.21.15.161:0/2138330397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65a8156b80 0x7f65a8157ec0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.511+0000 7f65b0400640 1 -- 172.21.15.161:0/2138330397 >> 172.21.15.161:0/2138330397 conn(0x7f65a806fc50 msgr2=0x7f65a8070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:26.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.515+0000 7f65b0400640 1 -- 172.21.15.161:0/2138330397 shutdown_connections 2024-01-18T00:47:26.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.515+0000 7f65b0400640 1 -- 172.21.15.161:0/2138330397 wait complete. 2024-01-18T00:47:26.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.515+0000 7f65b0400640 1 Processor -- start 2024-01-18T00:47:26.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.515+0000 7f65b0400640 1 -- start start 2024-01-18T00:47:26.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.515+0000 7f65b0400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65a81508d0 0x7f65a80c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:26.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.515+0000 7f65b0400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65a8156fe0 0x7f65a80c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:26.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.515+0000 7f65b0400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65a81f2b10 0x7f65a80b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:26.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.515+0000 7f65b0400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a8152620 con 0x7f65a8156fe0 2024-01-18T00:47:26.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.515+0000 7f65b0400640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a8153df0 con 0x7f65a81f2b10 2024-01-18T00:47:26.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.515+0000 7f65b0400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a80c3e60 con 0x7f65a81508d0 2024-01-18T00:47:26.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.515+0000 7f65ad000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65a8156fe0 0x7f65a80c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:26.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.515+0000 7f65ad000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65a8156fe0 0x7f65a80c5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39452/0 (socket says 172.21.15.161:39452) 2024-01-18T00:47:26.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.515+0000 7f65ad000640 1 -- 172.21.15.161:0/2160677362 learned_addr learned my addr 172.21.15.161:0/2160677362 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:26.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.519+0000 7f65ada00640 1 --2- 172.21.15.161:0/2160677362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65a81508d0 0x7f65a80c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:26.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.519+0000 7f65ae400640 1 --2- 172.21.15.161:0/2160677362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65a81f2b10 0x7f65a80b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:26.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.519+0000 7f65ad000640 1 -- 172.21.15.161:0/2160677362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65a81508d0 msgr2=0x7f65a80c37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:26.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.519+0000 7f65ad000640 1 --2- 172.21.15.161:0/2160677362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65a81508d0 0x7f65a80c37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.519+0000 7f65ad000640 1 -- 172.21.15.161:0/2160677362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65a81f2b10 msgr2=0x7f65a80b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:26.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.519+0000 7f65ad000640 1 --2- 172.21.15.161:0/2160677362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65a81f2b10 0x7f65a80b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.519+0000 7f65ad000640 1 -- 172.21.15.161:0/2160677362 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a0009a70 con 0x7f65a8156fe0 2024-01-18T00:47:26.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.523+0000 7f65ad000640 1 --2- 172.21.15.161:0/2160677362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65a8156fe0 0x7f65a80c5510 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f659000b3e0 tx=0x7f659000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:26.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.527+0000 7f65a5600640 1 -- 172.21.15.161:0/2160677362 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6590011830 con 0x7f65a8156fe0 2024-01-18T00:47:26.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.527+0000 7f65a5600640 1 -- 172.21.15.161:0/2160677362 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65900119b0 con 0x7f65a8156fe0 2024-01-18T00:47:26.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.527+0000 7f65a5600640 1 -- 172.21.15.161:0/2160677362 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6590011d60 con 0x7f65a8156fe0 2024-01-18T00:47:26.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.527+0000 7f65b0400640 1 -- 172.21.15.161:0/2160677362 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a8153550 con 0x7f65a8156fe0 2024-01-18T00:47:26.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.527+0000 7f65b0400640 1 -- 172.21.15.161:0/2160677362 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a8153b10 con 0x7f65a8156fe0 2024-01-18T00:47:26.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.527+0000 7f65b0400640 1 -- 172.21.15.161:0/2160677362 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a8067c90 con 0x7f65a8156fe0 2024-01-18T00:47:26.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.767+0000 7f65a5600640 1 -- 172.21.15.161:0/2160677362 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f659001a400 con 0x7f65a8156fe0 2024-01-18T00:47:26.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.767+0000 7f65a5600640 1 --2- 172.21.15.161:0/2160677362 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6580066840 0x7f6580068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:26.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.771+0000 7f65ada00640 1 --2- 172.21.15.161:0/2160677362 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6580066840 0x7f6580068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:26.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.771+0000 7f65ada00640 1 --2- 172.21.15.161:0/2160677362 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6580066840 0x7f6580068d00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6598000f70 tx=0x7f6598007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:26.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.787+0000 7f65a5600640 1 -- 172.21.15.161:0/2160677362 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f6590025e50 con 0x7f65a8156fe0 2024-01-18T00:47:26.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.787+0000 7f65a5600640 1 -- 172.21.15.161:0/2160677362 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f6590051a80 con 0x7f65a8156fe0 2024-01-18T00:47:26.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.951+0000 7f65b0400640 1 -- 172.21.15.161:0/2160677362 --> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f65a81579a0 con 0x7f6580066840 2024-01-18T00:47:26.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.951+0000 7f65a5600640 1 -- 172.21.15.161:0/2160677362 <== mgr.4110 v2:172.21.15.161:6800/272458188 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f65980014a0 con 0x7f6580066840 2024-01-18T00:47:26.953 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 7 to deep-scrub 2024-01-18T00:47:26.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.955+0000 7f65b0400640 1 -- 172.21.15.161:0/2160677362 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6580066840 msgr2=0x7f6580068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:26.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.955+0000 7f65b0400640 1 --2- 172.21.15.161:0/2160677362 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6580066840 0x7f6580068d00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6598000f70 tx=0x7f6598007e90 comp rx=0 tx=0).stop 2024-01-18T00:47:26.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.955+0000 7f65b0400640 1 -- 172.21.15.161:0/2160677362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65a8156fe0 msgr2=0x7f65a80c5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:26.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.955+0000 7f65b0400640 1 --2- 172.21.15.161:0/2160677362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65a8156fe0 0x7f65a80c5510 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f659000b3e0 tx=0x7f659000b8a0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.955+0000 7f65b0400640 1 -- 172.21.15.161:0/2160677362 shutdown_connections 2024-01-18T00:47:26.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.955+0000 7f65b0400640 1 --2- 172.21.15.161:0/2160677362 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6580066840 0x7f6580068d00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.955+0000 7f65b0400640 1 --2- 172.21.15.161:0/2160677362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65a81f2b10 0x7f65a80b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.955+0000 7f65b0400640 1 --2- 172.21.15.161:0/2160677362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65a8156fe0 0x7f65a80c5510 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.955+0000 7f65b0400640 1 --2- 172.21.15.161:0/2160677362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65a81508d0 0x7f65a80c37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:26.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.955+0000 7f65b0400640 1 -- 172.21.15.161:0/2160677362 >> 172.21.15.161:0/2160677362 conn(0x7f65a806fc50 msgr2=0x7f65a8070030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:26.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.955+0000 7f65b0400640 1 -- 172.21.15.161:0/2160677362 shutdown_connections 2024-01-18T00:47:26.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:26.955+0000 7f65b0400640 1 -- 172.21.15.161:0/2160677362 wait complete. 2024-01-18T00:47:26.975 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-18T00:47:27.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.115+0000 7efeaf000640 1 Processor -- start 2024-01-18T00:47:27.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.115+0000 7efeaf000640 1 -- start start 2024-01-18T00:47:27.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.115+0000 7efeaf000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efea80c8970 0x7efea80c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:27.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.115+0000 7efeaf000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea80c9300 con 0x7efea80c9650 2024-01-18T00:47:27.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.115+0000 7efeaf000640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea80c7910 con 0x7efea8151a90 2024-01-18T00:47:27.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.115+0000 7efeaf000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea815b5d0 con 0x7efea80c8970 2024-01-18T00:47:27.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.119+0000 7efead000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efea80c8970 0x7efea80c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:27.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.119+0000 7efead000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efea80c8970 0x7efea80c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39454/0 (socket says 172.21.15.161:39454) 2024-01-18T00:47:27.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.119+0000 7efead000640 1 -- 172.21.15.161:0/3800201418 learned_addr learned my addr 172.21.15.161:0/3800201418 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:27.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.119+0000 7efead000640 1 -- 172.21.15.161:0/3800201418 >> v1:172.21.15.190:6789/0 conn(0x7efea8151a90 legacy=0x7efea8157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:27.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.119+0000 7efead000640 1 -- 172.21.15.161:0/3800201418 >> v1:172.21.15.161:6789/0 conn(0x7efea80c9650 legacy=0x7efea80c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:27.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.119+0000 7efead000640 1 -- 172.21.15.161:0/3800201418 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea806efe0 con 0x7efea80c8970 2024-01-18T00:47:27.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.123+0000 7efead000640 1 --2- 172.21.15.161:0/3800201418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efea80c8970 0x7efea80c8dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efea0009e50 tx=0x7efea001f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afa2812ced1abd1 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:27.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.127+0000 7efea6a00640 1 -- 172.21.15.161:0/3800201418 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea00af400 con 0x7efea80c8970 2024-01-18T00:47:27.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.127+0000 7efea6a00640 1 -- 172.21.15.161:0/3800201418 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea00ab050 con 0x7efea80c8970 2024-01-18T00:47:27.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.127+0000 7efea6a00640 1 -- 172.21.15.161:0/3800201418 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea00af780 con 0x7efea80c8970 2024-01-18T00:47:27.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.131+0000 7efeaf000640 1 -- 172.21.15.161:0/3800201418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efea80c8970 msgr2=0x7efea80c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:27.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.131+0000 7efeaf000640 1 --2- 172.21.15.161:0/3800201418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efea80c8970 0x7efea80c8dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efea0009e50 tx=0x7efea001f180 comp rx=0 tx=0).stop 2024-01-18T00:47:27.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.131+0000 7efeaf000640 1 -- 172.21.15.161:0/3800201418 shutdown_connections 2024-01-18T00:47:27.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.131+0000 7efeaf000640 1 --2- 172.21.15.161:0/3800201418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efea80c8970 0x7efea80c8dc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:27.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.131+0000 7efeaf000640 1 -- 172.21.15.161:0/3800201418 >> 172.21.15.161:0/3800201418 conn(0x7efea806fc50 msgr2=0x7efea8070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:27.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.131+0000 7efeaf000640 1 -- 172.21.15.161:0/3800201418 shutdown_connections 2024-01-18T00:47:27.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.131+0000 7efeaf000640 1 -- 172.21.15.161:0/3800201418 wait complete. 2024-01-18T00:47:27.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.131+0000 7efeaf000640 1 Processor -- start 2024-01-18T00:47:27.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.131+0000 7efeaf000640 1 -- start start 2024-01-18T00:47:27.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.131+0000 7efeaf000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efea80c8970 0x7efea81f11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:27.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.131+0000 7efeaf000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efea80c9650 0x7efea8146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:27.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.135+0000 7efeaf000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efea8151a90 0x7efea8157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:27.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.135+0000 7efeaf000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea8149ad0 con 0x7efea8151a90 2024-01-18T00:47:27.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.135+0000 7efeaf000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea80cbde0 con 0x7efea80c9650 2024-01-18T00:47:27.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.135+0000 7efeaf000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea81f07c0 con 0x7efea80c8970 2024-01-18T00:47:27.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.135+0000 7efea7e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efea80c8970 0x7efea81f11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:27.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.135+0000 7efea7e00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efea80c8970 0x7efea81f11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:53412/0 (socket says 172.21.15.161:53412) 2024-01-18T00:47:27.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.135+0000 7efea7e00640 1 -- 172.21.15.161:0/3311964393 learned_addr learned my addr 172.21.15.161:0/3311964393 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:27.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.135+0000 7efea7400640 1 --2- 172.21.15.161:0/3311964393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efea80c9650 0x7efea8146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:27.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.139+0000 7efead000640 1 --2- 172.21.15.161:0/3311964393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efea8151a90 0x7efea8157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:27.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.143+0000 7efea7400640 1 -- 172.21.15.161:0/3311964393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efea80c8970 msgr2=0x7efea81f11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:27.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.143+0000 7efea7400640 1 --2- 172.21.15.161:0/3311964393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efea80c8970 0x7efea81f11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:27.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.143+0000 7efea7400640 1 -- 172.21.15.161:0/3311964393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efea8151a90 msgr2=0x7efea8157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:27.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.143+0000 7efea7400640 1 --2- 172.21.15.161:0/3311964393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efea8151a90 0x7efea8157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:27.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.143+0000 7efea7400640 1 -- 172.21.15.161:0/3311964393 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea0009b30 con 0x7efea80c9650 2024-01-18T00:47:27.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.147+0000 7efea7400640 1 --2- 172.21.15.161:0/3311964393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efea80c9650 0x7efea8146600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efe9000c360 tx=0x7efe9000c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:27.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.155+0000 7efe9fe00640 1 -- 172.21.15.161:0/3311964393 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90003600 con 0x7efea80c9650 2024-01-18T00:47:27.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.155+0000 7efe9fe00640 1 -- 172.21.15.161:0/3311964393 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe90003760 con 0x7efea80c9650 2024-01-18T00:47:27.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.155+0000 7efe9fe00640 1 -- 172.21.15.161:0/3311964393 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90003b50 con 0x7efea80c9650 2024-01-18T00:47:27.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.155+0000 7efeaf000640 1 -- 172.21.15.161:0/3311964393 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea81f1710 con 0x7efea80c9650 2024-01-18T00:47:27.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.155+0000 7efeaf000640 1 -- 172.21.15.161:0/3311964393 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea8140960 con 0x7efea80c9650 2024-01-18T00:47:27.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.159+0000 7efeaf000640 1 -- 172.21.15.161:0/3311964393 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea80746a0 con 0x7efea80c9650 2024-01-18T00:47:27.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.183+0000 7efe9fe00640 1 -- 172.21.15.161:0/3311964393 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7efe90003cb0 con 0x7efea80c9650 2024-01-18T00:47:27.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.183+0000 7efe9fe00640 1 --2- 172.21.15.161:0/3311964393 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efe80066890 0x7efe80068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:27.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.183+0000 7efea7e00640 1 --2- 172.21.15.161:0/3311964393 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efe80066890 0x7efe80068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:27.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.183+0000 7efea7e00640 1 --2- 172.21.15.161:0/3311964393 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efe80066890 0x7efe80068d50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efe98001960 tx=0x7efe98009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:27.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.187+0000 7efe9fe00640 1 -- 172.21.15.161:0/3311964393 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7efe90054980 con 0x7efea80c9650 2024-01-18T00:47:27.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.483+0000 7efe9fe00640 1 -- 172.21.15.161:0/3311964393 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7efe90050cc0 con 0x7efea80c9650 2024-01-18T00:47:27.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.635+0000 7efeaf000640 1 -- 172.21.15.161:0/3311964393 --> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efea815af10 con 0x7efe80066890 2024-01-18T00:47:27.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.643+0000 7efe9fe00640 1 -- 172.21.15.161:0/3311964393 <== mgr.4110 v2:172.21.15.161:6800/272458188 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368567 (secure 0 0 0) 0x7efe9800f910 con 0x7efe80066890 2024-01-18T00:47:27.648 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-18T00:47:27.650 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-01-18T00:47:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.647+0000 7efeaf000640 1 -- 172.21.15.161:0/3311964393 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efe80066890 msgr2=0x7efe80068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.647+0000 7efeaf000640 1 --2- 172.21.15.161:0/3311964393 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efe80066890 0x7efe80068d50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efe98001960 tx=0x7efe98009040 comp rx=0 tx=0).stop 2024-01-18T00:47:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.647+0000 7efeaf000640 1 -- 172.21.15.161:0/3311964393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efea80c9650 msgr2=0x7efea8146600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.647+0000 7efeaf000640 1 --2- 172.21.15.161:0/3311964393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efea80c9650 0x7efea8146600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efe9000c360 tx=0x7efe9000c820 comp rx=0 tx=0).stop 2024-01-18T00:47:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.647+0000 7efeaf000640 1 -- 172.21.15.161:0/3311964393 shutdown_connections 2024-01-18T00:47:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.647+0000 7efeaf000640 1 --2- 172.21.15.161:0/3311964393 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7efe80066890 0x7efe80068d50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.647+0000 7efeaf000640 1 --2- 172.21.15.161:0/3311964393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efea80c9650 0x7efea8146600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.647+0000 7efeaf000640 1 --2- 172.21.15.161:0/3311964393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efea8151a90 0x7efea8157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.647+0000 7efeaf000640 1 --2- 172.21.15.161:0/3311964393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efea80c8970 0x7efea81f11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.647+0000 7efeaf000640 1 -- 172.21.15.161:0/3311964393 >> 172.21.15.161:0/3311964393 conn(0x7efea806fc50 msgr2=0x7efea8070210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.647+0000 7efeaf000640 1 -- 172.21.15.161:0/3311964393 shutdown_connections 2024-01-18T00:47:27.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:27.647+0000 7efeaf000640 1 -- 172.21.15.161:0/3311964393 wait complete. 2024-01-18T00:47:27.669 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":3297,"stamp":"2024-01-18T00:47:26.477479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":198926355,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":3054,"num_read_kb":3537766,"num_write":47085,"num_write_kb":4540403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60159,"ondisk_log_size":60159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":964752,"kb_used_data":179920,"kb_used_omap":12,"kb_used_meta":784755,"kb_avail":754009968,"statfs":{"total":773094113280,"available":772106207232,"internally_reserved":0,"allocated":184238080,"data_stored":398820182,"data_compressed":51124606,"data_compressed_allocated":68771840,"data_compressed_original":284901376,"omap_allocated":12751,"internal_metadata":803589681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7254,"num_objects":-2,"num_object_clones":0,"num_object_copies":-8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":22,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002722"},"pg_stats":[{"pgid":"2.1f","version":"28'407","reported_seq":487,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:26.295512+0000","last_change":"2024-01-18T00:47:26.295663+0000","last_active":"2024-01-18T00:47:26.295512+0000","last_peered":"2024-01-18T00:47:26.295512+0000","last_clean":"2024-01-18T00:47:26.295512+0000","last_became_active":"2024-01-17T22:58:48.327340+0000","last_became_peered":"2024-01-17T22:58:48.327340+0000","last_unstale":"2024-01-18T00:47:26.295512+0000","last_undegraded":"2024-01-18T00:47:26.295512+0000","last_fullsized":"2024-01-18T00:47:26.295512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'407","last_scrub_stamp":"2024-01-18T00:47:26.295297+0000","last_deep_scrub":"28'407","last_deep_scrub_stamp":"2024-01-18T00:47:26.295297+0000","last_clean_scrub_stamp":"2024-01-18T00:47:26.295297+0000","objects_scrubbed":6,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:31:44.800535+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":8350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'198","reported_seq":270,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.710107+0000","last_change":"2024-01-17T22:58:49.351609+0000","last_active":"2024-01-18T00:47:15.710107+0000","last_peered":"2024-01-18T00:47:15.710107+0000","last_clean":"2024-01-18T00:47:15.710107+0000","last_became_active":"2024-01-17T22:58:49.350812+0000","last_became_peered":"2024-01-17T22:58:49.350812+0000","last_unstale":"2024-01-18T00:47:15.710107+0000","last_undegraded":"2024-01-18T00:47:15.710107+0000","last_fullsized":"2024-01-18T00:47:15.710107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:02:07.535209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'754","reported_seq":836,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:43.925020+0000","last_change":"2024-01-17T22:58:55.903757+0000","last_active":"2024-01-18T00:46:43.925020+0000","last_peered":"2024-01-18T00:46:43.925020+0000","last_clean":"2024-01-18T00:46:43.925020+0000","last_became_active":"2024-01-17T22:58:55.903167+0000","last_became_peered":"2024-01-17T22:58:55.903167+0000","last_unstale":"2024-01-18T00:46:43.925020+0000","last_undegraded":"2024-01-18T00:46:43.925020+0000","last_fullsized":"2024-01-18T00:46:43.925020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:11:22.127961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":69175,"num_write":737,"num_write_kb":101027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'515","reported_seq":588,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.499634+0000","last_change":"2024-01-17T22:58:48.373068+0000","last_active":"2024-01-18T00:46:53.499634+0000","last_peered":"2024-01-18T00:46:53.499634+0000","last_clean":"2024-01-18T00:46:53.499634+0000","last_became_active":"2024-01-17T22:58:48.372582+0000","last_became_peered":"2024-01-17T22:58:48.372582+0000","last_unstale":"2024-01-18T00:46:53.499634+0000","last_undegraded":"2024-01-18T00:46:53.499634+0000","last_fullsized":"2024-01-18T00:46:53.499634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:10:59.139723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":8429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'179","reported_seq":249,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.701157+0000","last_change":"2024-01-17T22:58:49.511918+0000","last_active":"2024-01-18T00:47:15.701157+0000","last_peered":"2024-01-18T00:47:15.701157+0000","last_clean":"2024-01-18T00:47:15.701157+0000","last_became_active":"2024-01-17T22:58:49.511303+0000","last_became_peered":"2024-01-17T22:58:49.511303+0000","last_unstale":"2024-01-18T00:47:15.701157+0000","last_undegraded":"2024-01-18T00:47:15.701157+0000","last_fullsized":"2024-01-18T00:47:15.701157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:13:09.466879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'814","reported_seq":912,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.700513+0000","last_change":"2024-01-17T22:58:55.878752+0000","last_active":"2024-01-18T00:47:08.700513+0000","last_peered":"2024-01-18T00:47:08.700513+0000","last_clean":"2024-01-18T00:47:08.700513+0000","last_became_active":"2024-01-17T22:58:55.878263+0000","last_became_peered":"2024-01-17T22:58:55.878263+0000","last_unstale":"2024-01-18T00:47:08.700513+0000","last_undegraded":"2024-01-18T00:47:08.700513+0000","last_fullsized":"2024-01-18T00:47:08.700513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":109513,"num_write":800,"num_write_kb":160118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1143","reported_seq":1214,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:24.886134+0000","last_change":"2024-01-18T00:47:24.886162+0000","last_active":"2024-01-18T00:47:24.886134+0000","last_peered":"2024-01-18T00:47:24.886134+0000","last_clean":"2024-01-18T00:47:24.886134+0000","last_became_active":"2024-01-17T22:58:48.346411+0000","last_became_peered":"2024-01-17T22:58:48.346411+0000","last_unstale":"2024-01-18T00:47:24.886134+0000","last_undegraded":"2024-01-18T00:47:24.886134+0000","last_fullsized":"2024-01-18T00:47:24.886134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1143","last_scrub_stamp":"2024-01-18T00:47:24.886069+0000","last_deep_scrub":"28'1143","last_deep_scrub_stamp":"2024-01-18T00:47:24.886069+0000","last_clean_scrub_stamp":"2024-01-18T00:47:24.886069+0000","objects_scrubbed":5,"log_size":1143,"log_dups_size":0,"ondisk_log_size":1143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:19:21.139280+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1083,"num_write_kb":12791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'196","reported_seq":265,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:25.854572+0000","last_change":"2024-01-18T00:47:25.854591+0000","last_active":"2024-01-18T00:47:25.854572+0000","last_peered":"2024-01-18T00:47:25.854572+0000","last_clean":"2024-01-18T00:47:25.854572+0000","last_became_active":"2024-01-17T22:58:49.517710+0000","last_became_peered":"2024-01-17T22:58:49.517710+0000","last_unstale":"2024-01-18T00:47:25.854572+0000","last_undegraded":"2024-01-18T00:47:25.854572+0000","last_fullsized":"2024-01-18T00:47:25.854572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'196","last_scrub_stamp":"2024-01-18T00:47:25.854523+0000","last_deep_scrub":"28'196","last_deep_scrub_stamp":"2024-01-18T00:47:25.854523+0000","last_clean_scrub_stamp":"2024-01-18T00:47:25.854523+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:28:46.105381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'731","reported_seq":810,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.700577+0000","last_change":"2024-01-17T22:58:55.847347+0000","last_active":"2024-01-18T00:47:08.700577+0000","last_peered":"2024-01-18T00:47:08.700577+0000","last_clean":"2024-01-18T00:47:08.700577+0000","last_became_active":"2024-01-17T22:58:55.846773+0000","last_became_peered":"2024-01-17T22:58:55.846773+0000","last_unstale":"2024-01-18T00:47:08.700577+0000","last_undegraded":"2024-01-18T00:47:08.700577+0000","last_fullsized":"2024-01-18T00:47:08.700577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":46045,"num_write":714,"num_write_kb":72807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'769","reported_seq":840,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:23.892477+0000","last_change":"2024-01-18T00:47:23.892504+0000","last_active":"2024-01-18T00:47:23.892477+0000","last_peered":"2024-01-18T00:47:23.892477+0000","last_clean":"2024-01-18T00:47:23.892477+0000","last_became_active":"2024-01-17T22:58:48.345749+0000","last_became_peered":"2024-01-17T22:58:48.345749+0000","last_unstale":"2024-01-18T00:47:23.892477+0000","last_undegraded":"2024-01-18T00:47:23.892477+0000","last_fullsized":"2024-01-18T00:47:23.892477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'769","last_scrub_stamp":"2024-01-18T00:47:23.892413+0000","last_deep_scrub":"28'769","last_deep_scrub_stamp":"2024-01-18T00:47:23.892413+0000","last_clean_scrub_stamp":"2024-01-18T00:47:23.892413+0000","objects_scrubbed":2,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:00:08.044448+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'208","reported_seq":270,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.664408+0000","last_change":"2024-01-17T22:58:49.371509+0000","last_active":"2024-01-18T00:47:15.664408+0000","last_peered":"2024-01-18T00:47:15.664408+0000","last_clean":"2024-01-18T00:47:15.664408+0000","last_became_active":"2024-01-17T22:58:49.370010+0000","last_became_peered":"2024-01-17T22:58:49.370010+0000","last_unstale":"2024-01-18T00:47:15.664408+0000","last_undegraded":"2024-01-18T00:47:15.664408+0000","last_fullsized":"2024-01-18T00:47:15.664408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'752","reported_seq":835,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.256626+0000","last_change":"2024-01-17T22:58:55.886223+0000","last_active":"2024-01-18T00:47:09.256626+0000","last_peered":"2024-01-18T00:47:09.256626+0000","last_clean":"2024-01-18T00:47:09.256626+0000","last_became_active":"2024-01-17T22:58:55.885739+0000","last_became_peered":"2024-01-17T22:58:55.885739+0000","last_unstale":"2024-01-18T00:47:09.256626+0000","last_undegraded":"2024-01-18T00:47:09.256626+0000","last_fullsized":"2024-01-18T00:47:09.256626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":79345,"num_write":732,"num_write_kb":104824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'223","reported_seq":291,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.661992+0000","last_change":"2024-01-17T22:58:49.514565+0000","last_active":"2024-01-18T00:47:15.661992+0000","last_peered":"2024-01-18T00:47:15.661992+0000","last_clean":"2024-01-18T00:47:15.661992+0000","last_became_active":"2024-01-17T22:58:49.514310+0000","last_became_peered":"2024-01-17T22:58:49.514310+0000","last_unstale":"2024-01-18T00:47:15.661992+0000","last_undegraded":"2024-01-18T00:47:15.661992+0000","last_fullsized":"2024-01-18T00:47:15.661992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1137","reported_seq":1205,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:51.380038+0000","last_change":"2024-01-17T22:58:48.341961+0000","last_active":"2024-01-18T00:46:51.380038+0000","last_peered":"2024-01-18T00:46:51.380038+0000","last_clean":"2024-01-18T00:46:51.380038+0000","last_became_active":"2024-01-17T22:58:48.341498+0000","last_became_peered":"2024-01-17T22:58:48.341498+0000","last_unstale":"2024-01-18T00:46:51.380038+0000","last_undegraded":"2024-01-18T00:46:51.380038+0000","last_fullsized":"2024-01-18T00:46:51.380038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1137,"log_dups_size":0,"ondisk_log_size":1137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1075,"num_write_kb":12808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'783","reported_seq":875,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:59.050957+0000","last_change":"2024-01-17T22:58:55.915918+0000","last_active":"2024-01-18T00:46:59.050957+0000","last_peered":"2024-01-18T00:46:59.050957+0000","last_clean":"2024-01-18T00:46:59.050957+0000","last_became_active":"2024-01-17T22:58:55.915556+0000","last_became_peered":"2024-01-17T22:58:55.915556+0000","last_unstale":"2024-01-18T00:46:59.050957+0000","last_undegraded":"2024-01-18T00:46:59.050957+0000","last_fullsized":"2024-01-18T00:46:59.050957+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":102943,"num_write":764,"num_write_kb":130404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'216","reported_seq":282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.678115+0000","last_change":"2024-01-17T22:58:49.388237+0000","last_active":"2024-01-18T00:47:15.678115+0000","last_peered":"2024-01-18T00:47:15.678115+0000","last_clean":"2024-01-18T00:47:15.678115+0000","last_became_active":"2024-01-17T22:58:49.387500+0000","last_became_peered":"2024-01-17T22:58:49.387500+0000","last_unstale":"2024-01-18T00:47:15.678115+0000","last_undegraded":"2024-01-18T00:47:15.678115+0000","last_fullsized":"2024-01-18T00:47:15.678115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:55.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'1206","reported_seq":1275,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:24.505248+0000","last_change":"2024-01-17T22:58:48.346215+0000","last_active":"2024-01-18T00:46:24.505248+0000","last_peered":"2024-01-18T00:46:24.505248+0000","last_clean":"2024-01-18T00:46:24.505248+0000","last_became_active":"2024-01-17T22:58:48.345584+0000","last_became_peered":"2024-01-17T22:58:48.345584+0000","last_unstale":"2024-01-18T00:46:24.505248+0000","last_undegraded":"2024-01-18T00:46:24.505248+0000","last_fullsized":"2024-01-18T00:46:24.505248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1206,"log_dups_size":0,"ondisk_log_size":1206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":8782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'818","reported_seq":904,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.807674+0000","last_change":"2024-01-17T22:58:55.904518+0000","last_active":"2024-01-18T00:47:04.807674+0000","last_peered":"2024-01-18T00:47:04.807674+0000","last_clean":"2024-01-18T00:47:04.807674+0000","last_became_active":"2024-01-17T22:58:55.904182+0000","last_became_peered":"2024-01-17T22:58:55.904182+0000","last_unstale":"2024-01-18T00:47:04.807674+0000","last_undegraded":"2024-01-18T00:47:04.807674+0000","last_fullsized":"2024-01-18T00:47:04.807674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":69224,"num_write":805,"num_write_kb":98188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'208","reported_seq":277,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651862+0000","last_change":"2024-01-17T22:58:49.417907+0000","last_active":"2024-01-18T00:47:15.651862+0000","last_peered":"2024-01-18T00:47:15.651862+0000","last_clean":"2024-01-18T00:47:15.651862+0000","last_became_active":"2024-01-17T22:58:49.417440+0000","last_became_peered":"2024-01-17T22:58:49.417440+0000","last_unstale":"2024-01-18T00:47:15.651862+0000","last_undegraded":"2024-01-18T00:47:15.651862+0000","last_fullsized":"2024-01-18T00:47:15.651862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'353","reported_seq":423,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:13.497690+0000","last_change":"2024-01-17T22:58:48.332092+0000","last_active":"2024-01-18T00:47:13.497690+0000","last_peered":"2024-01-18T00:47:13.497690+0000","last_clean":"2024-01-18T00:47:13.497690+0000","last_became_active":"2024-01-17T22:58:48.331435+0000","last_became_peered":"2024-01-17T22:58:48.331435+0000","last_unstale":"2024-01-18T00:47:13.497690+0000","last_undegraded":"2024-01-18T00:47:13.497690+0000","last_fullsized":"2024-01-18T00:47:13.497690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":286,"num_write_kb":4220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'749","reported_seq":842,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.674877+0000","last_change":"2024-01-17T22:59:09.254564+0000","last_active":"2024-01-18T00:46:53.674877+0000","last_peered":"2024-01-18T00:46:53.674877+0000","last_clean":"2024-01-18T00:46:53.674877+0000","last_became_active":"2024-01-17T22:59:09.254084+0000","last_became_peered":"2024-01-17T22:59:09.254084+0000","last_unstale":"2024-01-18T00:46:53.674877+0000","last_undegraded":"2024-01-18T00:46:53.674877+0000","last_fullsized":"2024-01-18T00:46:53.674877+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":86272,"num_write":735,"num_write_kb":127812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2,3],"acting":[0,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"28'213","reported_seq":282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.660275+0000","last_change":"2024-01-17T22:58:49.416963+0000","last_active":"2024-01-18T00:47:15.660275+0000","last_peered":"2024-01-18T00:47:15.660275+0000","last_clean":"2024-01-18T00:47:15.660275+0000","last_became_active":"2024-01-17T22:58:49.416757+0000","last_became_peered":"2024-01-17T22:58:49.416757+0000","last_unstale":"2024-01-18T00:47:15.660275+0000","last_undegraded":"2024-01-18T00:47:15.660275+0000","last_fullsized":"2024-01-18T00:47:15.660275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'205","reported_seq":283,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:21.939741+0000","last_change":"2024-01-18T00:47:21.939788+0000","last_active":"2024-01-18T00:47:21.939741+0000","last_peered":"2024-01-18T00:47:21.939741+0000","last_clean":"2024-01-18T00:47:21.939741+0000","last_became_active":"2024-01-17T22:58:48.341359+0000","last_became_peered":"2024-01-17T22:58:48.341359+0000","last_unstale":"2024-01-18T00:47:21.939741+0000","last_undegraded":"2024-01-18T00:47:21.939741+0000","last_fullsized":"2024-01-18T00:47:21.939741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'205","last_scrub_stamp":"2024-01-18T00:47:21.939672+0000","last_deep_scrub":"28'205","last_deep_scrub_stamp":"2024-01-18T00:47:21.939672+0000","last_clean_scrub_stamp":"2024-01-18T00:47:21.939672+0000","objects_scrubbed":2,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:38:25.360325+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'713","reported_seq":817,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.139719+0000","last_change":"2024-01-17T22:58:55.913996+0000","last_active":"2024-01-18T00:47:09.139719+0000","last_peered":"2024-01-18T00:47:09.139719+0000","last_clean":"2024-01-18T00:47:09.139719+0000","last_became_active":"2024-01-17T22:58:55.913645+0000","last_became_peered":"2024-01-17T22:58:55.913645+0000","last_unstale":"2024-01-18T00:47:09.139719+0000","last_undegraded":"2024-01-18T00:47:09.139719+0000","last_fullsized":"2024-01-18T00:47:09.139719+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":136231,"num_write":693,"num_write_kb":114548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'226","reported_seq":303,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:24.234567+0000","last_change":"2024-01-18T00:47:24.234625+0000","last_active":"2024-01-18T00:47:24.234567+0000","last_peered":"2024-01-18T00:47:24.234567+0000","last_clean":"2024-01-18T00:47:24.234567+0000","last_became_active":"2024-01-17T22:58:49.417385+0000","last_became_peered":"2024-01-17T22:58:49.417385+0000","last_unstale":"2024-01-18T00:47:24.234567+0000","last_undegraded":"2024-01-18T00:47:24.234567+0000","last_fullsized":"2024-01-18T00:47:24.234567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'226","last_scrub_stamp":"2024-01-18T00:47:24.234407+0000","last_deep_scrub":"28'226","last_deep_scrub_stamp":"2024-01-18T00:47:24.234407+0000","last_clean_scrub_stamp":"2024-01-18T00:47:24.234407+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:26:07.136004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'330","reported_seq":400,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:13.500545+0000","last_change":"2024-01-17T22:58:48.340052+0000","last_active":"2024-01-18T00:47:13.500545+0000","last_peered":"2024-01-18T00:47:13.500545+0000","last_clean":"2024-01-18T00:47:13.500545+0000","last_became_active":"2024-01-17T22:58:48.339738+0000","last_became_peered":"2024-01-17T22:58:48.339738+0000","last_unstale":"2024-01-18T00:47:13.500545+0000","last_undegraded":"2024-01-18T00:47:13.500545+0000","last_fullsized":"2024-01-18T00:47:13.500545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'778","reported_seq":884,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:16.409565+0000","last_change":"2024-01-17T22:58:55.904749+0000","last_active":"2024-01-18T00:47:16.409565+0000","last_peered":"2024-01-18T00:47:16.409565+0000","last_clean":"2024-01-18T00:47:16.409565+0000","last_became_active":"2024-01-17T22:58:55.904417+0000","last_became_peered":"2024-01-17T22:58:55.904417+0000","last_unstale":"2024-01-18T00:47:16.409565+0000","last_undegraded":"2024-01-18T00:47:16.409565+0000","last_fullsized":"2024-01-18T00:47:16.409565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":109858,"num_write":759,"num_write_kb":103009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'181","reported_seq":250,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.649040+0000","last_change":"2024-01-17T22:58:49.411284+0000","last_active":"2024-01-18T00:47:15.649040+0000","last_peered":"2024-01-18T00:47:15.649040+0000","last_clean":"2024-01-18T00:47:15.649040+0000","last_became_active":"2024-01-17T22:58:49.410830+0000","last_became_peered":"2024-01-17T22:58:49.410830+0000","last_unstale":"2024-01-18T00:47:15.649040+0000","last_undegraded":"2024-01-18T00:47:15.649040+0000","last_fullsized":"2024-01-18T00:47:15.649040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'1209","reported_seq":1279,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:16.552343+0000","last_change":"2024-01-17T22:58:48.339919+0000","last_active":"2024-01-18T00:47:16.552343+0000","last_peered":"2024-01-18T00:47:16.552343+0000","last_clean":"2024-01-18T00:47:16.552343+0000","last_became_active":"2024-01-17T22:58:48.338928+0000","last_became_peered":"2024-01-17T22:58:48.338928+0000","last_unstale":"2024-01-18T00:47:16.552343+0000","last_undegraded":"2024-01-18T00:47:16.552343+0000","last_fullsized":"2024-01-18T00:47:16.552343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1209,"log_dups_size":0,"ondisk_log_size":1209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3222,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'817","reported_seq":929,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.924523+0000","last_change":"2024-01-17T22:58:55.909140+0000","last_active":"2024-01-18T00:47:04.924523+0000","last_peered":"2024-01-18T00:47:04.924523+0000","last_clean":"2024-01-18T00:47:04.924523+0000","last_became_active":"2024-01-17T22:58:55.908232+0000","last_became_peered":"2024-01-17T22:58:55.908232+0000","last_unstale":"2024-01-18T00:47:04.924523+0000","last_undegraded":"2024-01-18T00:47:04.924523+0000","last_fullsized":"2024-01-18T00:47:04.924523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":152093,"num_write":804,"num_write_kb":135389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'198","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.835840+0000","last_change":"2024-01-17T22:58:49.370201+0000","last_active":"2024-01-18T00:47:15.835840+0000","last_peered":"2024-01-18T00:47:15.835840+0000","last_clean":"2024-01-18T00:47:15.835840+0000","last_became_active":"2024-01-17T22:58:49.369598+0000","last_became_peered":"2024-01-17T22:58:49.369598+0000","last_unstale":"2024-01-18T00:47:15.835840+0000","last_undegraded":"2024-01-18T00:47:15.835840+0000","last_fullsized":"2024-01-18T00:47:15.835840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'819","reported_seq":890,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.639449+0000","last_change":"2024-01-17T22:58:48.338556+0000","last_active":"2024-01-18T00:46:53.639449+0000","last_peered":"2024-01-18T00:46:53.639449+0000","last_clean":"2024-01-18T00:46:53.639449+0000","last_became_active":"2024-01-17T22:58:48.338225+0000","last_became_peered":"2024-01-17T22:58:48.338225+0000","last_unstale":"2024-01-18T00:46:53.639449+0000","last_undegraded":"2024-01-18T00:46:53.639449+0000","last_fullsized":"2024-01-18T00:46:53.639449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":8593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'758","reported_seq":864,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:16.403519+0000","last_change":"2024-01-17T22:58:55.872734+0000","last_active":"2024-01-18T00:47:16.403519+0000","last_peered":"2024-01-18T00:47:16.403519+0000","last_clean":"2024-01-18T00:47:16.403519+0000","last_became_active":"2024-01-17T22:58:55.872356+0000","last_became_peered":"2024-01-17T22:58:55.872356+0000","last_unstale":"2024-01-18T00:47:16.403519+0000","last_undegraded":"2024-01-18T00:47:16.403519+0000","last_fullsized":"2024-01-18T00:47:16.403519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":100834,"num_write":740,"num_write_kb":155893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'214","reported_seq":283,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.661638+0000","last_change":"2024-01-17T22:58:49.369806+0000","last_active":"2024-01-18T00:47:15.661638+0000","last_peered":"2024-01-18T00:47:15.661638+0000","last_clean":"2024-01-18T00:47:15.661638+0000","last_became_active":"2024-01-17T22:58:49.369487+0000","last_became_peered":"2024-01-17T22:58:49.369487+0000","last_unstale":"2024-01-18T00:47:15.661638+0000","last_undegraded":"2024-01-18T00:47:15.661638+0000","last_fullsized":"2024-01-18T00:47:15.661638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'276","reported_seq":347,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.606730+0000","last_change":"2024-01-17T22:58:48.341854+0000","last_active":"2024-01-18T00:46:53.606730+0000","last_peered":"2024-01-18T00:46:53.606730+0000","last_clean":"2024-01-18T00:46:53.606730+0000","last_became_active":"2024-01-17T22:58:48.339996+0000","last_became_peered":"2024-01-17T22:58:48.339996+0000","last_unstale":"2024-01-18T00:46:53.606730+0000","last_undegraded":"2024-01-18T00:46:53.606730+0000","last_fullsized":"2024-01-18T00:46:53.606730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:55:52.894278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'763","reported_seq":862,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:16.403451+0000","last_change":"2024-01-17T22:58:55.877637+0000","last_active":"2024-01-18T00:47:16.403451+0000","last_peered":"2024-01-18T00:47:16.403451+0000","last_clean":"2024-01-18T00:47:16.403451+0000","last_became_active":"2024-01-17T22:58:55.877118+0000","last_became_peered":"2024-01-17T22:58:55.877118+0000","last_unstale":"2024-01-18T00:47:16.403451+0000","last_undegraded":"2024-01-18T00:47:16.403451+0000","last_fullsized":"2024-01-18T00:47:16.403451+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":97013,"num_write":742,"num_write_kb":97416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'198","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.698133+0000","last_change":"2024-01-17T22:58:49.352845+0000","last_active":"2024-01-18T00:47:15.698133+0000","last_peered":"2024-01-18T00:47:15.698133+0000","last_clean":"2024-01-18T00:47:15.698133+0000","last_became_active":"2024-01-17T22:58:49.352563+0000","last_became_peered":"2024-01-17T22:58:49.352563+0000","last_unstale":"2024-01-18T00:47:15.698133+0000","last_undegraded":"2024-01-18T00:47:15.698133+0000","last_fullsized":"2024-01-18T00:47:15.698133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'1018","reported_seq":1090,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:11.382294+0000","last_change":"2024-01-17T22:58:48.343658+0000","last_active":"2024-01-18T00:47:11.382294+0000","last_peered":"2024-01-18T00:47:11.382294+0000","last_clean":"2024-01-18T00:47:11.382294+0000","last_became_active":"2024-01-17T22:58:48.343060+0000","last_became_peered":"2024-01-17T22:58:48.343060+0000","last_unstale":"2024-01-18T00:47:11.382294+0000","last_undegraded":"2024-01-18T00:47:11.382294+0000","last_fullsized":"2024-01-18T00:47:11.382294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":955,"num_write_kb":8650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'732","reported_seq":830,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:16.403586+0000","last_change":"2024-01-17T22:58:55.881076+0000","last_active":"2024-01-18T00:47:16.403586+0000","last_peered":"2024-01-18T00:47:16.403586+0000","last_clean":"2024-01-18T00:47:16.403586+0000","last_became_active":"2024-01-17T22:58:55.880665+0000","last_became_peered":"2024-01-17T22:58:55.880665+0000","last_unstale":"2024-01-18T00:47:16.403586+0000","last_undegraded":"2024-01-18T00:47:16.403586+0000","last_fullsized":"2024-01-18T00:47:16.403586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":93731,"num_write":720,"num_write_kb":118971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'203","reported_seq":275,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.705588+0000","last_change":"2024-01-17T22:58:49.385682+0000","last_active":"2024-01-18T00:47:15.705588+0000","last_peered":"2024-01-18T00:47:15.705588+0000","last_clean":"2024-01-18T00:47:15.705588+0000","last_became_active":"2024-01-17T22:58:49.384655+0000","last_became_peered":"2024-01-17T22:58:49.384655+0000","last_unstale":"2024-01-18T00:47:15.705588+0000","last_undegraded":"2024-01-18T00:47:15.705588+0000","last_fullsized":"2024-01-18T00:47:15.705588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:22:51.592384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'1859","reported_seq":3718,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:13.468415+0000","last_change":"2024-01-17T22:58:48.375527+0000","last_active":"2024-01-18T00:47:13.468415+0000","last_peered":"2024-01-18T00:47:13.468415+0000","last_clean":"2024-01-18T00:47:13.468415+0000","last_became_active":"2024-01-17T22:58:48.375210+0000","last_became_peered":"2024-01-17T22:58:48.375210+0000","last_unstale":"2024-01-18T00:47:13.468415+0000","last_undegraded":"2024-01-18T00:47:13.468415+0000","last_fullsized":"2024-01-18T00:47:13.468415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1859,"log_dups_size":0,"ondisk_log_size":1859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:51:00.037407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1556390,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1788,"num_read_kb":2847,"num_write":1794,"num_write_kb":2850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'738","reported_seq":828,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:16.403645+0000","last_change":"2024-01-17T22:58:55.903437+0000","last_active":"2024-01-18T00:47:16.403645+0000","last_peered":"2024-01-18T00:47:16.403645+0000","last_clean":"2024-01-18T00:47:16.403645+0000","last_became_active":"2024-01-17T22:58:55.902881+0000","last_became_peered":"2024-01-17T22:58:55.902881+0000","last_unstale":"2024-01-18T00:47:16.403645+0000","last_undegraded":"2024-01-18T00:47:16.403645+0000","last_fullsized":"2024-01-18T00:47:16.403645+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":79403,"num_write":724,"num_write_kb":135108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'196","reported_seq":267,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.835322+0000","last_change":"2024-01-17T22:58:49.367932+0000","last_active":"2024-01-18T00:47:15.835322+0000","last_peered":"2024-01-18T00:47:15.835322+0000","last_clean":"2024-01-18T00:47:15.835322+0000","last_became_active":"2024-01-17T22:58:49.367236+0000","last_became_peered":"2024-01-17T22:58:49.367236+0000","last_unstale":"2024-01-18T00:47:15.835322+0000","last_undegraded":"2024-01-18T00:47:15.835322+0000","last_fullsized":"2024-01-18T00:47:15.835322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'617","reported_seq":691,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:23.083732+0000","last_change":"2024-01-17T22:58:48.338730+0000","last_active":"2024-01-18T00:47:23.083732+0000","last_peered":"2024-01-18T00:47:23.083732+0000","last_clean":"2024-01-18T00:47:23.083732+0000","last_became_active":"2024-01-17T22:58:48.337500+0000","last_became_peered":"2024-01-17T22:58:48.337500+0000","last_unstale":"2024-01-18T00:47:23.083732+0000","last_undegraded":"2024-01-18T00:47:23.083732+0000","last_fullsized":"2024-01-18T00:47:23.083732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":12559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'904","reported_seq":1026,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:13.483995+0000","last_change":"2024-01-17T22:58:55.900298+0000","last_active":"2024-01-18T00:47:13.483995+0000","last_peered":"2024-01-18T00:47:13.483995+0000","last_clean":"2024-01-18T00:47:13.483995+0000","last_became_active":"2024-01-17T22:58:55.899657+0000","last_became_peered":"2024-01-17T22:58:55.899657+0000","last_unstale":"2024-01-18T00:47:13.483995+0000","last_undegraded":"2024-01-18T00:47:13.483995+0000","last_fullsized":"2024-01-18T00:47:13.483995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:30:03.955178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":184022,"num_write":887,"num_write_kb":259108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'189","reported_seq":260,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.652422+0000","last_change":"2024-01-17T22:58:49.412701+0000","last_active":"2024-01-18T00:47:15.652422+0000","last_peered":"2024-01-18T00:47:15.652422+0000","last_clean":"2024-01-18T00:47:15.652422+0000","last_became_active":"2024-01-17T22:58:49.411848+0000","last_became_peered":"2024-01-17T22:58:49.411848+0000","last_unstale":"2024-01-18T00:47:15.652422+0000","last_undegraded":"2024-01-18T00:47:15.652422+0000","last_fullsized":"2024-01-18T00:47:15.652422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'293","reported_seq":365,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:11.382330+0000","last_change":"2024-01-17T22:58:48.341769+0000","last_active":"2024-01-18T00:47:11.382330+0000","last_peered":"2024-01-18T00:47:11.382330+0000","last_clean":"2024-01-18T00:47:11.382330+0000","last_became_active":"2024-01-17T22:58:48.340963+0000","last_became_peered":"2024-01-17T22:58:48.340963+0000","last_unstale":"2024-01-18T00:47:11.382330+0000","last_undegraded":"2024-01-18T00:47:11.382330+0000","last_fullsized":"2024-01-18T00:47:11.382330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":4212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'163","reported_seq":289,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:21.863206+0000","last_change":"2024-01-18T00:47:21.863233+0000","last_active":"2024-01-18T00:47:21.863206+0000","last_peered":"2024-01-18T00:47:21.863206+0000","last_clean":"2024-01-18T00:47:21.863206+0000","last_became_active":"2024-01-17T22:58:17.321097+0000","last_became_peered":"2024-01-17T22:58:17.321097+0000","last_unstale":"2024-01-18T00:47:21.863206+0000","last_undegraded":"2024-01-18T00:47:21.863206+0000","last_fullsized":"2024-01-18T00:47:21.863206+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'163","last_scrub_stamp":"2024-01-18T00:47:21.863134+0000","last_deep_scrub":"28'163","last_deep_scrub_stamp":"2024-01-18T00:47:21.863134+0000","last_clean_scrub_stamp":"2024-01-18T00:47:21.863134+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:10:20.450518+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'806","reported_seq":939,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.352857+0000","last_change":"2024-01-17T22:58:55.909509+0000","last_active":"2024-01-18T00:47:04.352857+0000","last_peered":"2024-01-18T00:47:04.352857+0000","last_clean":"2024-01-18T00:47:04.352857+0000","last_became_active":"2024-01-17T22:58:55.909055+0000","last_became_peered":"2024-01-17T22:58:55.909055+0000","last_unstale":"2024-01-18T00:47:04.352857+0000","last_undegraded":"2024-01-18T00:47:04.352857+0000","last_fullsized":"2024-01-18T00:47:04.352857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":230974,"num_write":789,"num_write_kb":193453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'203","reported_seq":270,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.661971+0000","last_change":"2024-01-17T22:58:49.516198+0000","last_active":"2024-01-18T00:47:15.661971+0000","last_peered":"2024-01-18T00:47:15.661971+0000","last_clean":"2024-01-18T00:47:15.661971+0000","last_became_active":"2024-01-17T22:58:49.515941+0000","last_became_peered":"2024-01-17T22:58:49.515941+0000","last_unstale":"2024-01-18T00:47:15.661971+0000","last_undegraded":"2024-01-18T00:47:15.661971+0000","last_fullsized":"2024-01-18T00:47:15.661971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'366","reported_seq":438,"reported_epoch":28,"state":"active+clean+scrubbing+deep","last_fresh":"2024-01-18T00:47:26.410342+0000","last_change":"2024-01-18T00:47:26.384915+0000","last_active":"2024-01-18T00:47:26.410342+0000","last_peered":"2024-01-18T00:47:26.410342+0000","last_clean":"2024-01-18T00:47:26.410342+0000","last_became_active":"2024-01-17T22:58:48.344402+0000","last_became_peered":"2024-01-17T22:58:48.344402+0000","last_unstale":"2024-01-18T00:47:26.410342+0000","last_undegraded":"2024-01-18T00:47:26.410342+0000","last_fullsized":"2024-01-18T00:47:26.410342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":3,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'821","reported_seq":921,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.139121+0000","last_change":"2024-01-17T22:58:55.886258+0000","last_active":"2024-01-18T00:47:09.139121+0000","last_peered":"2024-01-18T00:47:09.139121+0000","last_clean":"2024-01-18T00:47:09.139121+0000","last_became_active":"2024-01-17T22:58:55.885809+0000","last_became_peered":"2024-01-17T22:58:55.885809+0000","last_unstale":"2024-01-18T00:47:09.139121+0000","last_undegraded":"2024-01-18T00:47:09.139121+0000","last_fullsized":"2024-01-18T00:47:09.139121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":121383,"num_write":812,"num_write_kb":179977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'216","reported_seq":275,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651675+0000","last_change":"2024-01-17T22:59:08.654953+0000","last_active":"2024-01-18T00:47:15.651675+0000","last_peered":"2024-01-18T00:47:15.651675+0000","last_clean":"2024-01-18T00:47:15.651675+0000","last_became_active":"2024-01-17T22:59:08.654136+0000","last_became_peered":"2024-01-17T22:59:08.654136+0000","last_unstale":"2024-01-18T00:47:15.651675+0000","last_undegraded":"2024-01-18T00:47:15.651675+0000","last_fullsized":"2024-01-18T00:47:15.651675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"28'404","reported_seq":471,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:47.632062+0000","last_change":"2024-01-17T22:58:48.338206+0000","last_active":"2024-01-18T00:45:47.632062+0000","last_peered":"2024-01-18T00:45:47.632062+0000","last_clean":"2024-01-18T00:45:47.632062+0000","last_became_active":"2024-01-17T22:58:48.337489+0000","last_became_peered":"2024-01-17T22:58:48.337489+0000","last_unstale":"2024-01-18T00:45:47.632062+0000","last_undegraded":"2024-01-18T00:45:47.632062+0000","last_fullsized":"2024-01-18T00:45:47.632062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:09:04.579374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'799","reported_seq":898,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.976358+0000","last_change":"2024-01-17T22:58:55.903435+0000","last_active":"2024-01-18T00:47:08.976358+0000","last_peered":"2024-01-18T00:47:08.976358+0000","last_clean":"2024-01-18T00:47:08.976358+0000","last_became_active":"2024-01-17T22:58:55.902857+0000","last_became_peered":"2024-01-17T22:58:55.902857+0000","last_unstale":"2024-01-18T00:47:08.976358+0000","last_undegraded":"2024-01-18T00:47:08.976358+0000","last_fullsized":"2024-01-18T00:47:08.976358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:24:43.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":124542,"num_write":790,"num_write_kb":159708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'194","reported_seq":261,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:20.554184+0000","last_change":"2024-01-17T22:58:49.519307+0000","last_active":"2024-01-18T00:47:20.554184+0000","last_peered":"2024-01-18T00:47:20.554184+0000","last_clean":"2024-01-18T00:47:20.554184+0000","last_became_active":"2024-01-17T22:58:49.519060+0000","last_became_peered":"2024-01-17T22:58:49.519060+0000","last_unstale":"2024-01-18T00:47:20.554184+0000","last_undegraded":"2024-01-18T00:47:20.554184+0000","last_fullsized":"2024-01-18T00:47:20.554184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'863","reported_seq":931,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:51.401319+0000","last_change":"2024-01-17T22:58:48.341584+0000","last_active":"2024-01-18T00:46:51.401319+0000","last_peered":"2024-01-18T00:46:51.401319+0000","last_clean":"2024-01-18T00:46:51.401319+0000","last_became_active":"2024-01-17T22:58:48.339433+0000","last_became_peered":"2024-01-17T22:58:48.339433+0000","last_unstale":"2024-01-18T00:46:51.401319+0000","last_undegraded":"2024-01-18T00:46:51.401319+0000","last_fullsized":"2024-01-18T00:46:51.401319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":4462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'819","reported_seq":916,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:16.382786+0000","last_change":"2024-01-17T22:58:55.905118+0000","last_active":"2024-01-18T00:47:16.382786+0000","last_peered":"2024-01-18T00:47:16.382786+0000","last_clean":"2024-01-18T00:47:16.382786+0000","last_became_active":"2024-01-17T22:58:55.904690+0000","last_became_peered":"2024-01-17T22:58:55.904690+0000","last_unstale":"2024-01-18T00:47:16.382786+0000","last_undegraded":"2024-01-18T00:47:16.382786+0000","last_fullsized":"2024-01-18T00:47:16.382786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":82183,"num_write":809,"num_write_kb":113772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'190","reported_seq":264,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:23.697594+0000","last_change":"2024-01-18T00:47:23.697617+0000","last_active":"2024-01-18T00:47:23.697594+0000","last_peered":"2024-01-18T00:47:23.697594+0000","last_clean":"2024-01-18T00:47:23.697594+0000","last_became_active":"2024-01-17T22:58:49.352744+0000","last_became_peered":"2024-01-17T22:58:49.352744+0000","last_unstale":"2024-01-18T00:47:23.697594+0000","last_undegraded":"2024-01-18T00:47:23.697594+0000","last_fullsized":"2024-01-18T00:47:23.697594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'190","last_scrub_stamp":"2024-01-18T00:47:23.697529+0000","last_deep_scrub":"28'190","last_deep_scrub_stamp":"2024-01-18T00:47:23.697529+0000","last_clean_scrub_stamp":"2024-01-18T00:47:23.697529+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:52:56.826907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'872","reported_seq":948,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:22.915864+0000","last_change":"2024-01-18T00:47:22.915864+0000","last_active":"2024-01-18T00:47:22.915864+0000","last_peered":"2024-01-18T00:47:22.915864+0000","last_clean":"2024-01-18T00:47:22.915864+0000","last_became_active":"2024-01-17T22:58:48.343435+0000","last_became_peered":"2024-01-17T22:58:48.343435+0000","last_unstale":"2024-01-18T00:47:22.915864+0000","last_undegraded":"2024-01-18T00:47:22.915864+0000","last_fullsized":"2024-01-18T00:47:22.915864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'872","last_scrub_stamp":"2024-01-18T00:47:22.915771+0000","last_deep_scrub":"28'872","last_deep_scrub_stamp":"2024-01-18T00:47:22.915771+0000","last_clean_scrub_stamp":"2024-01-18T00:47:22.915771+0000","objects_scrubbed":3,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:10:51.616803+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":942,"num_write_kb":4497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'797","reported_seq":905,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:16.438879+0000","last_change":"2024-01-17T22:58:55.913690+0000","last_active":"2024-01-18T00:47:16.438879+0000","last_peered":"2024-01-18T00:47:16.438879+0000","last_clean":"2024-01-18T00:47:16.438879+0000","last_became_active":"2024-01-17T22:58:55.913197+0000","last_became_peered":"2024-01-17T22:58:55.913197+0000","last_unstale":"2024-01-18T00:47:16.438879+0000","last_undegraded":"2024-01-18T00:47:16.438879+0000","last_fullsized":"2024-01-18T00:47:16.438879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":146211,"num_write":781,"num_write_kb":158858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'235","reported_seq":308,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:24.102479+0000","last_change":"2024-01-18T00:47:24.102499+0000","last_active":"2024-01-18T00:47:24.102479+0000","last_peered":"2024-01-18T00:47:24.102479+0000","last_clean":"2024-01-18T00:47:24.102479+0000","last_became_active":"2024-01-17T22:58:49.368018+0000","last_became_peered":"2024-01-17T22:58:49.368018+0000","last_unstale":"2024-01-18T00:47:24.102479+0000","last_undegraded":"2024-01-18T00:47:24.102479+0000","last_fullsized":"2024-01-18T00:47:24.102479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'235","last_scrub_stamp":"2024-01-18T00:47:24.102414+0000","last_deep_scrub":"28'235","last_deep_scrub_stamp":"2024-01-18T00:47:24.102414+0000","last_clean_scrub_stamp":"2024-01-18T00:47:24.102414+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:16.064043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'701","reported_seq":767,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:13.498085+0000","last_change":"2024-01-17T22:58:48.374293+0000","last_active":"2024-01-18T00:47:13.498085+0000","last_peered":"2024-01-18T00:47:13.498085+0000","last_clean":"2024-01-18T00:47:13.498085+0000","last_became_active":"2024-01-17T22:58:48.373287+0000","last_became_peered":"2024-01-17T22:58:48.373287+0000","last_unstale":"2024-01-18T00:47:13.498085+0000","last_undegraded":"2024-01-18T00:47:13.498085+0000","last_fullsized":"2024-01-18T00:47:13.498085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":649,"num_write_kb":8541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'825","reported_seq":940,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.758998+0000","last_change":"2024-01-17T22:58:55.909679+0000","last_active":"2024-01-18T00:46:53.758998+0000","last_peered":"2024-01-18T00:46:53.758998+0000","last_clean":"2024-01-18T00:46:53.758998+0000","last_became_active":"2024-01-17T22:58:55.909139+0000","last_became_peered":"2024-01-17T22:58:55.909139+0000","last_unstale":"2024-01-18T00:46:53.758998+0000","last_undegraded":"2024-01-18T00:46:53.758998+0000","last_fullsized":"2024-01-18T00:46:53.758998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:39:50.993158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":204092,"num_write":802,"num_write_kb":163340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'217","reported_seq":289,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:23.835079+0000","last_change":"2024-01-18T00:47:23.835098+0000","last_active":"2024-01-18T00:47:23.835079+0000","last_peered":"2024-01-18T00:47:23.835079+0000","last_clean":"2024-01-18T00:47:23.835079+0000","last_became_active":"2024-01-17T22:58:49.514776+0000","last_became_peered":"2024-01-17T22:58:49.514776+0000","last_unstale":"2024-01-18T00:47:23.835079+0000","last_undegraded":"2024-01-18T00:47:23.835079+0000","last_fullsized":"2024-01-18T00:47:23.835079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'217","last_scrub_stamp":"2024-01-18T00:47:23.835022+0000","last_deep_scrub":"28'217","last_deep_scrub_stamp":"2024-01-18T00:47:23.835022+0000","last_clean_scrub_stamp":"2024-01-18T00:47:23.835022+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:37:56.941376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'65","reported_seq":131,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.306803+0000","last_change":"2024-01-17T22:58:48.349505+0000","last_active":"2024-01-18T00:47:15.306803+0000","last_peered":"2024-01-18T00:47:15.306803+0000","last_clean":"2024-01-18T00:47:15.306803+0000","last_became_active":"2024-01-17T22:58:48.349193+0000","last_became_peered":"2024-01-17T22:58:48.349193+0000","last_unstale":"2024-01-18T00:47:15.306803+0000","last_undegraded":"2024-01-18T00:47:15.306803+0000","last_fullsized":"2024-01-18T00:47:15.306803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'809","reported_seq":919,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.381754+0000","last_change":"2024-01-17T22:58:55.911280+0000","last_active":"2024-01-18T00:47:04.381754+0000","last_peered":"2024-01-18T00:47:04.381754+0000","last_clean":"2024-01-18T00:47:04.381754+0000","last_became_active":"2024-01-17T22:58:55.910147+0000","last_became_peered":"2024-01-17T22:58:55.910147+0000","last_unstale":"2024-01-18T00:47:04.381754+0000","last_undegraded":"2024-01-18T00:47:04.381754+0000","last_fullsized":"2024-01-18T00:47:04.381754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:29:01.453903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":124212,"num_write":791,"num_write_kb":164591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'198","reported_seq":263,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.667291+0000","last_change":"2024-01-17T22:58:49.366332+0000","last_active":"2024-01-18T00:47:15.667291+0000","last_peered":"2024-01-18T00:47:15.667291+0000","last_clean":"2024-01-18T00:47:15.667291+0000","last_became_active":"2024-01-17T22:58:49.366055+0000","last_became_peered":"2024-01-17T22:58:49.366055+0000","last_unstale":"2024-01-18T00:47:15.667291+0000","last_undegraded":"2024-01-18T00:47:15.667291+0000","last_fullsized":"2024-01-18T00:47:15.667291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'54","reported_seq":120,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:13.498451+0000","last_change":"2024-01-17T22:58:48.378008+0000","last_active":"2024-01-18T00:47:13.498451+0000","last_peered":"2024-01-18T00:47:13.498451+0000","last_clean":"2024-01-18T00:47:13.498451+0000","last_became_active":"2024-01-17T22:58:48.377732+0000","last_became_peered":"2024-01-17T22:58:48.377732+0000","last_unstale":"2024-01-18T00:47:13.498451+0000","last_undegraded":"2024-01-18T00:47:13.498451+0000","last_fullsized":"2024-01-18T00:47:13.498451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'664","reported_seq":749,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.281449+0000","last_change":"2024-01-17T22:59:09.245915+0000","last_active":"2024-01-18T00:47:04.281449+0000","last_peered":"2024-01-18T00:47:04.281449+0000","last_clean":"2024-01-18T00:47:04.281449+0000","last_became_active":"2024-01-17T22:59:09.244621+0000","last_became_peered":"2024-01-17T22:59:09.244621+0000","last_unstale":"2024-01-18T00:47:04.281449+0000","last_undegraded":"2024-01-18T00:47:04.281449+0000","last_fullsized":"2024-01-18T00:47:04.281449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":44179,"num_write":651,"num_write_kb":63897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,5],"acting":[6,4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'209","reported_seq":274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.832657+0000","last_change":"2024-01-17T22:58:49.368620+0000","last_active":"2024-01-18T00:47:15.832657+0000","last_peered":"2024-01-18T00:47:15.832657+0000","last_clean":"2024-01-18T00:47:15.832657+0000","last_became_active":"2024-01-17T22:58:49.367258+0000","last_became_peered":"2024-01-17T22:58:49.367258+0000","last_unstale":"2024-01-18T00:47:15.832657+0000","last_undegraded":"2024-01-18T00:47:15.832657+0000","last_fullsized":"2024-01-18T00:47:15.832657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'368","reported_seq":433,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:43.489636+0000","last_change":"2024-01-17T22:58:48.371378+0000","last_active":"2024-01-18T00:45:43.489636+0000","last_peered":"2024-01-18T00:45:43.489636+0000","last_clean":"2024-01-18T00:45:43.489636+0000","last_became_active":"2024-01-17T22:58:48.370691+0000","last_became_peered":"2024-01-17T22:58:48.370691+0000","last_unstale":"2024-01-18T00:45:43.489636+0000","last_undegraded":"2024-01-18T00:45:43.489636+0000","last_fullsized":"2024-01-18T00:45:43.489636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:01:21.629083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":8326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'675","reported_seq":752,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:59.053235+0000","last_change":"2024-01-17T22:58:55.846853+0000","last_active":"2024-01-18T00:46:59.053235+0000","last_peered":"2024-01-18T00:46:59.053235+0000","last_clean":"2024-01-18T00:46:59.053235+0000","last_became_active":"2024-01-17T22:58:55.846382+0000","last_became_peered":"2024-01-17T22:58:55.846382+0000","last_unstale":"2024-01-18T00:46:59.053235+0000","last_undegraded":"2024-01-18T00:46:59.053235+0000","last_fullsized":"2024-01-18T00:46:59.053235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":43277,"num_write":656,"num_write_kb":56099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'195","reported_seq":258,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.767513+0000","last_change":"2024-01-17T22:58:49.367642+0000","last_active":"2024-01-18T00:47:15.767513+0000","last_peered":"2024-01-18T00:47:15.767513+0000","last_clean":"2024-01-18T00:47:15.767513+0000","last_became_active":"2024-01-17T22:58:49.367370+0000","last_became_peered":"2024-01-17T22:58:49.367370+0000","last_unstale":"2024-01-18T00:47:15.767513+0000","last_undegraded":"2024-01-18T00:47:15.767513+0000","last_fullsized":"2024-01-18T00:47:15.767513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'1306","reported_seq":1379,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:22.722529+0000","last_change":"2024-01-18T00:47:22.722561+0000","last_active":"2024-01-18T00:47:22.722529+0000","last_peered":"2024-01-18T00:47:22.722529+0000","last_clean":"2024-01-18T00:47:22.722529+0000","last_became_active":"2024-01-17T22:58:48.346574+0000","last_became_peered":"2024-01-17T22:58:48.346574+0000","last_unstale":"2024-01-18T00:47:22.722529+0000","last_undegraded":"2024-01-18T00:47:22.722529+0000","last_fullsized":"2024-01-18T00:47:22.722529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1306","last_scrub_stamp":"2024-01-18T00:47:22.722473+0000","last_deep_scrub":"28'1306","last_deep_scrub_stamp":"2024-01-18T00:47:22.722473+0000","last_clean_scrub_stamp":"2024-01-18T00:47:22.722473+0000","objects_scrubbed":7,"log_size":1306,"log_dups_size":0,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:27:51.317400+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":13137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'811","reported_seq":916,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.269637+0000","last_change":"2024-01-17T22:58:55.832183+0000","last_active":"2024-01-18T00:47:09.269637+0000","last_peered":"2024-01-18T00:47:09.269637+0000","last_clean":"2024-01-18T00:47:09.269637+0000","last_became_active":"2024-01-17T22:58:55.831090+0000","last_became_peered":"2024-01-17T22:58:55.831090+0000","last_unstale":"2024-01-18T00:47:09.269637+0000","last_undegraded":"2024-01-18T00:47:09.269637+0000","last_fullsized":"2024-01-18T00:47:09.269637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":127549,"num_write":788,"num_write_kb":160232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'198","reported_seq":263,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.664617+0000","last_change":"2024-01-17T22:58:49.366048+0000","last_active":"2024-01-18T00:47:15.664617+0000","last_peered":"2024-01-18T00:47:15.664617+0000","last_clean":"2024-01-18T00:47:15.664617+0000","last_became_active":"2024-01-17T22:58:49.365846+0000","last_became_peered":"2024-01-17T22:58:49.365846+0000","last_unstale":"2024-01-18T00:47:15.664617+0000","last_undegraded":"2024-01-18T00:47:15.664617+0000","last_fullsized":"2024-01-18T00:47:15.664617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'1446","reported_seq":1509,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:09.419203+0000","last_change":"2024-01-17T22:58:48.376099+0000","last_active":"2024-01-18T00:47:09.419203+0000","last_peered":"2024-01-18T00:47:09.419203+0000","last_clean":"2024-01-18T00:47:09.419203+0000","last_became_active":"2024-01-17T22:58:48.375504+0000","last_became_peered":"2024-01-17T22:58:48.375504+0000","last_unstale":"2024-01-18T00:47:09.419203+0000","last_undegraded":"2024-01-18T00:47:09.419203+0000","last_fullsized":"2024-01-18T00:47:09.419203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1446,"log_dups_size":0,"ondisk_log_size":1446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:13:23.339633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1379,"num_write_kb":5332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'771","reported_seq":868,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:13.493122+0000","last_change":"2024-01-17T22:58:55.906751+0000","last_active":"2024-01-18T00:47:13.493122+0000","last_peered":"2024-01-18T00:47:13.493122+0000","last_clean":"2024-01-18T00:47:13.493122+0000","last_became_active":"2024-01-17T22:58:55.906429+0000","last_became_peered":"2024-01-17T22:58:55.906429+0000","last_unstale":"2024-01-18T00:47:13.493122+0000","last_undegraded":"2024-01-18T00:47:13.493122+0000","last_fullsized":"2024-01-18T00:47:13.493122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":103553,"num_write":751,"num_write_kb":113909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'197","reported_seq":259,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.701655+0000","last_change":"2024-01-17T22:58:49.361059+0000","last_active":"2024-01-18T00:47:15.701655+0000","last_peered":"2024-01-18T00:47:15.701655+0000","last_clean":"2024-01-18T00:47:15.701655+0000","last_became_active":"2024-01-17T22:58:49.360282+0000","last_became_peered":"2024-01-17T22:58:49.360282+0000","last_unstale":"2024-01-18T00:47:15.701655+0000","last_undegraded":"2024-01-18T00:47:15.701655+0000","last_fullsized":"2024-01-18T00:47:15.701655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:10:15.673364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'183","reported_seq":247,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:28.602555+0000","last_change":"2024-01-17T22:58:48.349585+0000","last_active":"2024-01-18T00:45:28.602555+0000","last_peered":"2024-01-18T00:45:28.602555+0000","last_clean":"2024-01-18T00:45:28.602555+0000","last_became_active":"2024-01-17T22:58:48.349262+0000","last_became_peered":"2024-01-17T22:58:48.349262+0000","last_unstale":"2024-01-18T00:45:28.602555+0000","last_undegraded":"2024-01-18T00:45:28.602555+0000","last_fullsized":"2024-01-18T00:45:28.602555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'853","reported_seq":942,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.911679+0000","last_change":"2024-01-17T22:58:55.899604+0000","last_active":"2024-01-18T00:47:04.911679+0000","last_peered":"2024-01-18T00:47:04.911679+0000","last_clean":"2024-01-18T00:47:04.911679+0000","last_became_active":"2024-01-17T22:58:55.899176+0000","last_became_peered":"2024-01-17T22:58:55.899176+0000","last_unstale":"2024-01-18T00:47:04.911679+0000","last_undegraded":"2024-01-18T00:47:04.911679+0000","last_fullsized":"2024-01-18T00:47:04.911679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:13:47.829295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":85515,"num_write":843,"num_write_kb":192821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'218","reported_seq":288,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:24.731794+0000","last_change":"2024-01-18T00:47:24.731816+0000","last_active":"2024-01-18T00:47:24.731794+0000","last_peered":"2024-01-18T00:47:24.731794+0000","last_clean":"2024-01-18T00:47:24.731794+0000","last_became_active":"2024-01-17T22:58:49.363979+0000","last_became_peered":"2024-01-17T22:58:49.363979+0000","last_unstale":"2024-01-18T00:47:24.731794+0000","last_undegraded":"2024-01-18T00:47:24.731794+0000","last_fullsized":"2024-01-18T00:47:24.731794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'218","last_scrub_stamp":"2024-01-18T00:47:24.731720+0000","last_deep_scrub":"28'218","last_deep_scrub_stamp":"2024-01-18T00:47:24.731720+0000","last_clean_scrub_stamp":"2024-01-18T00:47:24.731720+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:05:55.164501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'58","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:22.873650+0000","last_change":"2024-01-18T00:47:22.873678+0000","last_active":"2024-01-18T00:47:22.873650+0000","last_peered":"2024-01-18T00:47:22.873650+0000","last_clean":"2024-01-18T00:47:22.873650+0000","last_became_active":"2024-01-17T22:58:48.321379+0000","last_became_peered":"2024-01-17T22:58:48.321379+0000","last_unstale":"2024-01-18T00:47:22.873650+0000","last_undegraded":"2024-01-18T00:47:22.873650+0000","last_fullsized":"2024-01-18T00:47:22.873650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'58","last_scrub_stamp":"2024-01-18T00:47:22.873594+0000","last_deep_scrub":"28'58","last_deep_scrub_stamp":"2024-01-18T00:47:22.873594+0000","last_clean_scrub_stamp":"2024-01-18T00:47:22.873594+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:32:41.455855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'867","reported_seq":979,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:08.754121+0000","last_change":"2024-01-17T22:58:55.873529+0000","last_active":"2024-01-18T00:47:08.754121+0000","last_peered":"2024-01-18T00:47:08.754121+0000","last_clean":"2024-01-18T00:47:08.754121+0000","last_became_active":"2024-01-17T22:58:55.872885+0000","last_became_peered":"2024-01-17T22:58:55.872885+0000","last_unstale":"2024-01-18T00:47:08.754121+0000","last_undegraded":"2024-01-18T00:47:08.754121+0000","last_fullsized":"2024-01-18T00:47:08.754121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":173952,"num_write":855,"num_write_kb":180962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'734","reported_seq":838,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.608523+0000","last_change":"2024-01-17T22:58:55.903620+0000","last_active":"2024-01-18T00:47:04.608523+0000","last_peered":"2024-01-18T00:47:04.608523+0000","last_clean":"2024-01-18T00:47:04.608523+0000","last_became_active":"2024-01-17T22:58:55.902860+0000","last_became_peered":"2024-01-17T22:58:55.902860+0000","last_unstale":"2024-01-18T00:47:04.608523+0000","last_undegraded":"2024-01-18T00:47:04.608523+0000","last_fullsized":"2024-01-18T00:47:04.608523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":112144,"num_write":721,"num_write_kb":109826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'202","reported_seq":265,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.652745+0000","last_change":"2024-01-17T22:58:49.515108+0000","last_active":"2024-01-18T00:47:15.652745+0000","last_peered":"2024-01-18T00:47:15.652745+0000","last_clean":"2024-01-18T00:47:15.652745+0000","last_became_active":"2024-01-17T22:58:49.514297+0000","last_became_peered":"2024-01-17T22:58:49.514297+0000","last_unstale":"2024-01-18T00:47:15.652745+0000","last_undegraded":"2024-01-18T00:47:15.652745+0000","last_fullsized":"2024-01-18T00:47:15.652745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'1279","reported_seq":1343,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:45:38.090199+0000","last_change":"2024-01-17T22:58:48.331952+0000","last_active":"2024-01-18T00:45:38.090199+0000","last_peered":"2024-01-18T00:45:38.090199+0000","last_clean":"2024-01-18T00:45:38.090199+0000","last_became_active":"2024-01-17T22:58:48.331645+0000","last_became_peered":"2024-01-17T22:58:48.331645+0000","last_unstale":"2024-01-18T00:45:38.090199+0000","last_undegraded":"2024-01-18T00:45:38.090199+0000","last_fullsized":"2024-01-18T00:45:38.090199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1279,"log_dups_size":0,"ondisk_log_size":1279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":12872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'696","reported_seq":782,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:16.382841+0000","last_change":"2024-01-17T22:58:55.906062+0000","last_active":"2024-01-18T00:47:16.382841+0000","last_peered":"2024-01-18T00:47:16.382841+0000","last_clean":"2024-01-18T00:47:16.382841+0000","last_became_active":"2024-01-17T22:58:55.905743+0000","last_became_peered":"2024-01-17T22:58:55.905743+0000","last_unstale":"2024-01-18T00:47:16.382841+0000","last_undegraded":"2024-01-18T00:47:16.382841+0000","last_fullsized":"2024-01-18T00:47:16.382841+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":59282,"num_write":679,"num_write_kb":96928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'234","reported_seq":296,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.704101+0000","last_change":"2024-01-17T22:58:49.369540+0000","last_active":"2024-01-18T00:47:15.704101+0000","last_peered":"2024-01-18T00:47:15.704101+0000","last_clean":"2024-01-18T00:47:15.704101+0000","last_became_active":"2024-01-17T22:58:49.366692+0000","last_became_peered":"2024-01-17T22:58:49.366692+0000","last_unstale":"2024-01-18T00:47:15.704101+0000","last_undegraded":"2024-01-18T00:47:15.704101+0000","last_fullsized":"2024-01-18T00:47:15.704101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:39:54.814019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'170","reported_seq":234,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:13.500192+0000","last_change":"2024-01-17T22:58:48.345003+0000","last_active":"2024-01-18T00:47:13.500192+0000","last_peered":"2024-01-18T00:47:13.500192+0000","last_clean":"2024-01-18T00:47:13.500192+0000","last_became_active":"2024-01-17T22:58:48.344271+0000","last_became_peered":"2024-01-17T22:58:48.344271+0000","last_unstale":"2024-01-18T00:47:13.500192+0000","last_undegraded":"2024-01-18T00:47:13.500192+0000","last_fullsized":"2024-01-18T00:47:13.500192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'1514","reported_seq":1577,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.983017+0000","last_change":"2024-01-17T22:58:48.342292+0000","last_active":"2024-01-18T00:47:15.983017+0000","last_peered":"2024-01-18T00:47:15.983017+0000","last_clean":"2024-01-18T00:47:15.983017+0000","last_became_active":"2024-01-17T22:58:48.339364+0000","last_became_peered":"2024-01-17T22:58:48.339364+0000","last_unstale":"2024-01-18T00:47:15.983017+0000","last_undegraded":"2024-01-18T00:47:15.983017+0000","last_fullsized":"2024-01-18T00:47:15.983017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":1514,"log_dups_size":0,"ondisk_log_size":1514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16419543,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1459,"num_write_kb":16764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'186","reported_seq":256,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:25.267478+0000","last_change":"2024-01-18T00:47:25.267644+0000","last_active":"2024-01-18T00:47:25.267478+0000","last_peered":"2024-01-18T00:47:25.267478+0000","last_clean":"2024-01-18T00:47:25.267478+0000","last_became_active":"2024-01-17T22:58:49.414163+0000","last_became_peered":"2024-01-17T22:58:49.414163+0000","last_unstale":"2024-01-18T00:47:25.267478+0000","last_undegraded":"2024-01-18T00:47:25.267478+0000","last_fullsized":"2024-01-18T00:47:25.267478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'186","last_scrub_stamp":"2024-01-18T00:47:25.267213+0000","last_deep_scrub":"28'186","last_deep_scrub_stamp":"2024-01-18T00:47:25.267213+0000","last_clean_scrub_stamp":"2024-01-18T00:47:25.267213+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:11:20.336269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'765","reported_seq":856,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:53.522472+0000","last_change":"2024-01-17T22:58:55.880197+0000","last_active":"2024-01-18T00:46:53.522472+0000","last_peered":"2024-01-18T00:46:53.522472+0000","last_clean":"2024-01-18T00:46:53.522472+0000","last_became_active":"2024-01-17T22:58:55.879263+0000","last_became_peered":"2024-01-17T22:58:55.879263+0000","last_unstale":"2024-01-18T00:46:53.522472+0000","last_undegraded":"2024-01-18T00:46:53.522472+0000","last_fullsized":"2024-01-18T00:46:53.522472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":97351,"num_write":747,"num_write_kb":155607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'208","reported_seq":270,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:43.763103+0000","last_change":"2024-01-17T22:58:48.339419+0000","last_active":"2024-01-18T00:46:43.763103+0000","last_peered":"2024-01-18T00:46:43.763103+0000","last_clean":"2024-01-18T00:46:43.763103+0000","last_became_active":"2024-01-17T22:58:48.338809+0000","last_became_peered":"2024-01-17T22:58:48.338809+0000","last_unstale":"2024-01-18T00:46:43.763103+0000","last_undegraded":"2024-01-18T00:46:43.763103+0000","last_fullsized":"2024-01-18T00:46:43.763103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:46.935232+0000","last_clean_scrub_stamp":"2024-01-17T22:58:46.935232+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:20:07.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195321,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'206","reported_seq":267,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.760995+0000","last_change":"2024-01-17T22:58:49.518469+0000","last_active":"2024-01-18T00:47:15.760995+0000","last_peered":"2024-01-18T00:47:15.760995+0000","last_clean":"2024-01-18T00:47:15.760995+0000","last_became_active":"2024-01-17T22:58:49.518211+0000","last_became_peered":"2024-01-17T22:58:49.518211+0000","last_unstale":"2024-01-18T00:47:15.760995+0000","last_undegraded":"2024-01-18T00:47:15.760995+0000","last_fullsized":"2024-01-18T00:47:15.760995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'779","reported_seq":879,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:44.254665+0000","last_change":"2024-01-17T22:58:55.913601+0000","last_active":"2024-01-18T00:46:44.254665+0000","last_peered":"2024-01-18T00:46:44.254665+0000","last_clean":"2024-01-18T00:46:44.254665+0000","last_became_active":"2024-01-17T22:58:55.912825+0000","last_became_peered":"2024-01-17T22:58:55.912825+0000","last_unstale":"2024-01-18T00:46:44.254665+0000","last_undegraded":"2024-01-18T00:46:44.254665+0000","last_fullsized":"2024-01-18T00:46:44.254665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:36.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":138691,"num_write":762,"num_write_kb":151906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'221","reported_seq":291,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.651660+0000","last_change":"2024-01-17T22:58:49.371282+0000","last_active":"2024-01-18T00:47:15.651660+0000","last_peered":"2024-01-18T00:47:15.651660+0000","last_clean":"2024-01-18T00:47:15.651660+0000","last_became_active":"2024-01-17T22:58:49.371125+0000","last_became_peered":"2024-01-17T22:58:49.371125+0000","last_unstale":"2024-01-18T00:47:15.651660+0000","last_undegraded":"2024-01-18T00:47:15.651660+0000","last_fullsized":"2024-01-18T00:47:15.651660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'215","reported_seq":285,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.682799+0000","last_change":"2024-01-17T22:58:49.510490+0000","last_active":"2024-01-18T00:47:15.682799+0000","last_peered":"2024-01-18T00:47:15.682799+0000","last_clean":"2024-01-18T00:47:15.682799+0000","last_became_active":"2024-01-17T22:58:49.509690+0000","last_became_peered":"2024-01-17T22:58:49.509690+0000","last_unstale":"2024-01-18T00:47:15.682799+0000","last_undegraded":"2024-01-18T00:47:15.682799+0000","last_fullsized":"2024-01-18T00:47:15.682799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:57.779484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'233","reported_seq":304,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.661721+0000","last_change":"2024-01-17T22:58:49.371326+0000","last_active":"2024-01-18T00:47:15.661721+0000","last_peered":"2024-01-18T00:47:15.661721+0000","last_clean":"2024-01-18T00:47:15.661721+0000","last_became_active":"2024-01-17T22:58:49.370511+0000","last_became_peered":"2024-01-17T22:58:49.370511+0000","last_unstale":"2024-01-18T00:47:15.661721+0000","last_undegraded":"2024-01-18T00:47:15.661721+0000","last_fullsized":"2024-01-18T00:47:15.661721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'208","reported_seq":277,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.702560+0000","last_change":"2024-01-17T22:58:49.385500+0000","last_active":"2024-01-18T00:47:15.702560+0000","last_peered":"2024-01-18T00:47:15.702560+0000","last_clean":"2024-01-18T00:47:15.702560+0000","last_became_active":"2024-01-17T22:58:49.384397+0000","last_became_peered":"2024-01-17T22:58:49.384397+0000","last_unstale":"2024-01-18T00:47:15.702560+0000","last_undegraded":"2024-01-18T00:47:15.702560+0000","last_fullsized":"2024-01-18T00:47:15.702560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:18.563360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'188","reported_seq":257,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.835746+0000","last_change":"2024-01-17T22:58:49.369750+0000","last_active":"2024-01-18T00:47:15.835746+0000","last_peered":"2024-01-18T00:47:15.835746+0000","last_clean":"2024-01-18T00:47:15.835746+0000","last_became_active":"2024-01-17T22:58:49.368591+0000","last_became_peered":"2024-01-17T22:58:49.368591+0000","last_unstale":"2024-01-18T00:47:15.835746+0000","last_undegraded":"2024-01-18T00:47:15.835746+0000","last_fullsized":"2024-01-18T00:47:15.835746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'203","reported_seq":272,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.830108+0000","last_change":"2024-01-17T22:58:49.380275+0000","last_active":"2024-01-18T00:47:15.830108+0000","last_peered":"2024-01-18T00:47:15.830108+0000","last_clean":"2024-01-18T00:47:15.830108+0000","last_became_active":"2024-01-17T22:58:49.379560+0000","last_became_peered":"2024-01-17T22:58:49.379560+0000","last_unstale":"2024-01-18T00:47:15.830108+0000","last_undegraded":"2024-01-18T00:47:15.830108+0000","last_fullsized":"2024-01-18T00:47:15.830108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'241","reported_seq":317,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:25.738722+0000","last_change":"2024-01-18T00:47:25.738743+0000","last_active":"2024-01-18T00:47:25.738722+0000","last_peered":"2024-01-18T00:47:25.738722+0000","last_clean":"2024-01-18T00:47:25.738722+0000","last_became_active":"2024-01-17T22:58:49.367330+0000","last_became_peered":"2024-01-17T22:58:49.367330+0000","last_unstale":"2024-01-18T00:47:25.738722+0000","last_undegraded":"2024-01-18T00:47:25.738722+0000","last_fullsized":"2024-01-18T00:47:25.738722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'241","last_scrub_stamp":"2024-01-18T00:47:25.738661+0000","last_deep_scrub":"28'241","last_deep_scrub_stamp":"2024-01-18T00:47:25.738661+0000","last_clean_scrub_stamp":"2024-01-18T00:47:25.738661+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:26.927623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'196","reported_seq":264,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.701464+0000","last_change":"2024-01-17T22:58:49.514419+0000","last_active":"2024-01-18T00:47:15.701464+0000","last_peered":"2024-01-18T00:47:15.701464+0000","last_clean":"2024-01-18T00:47:15.701464+0000","last_became_active":"2024-01-17T22:58:49.513924+0000","last_became_peered":"2024-01-17T22:58:49.513924+0000","last_unstale":"2024-01-18T00:47:15.701464+0000","last_undegraded":"2024-01-18T00:47:15.701464+0000","last_fullsized":"2024-01-18T00:47:15.701464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:24:43.594840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'222","reported_seq":298,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:25.103047+0000","last_change":"2024-01-18T00:47:25.103067+0000","last_active":"2024-01-18T00:47:25.103047+0000","last_peered":"2024-01-18T00:47:25.103047+0000","last_clean":"2024-01-18T00:47:25.103047+0000","last_became_active":"2024-01-17T22:58:49.370808+0000","last_became_peered":"2024-01-17T22:58:49.370808+0000","last_unstale":"2024-01-18T00:47:25.103047+0000","last_undegraded":"2024-01-18T00:47:25.103047+0000","last_fullsized":"2024-01-18T00:47:25.103047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'222","last_scrub_stamp":"2024-01-18T00:47:25.102983+0000","last_deep_scrub":"28'222","last_deep_scrub_stamp":"2024-01-18T00:47:25.102983+0000","last_clean_scrub_stamp":"2024-01-18T00:47:25.102983+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:12:39.606693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'200","reported_seq":266,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.703644+0000","last_change":"2024-01-17T22:58:49.350539+0000","last_active":"2024-01-18T00:47:15.703644+0000","last_peered":"2024-01-18T00:47:15.703644+0000","last_clean":"2024-01-18T00:47:15.703644+0000","last_became_active":"2024-01-17T22:58:49.350057+0000","last_became_peered":"2024-01-17T22:58:49.350057+0000","last_unstale":"2024-01-18T00:47:15.703644+0000","last_undegraded":"2024-01-18T00:47:15.703644+0000","last_fullsized":"2024-01-18T00:47:15.703644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:43.516572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'209","reported_seq":283,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:24.843292+0000","last_change":"2024-01-18T00:47:24.843313+0000","last_active":"2024-01-18T00:47:24.843292+0000","last_peered":"2024-01-18T00:47:24.843292+0000","last_clean":"2024-01-18T00:47:24.843292+0000","last_became_active":"2024-01-17T22:58:49.517631+0000","last_became_peered":"2024-01-17T22:58:49.517631+0000","last_unstale":"2024-01-18T00:47:24.843292+0000","last_undegraded":"2024-01-18T00:47:24.843292+0000","last_fullsized":"2024-01-18T00:47:24.843292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'209","last_scrub_stamp":"2024-01-18T00:47:24.843234+0000","last_deep_scrub":"28'209","last_deep_scrub_stamp":"2024-01-18T00:47:24.843234+0000","last_clean_scrub_stamp":"2024-01-18T00:47:24.843234+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:41:19.693577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'203","reported_seq":270,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.658653+0000","last_change":"2024-01-17T22:58:49.412901+0000","last_active":"2024-01-18T00:47:15.658653+0000","last_peered":"2024-01-18T00:47:15.658653+0000","last_clean":"2024-01-18T00:47:15.658653+0000","last_became_active":"2024-01-17T22:58:49.411772+0000","last_became_peered":"2024-01-17T22:58:49.411772+0000","last_unstale":"2024-01-18T00:47:15.658653+0000","last_undegraded":"2024-01-18T00:47:15.658653+0000","last_fullsized":"2024-01-18T00:47:15.658653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'220","reported_seq":278,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.681236+0000","last_change":"2024-01-17T22:59:08.750879+0000","last_active":"2024-01-18T00:47:15.681236+0000","last_peered":"2024-01-18T00:47:15.681236+0000","last_clean":"2024-01-18T00:47:15.681236+0000","last_became_active":"2024-01-17T22:59:08.750082+0000","last_became_peered":"2024-01-17T22:59:08.750082+0000","last_unstale":"2024-01-18T00:47:15.681236+0000","last_undegraded":"2024-01-18T00:47:15.681236+0000","last_fullsized":"2024-01-18T00:47:15.681236+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:49:12.522334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"28'209","reported_seq":276,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:23.084157+0000","last_change":"2024-01-17T22:58:49.415138+0000","last_active":"2024-01-18T00:47:23.084157+0000","last_peered":"2024-01-18T00:47:23.084157+0000","last_clean":"2024-01-18T00:47:23.084157+0000","last_became_active":"2024-01-17T22:58:49.414598+0000","last_became_peered":"2024-01-17T22:58:49.414598+0000","last_unstale":"2024-01-18T00:47:23.084157+0000","last_undegraded":"2024-01-18T00:47:23.084157+0000","last_fullsized":"2024-01-18T00:47:23.084157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'191","reported_seq":255,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.676927+0000","last_change":"2024-01-17T22:58:49.388702+0000","last_active":"2024-01-18T00:47:15.676927+0000","last_peered":"2024-01-18T00:47:15.676927+0000","last_clean":"2024-01-18T00:47:15.676927+0000","last_became_active":"2024-01-17T22:58:49.388096+0000","last_became_peered":"2024-01-17T22:58:49.388096+0000","last_unstale":"2024-01-18T00:47:15.676927+0000","last_undegraded":"2024-01-18T00:47:15.676927+0000","last_fullsized":"2024-01-18T00:47:15.676927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:07:53.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'199","reported_seq":272,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:23.148900+0000","last_change":"2024-01-18T00:47:23.148922+0000","last_active":"2024-01-18T00:47:23.148900+0000","last_peered":"2024-01-18T00:47:23.148900+0000","last_clean":"2024-01-18T00:47:23.148900+0000","last_became_active":"2024-01-17T22:58:49.369959+0000","last_became_peered":"2024-01-17T22:58:49.369959+0000","last_unstale":"2024-01-18T00:47:23.148900+0000","last_undegraded":"2024-01-18T00:47:23.148900+0000","last_fullsized":"2024-01-18T00:47:23.148900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'199","last_scrub_stamp":"2024-01-18T00:47:23.148840+0000","last_deep_scrub":"28'199","last_deep_scrub_stamp":"2024-01-18T00:47:23.148840+0000","last_clean_scrub_stamp":"2024-01-18T00:47:23.148840+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:05:42.004115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'218","reported_seq":291,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:26.108570+0000","last_change":"2024-01-18T00:47:26.108592+0000","last_active":"2024-01-18T00:47:26.108570+0000","last_peered":"2024-01-18T00:47:26.108570+0000","last_clean":"2024-01-18T00:47:26.108570+0000","last_became_active":"2024-01-17T22:58:49.366122+0000","last_became_peered":"2024-01-17T22:58:49.366122+0000","last_unstale":"2024-01-18T00:47:26.108570+0000","last_undegraded":"2024-01-18T00:47:26.108570+0000","last_fullsized":"2024-01-18T00:47:26.108570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'218","last_scrub_stamp":"2024-01-18T00:47:26.108502+0000","last_deep_scrub":"28'218","last_deep_scrub_stamp":"2024-01-18T00:47:26.108502+0000","last_clean_scrub_stamp":"2024-01-18T00:47:26.108502+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:04:46.080253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'209","reported_seq":273,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.698700+0000","last_change":"2024-01-17T22:58:49.349380+0000","last_active":"2024-01-18T00:47:15.698700+0000","last_peered":"2024-01-18T00:47:15.698700+0000","last_clean":"2024-01-18T00:47:15.698700+0000","last_became_active":"2024-01-17T22:58:49.348630+0000","last_became_peered":"2024-01-17T22:58:49.348630+0000","last_unstale":"2024-01-18T00:47:15.698700+0000","last_undegraded":"2024-01-18T00:47:15.698700+0000","last_fullsized":"2024-01-18T00:47:15.698700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:59:07.405202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'210","reported_seq":275,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.833041+0000","last_change":"2024-01-17T22:58:49.383079+0000","last_active":"2024-01-18T00:47:15.833041+0000","last_peered":"2024-01-18T00:47:15.833041+0000","last_clean":"2024-01-18T00:47:15.833041+0000","last_became_active":"2024-01-17T22:58:49.382454+0000","last_became_peered":"2024-01-17T22:58:49.382454+0000","last_unstale":"2024-01-18T00:47:15.833041+0000","last_undegraded":"2024-01-18T00:47:15.833041+0000","last_fullsized":"2024-01-18T00:47:15.833041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'196","reported_seq":259,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.833294+0000","last_change":"2024-01-17T22:58:49.366078+0000","last_active":"2024-01-18T00:47:15.833294+0000","last_peered":"2024-01-18T00:47:15.833294+0000","last_clean":"2024-01-18T00:47:15.833294+0000","last_became_active":"2024-01-17T22:58:49.364509+0000","last_became_peered":"2024-01-17T22:58:49.364509+0000","last_unstale":"2024-01-18T00:47:15.833294+0000","last_undegraded":"2024-01-18T00:47:15.833294+0000","last_fullsized":"2024-01-18T00:47:15.833294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'173","reported_seq":236,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.698323+0000","last_change":"2024-01-17T22:58:49.518204+0000","last_active":"2024-01-18T00:47:15.698323+0000","last_peered":"2024-01-18T00:47:15.698323+0000","last_clean":"2024-01-18T00:47:15.698323+0000","last_became_active":"2024-01-17T22:58:49.517927+0000","last_became_peered":"2024-01-17T22:58:49.517927+0000","last_unstale":"2024-01-18T00:47:15.698323+0000","last_undegraded":"2024-01-18T00:47:15.698323+0000","last_fullsized":"2024-01-18T00:47:15.698323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'173","reported_seq":236,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.690427+0000","last_change":"2024-01-17T22:58:49.364080+0000","last_active":"2024-01-18T00:47:15.690427+0000","last_peered":"2024-01-18T00:47:15.690427+0000","last_clean":"2024-01-18T00:47:15.690427+0000","last_became_active":"2024-01-17T22:58:49.363804+0000","last_became_peered":"2024-01-17T22:58:49.363804+0000","last_unstale":"2024-01-18T00:47:15.690427+0000","last_undegraded":"2024-01-18T00:47:15.690427+0000","last_fullsized":"2024-01-18T00:47:15.690427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"28'206","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.770107+0000","last_change":"2024-01-17T22:58:49.352782+0000","last_active":"2024-01-18T00:47:15.770107+0000","last_peered":"2024-01-18T00:47:15.770107+0000","last_clean":"2024-01-18T00:47:15.770107+0000","last_became_active":"2024-01-17T22:58:49.352513+0000","last_became_peered":"2024-01-17T22:58:49.352513+0000","last_unstale":"2024-01-18T00:47:15.770107+0000","last_undegraded":"2024-01-18T00:47:15.770107+0000","last_fullsized":"2024-01-18T00:47:15.770107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'213","reported_seq":275,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.760163+0000","last_change":"2024-01-17T22:58:49.519775+0000","last_active":"2024-01-18T00:47:15.760163+0000","last_peered":"2024-01-18T00:47:15.760163+0000","last_clean":"2024-01-18T00:47:15.760163+0000","last_became_active":"2024-01-17T22:58:49.518646+0000","last_became_peered":"2024-01-17T22:58:49.518646+0000","last_unstale":"2024-01-18T00:47:15.760163+0000","last_undegraded":"2024-01-18T00:47:15.760163+0000","last_fullsized":"2024-01-18T00:47:15.760163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'192","reported_seq":253,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.701716+0000","last_change":"2024-01-17T22:58:49.349737+0000","last_active":"2024-01-18T00:47:15.701716+0000","last_peered":"2024-01-18T00:47:15.701716+0000","last_clean":"2024-01-18T00:47:15.701716+0000","last_became_active":"2024-01-17T22:58:49.349021+0000","last_became_peered":"2024-01-17T22:58:49.349021+0000","last_unstale":"2024-01-18T00:47:15.701716+0000","last_undegraded":"2024-01-18T00:47:15.701716+0000","last_fullsized":"2024-01-18T00:47:15.701716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:42:24.949957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'204","reported_seq":266,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.697429+0000","last_change":"2024-01-17T22:58:49.415068+0000","last_active":"2024-01-18T00:47:15.697429+0000","last_peered":"2024-01-18T00:47:15.697429+0000","last_clean":"2024-01-18T00:47:15.697429+0000","last_became_active":"2024-01-17T22:58:49.414856+0000","last_became_peered":"2024-01-17T22:58:49.414856+0000","last_unstale":"2024-01-18T00:47:15.697429+0000","last_undegraded":"2024-01-18T00:47:15.697429+0000","last_fullsized":"2024-01-18T00:47:15.697429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'190","reported_seq":251,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.653918+0000","last_change":"2024-01-17T22:58:49.414783+0000","last_active":"2024-01-18T00:47:15.653918+0000","last_peered":"2024-01-18T00:47:15.653918+0000","last_clean":"2024-01-18T00:47:15.653918+0000","last_became_active":"2024-01-17T22:58:49.414446+0000","last_became_peered":"2024-01-17T22:58:49.414446+0000","last_unstale":"2024-01-18T00:47:15.653918+0000","last_undegraded":"2024-01-18T00:47:15.653918+0000","last_fullsized":"2024-01-18T00:47:15.653918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'210","reported_seq":280,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:20.955089+0000","last_change":"2024-01-18T00:47:20.955108+0000","last_active":"2024-01-18T00:47:20.955089+0000","last_peered":"2024-01-18T00:47:20.955089+0000","last_clean":"2024-01-18T00:47:20.955089+0000","last_became_active":"2024-01-17T22:58:49.357085+0000","last_became_peered":"2024-01-17T22:58:49.357085+0000","last_unstale":"2024-01-18T00:47:20.955089+0000","last_undegraded":"2024-01-18T00:47:20.955089+0000","last_fullsized":"2024-01-18T00:47:20.955089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'210","last_scrub_stamp":"2024-01-18T00:47:20.955022+0000","last_deep_scrub":"28'210","last_deep_scrub_stamp":"2024-01-18T00:47:20.955022+0000","last_clean_scrub_stamp":"2024-01-18T00:47:20.955022+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:48:26.904595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'196","reported_seq":268,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:22.220868+0000","last_change":"2024-01-17T22:58:49.414726+0000","last_active":"2024-01-18T00:47:22.220868+0000","last_peered":"2024-01-18T00:47:22.220868+0000","last_clean":"2024-01-18T00:47:22.220868+0000","last_became_active":"2024-01-17T22:58:49.414490+0000","last_became_peered":"2024-01-17T22:58:49.414490+0000","last_unstale":"2024-01-18T00:47:22.220868+0000","last_undegraded":"2024-01-18T00:47:22.220868+0000","last_fullsized":"2024-01-18T00:47:22.220868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'198","reported_seq":268,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.705089+0000","last_change":"2024-01-17T22:58:49.413155+0000","last_active":"2024-01-18T00:47:15.705089+0000","last_peered":"2024-01-18T00:47:15.705089+0000","last_clean":"2024-01-18T00:47:15.705089+0000","last_became_active":"2024-01-17T22:58:49.412382+0000","last_became_peered":"2024-01-17T22:58:49.412382+0000","last_unstale":"2024-01-18T00:47:15.705089+0000","last_undegraded":"2024-01-18T00:47:15.705089+0000","last_fullsized":"2024-01-18T00:47:15.705089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:04:38.588573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'201","reported_seq":271,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.707791+0000","last_change":"2024-01-17T22:58:49.368686+0000","last_active":"2024-01-18T00:47:15.707791+0000","last_peered":"2024-01-18T00:47:15.707791+0000","last_clean":"2024-01-18T00:47:15.707791+0000","last_became_active":"2024-01-17T22:58:49.367979+0000","last_became_peered":"2024-01-17T22:58:49.367979+0000","last_unstale":"2024-01-18T00:47:15.707791+0000","last_undegraded":"2024-01-18T00:47:15.707791+0000","last_fullsized":"2024-01-18T00:47:15.707791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:02:12.309297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'197","reported_seq":268,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.765043+0000","last_change":"2024-01-17T22:58:49.364561+0000","last_active":"2024-01-18T00:47:15.765043+0000","last_peered":"2024-01-18T00:47:15.765043+0000","last_clean":"2024-01-18T00:47:15.765043+0000","last_became_active":"2024-01-17T22:58:49.363810+0000","last_became_peered":"2024-01-17T22:58:49.363810+0000","last_unstale":"2024-01-18T00:47:15.765043+0000","last_undegraded":"2024-01-18T00:47:15.765043+0000","last_fullsized":"2024-01-18T00:47:15.765043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:48.190391+0000","last_clean_scrub_stamp":"2024-01-17T22:58:48.190391+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1120,"num_read_kb":3534792,"num_write":24383,"num_write_kb":4330508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24895,"ondisk_log_size":24895,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13088,"ondisk_log_size":13088,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":198335987,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":1788,"num_read_kb":2847,"num_write":22493,"num_write_kb":206433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":181755904,"data_stored":396671974,"data_compressed":51062148,"data_compressed_allocated":68689920,"data_compressed_original":283754496,"omap_allocated":0,"internal_metadata":0},"log_size":22013,"ondisk_log_size":22013,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":62458,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510754,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124208,"kb_used_data":12584,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94247632,"statfs":{"total":96636764160,"available":96509575168,"internally_reserved":0,"allocated":12886016,"data_stored":31038270,"data_compressed":4325598,"data_compressed_allocated":5689344,"data_compressed_original":24039424,"omap_allocated":1590,"internal_metadata":114293194},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.89200000000000002,"15min":0.88600000000000001},"min":{"1min":0.54800000000000004,"5min":0.42899999999999999,"15min":0.35399999999999998},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.84699999999999998,"15min":0.85299999999999998},"min":{"1min":0.66900000000000004,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.306,"5min":1.3240000000000001,"15min":1.603},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.92700000000000005,"15min":0.90600000000000003},"min":{"1min":0.626,"5min":0.46500000000000002,"15min":0.41499999999999998},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.90700000000000003,"15min":0.89300000000000002},"min":{"1min":0.68100000000000005,"5min":0.44600000000000001,"15min":0.28899999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.722},"last":1.077}]},{"osd":2,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.58899999999999997,"5min":0.45400000000000001,"15min":0.441},"max":{"1min":1.1970000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.038,"15min":0.98099999999999998},"min":{"1min":0.86399999999999999,"5min":0.50600000000000001,"15min":0.45800000000000002},"max":{"1min":2.7370000000000001,"5min":2.7370000000000001,"15min":2.7370000000000001},"last":0.95799999999999996}]},{"osd":3,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.89400000000000002,"15min":0.90300000000000002},"min":{"1min":0.60099999999999998,"5min":0.54000000000000004,"15min":0.48099999999999998},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.123,"5min":1.0609999999999999,"15min":1.0449999999999999},"min":{"1min":0.80400000000000005,"5min":0.54700000000000004,"15min":0.5},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":0.878}]},{"osd":4,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.999,"15min":1.018},"min":{"1min":0.59699999999999998,"5min":0.40100000000000002,"15min":0.32900000000000001},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.837},"last":1.228},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0089999999999999,"15min":1.03},"min":{"1min":0.54700000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.171,"15min":1.159},"min":{"1min":0.54500000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.141,"15min":1.1619999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.435},"max":{"1min":1.859,"5min":1.859,"15min":1.9159999999999999},"last":1.2889999999999999}]},{"osd":6,"last update":"Thu Jan 18 00:46:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.1839999999999999,"15min":1.196},"min":{"1min":0.54200000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.889,"5min":1.889,"15min":2.0209999999999999},"last":1.397},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.1519999999999999,"15min":1.1679999999999999},"min":{"1min":0.86399999999999999,"5min":0.53000000000000003,"15min":0.50900000000000001},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.119}]}]},{"osd":6,"up_from":15,"seq":64424510753,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83092,"kb_used_data":15820,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94288748,"statfs":{"total":96636764160,"available":96551677952,"internally_reserved":0,"allocated":16199680,"data_stored":33676965,"data_compressed":4280237,"data_compressed_allocated":5771264,"data_compressed_original":23433216,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85999999999999999,"15min":0.84799999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.44},"max":{"1min":1.2849999999999999,"5min":1.5580000000000001,"15min":1.788},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.878,"15min":0.84899999999999998},"min":{"1min":0.52500000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.65800000000000003}]},{"osd":1,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.83699999999999997,"15min":0.82199999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.45800000000000002},"max":{"1min":1.167,"5min":1.478,"15min":1.8540000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.018,"5min":0.93200000000000005,"15min":0.89500000000000002},"min":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.42999999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.641},"last":0.77200000000000002}]},{"osd":2,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.95199999999999996,"15min":0.94099999999999995},"min":{"1min":0.59799999999999998,"5min":0.54300000000000004,"15min":0.496},"max":{"1min":1.7030000000000001,"5min":1.766,"15min":1.766},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.96199999999999997,"15min":0.94399999999999995},"min":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.48499999999999999},"max":{"1min":1.4750000000000001,"5min":1.5629999999999999,"15min":2.1619999999999999},"last":1.226}]},{"osd":3,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.012,"15min":0.98399999999999999},"min":{"1min":0.76400000000000001,"5min":0.622,"15min":0.53900000000000003},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.997,"15min":0.93899999999999995},"min":{"1min":0.67600000000000005,"5min":0.66900000000000004,"15min":0.52300000000000002},"max":{"1min":1.1870000000000001,"5min":1.633,"15min":1.98},"last":1.034}]},{"osd":4,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.139,"15min":1.081},"min":{"1min":0.627,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":3.4969999999999999,"5min":3.4969999999999999,"15min":3.4969999999999999},"last":1.153},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.179,"15min":1.1359999999999999},"min":{"1min":0.66000000000000003,"5min":0.52700000000000002,"15min":0.46000000000000002},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":1.3400000000000001}]},{"osd":5,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.145,"15min":1.079},"min":{"1min":0.56699999999999995,"5min":0.49099999999999999,"15min":0.47499999999999998},"max":{"1min":3.8490000000000002,"5min":3.8490000000000002,"15min":3.8490000000000002},"last":1.181},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2230000000000001,"15min":1.177},"min":{"1min":0.78300000000000003,"5min":0.60999999999999999,"15min":0.54200000000000004},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":1.0720000000000001}]},{"osd":7,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.284,"15min":1.2250000000000001},"min":{"1min":0.75700000000000001,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":4.2910000000000004,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.254,"15min":1.2},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.56799999999999995},"max":{"1min":1.534,"5min":2.0649999999999999,"15min":2.129},"last":1.4570000000000001}]}]},{"osd":4,"up_from":15,"seq":64424510753,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121324,"kb_used_data":22180,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94250516,"statfs":{"total":96636764160,"available":96512528384,"internally_reserved":0,"allocated":22712320,"data_stored":50454822,"data_compressed":6935579,"data_compressed_allocated":9256960,"data_compressed_original":37212160,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86299999999999999,"15min":0.84499999999999997},"min":{"1min":0.52800000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.6879999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.83499999999999996,"15min":0.84199999999999997},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.42799999999999999},"max":{"1min":1.464,"5min":1.464,"15min":2.2410000000000001},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.90500000000000003,"15min":0.89000000000000001},"min":{"1min":0.63,"5min":0.47399999999999998,"15min":0.36199999999999999},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.626},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.89200000000000002,"15min":0.90700000000000003},"min":{"1min":0.499,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4179999999999999,"5min":2.097,"15min":2.097},"last":1.0900000000000001}]},{"osd":2,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.88200000000000001,"15min":0.91200000000000003},"min":{"1min":0.68700000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.96499999999999997,"15min":0.95799999999999996},"min":{"1min":0.65000000000000002,"5min":0.55500000000000005,"15min":0.34300000000000003},"max":{"1min":1.4510000000000001,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":0.96599999999999997}]},{"osd":3,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.90500000000000003,"15min":0.93200000000000005},"min":{"1min":0.54700000000000004,"5min":0.54000000000000004,"15min":0.41099999999999998},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":2.335},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.0800000000000001,"5min":0.98899999999999999,"15min":1.004},"min":{"1min":0.67300000000000004,"5min":0.60799999999999998,"15min":0.45300000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.054}]},{"osd":5,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.044,"15min":1.0840000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.35999999999999999},"max":{"1min":1.518,"5min":2.403,"15min":2.9249999999999998},"last":1.194},{"interface":"front","average":{"1min":1.141,"5min":1.04,"15min":1.075},"min":{"1min":0.66700000000000004,"5min":0.55200000000000005,"15min":0.38200000000000001},"max":{"1min":1.7909999999999999,"5min":1.804,"15min":2.4289999999999998},"last":0.874}]},{"osd":6,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1020000000000001,"15min":1.1339999999999999},"min":{"1min":0.57699999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.1110000000000002,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.181,"15min":1.202},"min":{"1min":0.56499999999999995,"5min":0.45800000000000002,"15min":0.38100000000000001},"max":{"1min":1.7989999999999999,"5min":2.4740000000000002,"15min":3.101},"last":1.254}]},{"osd":7,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.1639999999999999,"15min":1.1830000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.841,"5min":4.25,"15min":4.25},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2110000000000001,"15min":1.2549999999999999},"min":{"1min":0.59199999999999997,"5min":0.503,"15min":0.40200000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.5110000000000001},"last":1.1679999999999999}]}]},{"osd":3,"up_from":15,"seq":64424510753,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160572,"kb_used_data":39220,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94211268,"statfs":{"total":96636764160,"available":96472338432,"internally_reserved":0,"allocated":40161280,"data_stored":87845266,"data_compressed":11483169,"data_compressed_allocated":15335424,"data_compressed_original":63209472,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44,"15min":0.42899999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.23000000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45800000000000002,"15min":0.46300000000000002},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.25600000000000001},"max":{"1min":0.58299999999999996,"5min":0.72799999999999998,"15min":0.753},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.29399999999999998,"5min":0.28100000000000003,"15min":0.27500000000000002},"max":{"1min":0.61499999999999999,"5min":0.751,"15min":0.78000000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.502,"15min":0.496},"min":{"1min":0.318,"5min":0.313,"15min":0.27300000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.314},"max":{"1min":0.66700000000000004,"5min":0.79700000000000004,"15min":0.84299999999999997},"last":0.62},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.39000000000000001,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.68400000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.42099999999999999},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78300000000000003,"15min":0.76500000000000001},"min":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.105,"5min":1.325,"15min":1.325},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.76800000000000002},"min":{"1min":0.54200000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.1160000000000001,"5min":1.1559999999999999,"15min":1.1970000000000001},"last":0.874},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.754},"min":{"1min":0.52400000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0269999999999999,"5min":1.1539999999999999,"15min":1.2150000000000001},"last":1.0589999999999999}]},{"osd":6,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82299999999999995,"15min":0.80900000000000005},"min":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.48899999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2150000000000001},"last":1.04}]},{"osd":7,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.80300000000000005,"15min":0.79900000000000004},"min":{"1min":0.51100000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.24,"5min":1.248,"15min":1.337},"last":1.1559999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.83399999999999996,"15min":0.82199999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.42099999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.96299999999999997}]}]},{"osd":2,"up_from":15,"seq":64424510753,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94904,"kb_used_data":13808,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94276936,"statfs":{"total":96636764160,"available":96539582464,"internally_reserved":0,"allocated":14139392,"data_stored":33676072,"data_compressed":4580308,"data_compressed_allocated":5976064,"data_compressed_original":25698304,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42099999999999999,"15min":0.432},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.24299999999999999},"max":{"1min":0.58599999999999997,"5min":0.65300000000000002,"15min":1.095},"last":0.44},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26300000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":1.355},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.47599999999999998},"min":{"1min":0.36299999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64400000000000002,"5min":0.97699999999999998,"15min":1.026},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.503},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.308},"max":{"1min":0.67400000000000004,"5min":1.032,"15min":1.194},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.28599999999999998},"max":{"1min":0.754,"5min":0.77000000000000002,"15min":0.995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53800000000000003},"min":{"1min":0.36099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70499999999999996,"5min":0.90500000000000003,"15min":0.96999999999999997},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.75,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.46300000000000002,"15min":0.44700000000000001},"max":{"1min":1.014,"5min":1.155,"15min":1.502},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72299999999999998,"15min":0.752},"min":{"1min":0.46899999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.96899999999999997,"5min":1.0660000000000001,"15min":1.282},"last":0.78800000000000003}]},{"osd":5,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.751,"15min":0.753},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":1.099,"15min":1.1479999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.79000000000000004},"min":{"1min":0.61299999999999999,"5min":0.48899999999999999,"15min":0.48099999999999998},"max":{"1min":1.0649999999999999,"5min":4.343,"15min":4.343},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.46600000000000003},"max":{"1min":0.95899999999999996,"5min":1.075,"15min":1.528},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79900000000000004,"15min":0.81200000000000006},"min":{"1min":0.52900000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1379999999999999,"5min":1.1599999999999999,"15min":3.9159999999999999},"last":0.80600000000000005}]},{"osd":7,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80400000000000005,"15min":0.80200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.499},"max":{"1min":1.1040000000000001,"5min":1.248,"15min":1.248},"last":0.752},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.54500000000000004,"15min":0.51300000000000001},"max":{"1min":1.1160000000000001,"5min":3.9060000000000001,"15min":5.7370000000000001},"last":0.61699999999999999}]}]},{"osd":1,"up_from":15,"seq":64424510753,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108440,"kb_used_data":19024,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94263400,"statfs":{"total":96636764160,"available":96525721600,"internally_reserved":0,"allocated":19480576,"data_stored":38460198,"data_compressed":4277353,"data_compressed_allocated":5976064,"data_compressed_original":25141248,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.46400000000000002,"15min":0.439},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.39000000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69899999999999995,"5min":0.70299999999999996,"15min":0.73099999999999998},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.47299999999999998,"15min":0.46000000000000002},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.27800000000000002},"max":{"1min":0.629,"5min":0.70399999999999996,"15min":0.73099999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51700000000000002,"15min":0.51000000000000001},"min":{"1min":0.42199999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71699999999999997,"5min":0.77400000000000002,"15min":0.85099999999999998},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.55000000000000004},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.36799999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.79900000000000004},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.71599999999999997},"min":{"1min":0.53500000000000003,"5min":0.442,"15min":0.38700000000000001},"max":{"1min":0.89600000000000002,"5min":1.0549999999999999,"15min":1.103},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77200000000000002,"15min":0.78100000000000003},"min":{"1min":0.60299999999999998,"5min":0.47099999999999997,"15min":0.439},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.5700000000000001},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76200000000000001,"15min":0.76000000000000001},"min":{"1min":0.53000000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1299999999999999,"5min":1.1439999999999999,"15min":2.8069999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79000000000000004,"15min":0.77600000000000002},"min":{"1min":0.58599999999999997,"5min":0.46400000000000002,"15min":0.45400000000000001},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.27},"last":0.97399999999999998}]},{"osd":6,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.79400000000000004},"min":{"1min":0.64600000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.0660000000000001,"5min":1.242,"15min":1.395},"last":0.754},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.73699999999999999,"5min":0.5,"15min":0.46400000000000002},"max":{"1min":0.996,"5min":1.1279999999999999,"15min":1.1830000000000001},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.85099999999999998,"15min":0.83699999999999997},"min":{"1min":0.76900000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":3.9009999999999998},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.622,"5min":0.55700000000000005,"15min":0.50800000000000001},"max":{"1min":1.1379999999999999,"5min":1.2270000000000001,"15min":1.3999999999999999},"last":0.90300000000000002}]}]},{"osd":0,"up_from":14,"seq":60129543456,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143120,"kb_used_data":31496,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94228720,"statfs":{"total":96636764160,"available":96490209280,"internally_reserved":0,"allocated":32251904,"data_stored":71068140,"data_compressed":8958305,"data_compressed_allocated":12132352,"data_compressed_original":51142656,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44500000000000001,"15min":0.42899999999999999},"min":{"1min":0.29199999999999998,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.64500000000000002,"5min":0.66600000000000004,"15min":0.68400000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47899999999999998,"15min":0.47199999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.26700000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.502,"15min":0.496},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.28199999999999997},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.84999999999999998},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.311,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67900000000000005,"5min":0.69599999999999995,"15min":0.80200000000000005},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.49399999999999999,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.308,"15min":0.30499999999999999},"max":{"1min":0.72499999999999998,"5min":0.73999999999999999,"15min":0.81799999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.377},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.497}]},{"osd":4,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72199999999999998,"15min":0.73399999999999999},"min":{"1min":0.57899999999999996,"5min":0.46500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89500000000000002,"5min":1.3620000000000001,"15min":2.1779999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.745,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.505,"15min":0.44400000000000001},"max":{"1min":1.0149999999999999,"5min":1.159,"15min":1.159},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76900000000000002,"15min":0.76500000000000001},"min":{"1min":0.58799999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97199999999999998,"5min":1.423,"15min":1.423},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.59199999999999997,"5min":0.47599999999999998,"15min":0.42399999999999999},"max":{"1min":1.03,"5min":1.623,"15min":1.623},"last":0.747}]},{"osd":6,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.84699999999999998,"15min":0.82399999999999995},"min":{"1min":0.64300000000000002,"5min":0.52600000000000002,"15min":0.49099999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.874},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.84899999999999998,"15min":0.82699999999999996},"min":{"1min":0.57399999999999995,"5min":0.49099999999999999,"15min":0.46200000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.29},"last":0.82599999999999996}]},{"osd":7,"last update":"Thu Jan 18 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.82299999999999995,"15min":0.81799999999999995},"min":{"1min":0.64400000000000002,"5min":0.48299999999999998,"15min":0.44400000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.86799999999999999,"15min":0.85799999999999998},"min":{"1min":0.64800000000000002,"5min":0.61099999999999999,"15min":0.47899999999999998},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.88200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834576162,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":129092,"kb_used_data":25788,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94242748,"statfs":{"total":96636764160,"available":96504573952,"internally_reserved":0,"allocated":26406912,"data_stored":52600449,"data_compressed":6284057,"data_compressed_allocated":8634368,"data_compressed_original":35024896,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.81999999999999995,"15min":0.86399999999999999},"min":{"1min":0.52800000000000002,"5min":0.40100000000000002,"15min":0.36699999999999999},"max":{"1min":1.2729999999999999,"5min":1.3560000000000001,"15min":1.5409999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84099999999999997,"15min":0.85899999999999999},"min":{"1min":0.498,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.173,"5min":1.2170000000000001,"15min":1.7569999999999999},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.88100000000000001,"15min":0.90600000000000003},"min":{"1min":0.498,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2430000000000001,"5min":1.323,"15min":1.6299999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89400000000000002,"15min":0.91500000000000004},"min":{"1min":0.48799999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.5049999999999999},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.84999999999999998,"15min":0.84799999999999998},"min":{"1min":0.55500000000000005,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.95999999999999996,"15min":0.98099999999999998},"min":{"1min":0.66700000000000004,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2430000000000001,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.98499999999999999,"15min":0.998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2849999999999999,"5min":1.613,"15min":2.1499999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.94199999999999995,"15min":0.95699999999999996},"min":{"1min":0.63400000000000001,"5min":0.41099999999999998,"15min":0.40500000000000003},"max":{"1min":1.552,"5min":1.552,"15min":1.9430000000000001},"last":0.996}]},{"osd":4,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.073,"15min":1.085},"min":{"1min":0.56399999999999995,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.5089999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.137,"15min":1.1319999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.607,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.0840000000000001}]},{"osd":6,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.105,"15min":1.079},"min":{"1min":0.76000000000000001,"5min":0.55100000000000005,"15min":0.51800000000000002},"max":{"1min":1.659,"5min":1.659,"15min":1.8640000000000001},"last":1.123},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1699999999999999,"15min":1.1839999999999999},"min":{"1min":0.80500000000000005,"5min":0.69099999999999995,"15min":0.46999999999999997},"max":{"1min":1.5129999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.96399999999999997}]},{"osd":7,"last update":"Thu Jan 18 00:46:32 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.25,"15min":1.2350000000000001},"min":{"1min":0.66800000000000004,"5min":0.65900000000000003,"15min":0.57799999999999996},"max":{"1min":1.732,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.161},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.228,"15min":1.2170000000000001},"min":{"1min":0.73499999999999999,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.351}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31229,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31229,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31956992,"data_stored":70947206,"data_compressed":8958305,"data_compressed_allocated":12132352,"data_compressed_original":51142656,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19124224,"data_stored":37748896,"data_compressed":4246124,"data_compressed_allocated":5935104,"data_compressed_original":24567808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13844480,"data_stored":33555138,"data_compressed":4580308,"data_compressed_allocated":5976064,"data_compressed_original":25698304,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39866368,"data_stored":87724332,"data_compressed":11483169,"data_compressed_allocated":15335424,"data_compressed_original":63209472,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22417408,"data_stored":50333888,"data_compressed":6935579,"data_compressed_allocated":9256960,"data_compressed_original":37212160,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26050560,"data_stored":51889147,"data_compressed":6252828,"data_compressed_allocated":8593408,"data_compressed_original":34451456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15904768,"data_stored":33556031,"data_compressed":4280237,"data_compressed_allocated":5771264,"data_compressed_original":23433216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12591104,"data_stored":30917336,"data_compressed":4325598,"data_compressed_allocated":5689344,"data_compressed_original":24039424,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-18T00:47:27.678 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.678 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.678 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.679 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.679 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.679 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.679 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.679 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.679 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.679 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.679 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.679 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.679 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.680 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.680 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.680 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.680 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.680 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.680 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.680 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.680 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.680 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.681 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.681 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.681 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.681 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.681 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.681 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.681 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.681 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.681 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.681 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.681 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.682 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.682 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.682 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.682 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.682 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.682 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.682 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.682 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.682 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.682 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.682 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.683 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.683 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.683 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.683 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.683 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.683 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.683 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.683 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.683 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.684 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.684 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.684 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.684 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.684 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.684 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.684 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.684 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.684 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.684 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.685 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.685 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.685 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.685 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.685 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.685 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.685 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.685 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.685 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.685 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.685 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.686 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.686 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.686 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.686 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.686 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.686 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-01-17T22:58:46.935232+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=46, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.686 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.686 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.686 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.686 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.687 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.687 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.687 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.687 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.687 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.687 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.687 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.687 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.687 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.687 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.688 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.688 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.688 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.688 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.688 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.688 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.688 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.688 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.688 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.688 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.689 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.689 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.689 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.689 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-01-17T22:58:48.190391+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=48, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:27.689 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-18T00:47:34.270 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:49:57.629 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:34.275 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:49:57.634 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:34.307 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:49:57.585 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:34.311 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:49:57.589 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:34.330 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:49:57.608 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:34.331 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:49:57.609 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:34.353 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:49:57.712 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:34.496 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:49:57.774 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:34.497 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:49:57.776 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:44.979 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:50:08.338 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:44.984 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:50:08.344 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:45.012 INFO:tasks.ceph.mon.a.smithi161.stderr:==00:01:50:08.371 27389== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:45.098 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:50:08.376 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:45.105 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:50:08.384 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:45.108 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:50:08.386 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:45.109 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:50:08.388 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:45.173 INFO:tasks.ceph.mon.c.smithi190.stderr:==00:01:50:08.452 27872== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:45.187 INFO:tasks.ceph.mon.b.smithi190.stderr:==00:01:50:08.465 27870== Warning: unimplemented fcntl command: 1036 2024-01-18T00:47:47.689 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-18T00:47:47.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.826+0000 7f566f400640 1 Processor -- start 2024-01-18T00:47:47.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.826+0000 7f566f400640 1 -- start start 2024-01-18T00:47:47.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.826+0000 7f566f400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5668150560 0x7f5668156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:47.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.826+0000 7f566f400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f56680c0090 0x7f5668159910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:47.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.826+0000 7f566f400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566806dc10 con 0x7f56680c5a70 2024-01-18T00:47:47.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.826+0000 7f566f400640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566806d7e0 con 0x7f56680c0090 2024-01-18T00:47:47.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.826+0000 7f566f400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56681564c0 con 0x7f5668150560 2024-01-18T00:47:47.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.830+0000 7f566ca00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5668150560 0x7f5668156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:47.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.830+0000 7f5667e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f56680c5a70 0x7f56680722e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:41854/0 (socket says 172.21.15.161:41854) 2024-01-18T00:47:47.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.830+0000 7f5667e00640 1 -- 172.21.15.161:0/2981423081 learned_addr learned my addr 172.21.15.161:0/2981423081 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-18T00:47:47.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.830+0000 7f5667400640 1 -- 172.21.15.161:0/2981423081 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653672099 0 0) 0x7f566806dc10 con 0x7f56680c5a70 2024-01-18T00:47:47.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.830+0000 7f5667400640 1 -- 172.21.15.161:0/2981423081 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5648005740 con 0x7f56680c5a70 2024-01-18T00:47:47.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.834+0000 7f566d400640 1 --2- 172.21.15.161:0/2981423081 >> v2:172.21.15.190:3300/0 conn(0x7f56680c0090 0x7f5668159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:47.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.834+0000 7f5667400640 1 -- 172.21.15.161:0/2981423081 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2039255289 0 0) 0x7f5648005740 con 0x7f56680c5a70 2024-01-18T00:47:47.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.834+0000 7f5667400640 1 -- 172.21.15.161:0/2981423081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5668150560 msgr2=0x7f5668156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:47.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.834+0000 7f5667400640 1 --2- 172.21.15.161:0/2981423081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5668150560 0x7f5668156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:47.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.834+0000 7f5667400640 1 -- 172.21.15.161:0/2981423081 >> v2:172.21.15.190:3300/0 conn(0x7f56680c0090 msgr2=0x7f5668159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:47.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.834+0000 7f5667400640 1 --2- 172.21.15.161:0/2981423081 >> v2:172.21.15.190:3300/0 conn(0x7f56680c0090 0x7f5668159910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:47.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.834+0000 7f5667400640 1 -- 172.21.15.161:0/2981423081 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566806d220 con 0x7f56680c5a70 2024-01-18T00:47:47.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.834+0000 7f5667400640 1 -- 172.21.15.161:0/2981423081 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f56500016a0 con 0x7f56680c5a70 2024-01-18T00:47:47.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.834+0000 7f5667400640 1 -- 172.21.15.161:0/2981423081 >> v1:172.21.15.161:6789/0 conn(0x7f56680c5a70 legacy=0x7f56680722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:47.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.834+0000 7f5667400640 1 --2- 172.21.15.161:0/2981423081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5648005b90 0x7f5648005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:47.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.834+0000 7f5667400640 1 --2- 172.21.15.161:0/2981423081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56480069e0 0x7f5648006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:47.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.834+0000 7f5667400640 1 --2- 172.21.15.161:0/2981423081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5668150560 0x7f5648007400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:47.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.834+0000 7f5667400640 1 -- 172.21.15.161:0/2981423081 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566806d7e0 con 0x7f56480069e0 2024-01-18T00:47:47.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.834+0000 7f5667400640 1 -- 172.21.15.161:0/2981423081 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56681564c0 con 0x7f5648005b90 2024-01-18T00:47:47.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.834+0000 7f5667400640 1 -- 172.21.15.161:0/2981423081 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564800dde0 con 0x7f5668150560 2024-01-18T00:47:47.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.838+0000 7f5667e00640 1 --2- 172.21.15.161:0/2981423081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56480069e0 0x7f5648006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:47.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.842+0000 7f5667e00640 1 -- 172.21.15.161:0/2981423081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5668150560 msgr2=0x7f5648007400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:47.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.842+0000 7f5667e00640 1 --2- 172.21.15.161:0/2981423081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5668150560 0x7f5648007400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:47.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.842+0000 7f5667e00640 1 -- 172.21.15.161:0/2981423081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5648005b90 msgr2=0x7f5648005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:47:47.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.842+0000 7f5667e00640 1 --2- 172.21.15.161:0/2981423081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5648005b90 0x7f5648005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:47.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.842+0000 7f5667e00640 1 -- 172.21.15.161:0/2981423081 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5648005740 con 0x7f56480069e0 2024-01-18T00:47:47.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.846+0000 7f5667e00640 1 --2- 172.21.15.161:0/2981423081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56480069e0 0x7f5648006e60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f565000c160 tx=0x7f565001cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a523b14b000d5743 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:47.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.850+0000 7f5667400640 1 -- 172.21.15.161:0/2981423081 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56500058e0 con 0x7f56480069e0 2024-01-18T00:47:47.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.850+0000 7f5667400640 1 -- 172.21.15.161:0/2981423081 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5650005a40 con 0x7f56480069e0 2024-01-18T00:47:47.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.850+0000 7f5667400640 1 -- 172.21.15.161:0/2981423081 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5650005e30 con 0x7f56480069e0 2024-01-18T00:47:47.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.850+0000 7f566f400640 1 -- 172.21.15.161:0/2981423081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56480069e0 msgr2=0x7f5648006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:47.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.850+0000 7f566f400640 1 --2- 172.21.15.161:0/2981423081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56480069e0 0x7f5648006e60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f565000c160 tx=0x7f565001cb60 comp rx=0 tx=0).stop 2024-01-18T00:47:47.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.850+0000 7f566d400640 1 -- 172.21.15.161:0/2981423081 reap_dead start 2024-01-18T00:47:47.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.850+0000 7f566f400640 1 -- 172.21.15.161:0/2981423081 shutdown_connections 2024-01-18T00:47:47.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.850+0000 7f566f400640 1 -- 172.21.15.161:0/2981423081 >> 172.21.15.161:0/2981423081 conn(0x7f56680cb070 msgr2=0x7f56680cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:47.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.850+0000 7f566f400640 1 -- 172.21.15.161:0/2981423081 shutdown_connections 2024-01-18T00:47:47.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.850+0000 7f566f400640 1 -- 172.21.15.161:0/2981423081 wait complete. 2024-01-18T00:47:47.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.854+0000 7f566f400640 1 Processor -- start 2024-01-18T00:47:47.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.854+0000 7f566f400640 1 -- start start 2024-01-18T00:47:47.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.854+0000 7f566f400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56480069e0 0x7f56681f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:47.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.854+0000 7f566f400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5668159990 0x7f56680c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:47.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.854+0000 7f566f400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56680c8e70 0x7f56680ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:47.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.854+0000 7f566f400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5668159240 con 0x7f56680c8e70 2024-01-18T00:47:47.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.854+0000 7f566f400640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5668155450 con 0x7f5668159990 2024-01-18T00:47:47.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.854+0000 7f566f400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5668154e60 con 0x7f56480069e0 2024-01-18T00:47:47.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.854+0000 7f5667e00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5668159990 0x7f56680c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:47.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.854+0000 7f566d400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56680c8e70 0x7f56680ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:47.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.858+0000 7f5667e00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5668159990 0x7f56680c7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.161:50468/0 (socket says 172.21.15.161:50468) 2024-01-18T00:47:47.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.858+0000 7f5667e00640 1 -- 172.21.15.161:0/349310617 learned_addr learned my addr 172.21.15.161:0/349310617 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:47:47.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.858+0000 7f566ca00640 1 --2- 172.21.15.161:0/349310617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56480069e0 0x7f56681f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:47.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.866+0000 7f5667e00640 1 -- 172.21.15.161:0/349310617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56480069e0 msgr2=0x7f56681f67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:47.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.866+0000 7f5667e00640 1 --2- 172.21.15.161:0/349310617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56480069e0 0x7f56681f67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:47.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.866+0000 7f5667e00640 1 -- 172.21.15.161:0/349310617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56680c8e70 msgr2=0x7f56680ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:47.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.866+0000 7f5667e00640 1 --2- 172.21.15.161:0/349310617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56680c8e70 0x7f56680ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:47.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.866+0000 7f5667e00640 1 -- 172.21.15.161:0/349310617 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56681e5440 con 0x7f5668159990 2024-01-18T00:47:47.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.874+0000 7f5667e00640 1 --2- 172.21.15.161:0/349310617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5668159990 0x7f56680c7d60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5650007040 tx=0x7f5648007a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:47.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.994+0000 7f5664c00640 1 -- 172.21.15.161:0/349310617 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5650005e10 con 0x7f5668159990 2024-01-18T00:47:47.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.994+0000 7f5664c00640 1 -- 172.21.15.161:0/349310617 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5650001460 con 0x7f5668159990 2024-01-18T00:47:47.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.994+0000 7f5664c00640 1 -- 172.21.15.161:0/349310617 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56500070d0 con 0x7f5668159990 2024-01-18T00:47:47.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.994+0000 7f566f400640 1 -- 172.21.15.161:0/349310617 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56681e5720 con 0x7f5668159990 2024-01-18T00:47:47.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.994+0000 7f566f400640 1 -- 172.21.15.161:0/349310617 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56681f6290 con 0x7f5668159990 2024-01-18T00:47:47.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:47.998+0000 7f566f400640 1 -- 172.21.15.161:0/349310617 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56680746a0 con 0x7f5668159990 2024-01-18T00:47:48.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.314+0000 7f5664c00640 1 -- 172.21.15.161:0/349310617 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f5650007250 con 0x7f5668159990 2024-01-18T00:47:48.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.314+0000 7f5664c00640 1 --2- 172.21.15.161:0/349310617 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f56400668c0 0x7f5640068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:47:48.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.314+0000 7f566ca00640 1 --2- 172.21.15.161:0/349310617 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f56400668c0 0x7f5640068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:47:48.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.318+0000 7f566ca00640 1 --2- 172.21.15.161:0/349310617 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f56400668c0 0x7f5640068d80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f56580093f0 tx=0x7f56580094c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:47:48.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.322+0000 7f5664c00640 1 -- 172.21.15.161:0/349310617 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f56500afe40 con 0x7f5668159990 2024-01-18T00:47:48.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.354+0000 7f5664c00640 1 -- 172.21.15.161:0/349310617 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f56500eadc0 con 0x7f5668159990 2024-01-18T00:47:48.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.518+0000 7f566f400640 1 -- 172.21.15.161:0/349310617 --> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f56680719e0 con 0x7f56400668c0 2024-01-18T00:47:48.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.526+0000 7f5664c00640 1 -- 172.21.15.161:0/349310617 <== mgr.4110 v2:172.21.15.161:6800/272458188 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371978 (secure 0 0 0) 0x7f5658011a40 con 0x7f56400668c0 2024-01-18T00:47:48.531 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-18T00:47:48.533 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-01-18T00:47:48.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.530+0000 7f566f400640 1 -- 172.21.15.161:0/349310617 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f56400668c0 msgr2=0x7f5640068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:48.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.530+0000 7f566f400640 1 --2- 172.21.15.161:0/349310617 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f56400668c0 0x7f5640068d80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f56580093f0 tx=0x7f56580094c0 comp rx=0 tx=0).stop 2024-01-18T00:47:48.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.530+0000 7f566f400640 1 -- 172.21.15.161:0/349310617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5668159990 msgr2=0x7f56680c7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:47:48.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.530+0000 7f566f400640 1 --2- 172.21.15.161:0/349310617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5668159990 0x7f56680c7d60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5650007040 tx=0x7f5648007a10 comp rx=0 tx=0).stop 2024-01-18T00:47:48.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.530+0000 7f566f400640 1 -- 172.21.15.161:0/349310617 shutdown_connections 2024-01-18T00:47:48.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.530+0000 7f566f400640 1 --2- 172.21.15.161:0/349310617 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f56400668c0 0x7f5640068d80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:48.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.530+0000 7f566f400640 1 --2- 172.21.15.161:0/349310617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5668159990 0x7f56680c7d60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:48.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.530+0000 7f566f400640 1 --2- 172.21.15.161:0/349310617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56680c8e70 0x7f56680ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:48.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.530+0000 7f566f400640 1 --2- 172.21.15.161:0/349310617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56480069e0 0x7f56681f67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:47:48.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.530+0000 7f566f400640 1 -- 172.21.15.161:0/349310617 >> 172.21.15.161:0/349310617 conn(0x7f56680cb070 msgr2=0x7f566814f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:47:48.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.530+0000 7f566f400640 1 -- 172.21.15.161:0/349310617 shutdown_connections 2024-01-18T00:47:48.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:47:48.530+0000 7f566f400640 1 -- 172.21.15.161:0/349310617 wait complete. 2024-01-18T00:47:48.552 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":3308,"stamp":"2024-01-18T00:47:48.482766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":198926355,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":3054,"num_read_kb":3537766,"num_write":47085,"num_write_kb":4540403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60229,"ondisk_log_size":60229,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":964752,"kb_used_data":179920,"kb_used_omap":12,"kb_used_meta":784755,"kb_avail":754009968,"statfs":{"total":773094113280,"available":772106207232,"internally_reserved":0,"allocated":184238080,"data_stored":398820182,"data_compressed":51124606,"data_compressed_allocated":68771840,"data_compressed_original":284901376,"omap_allocated":12751,"internal_metadata":803589681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003081"},"pg_stats":[{"pgid":"2.1f","version":"28'407","reported_seq":487,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:26.295512+0000","last_change":"2024-01-18T00:47:26.295663+0000","last_active":"2024-01-18T00:47:26.295512+0000","last_peered":"2024-01-18T00:47:26.295512+0000","last_clean":"2024-01-18T00:47:26.295512+0000","last_became_active":"2024-01-17T22:58:48.327340+0000","last_became_peered":"2024-01-17T22:58:48.327340+0000","last_unstale":"2024-01-18T00:47:26.295512+0000","last_undegraded":"2024-01-18T00:47:26.295512+0000","last_fullsized":"2024-01-18T00:47:26.295512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'407","last_scrub_stamp":"2024-01-18T00:47:26.295297+0000","last_deep_scrub":"28'407","last_deep_scrub_stamp":"2024-01-18T00:47:26.295297+0000","last_clean_scrub_stamp":"2024-01-18T00:47:26.295297+0000","objects_scrubbed":6,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:31:44.800535+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":8350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'198","reported_seq":279,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:36.841000+0000","last_change":"2024-01-18T00:47:36.841058+0000","last_active":"2024-01-18T00:47:36.841000+0000","last_peered":"2024-01-18T00:47:36.841000+0000","last_clean":"2024-01-18T00:47:36.841000+0000","last_became_active":"2024-01-17T22:58:49.350812+0000","last_became_peered":"2024-01-17T22:58:49.350812+0000","last_unstale":"2024-01-18T00:47:36.841000+0000","last_undegraded":"2024-01-18T00:47:36.841000+0000","last_fullsized":"2024-01-18T00:47:36.841000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'198","last_scrub_stamp":"2024-01-18T00:47:36.840831+0000","last_deep_scrub":"28'198","last_deep_scrub_stamp":"2024-01-18T00:47:36.840831+0000","last_clean_scrub_stamp":"2024-01-18T00:47:36.840831+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:25:04.844870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'754","reported_seq":845,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:34.183273+0000","last_change":"2024-01-18T00:47:34.183336+0000","last_active":"2024-01-18T00:47:34.183273+0000","last_peered":"2024-01-18T00:47:34.183273+0000","last_clean":"2024-01-18T00:47:34.183273+0000","last_became_active":"2024-01-17T22:58:55.903167+0000","last_became_peered":"2024-01-17T22:58:55.903167+0000","last_unstale":"2024-01-18T00:47:34.183273+0000","last_undegraded":"2024-01-18T00:47:34.183273+0000","last_fullsized":"2024-01-18T00:47:34.183273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'754","last_scrub_stamp":"2024-01-18T00:47:34.183094+0000","last_deep_scrub":"28'754","last_deep_scrub_stamp":"2024-01-18T00:47:34.183094+0000","last_clean_scrub_stamp":"2024-01-18T00:47:34.183094+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:03:36.279948+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":69175,"num_write":737,"num_write_kb":101027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'517","reported_seq":599,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:32.868301+0000","last_change":"2024-01-18T00:47:32.868374+0000","last_active":"2024-01-18T00:47:32.868301+0000","last_peered":"2024-01-18T00:47:32.868301+0000","last_clean":"2024-01-18T00:47:32.868301+0000","last_became_active":"2024-01-17T22:58:48.372582+0000","last_became_peered":"2024-01-17T22:58:48.372582+0000","last_unstale":"2024-01-18T00:47:32.868301+0000","last_undegraded":"2024-01-18T00:47:32.868301+0000","last_fullsized":"2024-01-18T00:47:32.868301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'517","last_scrub_stamp":"2024-01-18T00:47:32.868128+0000","last_deep_scrub":"28'517","last_deep_scrub_stamp":"2024-01-18T00:47:32.868128+0000","last_clean_scrub_stamp":"2024-01-18T00:47:32.868128+0000","objects_scrubbed":2,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:32:30.066568+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":8429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'179","reported_seq":258,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:39.763733+0000","last_change":"2024-01-18T00:47:39.763793+0000","last_active":"2024-01-18T00:47:39.763733+0000","last_peered":"2024-01-18T00:47:39.763733+0000","last_clean":"2024-01-18T00:47:39.763733+0000","last_became_active":"2024-01-17T22:58:49.511303+0000","last_became_peered":"2024-01-17T22:58:49.511303+0000","last_unstale":"2024-01-18T00:47:39.763733+0000","last_undegraded":"2024-01-18T00:47:39.763733+0000","last_fullsized":"2024-01-18T00:47:39.763733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'179","last_scrub_stamp":"2024-01-18T00:47:39.763567+0000","last_deep_scrub":"28'179","last_deep_scrub_stamp":"2024-01-18T00:47:39.763567+0000","last_clean_scrub_stamp":"2024-01-18T00:47:39.763567+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:47:31.633089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'814","reported_seq":921,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.720814+0000","last_change":"2024-01-18T00:47:31.720814+0000","last_active":"2024-01-18T00:47:31.720814+0000","last_peered":"2024-01-18T00:47:31.720814+0000","last_clean":"2024-01-18T00:47:31.720814+0000","last_became_active":"2024-01-17T22:58:55.878263+0000","last_became_peered":"2024-01-17T22:58:55.878263+0000","last_unstale":"2024-01-18T00:47:31.720814+0000","last_undegraded":"2024-01-18T00:47:31.720814+0000","last_fullsized":"2024-01-18T00:47:31.720814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'814","last_scrub_stamp":"2024-01-18T00:47:31.720711+0000","last_deep_scrub":"28'814","last_deep_scrub_stamp":"2024-01-18T00:47:31.720711+0000","last_clean_scrub_stamp":"2024-01-18T00:47:31.720711+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:50:18.532683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":109513,"num_write":800,"num_write_kb":160118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1143","reported_seq":1214,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:24.886134+0000","last_change":"2024-01-18T00:47:24.886162+0000","last_active":"2024-01-18T00:47:24.886134+0000","last_peered":"2024-01-18T00:47:24.886134+0000","last_clean":"2024-01-18T00:47:24.886134+0000","last_became_active":"2024-01-17T22:58:48.346411+0000","last_became_peered":"2024-01-17T22:58:48.346411+0000","last_unstale":"2024-01-18T00:47:24.886134+0000","last_undegraded":"2024-01-18T00:47:24.886134+0000","last_fullsized":"2024-01-18T00:47:24.886134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1143","last_scrub_stamp":"2024-01-18T00:47:24.886069+0000","last_deep_scrub":"28'1143","last_deep_scrub_stamp":"2024-01-18T00:47:24.886069+0000","last_clean_scrub_stamp":"2024-01-18T00:47:24.886069+0000","objects_scrubbed":5,"log_size":1143,"log_dups_size":0,"ondisk_log_size":1143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:19:21.139280+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1083,"num_write_kb":12791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'196","reported_seq":265,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:25.854572+0000","last_change":"2024-01-18T00:47:25.854591+0000","last_active":"2024-01-18T00:47:25.854572+0000","last_peered":"2024-01-18T00:47:25.854572+0000","last_clean":"2024-01-18T00:47:25.854572+0000","last_became_active":"2024-01-17T22:58:49.517710+0000","last_became_peered":"2024-01-17T22:58:49.517710+0000","last_unstale":"2024-01-18T00:47:25.854572+0000","last_undegraded":"2024-01-18T00:47:25.854572+0000","last_fullsized":"2024-01-18T00:47:25.854572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'196","last_scrub_stamp":"2024-01-18T00:47:25.854523+0000","last_deep_scrub":"28'196","last_deep_scrub_stamp":"2024-01-18T00:47:25.854523+0000","last_clean_scrub_stamp":"2024-01-18T00:47:25.854523+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:28:46.105381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'731","reported_seq":818,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:30.740835+0000","last_change":"2024-01-18T00:47:30.740857+0000","last_active":"2024-01-18T00:47:30.740835+0000","last_peered":"2024-01-18T00:47:30.740835+0000","last_clean":"2024-01-18T00:47:30.740835+0000","last_became_active":"2024-01-17T22:58:55.846773+0000","last_became_peered":"2024-01-17T22:58:55.846773+0000","last_unstale":"2024-01-18T00:47:30.740835+0000","last_undegraded":"2024-01-18T00:47:30.740835+0000","last_fullsized":"2024-01-18T00:47:30.740835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'731","last_scrub_stamp":"2024-01-18T00:47:30.740740+0000","last_deep_scrub":"28'731","last_deep_scrub_stamp":"2024-01-18T00:47:30.740740+0000","last_clean_scrub_stamp":"2024-01-18T00:47:30.740740+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:51:31.196721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":46045,"num_write":714,"num_write_kb":72807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'769","reported_seq":840,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:23.892477+0000","last_change":"2024-01-18T00:47:23.892504+0000","last_active":"2024-01-18T00:47:23.892477+0000","last_peered":"2024-01-18T00:47:23.892477+0000","last_clean":"2024-01-18T00:47:23.892477+0000","last_became_active":"2024-01-17T22:58:48.345749+0000","last_became_peered":"2024-01-17T22:58:48.345749+0000","last_unstale":"2024-01-18T00:47:23.892477+0000","last_undegraded":"2024-01-18T00:47:23.892477+0000","last_fullsized":"2024-01-18T00:47:23.892477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'769","last_scrub_stamp":"2024-01-18T00:47:23.892413+0000","last_deep_scrub":"28'769","last_deep_scrub_stamp":"2024-01-18T00:47:23.892413+0000","last_clean_scrub_stamp":"2024-01-18T00:47:23.892413+0000","objects_scrubbed":2,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:00:08.044448+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'208","reported_seq":278,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:29.133590+0000","last_change":"2024-01-18T00:47:29.133610+0000","last_active":"2024-01-18T00:47:29.133590+0000","last_peered":"2024-01-18T00:47:29.133590+0000","last_clean":"2024-01-18T00:47:29.133590+0000","last_became_active":"2024-01-17T22:58:49.370010+0000","last_became_peered":"2024-01-17T22:58:49.370010+0000","last_unstale":"2024-01-18T00:47:29.133590+0000","last_undegraded":"2024-01-18T00:47:29.133590+0000","last_fullsized":"2024-01-18T00:47:29.133590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'208","last_scrub_stamp":"2024-01-18T00:47:29.133532+0000","last_deep_scrub":"28'208","last_deep_scrub_stamp":"2024-01-18T00:47:29.133532+0000","last_clean_scrub_stamp":"2024-01-18T00:47:29.133532+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:56:20.679598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'752","reported_seq":843,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:32.712165+0000","last_change":"2024-01-18T00:47:32.712188+0000","last_active":"2024-01-18T00:47:32.712165+0000","last_peered":"2024-01-18T00:47:32.712165+0000","last_clean":"2024-01-18T00:47:32.712165+0000","last_became_active":"2024-01-17T22:58:55.885739+0000","last_became_peered":"2024-01-17T22:58:55.885739+0000","last_unstale":"2024-01-18T00:47:32.712165+0000","last_undegraded":"2024-01-18T00:47:32.712165+0000","last_fullsized":"2024-01-18T00:47:32.712165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'752","last_scrub_stamp":"2024-01-18T00:47:32.712066+0000","last_deep_scrub":"28'752","last_deep_scrub_stamp":"2024-01-18T00:47:32.712066+0000","last_clean_scrub_stamp":"2024-01-18T00:47:32.712066+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:32:12.353517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":79345,"num_write":732,"num_write_kb":104824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'223","reported_seq":300,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:42.093987+0000","last_change":"2024-01-18T00:47:42.093987+0000","last_active":"2024-01-18T00:47:42.093987+0000","last_peered":"2024-01-18T00:47:42.093987+0000","last_clean":"2024-01-18T00:47:42.093987+0000","last_became_active":"2024-01-17T22:58:49.514310+0000","last_became_peered":"2024-01-17T22:58:49.514310+0000","last_unstale":"2024-01-18T00:47:42.093987+0000","last_undegraded":"2024-01-18T00:47:42.093987+0000","last_fullsized":"2024-01-18T00:47:42.093987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'223","last_scrub_stamp":"2024-01-18T00:47:42.093903+0000","last_deep_scrub":"28'223","last_deep_scrub_stamp":"2024-01-18T00:47:42.093903+0000","last_clean_scrub_stamp":"2024-01-18T00:47:42.093903+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:38:08.667830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1142","reported_seq":1218,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:38.181370+0000","last_change":"2024-01-18T00:47:38.181399+0000","last_active":"2024-01-18T00:47:38.181370+0000","last_peered":"2024-01-18T00:47:38.181370+0000","last_clean":"2024-01-18T00:47:38.181370+0000","last_became_active":"2024-01-17T22:58:48.341498+0000","last_became_peered":"2024-01-17T22:58:48.341498+0000","last_unstale":"2024-01-18T00:47:38.181370+0000","last_undegraded":"2024-01-18T00:47:38.181370+0000","last_fullsized":"2024-01-18T00:47:38.181370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1142","last_scrub_stamp":"2024-01-18T00:47:38.181308+0000","last_deep_scrub":"28'1142","last_deep_scrub_stamp":"2024-01-18T00:47:38.181308+0000","last_clean_scrub_stamp":"2024-01-18T00:47:38.181308+0000","objects_scrubbed":5,"log_size":1142,"log_dups_size":0,"ondisk_log_size":1142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:16:35.952462+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1075,"num_write_kb":12808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'783","reported_seq":875,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:46:59.050957+0000","last_change":"2024-01-17T22:58:55.915918+0000","last_active":"2024-01-18T00:46:59.050957+0000","last_peered":"2024-01-18T00:46:59.050957+0000","last_clean":"2024-01-18T00:46:59.050957+0000","last_became_active":"2024-01-17T22:58:55.915556+0000","last_became_peered":"2024-01-17T22:58:55.915556+0000","last_unstale":"2024-01-18T00:46:59.050957+0000","last_undegraded":"2024-01-18T00:46:59.050957+0000","last_fullsized":"2024-01-18T00:46:59.050957+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":102943,"num_write":764,"num_write_kb":130404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'216","reported_seq":291,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:30.185165+0000","last_change":"2024-01-18T00:47:30.185275+0000","last_active":"2024-01-18T00:47:30.185165+0000","last_peered":"2024-01-18T00:47:30.185165+0000","last_clean":"2024-01-18T00:47:30.185165+0000","last_became_active":"2024-01-17T22:58:49.387500+0000","last_became_peered":"2024-01-17T22:58:49.387500+0000","last_unstale":"2024-01-18T00:47:30.185165+0000","last_undegraded":"2024-01-18T00:47:30.185165+0000","last_fullsized":"2024-01-18T00:47:30.185165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'216","last_scrub_stamp":"2024-01-18T00:47:30.184929+0000","last_deep_scrub":"28'216","last_deep_scrub_stamp":"2024-01-18T00:47:30.184929+0000","last_clean_scrub_stamp":"2024-01-18T00:47:30.184929+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:35:50.286169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'1209","reported_seq":1287,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:28.427454+0000","last_change":"2024-01-18T00:47:28.427454+0000","last_active":"2024-01-18T00:47:28.427454+0000","last_peered":"2024-01-18T00:47:28.427454+0000","last_clean":"2024-01-18T00:47:28.427454+0000","last_became_active":"2024-01-17T22:58:48.345584+0000","last_became_peered":"2024-01-17T22:58:48.345584+0000","last_unstale":"2024-01-18T00:47:28.427454+0000","last_undegraded":"2024-01-18T00:47:28.427454+0000","last_fullsized":"2024-01-18T00:47:28.427454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1209","last_scrub_stamp":"2024-01-18T00:47:28.427200+0000","last_deep_scrub":"28'1209","last_deep_scrub_stamp":"2024-01-18T00:47:28.427200+0000","last_clean_scrub_stamp":"2024-01-18T00:47:28.427200+0000","objects_scrubbed":3,"log_size":1209,"log_dups_size":0,"ondisk_log_size":1209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:21:42.084978+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":8782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'818","reported_seq":912,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.781142+0000","last_change":"2024-01-18T00:47:35.781163+0000","last_active":"2024-01-18T00:47:35.781142+0000","last_peered":"2024-01-18T00:47:35.781142+0000","last_clean":"2024-01-18T00:47:35.781142+0000","last_became_active":"2024-01-17T22:58:55.904182+0000","last_became_peered":"2024-01-17T22:58:55.904182+0000","last_unstale":"2024-01-18T00:47:35.781142+0000","last_undegraded":"2024-01-18T00:47:35.781142+0000","last_fullsized":"2024-01-18T00:47:35.781142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'818","last_scrub_stamp":"2024-01-18T00:47:35.781058+0000","last_deep_scrub":"28'818","last_deep_scrub_stamp":"2024-01-18T00:47:35.781058+0000","last_clean_scrub_stamp":"2024-01-18T00:47:35.781058+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:00:06.452112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":69224,"num_write":805,"num_write_kb":98188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'208","reported_seq":285,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:34.405294+0000","last_change":"2024-01-18T00:47:34.405353+0000","last_active":"2024-01-18T00:47:34.405294+0000","last_peered":"2024-01-18T00:47:34.405294+0000","last_clean":"2024-01-18T00:47:34.405294+0000","last_became_active":"2024-01-17T22:58:49.417440+0000","last_became_peered":"2024-01-17T22:58:49.417440+0000","last_unstale":"2024-01-18T00:47:34.405294+0000","last_undegraded":"2024-01-18T00:47:34.405294+0000","last_fullsized":"2024-01-18T00:47:34.405294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'208","last_scrub_stamp":"2024-01-18T00:47:34.405134+0000","last_deep_scrub":"28'208","last_deep_scrub_stamp":"2024-01-18T00:47:34.405134+0000","last_clean_scrub_stamp":"2024-01-18T00:47:34.405134+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:46:08.348115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'356","reported_seq":434,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:27.275592+0000","last_change":"2024-01-18T00:47:27.275711+0000","last_active":"2024-01-18T00:47:27.275592+0000","last_peered":"2024-01-18T00:47:27.275592+0000","last_clean":"2024-01-18T00:47:27.275592+0000","last_became_active":"2024-01-17T22:58:48.331435+0000","last_became_peered":"2024-01-17T22:58:48.331435+0000","last_unstale":"2024-01-18T00:47:27.275592+0000","last_undegraded":"2024-01-18T00:47:27.275592+0000","last_fullsized":"2024-01-18T00:47:27.275592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'356","last_scrub_stamp":"2024-01-18T00:47:27.275365+0000","last_deep_scrub":"28'356","last_deep_scrub_stamp":"2024-01-18T00:47:27.275365+0000","last_clean_scrub_stamp":"2024-01-18T00:47:27.275365+0000","objects_scrubbed":3,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:03:29.372219+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":286,"num_write_kb":4220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'749","reported_seq":851,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:36.765707+0000","last_change":"2024-01-18T00:47:36.765707+0000","last_active":"2024-01-18T00:47:36.765707+0000","last_peered":"2024-01-18T00:47:36.765707+0000","last_clean":"2024-01-18T00:47:36.765707+0000","last_became_active":"2024-01-17T22:59:09.254084+0000","last_became_peered":"2024-01-17T22:59:09.254084+0000","last_unstale":"2024-01-18T00:47:36.765707+0000","last_undegraded":"2024-01-18T00:47:36.765707+0000","last_fullsized":"2024-01-18T00:47:36.765707+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'749","last_scrub_stamp":"2024-01-18T00:47:36.765626+0000","last_deep_scrub":"28'749","last_deep_scrub_stamp":"2024-01-18T00:47:36.765626+0000","last_clean_scrub_stamp":"2024-01-18T00:47:36.765626+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:19:20.665592+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":86272,"num_write":735,"num_write_kb":127812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2,3],"acting":[0,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"28'213","reported_seq":290,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:41.139796+0000","last_change":"2024-01-18T00:47:41.139817+0000","last_active":"2024-01-18T00:47:41.139796+0000","last_peered":"2024-01-18T00:47:41.139796+0000","last_clean":"2024-01-18T00:47:41.139796+0000","last_became_active":"2024-01-17T22:58:49.416757+0000","last_became_peered":"2024-01-17T22:58:49.416757+0000","last_unstale":"2024-01-18T00:47:41.139796+0000","last_undegraded":"2024-01-18T00:47:41.139796+0000","last_fullsized":"2024-01-18T00:47:41.139796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'213","last_scrub_stamp":"2024-01-18T00:47:41.139733+0000","last_deep_scrub":"28'213","last_deep_scrub_stamp":"2024-01-18T00:47:41.139733+0000","last_clean_scrub_stamp":"2024-01-18T00:47:41.139733+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:44:22.038117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'205","reported_seq":283,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:21.939741+0000","last_change":"2024-01-18T00:47:21.939788+0000","last_active":"2024-01-18T00:47:21.939741+0000","last_peered":"2024-01-18T00:47:21.939741+0000","last_clean":"2024-01-18T00:47:21.939741+0000","last_became_active":"2024-01-17T22:58:48.341359+0000","last_became_peered":"2024-01-17T22:58:48.341359+0000","last_unstale":"2024-01-18T00:47:21.939741+0000","last_undegraded":"2024-01-18T00:47:21.939741+0000","last_fullsized":"2024-01-18T00:47:21.939741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'205","last_scrub_stamp":"2024-01-18T00:47:21.939672+0000","last_deep_scrub":"28'205","last_deep_scrub_stamp":"2024-01-18T00:47:21.939672+0000","last_clean_scrub_stamp":"2024-01-18T00:47:21.939672+0000","objects_scrubbed":2,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:38:25.360325+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'713","reported_seq":825,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:36.725769+0000","last_change":"2024-01-18T00:47:36.725792+0000","last_active":"2024-01-18T00:47:36.725769+0000","last_peered":"2024-01-18T00:47:36.725769+0000","last_clean":"2024-01-18T00:47:36.725769+0000","last_became_active":"2024-01-17T22:58:55.913645+0000","last_became_peered":"2024-01-17T22:58:55.913645+0000","last_unstale":"2024-01-18T00:47:36.725769+0000","last_undegraded":"2024-01-18T00:47:36.725769+0000","last_fullsized":"2024-01-18T00:47:36.725769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'713","last_scrub_stamp":"2024-01-18T00:47:36.725665+0000","last_deep_scrub":"28'713","last_deep_scrub_stamp":"2024-01-18T00:47:36.725665+0000","last_clean_scrub_stamp":"2024-01-18T00:47:36.725665+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:36:56.866658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":136231,"num_write":693,"num_write_kb":114548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'226","reported_seq":303,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:24.234567+0000","last_change":"2024-01-18T00:47:24.234625+0000","last_active":"2024-01-18T00:47:24.234567+0000","last_peered":"2024-01-18T00:47:24.234567+0000","last_clean":"2024-01-18T00:47:24.234567+0000","last_became_active":"2024-01-17T22:58:49.417385+0000","last_became_peered":"2024-01-17T22:58:49.417385+0000","last_unstale":"2024-01-18T00:47:24.234567+0000","last_undegraded":"2024-01-18T00:47:24.234567+0000","last_fullsized":"2024-01-18T00:47:24.234567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'226","last_scrub_stamp":"2024-01-18T00:47:24.234407+0000","last_deep_scrub":"28'226","last_deep_scrub_stamp":"2024-01-18T00:47:24.234407+0000","last_clean_scrub_stamp":"2024-01-18T00:47:24.234407+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:26:07.136004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'333","reported_seq":411,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:36.173236+0000","last_change":"2024-01-18T00:47:36.173278+0000","last_active":"2024-01-18T00:47:36.173236+0000","last_peered":"2024-01-18T00:47:36.173236+0000","last_clean":"2024-01-18T00:47:36.173236+0000","last_became_active":"2024-01-17T22:58:48.339738+0000","last_became_peered":"2024-01-17T22:58:48.339738+0000","last_unstale":"2024-01-18T00:47:36.173236+0000","last_undegraded":"2024-01-18T00:47:36.173236+0000","last_fullsized":"2024-01-18T00:47:36.173236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'333","last_scrub_stamp":"2024-01-18T00:47:36.173168+0000","last_deep_scrub":"28'333","last_deep_scrub_stamp":"2024-01-18T00:47:36.173168+0000","last_clean_scrub_stamp":"2024-01-18T00:47:36.173168+0000","objects_scrubbed":3,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:45:09.570322+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'778","reported_seq":892,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:34.684958+0000","last_change":"2024-01-18T00:47:34.684996+0000","last_active":"2024-01-18T00:47:34.684958+0000","last_peered":"2024-01-18T00:47:34.684958+0000","last_clean":"2024-01-18T00:47:34.684958+0000","last_became_active":"2024-01-17T22:58:55.904417+0000","last_became_peered":"2024-01-17T22:58:55.904417+0000","last_unstale":"2024-01-18T00:47:34.684958+0000","last_undegraded":"2024-01-18T00:47:34.684958+0000","last_fullsized":"2024-01-18T00:47:34.684958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'778","last_scrub_stamp":"2024-01-18T00:47:34.684875+0000","last_deep_scrub":"28'778","last_deep_scrub_stamp":"2024-01-18T00:47:34.684875+0000","last_clean_scrub_stamp":"2024-01-18T00:47:34.684875+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:41:20.360418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":109858,"num_write":759,"num_write_kb":103009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'181","reported_seq":258,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.333433+0000","last_change":"2024-01-18T00:47:31.333460+0000","last_active":"2024-01-18T00:47:31.333433+0000","last_peered":"2024-01-18T00:47:31.333433+0000","last_clean":"2024-01-18T00:47:31.333433+0000","last_became_active":"2024-01-17T22:58:49.410830+0000","last_became_peered":"2024-01-17T22:58:49.410830+0000","last_unstale":"2024-01-18T00:47:31.333433+0000","last_undegraded":"2024-01-18T00:47:31.333433+0000","last_fullsized":"2024-01-18T00:47:31.333433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'181","last_scrub_stamp":"2024-01-18T00:47:31.333339+0000","last_deep_scrub":"28'181","last_deep_scrub_stamp":"2024-01-18T00:47:31.333339+0000","last_clean_scrub_stamp":"2024-01-18T00:47:31.333339+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:12:45.837049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'1210","reported_seq":1288,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:28.286858+0000","last_change":"2024-01-18T00:47:28.286920+0000","last_active":"2024-01-18T00:47:28.286858+0000","last_peered":"2024-01-18T00:47:28.286858+0000","last_clean":"2024-01-18T00:47:28.286858+0000","last_became_active":"2024-01-17T22:58:48.338928+0000","last_became_peered":"2024-01-17T22:58:48.338928+0000","last_unstale":"2024-01-18T00:47:28.286858+0000","last_undegraded":"2024-01-18T00:47:28.286858+0000","last_fullsized":"2024-01-18T00:47:28.286858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1210","last_scrub_stamp":"2024-01-18T00:47:28.286695+0000","last_deep_scrub":"28'1210","last_deep_scrub_stamp":"2024-01-18T00:47:28.286695+0000","last_clean_scrub_stamp":"2024-01-18T00:47:28.286695+0000","objects_scrubbed":2,"log_size":1210,"log_dups_size":0,"ondisk_log_size":1210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:26:56.654090+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3222,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'817","reported_seq":938,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:40.417666+0000","last_change":"2024-01-18T00:47:40.417757+0000","last_active":"2024-01-18T00:47:40.417666+0000","last_peered":"2024-01-18T00:47:40.417666+0000","last_clean":"2024-01-18T00:47:40.417666+0000","last_became_active":"2024-01-17T22:58:55.908232+0000","last_became_peered":"2024-01-17T22:58:55.908232+0000","last_unstale":"2024-01-18T00:47:40.417666+0000","last_undegraded":"2024-01-18T00:47:40.417666+0000","last_fullsized":"2024-01-18T00:47:40.417666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'817","last_scrub_stamp":"2024-01-18T00:47:40.417495+0000","last_deep_scrub":"28'817","last_deep_scrub_stamp":"2024-01-18T00:47:40.417495+0000","last_clean_scrub_stamp":"2024-01-18T00:47:40.417495+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:36:06.172564+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":152093,"num_write":804,"num_write_kb":135389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'198","reported_seq":277,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:33.397226+0000","last_change":"2024-01-18T00:47:33.397288+0000","last_active":"2024-01-18T00:47:33.397226+0000","last_peered":"2024-01-18T00:47:33.397226+0000","last_clean":"2024-01-18T00:47:33.397226+0000","last_became_active":"2024-01-17T22:58:49.369598+0000","last_became_peered":"2024-01-17T22:58:49.369598+0000","last_unstale":"2024-01-18T00:47:33.397226+0000","last_undegraded":"2024-01-18T00:47:33.397226+0000","last_fullsized":"2024-01-18T00:47:33.397226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'198","last_scrub_stamp":"2024-01-18T00:47:33.397072+0000","last_deep_scrub":"28'198","last_deep_scrub_stamp":"2024-01-18T00:47:33.397072+0000","last_clean_scrub_stamp":"2024-01-18T00:47:33.397072+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:25.358701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'822","reported_seq":902,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:34.172618+0000","last_change":"2024-01-18T00:47:34.172618+0000","last_active":"2024-01-18T00:47:34.172618+0000","last_peered":"2024-01-18T00:47:34.172618+0000","last_clean":"2024-01-18T00:47:34.172618+0000","last_became_active":"2024-01-17T22:58:48.338225+0000","last_became_peered":"2024-01-17T22:58:48.338225+0000","last_unstale":"2024-01-18T00:47:34.172618+0000","last_undegraded":"2024-01-18T00:47:34.172618+0000","last_fullsized":"2024-01-18T00:47:34.172618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'822","last_scrub_stamp":"2024-01-18T00:47:34.172533+0000","last_deep_scrub":"28'822","last_deep_scrub_stamp":"2024-01-18T00:47:34.172533+0000","last_clean_scrub_stamp":"2024-01-18T00:47:34.172533+0000","objects_scrubbed":3,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:16:20.853729+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":8593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'758","reported_seq":872,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:36.427284+0000","last_change":"2024-01-18T00:47:36.427349+0000","last_active":"2024-01-18T00:47:36.427284+0000","last_peered":"2024-01-18T00:47:36.427284+0000","last_clean":"2024-01-18T00:47:36.427284+0000","last_became_active":"2024-01-17T22:58:55.872356+0000","last_became_peered":"2024-01-17T22:58:55.872356+0000","last_unstale":"2024-01-18T00:47:36.427284+0000","last_undegraded":"2024-01-18T00:47:36.427284+0000","last_fullsized":"2024-01-18T00:47:36.427284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'758","last_scrub_stamp":"2024-01-18T00:47:36.427053+0000","last_deep_scrub":"28'758","last_deep_scrub_stamp":"2024-01-18T00:47:36.427053+0000","last_clean_scrub_stamp":"2024-01-18T00:47:36.427053+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:21:19.608773+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":100834,"num_write":740,"num_write_kb":155893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'214","reported_seq":292,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:26.742071+0000","last_change":"2024-01-18T00:47:26.742071+0000","last_active":"2024-01-18T00:47:26.742071+0000","last_peered":"2024-01-18T00:47:26.742071+0000","last_clean":"2024-01-18T00:47:26.742071+0000","last_became_active":"2024-01-17T22:58:49.369487+0000","last_became_peered":"2024-01-17T22:58:49.369487+0000","last_unstale":"2024-01-18T00:47:26.742071+0000","last_undegraded":"2024-01-18T00:47:26.742071+0000","last_fullsized":"2024-01-18T00:47:26.742071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'214","last_scrub_stamp":"2024-01-18T00:47:26.741937+0000","last_deep_scrub":"28'214","last_deep_scrub_stamp":"2024-01-18T00:47:26.741937+0000","last_clean_scrub_stamp":"2024-01-18T00:47:26.741937+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:03:28.838791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'277","reported_seq":357,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.883794+0000","last_change":"2024-01-18T00:47:31.883864+0000","last_active":"2024-01-18T00:47:31.883794+0000","last_peered":"2024-01-18T00:47:31.883794+0000","last_clean":"2024-01-18T00:47:31.883794+0000","last_became_active":"2024-01-17T22:58:48.339996+0000","last_became_peered":"2024-01-17T22:58:48.339996+0000","last_unstale":"2024-01-18T00:47:31.883794+0000","last_undegraded":"2024-01-18T00:47:31.883794+0000","last_fullsized":"2024-01-18T00:47:31.883794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'277","last_scrub_stamp":"2024-01-18T00:47:31.883639+0000","last_deep_scrub":"28'277","last_deep_scrub_stamp":"2024-01-18T00:47:31.883639+0000","last_clean_scrub_stamp":"2024-01-18T00:47:31.883639+0000","objects_scrubbed":1,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:14:45.527540+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'763","reported_seq":870,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:37.402553+0000","last_change":"2024-01-18T00:47:37.402683+0000","last_active":"2024-01-18T00:47:37.402553+0000","last_peered":"2024-01-18T00:47:37.402553+0000","last_clean":"2024-01-18T00:47:37.402553+0000","last_became_active":"2024-01-17T22:58:55.877118+0000","last_became_peered":"2024-01-17T22:58:55.877118+0000","last_unstale":"2024-01-18T00:47:37.402553+0000","last_undegraded":"2024-01-18T00:47:37.402553+0000","last_fullsized":"2024-01-18T00:47:37.402553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'763","last_scrub_stamp":"2024-01-18T00:47:37.402245+0000","last_deep_scrub":"28'763","last_deep_scrub_stamp":"2024-01-18T00:47:37.402245+0000","last_clean_scrub_stamp":"2024-01-18T00:47:37.402245+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:41:23.077788+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":97013,"num_write":742,"num_write_kb":97416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'198","reported_seq":277,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:28.881911+0000","last_change":"2024-01-18T00:47:28.881946+0000","last_active":"2024-01-18T00:47:28.881911+0000","last_peered":"2024-01-18T00:47:28.881911+0000","last_clean":"2024-01-18T00:47:28.881911+0000","last_became_active":"2024-01-17T22:58:49.352563+0000","last_became_peered":"2024-01-17T22:58:49.352563+0000","last_unstale":"2024-01-18T00:47:28.881911+0000","last_undegraded":"2024-01-18T00:47:28.881911+0000","last_fullsized":"2024-01-18T00:47:28.881911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'198","last_scrub_stamp":"2024-01-18T00:47:28.881827+0000","last_deep_scrub":"28'198","last_deep_scrub_stamp":"2024-01-18T00:47:28.881827+0000","last_clean_scrub_stamp":"2024-01-18T00:47:28.881827+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:15:47.907229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'1020","reported_seq":1100,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:40.196804+0000","last_change":"2024-01-18T00:47:40.196832+0000","last_active":"2024-01-18T00:47:40.196804+0000","last_peered":"2024-01-18T00:47:40.196804+0000","last_clean":"2024-01-18T00:47:40.196804+0000","last_became_active":"2024-01-17T22:58:48.343060+0000","last_became_peered":"2024-01-17T22:58:48.343060+0000","last_unstale":"2024-01-18T00:47:40.196804+0000","last_undegraded":"2024-01-18T00:47:40.196804+0000","last_fullsized":"2024-01-18T00:47:40.196804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1020","last_scrub_stamp":"2024-01-18T00:47:40.196742+0000","last_deep_scrub":"28'1020","last_deep_scrub_stamp":"2024-01-18T00:47:40.196742+0000","last_clean_scrub_stamp":"2024-01-18T00:47:40.196742+0000","objects_scrubbed":2,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:30.029104+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":955,"num_write_kb":8650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'732","reported_seq":838,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:38.372373+0000","last_change":"2024-01-18T00:47:38.372498+0000","last_active":"2024-01-18T00:47:38.372373+0000","last_peered":"2024-01-18T00:47:38.372373+0000","last_clean":"2024-01-18T00:47:38.372373+0000","last_became_active":"2024-01-17T22:58:55.880665+0000","last_became_peered":"2024-01-17T22:58:55.880665+0000","last_unstale":"2024-01-18T00:47:38.372373+0000","last_undegraded":"2024-01-18T00:47:38.372373+0000","last_fullsized":"2024-01-18T00:47:38.372373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'732","last_scrub_stamp":"2024-01-18T00:47:38.372188+0000","last_deep_scrub":"28'732","last_deep_scrub_stamp":"2024-01-18T00:47:38.372188+0000","last_clean_scrub_stamp":"2024-01-18T00:47:38.372188+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:41:40.801273+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":93731,"num_write":720,"num_write_kb":118971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'203","reported_seq":284,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:37.849057+0000","last_change":"2024-01-18T00:47:37.849181+0000","last_active":"2024-01-18T00:47:37.849057+0000","last_peered":"2024-01-18T00:47:37.849057+0000","last_clean":"2024-01-18T00:47:37.849057+0000","last_became_active":"2024-01-17T22:58:49.384655+0000","last_became_peered":"2024-01-17T22:58:49.384655+0000","last_unstale":"2024-01-18T00:47:37.849057+0000","last_undegraded":"2024-01-18T00:47:37.849057+0000","last_fullsized":"2024-01-18T00:47:37.849057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'203","last_scrub_stamp":"2024-01-18T00:47:37.848863+0000","last_deep_scrub":"28'203","last_deep_scrub_stamp":"2024-01-18T00:47:37.848863+0000","last_clean_scrub_stamp":"2024-01-18T00:47:37.848863+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:53:27.492878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'1860","reported_seq":3728,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:28.117698+0000","last_change":"2024-01-18T00:47:28.117767+0000","last_active":"2024-01-18T00:47:28.117698+0000","last_peered":"2024-01-18T00:47:28.117698+0000","last_clean":"2024-01-18T00:47:28.117698+0000","last_became_active":"2024-01-17T22:58:48.375210+0000","last_became_peered":"2024-01-17T22:58:48.375210+0000","last_unstale":"2024-01-18T00:47:28.117698+0000","last_undegraded":"2024-01-18T00:47:28.117698+0000","last_fullsized":"2024-01-18T00:47:28.117698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1860","last_scrub_stamp":"2024-01-18T00:47:28.117521+0000","last_deep_scrub":"28'1860","last_deep_scrub_stamp":"2024-01-18T00:47:28.117521+0000","last_clean_scrub_stamp":"2024-01-18T00:47:28.117521+0000","objects_scrubbed":3,"log_size":1860,"log_dups_size":0,"ondisk_log_size":1860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:41:29.090492+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1556390,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1788,"num_read_kb":2847,"num_write":1794,"num_write_kb":2850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'738","reported_seq":836,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:39.406041+0000","last_change":"2024-01-18T00:47:39.406102+0000","last_active":"2024-01-18T00:47:39.406041+0000","last_peered":"2024-01-18T00:47:39.406041+0000","last_clean":"2024-01-18T00:47:39.406041+0000","last_became_active":"2024-01-17T22:58:55.902881+0000","last_became_peered":"2024-01-17T22:58:55.902881+0000","last_unstale":"2024-01-18T00:47:39.406041+0000","last_undegraded":"2024-01-18T00:47:39.406041+0000","last_fullsized":"2024-01-18T00:47:39.406041+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'738","last_scrub_stamp":"2024-01-18T00:47:39.405868+0000","last_deep_scrub":"28'738","last_deep_scrub_stamp":"2024-01-18T00:47:39.405868+0000","last_clean_scrub_stamp":"2024-01-18T00:47:39.405868+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:36:59.546861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":79403,"num_write":724,"num_write_kb":135108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'196","reported_seq":275,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:30.416931+0000","last_change":"2024-01-18T00:47:30.417005+0000","last_active":"2024-01-18T00:47:30.416931+0000","last_peered":"2024-01-18T00:47:30.416931+0000","last_clean":"2024-01-18T00:47:30.416931+0000","last_became_active":"2024-01-17T22:58:49.367236+0000","last_became_peered":"2024-01-17T22:58:49.367236+0000","last_unstale":"2024-01-18T00:47:30.416931+0000","last_undegraded":"2024-01-18T00:47:30.416931+0000","last_fullsized":"2024-01-18T00:47:30.416931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'196","last_scrub_stamp":"2024-01-18T00:47:30.416781+0000","last_deep_scrub":"28'196","last_deep_scrub_stamp":"2024-01-18T00:47:30.416781+0000","last_clean_scrub_stamp":"2024-01-18T00:47:30.416781+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:20:30.689815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'621","reported_seq":703,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.193351+0000","last_change":"2024-01-18T00:47:35.193382+0000","last_active":"2024-01-18T00:47:35.193351+0000","last_peered":"2024-01-18T00:47:35.193351+0000","last_clean":"2024-01-18T00:47:35.193351+0000","last_became_active":"2024-01-17T22:58:48.337500+0000","last_became_peered":"2024-01-17T22:58:48.337500+0000","last_unstale":"2024-01-18T00:47:35.193351+0000","last_undegraded":"2024-01-18T00:47:35.193351+0000","last_fullsized":"2024-01-18T00:47:35.193351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'621","last_scrub_stamp":"2024-01-18T00:47:35.193282+0000","last_deep_scrub":"28'621","last_deep_scrub_stamp":"2024-01-18T00:47:35.193282+0000","last_clean_scrub_stamp":"2024-01-18T00:47:35.193282+0000","objects_scrubbed":4,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:25:31.442204+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":12559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'904","reported_seq":1035,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:41.757899+0000","last_change":"2024-01-18T00:47:41.758017+0000","last_active":"2024-01-18T00:47:41.757899+0000","last_peered":"2024-01-18T00:47:41.757899+0000","last_clean":"2024-01-18T00:47:41.757899+0000","last_became_active":"2024-01-17T22:58:55.899657+0000","last_became_peered":"2024-01-17T22:58:55.899657+0000","last_unstale":"2024-01-18T00:47:41.757899+0000","last_undegraded":"2024-01-18T00:47:41.757899+0000","last_fullsized":"2024-01-18T00:47:41.757899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'904","last_scrub_stamp":"2024-01-18T00:47:41.757692+0000","last_deep_scrub":"28'904","last_deep_scrub_stamp":"2024-01-18T00:47:41.757692+0000","last_clean_scrub_stamp":"2024-01-18T00:47:41.757692+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:33:03.481330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":184022,"num_write":887,"num_write_kb":259108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'189","reported_seq":268,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:32.339391+0000","last_change":"2024-01-18T00:47:32.339508+0000","last_active":"2024-01-18T00:47:32.339391+0000","last_peered":"2024-01-18T00:47:32.339391+0000","last_clean":"2024-01-18T00:47:32.339391+0000","last_became_active":"2024-01-17T22:58:49.411848+0000","last_became_peered":"2024-01-17T22:58:49.411848+0000","last_unstale":"2024-01-18T00:47:32.339391+0000","last_undegraded":"2024-01-18T00:47:32.339391+0000","last_fullsized":"2024-01-18T00:47:32.339391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'189","last_scrub_stamp":"2024-01-18T00:47:32.339194+0000","last_deep_scrub":"28'189","last_deep_scrub_stamp":"2024-01-18T00:47:32.339194+0000","last_clean_scrub_stamp":"2024-01-18T00:47:32.339194+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:04:52.310945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'297","reported_seq":377,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:37.145544+0000","last_change":"2024-01-18T00:47:37.145570+0000","last_active":"2024-01-18T00:47:37.145544+0000","last_peered":"2024-01-18T00:47:37.145544+0000","last_clean":"2024-01-18T00:47:37.145544+0000","last_became_active":"2024-01-17T22:58:48.340963+0000","last_became_peered":"2024-01-17T22:58:48.340963+0000","last_unstale":"2024-01-18T00:47:37.145544+0000","last_undegraded":"2024-01-18T00:47:37.145544+0000","last_fullsized":"2024-01-18T00:47:37.145544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'297","last_scrub_stamp":"2024-01-18T00:47:37.145485+0000","last_deep_scrub":"28'297","last_deep_scrub_stamp":"2024-01-18T00:47:37.145485+0000","last_clean_scrub_stamp":"2024-01-18T00:47:37.145485+0000","objects_scrubbed":4,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:23:12.913565+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":4212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'163","reported_seq":289,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:21.863206+0000","last_change":"2024-01-18T00:47:21.863233+0000","last_active":"2024-01-18T00:47:21.863206+0000","last_peered":"2024-01-18T00:47:21.863206+0000","last_clean":"2024-01-18T00:47:21.863206+0000","last_became_active":"2024-01-17T22:58:17.321097+0000","last_became_peered":"2024-01-17T22:58:17.321097+0000","last_unstale":"2024-01-18T00:47:21.863206+0000","last_undegraded":"2024-01-18T00:47:21.863206+0000","last_fullsized":"2024-01-18T00:47:21.863206+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'163","last_scrub_stamp":"2024-01-18T00:47:21.863134+0000","last_deep_scrub":"28'163","last_deep_scrub_stamp":"2024-01-18T00:47:21.863134+0000","last_clean_scrub_stamp":"2024-01-18T00:47:21.863134+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:10:20.450518+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'806","reported_seq":939,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:04.352857+0000","last_change":"2024-01-17T22:58:55.909509+0000","last_active":"2024-01-18T00:47:04.352857+0000","last_peered":"2024-01-18T00:47:04.352857+0000","last_clean":"2024-01-18T00:47:04.352857+0000","last_became_active":"2024-01-17T22:58:55.909055+0000","last_became_peered":"2024-01-17T22:58:55.909055+0000","last_unstale":"2024-01-18T00:47:04.352857+0000","last_undegraded":"2024-01-18T00:47:04.352857+0000","last_fullsized":"2024-01-18T00:47:04.352857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":230974,"num_write":789,"num_write_kb":193453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'203","reported_seq":278,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:43.139897+0000","last_change":"2024-01-18T00:47:43.139919+0000","last_active":"2024-01-18T00:47:43.139897+0000","last_peered":"2024-01-18T00:47:43.139897+0000","last_clean":"2024-01-18T00:47:43.139897+0000","last_became_active":"2024-01-17T22:58:49.515941+0000","last_became_peered":"2024-01-17T22:58:49.515941+0000","last_unstale":"2024-01-18T00:47:43.139897+0000","last_undegraded":"2024-01-18T00:47:43.139897+0000","last_fullsized":"2024-01-18T00:47:43.139897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'203","last_scrub_stamp":"2024-01-18T00:47:43.139836+0000","last_deep_scrub":"28'203","last_deep_scrub_stamp":"2024-01-18T00:47:43.139836+0000","last_clean_scrub_stamp":"2024-01-18T00:47:43.139836+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:56:43.736479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'366","reported_seq":443,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:26.411191+0000","last_change":"2024-01-18T00:47:26.411314+0000","last_active":"2024-01-18T00:47:26.411191+0000","last_peered":"2024-01-18T00:47:26.411191+0000","last_clean":"2024-01-18T00:47:26.411191+0000","last_became_active":"2024-01-17T22:58:48.344402+0000","last_became_peered":"2024-01-17T22:58:48.344402+0000","last_unstale":"2024-01-18T00:47:26.411191+0000","last_undegraded":"2024-01-18T00:47:26.411191+0000","last_fullsized":"2024-01-18T00:47:26.411191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'366","last_scrub_stamp":"2024-01-18T00:47:26.411007+0000","last_deep_scrub":"28'366","last_deep_scrub_stamp":"2024-01-18T00:47:26.411007+0000","last_clean_scrub_stamp":"2024-01-18T00:47:26.411007+0000","objects_scrubbed":3,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:52:59.540385+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'821","reported_seq":929,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:33.712122+0000","last_change":"2024-01-18T00:47:33.712144+0000","last_active":"2024-01-18T00:47:33.712122+0000","last_peered":"2024-01-18T00:47:33.712122+0000","last_clean":"2024-01-18T00:47:33.712122+0000","last_became_active":"2024-01-17T22:58:55.885809+0000","last_became_peered":"2024-01-17T22:58:55.885809+0000","last_unstale":"2024-01-18T00:47:33.712122+0000","last_undegraded":"2024-01-18T00:47:33.712122+0000","last_fullsized":"2024-01-18T00:47:33.712122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'821","last_scrub_stamp":"2024-01-18T00:47:33.712052+0000","last_deep_scrub":"28'821","last_deep_scrub_stamp":"2024-01-18T00:47:33.712052+0000","last_clean_scrub_stamp":"2024-01-18T00:47:33.712052+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:21:16.893771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":121383,"num_write":812,"num_write_kb":179977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'216","reported_seq":283,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:41.405558+0000","last_change":"2024-01-18T00:47:41.405617+0000","last_active":"2024-01-18T00:47:41.405558+0000","last_peered":"2024-01-18T00:47:41.405558+0000","last_clean":"2024-01-18T00:47:41.405558+0000","last_became_active":"2024-01-17T22:59:08.654136+0000","last_became_peered":"2024-01-17T22:59:08.654136+0000","last_unstale":"2024-01-18T00:47:41.405558+0000","last_undegraded":"2024-01-18T00:47:41.405558+0000","last_fullsized":"2024-01-18T00:47:41.405558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'216","last_scrub_stamp":"2024-01-18T00:47:41.405379+0000","last_deep_scrub":"28'216","last_deep_scrub_stamp":"2024-01-18T00:47:41.405379+0000","last_clean_scrub_stamp":"2024-01-18T00:47:41.405379+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:45:14.802533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"28'406","reported_seq":482,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:29.852441+0000","last_change":"2024-01-18T00:47:29.852520+0000","last_active":"2024-01-18T00:47:29.852441+0000","last_peered":"2024-01-18T00:47:29.852441+0000","last_clean":"2024-01-18T00:47:29.852441+0000","last_became_active":"2024-01-17T22:58:48.337489+0000","last_became_peered":"2024-01-17T22:58:48.337489+0000","last_unstale":"2024-01-18T00:47:29.852441+0000","last_undegraded":"2024-01-18T00:47:29.852441+0000","last_fullsized":"2024-01-18T00:47:29.852441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'406","last_scrub_stamp":"2024-01-18T00:47:29.852249+0000","last_deep_scrub":"28'406","last_deep_scrub_stamp":"2024-01-18T00:47:29.852249+0000","last_clean_scrub_stamp":"2024-01-18T00:47:29.852249+0000","objects_scrubbed":2,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:29:19.126729+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'799","reported_seq":907,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:42.729584+0000","last_change":"2024-01-18T00:47:42.729704+0000","last_active":"2024-01-18T00:47:42.729584+0000","last_peered":"2024-01-18T00:47:42.729584+0000","last_clean":"2024-01-18T00:47:42.729584+0000","last_became_active":"2024-01-17T22:58:55.902857+0000","last_became_peered":"2024-01-17T22:58:55.902857+0000","last_unstale":"2024-01-18T00:47:42.729584+0000","last_undegraded":"2024-01-18T00:47:42.729584+0000","last_fullsized":"2024-01-18T00:47:42.729584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'799","last_scrub_stamp":"2024-01-18T00:47:42.729315+0000","last_deep_scrub":"28'799","last_deep_scrub_stamp":"2024-01-18T00:47:42.729315+0000","last_clean_scrub_stamp":"2024-01-18T00:47:42.729315+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:48.862497+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":124542,"num_write":790,"num_write_kb":159708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'194","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:34.818322+0000","last_change":"2024-01-18T00:47:34.818342+0000","last_active":"2024-01-18T00:47:34.818322+0000","last_peered":"2024-01-18T00:47:34.818322+0000","last_clean":"2024-01-18T00:47:34.818322+0000","last_became_active":"2024-01-17T22:58:49.519060+0000","last_became_peered":"2024-01-17T22:58:49.519060+0000","last_unstale":"2024-01-18T00:47:34.818322+0000","last_undegraded":"2024-01-18T00:47:34.818322+0000","last_fullsized":"2024-01-18T00:47:34.818322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'194","last_scrub_stamp":"2024-01-18T00:47:34.818260+0000","last_deep_scrub":"28'194","last_deep_scrub_stamp":"2024-01-18T00:47:34.818260+0000","last_clean_scrub_stamp":"2024-01-18T00:47:34.818260+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:53:24.462275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'865","reported_seq":941,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:29.293239+0000","last_change":"2024-01-18T00:47:29.293306+0000","last_active":"2024-01-18T00:47:29.293239+0000","last_peered":"2024-01-18T00:47:29.293239+0000","last_clean":"2024-01-18T00:47:29.293239+0000","last_became_active":"2024-01-17T22:58:48.339433+0000","last_became_peered":"2024-01-17T22:58:48.339433+0000","last_unstale":"2024-01-18T00:47:29.293239+0000","last_undegraded":"2024-01-18T00:47:29.293239+0000","last_fullsized":"2024-01-18T00:47:29.293239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'865","last_scrub_stamp":"2024-01-18T00:47:29.293071+0000","last_deep_scrub":"28'865","last_deep_scrub_stamp":"2024-01-18T00:47:29.293071+0000","last_clean_scrub_stamp":"2024-01-18T00:47:29.293071+0000","objects_scrubbed":2,"log_size":865,"log_dups_size":0,"ondisk_log_size":865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:25:31.664017+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":4462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'819","reported_seq":924,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:45.167420+0000","last_change":"2024-01-18T00:47:45.167442+0000","last_active":"2024-01-18T00:47:45.167420+0000","last_peered":"2024-01-18T00:47:45.167420+0000","last_clean":"2024-01-18T00:47:45.167420+0000","last_became_active":"2024-01-17T22:58:55.904690+0000","last_became_peered":"2024-01-17T22:58:55.904690+0000","last_unstale":"2024-01-18T00:47:45.167420+0000","last_undegraded":"2024-01-18T00:47:45.167420+0000","last_fullsized":"2024-01-18T00:47:45.167420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'819","last_scrub_stamp":"2024-01-18T00:47:45.167338+0000","last_deep_scrub":"28'819","last_deep_scrub_stamp":"2024-01-18T00:47:45.167338+0000","last_clean_scrub_stamp":"2024-01-18T00:47:45.167338+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:13:44.825710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":82183,"num_write":809,"num_write_kb":113772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'190","reported_seq":264,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:23.697594+0000","last_change":"2024-01-18T00:47:23.697617+0000","last_active":"2024-01-18T00:47:23.697594+0000","last_peered":"2024-01-18T00:47:23.697594+0000","last_clean":"2024-01-18T00:47:23.697594+0000","last_became_active":"2024-01-17T22:58:49.352744+0000","last_became_peered":"2024-01-17T22:58:49.352744+0000","last_unstale":"2024-01-18T00:47:23.697594+0000","last_undegraded":"2024-01-18T00:47:23.697594+0000","last_fullsized":"2024-01-18T00:47:23.697594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'190","last_scrub_stamp":"2024-01-18T00:47:23.697529+0000","last_deep_scrub":"28'190","last_deep_scrub_stamp":"2024-01-18T00:47:23.697529+0000","last_clean_scrub_stamp":"2024-01-18T00:47:23.697529+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:52:56.826907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'872","reported_seq":948,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:22.915864+0000","last_change":"2024-01-18T00:47:22.915864+0000","last_active":"2024-01-18T00:47:22.915864+0000","last_peered":"2024-01-18T00:47:22.915864+0000","last_clean":"2024-01-18T00:47:22.915864+0000","last_became_active":"2024-01-17T22:58:48.343435+0000","last_became_peered":"2024-01-17T22:58:48.343435+0000","last_unstale":"2024-01-18T00:47:22.915864+0000","last_undegraded":"2024-01-18T00:47:22.915864+0000","last_fullsized":"2024-01-18T00:47:22.915864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'872","last_scrub_stamp":"2024-01-18T00:47:22.915771+0000","last_deep_scrub":"28'872","last_deep_scrub_stamp":"2024-01-18T00:47:22.915771+0000","last_clean_scrub_stamp":"2024-01-18T00:47:22.915771+0000","objects_scrubbed":3,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:10:51.616803+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":942,"num_write_kb":4497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'797","reported_seq":913,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:28.862016+0000","last_change":"2024-01-18T00:47:28.862053+0000","last_active":"2024-01-18T00:47:28.862016+0000","last_peered":"2024-01-18T00:47:28.862016+0000","last_clean":"2024-01-18T00:47:28.862016+0000","last_became_active":"2024-01-17T22:58:55.913197+0000","last_became_peered":"2024-01-17T22:58:55.913197+0000","last_unstale":"2024-01-18T00:47:28.862016+0000","last_undegraded":"2024-01-18T00:47:28.862016+0000","last_fullsized":"2024-01-18T00:47:28.862016+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'797","last_scrub_stamp":"2024-01-18T00:47:28.861945+0000","last_deep_scrub":"28'797","last_deep_scrub_stamp":"2024-01-18T00:47:28.861945+0000","last_clean_scrub_stamp":"2024-01-18T00:47:28.861945+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:42:57.348068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":146211,"num_write":781,"num_write_kb":158858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'235","reported_seq":308,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:24.102479+0000","last_change":"2024-01-18T00:47:24.102499+0000","last_active":"2024-01-18T00:47:24.102479+0000","last_peered":"2024-01-18T00:47:24.102479+0000","last_clean":"2024-01-18T00:47:24.102479+0000","last_became_active":"2024-01-17T22:58:49.368018+0000","last_became_peered":"2024-01-17T22:58:49.368018+0000","last_unstale":"2024-01-18T00:47:24.102479+0000","last_undegraded":"2024-01-18T00:47:24.102479+0000","last_fullsized":"2024-01-18T00:47:24.102479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'235","last_scrub_stamp":"2024-01-18T00:47:24.102414+0000","last_deep_scrub":"28'235","last_deep_scrub_stamp":"2024-01-18T00:47:24.102414+0000","last_clean_scrub_stamp":"2024-01-18T00:47:24.102414+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:16.064043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'711","reported_seq":785,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:30.350976+0000","last_change":"2024-01-18T00:47:30.351126+0000","last_active":"2024-01-18T00:47:30.350976+0000","last_peered":"2024-01-18T00:47:30.350976+0000","last_clean":"2024-01-18T00:47:30.350976+0000","last_became_active":"2024-01-17T22:58:48.373287+0000","last_became_peered":"2024-01-17T22:58:48.373287+0000","last_unstale":"2024-01-18T00:47:30.350976+0000","last_undegraded":"2024-01-18T00:47:30.350976+0000","last_fullsized":"2024-01-18T00:47:30.350976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'711","last_scrub_stamp":"2024-01-18T00:47:30.350778+0000","last_deep_scrub":"28'711","last_deep_scrub_stamp":"2024-01-18T00:47:30.350778+0000","last_clean_scrub_stamp":"2024-01-18T00:47:30.350778+0000","objects_scrubbed":10,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:22.312407+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":649,"num_write_kb":8541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'825","reported_seq":950,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:43.743820+0000","last_change":"2024-01-18T00:47:43.743820+0000","last_active":"2024-01-18T00:47:43.743820+0000","last_peered":"2024-01-18T00:47:43.743820+0000","last_clean":"2024-01-18T00:47:43.743820+0000","last_became_active":"2024-01-17T22:58:55.909139+0000","last_became_peered":"2024-01-17T22:58:55.909139+0000","last_unstale":"2024-01-18T00:47:43.743820+0000","last_undegraded":"2024-01-18T00:47:43.743820+0000","last_fullsized":"2024-01-18T00:47:43.743820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'825","last_scrub_stamp":"2024-01-18T00:47:43.743580+0000","last_deep_scrub":"28'825","last_deep_scrub_stamp":"2024-01-18T00:47:43.743580+0000","last_clean_scrub_stamp":"2024-01-18T00:47:43.743580+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:00:11.473109+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":204092,"num_write":802,"num_write_kb":163340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'217","reported_seq":289,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:23.835079+0000","last_change":"2024-01-18T00:47:23.835098+0000","last_active":"2024-01-18T00:47:23.835079+0000","last_peered":"2024-01-18T00:47:23.835079+0000","last_clean":"2024-01-18T00:47:23.835079+0000","last_became_active":"2024-01-17T22:58:49.514776+0000","last_became_peered":"2024-01-17T22:58:49.514776+0000","last_unstale":"2024-01-18T00:47:23.835079+0000","last_undegraded":"2024-01-18T00:47:23.835079+0000","last_fullsized":"2024-01-18T00:47:23.835079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'217","last_scrub_stamp":"2024-01-18T00:47:23.835022+0000","last_deep_scrub":"28'217","last_deep_scrub_stamp":"2024-01-18T00:47:23.835022+0000","last_clean_scrub_stamp":"2024-01-18T00:47:23.835022+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:37:56.941376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'66","reported_seq":140,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:25.853274+0000","last_change":"2024-01-18T00:47:25.853312+0000","last_active":"2024-01-18T00:47:25.853274+0000","last_peered":"2024-01-18T00:47:25.853274+0000","last_clean":"2024-01-18T00:47:25.853274+0000","last_became_active":"2024-01-17T22:58:48.349193+0000","last_became_peered":"2024-01-17T22:58:48.349193+0000","last_unstale":"2024-01-18T00:47:25.853274+0000","last_undegraded":"2024-01-18T00:47:25.853274+0000","last_fullsized":"2024-01-18T00:47:25.853274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'66","last_scrub_stamp":"2024-01-18T00:47:25.853201+0000","last_deep_scrub":"28'66","last_deep_scrub_stamp":"2024-01-18T00:47:25.853201+0000","last_clean_scrub_stamp":"2024-01-18T00:47:25.853201+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:51:49.020242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'809","reported_seq":921,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:25.188210+0000","last_change":"2024-01-17T22:58:55.911280+0000","last_active":"2024-01-18T00:47:25.188210+0000","last_peered":"2024-01-18T00:47:25.188210+0000","last_clean":"2024-01-18T00:47:25.188210+0000","last_became_active":"2024-01-17T22:58:55.910147+0000","last_became_peered":"2024-01-17T22:58:55.910147+0000","last_unstale":"2024-01-18T00:47:25.188210+0000","last_undegraded":"2024-01-18T00:47:25.188210+0000","last_fullsized":"2024-01-18T00:47:25.188210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:58:54.503705+0000","last_clean_scrub_stamp":"2024-01-17T22:58:54.503705+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":124212,"num_write":791,"num_write_kb":164591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'198","reported_seq":271,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:28.152253+0000","last_change":"2024-01-18T00:47:28.152275+0000","last_active":"2024-01-18T00:47:28.152253+0000","last_peered":"2024-01-18T00:47:28.152253+0000","last_clean":"2024-01-18T00:47:28.152253+0000","last_became_active":"2024-01-17T22:58:49.366055+0000","last_became_peered":"2024-01-17T22:58:49.366055+0000","last_unstale":"2024-01-18T00:47:28.152253+0000","last_undegraded":"2024-01-18T00:47:28.152253+0000","last_fullsized":"2024-01-18T00:47:28.152253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'198","last_scrub_stamp":"2024-01-18T00:47:28.152188+0000","last_deep_scrub":"28'198","last_deep_scrub_stamp":"2024-01-18T00:47:28.152188+0000","last_clean_scrub_stamp":"2024-01-18T00:47:28.152188+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:21:11.333907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'55","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:32.133710+0000","last_change":"2024-01-18T00:47:32.133732+0000","last_active":"2024-01-18T00:47:32.133710+0000","last_peered":"2024-01-18T00:47:32.133710+0000","last_clean":"2024-01-18T00:47:32.133710+0000","last_became_active":"2024-01-17T22:58:48.377732+0000","last_became_peered":"2024-01-17T22:58:48.377732+0000","last_unstale":"2024-01-18T00:47:32.133710+0000","last_undegraded":"2024-01-18T00:47:32.133710+0000","last_fullsized":"2024-01-18T00:47:32.133710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'55","last_scrub_stamp":"2024-01-18T00:47:32.133655+0000","last_deep_scrub":"28'55","last_deep_scrub_stamp":"2024-01-18T00:47:32.133655+0000","last_clean_scrub_stamp":"2024-01-18T00:47:32.133655+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:48:25.096740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'664","reported_seq":757,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:40.400726+0000","last_change":"2024-01-18T00:47:40.400789+0000","last_active":"2024-01-18T00:47:40.400726+0000","last_peered":"2024-01-18T00:47:40.400726+0000","last_clean":"2024-01-18T00:47:40.400726+0000","last_became_active":"2024-01-17T22:59:09.244621+0000","last_became_peered":"2024-01-17T22:59:09.244621+0000","last_unstale":"2024-01-18T00:47:40.400726+0000","last_undegraded":"2024-01-18T00:47:40.400726+0000","last_fullsized":"2024-01-18T00:47:40.400726+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'664","last_scrub_stamp":"2024-01-18T00:47:40.400563+0000","last_deep_scrub":"28'664","last_deep_scrub_stamp":"2024-01-18T00:47:40.400563+0000","last_clean_scrub_stamp":"2024-01-18T00:47:40.400563+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:08:13.507484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":44179,"num_write":651,"num_write_kb":63897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,5],"acting":[6,4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'209","reported_seq":282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.417392+0000","last_change":"2024-01-18T00:47:31.417505+0000","last_active":"2024-01-18T00:47:31.417392+0000","last_peered":"2024-01-18T00:47:31.417392+0000","last_clean":"2024-01-18T00:47:31.417392+0000","last_became_active":"2024-01-17T22:58:49.367258+0000","last_became_peered":"2024-01-17T22:58:49.367258+0000","last_unstale":"2024-01-18T00:47:31.417392+0000","last_undegraded":"2024-01-18T00:47:31.417392+0000","last_fullsized":"2024-01-18T00:47:31.417392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'209","last_scrub_stamp":"2024-01-18T00:47:31.417148+0000","last_deep_scrub":"28'209","last_deep_scrub_stamp":"2024-01-18T00:47:31.417148+0000","last_clean_scrub_stamp":"2024-01-18T00:47:31.417148+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:26:59.784543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'374","reported_seq":448,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:27.139297+0000","last_change":"2024-01-18T00:47:27.139403+0000","last_active":"2024-01-18T00:47:27.139297+0000","last_peered":"2024-01-18T00:47:27.139297+0000","last_clean":"2024-01-18T00:47:27.139297+0000","last_became_active":"2024-01-17T22:58:48.370691+0000","last_became_peered":"2024-01-17T22:58:48.370691+0000","last_unstale":"2024-01-18T00:47:27.139297+0000","last_undegraded":"2024-01-18T00:47:27.139297+0000","last_fullsized":"2024-01-18T00:47:27.139297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'374","last_scrub_stamp":"2024-01-18T00:47:27.139033+0000","last_deep_scrub":"28'374","last_deep_scrub_stamp":"2024-01-18T00:47:27.139033+0000","last_clean_scrub_stamp":"2024-01-18T00:47:27.139033+0000","objects_scrubbed":6,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:14:35.566185+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":8326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'675","reported_seq":761,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:44.193671+0000","last_change":"2024-01-18T00:47:44.193709+0000","last_active":"2024-01-18T00:47:44.193671+0000","last_peered":"2024-01-18T00:47:44.193671+0000","last_clean":"2024-01-18T00:47:44.193671+0000","last_became_active":"2024-01-17T22:58:55.846382+0000","last_became_peered":"2024-01-17T22:58:55.846382+0000","last_unstale":"2024-01-18T00:47:44.193671+0000","last_undegraded":"2024-01-18T00:47:44.193671+0000","last_fullsized":"2024-01-18T00:47:44.193671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'675","last_scrub_stamp":"2024-01-18T00:47:44.193593+0000","last_deep_scrub":"28'675","last_deep_scrub_stamp":"2024-01-18T00:47:44.193593+0000","last_clean_scrub_stamp":"2024-01-18T00:47:44.193593+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:39:28.894714+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":43277,"num_write":656,"num_write_kb":56099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'195","reported_seq":267,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.790498+0000","last_change":"2024-01-18T00:47:31.790498+0000","last_active":"2024-01-18T00:47:31.790498+0000","last_peered":"2024-01-18T00:47:31.790498+0000","last_clean":"2024-01-18T00:47:31.790498+0000","last_became_active":"2024-01-17T22:58:49.367370+0000","last_became_peered":"2024-01-17T22:58:49.367370+0000","last_unstale":"2024-01-18T00:47:31.790498+0000","last_undegraded":"2024-01-18T00:47:31.790498+0000","last_fullsized":"2024-01-18T00:47:31.790498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'195","last_scrub_stamp":"2024-01-18T00:47:31.790416+0000","last_deep_scrub":"28'195","last_deep_scrub_stamp":"2024-01-18T00:47:31.790416+0000","last_clean_scrub_stamp":"2024-01-18T00:47:31.790416+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:17:15.638833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'1306","reported_seq":1379,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:22.722529+0000","last_change":"2024-01-18T00:47:22.722561+0000","last_active":"2024-01-18T00:47:22.722529+0000","last_peered":"2024-01-18T00:47:22.722529+0000","last_clean":"2024-01-18T00:47:22.722529+0000","last_became_active":"2024-01-17T22:58:48.346574+0000","last_became_peered":"2024-01-17T22:58:48.346574+0000","last_unstale":"2024-01-18T00:47:22.722529+0000","last_undegraded":"2024-01-18T00:47:22.722529+0000","last_fullsized":"2024-01-18T00:47:22.722529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1306","last_scrub_stamp":"2024-01-18T00:47:22.722473+0000","last_deep_scrub":"28'1306","last_deep_scrub_stamp":"2024-01-18T00:47:22.722473+0000","last_clean_scrub_stamp":"2024-01-18T00:47:22.722473+0000","objects_scrubbed":7,"log_size":1306,"log_dups_size":0,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:27:51.317400+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":13137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'811","reported_seq":924,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:36.328143+0000","last_change":"2024-01-18T00:47:36.328208+0000","last_active":"2024-01-18T00:47:36.328143+0000","last_peered":"2024-01-18T00:47:36.328143+0000","last_clean":"2024-01-18T00:47:36.328143+0000","last_became_active":"2024-01-17T22:58:55.831090+0000","last_became_peered":"2024-01-17T22:58:55.831090+0000","last_unstale":"2024-01-18T00:47:36.328143+0000","last_undegraded":"2024-01-18T00:47:36.328143+0000","last_fullsized":"2024-01-18T00:47:36.328143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'811","last_scrub_stamp":"2024-01-18T00:47:36.327980+0000","last_deep_scrub":"28'811","last_deep_scrub_stamp":"2024-01-18T00:47:36.327980+0000","last_clean_scrub_stamp":"2024-01-18T00:47:36.327980+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:36:56.468973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":127549,"num_write":788,"num_write_kb":160232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'198","reported_seq":271,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:30.163504+0000","last_change":"2024-01-18T00:47:30.163539+0000","last_active":"2024-01-18T00:47:30.163504+0000","last_peered":"2024-01-18T00:47:30.163504+0000","last_clean":"2024-01-18T00:47:30.163504+0000","last_became_active":"2024-01-17T22:58:49.365846+0000","last_became_peered":"2024-01-17T22:58:49.365846+0000","last_unstale":"2024-01-18T00:47:30.163504+0000","last_undegraded":"2024-01-18T00:47:30.163504+0000","last_fullsized":"2024-01-18T00:47:30.163504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'198","last_scrub_stamp":"2024-01-18T00:47:30.163432+0000","last_deep_scrub":"28'198","last_deep_scrub_stamp":"2024-01-18T00:47:30.163432+0000","last_clean_scrub_stamp":"2024-01-18T00:47:30.163432+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:02:30.140975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'1449","reported_seq":1522,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:29.178030+0000","last_change":"2024-01-18T00:47:29.178030+0000","last_active":"2024-01-18T00:47:29.178030+0000","last_peered":"2024-01-18T00:47:29.178030+0000","last_clean":"2024-01-18T00:47:29.178030+0000","last_became_active":"2024-01-17T22:58:48.375504+0000","last_became_peered":"2024-01-17T22:58:48.375504+0000","last_unstale":"2024-01-18T00:47:29.178030+0000","last_undegraded":"2024-01-18T00:47:29.178030+0000","last_fullsized":"2024-01-18T00:47:29.178030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1449","last_scrub_stamp":"2024-01-18T00:47:29.177803+0000","last_deep_scrub":"28'1449","last_deep_scrub_stamp":"2024-01-18T00:47:29.177803+0000","last_clean_scrub_stamp":"2024-01-18T00:47:29.177803+0000","objects_scrubbed":4,"log_size":1449,"log_dups_size":0,"ondisk_log_size":1449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:42:57.663926+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1379,"num_write_kb":5332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'771","reported_seq":876,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.698476+0000","last_change":"2024-01-18T00:47:35.698499+0000","last_active":"2024-01-18T00:47:35.698476+0000","last_peered":"2024-01-18T00:47:35.698476+0000","last_clean":"2024-01-18T00:47:35.698476+0000","last_became_active":"2024-01-17T22:58:55.906429+0000","last_became_peered":"2024-01-17T22:58:55.906429+0000","last_unstale":"2024-01-18T00:47:35.698476+0000","last_undegraded":"2024-01-18T00:47:35.698476+0000","last_fullsized":"2024-01-18T00:47:35.698476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'771","last_scrub_stamp":"2024-01-18T00:47:35.698406+0000","last_deep_scrub":"28'771","last_deep_scrub_stamp":"2024-01-18T00:47:35.698406+0000","last_clean_scrub_stamp":"2024-01-18T00:47:35.698406+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:41:38.127491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":103553,"num_write":751,"num_write_kb":113909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'197","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:28.834731+0000","last_change":"2024-01-18T00:47:28.834731+0000","last_active":"2024-01-18T00:47:28.834731+0000","last_peered":"2024-01-18T00:47:28.834731+0000","last_clean":"2024-01-18T00:47:28.834731+0000","last_became_active":"2024-01-17T22:58:49.360282+0000","last_became_peered":"2024-01-17T22:58:49.360282+0000","last_unstale":"2024-01-18T00:47:28.834731+0000","last_undegraded":"2024-01-18T00:47:28.834731+0000","last_fullsized":"2024-01-18T00:47:28.834731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'197","last_scrub_stamp":"2024-01-18T00:47:28.834514+0000","last_deep_scrub":"28'197","last_deep_scrub_stamp":"2024-01-18T00:47:28.834514+0000","last_clean_scrub_stamp":"2024-01-18T00:47:28.834514+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:51:52.001556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'185","reported_seq":258,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:26.849637+0000","last_change":"2024-01-18T00:47:26.849637+0000","last_active":"2024-01-18T00:47:26.849637+0000","last_peered":"2024-01-18T00:47:26.849637+0000","last_clean":"2024-01-18T00:47:26.849637+0000","last_became_active":"2024-01-17T22:58:48.349262+0000","last_became_peered":"2024-01-17T22:58:48.349262+0000","last_unstale":"2024-01-18T00:47:26.849637+0000","last_undegraded":"2024-01-18T00:47:26.849637+0000","last_fullsized":"2024-01-18T00:47:26.849637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'185","last_scrub_stamp":"2024-01-18T00:47:26.849551+0000","last_deep_scrub":"28'185","last_deep_scrub_stamp":"2024-01-18T00:47:26.849551+0000","last_clean_scrub_stamp":"2024-01-18T00:47:26.849551+0000","objects_scrubbed":2,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:29:16.124031+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'853","reported_seq":951,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:33.219352+0000","last_change":"2024-01-18T00:47:33.219490+0000","last_active":"2024-01-18T00:47:33.219352+0000","last_peered":"2024-01-18T00:47:33.219352+0000","last_clean":"2024-01-18T00:47:33.219352+0000","last_became_active":"2024-01-17T22:58:55.899176+0000","last_became_peered":"2024-01-17T22:58:55.899176+0000","last_unstale":"2024-01-18T00:47:33.219352+0000","last_undegraded":"2024-01-18T00:47:33.219352+0000","last_fullsized":"2024-01-18T00:47:33.219352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'853","last_scrub_stamp":"2024-01-18T00:47:33.219137+0000","last_deep_scrub":"28'853","last_deep_scrub_stamp":"2024-01-18T00:47:33.219137+0000","last_clean_scrub_stamp":"2024-01-18T00:47:33.219137+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:34.408099+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":85515,"num_write":843,"num_write_kb":192821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'218","reported_seq":289,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:24.731816+0000","last_change":"2024-01-18T00:47:24.731816+0000","last_active":"2024-01-18T00:47:24.731816+0000","last_peered":"2024-01-18T00:47:24.731816+0000","last_clean":"2024-01-18T00:47:24.731816+0000","last_became_active":"2024-01-17T22:58:49.363979+0000","last_became_peered":"2024-01-17T22:58:49.363979+0000","last_unstale":"2024-01-18T00:47:24.731816+0000","last_undegraded":"2024-01-18T00:47:24.731816+0000","last_fullsized":"2024-01-18T00:47:24.731816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'218","last_scrub_stamp":"2024-01-18T00:47:24.731720+0000","last_deep_scrub":"28'218","last_deep_scrub_stamp":"2024-01-18T00:47:24.731720+0000","last_clean_scrub_stamp":"2024-01-18T00:47:24.731720+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:05:55.164501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'58","reported_seq":130,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:22.873678+0000","last_change":"2024-01-18T00:47:22.873678+0000","last_active":"2024-01-18T00:47:22.873678+0000","last_peered":"2024-01-18T00:47:22.873678+0000","last_clean":"2024-01-18T00:47:22.873678+0000","last_became_active":"2024-01-17T22:58:48.321379+0000","last_became_peered":"2024-01-17T22:58:48.321379+0000","last_unstale":"2024-01-18T00:47:22.873678+0000","last_undegraded":"2024-01-18T00:47:22.873678+0000","last_fullsized":"2024-01-18T00:47:22.873678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'58","last_scrub_stamp":"2024-01-18T00:47:22.873594+0000","last_deep_scrub":"28'58","last_deep_scrub_stamp":"2024-01-18T00:47:22.873594+0000","last_clean_scrub_stamp":"2024-01-18T00:47:22.873594+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:32:41.455855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'867","reported_seq":987,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:37.322417+0000","last_change":"2024-01-18T00:47:37.322479+0000","last_active":"2024-01-18T00:47:37.322417+0000","last_peered":"2024-01-18T00:47:37.322417+0000","last_clean":"2024-01-18T00:47:37.322417+0000","last_became_active":"2024-01-17T22:58:55.872885+0000","last_became_peered":"2024-01-17T22:58:55.872885+0000","last_unstale":"2024-01-18T00:47:37.322417+0000","last_undegraded":"2024-01-18T00:47:37.322417+0000","last_fullsized":"2024-01-18T00:47:37.322417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'867","last_scrub_stamp":"2024-01-18T00:47:37.322193+0000","last_deep_scrub":"28'867","last_deep_scrub_stamp":"2024-01-18T00:47:37.322193+0000","last_clean_scrub_stamp":"2024-01-18T00:47:37.322193+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:08:10.429114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":173952,"num_write":855,"num_write_kb":180962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'734","reported_seq":847,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:39.389000+0000","last_change":"2024-01-18T00:47:39.389063+0000","last_active":"2024-01-18T00:47:39.389000+0000","last_peered":"2024-01-18T00:47:39.389000+0000","last_clean":"2024-01-18T00:47:39.389000+0000","last_became_active":"2024-01-17T22:58:55.902860+0000","last_became_peered":"2024-01-17T22:58:55.902860+0000","last_unstale":"2024-01-18T00:47:39.389000+0000","last_undegraded":"2024-01-18T00:47:39.389000+0000","last_fullsized":"2024-01-18T00:47:39.389000+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'734","last_scrub_stamp":"2024-01-18T00:47:39.388824+0000","last_deep_scrub":"28'734","last_deep_scrub_stamp":"2024-01-18T00:47:39.388824+0000","last_clean_scrub_stamp":"2024-01-18T00:47:39.388824+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:09:33.540872+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":112144,"num_write":721,"num_write_kb":109826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'202","reported_seq":273,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.372464+0000","last_change":"2024-01-18T00:47:35.372580+0000","last_active":"2024-01-18T00:47:35.372464+0000","last_peered":"2024-01-18T00:47:35.372464+0000","last_clean":"2024-01-18T00:47:35.372464+0000","last_became_active":"2024-01-17T22:58:49.514297+0000","last_became_peered":"2024-01-17T22:58:49.514297+0000","last_unstale":"2024-01-18T00:47:35.372464+0000","last_undegraded":"2024-01-18T00:47:35.372464+0000","last_fullsized":"2024-01-18T00:47:35.372464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'202","last_scrub_stamp":"2024-01-18T00:47:35.372171+0000","last_deep_scrub":"28'202","last_deep_scrub_stamp":"2024-01-18T00:47:35.372171+0000","last_clean_scrub_stamp":"2024-01-18T00:47:35.372171+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:56:26.918237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'1282","reported_seq":1355,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:33.180161+0000","last_change":"2024-01-18T00:47:33.180161+0000","last_active":"2024-01-18T00:47:33.180161+0000","last_peered":"2024-01-18T00:47:33.180161+0000","last_clean":"2024-01-18T00:47:33.180161+0000","last_became_active":"2024-01-17T22:58:48.331645+0000","last_became_peered":"2024-01-17T22:58:48.331645+0000","last_unstale":"2024-01-18T00:47:33.180161+0000","last_undegraded":"2024-01-18T00:47:33.180161+0000","last_fullsized":"2024-01-18T00:47:33.180161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1282","last_scrub_stamp":"2024-01-18T00:47:33.180066+0000","last_deep_scrub":"28'1282","last_deep_scrub_stamp":"2024-01-18T00:47:33.180066+0000","last_clean_scrub_stamp":"2024-01-18T00:47:33.180066+0000","objects_scrubbed":3,"log_size":1282,"log_dups_size":0,"ondisk_log_size":1282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:49:49.880434+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":12872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'696","reported_seq":790,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:46.121058+0000","last_change":"2024-01-18T00:47:46.121079+0000","last_active":"2024-01-18T00:47:46.121058+0000","last_peered":"2024-01-18T00:47:46.121058+0000","last_clean":"2024-01-18T00:47:46.121058+0000","last_became_active":"2024-01-17T22:58:55.905743+0000","last_became_peered":"2024-01-17T22:58:55.905743+0000","last_unstale":"2024-01-18T00:47:46.121058+0000","last_undegraded":"2024-01-18T00:47:46.121058+0000","last_fullsized":"2024-01-18T00:47:46.121058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'696","last_scrub_stamp":"2024-01-18T00:47:46.120989+0000","last_deep_scrub":"28'696","last_deep_scrub_stamp":"2024-01-18T00:47:46.120989+0000","last_clean_scrub_stamp":"2024-01-18T00:47:46.120989+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:40:02.211023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":59282,"num_write":679,"num_write_kb":96928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'234","reported_seq":306,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:25.886880+0000","last_change":"2024-01-18T00:47:25.886880+0000","last_active":"2024-01-18T00:47:25.886880+0000","last_peered":"2024-01-18T00:47:25.886880+0000","last_clean":"2024-01-18T00:47:25.886880+0000","last_became_active":"2024-01-17T22:58:49.366692+0000","last_became_peered":"2024-01-17T22:58:49.366692+0000","last_unstale":"2024-01-18T00:47:25.886880+0000","last_undegraded":"2024-01-18T00:47:25.886880+0000","last_fullsized":"2024-01-18T00:47:25.886880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'234","last_scrub_stamp":"2024-01-18T00:47:25.886648+0000","last_deep_scrub":"28'234","last_deep_scrub_stamp":"2024-01-18T00:47:25.886648+0000","last_clean_scrub_stamp":"2024-01-18T00:47:25.886648+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:10:54.587680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'172","reported_seq":244,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:27.420802+0000","last_change":"2024-01-18T00:47:27.420866+0000","last_active":"2024-01-18T00:47:27.420802+0000","last_peered":"2024-01-18T00:47:27.420802+0000","last_clean":"2024-01-18T00:47:27.420802+0000","last_became_active":"2024-01-17T22:58:48.344271+0000","last_became_peered":"2024-01-17T22:58:48.344271+0000","last_unstale":"2024-01-18T00:47:27.420802+0000","last_undegraded":"2024-01-18T00:47:27.420802+0000","last_fullsized":"2024-01-18T00:47:27.420802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'172","last_scrub_stamp":"2024-01-18T00:47:27.420640+0000","last_deep_scrub":"28'172","last_deep_scrub_stamp":"2024-01-18T00:47:27.420640+0000","last_clean_scrub_stamp":"2024-01-18T00:47:27.420640+0000","objects_scrubbed":2,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:05:57.853421+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'1518","reported_seq":1589,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:39.174784+0000","last_change":"2024-01-18T00:47:39.174812+0000","last_active":"2024-01-18T00:47:39.174784+0000","last_peered":"2024-01-18T00:47:39.174784+0000","last_clean":"2024-01-18T00:47:39.174784+0000","last_became_active":"2024-01-17T22:58:48.339364+0000","last_became_peered":"2024-01-17T22:58:48.339364+0000","last_unstale":"2024-01-18T00:47:39.174784+0000","last_undegraded":"2024-01-18T00:47:39.174784+0000","last_fullsized":"2024-01-18T00:47:39.174784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1518","last_scrub_stamp":"2024-01-18T00:47:39.174728+0000","last_deep_scrub":"28'1518","last_deep_scrub_stamp":"2024-01-18T00:47:39.174728+0000","last_clean_scrub_stamp":"2024-01-18T00:47:39.174728+0000","objects_scrubbed":5,"log_size":1518,"log_dups_size":0,"ondisk_log_size":1518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:19:23.757834+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16419543,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1459,"num_write_kb":16764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'186","reported_seq":256,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:25.267478+0000","last_change":"2024-01-18T00:47:25.267644+0000","last_active":"2024-01-18T00:47:25.267478+0000","last_peered":"2024-01-18T00:47:25.267478+0000","last_clean":"2024-01-18T00:47:25.267478+0000","last_became_active":"2024-01-17T22:58:49.414163+0000","last_became_peered":"2024-01-17T22:58:49.414163+0000","last_unstale":"2024-01-18T00:47:25.267478+0000","last_undegraded":"2024-01-18T00:47:25.267478+0000","last_fullsized":"2024-01-18T00:47:25.267478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'186","last_scrub_stamp":"2024-01-18T00:47:25.267213+0000","last_deep_scrub":"28'186","last_deep_scrub_stamp":"2024-01-18T00:47:25.267213+0000","last_clean_scrub_stamp":"2024-01-18T00:47:25.267213+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:11:20.336269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'765","reported_seq":864,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:38.366487+0000","last_change":"2024-01-18T00:47:38.366551+0000","last_active":"2024-01-18T00:47:38.366487+0000","last_peered":"2024-01-18T00:47:38.366487+0000","last_clean":"2024-01-18T00:47:38.366487+0000","last_became_active":"2024-01-17T22:58:55.879263+0000","last_became_peered":"2024-01-17T22:58:55.879263+0000","last_unstale":"2024-01-18T00:47:38.366487+0000","last_undegraded":"2024-01-18T00:47:38.366487+0000","last_fullsized":"2024-01-18T00:47:38.366487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'765","last_scrub_stamp":"2024-01-18T00:47:38.366281+0000","last_deep_scrub":"28'765","last_deep_scrub_stamp":"2024-01-18T00:47:38.366281+0000","last_clean_scrub_stamp":"2024-01-18T00:47:38.366281+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:48:31.329366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":97351,"num_write":747,"num_write_kb":155607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'210","reported_seq":281,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:30.883772+0000","last_change":"2024-01-18T00:47:30.883842+0000","last_active":"2024-01-18T00:47:30.883772+0000","last_peered":"2024-01-18T00:47:30.883772+0000","last_clean":"2024-01-18T00:47:30.883772+0000","last_became_active":"2024-01-17T22:58:48.338809+0000","last_became_peered":"2024-01-17T22:58:48.338809+0000","last_unstale":"2024-01-18T00:47:30.883772+0000","last_undegraded":"2024-01-18T00:47:30.883772+0000","last_fullsized":"2024-01-18T00:47:30.883772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'210","last_scrub_stamp":"2024-01-18T00:47:30.883599+0000","last_deep_scrub":"28'210","last_deep_scrub_stamp":"2024-01-18T00:47:30.883599+0000","last_clean_scrub_stamp":"2024-01-18T00:47:30.883599+0000","objects_scrubbed":3,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:04:55.011112+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195321,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'206","reported_seq":275,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:26.903427+0000","last_change":"2024-01-18T00:47:26.903447+0000","last_active":"2024-01-18T00:47:26.903427+0000","last_peered":"2024-01-18T00:47:26.903427+0000","last_clean":"2024-01-18T00:47:26.903427+0000","last_became_active":"2024-01-17T22:58:49.518211+0000","last_became_peered":"2024-01-17T22:58:49.518211+0000","last_unstale":"2024-01-18T00:47:26.903427+0000","last_undegraded":"2024-01-18T00:47:26.903427+0000","last_fullsized":"2024-01-18T00:47:26.903427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'206","last_scrub_stamp":"2024-01-18T00:47:26.903365+0000","last_deep_scrub":"28'206","last_deep_scrub_stamp":"2024-01-18T00:47:26.903365+0000","last_clean_scrub_stamp":"2024-01-18T00:47:26.903365+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:29:51.634207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'779","reported_seq":888,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.199341+0000","last_change":"2024-01-18T00:47:35.199390+0000","last_active":"2024-01-18T00:47:35.199341+0000","last_peered":"2024-01-18T00:47:35.199341+0000","last_clean":"2024-01-18T00:47:35.199341+0000","last_became_active":"2024-01-17T22:58:55.912825+0000","last_became_peered":"2024-01-17T22:58:55.912825+0000","last_unstale":"2024-01-18T00:47:35.199341+0000","last_undegraded":"2024-01-18T00:47:35.199341+0000","last_fullsized":"2024-01-18T00:47:35.199341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'779","last_scrub_stamp":"2024-01-18T00:47:35.199232+0000","last_deep_scrub":"28'779","last_deep_scrub_stamp":"2024-01-18T00:47:35.199232+0000","last_clean_scrub_stamp":"2024-01-18T00:47:35.199232+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:56:42.841317+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":138691,"num_write":762,"num_write_kb":151906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'221","reported_seq":299,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:27.696805+0000","last_change":"2024-01-18T00:47:27.696825+0000","last_active":"2024-01-18T00:47:27.696805+0000","last_peered":"2024-01-18T00:47:27.696805+0000","last_clean":"2024-01-18T00:47:27.696805+0000","last_became_active":"2024-01-17T22:58:49.371125+0000","last_became_peered":"2024-01-17T22:58:49.371125+0000","last_unstale":"2024-01-18T00:47:27.696805+0000","last_undegraded":"2024-01-18T00:47:27.696805+0000","last_fullsized":"2024-01-18T00:47:27.696805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'221","last_scrub_stamp":"2024-01-18T00:47:27.696744+0000","last_deep_scrub":"28'221","last_deep_scrub_stamp":"2024-01-18T00:47:27.696744+0000","last_clean_scrub_stamp":"2024-01-18T00:47:27.696744+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:56:35.338829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'215","reported_seq":294,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:32.177968+0000","last_change":"2024-01-18T00:47:32.178022+0000","last_active":"2024-01-18T00:47:32.177968+0000","last_peered":"2024-01-18T00:47:32.177968+0000","last_clean":"2024-01-18T00:47:32.177968+0000","last_became_active":"2024-01-17T22:58:49.509690+0000","last_became_peered":"2024-01-17T22:58:49.509690+0000","last_unstale":"2024-01-18T00:47:32.177968+0000","last_undegraded":"2024-01-18T00:47:32.177968+0000","last_fullsized":"2024-01-18T00:47:32.177968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'215","last_scrub_stamp":"2024-01-18T00:47:32.177831+0000","last_deep_scrub":"28'215","last_deep_scrub_stamp":"2024-01-18T00:47:32.177831+0000","last_clean_scrub_stamp":"2024-01-18T00:47:32.177831+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:11:27.246887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'233","reported_seq":312,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:27.104884+0000","last_change":"2024-01-18T00:47:27.104915+0000","last_active":"2024-01-18T00:47:27.104884+0000","last_peered":"2024-01-18T00:47:27.104884+0000","last_clean":"2024-01-18T00:47:27.104884+0000","last_became_active":"2024-01-17T22:58:49.370511+0000","last_became_peered":"2024-01-17T22:58:49.370511+0000","last_unstale":"2024-01-18T00:47:27.104884+0000","last_undegraded":"2024-01-18T00:47:27.104884+0000","last_fullsized":"2024-01-18T00:47:27.104884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'233","last_scrub_stamp":"2024-01-18T00:47:27.104812+0000","last_deep_scrub":"28'233","last_deep_scrub_stamp":"2024-01-18T00:47:27.104812+0000","last_clean_scrub_stamp":"2024-01-18T00:47:27.104812+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:32:06.746264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'208","reported_seq":287,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:27.854044+0000","last_change":"2024-01-18T00:47:27.854044+0000","last_active":"2024-01-18T00:47:27.854044+0000","last_peered":"2024-01-18T00:47:27.854044+0000","last_clean":"2024-01-18T00:47:27.854044+0000","last_became_active":"2024-01-17T22:58:49.384397+0000","last_became_peered":"2024-01-17T22:58:49.384397+0000","last_unstale":"2024-01-18T00:47:27.854044+0000","last_undegraded":"2024-01-18T00:47:27.854044+0000","last_fullsized":"2024-01-18T00:47:27.854044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'208","last_scrub_stamp":"2024-01-18T00:47:27.853820+0000","last_deep_scrub":"28'208","last_deep_scrub_stamp":"2024-01-18T00:47:27.853820+0000","last_clean_scrub_stamp":"2024-01-18T00:47:27.853820+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:17:51.765227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'188","reported_seq":265,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:32.423691+0000","last_change":"2024-01-18T00:47:32.423749+0000","last_active":"2024-01-18T00:47:32.423691+0000","last_peered":"2024-01-18T00:47:32.423691+0000","last_clean":"2024-01-18T00:47:32.423691+0000","last_became_active":"2024-01-17T22:58:49.368591+0000","last_became_peered":"2024-01-17T22:58:49.368591+0000","last_unstale":"2024-01-18T00:47:32.423691+0000","last_undegraded":"2024-01-18T00:47:32.423691+0000","last_fullsized":"2024-01-18T00:47:32.423691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'188","last_scrub_stamp":"2024-01-18T00:47:32.423530+0000","last_deep_scrub":"28'188","last_deep_scrub_stamp":"2024-01-18T00:47:32.423530+0000","last_clean_scrub_stamp":"2024-01-18T00:47:32.423530+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:25:34.794476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'203","reported_seq":280,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:34.381296+0000","last_change":"2024-01-18T00:47:34.381401+0000","last_active":"2024-01-18T00:47:34.381296+0000","last_peered":"2024-01-18T00:47:34.381296+0000","last_clean":"2024-01-18T00:47:34.381296+0000","last_became_active":"2024-01-17T22:58:49.379560+0000","last_became_peered":"2024-01-17T22:58:49.379560+0000","last_unstale":"2024-01-18T00:47:34.381296+0000","last_undegraded":"2024-01-18T00:47:34.381296+0000","last_fullsized":"2024-01-18T00:47:34.381296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'203","last_scrub_stamp":"2024-01-18T00:47:34.381046+0000","last_deep_scrub":"28'203","last_deep_scrub_stamp":"2024-01-18T00:47:34.381046+0000","last_clean_scrub_stamp":"2024-01-18T00:47:34.381046+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:12:48.884757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'241","reported_seq":317,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:25.738722+0000","last_change":"2024-01-18T00:47:25.738743+0000","last_active":"2024-01-18T00:47:25.738722+0000","last_peered":"2024-01-18T00:47:25.738722+0000","last_clean":"2024-01-18T00:47:25.738722+0000","last_became_active":"2024-01-17T22:58:49.367330+0000","last_became_peered":"2024-01-17T22:58:49.367330+0000","last_unstale":"2024-01-18T00:47:25.738722+0000","last_undegraded":"2024-01-18T00:47:25.738722+0000","last_fullsized":"2024-01-18T00:47:25.738722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'241","last_scrub_stamp":"2024-01-18T00:47:25.738661+0000","last_deep_scrub":"28'241","last_deep_scrub_stamp":"2024-01-18T00:47:25.738661+0000","last_clean_scrub_stamp":"2024-01-18T00:47:25.738661+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:26.927623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'196","reported_seq":273,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:40.720003+0000","last_change":"2024-01-18T00:47:40.720118+0000","last_active":"2024-01-18T00:47:40.720003+0000","last_peered":"2024-01-18T00:47:40.720003+0000","last_clean":"2024-01-18T00:47:40.720003+0000","last_became_active":"2024-01-17T22:58:49.513924+0000","last_became_peered":"2024-01-17T22:58:49.513924+0000","last_unstale":"2024-01-18T00:47:40.720003+0000","last_undegraded":"2024-01-18T00:47:40.720003+0000","last_fullsized":"2024-01-18T00:47:40.720003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'196","last_scrub_stamp":"2024-01-18T00:47:40.719803+0000","last_deep_scrub":"28'196","last_deep_scrub_stamp":"2024-01-18T00:47:40.719803+0000","last_clean_scrub_stamp":"2024-01-18T00:47:40.719803+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:49:35.945296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'222","reported_seq":299,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:25.103067+0000","last_change":"2024-01-18T00:47:25.103067+0000","last_active":"2024-01-18T00:47:25.103067+0000","last_peered":"2024-01-18T00:47:25.103067+0000","last_clean":"2024-01-18T00:47:25.103067+0000","last_became_active":"2024-01-17T22:58:49.370808+0000","last_became_peered":"2024-01-17T22:58:49.370808+0000","last_unstale":"2024-01-18T00:47:25.103067+0000","last_undegraded":"2024-01-18T00:47:25.103067+0000","last_fullsized":"2024-01-18T00:47:25.103067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'222","last_scrub_stamp":"2024-01-18T00:47:25.102983+0000","last_deep_scrub":"28'222","last_deep_scrub_stamp":"2024-01-18T00:47:25.102983+0000","last_clean_scrub_stamp":"2024-01-18T00:47:25.102983+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:12:39.606693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'200","reported_seq":275,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.813434+0000","last_change":"2024-01-18T00:47:35.813571+0000","last_active":"2024-01-18T00:47:35.813434+0000","last_peered":"2024-01-18T00:47:35.813434+0000","last_clean":"2024-01-18T00:47:35.813434+0000","last_became_active":"2024-01-17T22:58:49.350057+0000","last_became_peered":"2024-01-17T22:58:49.350057+0000","last_unstale":"2024-01-18T00:47:35.813434+0000","last_undegraded":"2024-01-18T00:47:35.813434+0000","last_fullsized":"2024-01-18T00:47:35.813434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'200","last_scrub_stamp":"2024-01-18T00:47:35.813237+0000","last_deep_scrub":"28'200","last_deep_scrub_stamp":"2024-01-18T00:47:35.813237+0000","last_clean_scrub_stamp":"2024-01-18T00:47:35.813237+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:42:52.350001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'209","reported_seq":283,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:24.843292+0000","last_change":"2024-01-18T00:47:24.843313+0000","last_active":"2024-01-18T00:47:24.843292+0000","last_peered":"2024-01-18T00:47:24.843292+0000","last_clean":"2024-01-18T00:47:24.843292+0000","last_became_active":"2024-01-17T22:58:49.517631+0000","last_became_peered":"2024-01-17T22:58:49.517631+0000","last_unstale":"2024-01-18T00:47:24.843292+0000","last_undegraded":"2024-01-18T00:47:24.843292+0000","last_fullsized":"2024-01-18T00:47:24.843292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'209","last_scrub_stamp":"2024-01-18T00:47:24.843234+0000","last_deep_scrub":"28'209","last_deep_scrub_stamp":"2024-01-18T00:47:24.843234+0000","last_clean_scrub_stamp":"2024-01-18T00:47:24.843234+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:41:19.693577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'203","reported_seq":278,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:33.389029+0000","last_change":"2024-01-18T00:47:33.389072+0000","last_active":"2024-01-18T00:47:33.389029+0000","last_peered":"2024-01-18T00:47:33.389029+0000","last_clean":"2024-01-18T00:47:33.389029+0000","last_became_active":"2024-01-17T22:58:49.411772+0000","last_became_peered":"2024-01-17T22:58:49.411772+0000","last_unstale":"2024-01-18T00:47:33.389029+0000","last_undegraded":"2024-01-18T00:47:33.389029+0000","last_fullsized":"2024-01-18T00:47:33.389029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'203","last_scrub_stamp":"2024-01-18T00:47:33.388919+0000","last_deep_scrub":"28'203","last_deep_scrub_stamp":"2024-01-18T00:47:33.388919+0000","last_clean_scrub_stamp":"2024-01-18T00:47:33.388919+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:47:18.091511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'220","reported_seq":287,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:36.233574+0000","last_change":"2024-01-18T00:47:36.233633+0000","last_active":"2024-01-18T00:47:36.233574+0000","last_peered":"2024-01-18T00:47:36.233574+0000","last_clean":"2024-01-18T00:47:36.233574+0000","last_became_active":"2024-01-17T22:59:08.750082+0000","last_became_peered":"2024-01-17T22:59:08.750082+0000","last_unstale":"2024-01-18T00:47:36.233574+0000","last_undegraded":"2024-01-18T00:47:36.233574+0000","last_fullsized":"2024-01-18T00:47:36.233574+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'220","last_scrub_stamp":"2024-01-18T00:47:36.233407+0000","last_deep_scrub":"28'220","last_deep_scrub_stamp":"2024-01-18T00:47:36.233407+0000","last_clean_scrub_stamp":"2024-01-18T00:47:36.233407+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:05:55.088682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"28'209","reported_seq":284,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.137139+0000","last_change":"2024-01-18T00:47:31.137160+0000","last_active":"2024-01-18T00:47:31.137139+0000","last_peered":"2024-01-18T00:47:31.137139+0000","last_clean":"2024-01-18T00:47:31.137139+0000","last_became_active":"2024-01-17T22:58:49.414598+0000","last_became_peered":"2024-01-17T22:58:49.414598+0000","last_unstale":"2024-01-18T00:47:31.137139+0000","last_undegraded":"2024-01-18T00:47:31.137139+0000","last_fullsized":"2024-01-18T00:47:31.137139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'209","last_scrub_stamp":"2024-01-18T00:47:31.137044+0000","last_deep_scrub":"28'209","last_deep_scrub_stamp":"2024-01-18T00:47:31.137044+0000","last_clean_scrub_stamp":"2024-01-18T00:47:31.137044+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:08:04.243965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'191","reported_seq":264,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.145183+0000","last_change":"2024-01-18T00:47:31.145230+0000","last_active":"2024-01-18T00:47:31.145183+0000","last_peered":"2024-01-18T00:47:31.145183+0000","last_clean":"2024-01-18T00:47:31.145183+0000","last_became_active":"2024-01-17T22:58:49.388096+0000","last_became_peered":"2024-01-17T22:58:49.388096+0000","last_unstale":"2024-01-18T00:47:31.145183+0000","last_undegraded":"2024-01-18T00:47:31.145183+0000","last_fullsized":"2024-01-18T00:47:31.145183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'191","last_scrub_stamp":"2024-01-18T00:47:31.145059+0000","last_deep_scrub":"28'191","last_deep_scrub_stamp":"2024-01-18T00:47:31.145059+0000","last_clean_scrub_stamp":"2024-01-18T00:47:31.145059+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:26:14.046656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'199","reported_seq":272,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:23.148900+0000","last_change":"2024-01-18T00:47:23.148922+0000","last_active":"2024-01-18T00:47:23.148900+0000","last_peered":"2024-01-18T00:47:23.148900+0000","last_clean":"2024-01-18T00:47:23.148900+0000","last_became_active":"2024-01-17T22:58:49.369959+0000","last_became_peered":"2024-01-17T22:58:49.369959+0000","last_unstale":"2024-01-18T00:47:23.148900+0000","last_undegraded":"2024-01-18T00:47:23.148900+0000","last_fullsized":"2024-01-18T00:47:23.148900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'199","last_scrub_stamp":"2024-01-18T00:47:23.148840+0000","last_deep_scrub":"28'199","last_deep_scrub_stamp":"2024-01-18T00:47:23.148840+0000","last_clean_scrub_stamp":"2024-01-18T00:47:23.148840+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:05:42.004115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'218","reported_seq":291,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:26.108570+0000","last_change":"2024-01-18T00:47:26.108592+0000","last_active":"2024-01-18T00:47:26.108570+0000","last_peered":"2024-01-18T00:47:26.108570+0000","last_clean":"2024-01-18T00:47:26.108570+0000","last_became_active":"2024-01-17T22:58:49.366122+0000","last_became_peered":"2024-01-17T22:58:49.366122+0000","last_unstale":"2024-01-18T00:47:26.108570+0000","last_undegraded":"2024-01-18T00:47:26.108570+0000","last_fullsized":"2024-01-18T00:47:26.108570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'218","last_scrub_stamp":"2024-01-18T00:47:26.108502+0000","last_deep_scrub":"28'218","last_deep_scrub_stamp":"2024-01-18T00:47:26.108502+0000","last_clean_scrub_stamp":"2024-01-18T00:47:26.108502+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:04:46.080253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'209","reported_seq":282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:33.840786+0000","last_change":"2024-01-18T00:47:33.840903+0000","last_active":"2024-01-18T00:47:33.840786+0000","last_peered":"2024-01-18T00:47:33.840786+0000","last_clean":"2024-01-18T00:47:33.840786+0000","last_became_active":"2024-01-17T22:58:49.348630+0000","last_became_peered":"2024-01-17T22:58:49.348630+0000","last_unstale":"2024-01-18T00:47:33.840786+0000","last_undegraded":"2024-01-18T00:47:33.840786+0000","last_fullsized":"2024-01-18T00:47:33.840786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'209","last_scrub_stamp":"2024-01-18T00:47:33.840597+0000","last_deep_scrub":"28'209","last_deep_scrub_stamp":"2024-01-18T00:47:33.840597+0000","last_clean_scrub_stamp":"2024-01-18T00:47:33.840597+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:28:23.409848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'210","reported_seq":283,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.403859+0000","last_change":"2024-01-18T00:47:35.403994+0000","last_active":"2024-01-18T00:47:35.403859+0000","last_peered":"2024-01-18T00:47:35.403859+0000","last_clean":"2024-01-18T00:47:35.403859+0000","last_became_active":"2024-01-17T22:58:49.382454+0000","last_became_peered":"2024-01-17T22:58:49.382454+0000","last_unstale":"2024-01-18T00:47:35.403859+0000","last_undegraded":"2024-01-18T00:47:35.403859+0000","last_fullsized":"2024-01-18T00:47:35.403859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'210","last_scrub_stamp":"2024-01-18T00:47:35.403671+0000","last_deep_scrub":"28'210","last_deep_scrub_stamp":"2024-01-18T00:47:35.403671+0000","last_clean_scrub_stamp":"2024-01-18T00:47:35.403671+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:54:10.158219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'196","reported_seq":268,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:29.391357+0000","last_change":"2024-01-18T00:47:29.391357+0000","last_active":"2024-01-18T00:47:29.391357+0000","last_peered":"2024-01-18T00:47:29.391357+0000","last_clean":"2024-01-18T00:47:29.391357+0000","last_became_active":"2024-01-17T22:58:49.364509+0000","last_became_peered":"2024-01-17T22:58:49.364509+0000","last_unstale":"2024-01-18T00:47:29.391357+0000","last_undegraded":"2024-01-18T00:47:29.391357+0000","last_fullsized":"2024-01-18T00:47:29.391357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'196","last_scrub_stamp":"2024-01-18T00:47:29.391150+0000","last_deep_scrub":"28'196","last_deep_scrub_stamp":"2024-01-18T00:47:29.391150+0000","last_clean_scrub_stamp":"2024-01-18T00:47:29.391150+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:33:38.445872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'173","reported_seq":245,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:33.778632+0000","last_change":"2024-01-18T00:47:33.778632+0000","last_active":"2024-01-18T00:47:33.778632+0000","last_peered":"2024-01-18T00:47:33.778632+0000","last_clean":"2024-01-18T00:47:33.778632+0000","last_became_active":"2024-01-17T22:58:49.517927+0000","last_became_peered":"2024-01-17T22:58:49.517927+0000","last_unstale":"2024-01-18T00:47:33.778632+0000","last_undegraded":"2024-01-18T00:47:33.778632+0000","last_fullsized":"2024-01-18T00:47:33.778632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'173","last_scrub_stamp":"2024-01-18T00:47:33.778547+0000","last_deep_scrub":"28'173","last_deep_scrub_stamp":"2024-01-18T00:47:33.778547+0000","last_clean_scrub_stamp":"2024-01-18T00:47:33.778547+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:25:01.782585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'173","reported_seq":245,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:29.836229+0000","last_change":"2024-01-18T00:47:29.836229+0000","last_active":"2024-01-18T00:47:29.836229+0000","last_peered":"2024-01-18T00:47:29.836229+0000","last_clean":"2024-01-18T00:47:29.836229+0000","last_became_active":"2024-01-17T22:58:49.363804+0000","last_became_peered":"2024-01-17T22:58:49.363804+0000","last_unstale":"2024-01-18T00:47:29.836229+0000","last_undegraded":"2024-01-18T00:47:29.836229+0000","last_fullsized":"2024-01-18T00:47:29.836229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'173","last_scrub_stamp":"2024-01-18T00:47:29.836148+0000","last_deep_scrub":"28'173","last_deep_scrub_stamp":"2024-01-18T00:47:29.836148+0000","last_clean_scrub_stamp":"2024-01-18T00:47:29.836148+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:30:28.917892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"28'206","reported_seq":278,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:27.855299+0000","last_change":"2024-01-18T00:47:27.855299+0000","last_active":"2024-01-18T00:47:27.855299+0000","last_peered":"2024-01-18T00:47:27.855299+0000","last_clean":"2024-01-18T00:47:27.855299+0000","last_became_active":"2024-01-17T22:58:49.352513+0000","last_became_peered":"2024-01-17T22:58:49.352513+0000","last_unstale":"2024-01-18T00:47:27.855299+0000","last_undegraded":"2024-01-18T00:47:27.855299+0000","last_fullsized":"2024-01-18T00:47:27.855299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'206","last_scrub_stamp":"2024-01-18T00:47:27.855213+0000","last_deep_scrub":"28'206","last_deep_scrub_stamp":"2024-01-18T00:47:27.855213+0000","last_clean_scrub_stamp":"2024-01-18T00:47:27.855213+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:04:51.982726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'213","reported_seq":283,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:27.872566+0000","last_change":"2024-01-18T00:47:27.872605+0000","last_active":"2024-01-18T00:47:27.872566+0000","last_peered":"2024-01-18T00:47:27.872566+0000","last_clean":"2024-01-18T00:47:27.872566+0000","last_became_active":"2024-01-17T22:58:49.518646+0000","last_became_peered":"2024-01-17T22:58:49.518646+0000","last_unstale":"2024-01-18T00:47:27.872566+0000","last_undegraded":"2024-01-18T00:47:27.872566+0000","last_fullsized":"2024-01-18T00:47:27.872566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'213","last_scrub_stamp":"2024-01-18T00:47:27.872498+0000","last_deep_scrub":"28'213","last_deep_scrub_stamp":"2024-01-18T00:47:27.872498+0000","last_clean_scrub_stamp":"2024-01-18T00:47:27.872498+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:41:28.845468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'192","reported_seq":262,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:34.824034+0000","last_change":"2024-01-18T00:47:34.824068+0000","last_active":"2024-01-18T00:47:34.824034+0000","last_peered":"2024-01-18T00:47:34.824034+0000","last_clean":"2024-01-18T00:47:34.824034+0000","last_became_active":"2024-01-17T22:58:49.349021+0000","last_became_peered":"2024-01-17T22:58:49.349021+0000","last_unstale":"2024-01-18T00:47:34.824034+0000","last_undegraded":"2024-01-18T00:47:34.824034+0000","last_fullsized":"2024-01-18T00:47:34.824034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'192","last_scrub_stamp":"2024-01-18T00:47:34.823940+0000","last_deep_scrub":"28'192","last_deep_scrub_stamp":"2024-01-18T00:47:34.823940+0000","last_clean_scrub_stamp":"2024-01-18T00:47:34.823940+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:42:44.005567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'204","reported_seq":274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:32.815241+0000","last_change":"2024-01-18T00:47:32.815262+0000","last_active":"2024-01-18T00:47:32.815241+0000","last_peered":"2024-01-18T00:47:32.815241+0000","last_clean":"2024-01-18T00:47:32.815241+0000","last_became_active":"2024-01-17T22:58:49.414856+0000","last_became_peered":"2024-01-17T22:58:49.414856+0000","last_unstale":"2024-01-18T00:47:32.815241+0000","last_undegraded":"2024-01-18T00:47:32.815241+0000","last_fullsized":"2024-01-18T00:47:32.815241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'204","last_scrub_stamp":"2024-01-18T00:47:32.815166+0000","last_deep_scrub":"28'204","last_deep_scrub_stamp":"2024-01-18T00:47:32.815166+0000","last_clean_scrub_stamp":"2024-01-18T00:47:32.815166+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:01:21.065765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'190","reported_seq":259,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:29.743841+0000","last_change":"2024-01-18T00:47:29.743880+0000","last_active":"2024-01-18T00:47:29.743841+0000","last_peered":"2024-01-18T00:47:29.743841+0000","last_clean":"2024-01-18T00:47:29.743841+0000","last_became_active":"2024-01-17T22:58:49.414446+0000","last_became_peered":"2024-01-17T22:58:49.414446+0000","last_unstale":"2024-01-18T00:47:29.743841+0000","last_undegraded":"2024-01-18T00:47:29.743841+0000","last_fullsized":"2024-01-18T00:47:29.743841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'190","last_scrub_stamp":"2024-01-18T00:47:29.743761+0000","last_deep_scrub":"28'190","last_deep_scrub_stamp":"2024-01-18T00:47:29.743761+0000","last_clean_scrub_stamp":"2024-01-18T00:47:29.743761+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:18:05.701588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'210","reported_seq":280,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:20.955089+0000","last_change":"2024-01-18T00:47:20.955108+0000","last_active":"2024-01-18T00:47:20.955089+0000","last_peered":"2024-01-18T00:47:20.955089+0000","last_clean":"2024-01-18T00:47:20.955089+0000","last_became_active":"2024-01-17T22:58:49.357085+0000","last_became_peered":"2024-01-17T22:58:49.357085+0000","last_unstale":"2024-01-18T00:47:20.955089+0000","last_undegraded":"2024-01-18T00:47:20.955089+0000","last_fullsized":"2024-01-18T00:47:20.955089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'210","last_scrub_stamp":"2024-01-18T00:47:20.955022+0000","last_deep_scrub":"28'210","last_deep_scrub_stamp":"2024-01-18T00:47:20.955022+0000","last_clean_scrub_stamp":"2024-01-18T00:47:20.955022+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:48:26.904595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'196","reported_seq":276,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:28.699864+0000","last_change":"2024-01-18T00:47:28.699884+0000","last_active":"2024-01-18T00:47:28.699864+0000","last_peered":"2024-01-18T00:47:28.699864+0000","last_clean":"2024-01-18T00:47:28.699864+0000","last_became_active":"2024-01-17T22:58:49.414490+0000","last_became_peered":"2024-01-17T22:58:49.414490+0000","last_unstale":"2024-01-18T00:47:28.699864+0000","last_undegraded":"2024-01-18T00:47:28.699864+0000","last_fullsized":"2024-01-18T00:47:28.699864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'196","last_scrub_stamp":"2024-01-18T00:47:28.699802+0000","last_deep_scrub":"28'196","last_deep_scrub_stamp":"2024-01-18T00:47:28.699802+0000","last_clean_scrub_stamp":"2024-01-18T00:47:28.699802+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:05:47.555078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'198","reported_seq":277,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:38.803039+0000","last_change":"2024-01-18T00:47:38.803101+0000","last_active":"2024-01-18T00:47:38.803039+0000","last_peered":"2024-01-18T00:47:38.803039+0000","last_clean":"2024-01-18T00:47:38.803039+0000","last_became_active":"2024-01-17T22:58:49.412382+0000","last_became_peered":"2024-01-17T22:58:49.412382+0000","last_unstale":"2024-01-18T00:47:38.803039+0000","last_undegraded":"2024-01-18T00:47:38.803039+0000","last_fullsized":"2024-01-18T00:47:38.803039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'198","last_scrub_stamp":"2024-01-18T00:47:38.802879+0000","last_deep_scrub":"28'198","last_deep_scrub_stamp":"2024-01-18T00:47:38.802879+0000","last_clean_scrub_stamp":"2024-01-18T00:47:38.802879+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:48:20.121292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'201","reported_seq":280,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:26.839873+0000","last_change":"2024-01-18T00:47:26.839930+0000","last_active":"2024-01-18T00:47:26.839873+0000","last_peered":"2024-01-18T00:47:26.839873+0000","last_clean":"2024-01-18T00:47:26.839873+0000","last_became_active":"2024-01-17T22:58:49.367979+0000","last_became_peered":"2024-01-17T22:58:49.367979+0000","last_unstale":"2024-01-18T00:47:26.839873+0000","last_undegraded":"2024-01-18T00:47:26.839873+0000","last_fullsized":"2024-01-18T00:47:26.839873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'201","last_scrub_stamp":"2024-01-18T00:47:26.839715+0000","last_deep_scrub":"28'201","last_deep_scrub_stamp":"2024-01-18T00:47:26.839715+0000","last_clean_scrub_stamp":"2024-01-18T00:47:26.839715+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:00:10.991750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'197","reported_seq":276,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:30.812718+0000","last_change":"2024-01-18T00:47:30.812770+0000","last_active":"2024-01-18T00:47:30.812718+0000","last_peered":"2024-01-18T00:47:30.812718+0000","last_clean":"2024-01-18T00:47:30.812718+0000","last_became_active":"2024-01-17T22:58:49.363810+0000","last_became_peered":"2024-01-17T22:58:49.363810+0000","last_unstale":"2024-01-18T00:47:30.812718+0000","last_undegraded":"2024-01-18T00:47:30.812718+0000","last_fullsized":"2024-01-18T00:47:30.812718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'197","last_scrub_stamp":"2024-01-18T00:47:30.812647+0000","last_deep_scrub":"28'197","last_deep_scrub_stamp":"2024-01-18T00:47:30.812647+0000","last_clean_scrub_stamp":"2024-01-18T00:47:30.812647+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:59:54.390543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1120,"num_read_kb":3534792,"num_write":24383,"num_write_kb":4330508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24895,"ondisk_log_size":24895,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13088,"ondisk_log_size":13088,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":198335987,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":1788,"num_read_kb":2847,"num_write":22493,"num_write_kb":206433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":181755904,"data_stored":396671974,"data_compressed":51062148,"data_compressed_allocated":68689920,"data_compressed_original":283754496,"omap_allocated":0,"internal_metadata":0},"log_size":22083,"ondisk_log_size":22083,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":62458,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510758,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124208,"kb_used_data":12584,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94247632,"statfs":{"total":96636764160,"available":96509575168,"internally_reserved":0,"allocated":12886016,"data_stored":31038270,"data_compressed":4325598,"data_compressed_allocated":5689344,"data_compressed_original":24039424,"omap_allocated":1590,"internal_metadata":114293194},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:44 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.86699999999999999,"15min":0.876},"min":{"1min":0.497,"5min":0.42899999999999999,"15min":0.35399999999999998},"max":{"1min":1.3680000000000001,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.86099999999999999,"15min":0.85099999999999998},"min":{"1min":0.52800000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.292,"5min":1.3240000000000001,"15min":1.603},"last":1.046}]},{"osd":1,"last update":"Thu Jan 18 00:47:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.90900000000000003,"15min":0.90400000000000003},"min":{"1min":0.59999999999999998,"5min":0.46500000000000002,"15min":0.41499999999999998},"max":{"1min":1.1919999999999999,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.90500000000000003,"15min":0.89400000000000002},"min":{"1min":0.57899999999999996,"5min":0.44600000000000001,"15min":0.28899999999999998},"max":{"1min":1.369,"5min":1.5960000000000001,"15min":1.722},"last":1.1339999999999999}]},{"osd":2,"last update":"Thu Jan 18 00:47:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.81799999999999995,"15min":0.81299999999999994},"min":{"1min":0.61399999999999999,"5min":0.45400000000000001,"15min":0.441},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.095},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.026,"15min":0.97799999999999998},"min":{"1min":0.58999999999999997,"5min":0.50600000000000001,"15min":0.45800000000000002},"max":{"1min":1.6950000000000001,"5min":2.7370000000000001,"15min":2.7370000000000001},"last":0.89800000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:47:44 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.91600000000000004,"15min":0.90600000000000003},"min":{"1min":0.627,"5min":0.54000000000000004,"15min":0.48099999999999998},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.014,"5min":1.048,"15min":1.0389999999999999},"min":{"1min":0.73599999999999999,"5min":0.54700000000000004,"15min":0.5},"max":{"1min":1.607,"5min":2.806,"15min":2.806},"last":1.1699999999999999}]},{"osd":4,"last update":"Thu Jan 18 00:47:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.02,"15min":1.0169999999999999},"min":{"1min":0.72399999999999998,"5min":0.40100000000000002,"15min":0.32900000000000001},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.123,"5min":1.0289999999999999,"15min":1.0309999999999999},"min":{"1min":0.67900000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.238}]},{"osd":5,"last update":"Thu Jan 18 00:47:44 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.1619999999999999,"15min":1.1559999999999999},"min":{"1min":0.64200000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.8460000000000001,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.1439999999999999,"15min":1.161},"min":{"1min":0.65200000000000002,"5min":0.51400000000000001,"15min":0.435},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.2769999999999999}]},{"osd":6,"last update":"Thu Jan 18 00:47:44 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.1910000000000001,"15min":1.194},"min":{"1min":0.622,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.016,"5min":2.016,"15min":2.0209999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.25,"5min":1.1659999999999999,"15min":1.1679999999999999},"min":{"1min":0.94399999999999995,"5min":0.53000000000000003,"15min":0.50900000000000001},"max":{"1min":2.0449999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.3420000000000001}]}]},{"osd":6,"up_from":15,"seq":64424510757,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83092,"kb_used_data":15820,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94288748,"statfs":{"total":96636764160,"available":96551677952,"internally_reserved":0,"allocated":16199680,"data_stored":33676965,"data_compressed":4280237,"data_compressed_allocated":5771264,"data_compressed_original":23433216,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85999999999999999,"15min":0.84799999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.44},"max":{"1min":1.2849999999999999,"5min":1.5580000000000001,"15min":1.788},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.878,"15min":0.84899999999999998},"min":{"1min":0.52500000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.83699999999999997,"15min":0.82199999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.45800000000000002},"max":{"1min":1.167,"5min":1.478,"15min":1.8540000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.018,"5min":0.93200000000000005,"15min":0.89500000000000002},"min":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.42999999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.641},"last":1.083}]},{"osd":2,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.95199999999999996,"15min":0.94099999999999995},"min":{"1min":0.59799999999999998,"5min":0.54300000000000004,"15min":0.496},"max":{"1min":1.7030000000000001,"5min":1.766,"15min":1.766},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.96199999999999997,"15min":0.94399999999999995},"min":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.48499999999999999},"max":{"1min":1.4750000000000001,"5min":1.5629999999999999,"15min":2.1619999999999999},"last":1.022}]},{"osd":3,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.012,"15min":0.98399999999999999},"min":{"1min":0.76400000000000001,"5min":0.622,"15min":0.53900000000000003},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.236},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.997,"15min":0.93899999999999995},"min":{"1min":0.67600000000000005,"5min":0.66900000000000004,"15min":0.52300000000000002},"max":{"1min":1.1870000000000001,"5min":1.633,"15min":1.98},"last":1.0600000000000001}]},{"osd":4,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.139,"15min":1.081},"min":{"1min":0.627,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":3.4969999999999999,"5min":3.4969999999999999,"15min":3.4969999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.179,"15min":1.1359999999999999},"min":{"1min":0.66000000000000003,"5min":0.52700000000000002,"15min":0.46000000000000002},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":0.90200000000000002}]},{"osd":5,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.145,"15min":1.079},"min":{"1min":0.56699999999999995,"5min":0.49099999999999999,"15min":0.47499999999999998},"max":{"1min":3.8490000000000002,"5min":3.8490000000000002,"15min":3.8490000000000002},"last":1.113},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2230000000000001,"15min":1.177},"min":{"1min":0.78300000000000003,"5min":0.60999999999999999,"15min":0.54200000000000004},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":1.1519999999999999}]},{"osd":7,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.284,"15min":1.2250000000000001},"min":{"1min":0.75700000000000001,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":4.2910000000000004,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.254,"15min":1.2},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.56799999999999995},"max":{"1min":1.534,"5min":2.0649999999999999,"15min":2.129},"last":1.1779999999999999}]}]},{"osd":4,"up_from":15,"seq":64424510757,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121324,"kb_used_data":22180,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94250516,"statfs":{"total":96636764160,"available":96512528384,"internally_reserved":0,"allocated":22712320,"data_stored":50454822,"data_compressed":6935579,"data_compressed_allocated":9256960,"data_compressed_original":37212160,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86299999999999999,"15min":0.84499999999999997},"min":{"1min":0.52800000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.6879999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.83499999999999996,"15min":0.84199999999999997},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.42799999999999999},"max":{"1min":1.464,"5min":1.464,"15min":2.2410000000000001},"last":1.0529999999999999}]},{"osd":1,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.90500000000000003,"15min":0.89000000000000001},"min":{"1min":0.63,"5min":0.47399999999999998,"15min":0.36199999999999999},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.89200000000000002,"15min":0.90700000000000003},"min":{"1min":0.499,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4179999999999999,"5min":2.097,"15min":2.097},"last":1.016}]},{"osd":2,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.88200000000000001,"15min":0.91200000000000003},"min":{"1min":0.68700000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.96499999999999997,"15min":0.95799999999999996},"min":{"1min":0.65000000000000002,"5min":0.55500000000000005,"15min":0.34300000000000003},"max":{"1min":1.4510000000000001,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.0760000000000001}]},{"osd":3,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.90500000000000003,"15min":0.93200000000000005},"min":{"1min":0.54700000000000004,"5min":0.54000000000000004,"15min":0.41099999999999998},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":2.335},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.0800000000000001,"5min":0.98899999999999999,"15min":1.004},"min":{"1min":0.67300000000000004,"5min":0.60799999999999998,"15min":0.45300000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.177}]},{"osd":5,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.044,"15min":1.0840000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.35999999999999999},"max":{"1min":1.518,"5min":2.403,"15min":2.9249999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.141,"5min":1.04,"15min":1.075},"min":{"1min":0.66700000000000004,"5min":0.55200000000000005,"15min":0.38200000000000001},"max":{"1min":1.7909999999999999,"5min":1.804,"15min":2.4289999999999998},"last":0.95399999999999996}]},{"osd":6,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1020000000000001,"15min":1.1339999999999999},"min":{"1min":0.57699999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.1110000000000002,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.181,"15min":1.202},"min":{"1min":0.56499999999999995,"5min":0.45800000000000002,"15min":0.38100000000000001},"max":{"1min":1.7989999999999999,"5min":2.4740000000000002,"15min":3.101},"last":0.78300000000000003}]},{"osd":7,"last update":"Thu Jan 18 00:46:57 2024","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.1639999999999999,"15min":1.1830000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.841,"5min":4.25,"15min":4.25},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2110000000000001,"15min":1.2549999999999999},"min":{"1min":0.59199999999999997,"5min":0.503,"15min":0.40200000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.5110000000000001},"last":1.0940000000000001}]}]},{"osd":3,"up_from":15,"seq":64424510757,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160572,"kb_used_data":39220,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94211268,"statfs":{"total":96636764160,"available":96472338432,"internally_reserved":0,"allocated":40161280,"data_stored":87845266,"data_compressed":11483169,"data_compressed_allocated":15335424,"data_compressed_original":63209472,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44,"15min":0.42899999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.23000000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45800000000000002,"15min":0.46300000000000002},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.25600000000000001},"max":{"1min":0.58299999999999996,"5min":0.72799999999999998,"15min":0.753},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.29399999999999998,"5min":0.28100000000000003,"15min":0.27500000000000002},"max":{"1min":0.61499999999999999,"5min":0.751,"15min":0.78000000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.502,"15min":0.496},"min":{"1min":0.318,"5min":0.313,"15min":0.27300000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.314},"max":{"1min":0.66700000000000004,"5min":0.79700000000000004,"15min":0.84299999999999997},"last":0.377},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.39000000000000001,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.68400000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.42099999999999999},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78300000000000003,"15min":0.76500000000000001},"min":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.105,"5min":1.325,"15min":1.325},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.76800000000000002},"min":{"1min":0.54200000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.1160000000000001,"5min":1.1559999999999999,"15min":1.1970000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.754},"min":{"1min":0.52400000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0269999999999999,"5min":1.1539999999999999,"15min":1.2150000000000001},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82299999999999995,"15min":0.80900000000000005},"min":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.48899999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2150000000000001},"last":0.85499999999999998}]},{"osd":7,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.80300000000000005,"15min":0.79900000000000004},"min":{"1min":0.51100000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.24,"5min":1.248,"15min":1.337},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.83399999999999996,"15min":0.82199999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.42099999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.78800000000000003}]}]},{"osd":2,"up_from":15,"seq":64424510757,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94904,"kb_used_data":13808,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94276936,"statfs":{"total":96636764160,"available":96539582464,"internally_reserved":0,"allocated":14139392,"data_stored":33676072,"data_compressed":4580308,"data_compressed_allocated":5976064,"data_compressed_original":25698304,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42099999999999999,"15min":0.432},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.24299999999999999},"max":{"1min":0.58599999999999997,"5min":0.65300000000000002,"15min":1.095},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26300000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":1.355},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.47599999999999998},"min":{"1min":0.36299999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64400000000000002,"5min":0.97699999999999998,"15min":1.026},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.503},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.308},"max":{"1min":0.67400000000000004,"5min":1.032,"15min":1.194},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.28599999999999998},"max":{"1min":0.754,"5min":0.77000000000000002,"15min":0.995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53800000000000003},"min":{"1min":0.36099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70499999999999996,"5min":0.90500000000000003,"15min":0.96999999999999997},"last":0.505}]},{"osd":4,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.75,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.46300000000000002,"15min":0.44700000000000001},"max":{"1min":1.014,"5min":1.155,"15min":1.502},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72299999999999998,"15min":0.752},"min":{"1min":0.46899999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.96899999999999997,"5min":1.0660000000000001,"15min":1.282},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.751,"15min":0.753},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":1.099,"15min":1.1479999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.79000000000000004},"min":{"1min":0.61299999999999999,"5min":0.48899999999999999,"15min":0.48099999999999998},"max":{"1min":1.0649999999999999,"5min":4.343,"15min":4.343},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.46600000000000003},"max":{"1min":0.95899999999999996,"5min":1.075,"15min":1.528},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79900000000000004,"15min":0.81200000000000006},"min":{"1min":0.52900000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1379999999999999,"5min":1.1599999999999999,"15min":3.9159999999999999},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80400000000000005,"15min":0.80200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.499},"max":{"1min":1.1040000000000001,"5min":1.248,"15min":1.248},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.54500000000000004,"15min":0.51300000000000001},"max":{"1min":1.1160000000000001,"5min":3.9060000000000001,"15min":5.7370000000000001},"last":0.72299999999999998}]}]},{"osd":1,"up_from":15,"seq":64424510757,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108440,"kb_used_data":19024,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94263400,"statfs":{"total":96636764160,"available":96525721600,"internally_reserved":0,"allocated":19480576,"data_stored":38460198,"data_compressed":4277353,"data_compressed_allocated":5976064,"data_compressed_original":25141248,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.46400000000000002,"15min":0.439},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.498},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.39000000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69899999999999995,"5min":0.70299999999999996,"15min":0.73099999999999998},"last":0.376}]},{"osd":2,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.47299999999999998,"15min":0.46000000000000002},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.27800000000000002},"max":{"1min":0.629,"5min":0.70399999999999996,"15min":0.73099999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51700000000000002,"15min":0.51000000000000001},"min":{"1min":0.42199999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71699999999999997,"5min":0.77400000000000002,"15min":0.85099999999999998},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.55000000000000004},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.36799999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.79900000000000004},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.71599999999999997},"min":{"1min":0.53500000000000003,"5min":0.442,"15min":0.38700000000000001},"max":{"1min":0.89600000000000002,"5min":1.0549999999999999,"15min":1.103},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77200000000000002,"15min":0.78100000000000003},"min":{"1min":0.60299999999999998,"5min":0.47099999999999997,"15min":0.439},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.5700000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76200000000000001,"15min":0.76000000000000001},"min":{"1min":0.53000000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1299999999999999,"5min":1.1439999999999999,"15min":2.8069999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79000000000000004,"15min":0.77600000000000002},"min":{"1min":0.58599999999999997,"5min":0.46400000000000002,"15min":0.45400000000000001},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.27},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.79400000000000004},"min":{"1min":0.64600000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.0660000000000001,"5min":1.242,"15min":1.395},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.73699999999999999,"5min":0.5,"15min":0.46400000000000002},"max":{"1min":0.996,"5min":1.1279999999999999,"15min":1.1830000000000001},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.85099999999999998,"15min":0.83699999999999997},"min":{"1min":0.76900000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":3.9009999999999998},"last":0.627},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.622,"5min":0.55700000000000005,"15min":0.50800000000000001},"max":{"1min":1.1379999999999999,"5min":1.2270000000000001,"15min":1.3999999999999999},"last":0.81000000000000005}]}]},{"osd":0,"up_from":14,"seq":60129543460,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143120,"kb_used_data":31496,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94228720,"statfs":{"total":96636764160,"available":96490209280,"internally_reserved":0,"allocated":32251904,"data_stored":71068140,"data_compressed":8958305,"data_compressed_allocated":12132352,"data_compressed_original":51142656,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 18 00:47:28 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.435,"15min":0.42799999999999999},"min":{"1min":0.28899999999999998,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.56000000000000005,"5min":0.66600000000000004,"15min":0.68400000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.47099999999999997,"15min":0.47199999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.505}]},{"osd":2,"last update":"Thu Jan 18 00:47:28 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.33700000000000002,"5min":0.32800000000000001,"15min":0.28199999999999997},"max":{"1min":0.67000000000000004,"5min":0.82899999999999996,"15min":0.84999999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.34300000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67000000000000004,"5min":0.67900000000000005,"15min":0.80200000000000005},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 18 00:47:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48399999999999999,"15min":0.48799999999999999},"min":{"1min":0.33200000000000002,"5min":0.308,"15min":0.30499999999999999},"max":{"1min":0.60999999999999999,"5min":0.73999999999999999,"15min":0.81799999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.53600000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.377},"max":{"1min":0.63500000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 18 00:47:28 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.51800000000000002,"5min":0.46500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0249999999999999,"5min":1.3620000000000001,"15min":2.1779999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.74199999999999999,"15min":0.73699999999999999},"min":{"1min":0.52800000000000002,"5min":0.505,"15min":0.44400000000000001},"max":{"1min":0.93400000000000005,"5min":1.159,"15min":1.159},"last":0.95499999999999996}]},{"osd":5,"last update":"Thu Jan 18 00:47:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.754,"15min":0.76500000000000001},"min":{"1min":0.57499999999999996,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97099999999999997,"5min":1.423,"15min":1.423},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.75900000000000001,"15min":0.753},"min":{"1min":0.61499999999999999,"5min":0.47599999999999998,"15min":0.42399999999999999},"max":{"1min":0.95899999999999996,"5min":1.623,"15min":1.623},"last":0.98899999999999999}]},{"osd":6,"last update":"Thu Jan 18 00:47:28 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.84599999999999997,"15min":0.82599999999999996},"min":{"1min":0.61699999999999999,"5min":0.52600000000000002,"15min":0.49099999999999999},"max":{"1min":1.181,"5min":1.222,"15min":1.222},"last":1.131},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84799999999999998,"15min":0.82699999999999996},"min":{"1min":0.57899999999999996,"5min":0.49099999999999999,"15min":0.46200000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.29},"last":1.1679999999999999}]},{"osd":7,"last update":"Thu Jan 18 00:47:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":0.81899999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.44400000000000001},"max":{"1min":1.077,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.86299999999999999,"15min":0.86099999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.47899999999999998},"max":{"1min":1.044,"5min":1.609,"15min":1.609},"last":1.0669999999999999}]}]},{"osd":5,"up_from":13,"seq":55834576166,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":129092,"kb_used_data":25788,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94242748,"statfs":{"total":96636764160,"available":96504573952,"internally_reserved":0,"allocated":26406912,"data_stored":52600449,"data_compressed":6284057,"data_compressed_allocated":8634368,"data_compressed_original":35024896,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.83099999999999996,"15min":0.86699999999999999},"min":{"1min":0.48299999999999998,"5min":0.42799999999999999,"15min":0.36699999999999999},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.133},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.85499999999999998,"15min":0.85899999999999999},"min":{"1min":0.57799999999999996,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.7569999999999999},"last":1.2729999999999999}]},{"osd":1,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.90100000000000002,"15min":0.91000000000000003},"min":{"1min":0.53600000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.90800000000000003,"15min":0.91300000000000003},"min":{"1min":0.67300000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.3169999999999999,"5min":1.393,"15min":1.5049999999999999},"last":1.1830000000000001}]},{"osd":2,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.48599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.97999999999999998,"15min":0.98499999999999999},"min":{"1min":0.67800000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.7040000000000002,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.006}]},{"osd":3,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0009999999999999,"15min":0.997},"min":{"1min":0.61899999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4670000000000001,"5min":1.613,"15min":1.633},"last":1.081},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93899999999999995,"15min":0.94799999999999995},"min":{"1min":0.55500000000000005,"5min":0.41099999999999998,"15min":0.40500000000000003},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.9430000000000001},"last":1.0529999999999999}]},{"osd":4,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.1040000000000001,"15min":1.0960000000000001},"min":{"1min":0.84399999999999997,"5min":0.52400000000000002,"15min":0.46100000000000002},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.238,"5min":1.1619999999999999,"15min":1.133},"min":{"1min":0.67000000000000004,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.776,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.3819999999999999}]},{"osd":6,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.103,"15min":1.0740000000000001},"min":{"1min":0.70499999999999996,"5min":0.55100000000000005,"15min":0.51800000000000002},"max":{"1min":1.859,"5min":1.859,"15min":1.8640000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.2030000000000001,"15min":1.1930000000000001},"min":{"1min":0.878,"5min":0.70299999999999996,"15min":0.46999999999999997},"max":{"1min":2.6600000000000001,"5min":2.6600000000000001,"15min":2.6600000000000001},"last":1.24}]},{"osd":7,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.2649999999999999,"15min":1.2370000000000001},"min":{"1min":0.999,"5min":0.65900000000000003,"15min":0.57799999999999996},"max":{"1min":1.6779999999999999,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.337},{"interface":"front","average":{"1min":1.246,"5min":1.234,"15min":1.2150000000000001},"min":{"1min":0.72399999999999998,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.0640000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.212}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31229,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31229,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31956992,"data_stored":70947206,"data_compressed":8958305,"data_compressed_allocated":12132352,"data_compressed_original":51142656,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19124224,"data_stored":37748896,"data_compressed":4246124,"data_compressed_allocated":5935104,"data_compressed_original":24567808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13844480,"data_stored":33555138,"data_compressed":4580308,"data_compressed_allocated":5976064,"data_compressed_original":25698304,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39866368,"data_stored":87724332,"data_compressed":11483169,"data_compressed_allocated":15335424,"data_compressed_original":63209472,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22417408,"data_stored":50333888,"data_compressed":6935579,"data_compressed_allocated":9256960,"data_compressed_original":37212160,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26050560,"data_stored":51889147,"data_compressed":6252828,"data_compressed_allocated":8593408,"data_compressed_original":34451456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15904768,"data_stored":33556031,"data_compressed":4280237,"data_compressed_allocated":5771264,"data_compressed_original":23433216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12591104,"data_stored":30917336,"data_compressed":4325598,"data_compressed_allocated":5689344,"data_compressed_original":24039424,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-18T00:47:48.559 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:48.560 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:48.560 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-01-17T22:58:54.503705+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=58, tm_sec=54, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=47, tm_sec=18, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:47:48.561 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-18T00:48:08.562 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-18T00:48:08.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.702+0000 7f347f400640 1 Processor -- start 2024-01-18T00:48:08.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.702+0000 7f347f400640 1 -- start start 2024-01-18T00:48:08.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.702+0000 7f347f400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3478153970 0x7f347806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:08.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.702+0000 7f347f400640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f347806f0a0 0x7f347815d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:08.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.702+0000 7f347f400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34780c1e70 con 0x7f347815d900 2024-01-18T00:48:08.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.702+0000 7f347f400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34781597a0 con 0x7f3478153970 2024-01-18T00:48:08.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.702+0000 7f347f400640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f347815dd30 con 0x7f347806f0a0 2024-01-18T00:48:08.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.702+0000 7f347ca00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3478153970 0x7f347806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:08.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.706+0000 7f347ca00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3478153970 0x7f347806eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47122/0 (socket says 172.21.15.161:47122) 2024-01-18T00:48:08.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.706+0000 7f347ca00640 1 -- 172.21.15.161:0/1785401310 learned_addr learned my addr 172.21.15.161:0/1785401310 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:48:08.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.706+0000 7f3477e00640 1 --2- 172.21.15.161:0/1785401310 >> v2:172.21.15.190:3300/0 conn(0x7f347806f0a0 0x7f347815d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:08.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.706+0000 7f347ca00640 1 -- 172.21.15.161:0/1785401310 >> v2:172.21.15.190:3300/0 conn(0x7f347806f0a0 msgr2=0x7f347815d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:08.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.706+0000 7f347ca00640 1 --2- 172.21.15.161:0/1785401310 >> v2:172.21.15.190:3300/0 conn(0x7f347806f0a0 0x7f347815d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:08.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.706+0000 7f347ca00640 1 -- 172.21.15.161:0/1785401310 >> v1:172.21.15.161:6789/0 conn(0x7f347815d900 legacy=0x7f34780c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:08.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.706+0000 7f347ca00640 1 -- 172.21.15.161:0/1785401310 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347806e960 con 0x7f3478153970 2024-01-18T00:48:08.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.710+0000 7f347ca00640 1 --2- 172.21.15.161:0/1785401310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3478153970 0x7f347806eb60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f34780cbf70 tx=0x7f346801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de878e89b149bdf server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.714+0000 7f3477400640 1 -- 172.21.15.161:0/1785401310 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34680a89b0 con 0x7f3478153970 2024-01-18T00:48:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.714+0000 7f3477400640 1 -- 172.21.15.161:0/1785401310 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34680a8b10 con 0x7f3478153970 2024-01-18T00:48:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.714+0000 7f3477400640 1 -- 172.21.15.161:0/1785401310 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34680a8ea0 con 0x7f3478153970 2024-01-18T00:48:08.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.714+0000 7f347f400640 1 -- 172.21.15.161:0/1785401310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3478153970 msgr2=0x7f347806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:08.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.714+0000 7f347f400640 1 --2- 172.21.15.161:0/1785401310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3478153970 0x7f347806eb60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f34780cbf70 tx=0x7f346801ecb0 comp rx=0 tx=0).stop 2024-01-18T00:48:08.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.714+0000 7f347f400640 1 -- 172.21.15.161:0/1785401310 shutdown_connections 2024-01-18T00:48:08.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.714+0000 7f347f400640 1 --2- 172.21.15.161:0/1785401310 >> v2:172.21.15.190:3300/0 conn(0x7f347806f0a0 0x7f347815d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:08.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.714+0000 7f347f400640 1 --2- 172.21.15.161:0/1785401310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3478153970 0x7f347806eb60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:08.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.714+0000 7f347f400640 1 -- 172.21.15.161:0/1785401310 >> 172.21.15.161:0/1785401310 conn(0x7f347806fd30 msgr2=0x7f3478070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:08.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.714+0000 7f347f400640 1 -- 172.21.15.161:0/1785401310 shutdown_connections 2024-01-18T00:48:08.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.714+0000 7f347f400640 1 -- 172.21.15.161:0/1785401310 wait complete. 2024-01-18T00:48:08.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.718+0000 7f347f400640 1 Processor -- start 2024-01-18T00:48:08.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.718+0000 7f347f400640 1 -- start start 2024-01-18T00:48:08.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.718+0000 7f347f400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f347806f0a0 0x7f34781f2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:08.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.718+0000 7f347f400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3478153970 0x7f3478158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:08.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.718+0000 7f347f400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f347815d900 0x7f34781457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:08.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.718+0000 7f347f400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347815c4f0 con 0x7f3478153970 2024-01-18T00:48:08.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.718+0000 7f347f400640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347815b020 con 0x7f347806f0a0 2024-01-18T00:48:08.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.718+0000 7f347f400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347815b300 con 0x7f347815d900 2024-01-18T00:48:08.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.718+0000 7f3477e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3478153970 0x7f3478158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:08.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.718+0000 7f3477e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3478153970 0x7f3478158ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47124/0 (socket says 172.21.15.161:47124) 2024-01-18T00:48:08.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.718+0000 7f3477e00640 1 -- 172.21.15.161:0/573625549 learned_addr learned my addr 172.21.15.161:0/573625549 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:48:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.722+0000 7f347d400640 1 --2- 172.21.15.161:0/573625549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f347815d900 0x7f34781457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.722+0000 7f347ca00640 1 --2- 172.21.15.161:0/573625549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f347806f0a0 0x7f34781f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:08.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.722+0000 7f3477e00640 1 -- 172.21.15.161:0/573625549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f347815d900 msgr2=0x7f34781457e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:08.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.722+0000 7f3477e00640 1 --2- 172.21.15.161:0/573625549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f347815d900 0x7f34781457e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:08.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.722+0000 7f3477e00640 1 -- 172.21.15.161:0/573625549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f347806f0a0 msgr2=0x7f34781f2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:08.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.722+0000 7f3477e00640 1 --2- 172.21.15.161:0/573625549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f347806f0a0 0x7f34781f2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:08.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.722+0000 7f3477e00640 1 -- 172.21.15.161:0/573625549 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34680094d0 con 0x7f3478153970 2024-01-18T00:48:08.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.726+0000 7f3477e00640 1 --2- 172.21.15.161:0/573625549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3478153970 0x7f3478158ca0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f346000e870 tx=0x7f346000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:08.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.730+0000 7f3474c00640 1 -- 172.21.15.161:0/573625549 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460009530 con 0x7f3478153970 2024-01-18T00:48:08.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.730+0000 7f347f400640 1 -- 172.21.15.161:0/573625549 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f347815b5e0 con 0x7f3478153970 2024-01-18T00:48:08.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.730+0000 7f347f400640 1 -- 172.21.15.161:0/573625549 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f347815c180 con 0x7f3478153970 2024-01-18T00:48:08.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.730+0000 7f3474c00640 1 -- 172.21.15.161:0/573625549 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34600059a0 con 0x7f3478153970 2024-01-18T00:48:08.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.730+0000 7f3474c00640 1 -- 172.21.15.161:0/573625549 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460005d10 con 0x7f3478153970 2024-01-18T00:48:08.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.730+0000 7f347f400640 1 -- 172.21.15.161:0/573625549 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34480052a0 con 0x7f3478153970 2024-01-18T00:48:08.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.970+0000 7f3474c00640 1 -- 172.21.15.161:0/573625549 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f346000c940 con 0x7f3478153970 2024-01-18T00:48:08.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.970+0000 7f3474c00640 1 --2- 172.21.15.161:0/573625549 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3450066840 0x7f3450068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:08.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.970+0000 7f347ca00640 1 --2- 172.21.15.161:0/573625549 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3450066840 0x7f3450068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:08.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.970+0000 7f347ca00640 1 --2- 172.21.15.161:0/573625549 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3450066840 0x7f3450068d00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f34680b2000 tx=0x7f34680aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:08.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.982+0000 7f3474c00640 1 -- 172.21.15.161:0/573625549 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f3460055540 con 0x7f3478153970 2024-01-18T00:48:08.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:08.982+0000 7f3474c00640 1 -- 172.21.15.161:0/573625549 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f3460051880 con 0x7f3478153970 2024-01-18T00:48:09.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.138+0000 7f347f400640 1 -- 172.21.15.161:0/573625549 --> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3448000bd0 con 0x7f3450066840 2024-01-18T00:48:09.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.150+0000 7f3474c00640 1 -- 172.21.15.161:0/573625549 <== mgr.4110 v2:172.21.15.161:6800/272458188 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371997 (secure 0 0 0) 0x7f3448000bd0 con 0x7f3450066840 2024-01-18T00:48:09.154 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-18T00:48:09.156 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-01-18T00:48:09.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.154+0000 7f347f400640 1 -- 172.21.15.161:0/573625549 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3450066840 msgr2=0x7f3450068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:09.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.154+0000 7f347f400640 1 --2- 172.21.15.161:0/573625549 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3450066840 0x7f3450068d00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f34680b2000 tx=0x7f34680aa070 comp rx=0 tx=0).stop 2024-01-18T00:48:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.154+0000 7f347f400640 1 -- 172.21.15.161:0/573625549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3478153970 msgr2=0x7f3478158ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.154+0000 7f347f400640 1 --2- 172.21.15.161:0/573625549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3478153970 0x7f3478158ca0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f346000e870 tx=0x7f346000ed30 comp rx=0 tx=0).stop 2024-01-18T00:48:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.154+0000 7f347f400640 1 -- 172.21.15.161:0/573625549 shutdown_connections 2024-01-18T00:48:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.154+0000 7f347f400640 1 --2- 172.21.15.161:0/573625549 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f3450066840 0x7f3450068d00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.154+0000 7f347f400640 1 --2- 172.21.15.161:0/573625549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f347815d900 0x7f34781457e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.154+0000 7f347f400640 1 --2- 172.21.15.161:0/573625549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3478153970 0x7f3478158ca0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.154+0000 7f347f400640 1 --2- 172.21.15.161:0/573625549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f347806f0a0 0x7f34781f2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.154+0000 7f347f400640 1 -- 172.21.15.161:0/573625549 >> 172.21.15.161:0/573625549 conn(0x7f347806fd30 msgr2=0x7f34780c6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.154+0000 7f347f400640 1 -- 172.21.15.161:0/573625549 shutdown_connections 2024-01-18T00:48:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.154+0000 7f347f400640 1 -- 172.21.15.161:0/573625549 wait complete. 2024-01-18T00:48:09.175 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":3318,"stamp":"2024-01-18T00:48:08.488019+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":198926355,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":3054,"num_read_kb":3537766,"num_write":47085,"num_write_kb":4540403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60229,"ondisk_log_size":60229,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":964752,"kb_used_data":179920,"kb_used_omap":12,"kb_used_meta":784755,"kb_avail":754009968,"statfs":{"total":773094113280,"available":772106207232,"internally_reserved":0,"allocated":184238080,"data_stored":398820182,"data_compressed":51124606,"data_compressed_allocated":68771840,"data_compressed_original":284901376,"omap_allocated":12751,"internal_metadata":803589681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003324"},"pg_stats":[{"pgid":"2.1f","version":"28'407","reported_seq":487,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:26.295512+0000","last_change":"2024-01-18T00:47:26.295663+0000","last_active":"2024-01-18T00:47:26.295512+0000","last_peered":"2024-01-18T00:47:26.295512+0000","last_clean":"2024-01-18T00:47:26.295512+0000","last_became_active":"2024-01-17T22:58:48.327340+0000","last_became_peered":"2024-01-17T22:58:48.327340+0000","last_unstale":"2024-01-18T00:47:26.295512+0000","last_undegraded":"2024-01-18T00:47:26.295512+0000","last_fullsized":"2024-01-18T00:47:26.295512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'407","last_scrub_stamp":"2024-01-18T00:47:26.295297+0000","last_deep_scrub":"28'407","last_deep_scrub_stamp":"2024-01-18T00:47:26.295297+0000","last_clean_scrub_stamp":"2024-01-18T00:47:26.295297+0000","objects_scrubbed":6,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:31:44.800535+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":8350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'198","reported_seq":279,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:36.841000+0000","last_change":"2024-01-18T00:47:36.841058+0000","last_active":"2024-01-18T00:47:36.841000+0000","last_peered":"2024-01-18T00:47:36.841000+0000","last_clean":"2024-01-18T00:47:36.841000+0000","last_became_active":"2024-01-17T22:58:49.350812+0000","last_became_peered":"2024-01-17T22:58:49.350812+0000","last_unstale":"2024-01-18T00:47:36.841000+0000","last_undegraded":"2024-01-18T00:47:36.841000+0000","last_fullsized":"2024-01-18T00:47:36.841000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'198","last_scrub_stamp":"2024-01-18T00:47:36.840831+0000","last_deep_scrub":"28'198","last_deep_scrub_stamp":"2024-01-18T00:47:36.840831+0000","last_clean_scrub_stamp":"2024-01-18T00:47:36.840831+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:25:04.844870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'754","reported_seq":845,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:34.183273+0000","last_change":"2024-01-18T00:47:34.183336+0000","last_active":"2024-01-18T00:47:34.183273+0000","last_peered":"2024-01-18T00:47:34.183273+0000","last_clean":"2024-01-18T00:47:34.183273+0000","last_became_active":"2024-01-17T22:58:55.903167+0000","last_became_peered":"2024-01-17T22:58:55.903167+0000","last_unstale":"2024-01-18T00:47:34.183273+0000","last_undegraded":"2024-01-18T00:47:34.183273+0000","last_fullsized":"2024-01-18T00:47:34.183273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'754","last_scrub_stamp":"2024-01-18T00:47:34.183094+0000","last_deep_scrub":"28'754","last_deep_scrub_stamp":"2024-01-18T00:47:34.183094+0000","last_clean_scrub_stamp":"2024-01-18T00:47:34.183094+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:03:36.279948+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":69175,"num_write":737,"num_write_kb":101027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'517","reported_seq":599,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:32.868301+0000","last_change":"2024-01-18T00:47:32.868374+0000","last_active":"2024-01-18T00:47:32.868301+0000","last_peered":"2024-01-18T00:47:32.868301+0000","last_clean":"2024-01-18T00:47:32.868301+0000","last_became_active":"2024-01-17T22:58:48.372582+0000","last_became_peered":"2024-01-17T22:58:48.372582+0000","last_unstale":"2024-01-18T00:47:32.868301+0000","last_undegraded":"2024-01-18T00:47:32.868301+0000","last_fullsized":"2024-01-18T00:47:32.868301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'517","last_scrub_stamp":"2024-01-18T00:47:32.868128+0000","last_deep_scrub":"28'517","last_deep_scrub_stamp":"2024-01-18T00:47:32.868128+0000","last_clean_scrub_stamp":"2024-01-18T00:47:32.868128+0000","objects_scrubbed":2,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:32:30.066568+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":8429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'179","reported_seq":258,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:39.763733+0000","last_change":"2024-01-18T00:47:39.763793+0000","last_active":"2024-01-18T00:47:39.763733+0000","last_peered":"2024-01-18T00:47:39.763733+0000","last_clean":"2024-01-18T00:47:39.763733+0000","last_became_active":"2024-01-17T22:58:49.511303+0000","last_became_peered":"2024-01-17T22:58:49.511303+0000","last_unstale":"2024-01-18T00:47:39.763733+0000","last_undegraded":"2024-01-18T00:47:39.763733+0000","last_fullsized":"2024-01-18T00:47:39.763733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'179","last_scrub_stamp":"2024-01-18T00:47:39.763567+0000","last_deep_scrub":"28'179","last_deep_scrub_stamp":"2024-01-18T00:47:39.763567+0000","last_clean_scrub_stamp":"2024-01-18T00:47:39.763567+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:47:31.633089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'814","reported_seq":921,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.720814+0000","last_change":"2024-01-18T00:47:31.720814+0000","last_active":"2024-01-18T00:47:31.720814+0000","last_peered":"2024-01-18T00:47:31.720814+0000","last_clean":"2024-01-18T00:47:31.720814+0000","last_became_active":"2024-01-17T22:58:55.878263+0000","last_became_peered":"2024-01-17T22:58:55.878263+0000","last_unstale":"2024-01-18T00:47:31.720814+0000","last_undegraded":"2024-01-18T00:47:31.720814+0000","last_fullsized":"2024-01-18T00:47:31.720814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'814","last_scrub_stamp":"2024-01-18T00:47:31.720711+0000","last_deep_scrub":"28'814","last_deep_scrub_stamp":"2024-01-18T00:47:31.720711+0000","last_clean_scrub_stamp":"2024-01-18T00:47:31.720711+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:50:18.532683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":109513,"num_write":800,"num_write_kb":160118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1143","reported_seq":1214,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:24.886134+0000","last_change":"2024-01-18T00:47:24.886162+0000","last_active":"2024-01-18T00:47:24.886134+0000","last_peered":"2024-01-18T00:47:24.886134+0000","last_clean":"2024-01-18T00:47:24.886134+0000","last_became_active":"2024-01-17T22:58:48.346411+0000","last_became_peered":"2024-01-17T22:58:48.346411+0000","last_unstale":"2024-01-18T00:47:24.886134+0000","last_undegraded":"2024-01-18T00:47:24.886134+0000","last_fullsized":"2024-01-18T00:47:24.886134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1143","last_scrub_stamp":"2024-01-18T00:47:24.886069+0000","last_deep_scrub":"28'1143","last_deep_scrub_stamp":"2024-01-18T00:47:24.886069+0000","last_clean_scrub_stamp":"2024-01-18T00:47:24.886069+0000","objects_scrubbed":5,"log_size":1143,"log_dups_size":0,"ondisk_log_size":1143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:19:21.139280+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1083,"num_write_kb":12791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'196","reported_seq":265,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:25.854572+0000","last_change":"2024-01-18T00:47:25.854591+0000","last_active":"2024-01-18T00:47:25.854572+0000","last_peered":"2024-01-18T00:47:25.854572+0000","last_clean":"2024-01-18T00:47:25.854572+0000","last_became_active":"2024-01-17T22:58:49.517710+0000","last_became_peered":"2024-01-17T22:58:49.517710+0000","last_unstale":"2024-01-18T00:47:25.854572+0000","last_undegraded":"2024-01-18T00:47:25.854572+0000","last_fullsized":"2024-01-18T00:47:25.854572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'196","last_scrub_stamp":"2024-01-18T00:47:25.854523+0000","last_deep_scrub":"28'196","last_deep_scrub_stamp":"2024-01-18T00:47:25.854523+0000","last_clean_scrub_stamp":"2024-01-18T00:47:25.854523+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:28:46.105381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'731","reported_seq":818,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:30.740835+0000","last_change":"2024-01-18T00:47:30.740857+0000","last_active":"2024-01-18T00:47:30.740835+0000","last_peered":"2024-01-18T00:47:30.740835+0000","last_clean":"2024-01-18T00:47:30.740835+0000","last_became_active":"2024-01-17T22:58:55.846773+0000","last_became_peered":"2024-01-17T22:58:55.846773+0000","last_unstale":"2024-01-18T00:47:30.740835+0000","last_undegraded":"2024-01-18T00:47:30.740835+0000","last_fullsized":"2024-01-18T00:47:30.740835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'731","last_scrub_stamp":"2024-01-18T00:47:30.740740+0000","last_deep_scrub":"28'731","last_deep_scrub_stamp":"2024-01-18T00:47:30.740740+0000","last_clean_scrub_stamp":"2024-01-18T00:47:30.740740+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:51:31.196721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":46045,"num_write":714,"num_write_kb":72807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'769","reported_seq":840,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:23.892477+0000","last_change":"2024-01-18T00:47:23.892504+0000","last_active":"2024-01-18T00:47:23.892477+0000","last_peered":"2024-01-18T00:47:23.892477+0000","last_clean":"2024-01-18T00:47:23.892477+0000","last_became_active":"2024-01-17T22:58:48.345749+0000","last_became_peered":"2024-01-17T22:58:48.345749+0000","last_unstale":"2024-01-18T00:47:23.892477+0000","last_undegraded":"2024-01-18T00:47:23.892477+0000","last_fullsized":"2024-01-18T00:47:23.892477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'769","last_scrub_stamp":"2024-01-18T00:47:23.892413+0000","last_deep_scrub":"28'769","last_deep_scrub_stamp":"2024-01-18T00:47:23.892413+0000","last_clean_scrub_stamp":"2024-01-18T00:47:23.892413+0000","objects_scrubbed":2,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:00:08.044448+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'208","reported_seq":278,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:29.133590+0000","last_change":"2024-01-18T00:47:29.133610+0000","last_active":"2024-01-18T00:47:29.133590+0000","last_peered":"2024-01-18T00:47:29.133590+0000","last_clean":"2024-01-18T00:47:29.133590+0000","last_became_active":"2024-01-17T22:58:49.370010+0000","last_became_peered":"2024-01-17T22:58:49.370010+0000","last_unstale":"2024-01-18T00:47:29.133590+0000","last_undegraded":"2024-01-18T00:47:29.133590+0000","last_fullsized":"2024-01-18T00:47:29.133590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'208","last_scrub_stamp":"2024-01-18T00:47:29.133532+0000","last_deep_scrub":"28'208","last_deep_scrub_stamp":"2024-01-18T00:47:29.133532+0000","last_clean_scrub_stamp":"2024-01-18T00:47:29.133532+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:56:20.679598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'752","reported_seq":843,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:32.712165+0000","last_change":"2024-01-18T00:47:32.712188+0000","last_active":"2024-01-18T00:47:32.712165+0000","last_peered":"2024-01-18T00:47:32.712165+0000","last_clean":"2024-01-18T00:47:32.712165+0000","last_became_active":"2024-01-17T22:58:55.885739+0000","last_became_peered":"2024-01-17T22:58:55.885739+0000","last_unstale":"2024-01-18T00:47:32.712165+0000","last_undegraded":"2024-01-18T00:47:32.712165+0000","last_fullsized":"2024-01-18T00:47:32.712165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'752","last_scrub_stamp":"2024-01-18T00:47:32.712066+0000","last_deep_scrub":"28'752","last_deep_scrub_stamp":"2024-01-18T00:47:32.712066+0000","last_clean_scrub_stamp":"2024-01-18T00:47:32.712066+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:32:12.353517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":79345,"num_write":732,"num_write_kb":104824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'223","reported_seq":300,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:42.093987+0000","last_change":"2024-01-18T00:47:42.093987+0000","last_active":"2024-01-18T00:47:42.093987+0000","last_peered":"2024-01-18T00:47:42.093987+0000","last_clean":"2024-01-18T00:47:42.093987+0000","last_became_active":"2024-01-17T22:58:49.514310+0000","last_became_peered":"2024-01-17T22:58:49.514310+0000","last_unstale":"2024-01-18T00:47:42.093987+0000","last_undegraded":"2024-01-18T00:47:42.093987+0000","last_fullsized":"2024-01-18T00:47:42.093987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'223","last_scrub_stamp":"2024-01-18T00:47:42.093903+0000","last_deep_scrub":"28'223","last_deep_scrub_stamp":"2024-01-18T00:47:42.093903+0000","last_clean_scrub_stamp":"2024-01-18T00:47:42.093903+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:38:08.667830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1142","reported_seq":1218,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:38.181370+0000","last_change":"2024-01-18T00:47:38.181399+0000","last_active":"2024-01-18T00:47:38.181370+0000","last_peered":"2024-01-18T00:47:38.181370+0000","last_clean":"2024-01-18T00:47:38.181370+0000","last_became_active":"2024-01-17T22:58:48.341498+0000","last_became_peered":"2024-01-17T22:58:48.341498+0000","last_unstale":"2024-01-18T00:47:38.181370+0000","last_undegraded":"2024-01-18T00:47:38.181370+0000","last_fullsized":"2024-01-18T00:47:38.181370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1142","last_scrub_stamp":"2024-01-18T00:47:38.181308+0000","last_deep_scrub":"28'1142","last_deep_scrub_stamp":"2024-01-18T00:47:38.181308+0000","last_clean_scrub_stamp":"2024-01-18T00:47:38.181308+0000","objects_scrubbed":5,"log_size":1142,"log_dups_size":0,"ondisk_log_size":1142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:16:35.952462+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1075,"num_write_kb":12808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'783","reported_seq":883,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:48.117549+0000","last_change":"2024-01-18T00:47:48.117571+0000","last_active":"2024-01-18T00:47:48.117549+0000","last_peered":"2024-01-18T00:47:48.117549+0000","last_clean":"2024-01-18T00:47:48.117549+0000","last_became_active":"2024-01-17T22:58:55.915556+0000","last_became_peered":"2024-01-17T22:58:55.915556+0000","last_unstale":"2024-01-18T00:47:48.117549+0000","last_undegraded":"2024-01-18T00:47:48.117549+0000","last_fullsized":"2024-01-18T00:47:48.117549+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'783","last_scrub_stamp":"2024-01-18T00:47:48.117480+0000","last_deep_scrub":"28'783","last_deep_scrub_stamp":"2024-01-18T00:47:48.117480+0000","last_clean_scrub_stamp":"2024-01-18T00:47:48.117480+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:39:54.608442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":102943,"num_write":764,"num_write_kb":130404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'216","reported_seq":291,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:30.185165+0000","last_change":"2024-01-18T00:47:30.185275+0000","last_active":"2024-01-18T00:47:30.185165+0000","last_peered":"2024-01-18T00:47:30.185165+0000","last_clean":"2024-01-18T00:47:30.185165+0000","last_became_active":"2024-01-17T22:58:49.387500+0000","last_became_peered":"2024-01-17T22:58:49.387500+0000","last_unstale":"2024-01-18T00:47:30.185165+0000","last_undegraded":"2024-01-18T00:47:30.185165+0000","last_fullsized":"2024-01-18T00:47:30.185165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'216","last_scrub_stamp":"2024-01-18T00:47:30.184929+0000","last_deep_scrub":"28'216","last_deep_scrub_stamp":"2024-01-18T00:47:30.184929+0000","last_clean_scrub_stamp":"2024-01-18T00:47:30.184929+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:35:50.286169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'1209","reported_seq":1287,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:28.427454+0000","last_change":"2024-01-18T00:47:28.427454+0000","last_active":"2024-01-18T00:47:28.427454+0000","last_peered":"2024-01-18T00:47:28.427454+0000","last_clean":"2024-01-18T00:47:28.427454+0000","last_became_active":"2024-01-17T22:58:48.345584+0000","last_became_peered":"2024-01-17T22:58:48.345584+0000","last_unstale":"2024-01-18T00:47:28.427454+0000","last_undegraded":"2024-01-18T00:47:28.427454+0000","last_fullsized":"2024-01-18T00:47:28.427454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1209","last_scrub_stamp":"2024-01-18T00:47:28.427200+0000","last_deep_scrub":"28'1209","last_deep_scrub_stamp":"2024-01-18T00:47:28.427200+0000","last_clean_scrub_stamp":"2024-01-18T00:47:28.427200+0000","objects_scrubbed":3,"log_size":1209,"log_dups_size":0,"ondisk_log_size":1209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:21:42.084978+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":8782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'818","reported_seq":912,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.781142+0000","last_change":"2024-01-18T00:47:35.781163+0000","last_active":"2024-01-18T00:47:35.781142+0000","last_peered":"2024-01-18T00:47:35.781142+0000","last_clean":"2024-01-18T00:47:35.781142+0000","last_became_active":"2024-01-17T22:58:55.904182+0000","last_became_peered":"2024-01-17T22:58:55.904182+0000","last_unstale":"2024-01-18T00:47:35.781142+0000","last_undegraded":"2024-01-18T00:47:35.781142+0000","last_fullsized":"2024-01-18T00:47:35.781142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'818","last_scrub_stamp":"2024-01-18T00:47:35.781058+0000","last_deep_scrub":"28'818","last_deep_scrub_stamp":"2024-01-18T00:47:35.781058+0000","last_clean_scrub_stamp":"2024-01-18T00:47:35.781058+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:00:06.452112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":69224,"num_write":805,"num_write_kb":98188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'208","reported_seq":285,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:34.405294+0000","last_change":"2024-01-18T00:47:34.405353+0000","last_active":"2024-01-18T00:47:34.405294+0000","last_peered":"2024-01-18T00:47:34.405294+0000","last_clean":"2024-01-18T00:47:34.405294+0000","last_became_active":"2024-01-17T22:58:49.417440+0000","last_became_peered":"2024-01-17T22:58:49.417440+0000","last_unstale":"2024-01-18T00:47:34.405294+0000","last_undegraded":"2024-01-18T00:47:34.405294+0000","last_fullsized":"2024-01-18T00:47:34.405294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'208","last_scrub_stamp":"2024-01-18T00:47:34.405134+0000","last_deep_scrub":"28'208","last_deep_scrub_stamp":"2024-01-18T00:47:34.405134+0000","last_clean_scrub_stamp":"2024-01-18T00:47:34.405134+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:46:08.348115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'356","reported_seq":434,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:27.275592+0000","last_change":"2024-01-18T00:47:27.275711+0000","last_active":"2024-01-18T00:47:27.275592+0000","last_peered":"2024-01-18T00:47:27.275592+0000","last_clean":"2024-01-18T00:47:27.275592+0000","last_became_active":"2024-01-17T22:58:48.331435+0000","last_became_peered":"2024-01-17T22:58:48.331435+0000","last_unstale":"2024-01-18T00:47:27.275592+0000","last_undegraded":"2024-01-18T00:47:27.275592+0000","last_fullsized":"2024-01-18T00:47:27.275592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'356","last_scrub_stamp":"2024-01-18T00:47:27.275365+0000","last_deep_scrub":"28'356","last_deep_scrub_stamp":"2024-01-18T00:47:27.275365+0000","last_clean_scrub_stamp":"2024-01-18T00:47:27.275365+0000","objects_scrubbed":3,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:03:29.372219+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":286,"num_write_kb":4220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'749","reported_seq":851,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:36.765707+0000","last_change":"2024-01-18T00:47:36.765707+0000","last_active":"2024-01-18T00:47:36.765707+0000","last_peered":"2024-01-18T00:47:36.765707+0000","last_clean":"2024-01-18T00:47:36.765707+0000","last_became_active":"2024-01-17T22:59:09.254084+0000","last_became_peered":"2024-01-17T22:59:09.254084+0000","last_unstale":"2024-01-18T00:47:36.765707+0000","last_undegraded":"2024-01-18T00:47:36.765707+0000","last_fullsized":"2024-01-18T00:47:36.765707+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'749","last_scrub_stamp":"2024-01-18T00:47:36.765626+0000","last_deep_scrub":"28'749","last_deep_scrub_stamp":"2024-01-18T00:47:36.765626+0000","last_clean_scrub_stamp":"2024-01-18T00:47:36.765626+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:19:20.665592+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":86272,"num_write":735,"num_write_kb":127812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2,3],"acting":[0,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"28'213","reported_seq":290,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:41.139796+0000","last_change":"2024-01-18T00:47:41.139817+0000","last_active":"2024-01-18T00:47:41.139796+0000","last_peered":"2024-01-18T00:47:41.139796+0000","last_clean":"2024-01-18T00:47:41.139796+0000","last_became_active":"2024-01-17T22:58:49.416757+0000","last_became_peered":"2024-01-17T22:58:49.416757+0000","last_unstale":"2024-01-18T00:47:41.139796+0000","last_undegraded":"2024-01-18T00:47:41.139796+0000","last_fullsized":"2024-01-18T00:47:41.139796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'213","last_scrub_stamp":"2024-01-18T00:47:41.139733+0000","last_deep_scrub":"28'213","last_deep_scrub_stamp":"2024-01-18T00:47:41.139733+0000","last_clean_scrub_stamp":"2024-01-18T00:47:41.139733+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:44:22.038117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'205","reported_seq":283,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:21.939741+0000","last_change":"2024-01-18T00:47:21.939788+0000","last_active":"2024-01-18T00:47:21.939741+0000","last_peered":"2024-01-18T00:47:21.939741+0000","last_clean":"2024-01-18T00:47:21.939741+0000","last_became_active":"2024-01-17T22:58:48.341359+0000","last_became_peered":"2024-01-17T22:58:48.341359+0000","last_unstale":"2024-01-18T00:47:21.939741+0000","last_undegraded":"2024-01-18T00:47:21.939741+0000","last_fullsized":"2024-01-18T00:47:21.939741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'205","last_scrub_stamp":"2024-01-18T00:47:21.939672+0000","last_deep_scrub":"28'205","last_deep_scrub_stamp":"2024-01-18T00:47:21.939672+0000","last_clean_scrub_stamp":"2024-01-18T00:47:21.939672+0000","objects_scrubbed":2,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:38:25.360325+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'713","reported_seq":825,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:36.725769+0000","last_change":"2024-01-18T00:47:36.725792+0000","last_active":"2024-01-18T00:47:36.725769+0000","last_peered":"2024-01-18T00:47:36.725769+0000","last_clean":"2024-01-18T00:47:36.725769+0000","last_became_active":"2024-01-17T22:58:55.913645+0000","last_became_peered":"2024-01-17T22:58:55.913645+0000","last_unstale":"2024-01-18T00:47:36.725769+0000","last_undegraded":"2024-01-18T00:47:36.725769+0000","last_fullsized":"2024-01-18T00:47:36.725769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'713","last_scrub_stamp":"2024-01-18T00:47:36.725665+0000","last_deep_scrub":"28'713","last_deep_scrub_stamp":"2024-01-18T00:47:36.725665+0000","last_clean_scrub_stamp":"2024-01-18T00:47:36.725665+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:36:56.866658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":136231,"num_write":693,"num_write_kb":114548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'226","reported_seq":303,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:24.234567+0000","last_change":"2024-01-18T00:47:24.234625+0000","last_active":"2024-01-18T00:47:24.234567+0000","last_peered":"2024-01-18T00:47:24.234567+0000","last_clean":"2024-01-18T00:47:24.234567+0000","last_became_active":"2024-01-17T22:58:49.417385+0000","last_became_peered":"2024-01-17T22:58:49.417385+0000","last_unstale":"2024-01-18T00:47:24.234567+0000","last_undegraded":"2024-01-18T00:47:24.234567+0000","last_fullsized":"2024-01-18T00:47:24.234567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'226","last_scrub_stamp":"2024-01-18T00:47:24.234407+0000","last_deep_scrub":"28'226","last_deep_scrub_stamp":"2024-01-18T00:47:24.234407+0000","last_clean_scrub_stamp":"2024-01-18T00:47:24.234407+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:26:07.136004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'333","reported_seq":411,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:36.173236+0000","last_change":"2024-01-18T00:47:36.173278+0000","last_active":"2024-01-18T00:47:36.173236+0000","last_peered":"2024-01-18T00:47:36.173236+0000","last_clean":"2024-01-18T00:47:36.173236+0000","last_became_active":"2024-01-17T22:58:48.339738+0000","last_became_peered":"2024-01-17T22:58:48.339738+0000","last_unstale":"2024-01-18T00:47:36.173236+0000","last_undegraded":"2024-01-18T00:47:36.173236+0000","last_fullsized":"2024-01-18T00:47:36.173236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'333","last_scrub_stamp":"2024-01-18T00:47:36.173168+0000","last_deep_scrub":"28'333","last_deep_scrub_stamp":"2024-01-18T00:47:36.173168+0000","last_clean_scrub_stamp":"2024-01-18T00:47:36.173168+0000","objects_scrubbed":3,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:45:09.570322+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'778","reported_seq":892,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:34.684958+0000","last_change":"2024-01-18T00:47:34.684996+0000","last_active":"2024-01-18T00:47:34.684958+0000","last_peered":"2024-01-18T00:47:34.684958+0000","last_clean":"2024-01-18T00:47:34.684958+0000","last_became_active":"2024-01-17T22:58:55.904417+0000","last_became_peered":"2024-01-17T22:58:55.904417+0000","last_unstale":"2024-01-18T00:47:34.684958+0000","last_undegraded":"2024-01-18T00:47:34.684958+0000","last_fullsized":"2024-01-18T00:47:34.684958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'778","last_scrub_stamp":"2024-01-18T00:47:34.684875+0000","last_deep_scrub":"28'778","last_deep_scrub_stamp":"2024-01-18T00:47:34.684875+0000","last_clean_scrub_stamp":"2024-01-18T00:47:34.684875+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:41:20.360418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":109858,"num_write":759,"num_write_kb":103009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'181","reported_seq":258,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.333433+0000","last_change":"2024-01-18T00:47:31.333460+0000","last_active":"2024-01-18T00:47:31.333433+0000","last_peered":"2024-01-18T00:47:31.333433+0000","last_clean":"2024-01-18T00:47:31.333433+0000","last_became_active":"2024-01-17T22:58:49.410830+0000","last_became_peered":"2024-01-17T22:58:49.410830+0000","last_unstale":"2024-01-18T00:47:31.333433+0000","last_undegraded":"2024-01-18T00:47:31.333433+0000","last_fullsized":"2024-01-18T00:47:31.333433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'181","last_scrub_stamp":"2024-01-18T00:47:31.333339+0000","last_deep_scrub":"28'181","last_deep_scrub_stamp":"2024-01-18T00:47:31.333339+0000","last_clean_scrub_stamp":"2024-01-18T00:47:31.333339+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:12:45.837049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'1210","reported_seq":1288,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:28.286858+0000","last_change":"2024-01-18T00:47:28.286920+0000","last_active":"2024-01-18T00:47:28.286858+0000","last_peered":"2024-01-18T00:47:28.286858+0000","last_clean":"2024-01-18T00:47:28.286858+0000","last_became_active":"2024-01-17T22:58:48.338928+0000","last_became_peered":"2024-01-17T22:58:48.338928+0000","last_unstale":"2024-01-18T00:47:28.286858+0000","last_undegraded":"2024-01-18T00:47:28.286858+0000","last_fullsized":"2024-01-18T00:47:28.286858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1210","last_scrub_stamp":"2024-01-18T00:47:28.286695+0000","last_deep_scrub":"28'1210","last_deep_scrub_stamp":"2024-01-18T00:47:28.286695+0000","last_clean_scrub_stamp":"2024-01-18T00:47:28.286695+0000","objects_scrubbed":2,"log_size":1210,"log_dups_size":0,"ondisk_log_size":1210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:26:56.654090+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3222,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'817","reported_seq":938,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:40.417666+0000","last_change":"2024-01-18T00:47:40.417757+0000","last_active":"2024-01-18T00:47:40.417666+0000","last_peered":"2024-01-18T00:47:40.417666+0000","last_clean":"2024-01-18T00:47:40.417666+0000","last_became_active":"2024-01-17T22:58:55.908232+0000","last_became_peered":"2024-01-17T22:58:55.908232+0000","last_unstale":"2024-01-18T00:47:40.417666+0000","last_undegraded":"2024-01-18T00:47:40.417666+0000","last_fullsized":"2024-01-18T00:47:40.417666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'817","last_scrub_stamp":"2024-01-18T00:47:40.417495+0000","last_deep_scrub":"28'817","last_deep_scrub_stamp":"2024-01-18T00:47:40.417495+0000","last_clean_scrub_stamp":"2024-01-18T00:47:40.417495+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:36:06.172564+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":152093,"num_write":804,"num_write_kb":135389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'198","reported_seq":277,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:33.397226+0000","last_change":"2024-01-18T00:47:33.397288+0000","last_active":"2024-01-18T00:47:33.397226+0000","last_peered":"2024-01-18T00:47:33.397226+0000","last_clean":"2024-01-18T00:47:33.397226+0000","last_became_active":"2024-01-17T22:58:49.369598+0000","last_became_peered":"2024-01-17T22:58:49.369598+0000","last_unstale":"2024-01-18T00:47:33.397226+0000","last_undegraded":"2024-01-18T00:47:33.397226+0000","last_fullsized":"2024-01-18T00:47:33.397226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'198","last_scrub_stamp":"2024-01-18T00:47:33.397072+0000","last_deep_scrub":"28'198","last_deep_scrub_stamp":"2024-01-18T00:47:33.397072+0000","last_clean_scrub_stamp":"2024-01-18T00:47:33.397072+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:25.358701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'822","reported_seq":902,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:34.172618+0000","last_change":"2024-01-18T00:47:34.172618+0000","last_active":"2024-01-18T00:47:34.172618+0000","last_peered":"2024-01-18T00:47:34.172618+0000","last_clean":"2024-01-18T00:47:34.172618+0000","last_became_active":"2024-01-17T22:58:48.338225+0000","last_became_peered":"2024-01-17T22:58:48.338225+0000","last_unstale":"2024-01-18T00:47:34.172618+0000","last_undegraded":"2024-01-18T00:47:34.172618+0000","last_fullsized":"2024-01-18T00:47:34.172618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'822","last_scrub_stamp":"2024-01-18T00:47:34.172533+0000","last_deep_scrub":"28'822","last_deep_scrub_stamp":"2024-01-18T00:47:34.172533+0000","last_clean_scrub_stamp":"2024-01-18T00:47:34.172533+0000","objects_scrubbed":3,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:16:20.853729+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":8593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'758","reported_seq":872,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:36.427284+0000","last_change":"2024-01-18T00:47:36.427349+0000","last_active":"2024-01-18T00:47:36.427284+0000","last_peered":"2024-01-18T00:47:36.427284+0000","last_clean":"2024-01-18T00:47:36.427284+0000","last_became_active":"2024-01-17T22:58:55.872356+0000","last_became_peered":"2024-01-17T22:58:55.872356+0000","last_unstale":"2024-01-18T00:47:36.427284+0000","last_undegraded":"2024-01-18T00:47:36.427284+0000","last_fullsized":"2024-01-18T00:47:36.427284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'758","last_scrub_stamp":"2024-01-18T00:47:36.427053+0000","last_deep_scrub":"28'758","last_deep_scrub_stamp":"2024-01-18T00:47:36.427053+0000","last_clean_scrub_stamp":"2024-01-18T00:47:36.427053+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:21:19.608773+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":100834,"num_write":740,"num_write_kb":155893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'214","reported_seq":292,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:26.742071+0000","last_change":"2024-01-18T00:47:26.742071+0000","last_active":"2024-01-18T00:47:26.742071+0000","last_peered":"2024-01-18T00:47:26.742071+0000","last_clean":"2024-01-18T00:47:26.742071+0000","last_became_active":"2024-01-17T22:58:49.369487+0000","last_became_peered":"2024-01-17T22:58:49.369487+0000","last_unstale":"2024-01-18T00:47:26.742071+0000","last_undegraded":"2024-01-18T00:47:26.742071+0000","last_fullsized":"2024-01-18T00:47:26.742071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'214","last_scrub_stamp":"2024-01-18T00:47:26.741937+0000","last_deep_scrub":"28'214","last_deep_scrub_stamp":"2024-01-18T00:47:26.741937+0000","last_clean_scrub_stamp":"2024-01-18T00:47:26.741937+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:03:28.838791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'277","reported_seq":357,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.883794+0000","last_change":"2024-01-18T00:47:31.883864+0000","last_active":"2024-01-18T00:47:31.883794+0000","last_peered":"2024-01-18T00:47:31.883794+0000","last_clean":"2024-01-18T00:47:31.883794+0000","last_became_active":"2024-01-17T22:58:48.339996+0000","last_became_peered":"2024-01-17T22:58:48.339996+0000","last_unstale":"2024-01-18T00:47:31.883794+0000","last_undegraded":"2024-01-18T00:47:31.883794+0000","last_fullsized":"2024-01-18T00:47:31.883794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'277","last_scrub_stamp":"2024-01-18T00:47:31.883639+0000","last_deep_scrub":"28'277","last_deep_scrub_stamp":"2024-01-18T00:47:31.883639+0000","last_clean_scrub_stamp":"2024-01-18T00:47:31.883639+0000","objects_scrubbed":1,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:14:45.527540+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'763","reported_seq":870,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:37.402553+0000","last_change":"2024-01-18T00:47:37.402683+0000","last_active":"2024-01-18T00:47:37.402553+0000","last_peered":"2024-01-18T00:47:37.402553+0000","last_clean":"2024-01-18T00:47:37.402553+0000","last_became_active":"2024-01-17T22:58:55.877118+0000","last_became_peered":"2024-01-17T22:58:55.877118+0000","last_unstale":"2024-01-18T00:47:37.402553+0000","last_undegraded":"2024-01-18T00:47:37.402553+0000","last_fullsized":"2024-01-18T00:47:37.402553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'763","last_scrub_stamp":"2024-01-18T00:47:37.402245+0000","last_deep_scrub":"28'763","last_deep_scrub_stamp":"2024-01-18T00:47:37.402245+0000","last_clean_scrub_stamp":"2024-01-18T00:47:37.402245+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:41:23.077788+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":97013,"num_write":742,"num_write_kb":97416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'198","reported_seq":277,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:28.881911+0000","last_change":"2024-01-18T00:47:28.881946+0000","last_active":"2024-01-18T00:47:28.881911+0000","last_peered":"2024-01-18T00:47:28.881911+0000","last_clean":"2024-01-18T00:47:28.881911+0000","last_became_active":"2024-01-17T22:58:49.352563+0000","last_became_peered":"2024-01-17T22:58:49.352563+0000","last_unstale":"2024-01-18T00:47:28.881911+0000","last_undegraded":"2024-01-18T00:47:28.881911+0000","last_fullsized":"2024-01-18T00:47:28.881911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'198","last_scrub_stamp":"2024-01-18T00:47:28.881827+0000","last_deep_scrub":"28'198","last_deep_scrub_stamp":"2024-01-18T00:47:28.881827+0000","last_clean_scrub_stamp":"2024-01-18T00:47:28.881827+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:15:47.907229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'1020","reported_seq":1100,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:40.196804+0000","last_change":"2024-01-18T00:47:40.196832+0000","last_active":"2024-01-18T00:47:40.196804+0000","last_peered":"2024-01-18T00:47:40.196804+0000","last_clean":"2024-01-18T00:47:40.196804+0000","last_became_active":"2024-01-17T22:58:48.343060+0000","last_became_peered":"2024-01-17T22:58:48.343060+0000","last_unstale":"2024-01-18T00:47:40.196804+0000","last_undegraded":"2024-01-18T00:47:40.196804+0000","last_fullsized":"2024-01-18T00:47:40.196804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1020","last_scrub_stamp":"2024-01-18T00:47:40.196742+0000","last_deep_scrub":"28'1020","last_deep_scrub_stamp":"2024-01-18T00:47:40.196742+0000","last_clean_scrub_stamp":"2024-01-18T00:47:40.196742+0000","objects_scrubbed":2,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:07:30.029104+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":955,"num_write_kb":8650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'732","reported_seq":838,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:38.372373+0000","last_change":"2024-01-18T00:47:38.372498+0000","last_active":"2024-01-18T00:47:38.372373+0000","last_peered":"2024-01-18T00:47:38.372373+0000","last_clean":"2024-01-18T00:47:38.372373+0000","last_became_active":"2024-01-17T22:58:55.880665+0000","last_became_peered":"2024-01-17T22:58:55.880665+0000","last_unstale":"2024-01-18T00:47:38.372373+0000","last_undegraded":"2024-01-18T00:47:38.372373+0000","last_fullsized":"2024-01-18T00:47:38.372373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'732","last_scrub_stamp":"2024-01-18T00:47:38.372188+0000","last_deep_scrub":"28'732","last_deep_scrub_stamp":"2024-01-18T00:47:38.372188+0000","last_clean_scrub_stamp":"2024-01-18T00:47:38.372188+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:41:40.801273+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":93731,"num_write":720,"num_write_kb":118971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'203","reported_seq":284,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:37.849057+0000","last_change":"2024-01-18T00:47:37.849181+0000","last_active":"2024-01-18T00:47:37.849057+0000","last_peered":"2024-01-18T00:47:37.849057+0000","last_clean":"2024-01-18T00:47:37.849057+0000","last_became_active":"2024-01-17T22:58:49.384655+0000","last_became_peered":"2024-01-17T22:58:49.384655+0000","last_unstale":"2024-01-18T00:47:37.849057+0000","last_undegraded":"2024-01-18T00:47:37.849057+0000","last_fullsized":"2024-01-18T00:47:37.849057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'203","last_scrub_stamp":"2024-01-18T00:47:37.848863+0000","last_deep_scrub":"28'203","last_deep_scrub_stamp":"2024-01-18T00:47:37.848863+0000","last_clean_scrub_stamp":"2024-01-18T00:47:37.848863+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:53:27.492878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'1860","reported_seq":3728,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:28.117698+0000","last_change":"2024-01-18T00:47:28.117767+0000","last_active":"2024-01-18T00:47:28.117698+0000","last_peered":"2024-01-18T00:47:28.117698+0000","last_clean":"2024-01-18T00:47:28.117698+0000","last_became_active":"2024-01-17T22:58:48.375210+0000","last_became_peered":"2024-01-17T22:58:48.375210+0000","last_unstale":"2024-01-18T00:47:28.117698+0000","last_undegraded":"2024-01-18T00:47:28.117698+0000","last_fullsized":"2024-01-18T00:47:28.117698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1860","last_scrub_stamp":"2024-01-18T00:47:28.117521+0000","last_deep_scrub":"28'1860","last_deep_scrub_stamp":"2024-01-18T00:47:28.117521+0000","last_clean_scrub_stamp":"2024-01-18T00:47:28.117521+0000","objects_scrubbed":3,"log_size":1860,"log_dups_size":0,"ondisk_log_size":1860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:41:29.090492+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1556390,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1788,"num_read_kb":2847,"num_write":1794,"num_write_kb":2850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'738","reported_seq":836,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:39.406041+0000","last_change":"2024-01-18T00:47:39.406102+0000","last_active":"2024-01-18T00:47:39.406041+0000","last_peered":"2024-01-18T00:47:39.406041+0000","last_clean":"2024-01-18T00:47:39.406041+0000","last_became_active":"2024-01-17T22:58:55.902881+0000","last_became_peered":"2024-01-17T22:58:55.902881+0000","last_unstale":"2024-01-18T00:47:39.406041+0000","last_undegraded":"2024-01-18T00:47:39.406041+0000","last_fullsized":"2024-01-18T00:47:39.406041+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'738","last_scrub_stamp":"2024-01-18T00:47:39.405868+0000","last_deep_scrub":"28'738","last_deep_scrub_stamp":"2024-01-18T00:47:39.405868+0000","last_clean_scrub_stamp":"2024-01-18T00:47:39.405868+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:36:59.546861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":79403,"num_write":724,"num_write_kb":135108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'196","reported_seq":275,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:30.416931+0000","last_change":"2024-01-18T00:47:30.417005+0000","last_active":"2024-01-18T00:47:30.416931+0000","last_peered":"2024-01-18T00:47:30.416931+0000","last_clean":"2024-01-18T00:47:30.416931+0000","last_became_active":"2024-01-17T22:58:49.367236+0000","last_became_peered":"2024-01-17T22:58:49.367236+0000","last_unstale":"2024-01-18T00:47:30.416931+0000","last_undegraded":"2024-01-18T00:47:30.416931+0000","last_fullsized":"2024-01-18T00:47:30.416931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'196","last_scrub_stamp":"2024-01-18T00:47:30.416781+0000","last_deep_scrub":"28'196","last_deep_scrub_stamp":"2024-01-18T00:47:30.416781+0000","last_clean_scrub_stamp":"2024-01-18T00:47:30.416781+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:20:30.689815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'621","reported_seq":703,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.193351+0000","last_change":"2024-01-18T00:47:35.193382+0000","last_active":"2024-01-18T00:47:35.193351+0000","last_peered":"2024-01-18T00:47:35.193351+0000","last_clean":"2024-01-18T00:47:35.193351+0000","last_became_active":"2024-01-17T22:58:48.337500+0000","last_became_peered":"2024-01-17T22:58:48.337500+0000","last_unstale":"2024-01-18T00:47:35.193351+0000","last_undegraded":"2024-01-18T00:47:35.193351+0000","last_fullsized":"2024-01-18T00:47:35.193351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'621","last_scrub_stamp":"2024-01-18T00:47:35.193282+0000","last_deep_scrub":"28'621","last_deep_scrub_stamp":"2024-01-18T00:47:35.193282+0000","last_clean_scrub_stamp":"2024-01-18T00:47:35.193282+0000","objects_scrubbed":4,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:25:31.442204+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":12559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'904","reported_seq":1035,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:41.757899+0000","last_change":"2024-01-18T00:47:41.758017+0000","last_active":"2024-01-18T00:47:41.757899+0000","last_peered":"2024-01-18T00:47:41.757899+0000","last_clean":"2024-01-18T00:47:41.757899+0000","last_became_active":"2024-01-17T22:58:55.899657+0000","last_became_peered":"2024-01-17T22:58:55.899657+0000","last_unstale":"2024-01-18T00:47:41.757899+0000","last_undegraded":"2024-01-18T00:47:41.757899+0000","last_fullsized":"2024-01-18T00:47:41.757899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'904","last_scrub_stamp":"2024-01-18T00:47:41.757692+0000","last_deep_scrub":"28'904","last_deep_scrub_stamp":"2024-01-18T00:47:41.757692+0000","last_clean_scrub_stamp":"2024-01-18T00:47:41.757692+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:33:03.481330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":184022,"num_write":887,"num_write_kb":259108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'189","reported_seq":268,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:32.339391+0000","last_change":"2024-01-18T00:47:32.339508+0000","last_active":"2024-01-18T00:47:32.339391+0000","last_peered":"2024-01-18T00:47:32.339391+0000","last_clean":"2024-01-18T00:47:32.339391+0000","last_became_active":"2024-01-17T22:58:49.411848+0000","last_became_peered":"2024-01-17T22:58:49.411848+0000","last_unstale":"2024-01-18T00:47:32.339391+0000","last_undegraded":"2024-01-18T00:47:32.339391+0000","last_fullsized":"2024-01-18T00:47:32.339391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'189","last_scrub_stamp":"2024-01-18T00:47:32.339194+0000","last_deep_scrub":"28'189","last_deep_scrub_stamp":"2024-01-18T00:47:32.339194+0000","last_clean_scrub_stamp":"2024-01-18T00:47:32.339194+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:04:52.310945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'297","reported_seq":377,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:37.145544+0000","last_change":"2024-01-18T00:47:37.145570+0000","last_active":"2024-01-18T00:47:37.145544+0000","last_peered":"2024-01-18T00:47:37.145544+0000","last_clean":"2024-01-18T00:47:37.145544+0000","last_became_active":"2024-01-17T22:58:48.340963+0000","last_became_peered":"2024-01-17T22:58:48.340963+0000","last_unstale":"2024-01-18T00:47:37.145544+0000","last_undegraded":"2024-01-18T00:47:37.145544+0000","last_fullsized":"2024-01-18T00:47:37.145544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'297","last_scrub_stamp":"2024-01-18T00:47:37.145485+0000","last_deep_scrub":"28'297","last_deep_scrub_stamp":"2024-01-18T00:47:37.145485+0000","last_clean_scrub_stamp":"2024-01-18T00:47:37.145485+0000","objects_scrubbed":4,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:23:12.913565+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":4212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'163","reported_seq":289,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:21.863206+0000","last_change":"2024-01-18T00:47:21.863233+0000","last_active":"2024-01-18T00:47:21.863206+0000","last_peered":"2024-01-18T00:47:21.863206+0000","last_clean":"2024-01-18T00:47:21.863206+0000","last_became_active":"2024-01-17T22:58:17.321097+0000","last_became_peered":"2024-01-17T22:58:17.321097+0000","last_unstale":"2024-01-18T00:47:21.863206+0000","last_undegraded":"2024-01-18T00:47:21.863206+0000","last_fullsized":"2024-01-18T00:47:21.863206+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'163","last_scrub_stamp":"2024-01-18T00:47:21.863134+0000","last_deep_scrub":"28'163","last_deep_scrub_stamp":"2024-01-18T00:47:21.863134+0000","last_clean_scrub_stamp":"2024-01-18T00:47:21.863134+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:10:20.450518+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'806","reported_seq":948,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:47.131034+0000","last_change":"2024-01-18T00:47:47.131034+0000","last_active":"2024-01-18T00:47:47.131034+0000","last_peered":"2024-01-18T00:47:47.131034+0000","last_clean":"2024-01-18T00:47:47.131034+0000","last_became_active":"2024-01-17T22:58:55.909055+0000","last_became_peered":"2024-01-17T22:58:55.909055+0000","last_unstale":"2024-01-18T00:47:47.131034+0000","last_undegraded":"2024-01-18T00:47:47.131034+0000","last_fullsized":"2024-01-18T00:47:47.131034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'806","last_scrub_stamp":"2024-01-18T00:47:47.130945+0000","last_deep_scrub":"28'806","last_deep_scrub_stamp":"2024-01-18T00:47:47.130945+0000","last_clean_scrub_stamp":"2024-01-18T00:47:47.130945+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:27:01.646469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":230974,"num_write":789,"num_write_kb":193453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'203","reported_seq":278,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:43.139897+0000","last_change":"2024-01-18T00:47:43.139919+0000","last_active":"2024-01-18T00:47:43.139897+0000","last_peered":"2024-01-18T00:47:43.139897+0000","last_clean":"2024-01-18T00:47:43.139897+0000","last_became_active":"2024-01-17T22:58:49.515941+0000","last_became_peered":"2024-01-17T22:58:49.515941+0000","last_unstale":"2024-01-18T00:47:43.139897+0000","last_undegraded":"2024-01-18T00:47:43.139897+0000","last_fullsized":"2024-01-18T00:47:43.139897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'203","last_scrub_stamp":"2024-01-18T00:47:43.139836+0000","last_deep_scrub":"28'203","last_deep_scrub_stamp":"2024-01-18T00:47:43.139836+0000","last_clean_scrub_stamp":"2024-01-18T00:47:43.139836+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:56:43.736479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'366","reported_seq":443,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:26.411191+0000","last_change":"2024-01-18T00:47:26.411314+0000","last_active":"2024-01-18T00:47:26.411191+0000","last_peered":"2024-01-18T00:47:26.411191+0000","last_clean":"2024-01-18T00:47:26.411191+0000","last_became_active":"2024-01-17T22:58:48.344402+0000","last_became_peered":"2024-01-17T22:58:48.344402+0000","last_unstale":"2024-01-18T00:47:26.411191+0000","last_undegraded":"2024-01-18T00:47:26.411191+0000","last_fullsized":"2024-01-18T00:47:26.411191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'366","last_scrub_stamp":"2024-01-18T00:47:26.411007+0000","last_deep_scrub":"28'366","last_deep_scrub_stamp":"2024-01-18T00:47:26.411007+0000","last_clean_scrub_stamp":"2024-01-18T00:47:26.411007+0000","objects_scrubbed":3,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:52:59.540385+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'821","reported_seq":930,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:33.712144+0000","last_change":"2024-01-18T00:47:33.712144+0000","last_active":"2024-01-18T00:47:33.712144+0000","last_peered":"2024-01-18T00:47:33.712144+0000","last_clean":"2024-01-18T00:47:33.712144+0000","last_became_active":"2024-01-17T22:58:55.885809+0000","last_became_peered":"2024-01-17T22:58:55.885809+0000","last_unstale":"2024-01-18T00:47:33.712144+0000","last_undegraded":"2024-01-18T00:47:33.712144+0000","last_fullsized":"2024-01-18T00:47:33.712144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'821","last_scrub_stamp":"2024-01-18T00:47:33.712052+0000","last_deep_scrub":"28'821","last_deep_scrub_stamp":"2024-01-18T00:47:33.712052+0000","last_clean_scrub_stamp":"2024-01-18T00:47:33.712052+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:21:16.893771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":121383,"num_write":812,"num_write_kb":179977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'216","reported_seq":283,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:41.405558+0000","last_change":"2024-01-18T00:47:41.405617+0000","last_active":"2024-01-18T00:47:41.405558+0000","last_peered":"2024-01-18T00:47:41.405558+0000","last_clean":"2024-01-18T00:47:41.405558+0000","last_became_active":"2024-01-17T22:59:08.654136+0000","last_became_peered":"2024-01-17T22:59:08.654136+0000","last_unstale":"2024-01-18T00:47:41.405558+0000","last_undegraded":"2024-01-18T00:47:41.405558+0000","last_fullsized":"2024-01-18T00:47:41.405558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'216","last_scrub_stamp":"2024-01-18T00:47:41.405379+0000","last_deep_scrub":"28'216","last_deep_scrub_stamp":"2024-01-18T00:47:41.405379+0000","last_clean_scrub_stamp":"2024-01-18T00:47:41.405379+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:45:14.802533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"28'406","reported_seq":482,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:29.852441+0000","last_change":"2024-01-18T00:47:29.852520+0000","last_active":"2024-01-18T00:47:29.852441+0000","last_peered":"2024-01-18T00:47:29.852441+0000","last_clean":"2024-01-18T00:47:29.852441+0000","last_became_active":"2024-01-17T22:58:48.337489+0000","last_became_peered":"2024-01-17T22:58:48.337489+0000","last_unstale":"2024-01-18T00:47:29.852441+0000","last_undegraded":"2024-01-18T00:47:29.852441+0000","last_fullsized":"2024-01-18T00:47:29.852441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'406","last_scrub_stamp":"2024-01-18T00:47:29.852249+0000","last_deep_scrub":"28'406","last_deep_scrub_stamp":"2024-01-18T00:47:29.852249+0000","last_clean_scrub_stamp":"2024-01-18T00:47:29.852249+0000","objects_scrubbed":2,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:29:19.126729+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'799","reported_seq":907,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:42.729584+0000","last_change":"2024-01-18T00:47:42.729704+0000","last_active":"2024-01-18T00:47:42.729584+0000","last_peered":"2024-01-18T00:47:42.729584+0000","last_clean":"2024-01-18T00:47:42.729584+0000","last_became_active":"2024-01-17T22:58:55.902857+0000","last_became_peered":"2024-01-17T22:58:55.902857+0000","last_unstale":"2024-01-18T00:47:42.729584+0000","last_undegraded":"2024-01-18T00:47:42.729584+0000","last_fullsized":"2024-01-18T00:47:42.729584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'799","last_scrub_stamp":"2024-01-18T00:47:42.729315+0000","last_deep_scrub":"28'799","last_deep_scrub_stamp":"2024-01-18T00:47:42.729315+0000","last_clean_scrub_stamp":"2024-01-18T00:47:42.729315+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:48.862497+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":124542,"num_write":790,"num_write_kb":159708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'194","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:34.818322+0000","last_change":"2024-01-18T00:47:34.818342+0000","last_active":"2024-01-18T00:47:34.818322+0000","last_peered":"2024-01-18T00:47:34.818322+0000","last_clean":"2024-01-18T00:47:34.818322+0000","last_became_active":"2024-01-17T22:58:49.519060+0000","last_became_peered":"2024-01-17T22:58:49.519060+0000","last_unstale":"2024-01-18T00:47:34.818322+0000","last_undegraded":"2024-01-18T00:47:34.818322+0000","last_fullsized":"2024-01-18T00:47:34.818322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'194","last_scrub_stamp":"2024-01-18T00:47:34.818260+0000","last_deep_scrub":"28'194","last_deep_scrub_stamp":"2024-01-18T00:47:34.818260+0000","last_clean_scrub_stamp":"2024-01-18T00:47:34.818260+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:53:24.462275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'865","reported_seq":941,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:29.293239+0000","last_change":"2024-01-18T00:47:29.293306+0000","last_active":"2024-01-18T00:47:29.293239+0000","last_peered":"2024-01-18T00:47:29.293239+0000","last_clean":"2024-01-18T00:47:29.293239+0000","last_became_active":"2024-01-17T22:58:48.339433+0000","last_became_peered":"2024-01-17T22:58:48.339433+0000","last_unstale":"2024-01-18T00:47:29.293239+0000","last_undegraded":"2024-01-18T00:47:29.293239+0000","last_fullsized":"2024-01-18T00:47:29.293239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'865","last_scrub_stamp":"2024-01-18T00:47:29.293071+0000","last_deep_scrub":"28'865","last_deep_scrub_stamp":"2024-01-18T00:47:29.293071+0000","last_clean_scrub_stamp":"2024-01-18T00:47:29.293071+0000","objects_scrubbed":2,"log_size":865,"log_dups_size":0,"ondisk_log_size":865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:25:31.664017+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":4462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'819","reported_seq":924,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:45.167420+0000","last_change":"2024-01-18T00:47:45.167442+0000","last_active":"2024-01-18T00:47:45.167420+0000","last_peered":"2024-01-18T00:47:45.167420+0000","last_clean":"2024-01-18T00:47:45.167420+0000","last_became_active":"2024-01-17T22:58:55.904690+0000","last_became_peered":"2024-01-17T22:58:55.904690+0000","last_unstale":"2024-01-18T00:47:45.167420+0000","last_undegraded":"2024-01-18T00:47:45.167420+0000","last_fullsized":"2024-01-18T00:47:45.167420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'819","last_scrub_stamp":"2024-01-18T00:47:45.167338+0000","last_deep_scrub":"28'819","last_deep_scrub_stamp":"2024-01-18T00:47:45.167338+0000","last_clean_scrub_stamp":"2024-01-18T00:47:45.167338+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:13:44.825710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":82183,"num_write":809,"num_write_kb":113772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'190","reported_seq":264,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:23.697594+0000","last_change":"2024-01-18T00:47:23.697617+0000","last_active":"2024-01-18T00:47:23.697594+0000","last_peered":"2024-01-18T00:47:23.697594+0000","last_clean":"2024-01-18T00:47:23.697594+0000","last_became_active":"2024-01-17T22:58:49.352744+0000","last_became_peered":"2024-01-17T22:58:49.352744+0000","last_unstale":"2024-01-18T00:47:23.697594+0000","last_undegraded":"2024-01-18T00:47:23.697594+0000","last_fullsized":"2024-01-18T00:47:23.697594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'190","last_scrub_stamp":"2024-01-18T00:47:23.697529+0000","last_deep_scrub":"28'190","last_deep_scrub_stamp":"2024-01-18T00:47:23.697529+0000","last_clean_scrub_stamp":"2024-01-18T00:47:23.697529+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:52:56.826907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'872","reported_seq":948,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:22.915864+0000","last_change":"2024-01-18T00:47:22.915864+0000","last_active":"2024-01-18T00:47:22.915864+0000","last_peered":"2024-01-18T00:47:22.915864+0000","last_clean":"2024-01-18T00:47:22.915864+0000","last_became_active":"2024-01-17T22:58:48.343435+0000","last_became_peered":"2024-01-17T22:58:48.343435+0000","last_unstale":"2024-01-18T00:47:22.915864+0000","last_undegraded":"2024-01-18T00:47:22.915864+0000","last_fullsized":"2024-01-18T00:47:22.915864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'872","last_scrub_stamp":"2024-01-18T00:47:22.915771+0000","last_deep_scrub":"28'872","last_deep_scrub_stamp":"2024-01-18T00:47:22.915771+0000","last_clean_scrub_stamp":"2024-01-18T00:47:22.915771+0000","objects_scrubbed":3,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:10:51.616803+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":942,"num_write_kb":4497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'797","reported_seq":913,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:28.862016+0000","last_change":"2024-01-18T00:47:28.862053+0000","last_active":"2024-01-18T00:47:28.862016+0000","last_peered":"2024-01-18T00:47:28.862016+0000","last_clean":"2024-01-18T00:47:28.862016+0000","last_became_active":"2024-01-17T22:58:55.913197+0000","last_became_peered":"2024-01-17T22:58:55.913197+0000","last_unstale":"2024-01-18T00:47:28.862016+0000","last_undegraded":"2024-01-18T00:47:28.862016+0000","last_fullsized":"2024-01-18T00:47:28.862016+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'797","last_scrub_stamp":"2024-01-18T00:47:28.861945+0000","last_deep_scrub":"28'797","last_deep_scrub_stamp":"2024-01-18T00:47:28.861945+0000","last_clean_scrub_stamp":"2024-01-18T00:47:28.861945+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:42:57.348068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":146211,"num_write":781,"num_write_kb":158858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'235","reported_seq":308,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:24.102479+0000","last_change":"2024-01-18T00:47:24.102499+0000","last_active":"2024-01-18T00:47:24.102479+0000","last_peered":"2024-01-18T00:47:24.102479+0000","last_clean":"2024-01-18T00:47:24.102479+0000","last_became_active":"2024-01-17T22:58:49.368018+0000","last_became_peered":"2024-01-17T22:58:49.368018+0000","last_unstale":"2024-01-18T00:47:24.102479+0000","last_undegraded":"2024-01-18T00:47:24.102479+0000","last_fullsized":"2024-01-18T00:47:24.102479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'235","last_scrub_stamp":"2024-01-18T00:47:24.102414+0000","last_deep_scrub":"28'235","last_deep_scrub_stamp":"2024-01-18T00:47:24.102414+0000","last_clean_scrub_stamp":"2024-01-18T00:47:24.102414+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:16.064043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'711","reported_seq":785,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:30.350976+0000","last_change":"2024-01-18T00:47:30.351126+0000","last_active":"2024-01-18T00:47:30.350976+0000","last_peered":"2024-01-18T00:47:30.350976+0000","last_clean":"2024-01-18T00:47:30.350976+0000","last_became_active":"2024-01-17T22:58:48.373287+0000","last_became_peered":"2024-01-17T22:58:48.373287+0000","last_unstale":"2024-01-18T00:47:30.350976+0000","last_undegraded":"2024-01-18T00:47:30.350976+0000","last_fullsized":"2024-01-18T00:47:30.350976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'711","last_scrub_stamp":"2024-01-18T00:47:30.350778+0000","last_deep_scrub":"28'711","last_deep_scrub_stamp":"2024-01-18T00:47:30.350778+0000","last_clean_scrub_stamp":"2024-01-18T00:47:30.350778+0000","objects_scrubbed":10,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:56:22.312407+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":649,"num_write_kb":8541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'825","reported_seq":950,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:43.743820+0000","last_change":"2024-01-18T00:47:43.743820+0000","last_active":"2024-01-18T00:47:43.743820+0000","last_peered":"2024-01-18T00:47:43.743820+0000","last_clean":"2024-01-18T00:47:43.743820+0000","last_became_active":"2024-01-17T22:58:55.909139+0000","last_became_peered":"2024-01-17T22:58:55.909139+0000","last_unstale":"2024-01-18T00:47:43.743820+0000","last_undegraded":"2024-01-18T00:47:43.743820+0000","last_fullsized":"2024-01-18T00:47:43.743820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'825","last_scrub_stamp":"2024-01-18T00:47:43.743580+0000","last_deep_scrub":"28'825","last_deep_scrub_stamp":"2024-01-18T00:47:43.743580+0000","last_clean_scrub_stamp":"2024-01-18T00:47:43.743580+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:00:11.473109+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":204092,"num_write":802,"num_write_kb":163340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'217","reported_seq":289,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:23.835079+0000","last_change":"2024-01-18T00:47:23.835098+0000","last_active":"2024-01-18T00:47:23.835079+0000","last_peered":"2024-01-18T00:47:23.835079+0000","last_clean":"2024-01-18T00:47:23.835079+0000","last_became_active":"2024-01-17T22:58:49.514776+0000","last_became_peered":"2024-01-17T22:58:49.514776+0000","last_unstale":"2024-01-18T00:47:23.835079+0000","last_undegraded":"2024-01-18T00:47:23.835079+0000","last_fullsized":"2024-01-18T00:47:23.835079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'217","last_scrub_stamp":"2024-01-18T00:47:23.835022+0000","last_deep_scrub":"28'217","last_deep_scrub_stamp":"2024-01-18T00:47:23.835022+0000","last_clean_scrub_stamp":"2024-01-18T00:47:23.835022+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:37:56.941376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'66","reported_seq":140,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:25.853274+0000","last_change":"2024-01-18T00:47:25.853312+0000","last_active":"2024-01-18T00:47:25.853274+0000","last_peered":"2024-01-18T00:47:25.853274+0000","last_clean":"2024-01-18T00:47:25.853274+0000","last_became_active":"2024-01-17T22:58:48.349193+0000","last_became_peered":"2024-01-17T22:58:48.349193+0000","last_unstale":"2024-01-18T00:47:25.853274+0000","last_undegraded":"2024-01-18T00:47:25.853274+0000","last_fullsized":"2024-01-18T00:47:25.853274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'66","last_scrub_stamp":"2024-01-18T00:47:25.853201+0000","last_deep_scrub":"28'66","last_deep_scrub_stamp":"2024-01-18T00:47:25.853201+0000","last_clean_scrub_stamp":"2024-01-18T00:47:25.853201+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:51:49.020242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'809","reported_seq":929,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:44.729302+0000","last_change":"2024-01-18T00:47:44.729368+0000","last_active":"2024-01-18T00:47:44.729302+0000","last_peered":"2024-01-18T00:47:44.729302+0000","last_clean":"2024-01-18T00:47:44.729302+0000","last_became_active":"2024-01-17T22:58:55.910147+0000","last_became_peered":"2024-01-17T22:58:55.910147+0000","last_unstale":"2024-01-18T00:47:44.729302+0000","last_undegraded":"2024-01-18T00:47:44.729302+0000","last_fullsized":"2024-01-18T00:47:44.729302+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'809","last_scrub_stamp":"2024-01-18T00:47:44.729120+0000","last_deep_scrub":"28'809","last_deep_scrub_stamp":"2024-01-18T00:47:44.729120+0000","last_clean_scrub_stamp":"2024-01-18T00:47:44.729120+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:59:27.442217+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":124212,"num_write":791,"num_write_kb":164591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'198","reported_seq":271,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:28.152253+0000","last_change":"2024-01-18T00:47:28.152275+0000","last_active":"2024-01-18T00:47:28.152253+0000","last_peered":"2024-01-18T00:47:28.152253+0000","last_clean":"2024-01-18T00:47:28.152253+0000","last_became_active":"2024-01-17T22:58:49.366055+0000","last_became_peered":"2024-01-17T22:58:49.366055+0000","last_unstale":"2024-01-18T00:47:28.152253+0000","last_undegraded":"2024-01-18T00:47:28.152253+0000","last_fullsized":"2024-01-18T00:47:28.152253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'198","last_scrub_stamp":"2024-01-18T00:47:28.152188+0000","last_deep_scrub":"28'198","last_deep_scrub_stamp":"2024-01-18T00:47:28.152188+0000","last_clean_scrub_stamp":"2024-01-18T00:47:28.152188+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:21:11.333907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'55","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:32.133710+0000","last_change":"2024-01-18T00:47:32.133732+0000","last_active":"2024-01-18T00:47:32.133710+0000","last_peered":"2024-01-18T00:47:32.133710+0000","last_clean":"2024-01-18T00:47:32.133710+0000","last_became_active":"2024-01-17T22:58:48.377732+0000","last_became_peered":"2024-01-17T22:58:48.377732+0000","last_unstale":"2024-01-18T00:47:32.133710+0000","last_undegraded":"2024-01-18T00:47:32.133710+0000","last_fullsized":"2024-01-18T00:47:32.133710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'55","last_scrub_stamp":"2024-01-18T00:47:32.133655+0000","last_deep_scrub":"28'55","last_deep_scrub_stamp":"2024-01-18T00:47:32.133655+0000","last_clean_scrub_stamp":"2024-01-18T00:47:32.133655+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:48:25.096740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'664","reported_seq":757,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:40.400726+0000","last_change":"2024-01-18T00:47:40.400789+0000","last_active":"2024-01-18T00:47:40.400726+0000","last_peered":"2024-01-18T00:47:40.400726+0000","last_clean":"2024-01-18T00:47:40.400726+0000","last_became_active":"2024-01-17T22:59:09.244621+0000","last_became_peered":"2024-01-17T22:59:09.244621+0000","last_unstale":"2024-01-18T00:47:40.400726+0000","last_undegraded":"2024-01-18T00:47:40.400726+0000","last_fullsized":"2024-01-18T00:47:40.400726+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'664","last_scrub_stamp":"2024-01-18T00:47:40.400563+0000","last_deep_scrub":"28'664","last_deep_scrub_stamp":"2024-01-18T00:47:40.400563+0000","last_clean_scrub_stamp":"2024-01-18T00:47:40.400563+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:08:13.507484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":44179,"num_write":651,"num_write_kb":63897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,5],"acting":[6,4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'209","reported_seq":282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.417392+0000","last_change":"2024-01-18T00:47:31.417505+0000","last_active":"2024-01-18T00:47:31.417392+0000","last_peered":"2024-01-18T00:47:31.417392+0000","last_clean":"2024-01-18T00:47:31.417392+0000","last_became_active":"2024-01-17T22:58:49.367258+0000","last_became_peered":"2024-01-17T22:58:49.367258+0000","last_unstale":"2024-01-18T00:47:31.417392+0000","last_undegraded":"2024-01-18T00:47:31.417392+0000","last_fullsized":"2024-01-18T00:47:31.417392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'209","last_scrub_stamp":"2024-01-18T00:47:31.417148+0000","last_deep_scrub":"28'209","last_deep_scrub_stamp":"2024-01-18T00:47:31.417148+0000","last_clean_scrub_stamp":"2024-01-18T00:47:31.417148+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:26:59.784543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'374","reported_seq":448,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:27.139297+0000","last_change":"2024-01-18T00:47:27.139403+0000","last_active":"2024-01-18T00:47:27.139297+0000","last_peered":"2024-01-18T00:47:27.139297+0000","last_clean":"2024-01-18T00:47:27.139297+0000","last_became_active":"2024-01-17T22:58:48.370691+0000","last_became_peered":"2024-01-17T22:58:48.370691+0000","last_unstale":"2024-01-18T00:47:27.139297+0000","last_undegraded":"2024-01-18T00:47:27.139297+0000","last_fullsized":"2024-01-18T00:47:27.139297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'374","last_scrub_stamp":"2024-01-18T00:47:27.139033+0000","last_deep_scrub":"28'374","last_deep_scrub_stamp":"2024-01-18T00:47:27.139033+0000","last_clean_scrub_stamp":"2024-01-18T00:47:27.139033+0000","objects_scrubbed":6,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:14:35.566185+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":8326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'675","reported_seq":761,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:44.193671+0000","last_change":"2024-01-18T00:47:44.193709+0000","last_active":"2024-01-18T00:47:44.193671+0000","last_peered":"2024-01-18T00:47:44.193671+0000","last_clean":"2024-01-18T00:47:44.193671+0000","last_became_active":"2024-01-17T22:58:55.846382+0000","last_became_peered":"2024-01-17T22:58:55.846382+0000","last_unstale":"2024-01-18T00:47:44.193671+0000","last_undegraded":"2024-01-18T00:47:44.193671+0000","last_fullsized":"2024-01-18T00:47:44.193671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'675","last_scrub_stamp":"2024-01-18T00:47:44.193593+0000","last_deep_scrub":"28'675","last_deep_scrub_stamp":"2024-01-18T00:47:44.193593+0000","last_clean_scrub_stamp":"2024-01-18T00:47:44.193593+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:39:28.894714+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":43277,"num_write":656,"num_write_kb":56099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'195","reported_seq":267,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.790498+0000","last_change":"2024-01-18T00:47:31.790498+0000","last_active":"2024-01-18T00:47:31.790498+0000","last_peered":"2024-01-18T00:47:31.790498+0000","last_clean":"2024-01-18T00:47:31.790498+0000","last_became_active":"2024-01-17T22:58:49.367370+0000","last_became_peered":"2024-01-17T22:58:49.367370+0000","last_unstale":"2024-01-18T00:47:31.790498+0000","last_undegraded":"2024-01-18T00:47:31.790498+0000","last_fullsized":"2024-01-18T00:47:31.790498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'195","last_scrub_stamp":"2024-01-18T00:47:31.790416+0000","last_deep_scrub":"28'195","last_deep_scrub_stamp":"2024-01-18T00:47:31.790416+0000","last_clean_scrub_stamp":"2024-01-18T00:47:31.790416+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:17:15.638833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'1306","reported_seq":1379,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:22.722529+0000","last_change":"2024-01-18T00:47:22.722561+0000","last_active":"2024-01-18T00:47:22.722529+0000","last_peered":"2024-01-18T00:47:22.722529+0000","last_clean":"2024-01-18T00:47:22.722529+0000","last_became_active":"2024-01-17T22:58:48.346574+0000","last_became_peered":"2024-01-17T22:58:48.346574+0000","last_unstale":"2024-01-18T00:47:22.722529+0000","last_undegraded":"2024-01-18T00:47:22.722529+0000","last_fullsized":"2024-01-18T00:47:22.722529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1306","last_scrub_stamp":"2024-01-18T00:47:22.722473+0000","last_deep_scrub":"28'1306","last_deep_scrub_stamp":"2024-01-18T00:47:22.722473+0000","last_clean_scrub_stamp":"2024-01-18T00:47:22.722473+0000","objects_scrubbed":7,"log_size":1306,"log_dups_size":0,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:27:51.317400+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":13137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'811","reported_seq":924,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:36.328143+0000","last_change":"2024-01-18T00:47:36.328208+0000","last_active":"2024-01-18T00:47:36.328143+0000","last_peered":"2024-01-18T00:47:36.328143+0000","last_clean":"2024-01-18T00:47:36.328143+0000","last_became_active":"2024-01-17T22:58:55.831090+0000","last_became_peered":"2024-01-17T22:58:55.831090+0000","last_unstale":"2024-01-18T00:47:36.328143+0000","last_undegraded":"2024-01-18T00:47:36.328143+0000","last_fullsized":"2024-01-18T00:47:36.328143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'811","last_scrub_stamp":"2024-01-18T00:47:36.327980+0000","last_deep_scrub":"28'811","last_deep_scrub_stamp":"2024-01-18T00:47:36.327980+0000","last_clean_scrub_stamp":"2024-01-18T00:47:36.327980+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:36:56.468973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":127549,"num_write":788,"num_write_kb":160232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'198","reported_seq":271,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:30.163504+0000","last_change":"2024-01-18T00:47:30.163539+0000","last_active":"2024-01-18T00:47:30.163504+0000","last_peered":"2024-01-18T00:47:30.163504+0000","last_clean":"2024-01-18T00:47:30.163504+0000","last_became_active":"2024-01-17T22:58:49.365846+0000","last_became_peered":"2024-01-17T22:58:49.365846+0000","last_unstale":"2024-01-18T00:47:30.163504+0000","last_undegraded":"2024-01-18T00:47:30.163504+0000","last_fullsized":"2024-01-18T00:47:30.163504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'198","last_scrub_stamp":"2024-01-18T00:47:30.163432+0000","last_deep_scrub":"28'198","last_deep_scrub_stamp":"2024-01-18T00:47:30.163432+0000","last_clean_scrub_stamp":"2024-01-18T00:47:30.163432+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:02:30.140975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'1449","reported_seq":1522,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:29.178030+0000","last_change":"2024-01-18T00:47:29.178030+0000","last_active":"2024-01-18T00:47:29.178030+0000","last_peered":"2024-01-18T00:47:29.178030+0000","last_clean":"2024-01-18T00:47:29.178030+0000","last_became_active":"2024-01-17T22:58:48.375504+0000","last_became_peered":"2024-01-17T22:58:48.375504+0000","last_unstale":"2024-01-18T00:47:29.178030+0000","last_undegraded":"2024-01-18T00:47:29.178030+0000","last_fullsized":"2024-01-18T00:47:29.178030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1449","last_scrub_stamp":"2024-01-18T00:47:29.177803+0000","last_deep_scrub":"28'1449","last_deep_scrub_stamp":"2024-01-18T00:47:29.177803+0000","last_clean_scrub_stamp":"2024-01-18T00:47:29.177803+0000","objects_scrubbed":4,"log_size":1449,"log_dups_size":0,"ondisk_log_size":1449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:42:57.663926+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1379,"num_write_kb":5332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'771","reported_seq":876,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.698476+0000","last_change":"2024-01-18T00:47:35.698499+0000","last_active":"2024-01-18T00:47:35.698476+0000","last_peered":"2024-01-18T00:47:35.698476+0000","last_clean":"2024-01-18T00:47:35.698476+0000","last_became_active":"2024-01-17T22:58:55.906429+0000","last_became_peered":"2024-01-17T22:58:55.906429+0000","last_unstale":"2024-01-18T00:47:35.698476+0000","last_undegraded":"2024-01-18T00:47:35.698476+0000","last_fullsized":"2024-01-18T00:47:35.698476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'771","last_scrub_stamp":"2024-01-18T00:47:35.698406+0000","last_deep_scrub":"28'771","last_deep_scrub_stamp":"2024-01-18T00:47:35.698406+0000","last_clean_scrub_stamp":"2024-01-18T00:47:35.698406+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:41:38.127491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":103553,"num_write":751,"num_write_kb":113909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'197","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:28.834731+0000","last_change":"2024-01-18T00:47:28.834731+0000","last_active":"2024-01-18T00:47:28.834731+0000","last_peered":"2024-01-18T00:47:28.834731+0000","last_clean":"2024-01-18T00:47:28.834731+0000","last_became_active":"2024-01-17T22:58:49.360282+0000","last_became_peered":"2024-01-17T22:58:49.360282+0000","last_unstale":"2024-01-18T00:47:28.834731+0000","last_undegraded":"2024-01-18T00:47:28.834731+0000","last_fullsized":"2024-01-18T00:47:28.834731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'197","last_scrub_stamp":"2024-01-18T00:47:28.834514+0000","last_deep_scrub":"28'197","last_deep_scrub_stamp":"2024-01-18T00:47:28.834514+0000","last_clean_scrub_stamp":"2024-01-18T00:47:28.834514+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:51:52.001556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'185","reported_seq":258,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:26.849637+0000","last_change":"2024-01-18T00:47:26.849637+0000","last_active":"2024-01-18T00:47:26.849637+0000","last_peered":"2024-01-18T00:47:26.849637+0000","last_clean":"2024-01-18T00:47:26.849637+0000","last_became_active":"2024-01-17T22:58:48.349262+0000","last_became_peered":"2024-01-17T22:58:48.349262+0000","last_unstale":"2024-01-18T00:47:26.849637+0000","last_undegraded":"2024-01-18T00:47:26.849637+0000","last_fullsized":"2024-01-18T00:47:26.849637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'185","last_scrub_stamp":"2024-01-18T00:47:26.849551+0000","last_deep_scrub":"28'185","last_deep_scrub_stamp":"2024-01-18T00:47:26.849551+0000","last_clean_scrub_stamp":"2024-01-18T00:47:26.849551+0000","objects_scrubbed":2,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:29:16.124031+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'853","reported_seq":951,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:33.219352+0000","last_change":"2024-01-18T00:47:33.219490+0000","last_active":"2024-01-18T00:47:33.219352+0000","last_peered":"2024-01-18T00:47:33.219352+0000","last_clean":"2024-01-18T00:47:33.219352+0000","last_became_active":"2024-01-17T22:58:55.899176+0000","last_became_peered":"2024-01-17T22:58:55.899176+0000","last_unstale":"2024-01-18T00:47:33.219352+0000","last_undegraded":"2024-01-18T00:47:33.219352+0000","last_fullsized":"2024-01-18T00:47:33.219352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'853","last_scrub_stamp":"2024-01-18T00:47:33.219137+0000","last_deep_scrub":"28'853","last_deep_scrub_stamp":"2024-01-18T00:47:33.219137+0000","last_clean_scrub_stamp":"2024-01-18T00:47:33.219137+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:34.408099+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":85515,"num_write":843,"num_write_kb":192821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'218","reported_seq":289,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:24.731816+0000","last_change":"2024-01-18T00:47:24.731816+0000","last_active":"2024-01-18T00:47:24.731816+0000","last_peered":"2024-01-18T00:47:24.731816+0000","last_clean":"2024-01-18T00:47:24.731816+0000","last_became_active":"2024-01-17T22:58:49.363979+0000","last_became_peered":"2024-01-17T22:58:49.363979+0000","last_unstale":"2024-01-18T00:47:24.731816+0000","last_undegraded":"2024-01-18T00:47:24.731816+0000","last_fullsized":"2024-01-18T00:47:24.731816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'218","last_scrub_stamp":"2024-01-18T00:47:24.731720+0000","last_deep_scrub":"28'218","last_deep_scrub_stamp":"2024-01-18T00:47:24.731720+0000","last_clean_scrub_stamp":"2024-01-18T00:47:24.731720+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:05:55.164501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'58","reported_seq":130,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:22.873678+0000","last_change":"2024-01-18T00:47:22.873678+0000","last_active":"2024-01-18T00:47:22.873678+0000","last_peered":"2024-01-18T00:47:22.873678+0000","last_clean":"2024-01-18T00:47:22.873678+0000","last_became_active":"2024-01-17T22:58:48.321379+0000","last_became_peered":"2024-01-17T22:58:48.321379+0000","last_unstale":"2024-01-18T00:47:22.873678+0000","last_undegraded":"2024-01-18T00:47:22.873678+0000","last_fullsized":"2024-01-18T00:47:22.873678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'58","last_scrub_stamp":"2024-01-18T00:47:22.873594+0000","last_deep_scrub":"28'58","last_deep_scrub_stamp":"2024-01-18T00:47:22.873594+0000","last_clean_scrub_stamp":"2024-01-18T00:47:22.873594+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:32:41.455855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'867","reported_seq":987,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:37.322417+0000","last_change":"2024-01-18T00:47:37.322479+0000","last_active":"2024-01-18T00:47:37.322417+0000","last_peered":"2024-01-18T00:47:37.322417+0000","last_clean":"2024-01-18T00:47:37.322417+0000","last_became_active":"2024-01-17T22:58:55.872885+0000","last_became_peered":"2024-01-17T22:58:55.872885+0000","last_unstale":"2024-01-18T00:47:37.322417+0000","last_undegraded":"2024-01-18T00:47:37.322417+0000","last_fullsized":"2024-01-18T00:47:37.322417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'867","last_scrub_stamp":"2024-01-18T00:47:37.322193+0000","last_deep_scrub":"28'867","last_deep_scrub_stamp":"2024-01-18T00:47:37.322193+0000","last_clean_scrub_stamp":"2024-01-18T00:47:37.322193+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:08:10.429114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":173952,"num_write":855,"num_write_kb":180962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'734","reported_seq":847,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:39.389000+0000","last_change":"2024-01-18T00:47:39.389063+0000","last_active":"2024-01-18T00:47:39.389000+0000","last_peered":"2024-01-18T00:47:39.389000+0000","last_clean":"2024-01-18T00:47:39.389000+0000","last_became_active":"2024-01-17T22:58:55.902860+0000","last_became_peered":"2024-01-17T22:58:55.902860+0000","last_unstale":"2024-01-18T00:47:39.389000+0000","last_undegraded":"2024-01-18T00:47:39.389000+0000","last_fullsized":"2024-01-18T00:47:39.389000+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'734","last_scrub_stamp":"2024-01-18T00:47:39.388824+0000","last_deep_scrub":"28'734","last_deep_scrub_stamp":"2024-01-18T00:47:39.388824+0000","last_clean_scrub_stamp":"2024-01-18T00:47:39.388824+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:09:33.540872+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":112144,"num_write":721,"num_write_kb":109826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'202","reported_seq":273,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.372464+0000","last_change":"2024-01-18T00:47:35.372580+0000","last_active":"2024-01-18T00:47:35.372464+0000","last_peered":"2024-01-18T00:47:35.372464+0000","last_clean":"2024-01-18T00:47:35.372464+0000","last_became_active":"2024-01-17T22:58:49.514297+0000","last_became_peered":"2024-01-17T22:58:49.514297+0000","last_unstale":"2024-01-18T00:47:35.372464+0000","last_undegraded":"2024-01-18T00:47:35.372464+0000","last_fullsized":"2024-01-18T00:47:35.372464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'202","last_scrub_stamp":"2024-01-18T00:47:35.372171+0000","last_deep_scrub":"28'202","last_deep_scrub_stamp":"2024-01-18T00:47:35.372171+0000","last_clean_scrub_stamp":"2024-01-18T00:47:35.372171+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:56:26.918237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'1282","reported_seq":1355,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:33.180161+0000","last_change":"2024-01-18T00:47:33.180161+0000","last_active":"2024-01-18T00:47:33.180161+0000","last_peered":"2024-01-18T00:47:33.180161+0000","last_clean":"2024-01-18T00:47:33.180161+0000","last_became_active":"2024-01-17T22:58:48.331645+0000","last_became_peered":"2024-01-17T22:58:48.331645+0000","last_unstale":"2024-01-18T00:47:33.180161+0000","last_undegraded":"2024-01-18T00:47:33.180161+0000","last_fullsized":"2024-01-18T00:47:33.180161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1282","last_scrub_stamp":"2024-01-18T00:47:33.180066+0000","last_deep_scrub":"28'1282","last_deep_scrub_stamp":"2024-01-18T00:47:33.180066+0000","last_clean_scrub_stamp":"2024-01-18T00:47:33.180066+0000","objects_scrubbed":3,"log_size":1282,"log_dups_size":0,"ondisk_log_size":1282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:49:49.880434+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":12872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'696","reported_seq":790,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:46.121058+0000","last_change":"2024-01-18T00:47:46.121079+0000","last_active":"2024-01-18T00:47:46.121058+0000","last_peered":"2024-01-18T00:47:46.121058+0000","last_clean":"2024-01-18T00:47:46.121058+0000","last_became_active":"2024-01-17T22:58:55.905743+0000","last_became_peered":"2024-01-17T22:58:55.905743+0000","last_unstale":"2024-01-18T00:47:46.121058+0000","last_undegraded":"2024-01-18T00:47:46.121058+0000","last_fullsized":"2024-01-18T00:47:46.121058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'696","last_scrub_stamp":"2024-01-18T00:47:46.120989+0000","last_deep_scrub":"28'696","last_deep_scrub_stamp":"2024-01-18T00:47:46.120989+0000","last_clean_scrub_stamp":"2024-01-18T00:47:46.120989+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:40:02.211023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":59282,"num_write":679,"num_write_kb":96928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'234","reported_seq":306,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:25.886880+0000","last_change":"2024-01-18T00:47:25.886880+0000","last_active":"2024-01-18T00:47:25.886880+0000","last_peered":"2024-01-18T00:47:25.886880+0000","last_clean":"2024-01-18T00:47:25.886880+0000","last_became_active":"2024-01-17T22:58:49.366692+0000","last_became_peered":"2024-01-17T22:58:49.366692+0000","last_unstale":"2024-01-18T00:47:25.886880+0000","last_undegraded":"2024-01-18T00:47:25.886880+0000","last_fullsized":"2024-01-18T00:47:25.886880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'234","last_scrub_stamp":"2024-01-18T00:47:25.886648+0000","last_deep_scrub":"28'234","last_deep_scrub_stamp":"2024-01-18T00:47:25.886648+0000","last_clean_scrub_stamp":"2024-01-18T00:47:25.886648+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:10:54.587680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'172","reported_seq":244,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:27.420802+0000","last_change":"2024-01-18T00:47:27.420866+0000","last_active":"2024-01-18T00:47:27.420802+0000","last_peered":"2024-01-18T00:47:27.420802+0000","last_clean":"2024-01-18T00:47:27.420802+0000","last_became_active":"2024-01-17T22:58:48.344271+0000","last_became_peered":"2024-01-17T22:58:48.344271+0000","last_unstale":"2024-01-18T00:47:27.420802+0000","last_undegraded":"2024-01-18T00:47:27.420802+0000","last_fullsized":"2024-01-18T00:47:27.420802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'172","last_scrub_stamp":"2024-01-18T00:47:27.420640+0000","last_deep_scrub":"28'172","last_deep_scrub_stamp":"2024-01-18T00:47:27.420640+0000","last_clean_scrub_stamp":"2024-01-18T00:47:27.420640+0000","objects_scrubbed":2,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:05:57.853421+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'1518","reported_seq":1589,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:39.174784+0000","last_change":"2024-01-18T00:47:39.174812+0000","last_active":"2024-01-18T00:47:39.174784+0000","last_peered":"2024-01-18T00:47:39.174784+0000","last_clean":"2024-01-18T00:47:39.174784+0000","last_became_active":"2024-01-17T22:58:48.339364+0000","last_became_peered":"2024-01-17T22:58:48.339364+0000","last_unstale":"2024-01-18T00:47:39.174784+0000","last_undegraded":"2024-01-18T00:47:39.174784+0000","last_fullsized":"2024-01-18T00:47:39.174784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1518","last_scrub_stamp":"2024-01-18T00:47:39.174728+0000","last_deep_scrub":"28'1518","last_deep_scrub_stamp":"2024-01-18T00:47:39.174728+0000","last_clean_scrub_stamp":"2024-01-18T00:47:39.174728+0000","objects_scrubbed":5,"log_size":1518,"log_dups_size":0,"ondisk_log_size":1518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:19:23.757834+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16419543,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1459,"num_write_kb":16764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'186","reported_seq":256,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:25.267478+0000","last_change":"2024-01-18T00:47:25.267644+0000","last_active":"2024-01-18T00:47:25.267478+0000","last_peered":"2024-01-18T00:47:25.267478+0000","last_clean":"2024-01-18T00:47:25.267478+0000","last_became_active":"2024-01-17T22:58:49.414163+0000","last_became_peered":"2024-01-17T22:58:49.414163+0000","last_unstale":"2024-01-18T00:47:25.267478+0000","last_undegraded":"2024-01-18T00:47:25.267478+0000","last_fullsized":"2024-01-18T00:47:25.267478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'186","last_scrub_stamp":"2024-01-18T00:47:25.267213+0000","last_deep_scrub":"28'186","last_deep_scrub_stamp":"2024-01-18T00:47:25.267213+0000","last_clean_scrub_stamp":"2024-01-18T00:47:25.267213+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:11:20.336269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'765","reported_seq":864,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:38.366487+0000","last_change":"2024-01-18T00:47:38.366551+0000","last_active":"2024-01-18T00:47:38.366487+0000","last_peered":"2024-01-18T00:47:38.366487+0000","last_clean":"2024-01-18T00:47:38.366487+0000","last_became_active":"2024-01-17T22:58:55.879263+0000","last_became_peered":"2024-01-17T22:58:55.879263+0000","last_unstale":"2024-01-18T00:47:38.366487+0000","last_undegraded":"2024-01-18T00:47:38.366487+0000","last_fullsized":"2024-01-18T00:47:38.366487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'765","last_scrub_stamp":"2024-01-18T00:47:38.366281+0000","last_deep_scrub":"28'765","last_deep_scrub_stamp":"2024-01-18T00:47:38.366281+0000","last_clean_scrub_stamp":"2024-01-18T00:47:38.366281+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:48:31.329366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":97351,"num_write":747,"num_write_kb":155607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'210","reported_seq":281,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:30.883772+0000","last_change":"2024-01-18T00:47:30.883842+0000","last_active":"2024-01-18T00:47:30.883772+0000","last_peered":"2024-01-18T00:47:30.883772+0000","last_clean":"2024-01-18T00:47:30.883772+0000","last_became_active":"2024-01-17T22:58:48.338809+0000","last_became_peered":"2024-01-17T22:58:48.338809+0000","last_unstale":"2024-01-18T00:47:30.883772+0000","last_undegraded":"2024-01-18T00:47:30.883772+0000","last_fullsized":"2024-01-18T00:47:30.883772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'210","last_scrub_stamp":"2024-01-18T00:47:30.883599+0000","last_deep_scrub":"28'210","last_deep_scrub_stamp":"2024-01-18T00:47:30.883599+0000","last_clean_scrub_stamp":"2024-01-18T00:47:30.883599+0000","objects_scrubbed":3,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:04:55.011112+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195321,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'206","reported_seq":275,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:26.903427+0000","last_change":"2024-01-18T00:47:26.903447+0000","last_active":"2024-01-18T00:47:26.903427+0000","last_peered":"2024-01-18T00:47:26.903427+0000","last_clean":"2024-01-18T00:47:26.903427+0000","last_became_active":"2024-01-17T22:58:49.518211+0000","last_became_peered":"2024-01-17T22:58:49.518211+0000","last_unstale":"2024-01-18T00:47:26.903427+0000","last_undegraded":"2024-01-18T00:47:26.903427+0000","last_fullsized":"2024-01-18T00:47:26.903427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'206","last_scrub_stamp":"2024-01-18T00:47:26.903365+0000","last_deep_scrub":"28'206","last_deep_scrub_stamp":"2024-01-18T00:47:26.903365+0000","last_clean_scrub_stamp":"2024-01-18T00:47:26.903365+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:29:51.634207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'779","reported_seq":888,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.199341+0000","last_change":"2024-01-18T00:47:35.199390+0000","last_active":"2024-01-18T00:47:35.199341+0000","last_peered":"2024-01-18T00:47:35.199341+0000","last_clean":"2024-01-18T00:47:35.199341+0000","last_became_active":"2024-01-17T22:58:55.912825+0000","last_became_peered":"2024-01-17T22:58:55.912825+0000","last_unstale":"2024-01-18T00:47:35.199341+0000","last_undegraded":"2024-01-18T00:47:35.199341+0000","last_fullsized":"2024-01-18T00:47:35.199341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'779","last_scrub_stamp":"2024-01-18T00:47:35.199232+0000","last_deep_scrub":"28'779","last_deep_scrub_stamp":"2024-01-18T00:47:35.199232+0000","last_clean_scrub_stamp":"2024-01-18T00:47:35.199232+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:56:42.841317+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":138691,"num_write":762,"num_write_kb":151906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'221","reported_seq":299,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:27.696805+0000","last_change":"2024-01-18T00:47:27.696825+0000","last_active":"2024-01-18T00:47:27.696805+0000","last_peered":"2024-01-18T00:47:27.696805+0000","last_clean":"2024-01-18T00:47:27.696805+0000","last_became_active":"2024-01-17T22:58:49.371125+0000","last_became_peered":"2024-01-17T22:58:49.371125+0000","last_unstale":"2024-01-18T00:47:27.696805+0000","last_undegraded":"2024-01-18T00:47:27.696805+0000","last_fullsized":"2024-01-18T00:47:27.696805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'221","last_scrub_stamp":"2024-01-18T00:47:27.696744+0000","last_deep_scrub":"28'221","last_deep_scrub_stamp":"2024-01-18T00:47:27.696744+0000","last_clean_scrub_stamp":"2024-01-18T00:47:27.696744+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:56:35.338829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'215","reported_seq":294,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:32.177968+0000","last_change":"2024-01-18T00:47:32.178022+0000","last_active":"2024-01-18T00:47:32.177968+0000","last_peered":"2024-01-18T00:47:32.177968+0000","last_clean":"2024-01-18T00:47:32.177968+0000","last_became_active":"2024-01-17T22:58:49.509690+0000","last_became_peered":"2024-01-17T22:58:49.509690+0000","last_unstale":"2024-01-18T00:47:32.177968+0000","last_undegraded":"2024-01-18T00:47:32.177968+0000","last_fullsized":"2024-01-18T00:47:32.177968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'215","last_scrub_stamp":"2024-01-18T00:47:32.177831+0000","last_deep_scrub":"28'215","last_deep_scrub_stamp":"2024-01-18T00:47:32.177831+0000","last_clean_scrub_stamp":"2024-01-18T00:47:32.177831+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:11:27.246887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'233","reported_seq":312,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:27.104884+0000","last_change":"2024-01-18T00:47:27.104915+0000","last_active":"2024-01-18T00:47:27.104884+0000","last_peered":"2024-01-18T00:47:27.104884+0000","last_clean":"2024-01-18T00:47:27.104884+0000","last_became_active":"2024-01-17T22:58:49.370511+0000","last_became_peered":"2024-01-17T22:58:49.370511+0000","last_unstale":"2024-01-18T00:47:27.104884+0000","last_undegraded":"2024-01-18T00:47:27.104884+0000","last_fullsized":"2024-01-18T00:47:27.104884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'233","last_scrub_stamp":"2024-01-18T00:47:27.104812+0000","last_deep_scrub":"28'233","last_deep_scrub_stamp":"2024-01-18T00:47:27.104812+0000","last_clean_scrub_stamp":"2024-01-18T00:47:27.104812+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:32:06.746264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'208","reported_seq":287,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:27.854044+0000","last_change":"2024-01-18T00:47:27.854044+0000","last_active":"2024-01-18T00:47:27.854044+0000","last_peered":"2024-01-18T00:47:27.854044+0000","last_clean":"2024-01-18T00:47:27.854044+0000","last_became_active":"2024-01-17T22:58:49.384397+0000","last_became_peered":"2024-01-17T22:58:49.384397+0000","last_unstale":"2024-01-18T00:47:27.854044+0000","last_undegraded":"2024-01-18T00:47:27.854044+0000","last_fullsized":"2024-01-18T00:47:27.854044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'208","last_scrub_stamp":"2024-01-18T00:47:27.853820+0000","last_deep_scrub":"28'208","last_deep_scrub_stamp":"2024-01-18T00:47:27.853820+0000","last_clean_scrub_stamp":"2024-01-18T00:47:27.853820+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:17:51.765227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'188","reported_seq":265,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:32.423691+0000","last_change":"2024-01-18T00:47:32.423749+0000","last_active":"2024-01-18T00:47:32.423691+0000","last_peered":"2024-01-18T00:47:32.423691+0000","last_clean":"2024-01-18T00:47:32.423691+0000","last_became_active":"2024-01-17T22:58:49.368591+0000","last_became_peered":"2024-01-17T22:58:49.368591+0000","last_unstale":"2024-01-18T00:47:32.423691+0000","last_undegraded":"2024-01-18T00:47:32.423691+0000","last_fullsized":"2024-01-18T00:47:32.423691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'188","last_scrub_stamp":"2024-01-18T00:47:32.423530+0000","last_deep_scrub":"28'188","last_deep_scrub_stamp":"2024-01-18T00:47:32.423530+0000","last_clean_scrub_stamp":"2024-01-18T00:47:32.423530+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:25:34.794476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'203","reported_seq":280,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:34.381296+0000","last_change":"2024-01-18T00:47:34.381401+0000","last_active":"2024-01-18T00:47:34.381296+0000","last_peered":"2024-01-18T00:47:34.381296+0000","last_clean":"2024-01-18T00:47:34.381296+0000","last_became_active":"2024-01-17T22:58:49.379560+0000","last_became_peered":"2024-01-17T22:58:49.379560+0000","last_unstale":"2024-01-18T00:47:34.381296+0000","last_undegraded":"2024-01-18T00:47:34.381296+0000","last_fullsized":"2024-01-18T00:47:34.381296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'203","last_scrub_stamp":"2024-01-18T00:47:34.381046+0000","last_deep_scrub":"28'203","last_deep_scrub_stamp":"2024-01-18T00:47:34.381046+0000","last_clean_scrub_stamp":"2024-01-18T00:47:34.381046+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:12:48.884757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'241","reported_seq":317,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:25.738722+0000","last_change":"2024-01-18T00:47:25.738743+0000","last_active":"2024-01-18T00:47:25.738722+0000","last_peered":"2024-01-18T00:47:25.738722+0000","last_clean":"2024-01-18T00:47:25.738722+0000","last_became_active":"2024-01-17T22:58:49.367330+0000","last_became_peered":"2024-01-17T22:58:49.367330+0000","last_unstale":"2024-01-18T00:47:25.738722+0000","last_undegraded":"2024-01-18T00:47:25.738722+0000","last_fullsized":"2024-01-18T00:47:25.738722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'241","last_scrub_stamp":"2024-01-18T00:47:25.738661+0000","last_deep_scrub":"28'241","last_deep_scrub_stamp":"2024-01-18T00:47:25.738661+0000","last_clean_scrub_stamp":"2024-01-18T00:47:25.738661+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:26.927623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'196","reported_seq":273,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:40.720003+0000","last_change":"2024-01-18T00:47:40.720118+0000","last_active":"2024-01-18T00:47:40.720003+0000","last_peered":"2024-01-18T00:47:40.720003+0000","last_clean":"2024-01-18T00:47:40.720003+0000","last_became_active":"2024-01-17T22:58:49.513924+0000","last_became_peered":"2024-01-17T22:58:49.513924+0000","last_unstale":"2024-01-18T00:47:40.720003+0000","last_undegraded":"2024-01-18T00:47:40.720003+0000","last_fullsized":"2024-01-18T00:47:40.720003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'196","last_scrub_stamp":"2024-01-18T00:47:40.719803+0000","last_deep_scrub":"28'196","last_deep_scrub_stamp":"2024-01-18T00:47:40.719803+0000","last_clean_scrub_stamp":"2024-01-18T00:47:40.719803+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:49:35.945296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'222","reported_seq":299,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:25.103067+0000","last_change":"2024-01-18T00:47:25.103067+0000","last_active":"2024-01-18T00:47:25.103067+0000","last_peered":"2024-01-18T00:47:25.103067+0000","last_clean":"2024-01-18T00:47:25.103067+0000","last_became_active":"2024-01-17T22:58:49.370808+0000","last_became_peered":"2024-01-17T22:58:49.370808+0000","last_unstale":"2024-01-18T00:47:25.103067+0000","last_undegraded":"2024-01-18T00:47:25.103067+0000","last_fullsized":"2024-01-18T00:47:25.103067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'222","last_scrub_stamp":"2024-01-18T00:47:25.102983+0000","last_deep_scrub":"28'222","last_deep_scrub_stamp":"2024-01-18T00:47:25.102983+0000","last_clean_scrub_stamp":"2024-01-18T00:47:25.102983+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:12:39.606693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'200","reported_seq":275,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.813434+0000","last_change":"2024-01-18T00:47:35.813571+0000","last_active":"2024-01-18T00:47:35.813434+0000","last_peered":"2024-01-18T00:47:35.813434+0000","last_clean":"2024-01-18T00:47:35.813434+0000","last_became_active":"2024-01-17T22:58:49.350057+0000","last_became_peered":"2024-01-17T22:58:49.350057+0000","last_unstale":"2024-01-18T00:47:35.813434+0000","last_undegraded":"2024-01-18T00:47:35.813434+0000","last_fullsized":"2024-01-18T00:47:35.813434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'200","last_scrub_stamp":"2024-01-18T00:47:35.813237+0000","last_deep_scrub":"28'200","last_deep_scrub_stamp":"2024-01-18T00:47:35.813237+0000","last_clean_scrub_stamp":"2024-01-18T00:47:35.813237+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:42:52.350001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'209","reported_seq":283,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:24.843292+0000","last_change":"2024-01-18T00:47:24.843313+0000","last_active":"2024-01-18T00:47:24.843292+0000","last_peered":"2024-01-18T00:47:24.843292+0000","last_clean":"2024-01-18T00:47:24.843292+0000","last_became_active":"2024-01-17T22:58:49.517631+0000","last_became_peered":"2024-01-17T22:58:49.517631+0000","last_unstale":"2024-01-18T00:47:24.843292+0000","last_undegraded":"2024-01-18T00:47:24.843292+0000","last_fullsized":"2024-01-18T00:47:24.843292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'209","last_scrub_stamp":"2024-01-18T00:47:24.843234+0000","last_deep_scrub":"28'209","last_deep_scrub_stamp":"2024-01-18T00:47:24.843234+0000","last_clean_scrub_stamp":"2024-01-18T00:47:24.843234+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:41:19.693577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'203","reported_seq":278,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:33.389029+0000","last_change":"2024-01-18T00:47:33.389072+0000","last_active":"2024-01-18T00:47:33.389029+0000","last_peered":"2024-01-18T00:47:33.389029+0000","last_clean":"2024-01-18T00:47:33.389029+0000","last_became_active":"2024-01-17T22:58:49.411772+0000","last_became_peered":"2024-01-17T22:58:49.411772+0000","last_unstale":"2024-01-18T00:47:33.389029+0000","last_undegraded":"2024-01-18T00:47:33.389029+0000","last_fullsized":"2024-01-18T00:47:33.389029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'203","last_scrub_stamp":"2024-01-18T00:47:33.388919+0000","last_deep_scrub":"28'203","last_deep_scrub_stamp":"2024-01-18T00:47:33.388919+0000","last_clean_scrub_stamp":"2024-01-18T00:47:33.388919+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:47:18.091511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'220","reported_seq":287,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:36.233574+0000","last_change":"2024-01-18T00:47:36.233633+0000","last_active":"2024-01-18T00:47:36.233574+0000","last_peered":"2024-01-18T00:47:36.233574+0000","last_clean":"2024-01-18T00:47:36.233574+0000","last_became_active":"2024-01-17T22:59:08.750082+0000","last_became_peered":"2024-01-17T22:59:08.750082+0000","last_unstale":"2024-01-18T00:47:36.233574+0000","last_undegraded":"2024-01-18T00:47:36.233574+0000","last_fullsized":"2024-01-18T00:47:36.233574+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'220","last_scrub_stamp":"2024-01-18T00:47:36.233407+0000","last_deep_scrub":"28'220","last_deep_scrub_stamp":"2024-01-18T00:47:36.233407+0000","last_clean_scrub_stamp":"2024-01-18T00:47:36.233407+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:05:55.088682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"28'209","reported_seq":284,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.137139+0000","last_change":"2024-01-18T00:47:31.137160+0000","last_active":"2024-01-18T00:47:31.137139+0000","last_peered":"2024-01-18T00:47:31.137139+0000","last_clean":"2024-01-18T00:47:31.137139+0000","last_became_active":"2024-01-17T22:58:49.414598+0000","last_became_peered":"2024-01-17T22:58:49.414598+0000","last_unstale":"2024-01-18T00:47:31.137139+0000","last_undegraded":"2024-01-18T00:47:31.137139+0000","last_fullsized":"2024-01-18T00:47:31.137139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'209","last_scrub_stamp":"2024-01-18T00:47:31.137044+0000","last_deep_scrub":"28'209","last_deep_scrub_stamp":"2024-01-18T00:47:31.137044+0000","last_clean_scrub_stamp":"2024-01-18T00:47:31.137044+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:08:04.243965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'191","reported_seq":264,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.145183+0000","last_change":"2024-01-18T00:47:31.145230+0000","last_active":"2024-01-18T00:47:31.145183+0000","last_peered":"2024-01-18T00:47:31.145183+0000","last_clean":"2024-01-18T00:47:31.145183+0000","last_became_active":"2024-01-17T22:58:49.388096+0000","last_became_peered":"2024-01-17T22:58:49.388096+0000","last_unstale":"2024-01-18T00:47:31.145183+0000","last_undegraded":"2024-01-18T00:47:31.145183+0000","last_fullsized":"2024-01-18T00:47:31.145183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'191","last_scrub_stamp":"2024-01-18T00:47:31.145059+0000","last_deep_scrub":"28'191","last_deep_scrub_stamp":"2024-01-18T00:47:31.145059+0000","last_clean_scrub_stamp":"2024-01-18T00:47:31.145059+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:26:14.046656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'199","reported_seq":272,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:23.148900+0000","last_change":"2024-01-18T00:47:23.148922+0000","last_active":"2024-01-18T00:47:23.148900+0000","last_peered":"2024-01-18T00:47:23.148900+0000","last_clean":"2024-01-18T00:47:23.148900+0000","last_became_active":"2024-01-17T22:58:49.369959+0000","last_became_peered":"2024-01-17T22:58:49.369959+0000","last_unstale":"2024-01-18T00:47:23.148900+0000","last_undegraded":"2024-01-18T00:47:23.148900+0000","last_fullsized":"2024-01-18T00:47:23.148900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'199","last_scrub_stamp":"2024-01-18T00:47:23.148840+0000","last_deep_scrub":"28'199","last_deep_scrub_stamp":"2024-01-18T00:47:23.148840+0000","last_clean_scrub_stamp":"2024-01-18T00:47:23.148840+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:05:42.004115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'218","reported_seq":291,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:26.108570+0000","last_change":"2024-01-18T00:47:26.108592+0000","last_active":"2024-01-18T00:47:26.108570+0000","last_peered":"2024-01-18T00:47:26.108570+0000","last_clean":"2024-01-18T00:47:26.108570+0000","last_became_active":"2024-01-17T22:58:49.366122+0000","last_became_peered":"2024-01-17T22:58:49.366122+0000","last_unstale":"2024-01-18T00:47:26.108570+0000","last_undegraded":"2024-01-18T00:47:26.108570+0000","last_fullsized":"2024-01-18T00:47:26.108570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'218","last_scrub_stamp":"2024-01-18T00:47:26.108502+0000","last_deep_scrub":"28'218","last_deep_scrub_stamp":"2024-01-18T00:47:26.108502+0000","last_clean_scrub_stamp":"2024-01-18T00:47:26.108502+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:04:46.080253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'209","reported_seq":282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:33.840786+0000","last_change":"2024-01-18T00:47:33.840903+0000","last_active":"2024-01-18T00:47:33.840786+0000","last_peered":"2024-01-18T00:47:33.840786+0000","last_clean":"2024-01-18T00:47:33.840786+0000","last_became_active":"2024-01-17T22:58:49.348630+0000","last_became_peered":"2024-01-17T22:58:49.348630+0000","last_unstale":"2024-01-18T00:47:33.840786+0000","last_undegraded":"2024-01-18T00:47:33.840786+0000","last_fullsized":"2024-01-18T00:47:33.840786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'209","last_scrub_stamp":"2024-01-18T00:47:33.840597+0000","last_deep_scrub":"28'209","last_deep_scrub_stamp":"2024-01-18T00:47:33.840597+0000","last_clean_scrub_stamp":"2024-01-18T00:47:33.840597+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:28:23.409848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'210","reported_seq":283,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.403859+0000","last_change":"2024-01-18T00:47:35.403994+0000","last_active":"2024-01-18T00:47:35.403859+0000","last_peered":"2024-01-18T00:47:35.403859+0000","last_clean":"2024-01-18T00:47:35.403859+0000","last_became_active":"2024-01-17T22:58:49.382454+0000","last_became_peered":"2024-01-17T22:58:49.382454+0000","last_unstale":"2024-01-18T00:47:35.403859+0000","last_undegraded":"2024-01-18T00:47:35.403859+0000","last_fullsized":"2024-01-18T00:47:35.403859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'210","last_scrub_stamp":"2024-01-18T00:47:35.403671+0000","last_deep_scrub":"28'210","last_deep_scrub_stamp":"2024-01-18T00:47:35.403671+0000","last_clean_scrub_stamp":"2024-01-18T00:47:35.403671+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:54:10.158219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'196","reported_seq":268,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:29.391357+0000","last_change":"2024-01-18T00:47:29.391357+0000","last_active":"2024-01-18T00:47:29.391357+0000","last_peered":"2024-01-18T00:47:29.391357+0000","last_clean":"2024-01-18T00:47:29.391357+0000","last_became_active":"2024-01-17T22:58:49.364509+0000","last_became_peered":"2024-01-17T22:58:49.364509+0000","last_unstale":"2024-01-18T00:47:29.391357+0000","last_undegraded":"2024-01-18T00:47:29.391357+0000","last_fullsized":"2024-01-18T00:47:29.391357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'196","last_scrub_stamp":"2024-01-18T00:47:29.391150+0000","last_deep_scrub":"28'196","last_deep_scrub_stamp":"2024-01-18T00:47:29.391150+0000","last_clean_scrub_stamp":"2024-01-18T00:47:29.391150+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:33:38.445872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'173","reported_seq":245,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:33.778632+0000","last_change":"2024-01-18T00:47:33.778632+0000","last_active":"2024-01-18T00:47:33.778632+0000","last_peered":"2024-01-18T00:47:33.778632+0000","last_clean":"2024-01-18T00:47:33.778632+0000","last_became_active":"2024-01-17T22:58:49.517927+0000","last_became_peered":"2024-01-17T22:58:49.517927+0000","last_unstale":"2024-01-18T00:47:33.778632+0000","last_undegraded":"2024-01-18T00:47:33.778632+0000","last_fullsized":"2024-01-18T00:47:33.778632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'173","last_scrub_stamp":"2024-01-18T00:47:33.778547+0000","last_deep_scrub":"28'173","last_deep_scrub_stamp":"2024-01-18T00:47:33.778547+0000","last_clean_scrub_stamp":"2024-01-18T00:47:33.778547+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:25:01.782585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'173","reported_seq":245,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:29.836229+0000","last_change":"2024-01-18T00:47:29.836229+0000","last_active":"2024-01-18T00:47:29.836229+0000","last_peered":"2024-01-18T00:47:29.836229+0000","last_clean":"2024-01-18T00:47:29.836229+0000","last_became_active":"2024-01-17T22:58:49.363804+0000","last_became_peered":"2024-01-17T22:58:49.363804+0000","last_unstale":"2024-01-18T00:47:29.836229+0000","last_undegraded":"2024-01-18T00:47:29.836229+0000","last_fullsized":"2024-01-18T00:47:29.836229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'173","last_scrub_stamp":"2024-01-18T00:47:29.836148+0000","last_deep_scrub":"28'173","last_deep_scrub_stamp":"2024-01-18T00:47:29.836148+0000","last_clean_scrub_stamp":"2024-01-18T00:47:29.836148+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:30:28.917892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"28'206","reported_seq":278,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:27.855299+0000","last_change":"2024-01-18T00:47:27.855299+0000","last_active":"2024-01-18T00:47:27.855299+0000","last_peered":"2024-01-18T00:47:27.855299+0000","last_clean":"2024-01-18T00:47:27.855299+0000","last_became_active":"2024-01-17T22:58:49.352513+0000","last_became_peered":"2024-01-17T22:58:49.352513+0000","last_unstale":"2024-01-18T00:47:27.855299+0000","last_undegraded":"2024-01-18T00:47:27.855299+0000","last_fullsized":"2024-01-18T00:47:27.855299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'206","last_scrub_stamp":"2024-01-18T00:47:27.855213+0000","last_deep_scrub":"28'206","last_deep_scrub_stamp":"2024-01-18T00:47:27.855213+0000","last_clean_scrub_stamp":"2024-01-18T00:47:27.855213+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:04:51.982726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'213","reported_seq":283,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:27.872566+0000","last_change":"2024-01-18T00:47:27.872605+0000","last_active":"2024-01-18T00:47:27.872566+0000","last_peered":"2024-01-18T00:47:27.872566+0000","last_clean":"2024-01-18T00:47:27.872566+0000","last_became_active":"2024-01-17T22:58:49.518646+0000","last_became_peered":"2024-01-17T22:58:49.518646+0000","last_unstale":"2024-01-18T00:47:27.872566+0000","last_undegraded":"2024-01-18T00:47:27.872566+0000","last_fullsized":"2024-01-18T00:47:27.872566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'213","last_scrub_stamp":"2024-01-18T00:47:27.872498+0000","last_deep_scrub":"28'213","last_deep_scrub_stamp":"2024-01-18T00:47:27.872498+0000","last_clean_scrub_stamp":"2024-01-18T00:47:27.872498+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:41:28.845468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'192","reported_seq":262,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:34.824034+0000","last_change":"2024-01-18T00:47:34.824068+0000","last_active":"2024-01-18T00:47:34.824034+0000","last_peered":"2024-01-18T00:47:34.824034+0000","last_clean":"2024-01-18T00:47:34.824034+0000","last_became_active":"2024-01-17T22:58:49.349021+0000","last_became_peered":"2024-01-17T22:58:49.349021+0000","last_unstale":"2024-01-18T00:47:34.824034+0000","last_undegraded":"2024-01-18T00:47:34.824034+0000","last_fullsized":"2024-01-18T00:47:34.824034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'192","last_scrub_stamp":"2024-01-18T00:47:34.823940+0000","last_deep_scrub":"28'192","last_deep_scrub_stamp":"2024-01-18T00:47:34.823940+0000","last_clean_scrub_stamp":"2024-01-18T00:47:34.823940+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:42:44.005567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'204","reported_seq":274,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:32.815241+0000","last_change":"2024-01-18T00:47:32.815262+0000","last_active":"2024-01-18T00:47:32.815241+0000","last_peered":"2024-01-18T00:47:32.815241+0000","last_clean":"2024-01-18T00:47:32.815241+0000","last_became_active":"2024-01-17T22:58:49.414856+0000","last_became_peered":"2024-01-17T22:58:49.414856+0000","last_unstale":"2024-01-18T00:47:32.815241+0000","last_undegraded":"2024-01-18T00:47:32.815241+0000","last_fullsized":"2024-01-18T00:47:32.815241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'204","last_scrub_stamp":"2024-01-18T00:47:32.815166+0000","last_deep_scrub":"28'204","last_deep_scrub_stamp":"2024-01-18T00:47:32.815166+0000","last_clean_scrub_stamp":"2024-01-18T00:47:32.815166+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:01:21.065765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'190","reported_seq":259,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:29.743841+0000","last_change":"2024-01-18T00:47:29.743880+0000","last_active":"2024-01-18T00:47:29.743841+0000","last_peered":"2024-01-18T00:47:29.743841+0000","last_clean":"2024-01-18T00:47:29.743841+0000","last_became_active":"2024-01-17T22:58:49.414446+0000","last_became_peered":"2024-01-17T22:58:49.414446+0000","last_unstale":"2024-01-18T00:47:29.743841+0000","last_undegraded":"2024-01-18T00:47:29.743841+0000","last_fullsized":"2024-01-18T00:47:29.743841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'190","last_scrub_stamp":"2024-01-18T00:47:29.743761+0000","last_deep_scrub":"28'190","last_deep_scrub_stamp":"2024-01-18T00:47:29.743761+0000","last_clean_scrub_stamp":"2024-01-18T00:47:29.743761+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:18:05.701588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'210","reported_seq":280,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:20.955089+0000","last_change":"2024-01-18T00:47:20.955108+0000","last_active":"2024-01-18T00:47:20.955089+0000","last_peered":"2024-01-18T00:47:20.955089+0000","last_clean":"2024-01-18T00:47:20.955089+0000","last_became_active":"2024-01-17T22:58:49.357085+0000","last_became_peered":"2024-01-17T22:58:49.357085+0000","last_unstale":"2024-01-18T00:47:20.955089+0000","last_undegraded":"2024-01-18T00:47:20.955089+0000","last_fullsized":"2024-01-18T00:47:20.955089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'210","last_scrub_stamp":"2024-01-18T00:47:20.955022+0000","last_deep_scrub":"28'210","last_deep_scrub_stamp":"2024-01-18T00:47:20.955022+0000","last_clean_scrub_stamp":"2024-01-18T00:47:20.955022+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:48:26.904595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'196","reported_seq":276,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:28.699864+0000","last_change":"2024-01-18T00:47:28.699884+0000","last_active":"2024-01-18T00:47:28.699864+0000","last_peered":"2024-01-18T00:47:28.699864+0000","last_clean":"2024-01-18T00:47:28.699864+0000","last_became_active":"2024-01-17T22:58:49.414490+0000","last_became_peered":"2024-01-17T22:58:49.414490+0000","last_unstale":"2024-01-18T00:47:28.699864+0000","last_undegraded":"2024-01-18T00:47:28.699864+0000","last_fullsized":"2024-01-18T00:47:28.699864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'196","last_scrub_stamp":"2024-01-18T00:47:28.699802+0000","last_deep_scrub":"28'196","last_deep_scrub_stamp":"2024-01-18T00:47:28.699802+0000","last_clean_scrub_stamp":"2024-01-18T00:47:28.699802+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:05:47.555078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'198","reported_seq":277,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:38.803039+0000","last_change":"2024-01-18T00:47:38.803101+0000","last_active":"2024-01-18T00:47:38.803039+0000","last_peered":"2024-01-18T00:47:38.803039+0000","last_clean":"2024-01-18T00:47:38.803039+0000","last_became_active":"2024-01-17T22:58:49.412382+0000","last_became_peered":"2024-01-17T22:58:49.412382+0000","last_unstale":"2024-01-18T00:47:38.803039+0000","last_undegraded":"2024-01-18T00:47:38.803039+0000","last_fullsized":"2024-01-18T00:47:38.803039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'198","last_scrub_stamp":"2024-01-18T00:47:38.802879+0000","last_deep_scrub":"28'198","last_deep_scrub_stamp":"2024-01-18T00:47:38.802879+0000","last_clean_scrub_stamp":"2024-01-18T00:47:38.802879+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:48:20.121292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'201","reported_seq":280,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:26.839873+0000","last_change":"2024-01-18T00:47:26.839930+0000","last_active":"2024-01-18T00:47:26.839873+0000","last_peered":"2024-01-18T00:47:26.839873+0000","last_clean":"2024-01-18T00:47:26.839873+0000","last_became_active":"2024-01-17T22:58:49.367979+0000","last_became_peered":"2024-01-17T22:58:49.367979+0000","last_unstale":"2024-01-18T00:47:26.839873+0000","last_undegraded":"2024-01-18T00:47:26.839873+0000","last_fullsized":"2024-01-18T00:47:26.839873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'201","last_scrub_stamp":"2024-01-18T00:47:26.839715+0000","last_deep_scrub":"28'201","last_deep_scrub_stamp":"2024-01-18T00:47:26.839715+0000","last_clean_scrub_stamp":"2024-01-18T00:47:26.839715+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:00:10.991750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'197","reported_seq":276,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-18T00:47:30.812718+0000","last_change":"2024-01-18T00:47:30.812770+0000","last_active":"2024-01-18T00:47:30.812718+0000","last_peered":"2024-01-18T00:47:30.812718+0000","last_clean":"2024-01-18T00:47:30.812718+0000","last_became_active":"2024-01-17T22:58:49.363810+0000","last_became_peered":"2024-01-17T22:58:49.363810+0000","last_unstale":"2024-01-18T00:47:30.812718+0000","last_undegraded":"2024-01-18T00:47:30.812718+0000","last_fullsized":"2024-01-18T00:47:30.812718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'197","last_scrub_stamp":"2024-01-18T00:47:30.812647+0000","last_deep_scrub":"28'197","last_deep_scrub_stamp":"2024-01-18T00:47:30.812647+0000","last_clean_scrub_stamp":"2024-01-18T00:47:30.812647+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:59:54.390543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1120,"num_read_kb":3534792,"num_write":24383,"num_write_kb":4330508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24895,"ondisk_log_size":24895,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13088,"ondisk_log_size":13088,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":198335987,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":1788,"num_read_kb":2847,"num_write":22493,"num_write_kb":206433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":181755904,"data_stored":396671974,"data_compressed":51062148,"data_compressed_allocated":68689920,"data_compressed_original":283754496,"omap_allocated":0,"internal_metadata":0},"log_size":22083,"ondisk_log_size":22083,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":62458,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510762,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124208,"kb_used_data":12584,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94247632,"statfs":{"total":96636764160,"available":96509575168,"internally_reserved":0,"allocated":12886016,"data_stored":31038270,"data_compressed":4325598,"data_compressed_allocated":5689344,"data_compressed_original":24039424,"omap_allocated":1590,"internal_metadata":114293194},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:44 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.86699999999999999,"15min":0.876},"min":{"1min":0.497,"5min":0.42899999999999999,"15min":0.35399999999999998},"max":{"1min":1.3680000000000001,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.86099999999999999,"15min":0.85099999999999998},"min":{"1min":0.52800000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.292,"5min":1.3240000000000001,"15min":1.603},"last":1.012}]},{"osd":1,"last update":"Thu Jan 18 00:47:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.90900000000000003,"15min":0.90400000000000003},"min":{"1min":0.59999999999999998,"5min":0.46500000000000002,"15min":0.41499999999999998},"max":{"1min":1.1919999999999999,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.90500000000000003,"15min":0.89400000000000002},"min":{"1min":0.57899999999999996,"5min":0.44600000000000001,"15min":0.28899999999999998},"max":{"1min":1.369,"5min":1.5960000000000001,"15min":1.722},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 18 00:47:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.81799999999999995,"15min":0.81299999999999994},"min":{"1min":0.61399999999999999,"5min":0.45400000000000001,"15min":0.441},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.026,"15min":0.97799999999999998},"min":{"1min":0.58999999999999997,"5min":0.50600000000000001,"15min":0.45800000000000002},"max":{"1min":1.6950000000000001,"5min":2.7370000000000001,"15min":2.7370000000000001},"last":0.89500000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:47:44 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.91600000000000004,"15min":0.90600000000000003},"min":{"1min":0.627,"5min":0.54000000000000004,"15min":0.48099999999999998},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.014,"5min":1.048,"15min":1.0389999999999999},"min":{"1min":0.73599999999999999,"5min":0.54700000000000004,"15min":0.5},"max":{"1min":1.607,"5min":2.806,"15min":2.806},"last":1.1120000000000001}]},{"osd":4,"last update":"Thu Jan 18 00:47:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.02,"15min":1.0169999999999999},"min":{"1min":0.72399999999999998,"5min":0.40100000000000002,"15min":0.32900000000000001},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.123,"5min":1.0289999999999999,"15min":1.0309999999999999},"min":{"1min":0.67900000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.98099999999999998}]},{"osd":5,"last update":"Thu Jan 18 00:47:44 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.1619999999999999,"15min":1.1559999999999999},"min":{"1min":0.64200000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.8460000000000001,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.23,"5min":1.1439999999999999,"15min":1.161},"min":{"1min":0.65200000000000002,"5min":0.51400000000000001,"15min":0.435},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.1399999999999999}]},{"osd":6,"last update":"Thu Jan 18 00:47:44 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.1910000000000001,"15min":1.194},"min":{"1min":0.622,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.016,"5min":2.016,"15min":2.0209999999999999},"last":1.22},{"interface":"front","average":{"1min":1.25,"5min":1.1659999999999999,"15min":1.1679999999999999},"min":{"1min":0.94399999999999995,"5min":0.53000000000000003,"15min":0.50900000000000001},"max":{"1min":2.0449999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.085}]}]},{"osd":6,"up_from":15,"seq":64424510761,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83092,"kb_used_data":15820,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94288748,"statfs":{"total":96636764160,"available":96551677952,"internally_reserved":0,"allocated":16199680,"data_stored":33676965,"data_compressed":4280237,"data_compressed_allocated":5771264,"data_compressed_original":23433216,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85999999999999999,"15min":0.84799999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.44},"max":{"1min":1.2849999999999999,"5min":1.5580000000000001,"15min":1.788},"last":1.105},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.878,"15min":0.84899999999999998},"min":{"1min":0.52500000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":1.3080000000000001}]},{"osd":1,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.83699999999999997,"15min":0.82199999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.45800000000000002},"max":{"1min":1.167,"5min":1.478,"15min":1.8540000000000001},"last":1.196},{"interface":"front","average":{"1min":1.018,"5min":0.93200000000000005,"15min":0.89500000000000002},"min":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.42999999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.641},"last":0.95499999999999996}]},{"osd":2,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.95199999999999996,"15min":0.94099999999999995},"min":{"1min":0.59799999999999998,"5min":0.54300000000000004,"15min":0.496},"max":{"1min":1.7030000000000001,"5min":1.766,"15min":1.766},"last":1.2809999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.96199999999999997,"15min":0.94399999999999995},"min":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.48499999999999999},"max":{"1min":1.4750000000000001,"5min":1.5629999999999999,"15min":2.1619999999999999},"last":1.0649999999999999}]},{"osd":3,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.012,"15min":0.98399999999999999},"min":{"1min":0.76400000000000001,"5min":0.622,"15min":0.53900000000000003},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.139},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.997,"15min":0.93899999999999995},"min":{"1min":0.67600000000000005,"5min":0.66900000000000004,"15min":0.52300000000000002},"max":{"1min":1.1870000000000001,"5min":1.633,"15min":1.98},"last":1.0049999999999999}]},{"osd":4,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.139,"15min":1.081},"min":{"1min":0.627,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":3.4969999999999999,"5min":3.4969999999999999,"15min":3.4969999999999999},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.179,"15min":1.1359999999999999},"min":{"1min":0.66000000000000003,"5min":0.52700000000000002,"15min":0.46000000000000002},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":1.25}]},{"osd":5,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.145,"15min":1.079},"min":{"1min":0.56699999999999995,"5min":0.49099999999999999,"15min":0.47499999999999998},"max":{"1min":3.8490000000000002,"5min":3.8490000000000002,"15min":3.8490000000000002},"last":1.331},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2230000000000001,"15min":1.177},"min":{"1min":0.78300000000000003,"5min":0.60999999999999999,"15min":0.54200000000000004},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":1.3560000000000001}]},{"osd":7,"last update":"Thu Jan 18 00:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.284,"15min":1.2250000000000001},"min":{"1min":0.75700000000000001,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":4.2910000000000004,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.254,"15min":1.2},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.56799999999999995},"max":{"1min":1.534,"5min":2.0649999999999999,"15min":2.129},"last":1.3919999999999999}]}]},{"osd":4,"up_from":15,"seq":64424510761,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121324,"kb_used_data":22180,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94250516,"statfs":{"total":96636764160,"available":96512528384,"internally_reserved":0,"allocated":22712320,"data_stored":50454822,"data_compressed":6935579,"data_compressed_allocated":9256960,"data_compressed_original":37212160,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.89100000000000001,"15min":0.84999999999999998},"min":{"1min":0.52400000000000002,"5min":0.51500000000000001,"15min":0.35999999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.6879999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.83699999999999997,"15min":0.84499999999999997},"min":{"1min":0.65400000000000003,"5min":0.50600000000000001,"15min":0.42799999999999999},"max":{"1min":1.3080000000000001,"5min":1.464,"15min":2.2410000000000001},"last":0.621}]},{"osd":1,"last update":"Thu Jan 18 00:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92500000000000004,"15min":0.89200000000000002},"min":{"1min":0.626,"5min":0.51300000000000001,"15min":0.36199999999999999},"max":{"1min":1.228,"5min":1.736,"15min":1.736},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.59799999999999998,"5min":0.45500000000000002,"15min":0.42299999999999999},"max":{"1min":1.1140000000000001,"5min":2.097,"15min":2.097},"last":1.137}]},{"osd":2,"last update":"Thu Jan 18 00:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.90400000000000003,"15min":0.91800000000000004},"min":{"1min":0.63500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2989999999999999,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.002,"5min":0.98199999999999998,"15min":0.95899999999999996},"min":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.34300000000000003},"max":{"1min":1.444,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":0.95299999999999996}]},{"osd":3,"last update":"Thu Jan 18 00:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.91100000000000003,"15min":0.93200000000000005},"min":{"1min":0.623,"5min":0.54000000000000004,"15min":0.41099999999999998},"max":{"1min":1.2190000000000001,"5min":1.6759999999999999,"15min":2.335},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.024,"5min":1.0069999999999999,"15min":1.004},"min":{"1min":0.64200000000000002,"5min":0.60799999999999998,"15min":0.45300000000000001},"max":{"1min":1.5489999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.91600000000000004}]},{"osd":5,"last update":"Thu Jan 18 00:47:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.069,"15min":1.083},"min":{"1min":0.69199999999999995,"5min":0.44700000000000001,"15min":0.35999999999999999},"max":{"1min":1.425,"5min":2.403,"15min":2.9249999999999998},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0549999999999999,"15min":1.071},"min":{"1min":0.83199999999999996,"5min":0.59299999999999997,"15min":0.38200000000000001},"max":{"1min":1.5760000000000001,"5min":1.804,"15min":2.4289999999999998},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 18 00:47:58 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.129,"15min":1.1359999999999999},"min":{"1min":0.78200000000000003,"5min":0.57699999999999996,"15min":0.47699999999999998},"max":{"1min":1.4119999999999999,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.194,"15min":1.2030000000000001},"min":{"1min":0.78300000000000003,"5min":0.45800000000000002,"15min":0.38100000000000001},"max":{"1min":1.534,"5min":2.4740000000000002,"15min":3.101},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 18 00:47:58 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1679999999999999,"15min":1.177},"min":{"1min":0.75700000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.569,"5min":4.25,"15min":4.25},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.234,"15min":1.256},"min":{"1min":1.036,"5min":0.503,"15min":0.40200000000000002},"max":{"1min":1.6060000000000001,"5min":2.161,"15min":2.5110000000000001},"last":1.083}]}]},{"osd":3,"up_from":15,"seq":64424510761,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160572,"kb_used_data":39220,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94211268,"statfs":{"total":96636764160,"available":96472338432,"internally_reserved":0,"allocated":40161280,"data_stored":87845266,"data_compressed":11483169,"data_compressed_allocated":15335424,"data_compressed_original":63209472,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44,"15min":0.42899999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.23000000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45800000000000002,"15min":0.46300000000000002},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.25600000000000001},"max":{"1min":0.58299999999999996,"5min":0.72799999999999998,"15min":0.753},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.29399999999999998,"5min":0.28100000000000003,"15min":0.27500000000000002},"max":{"1min":0.61499999999999999,"5min":0.751,"15min":0.78000000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.502,"15min":0.496},"min":{"1min":0.318,"5min":0.313,"15min":0.27300000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.44}]},{"osd":2,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.314},"max":{"1min":0.66700000000000004,"5min":0.79700000000000004,"15min":0.84299999999999997},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.39000000000000001,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.68400000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.496}]},{"osd":4,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.42099999999999999},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78300000000000003,"15min":0.76500000000000001},"min":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.105,"5min":1.325,"15min":1.325},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.76800000000000002},"min":{"1min":0.54200000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.1160000000000001,"5min":1.1559999999999999,"15min":1.1970000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.754},"min":{"1min":0.52400000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0269999999999999,"5min":1.1539999999999999,"15min":1.2150000000000001},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82299999999999995,"15min":0.80900000000000005},"min":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.48899999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2150000000000001},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 18 00:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.80300000000000005,"15min":0.79900000000000004},"min":{"1min":0.51100000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.24,"5min":1.248,"15min":1.337},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.83399999999999996,"15min":0.82199999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.42099999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.59999999999999998}]}]},{"osd":2,"up_from":15,"seq":64424510761,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94904,"kb_used_data":13808,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94276936,"statfs":{"total":96636764160,"available":96539582464,"internally_reserved":0,"allocated":14139392,"data_stored":33676072,"data_compressed":4580308,"data_compressed_allocated":5976064,"data_compressed_original":25698304,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42099999999999999,"15min":0.432},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.24299999999999999},"max":{"1min":0.58599999999999997,"5min":0.65300000000000002,"15min":1.095},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.26300000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":1.355},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.47599999999999998},"min":{"1min":0.36299999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64400000000000002,"5min":0.97699999999999998,"15min":1.026},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.503},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.308},"max":{"1min":0.67400000000000004,"5min":1.032,"15min":1.194},"last":0.434}]},{"osd":3,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.28599999999999998},"max":{"1min":0.754,"5min":0.77000000000000002,"15min":0.995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53800000000000003},"min":{"1min":0.36099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70499999999999996,"5min":0.90500000000000003,"15min":0.96999999999999997},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.75,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.46300000000000002,"15min":0.44700000000000001},"max":{"1min":1.014,"5min":1.155,"15min":1.502},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72299999999999998,"15min":0.752},"min":{"1min":0.46899999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.96899999999999997,"5min":1.0660000000000001,"15min":1.282},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.751,"15min":0.753},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":1.099,"15min":1.1479999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.79000000000000004},"min":{"1min":0.61299999999999999,"5min":0.48899999999999999,"15min":0.48099999999999998},"max":{"1min":1.0649999999999999,"5min":4.343,"15min":4.343},"last":0.83199999999999996}]},{"osd":6,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.46600000000000003},"max":{"1min":0.95899999999999996,"5min":1.075,"15min":1.528},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79900000000000004,"15min":0.81200000000000006},"min":{"1min":0.52900000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1379999999999999,"5min":1.1599999999999999,"15min":3.9159999999999999},"last":0.872}]},{"osd":7,"last update":"Thu Jan 18 00:47:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80400000000000005,"15min":0.80200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.499},"max":{"1min":1.1040000000000001,"5min":1.248,"15min":1.248},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.54500000000000004,"15min":0.51300000000000001},"max":{"1min":1.1160000000000001,"5min":3.9060000000000001,"15min":5.7370000000000001},"last":0.84599999999999997}]}]},{"osd":1,"up_from":15,"seq":64424510761,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108440,"kb_used_data":19024,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94263400,"statfs":{"total":96636764160,"available":96525721600,"internally_reserved":0,"allocated":19480576,"data_stored":38460198,"data_compressed":4277353,"data_compressed_allocated":5976064,"data_compressed_original":25141248,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.46400000000000002,"15min":0.439},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.39000000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69899999999999995,"5min":0.70299999999999996,"15min":0.73099999999999998},"last":0.626}]},{"osd":2,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.47299999999999998,"15min":0.46000000000000002},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.27800000000000002},"max":{"1min":0.629,"5min":0.70399999999999996,"15min":0.73099999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51700000000000002,"15min":0.51000000000000001},"min":{"1min":0.42199999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71699999999999997,"5min":0.77400000000000002,"15min":0.85099999999999998},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.55000000000000004},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.36799999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.79900000000000004},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.71599999999999997},"min":{"1min":0.53500000000000003,"5min":0.442,"15min":0.38700000000000001},"max":{"1min":0.89600000000000002,"5min":1.0549999999999999,"15min":1.103},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77200000000000002,"15min":0.78100000000000003},"min":{"1min":0.60299999999999998,"5min":0.47099999999999997,"15min":0.439},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.5700000000000001},"last":0.95399999999999996}]},{"osd":5,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76200000000000001,"15min":0.76000000000000001},"min":{"1min":0.53000000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1299999999999999,"5min":1.1439999999999999,"15min":2.8069999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79000000000000004,"15min":0.77600000000000002},"min":{"1min":0.58599999999999997,"5min":0.46400000000000002,"15min":0.45400000000000001},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.27},"last":0.93000000000000005}]},{"osd":6,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.79400000000000004},"min":{"1min":0.64600000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.0660000000000001,"5min":1.242,"15min":1.395},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.73699999999999999,"5min":0.5,"15min":0.46400000000000002},"max":{"1min":0.996,"5min":1.1279999999999999,"15min":1.1830000000000001},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jan 18 00:47:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.85099999999999998,"15min":0.83699999999999997},"min":{"1min":0.76900000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":3.9009999999999998},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.622,"5min":0.55700000000000005,"15min":0.50800000000000001},"max":{"1min":1.1379999999999999,"5min":1.2270000000000001,"15min":1.3999999999999999},"last":0.83999999999999997}]}]},{"osd":0,"up_from":14,"seq":60129543464,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143120,"kb_used_data":31496,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94228720,"statfs":{"total":96636764160,"available":96490209280,"internally_reserved":0,"allocated":32251904,"data_stored":71068140,"data_compressed":8958305,"data_compressed_allocated":12132352,"data_compressed_original":51142656,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 18 00:47:28 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.435,"15min":0.42799999999999999},"min":{"1min":0.28899999999999998,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.56000000000000005,"5min":0.66600000000000004,"15min":0.68400000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.47099999999999997,"15min":0.47199999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.63}]},{"osd":2,"last update":"Thu Jan 18 00:47:28 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.33700000000000002,"5min":0.32800000000000001,"15min":0.28199999999999997},"max":{"1min":0.67000000000000004,"5min":0.82899999999999996,"15min":0.84999999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.34300000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67000000000000004,"5min":0.67900000000000005,"15min":0.80200000000000005},"last":0.379}]},{"osd":3,"last update":"Thu Jan 18 00:47:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48399999999999999,"15min":0.48799999999999999},"min":{"1min":0.33200000000000002,"5min":0.308,"15min":0.30499999999999999},"max":{"1min":0.60999999999999999,"5min":0.73999999999999999,"15min":0.81799999999999995},"last":0.495},{"interface":"front","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.53600000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.377},"max":{"1min":0.63500000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 18 00:47:28 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.51800000000000002,"5min":0.46500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0249999999999999,"5min":1.3620000000000001,"15min":2.1779999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.74199999999999999,"15min":0.73699999999999999},"min":{"1min":0.52800000000000002,"5min":0.505,"15min":0.44400000000000001},"max":{"1min":0.93400000000000005,"5min":1.159,"15min":1.159},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jan 18 00:47:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.754,"15min":0.76500000000000001},"min":{"1min":0.57499999999999996,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97099999999999997,"5min":1.423,"15min":1.423},"last":0.75},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.75900000000000001,"15min":0.753},"min":{"1min":0.61499999999999999,"5min":0.47599999999999998,"15min":0.42399999999999999},"max":{"1min":0.95899999999999996,"5min":1.623,"15min":1.623},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Jan 18 00:47:28 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.84599999999999997,"15min":0.82599999999999996},"min":{"1min":0.61699999999999999,"5min":0.52600000000000002,"15min":0.49099999999999999},"max":{"1min":1.181,"5min":1.222,"15min":1.222},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84799999999999998,"15min":0.82699999999999996},"min":{"1min":0.57899999999999996,"5min":0.49099999999999999,"15min":0.46200000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.29},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 18 00:47:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":0.81899999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.44400000000000001},"max":{"1min":1.077,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.86299999999999999,"15min":0.86099999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.47899999999999998},"max":{"1min":1.044,"5min":1.609,"15min":1.609},"last":0.874}]}]},{"osd":5,"up_from":13,"seq":55834576170,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":129092,"kb_used_data":25788,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94242748,"statfs":{"total":96636764160,"available":96504573952,"internally_reserved":0,"allocated":26406912,"data_stored":52600449,"data_compressed":6284057,"data_compressed_allocated":8634368,"data_compressed_original":35024896,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.83099999999999996,"15min":0.86699999999999999},"min":{"1min":0.48299999999999998,"5min":0.42799999999999999,"15min":0.36699999999999999},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.85499999999999998,"15min":0.85899999999999999},"min":{"1min":0.57799999999999996,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.7569999999999999},"last":0.82699999999999996}]},{"osd":1,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.90100000000000002,"15min":0.91000000000000003},"min":{"1min":0.53600000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.90800000000000003,"15min":0.91300000000000003},"min":{"1min":0.67300000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.3169999999999999,"5min":1.393,"15min":1.5049999999999999},"last":1.04}]},{"osd":2,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.48599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.874},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.97999999999999998,"15min":0.98499999999999999},"min":{"1min":0.67800000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.7040000000000002,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0009999999999999,"15min":0.997},"min":{"1min":0.61899999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4670000000000001,"5min":1.613,"15min":1.633},"last":1.111},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93899999999999995,"15min":0.94799999999999995},"min":{"1min":0.55500000000000005,"5min":0.41099999999999998,"15min":0.40500000000000003},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.9430000000000001},"last":1.0049999999999999}]},{"osd":4,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.1040000000000001,"15min":1.0960000000000001},"min":{"1min":0.84399999999999997,"5min":0.52400000000000002,"15min":0.46100000000000002},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.1619999999999999,"15min":1.133},"min":{"1min":0.67000000000000004,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.776,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.175}]},{"osd":6,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.103,"15min":1.0740000000000001},"min":{"1min":0.70499999999999996,"5min":0.55100000000000005,"15min":0.51800000000000002},"max":{"1min":1.859,"5min":1.859,"15min":1.8640000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.2030000000000001,"15min":1.1930000000000001},"min":{"1min":0.878,"5min":0.70299999999999996,"15min":0.46999999999999997},"max":{"1min":2.6600000000000001,"5min":2.6600000000000001,"15min":2.6600000000000001},"last":0.624}]},{"osd":7,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.2649999999999999,"15min":1.2370000000000001},"min":{"1min":0.999,"5min":0.65900000000000003,"15min":0.57799999999999996},"max":{"1min":1.6779999999999999,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.246,"5min":1.234,"15min":1.2150000000000001},"min":{"1min":0.72399999999999998,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.0640000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.79600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31229,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31229,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31956992,"data_stored":70947206,"data_compressed":8958305,"data_compressed_allocated":12132352,"data_compressed_original":51142656,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19124224,"data_stored":37748896,"data_compressed":4246124,"data_compressed_allocated":5935104,"data_compressed_original":24567808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13844480,"data_stored":33555138,"data_compressed":4580308,"data_compressed_allocated":5976064,"data_compressed_original":25698304,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39866368,"data_stored":87724332,"data_compressed":11483169,"data_compressed_allocated":15335424,"data_compressed_original":63209472,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22417408,"data_stored":50333888,"data_compressed":6935579,"data_compressed_allocated":9256960,"data_compressed_original":37212160,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26050560,"data_stored":51889147,"data_compressed":6252828,"data_compressed_allocated":8593408,"data_compressed_original":34451456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15904768,"data_stored":33556031,"data_compressed":4280237,"data_compressed_allocated":5771264,"data_compressed_original":23433216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12591104,"data_stored":30917336,"data_compressed":4325598,"data_compressed_allocated":5689344,"data_compressed_original":24039424,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-18T00:48:09.182 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-18T00:48:09.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.350+0000 7f60bf600640 1 Processor -- start 2024-01-18T00:48:09.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.350+0000 7f60bf600640 1 -- start start 2024-01-18T00:48:09.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.350+0000 7f60bf600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f60b80c5680 0x7f60b8150280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:09.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.350+0000 7f60bf600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60b80c37c0 0x7f60b81507c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:09.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.350+0000 7f60bf600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b8159b40 con 0x7f60b80c5a60 2024-01-18T00:48:09.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.350+0000 7f60bf600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b8159e20 con 0x7f60b80c5680 2024-01-18T00:48:09.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.350+0000 7f60bf600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b815a100 con 0x7f60b80c37c0 2024-01-18T00:48:09.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.354+0000 7f60bcc00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f60b80c5680 0x7f60b8150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:09.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.354+0000 7f60bcc00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f60b80c5680 0x7f60b8150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47140/0 (socket says 172.21.15.161:47140) 2024-01-18T00:48:09.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.354+0000 7f60bcc00640 1 -- 172.21.15.161:0/3604870497 learned_addr learned my addr 172.21.15.161:0/3604870497 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:48:09.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.354+0000 7f60bcc00640 1 -- 172.21.15.161:0/3604870497 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60b80c37c0 msgr2=0x7f60b81507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:09.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.354+0000 7f60bcc00640 1 --2- 172.21.15.161:0/3604870497 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60b80c37c0 0x7f60b81507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:09.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.354+0000 7f60bcc00640 1 -- 172.21.15.161:0/3604870497 >> v1:172.21.15.161:6789/0 conn(0x7f60b80c5a60 legacy=0x7f60b80c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:09.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.354+0000 7f60bcc00640 1 -- 172.21.15.161:0/3604870497 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b815a3e0 con 0x7f60b80c5680 2024-01-18T00:48:09.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.358+0000 7f60bcc00640 1 --2- 172.21.15.161:0/3604870497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60b80c5680 0x7f60b8150280 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f60a8009870 tx=0x7f60a801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434f339dfc501150 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:09.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.362+0000 7f60b7400640 1 -- 172.21.15.161:0/3604870497 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a80a89b0 con 0x7f60b80c5680 2024-01-18T00:48:09.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.362+0000 7f60b7400640 1 -- 172.21.15.161:0/3604870497 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a80a8b10 con 0x7f60b80c5680 2024-01-18T00:48:09.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.362+0000 7f60b7400640 1 -- 172.21.15.161:0/3604870497 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a80a8ea0 con 0x7f60b80c5680 2024-01-18T00:48:09.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.362+0000 7f60bf600640 1 -- 172.21.15.161:0/3604870497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60b80c5680 msgr2=0x7f60b8150280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:09.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.362+0000 7f60bf600640 1 --2- 172.21.15.161:0/3604870497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60b80c5680 0x7f60b8150280 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f60a8009870 tx=0x7f60a801ecf0 comp rx=0 tx=0).stop 2024-01-18T00:48:09.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.362+0000 7f60bf600640 1 -- 172.21.15.161:0/3604870497 shutdown_connections 2024-01-18T00:48:09.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.362+0000 7f60bf600640 1 --2- 172.21.15.161:0/3604870497 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60b80c37c0 0x7f60b81507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:09.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.362+0000 7f60bf600640 1 --2- 172.21.15.161:0/3604870497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60b80c5680 0x7f60b8150280 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:09.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.362+0000 7f60bf600640 1 -- 172.21.15.161:0/3604870497 >> 172.21.15.161:0/3604870497 conn(0x7f60b80c82d0 msgr2=0x7f60b80c86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:09.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.366+0000 7f60bf600640 1 -- 172.21.15.161:0/3604870497 shutdown_connections 2024-01-18T00:48:09.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.366+0000 7f60bf600640 1 -- 172.21.15.161:0/3604870497 wait complete. 2024-01-18T00:48:09.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.366+0000 7f60bf600640 1 Processor -- start 2024-01-18T00:48:09.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.366+0000 7f60bf600640 1 -- start start 2024-01-18T00:48:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.366+0000 7f60bf600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60b80c37c0 0x7f60b80ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.366+0000 7f60bf600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60b80c5680 0x7f60b8154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.366+0000 7f60bf600640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60b8156e80 0x7f60b81547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.366+0000 7f60bf600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b8156120 con 0x7f60b80c5680 2024-01-18T00:48:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.366+0000 7f60bf600640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b8151300 con 0x7f60b8156e80 2024-01-18T00:48:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.366+0000 7f60bf600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b81515a0 con 0x7f60b80c37c0 2024-01-18T00:48:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.366+0000 7f60b7e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60b80c5680 0x7f60b8154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.370+0000 7f60b7e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60b80c5680 0x7f60b8154260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47156/0 (socket says 172.21.15.161:47156) 2024-01-18T00:48:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.370+0000 7f60b7e00640 1 -- 172.21.15.161:0/2817953781 learned_addr learned my addr 172.21.15.161:0/2817953781 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:48:09.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.370+0000 7f60b7e00640 1 -- 172.21.15.161:0/2817953781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60b80c37c0 msgr2=0x7f60b80ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:09.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.370+0000 7f60b7e00640 1 --2- 172.21.15.161:0/2817953781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60b80c37c0 0x7f60b80ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:09.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.370+0000 7f60b7e00640 1 -- 172.21.15.161:0/2817953781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60b8156e80 msgr2=0x7f60b81547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:09.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.370+0000 7f60b7e00640 1 --2- 172.21.15.161:0/2817953781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60b8156e80 0x7f60b81547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:09.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.370+0000 7f60b7e00640 1 -- 172.21.15.161:0/2817953781 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a80094d0 con 0x7f60b80c5680 2024-01-18T00:48:09.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.378+0000 7f60b7e00640 1 --2- 172.21.15.161:0/2817953781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60b80c5680 0x7f60b8154260 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f60a000b3e0 tx=0x7f60a000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:09.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.382+0000 7f60b4c00640 1 -- 172.21.15.161:0/2817953781 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a0011830 con 0x7f60b80c5680 2024-01-18T00:48:09.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.382+0000 7f60b4c00640 1 -- 172.21.15.161:0/2817953781 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a00119b0 con 0x7f60b80c5680 2024-01-18T00:48:09.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.382+0000 7f60b4c00640 1 -- 172.21.15.161:0/2817953781 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a0011d60 con 0x7f60b80c5680 2024-01-18T00:48:09.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.382+0000 7f60bf600640 1 -- 172.21.15.161:0/2817953781 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b8151880 con 0x7f60b80c5680 2024-01-18T00:48:09.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.382+0000 7f60bf600640 1 -- 172.21.15.161:0/2817953781 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b8151e40 con 0x7f60b80c5680 2024-01-18T00:48:09.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.386+0000 7f60bf600640 1 -- 172.21.15.161:0/2817953781 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b806c100 con 0x7f60b80c5680 2024-01-18T00:48:09.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.406+0000 7f60b4c00640 1 -- 172.21.15.161:0/2817953781 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f60a001a400 con 0x7f60b80c5680 2024-01-18T00:48:09.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.406+0000 7f60b4c00640 1 --2- 172.21.15.161:0/2817953781 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6090066840 0x7f6090068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:09.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.406+0000 7f60bcc00640 1 --2- 172.21.15.161:0/2817953781 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6090066840 0x7f6090068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:09.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.406+0000 7f60bcc00640 1 --2- 172.21.15.161:0/2817953781 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6090066840 0x7f6090068d00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f60a80b2000 tx=0x7f60a8004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:09.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.406+0000 7f60b4c00640 1 -- 172.21.15.161:0/2817953781 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f60a0055890 con 0x7f60b80c5680 2024-01-18T00:48:09.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.642+0000 7f60b4c00640 1 -- 172.21.15.161:0/2817953781 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f60a0051bd0 con 0x7f60b80c5680 2024-01-18T00:48:09.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.794+0000 7f60bf600640 1 -- 172.21.15.161:0/2817953781 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f60b80746a0 con 0x7f60b80c5680 2024-01-18T00:48:09.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.894+0000 7f60b4c00640 1 -- 172.21.15.161:0/2817953781 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f60a0015020 con 0x7f60b80c5680 2024-01-18T00:48:09.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.894+0000 7f60b4c00640 1 -- 172.21.15.161:0/2817953781 <== mon.0 v2:172.21.15.161:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f60a005dae0 con 0x7f60b80c5680 2024-01-18T00:48:09.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.898+0000 7f60bf600640 1 -- 172.21.15.161:0/2817953781 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6090066840 msgr2=0x7f6090068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:09.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.898+0000 7f60bf600640 1 --2- 172.21.15.161:0/2817953781 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6090066840 0x7f6090068d00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f60a80b2000 tx=0x7f60a8004740 comp rx=0 tx=0).stop 2024-01-18T00:48:09.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.898+0000 7f60bf600640 1 -- 172.21.15.161:0/2817953781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60b80c5680 msgr2=0x7f60b8154260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:09.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.898+0000 7f60bf600640 1 --2- 172.21.15.161:0/2817953781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60b80c5680 0x7f60b8154260 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f60a000b3e0 tx=0x7f60a000b8a0 comp rx=0 tx=0).stop 2024-01-18T00:48:09.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.898+0000 7f60bf600640 1 -- 172.21.15.161:0/2817953781 shutdown_connections 2024-01-18T00:48:09.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.898+0000 7f60bf600640 1 --2- 172.21.15.161:0/2817953781 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6090066840 0x7f6090068d00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:09.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.898+0000 7f60bf600640 1 --2- 172.21.15.161:0/2817953781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60b8156e80 0x7f60b81547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:09.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.898+0000 7f60bf600640 1 --2- 172.21.15.161:0/2817953781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60b80c5680 0x7f60b8154260 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:09.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.898+0000 7f60bf600640 1 --2- 172.21.15.161:0/2817953781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60b80c37c0 0x7f60b80ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:09.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.898+0000 7f60bf600640 1 -- 172.21.15.161:0/2817953781 >> 172.21.15.161:0/2817953781 conn(0x7f60b80c82d0 msgr2=0x7f60b80c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:09.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.898+0000 7f60bf600640 1 -- 172.21.15.161:0/2817953781 shutdown_connections 2024-01-18T00:48:09.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:09.898+0000 7f60bf600640 1 -- 172.21.15.161:0/2817953781 wait complete. 2024-01-18T00:48:09.924 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-18T00:48:09.924 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-18T00:48:10.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.066+0000 7f6af2400640 1 Processor -- start 2024-01-18T00:48:10.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.070+0000 7f6af2400640 1 -- start start 2024-01-18T00:48:10.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.070+0000 7f6af2400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6aec06c840 0x7f6aec1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:10.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.070+0000 7f6af2400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec072b80 con 0x7f6aec06cf50 2024-01-18T00:48:10.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.070+0000 7f6af2400640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec0728a0 con 0x7f6aec06d330 2024-01-18T00:48:10.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.070+0000 7f6af2400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aec0720a0 con 0x7f6aec06c840 2024-01-18T00:48:10.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.070+0000 7f6aebe00640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f6aec06d330 0x7f6aec156e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.161:43906/0 (socket says 172.21.15.161:43906) 2024-01-18T00:48:10.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.070+0000 7f6aebe00640 1 -- 172.21.15.161:0/2760377594 learned_addr learned my addr 172.21.15.161:0/2760377594 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-18T00:48:10.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.106+0000 7f6aeaa00640 1 --2- 172.21.15.161:0/2760377594 >> v2:172.21.15.161:3300/0 conn(0x7f6aec06c840 0x7f6aec1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:10.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.110+0000 7f6aeaa00640 1 -- 172.21.15.161:0/2760377594 >> v1:172.21.15.190:6789/0 conn(0x7f6aec06d330 legacy=0x7f6aec156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:10.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.110+0000 7f6aeaa00640 1 -- 172.21.15.161:0/2760377594 >> v1:172.21.15.161:6789/0 conn(0x7f6aec06cf50 legacy=0x7f6aec15ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:10.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.110+0000 7f6aeaa00640 1 -- 172.21.15.161:0/2760377594 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec0712e0 con 0x7f6aec06c840 2024-01-18T00:48:10.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.114+0000 7f6aeaa00640 1 --2- 172.21.15.161:0/2760377594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aec06c840 0x7f6aec1568d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40097c0 tx=0x7f6ad401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1682f43a04d49f82 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:10.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.118+0000 7f6aea000640 1 -- 172.21.15.161:0/2760377594 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40ab610 con 0x7f6aec06c840 2024-01-18T00:48:10.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.118+0000 7f6aea000640 1 -- 172.21.15.161:0/2760377594 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6ad40ab770 con 0x7f6aec06c840 2024-01-18T00:48:10.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.118+0000 7f6aea000640 1 -- 172.21.15.161:0/2760377594 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40abb20 con 0x7f6aec06c840 2024-01-18T00:48:10.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.118+0000 7f6af2400640 1 -- 172.21.15.161:0/2760377594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aec06c840 msgr2=0x7f6aec1568d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:10.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.118+0000 7f6af2400640 1 --2- 172.21.15.161:0/2760377594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aec06c840 0x7f6aec1568d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40097c0 tx=0x7f6ad401c410 comp rx=0 tx=0).stop 2024-01-18T00:48:10.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.118+0000 7f6af2400640 1 -- 172.21.15.161:0/2760377594 shutdown_connections 2024-01-18T00:48:10.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.118+0000 7f6af2400640 1 --2- 172.21.15.161:0/2760377594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aec06c840 0x7f6aec1568d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:10.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.118+0000 7f6af2400640 1 -- 172.21.15.161:0/2760377594 >> 172.21.15.161:0/2760377594 conn(0x7f6aec0cb070 msgr2=0x7f6aec0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:10.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.118+0000 7f6af2400640 1 -- 172.21.15.161:0/2760377594 shutdown_connections 2024-01-18T00:48:10.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.118+0000 7f6af2400640 1 -- 172.21.15.161:0/2760377594 wait complete. 2024-01-18T00:48:10.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.118+0000 7f6af2400640 1 Processor -- start 2024-01-18T00:48:10.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.122+0000 7f6af2400640 1 -- start start 2024-01-18T00:48:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.122+0000 7f6af2400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aec06c840 0x7f6aec0c2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.122+0000 7f6af2400640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6aec06cf50 0x7f6aec158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.122+0000 7f6af2400640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6aec06d330 0x7f6aec1f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.122+0000 7f6af2400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec15c620 con 0x7f6aec06c840 2024-01-18T00:48:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.122+0000 7f6af2400640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec152400 con 0x7f6aec06d330 2024-01-18T00:48:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.122+0000 7f6af2400640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec1f3940 con 0x7f6aec06cf50 2024-01-18T00:48:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.122+0000 7f6aeb400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aec06c840 0x7f6aec0c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:10.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.122+0000 7f6aeb400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aec06c840 0x7f6aec0c2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47170/0 (socket says 172.21.15.161:47170) 2024-01-18T00:48:10.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.122+0000 7f6aeb400640 1 -- 172.21.15.161:0/2945335567 learned_addr learned my addr 172.21.15.161:0/2945335567 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:48:10.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.126+0000 7f6aeb400640 1 -- 172.21.15.161:0/2945335567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6aec06cf50 msgr2=0x7f6aec158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:10.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.126+0000 7f6aeb400640 1 --2- 172.21.15.161:0/2945335567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6aec06cf50 0x7f6aec158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:10.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.126+0000 7f6aeb400640 1 -- 172.21.15.161:0/2945335567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6aec06d330 msgr2=0x7f6aec1f3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:10.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.126+0000 7f6aeb400640 1 --2- 172.21.15.161:0/2945335567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6aec06d330 0x7f6aec1f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:10.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.126+0000 7f6aeb400640 1 -- 172.21.15.161:0/2945335567 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad4009420 con 0x7f6aec06c840 2024-01-18T00:48:10.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.126+0000 7f6aeb400640 1 --2- 172.21.15.161:0/2945335567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aec06c840 0x7f6aec0c2620 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00c490 tx=0x7f6adc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:10.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.130+0000 7f6ae3400640 1 -- 172.21.15.161:0/2945335567 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc003600 con 0x7f6aec06c840 2024-01-18T00:48:10.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.130+0000 7f6ae3400640 1 -- 172.21.15.161:0/2945335567 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6adc003780 con 0x7f6aec06c840 2024-01-18T00:48:10.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.130+0000 7f6ae3400640 1 -- 172.21.15.161:0/2945335567 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc003b90 con 0x7f6aec06c840 2024-01-18T00:48:10.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.130+0000 7f6af2400640 1 -- 172.21.15.161:0/2945335567 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aec15d6c0 con 0x7f6aec06c840 2024-01-18T00:48:10.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.130+0000 7f6af2400640 1 -- 172.21.15.161:0/2945335567 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aec15c340 con 0x7f6aec06c840 2024-01-18T00:48:10.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.134+0000 7f6af2400640 1 -- 172.21.15.161:0/2945335567 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aec15d520 con 0x7f6aec06c840 2024-01-18T00:48:10.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.150+0000 7f6ae3400640 1 -- 172.21.15.161:0/2945335567 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f6adc003cf0 con 0x7f6aec06c840 2024-01-18T00:48:10.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.154+0000 7f6ae3400640 1 --2- 172.21.15.161:0/2945335567 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6ac40668c0 0x7f6ac4068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:10.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.154+0000 7f6aeaa00640 1 --2- 172.21.15.161:0/2945335567 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6ac40668c0 0x7f6ac4068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:10.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.154+0000 7f6aeaa00640 1 --2- 172.21.15.161:0/2945335567 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6ac40668c0 0x7f6ac4068d80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40af000 tx=0x7f6ad4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:10.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.154+0000 7f6ae3400640 1 -- 172.21.15.161:0/2945335567 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f6adc0550c0 con 0x7f6aec06c840 2024-01-18T00:48:10.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.386+0000 7f6ae3400640 1 -- 172.21.15.161:0/2945335567 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f6adc050d00 con 0x7f6aec06c840 2024-01-18T00:48:10.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.578+0000 7f6af2400640 1 -- 172.21.15.161:0/2945335567 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6aec15d520 con 0x7f6aec06c840 2024-01-18T00:48:10.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.598+0000 7f6ae3400640 1 -- 172.21.15.161:0/2945335567 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+6563 (secure 0 0 0) 0x7f6aec15d520 con 0x7f6aec06c840 2024-01-18T00:48:10.598 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-18T00:48:10.598 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6839/2820898287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":2820898287},{"type":"v1","addr":"172.21.15.161:6839","nonce":2820898287}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/2332272186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2332272186},{"type":"v1","addr":"172.21.15.190:6833","nonce":2332272186}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3170137737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3170137737},{"type":"v1","addr":"172.21.15.190:6835","nonce":3170137737}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-17T22:58:49.015246+0000","modified":"2024-01-17T23:57:35.607549+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4269,"mds_1":4263,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":17,"addr":"172.21.15.161:6835/1671527613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1671527613},{"type":"v1","addr":"172.21.15.161:6835","nonce":1671527613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4263":{"gid":4263,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":16,"addr":"172.21.15.161:6837/409686078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":409686078},{"type":"v1","addr":"172.21.15.161:6837","nonce":409686078}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4269":{"gid":4269,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":879,"addr":"172.21.15.190:6837/561131647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":561131647},{"type":"v1","addr":"172.21.15.190:6837","nonce":561131647}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-18T00:48:10.598 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 19 2024-01-18T00:48:10.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.598+0000 7f6af2400640 1 -- 172.21.15.161:0/2945335567 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6ac40668c0 msgr2=0x7f6ac4068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:10.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.598+0000 7f6af2400640 1 --2- 172.21.15.161:0/2945335567 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6ac40668c0 0x7f6ac4068d80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40af000 tx=0x7f6ad4008040 comp rx=0 tx=0).stop 2024-01-18T00:48:10.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.598+0000 7f6af2400640 1 -- 172.21.15.161:0/2945335567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aec06c840 msgr2=0x7f6aec0c2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:10.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.598+0000 7f6af2400640 1 --2- 172.21.15.161:0/2945335567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aec06c840 0x7f6aec0c2620 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00c490 tx=0x7f6adc001e80 comp rx=0 tx=0).stop 2024-01-18T00:48:10.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.598+0000 7f6af2400640 1 -- 172.21.15.161:0/2945335567 shutdown_connections 2024-01-18T00:48:10.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.598+0000 7f6af2400640 1 --2- 172.21.15.161:0/2945335567 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f6ac40668c0 0x7f6ac4068d80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:10.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.598+0000 7f6af2400640 1 --2- 172.21.15.161:0/2945335567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6aec06d330 0x7f6aec1f3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:10.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.598+0000 7f6af2400640 1 --2- 172.21.15.161:0/2945335567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6aec06cf50 0x7f6aec158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:10.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.598+0000 7f6af2400640 1 --2- 172.21.15.161:0/2945335567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aec06c840 0x7f6aec0c2620 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:10.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.598+0000 7f6af2400640 1 -- 172.21.15.161:0/2945335567 >> 172.21.15.161:0/2945335567 conn(0x7f6aec0cb070 msgr2=0x7f6aec06a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:10.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.598+0000 7f6af2400640 1 -- 172.21.15.161:0/2945335567 shutdown_connections 2024-01-18T00:48:10.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.598+0000 7f6af2400640 1 -- 172.21.15.161:0/2945335567 wait complete. 2024-01-18T00:48:10.621 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-18T00:48:10.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.758+0000 7f44f0c00640 1 Processor -- start 2024-01-18T00:48:10.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.758+0000 7f44f0c00640 1 -- start start 2024-01-18T00:48:10.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.758+0000 7f44f0c00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f44ec153d00 0x7f44ec06a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:10.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.758+0000 7f44f0c00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44ec06ac20 0x7f44ec0c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:10.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.758+0000 7f44f0c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ec0c2470 con 0x7f44ec0c2e60 2024-01-18T00:48:10.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.758+0000 7f44f0c00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ec0c32f0 con 0x7f44ec153d00 2024-01-18T00:48:10.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.758+0000 7f44f0c00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec15cec0 con 0x7f44ec06ac20 2024-01-18T00:48:10.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.758+0000 7f44ea800640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f44ec0c2e60 0x7f44ec0cc110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:48388/0 (socket says 172.21.15.161:48388) 2024-01-18T00:48:10.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.758+0000 7f44ea800640 1 -- 172.21.15.161:0/3180857536 learned_addr learned my addr 172.21.15.161:0/3180857536 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-18T00:48:10.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.758+0000 7f44e9400640 1 --2- 172.21.15.161:0/3180857536 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44ec06ac20 0x7f44ec0c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:10.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.758+0000 7f44e9e00640 1 --2- 172.21.15.161:0/3180857536 >> v2:172.21.15.190:3300/0 conn(0x7f44ec153d00 0x7f44ec06a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:10.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.762+0000 7f44e8a00640 1 -- 172.21.15.161:0/3180857536 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039063289 0 0) 0x7f44ec0c2470 con 0x7f44ec0c2e60 2024-01-18T00:48:10.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.762+0000 7f44e8a00640 1 -- 172.21.15.161:0/3180857536 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44cc003530 con 0x7f44ec0c2e60 2024-01-18T00:48:10.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.766+0000 7f44e8a00640 1 -- 172.21.15.161:0/3180857536 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2097256826 0 0) 0x7f44cc003530 con 0x7f44ec0c2e60 2024-01-18T00:48:10.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.766+0000 7f44e8a00640 1 -- 172.21.15.161:0/3180857536 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44ec06ac20 msgr2=0x7f44ec0c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:10.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.766+0000 7f44e8a00640 1 --2- 172.21.15.161:0/3180857536 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44ec06ac20 0x7f44ec0c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:10.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.766+0000 7f44e8a00640 1 -- 172.21.15.161:0/3180857536 >> v2:172.21.15.190:3300/0 conn(0x7f44ec153d00 msgr2=0x7f44ec06a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:10.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.766+0000 7f44e8a00640 1 --2- 172.21.15.161:0/3180857536 >> v2:172.21.15.190:3300/0 conn(0x7f44ec153d00 0x7f44ec06a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:10.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.766+0000 7f44e8a00640 1 -- 172.21.15.161:0/3180857536 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec15d1a0 con 0x7f44ec0c2e60 2024-01-18T00:48:10.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.766+0000 7f44e8a00640 1 -- 172.21.15.161:0/3180857536 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f44e4001a00 con 0x7f44ec0c2e60 2024-01-18T00:48:10.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.766+0000 7f44e8a00640 1 -- 172.21.15.161:0/3180857536 >> v1:172.21.15.161:6789/0 conn(0x7f44ec0c2e60 legacy=0x7f44ec0cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:10.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.766+0000 7f44e8a00640 1 --2- 172.21.15.161:0/3180857536 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44ec06ac20 0x7f44cc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:10.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.766+0000 7f44e8a00640 1 --2- 172.21.15.161:0/3180857536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44cc003f50 0x7f44cc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:10.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.766+0000 7f44e8a00640 1 --2- 172.21.15.161:0/3180857536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44cc004d10 0x7f44cc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:10.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.766+0000 7f44e8a00640 1 -- 172.21.15.161:0/3180857536 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec0c32f0 con 0x7f44cc003f50 2024-01-18T00:48:10.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.766+0000 7f44e8a00640 1 -- 172.21.15.161:0/3180857536 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec15cec0 con 0x7f44cc004d10 2024-01-18T00:48:10.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.766+0000 7f44e8a00640 1 -- 172.21.15.161:0/3180857536 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc00b990 con 0x7f44ec06ac20 2024-01-18T00:48:10.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.766+0000 7f44e9400640 1 --2- 172.21.15.161:0/3180857536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44cc003f50 0x7f44cc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:10.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.770+0000 7f44e9400640 1 -- 172.21.15.161:0/3180857536 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44ec06ac20 msgr2=0x7f44cc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:10.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.770+0000 7f44e9400640 1 --2- 172.21.15.161:0/3180857536 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44ec06ac20 0x7f44cc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:10.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.770+0000 7f44e9400640 1 -- 172.21.15.161:0/3180857536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44cc004d10 msgr2=0x7f44cc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:10.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.770+0000 7f44e9400640 1 --2- 172.21.15.161:0/3180857536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44cc004d10 0x7f44cc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:10.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.770+0000 7f44e9400640 1 -- 172.21.15.161:0/3180857536 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc003530 con 0x7f44cc003f50 2024-01-18T00:48:10.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.774+0000 7f44e9400640 1 --2- 172.21.15.161:0/3180857536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44cc003f50 0x7f44cc0047d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f44d4009b10 tx=0x7f44d401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810941cd895b7dce server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:10.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.778+0000 7f44e8a00640 1 -- 172.21.15.161:0/3180857536 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d40a5680 con 0x7f44cc003f50 2024-01-18T00:48:10.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.778+0000 7f44e8a00640 1 -- 172.21.15.161:0/3180857536 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f44d40a57e0 con 0x7f44cc003f50 2024-01-18T00:48:10.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.778+0000 7f44e8a00640 1 -- 172.21.15.161:0/3180857536 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d40a5bb0 con 0x7f44cc003f50 2024-01-18T00:48:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.778+0000 7f44f0c00640 1 -- 172.21.15.161:0/3180857536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44cc003f50 msgr2=0x7f44cc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.778+0000 7f44f0c00640 1 --2- 172.21.15.161:0/3180857536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44cc003f50 0x7f44cc0047d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f44d4009b10 tx=0x7f44d401ca90 comp rx=0 tx=0).stop 2024-01-18T00:48:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.778+0000 7f44ea800640 1 -- 172.21.15.161:0/3180857536 reap_dead start 2024-01-18T00:48:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.778+0000 7f44f0c00640 1 -- 172.21.15.161:0/3180857536 shutdown_connections 2024-01-18T00:48:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.778+0000 7f44f0c00640 1 -- 172.21.15.161:0/3180857536 >> 172.21.15.161:0/3180857536 conn(0x7f44ec06e0e0 msgr2=0x7f44ec06e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:10.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.778+0000 7f44f0c00640 1 -- 172.21.15.161:0/3180857536 shutdown_connections 2024-01-18T00:48:10.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.778+0000 7f44f0c00640 1 -- 172.21.15.161:0/3180857536 wait complete. 2024-01-18T00:48:10.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.782+0000 7f44f0c00640 1 Processor -- start 2024-01-18T00:48:10.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.782+0000 7f44f0c00640 1 -- start start 2024-01-18T00:48:10.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.782+0000 7f44f0c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44cc003f50 0x7f44ec1f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:10.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.782+0000 7f44f0c00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44ec1f2df0 0x7f44ec155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:10.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.782+0000 7f44f0c00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44ec156470 0x7f44ec149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:10.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.782+0000 7f44f0c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec14dfb0 con 0x7f44cc003f50 2024-01-18T00:48:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.782+0000 7f44f0c00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec1f35a0 con 0x7f44ec1f2df0 2024-01-18T00:48:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.782+0000 7f44f0c00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec155aa0 con 0x7f44ec156470 2024-01-18T00:48:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.782+0000 7f44e9e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44cc003f50 0x7f44ec1f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.782+0000 7f44e9e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44cc003f50 0x7f44ec1f28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47184/0 (socket says 172.21.15.161:47184) 2024-01-18T00:48:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.782+0000 7f44e9e00640 1 -- 172.21.15.161:0/2841890138 learned_addr learned my addr 172.21.15.161:0/2841890138 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:48:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.786+0000 7f44e9400640 1 --2- 172.21.15.161:0/2841890138 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44ec1f2df0 0x7f44ec155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.786+0000 7f44ea800640 1 --2- 172.21.15.161:0/2841890138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44ec156470 0x7f44ec149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.786+0000 7f44e9e00640 1 -- 172.21.15.161:0/2841890138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44ec156470 msgr2=0x7f44ec149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.786+0000 7f44e9e00640 1 --2- 172.21.15.161:0/2841890138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44ec156470 0x7f44ec149540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.786+0000 7f44e9e00640 1 -- 172.21.15.161:0/2841890138 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44ec1f2df0 msgr2=0x7f44ec155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:10.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.786+0000 7f44e9e00640 1 --2- 172.21.15.161:0/2841890138 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44ec1f2df0 0x7f44ec155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:10.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.786+0000 7f44e9e00640 1 -- 172.21.15.161:0/2841890138 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec14dcd0 con 0x7f44cc003f50 2024-01-18T00:48:10.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.790+0000 7f44e9e00640 1 --2- 172.21.15.161:0/2841890138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44cc003f50 0x7f44ec1f28b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00e840 tx=0x7f44dc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.794+0000 7f44e2000640 1 -- 172.21.15.161:0/2841890138 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc009620 con 0x7f44cc003f50 2024-01-18T00:48:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.794+0000 7f44f0c00640 1 -- 172.21.15.161:0/2841890138 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ec1f32c0 con 0x7f44cc003f50 2024-01-18T00:48:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.794+0000 7f44f0c00640 1 -- 172.21.15.161:0/2841890138 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ec156ef0 con 0x7f44cc003f50 2024-01-18T00:48:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.794+0000 7f44e2000640 1 -- 172.21.15.161:0/2841890138 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f44dc0059a0 con 0x7f44cc003f50 2024-01-18T00:48:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.794+0000 7f44e2000640 1 -- 172.21.15.161:0/2841890138 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc005d10 con 0x7f44cc003f50 2024-01-18T00:48:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.794+0000 7f44f0c00640 1 -- 172.21.15.161:0/2841890138 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44bc0052a0 con 0x7f44cc003f50 2024-01-18T00:48:10.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.814+0000 7f44e2000640 1 -- 172.21.15.161:0/2841890138 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f44dc00c940 con 0x7f44cc003f50 2024-01-18T00:48:10.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.814+0000 7f44e2000640 1 --2- 172.21.15.161:0/2841890138 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f44c4066870 0x7f44c4068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:10.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.818+0000 7f44e9400640 1 --2- 172.21.15.161:0/2841890138 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f44c4066870 0x7f44c4068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:10.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:10.818+0000 7f44e9400640 1 --2- 172.21.15.161:0/2841890138 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f44c4066870 0x7f44c4068d30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f44d40af000 tx=0x7f44d40046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:11.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.046+0000 7f44e2000640 1 -- 172.21.15.161:0/2841890138 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f44dc055580 con 0x7f44cc003f50 2024-01-18T00:48:11.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.046+0000 7f44e2000640 1 -- 172.21.15.161:0/2841890138 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f44dc0518c0 con 0x7f44cc003f50 2024-01-18T00:48:11.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.234+0000 7f44f0c00640 1 -- 172.21.15.161:0/2841890138 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44bc005900 con 0x7f44cc003f50 2024-01-18T00:48:11.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.250+0000 7f44e2000640 1 -- 172.21.15.161:0/2841890138 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+6563 (secure 0 0 0) 0x7f44bc005900 con 0x7f44cc003f50 2024-01-18T00:48:11.250 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-18T00:48:11.250 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6839/2820898287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":2820898287},{"type":"v1","addr":"172.21.15.161:6839","nonce":2820898287}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/2332272186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2332272186},{"type":"v1","addr":"172.21.15.190:6833","nonce":2332272186}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3170137737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3170137737},{"type":"v1","addr":"172.21.15.190:6835","nonce":3170137737}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-17T22:58:49.015246+0000","modified":"2024-01-17T23:57:35.607549+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4269,"mds_1":4263,"mds_2":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":17,"addr":"172.21.15.161:6835/1671527613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1671527613},{"type":"v1","addr":"172.21.15.161:6835","nonce":1671527613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4263":{"gid":4263,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":16,"addr":"172.21.15.161:6837/409686078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":409686078},{"type":"v1","addr":"172.21.15.161:6837","nonce":409686078}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4269":{"gid":4269,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":879,"addr":"172.21.15.190:6837/561131647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":561131647},{"type":"v1","addr":"172.21.15.190:6837","nonce":561131647}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-18T00:48:11.251 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 19 2024-01-18T00:48:11.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.250+0000 7f44f0c00640 1 -- 172.21.15.161:0/2841890138 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f44c4066870 msgr2=0x7f44c4068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:11.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.250+0000 7f44f0c00640 1 --2- 172.21.15.161:0/2841890138 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f44c4066870 0x7f44c4068d30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f44d40af000 tx=0x7f44d40046d0 comp rx=0 tx=0).stop 2024-01-18T00:48:11.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.250+0000 7f44f0c00640 1 -- 172.21.15.161:0/2841890138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44cc003f50 msgr2=0x7f44ec1f28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:11.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.250+0000 7f44f0c00640 1 --2- 172.21.15.161:0/2841890138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44cc003f50 0x7f44ec1f28b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00e840 tx=0x7f44dc00ed00 comp rx=0 tx=0).stop 2024-01-18T00:48:11.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.250+0000 7f44f0c00640 1 -- 172.21.15.161:0/2841890138 shutdown_connections 2024-01-18T00:48:11.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.250+0000 7f44f0c00640 1 --2- 172.21.15.161:0/2841890138 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f44c4066870 0x7f44c4068d30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:11.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.250+0000 7f44f0c00640 1 --2- 172.21.15.161:0/2841890138 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44ec1f2df0 0x7f44ec155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:11.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.250+0000 7f44f0c00640 1 --2- 172.21.15.161:0/2841890138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44ec156470 0x7f44ec149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:11.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.250+0000 7f44f0c00640 1 --2- 172.21.15.161:0/2841890138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44cc003f50 0x7f44ec1f28b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:11.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.250+0000 7f44f0c00640 1 -- 172.21.15.161:0/2841890138 >> 172.21.15.161:0/2841890138 conn(0x7f44ec06e0e0 msgr2=0x7f44ec14e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:11.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.250+0000 7f44f0c00640 1 -- 172.21.15.161:0/2841890138 shutdown_connections 2024-01-18T00:48:11.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.250+0000 7f44f0c00640 1 -- 172.21.15.161:0/2841890138 wait complete. 2024-01-18T00:48:11.273 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-18T00:48:11.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.410+0000 7f819f000640 1 Processor -- start 2024-01-18T00:48:11.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.410+0000 7f819f000640 1 -- start start 2024-01-18T00:48:11.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.410+0000 7f819f000640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f81980c8230 0x7f8198070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:11.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.410+0000 7f819f000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81980ca470 0x7f81980712c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:11.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.410+0000 7f819f000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8198157750 con 0x7f81981514b0 2024-01-18T00:48:11.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.410+0000 7f819f000640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819815af30 con 0x7f81980c8230 2024-01-18T00:48:11.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.410+0000 7f819f000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819815b210 con 0x7f81980ca470 2024-01-18T00:48:11.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.410+0000 7f8197e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f81981514b0 0x7f8198157be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:48398/0 (socket says 172.21.15.161:48398) 2024-01-18T00:48:11.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.410+0000 7f8197e00640 1 -- 172.21.15.161:0/3191038069 learned_addr learned my addr 172.21.15.161:0/3191038069 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-01-18T00:48:11.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.414+0000 7f819d000640 1 --2- 172.21.15.161:0/3191038069 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81980ca470 0x7f81980712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:11.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.414+0000 7f8197400640 1 --2- 172.21.15.161:0/3191038069 >> v2:172.21.15.190:3300/0 conn(0x7f81980c8230 0x7f8198070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:11.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.414+0000 7f8196a00640 1 -- 172.21.15.161:0/3191038069 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397941860 0 0) 0x7f8198157750 con 0x7f81981514b0 2024-01-18T00:48:11.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.414+0000 7f8196a00640 1 -- 172.21.15.161:0/3191038069 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8178003530 con 0x7f81981514b0 2024-01-18T00:48:11.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.418+0000 7f8196a00640 1 -- 172.21.15.161:0/3191038069 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4144072925 0 0) 0x7f8178003530 con 0x7f81981514b0 2024-01-18T00:48:11.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.418+0000 7f8196a00640 1 -- 172.21.15.161:0/3191038069 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81980ca470 msgr2=0x7f81980712c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:11.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.418+0000 7f8196a00640 1 --2- 172.21.15.161:0/3191038069 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81980ca470 0x7f81980712c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:11.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.418+0000 7f8196a00640 1 -- 172.21.15.161:0/3191038069 >> v2:172.21.15.190:3300/0 conn(0x7f81980c8230 msgr2=0x7f8198070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:11.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.418+0000 7f8196a00640 1 --2- 172.21.15.161:0/3191038069 >> v2:172.21.15.190:3300/0 conn(0x7f81980c8230 0x7f8198070d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:11.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.418+0000 7f8196a00640 1 -- 172.21.15.161:0/3191038069 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819815b4f0 con 0x7f81981514b0 2024-01-18T00:48:11.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.418+0000 7f8196a00640 1 -- 172.21.15.161:0/3191038069 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1971850982 0 0) 0x7f8188001680 con 0x7f81981514b0 2024-01-18T00:48:11.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.418+0000 7f8196a00640 1 -- 172.21.15.161:0/3191038069 >> v1:172.21.15.161:6789/0 conn(0x7f81981514b0 legacy=0x7f8198157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:11.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.418+0000 7f8196a00640 1 --2- 172.21.15.161:0/3191038069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8178003980 0x7f8178003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:11.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.418+0000 7f8196a00640 1 --2- 172.21.15.161:0/3191038069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81780047d0 0x7f8178004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:11.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.418+0000 7f8196a00640 1 --2- 172.21.15.161:0/3191038069 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81980ca470 0x7f8178005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:11.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.418+0000 7f8196a00640 1 -- 172.21.15.161:0/3191038069 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819815af30 con 0x7f8178003980 2024-01-18T00:48:11.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.418+0000 7f8196a00640 1 -- 172.21.15.161:0/3191038069 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819815b210 con 0x7f81780047d0 2024-01-18T00:48:11.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.418+0000 7f8196a00640 1 -- 172.21.15.161:0/3191038069 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817800b9c0 con 0x7f81980ca470 2024-01-18T00:48:11.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.426+0000 7f8197e00640 1 --2- 172.21.15.161:0/3191038069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8178003980 0x7f8178003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:11.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.430+0000 7f8197e00640 1 -- 172.21.15.161:0/3191038069 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81980ca470 msgr2=0x7f8178005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:11.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.430+0000 7f8197e00640 1 --2- 172.21.15.161:0/3191038069 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81980ca470 0x7f8178005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:11.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.430+0000 7f8197e00640 1 -- 172.21.15.161:0/3191038069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81780047d0 msgr2=0x7f8178004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:11.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.430+0000 7f8197e00640 1 --2- 172.21.15.161:0/3191038069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81780047d0 0x7f8178004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:11.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.430+0000 7f8197e00640 1 -- 172.21.15.161:0/3191038069 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8178003530 con 0x7f8178003980 2024-01-18T00:48:11.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.434+0000 7f8197e00640 1 --2- 172.21.15.161:0/3191038069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8178003980 0x7f8178003da0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f818800c0e0 tx=0x7f818801f2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a74a4e19617ccf1 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:11.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.438+0000 7f8196a00640 1 -- 172.21.15.161:0/3191038069 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81880a8bf0 con 0x7f8178003980 2024-01-18T00:48:11.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.438+0000 7f8196a00640 1 -- 172.21.15.161:0/3191038069 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f81880a8d50 con 0x7f8178003980 2024-01-18T00:48:11.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.438+0000 7f8196a00640 1 -- 172.21.15.161:0/3191038069 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8188005b40 con 0x7f8178003980 2024-01-18T00:48:11.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.438+0000 7f819f000640 1 -- 172.21.15.161:0/3191038069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8178003980 msgr2=0x7f8178003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:11.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.438+0000 7f819f000640 1 --2- 172.21.15.161:0/3191038069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8178003980 0x7f8178003da0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f818800c0e0 tx=0x7f818801f2d0 comp rx=0 tx=0).stop 2024-01-18T00:48:11.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.438+0000 7f819d000640 1 -- 172.21.15.161:0/3191038069 reap_dead start 2024-01-18T00:48:11.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.438+0000 7f819f000640 1 -- 172.21.15.161:0/3191038069 shutdown_connections 2024-01-18T00:48:11.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.438+0000 7f819f000640 1 -- 172.21.15.161:0/3191038069 >> 172.21.15.161:0/3191038069 conn(0x7f819806a8b0 msgr2=0x7f819806f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:11.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.438+0000 7f819f000640 1 -- 172.21.15.161:0/3191038069 shutdown_connections 2024-01-18T00:48:11.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.438+0000 7f819f000640 1 -- 172.21.15.161:0/3191038069 wait complete. 2024-01-18T00:48:11.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.442+0000 7f819f000640 1 Processor -- start 2024-01-18T00:48:11.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.442+0000 7f819f000640 1 -- start start 2024-01-18T00:48:11.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.442+0000 7f819f000640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8178003980 0x7f81981500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:11.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.442+0000 7f819f000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f819814c010 0x7f81980cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:11.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.442+0000 7f819f000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f819814c470 0x7f81980cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:11.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.442+0000 7f819f000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819814b2d0 con 0x7f819814c470 2024-01-18T00:48:11.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.442+0000 7f819f000640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81980cb370 con 0x7f8178003980 2024-01-18T00:48:11.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.442+0000 7f819f000640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819806d610 con 0x7f819814c010 2024-01-18T00:48:11.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.442+0000 7f819d000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f819814c470 0x7f81980cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:11.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.446+0000 7f819d000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f819814c470 0x7f81980cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47192/0 (socket says 172.21.15.161:47192) 2024-01-18T00:48:11.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.446+0000 7f819d000640 1 -- 172.21.15.161:0/2795142400 learned_addr learned my addr 172.21.15.161:0/2795142400 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:48:11.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.446+0000 7f8197e00640 1 --2- 172.21.15.161:0/2795142400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8178003980 0x7f81981500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:11.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.446+0000 7f8197400640 1 --2- 172.21.15.161:0/2795142400 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f819814c010 0x7f81980cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:11.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.450+0000 7f819d000640 1 -- 172.21.15.161:0/2795142400 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f819814c010 msgr2=0x7f81980cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:11.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.450+0000 7f819d000640 1 --2- 172.21.15.161:0/2795142400 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f819814c010 0x7f81980cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:11.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.450+0000 7f819d000640 1 -- 172.21.15.161:0/2795142400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8178003980 msgr2=0x7f81981500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:11.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.450+0000 7f819d000640 1 --2- 172.21.15.161:0/2795142400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8178003980 0x7f81981500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:11.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.450+0000 7f819d000640 1 -- 172.21.15.161:0/2795142400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819814b4b0 con 0x7f819814c470 2024-01-18T00:48:11.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.502+0000 7f819d000640 1 --2- 172.21.15.161:0/2795142400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f819814c470 0x7f81980cc360 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f81980cde60 tx=0x7f819000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:11.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.510+0000 7f818fe00640 1 -- 172.21.15.161:0/2795142400 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8190010040 con 0x7f819814c470 2024-01-18T00:48:11.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.510+0000 7f818fe00640 1 -- 172.21.15.161:0/2795142400 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f819000bae0 con 0x7f819814c470 2024-01-18T00:48:11.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.510+0000 7f818fe00640 1 -- 172.21.15.161:0/2795142400 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819000be90 con 0x7f819814c470 2024-01-18T00:48:11.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.510+0000 7f819f000640 1 -- 172.21.15.161:0/2795142400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81980cad20 con 0x7f819814c470 2024-01-18T00:48:11.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.510+0000 7f819f000640 1 -- 172.21.15.161:0/2795142400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819806c8d0 con 0x7f819814c470 2024-01-18T00:48:11.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.510+0000 7f819f000640 1 -- 172.21.15.161:0/2795142400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81980cb1d0 con 0x7f819814c470 2024-01-18T00:48:11.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.754+0000 7f818fe00640 1 -- 172.21.15.161:0/2795142400 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f8190028430 con 0x7f819814c470 2024-01-18T00:48:11.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.754+0000 7f818fe00640 1 --2- 172.21.15.161:0/2795142400 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8170066890 0x7f8170068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.758+0000 7f8197e00640 1 --2- 172.21.15.161:0/2795142400 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8170066890 0x7f8170068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.758+0000 7f8197e00640 1 --2- 172.21.15.161:0/2795142400 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8170066890 0x7f8170068d50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f81880ad000 tx=0x7f8188000ff0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:11.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.770+0000 7f818fe00640 1 -- 172.21.15.161:0/2795142400 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f8190055cd0 con 0x7f819814c470 2024-01-18T00:48:11.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.770+0000 7f818fe00640 1 -- 172.21.15.161:0/2795142400 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f8190055aa0 con 0x7f819814c470 2024-01-18T00:48:11.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.934+0000 7f819f000640 1 -- 172.21.15.161:0/2795142400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81980cb1d0 con 0x7f819814c470 2024-01-18T00:48:11.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.970+0000 7f818fe00640 1 -- 172.21.15.161:0/2795142400 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18587 (secure 0 0 0) 0x7f81980cb1d0 con 0x7f819814c470 2024-01-18T00:48:11.974 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-18T00:48:11.974 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":28,"fsid":"58c3361f-c527-4d53-a987-e30062ef8beb","created":"2024-01-17T22:57:59.990808+0000","modified":"2024-01-17T22:59:08.571619+0000","last_up_change":"2024-01-17T22:58:15.452106+0000","last_in_change":"2024-01-17T22:58:05.988359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:58:14.876386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T22:58:46.757110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T22:58:47.930512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T22:58:53.561624+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d013c8c8-b2d5-4c32-9512-889ec824946b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6803","nonce":2733858976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6805","nonce":2733858976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6809","nonce":2733858976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2733858976},{"type":"v1","addr":"172.21.15.161:6807","nonce":2733858976}]},"public_addr":"172.21.15.161:6803/2733858976","cluster_addr":"172.21.15.161:6805/2733858976","heartbeat_back_addr":"172.21.15.161:6809/2733858976","heartbeat_front_addr":"172.21.15.161:6807/2733858976","state":["exists","up"]},{"osd":1,"uuid":"023339bd-53e4-49ac-b5a1-d24c569229ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6827","nonce":1566364308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6829","nonce":1566364308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6833","nonce":1566364308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1566364308},{"type":"v1","addr":"172.21.15.161:6831","nonce":1566364308}]},"public_addr":"172.21.15.161:6827/1566364308","cluster_addr":"172.21.15.161:6829/1566364308","heartbeat_back_addr":"172.21.15.161:6833/1566364308","heartbeat_front_addr":"172.21.15.161:6831/1566364308","state":["exists","up"]},{"osd":2,"uuid":"627dc52e-6bf8-4845-91b2-d9f2cb1be607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6812","nonce":3517914982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6817","nonce":3517914982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6825","nonce":3517914982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6819","nonce":3517914982},{"type":"v1","addr":"172.21.15.161:6821","nonce":3517914982}]},"public_addr":"172.21.15.161:6812/3517914982","cluster_addr":"172.21.15.161:6817/3517914982","heartbeat_back_addr":"172.21.15.161:6825/3517914982","heartbeat_front_addr":"172.21.15.161:6821/3517914982","state":["exists","up"]},{"osd":3,"uuid":"61318d5c-4ff3-4e73-92aa-a7bb2e5ab996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6813","nonce":607538014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6816","nonce":607538014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6824","nonce":607538014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":607538014},{"type":"v1","addr":"172.21.15.161:6820","nonce":607538014}]},"public_addr":"172.21.15.161:6813/607538014","cluster_addr":"172.21.15.161:6816/607538014","heartbeat_back_addr":"172.21.15.161:6824/607538014","heartbeat_front_addr":"172.21.15.161:6820/607538014","state":["exists","up"]},{"osd":4,"uuid":"00613158-a6c9-412f-b658-e348d7b6a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6801","nonce":1815468048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6803","nonce":1815468048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6807","nonce":1815468048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1815468048},{"type":"v1","addr":"172.21.15.190:6805","nonce":1815468048}]},"public_addr":"172.21.15.190:6801/1815468048","cluster_addr":"172.21.15.190:6803/1815468048","heartbeat_back_addr":"172.21.15.190:6807/1815468048","heartbeat_front_addr":"172.21.15.190:6805/1815468048","state":["exists","up"]},{"osd":5,"uuid":"d2db9779-83a1-4339-9f78-3a46875ce3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6817","nonce":3551605927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6819","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6821","nonce":3551605927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6827","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6829","nonce":3551605927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":3551605927},{"type":"v1","addr":"172.21.15.190:6825","nonce":3551605927}]},"public_addr":"172.21.15.190:6817/3551605927","cluster_addr":"172.21.15.190:6821/3551605927","heartbeat_back_addr":"172.21.15.190:6829/3551605927","heartbeat_front_addr":"172.21.15.190:6825/3551605927","state":["exists","up"]},{"osd":6,"uuid":"2f8ca4e1-cda9-4517-98f9-86aa5e8697f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6809","nonce":3291452378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6811","nonce":3291452378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6815","nonce":3291452378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3291452378},{"type":"v1","addr":"172.21.15.190:6813","nonce":3291452378}]},"public_addr":"172.21.15.190:6809/3291452378","cluster_addr":"172.21.15.190:6811/3291452378","heartbeat_back_addr":"172.21.15.190:6815/3291452378","heartbeat_front_addr":"172.21.15.190:6813/3291452378","state":["exists","up"]},{"osd":7,"uuid":"2280c95e-a481-470f-9e41-7e25840e46d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6820","nonce":2131748209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6824","nonce":2131748209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6831","nonce":2131748209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2131748209},{"type":"v1","addr":"172.21.15.190:6828","nonce":2131748209}]},"public_addr":"172.21.15.190:6820/2131748209","cluster_addr":"172.21.15.190:6824/2131748209","heartbeat_back_addr":"172.21.15.190:6831/2131748209","heartbeat_front_addr":"172.21.15.190:6828/2131748209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.614036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.746767+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.689096+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.706485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.628004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.200508+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.680048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:58:11.571249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]},{"pgid":"4.14","mappings":[{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-18T00:48:11.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.974+0000 7f819f000640 1 -- 172.21.15.161:0/2795142400 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8170066890 msgr2=0x7f8170068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:11.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.974+0000 7f819f000640 1 --2- 172.21.15.161:0/2795142400 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8170066890 0x7f8170068d50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f81880ad000 tx=0x7f8188000ff0 comp rx=0 tx=0).stop 2024-01-18T00:48:11.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.974+0000 7f819f000640 1 -- 172.21.15.161:0/2795142400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f819814c470 msgr2=0x7f81980cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:11.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.974+0000 7f819f000640 1 --2- 172.21.15.161:0/2795142400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f819814c470 0x7f81980cc360 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f81980cde60 tx=0x7f819000b480 comp rx=0 tx=0).stop 2024-01-18T00:48:11.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.974+0000 7f819f000640 1 -- 172.21.15.161:0/2795142400 shutdown_connections 2024-01-18T00:48:11.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.974+0000 7f819f000640 1 --2- 172.21.15.161:0/2795142400 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8170066890 0x7f8170068d50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:11.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.974+0000 7f819f000640 1 --2- 172.21.15.161:0/2795142400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f819814c470 0x7f81980cc360 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:11.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.974+0000 7f819f000640 1 --2- 172.21.15.161:0/2795142400 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f819814c010 0x7f81980cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:11.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.974+0000 7f819f000640 1 --2- 172.21.15.161:0/2795142400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8178003980 0x7f81981500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:11.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.974+0000 7f819f000640 1 -- 172.21.15.161:0/2795142400 >> 172.21.15.161:0/2795142400 conn(0x7f819806a8b0 msgr2=0x7f8198156020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:11.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.974+0000 7f819f000640 1 -- 172.21.15.161:0/2795142400 shutdown_connections 2024-01-18T00:48:11.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:11.974+0000 7f819f000640 1 -- 172.21.15.161:0/2795142400 wait complete. 2024-01-18T00:48:11.998 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-18T00:48:12.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.134+0000 7f56d9a00640 1 Processor -- start 2024-01-18T00:48:12.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.134+0000 7f56d9a00640 1 -- start start 2024-01-18T00:48:12.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.134+0000 7f56d9a00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f56d41539a0 0x7f56d40ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:12.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.134+0000 7f56d9a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f56d40c79c0 0x7f56d4061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:12.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.134+0000 7f56d9a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56d4061640 0x7f56d415d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:12.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.134+0000 7f56d9a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d406d570 con 0x7f56d40c79c0 2024-01-18T00:48:12.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.134+0000 7f56d9a00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d40c9890 con 0x7f56d41539a0 2024-01-18T00:48:12.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.134+0000 7f56d9a00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d4159bf0 con 0x7f56d4061640 2024-01-18T00:48:12.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.138+0000 7f56d2000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f56d40c79c0 0x7f56d4061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:12.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.138+0000 7f56d2000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f56d40c79c0 0x7f56d4061100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57230/0 (socket says 172.21.15.161:57230) 2024-01-18T00:48:12.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.138+0000 7f56d2000640 1 -- 172.21.15.161:0/3157025875 learned_addr learned my addr 172.21.15.161:0/3157025875 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:48:12.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.138+0000 7f56d2a00640 1 --2- 172.21.15.161:0/3157025875 >> v2:172.21.15.190:3300/0 conn(0x7f56d41539a0 0x7f56d40ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:12.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.138+0000 7f56d3400640 1 --2- 172.21.15.161:0/3157025875 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56d4061640 0x7f56d415d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:12.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.138+0000 7f56d2000640 1 -- 172.21.15.161:0/3157025875 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56d4061640 msgr2=0x7f56d415d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:12.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.138+0000 7f56d2000640 1 --2- 172.21.15.161:0/3157025875 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56d4061640 0x7f56d415d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:12.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.138+0000 7f56d2000640 1 -- 172.21.15.161:0/3157025875 >> v2:172.21.15.190:3300/0 conn(0x7f56d41539a0 msgr2=0x7f56d40ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:12.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.138+0000 7f56d2000640 1 --2- 172.21.15.161:0/3157025875 >> v2:172.21.15.190:3300/0 conn(0x7f56d41539a0 0x7f56d40ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:12.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.138+0000 7f56d2000640 1 -- 172.21.15.161:0/3157025875 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d4159eb0 con 0x7f56d40c79c0 2024-01-18T00:48:12.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.142+0000 7f56d2000640 1 --2- 172.21.15.161:0/3157025875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d40c79c0 0x7f56d4061100 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f56d4061cf0 tx=0x7f56bc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c08bfd794b46171 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:12.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.146+0000 7f56d1600640 1 -- 172.21.15.161:0/3157025875 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0aa620 con 0x7f56d40c79c0 2024-01-18T00:48:12.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.146+0000 7f56d1600640 1 -- 172.21.15.161:0/3157025875 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f56bc0aa780 con 0x7f56d40c79c0 2024-01-18T00:48:12.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.146+0000 7f56d1600640 1 -- 172.21.15.161:0/3157025875 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0aab30 con 0x7f56d40c79c0 2024-01-18T00:48:12.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.146+0000 7f56d9a00640 1 -- 172.21.15.161:0/3157025875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d40c79c0 msgr2=0x7f56d4061100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:12.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.146+0000 7f56d9a00640 1 --2- 172.21.15.161:0/3157025875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d40c79c0 0x7f56d4061100 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f56d4061cf0 tx=0x7f56bc01c500 comp rx=0 tx=0).stop 2024-01-18T00:48:12.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.146+0000 7f56d9a00640 1 -- 172.21.15.161:0/3157025875 shutdown_connections 2024-01-18T00:48:12.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.146+0000 7f56d9a00640 1 --2- 172.21.15.161:0/3157025875 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56d4061640 0x7f56d415d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:12.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.146+0000 7f56d9a00640 1 --2- 172.21.15.161:0/3157025875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d40c79c0 0x7f56d4061100 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:12.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.146+0000 7f56d9a00640 1 --2- 172.21.15.161:0/3157025875 >> v2:172.21.15.190:3300/0 conn(0x7f56d41539a0 0x7f56d40ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:12.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.146+0000 7f56d9a00640 1 -- 172.21.15.161:0/3157025875 >> 172.21.15.161:0/3157025875 conn(0x7f56d406ad40 msgr2=0x7f56d406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:12.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.146+0000 7f56d9a00640 1 -- 172.21.15.161:0/3157025875 shutdown_connections 2024-01-18T00:48:12.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.146+0000 7f56d9a00640 1 -- 172.21.15.161:0/3157025875 wait complete. 2024-01-18T00:48:12.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.150+0000 7f56d9a00640 1 Processor -- start 2024-01-18T00:48:12.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.150+0000 7f56d9a00640 1 -- start start 2024-01-18T00:48:12.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.150+0000 7f56d9a00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56d4061640 0x7f56d40cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:12.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.150+0000 7f56d9a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d40c79c0 0x7f56d415af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:12.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.150+0000 7f56d9a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56d41539a0 0x7f56d415b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:12.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.150+0000 7f56d9a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40c9690 con 0x7f56d40c79c0 2024-01-18T00:48:12.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.150+0000 7f56d9a00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d415aaa0 con 0x7f56d4061640 2024-01-18T00:48:12.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.150+0000 7f56d9a00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40c9110 con 0x7f56d41539a0 2024-01-18T00:48:12.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.150+0000 7f56d2000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d40c79c0 0x7f56d415af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:12.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.150+0000 7f56d2000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d40c79c0 0x7f56d415af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57244/0 (socket says 172.21.15.161:57244) 2024-01-18T00:48:12.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.150+0000 7f56d2000640 1 -- 172.21.15.161:0/934177747 learned_addr learned my addr 172.21.15.161:0/934177747 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:48:12.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.150+0000 7f56d3400640 1 --2- 172.21.15.161:0/934177747 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56d41539a0 0x7f56d415b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:12.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.150+0000 7f56d2a00640 1 --2- 172.21.15.161:0/934177747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56d4061640 0x7f56d40cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:12.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.154+0000 7f56d2000640 1 -- 172.21.15.161:0/934177747 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56d41539a0 msgr2=0x7f56d415b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:12.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.154+0000 7f56d2000640 1 --2- 172.21.15.161:0/934177747 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56d41539a0 0x7f56d415b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:12.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.154+0000 7f56d2000640 1 -- 172.21.15.161:0/934177747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56d4061640 msgr2=0x7f56d40cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:12.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.154+0000 7f56d2000640 1 --2- 172.21.15.161:0/934177747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56d4061640 0x7f56d40cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:12.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.154+0000 7f56d2000640 1 -- 172.21.15.161:0/934177747 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc0094d0 con 0x7f56d40c79c0 2024-01-18T00:48:12.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.158+0000 7f56d2000640 1 --2- 172.21.15.161:0/934177747 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d40c79c0 0x7f56d415af50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f56bc0ac040 tx=0x7f56bc01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:12.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.162+0000 7f56caa00640 1 -- 172.21.15.161:0/934177747 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0bd3f0 con 0x7f56d40c79c0 2024-01-18T00:48:12.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.162+0000 7f56caa00640 1 -- 172.21.15.161:0/934177747 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f56bc0bd570 con 0x7f56d40c79c0 2024-01-18T00:48:12.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.162+0000 7f56caa00640 1 -- 172.21.15.161:0/934177747 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0bd940 con 0x7f56d40c79c0 2024-01-18T00:48:12.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.162+0000 7f56d9a00640 1 -- 172.21.15.161:0/934177747 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d40c93b0 con 0x7f56d40c79c0 2024-01-18T00:48:12.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.162+0000 7f56d9a00640 1 -- 172.21.15.161:0/934177747 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d415c8a0 con 0x7f56d40c79c0 2024-01-18T00:48:12.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.162+0000 7f56d9a00640 1 -- 172.21.15.161:0/934177747 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d406b620 con 0x7f56d40c79c0 2024-01-18T00:48:12.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.182+0000 7f56caa00640 1 -- 172.21.15.161:0/934177747 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f56bc0c7410 con 0x7f56d40c79c0 2024-01-18T00:48:12.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.182+0000 7f56caa00640 1 --2- 172.21.15.161:0/934177747 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f56ac066890 0x7f56ac068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:12.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.182+0000 7f56d2a00640 1 --2- 172.21.15.161:0/934177747 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f56ac066890 0x7f56ac068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:12.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.182+0000 7f56d2a00640 1 --2- 172.21.15.161:0/934177747 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f56ac066890 0x7f56ac068d50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f56c40079c0 tx=0x7f56c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:12.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.182+0000 7f56caa00640 1 -- 172.21.15.161:0/934177747 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f56bc0ef8d0 con 0x7f56d40c79c0 2024-01-18T00:48:12.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.414+0000 7f56caa00640 1 -- 172.21.15.161:0/934177747 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f56bc0ebc10 con 0x7f56d40c79c0 2024-01-18T00:48:12.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.598+0000 7f56d9a00640 1 -- 172.21.15.161:0/934177747 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f56d40746a0 con 0x7f56d40c79c0 2024-01-18T00:48:12.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.734+0000 7f56caa00640 1 -- 172.21.15.161:0/934177747 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7f56bc0ef230 con 0x7f56d40c79c0 2024-01-18T00:48:12.737 INFO:teuthology.orchestra.run.smithi161.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-18T00:48:12.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.738+0000 7f56d9a00640 1 -- 172.21.15.161:0/934177747 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f56ac066890 msgr2=0x7f56ac068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:12.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.738+0000 7f56d9a00640 1 --2- 172.21.15.161:0/934177747 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f56ac066890 0x7f56ac068d50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f56c40079c0 tx=0x7f56c4008040 comp rx=0 tx=0).stop 2024-01-18T00:48:12.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.738+0000 7f56d9a00640 1 -- 172.21.15.161:0/934177747 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d40c79c0 msgr2=0x7f56d415af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:12.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.738+0000 7f56d9a00640 1 --2- 172.21.15.161:0/934177747 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d40c79c0 0x7f56d415af50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f56bc0ac040 tx=0x7f56bc01ad40 comp rx=0 tx=0).stop 2024-01-18T00:48:12.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.738+0000 7f56d9a00640 1 -- 172.21.15.161:0/934177747 shutdown_connections 2024-01-18T00:48:12.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.738+0000 7f56d9a00640 1 --2- 172.21.15.161:0/934177747 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f56ac066890 0x7f56ac068d50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:12.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.738+0000 7f56d9a00640 1 --2- 172.21.15.161:0/934177747 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56d41539a0 0x7f56d415b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:12.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.738+0000 7f56d9a00640 1 --2- 172.21.15.161:0/934177747 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d40c79c0 0x7f56d415af50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:12.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.738+0000 7f56d9a00640 1 --2- 172.21.15.161:0/934177747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56d4061640 0x7f56d40cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:12.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.738+0000 7f56d9a00640 1 -- 172.21.15.161:0/934177747 >> 172.21.15.161:0/934177747 conn(0x7f56d406ad40 msgr2=0x7f56d406c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:12.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.738+0000 7f56d9a00640 1 -- 172.21.15.161:0/934177747 shutdown_connections 2024-01-18T00:48:12.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.738+0000 7f56d9a00640 1 -- 172.21.15.161:0/934177747 wait complete. 2024-01-18T00:48:12.765 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-18T00:48:12.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.914+0000 7f63c9800640 1 Processor -- start 2024-01-18T00:48:12.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.914+0000 7f63c9800640 1 -- start start 2024-01-18T00:48:12.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.914+0000 7f63c9800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f63c4159620 0x7f63c4070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:12.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.914+0000 7f63c9800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c4159c40 con 0x7f63c40ca2f0 2024-01-18T00:48:12.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.914+0000 7f63c9800640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c4159f20 con 0x7f63c4153780 2024-01-18T00:48:12.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.914+0000 7f63c9800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c4159a50 con 0x7f63c4159620 2024-01-18T00:48:12.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.914+0000 7f63c3400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f63c4159620 0x7f63c4070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:12.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.914+0000 7f63c3400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f63c4159620 0x7f63c4070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57246/0 (socket says 172.21.15.161:57246) 2024-01-18T00:48:12.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.914+0000 7f63c3400640 1 -- 172.21.15.161:0/496078277 learned_addr learned my addr 172.21.15.161:0/496078277 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:48:12.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.918+0000 7f63c3400640 1 -- 172.21.15.161:0/496078277 >> v1:172.21.15.190:6789/0 conn(0x7f63c4153780 legacy=0x7f63c406c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:12.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.918+0000 7f63c3400640 1 -- 172.21.15.161:0/496078277 >> v1:172.21.15.161:6789/0 conn(0x7f63c40ca2f0 legacy=0x7f63c415d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:12.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.918+0000 7f63c3400640 1 -- 172.21.15.161:0/496078277 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c415a200 con 0x7f63c4159620 2024-01-18T00:48:12.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.926+0000 7f63c3400640 1 --2- 172.21.15.161:0/496078277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c4159620 0x7f63c4070d20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f63bc009e50 tx=0x7f63bc01f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40cbdd590d5e617 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:12.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.930+0000 7f63c1600640 1 -- 172.21.15.161:0/496078277 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc0af400 con 0x7f63c4159620 2024-01-18T00:48:12.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.930+0000 7f63c1600640 1 -- 172.21.15.161:0/496078277 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f63bc0ab050 con 0x7f63c4159620 2024-01-18T00:48:12.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.930+0000 7f63c1600640 1 -- 172.21.15.161:0/496078277 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc0af7a0 con 0x7f63c4159620 2024-01-18T00:48:12.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.930+0000 7f63c9800640 1 -- 172.21.15.161:0/496078277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c4159620 msgr2=0x7f63c4070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:12.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.930+0000 7f63c9800640 1 --2- 172.21.15.161:0/496078277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c4159620 0x7f63c4070d20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f63bc009e50 tx=0x7f63bc01f180 comp rx=0 tx=0).stop 2024-01-18T00:48:12.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.930+0000 7f63c9800640 1 -- 172.21.15.161:0/496078277 shutdown_connections 2024-01-18T00:48:12.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.930+0000 7f63c9800640 1 --2- 172.21.15.161:0/496078277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c4159620 0x7f63c4070d20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:12.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.930+0000 7f63c9800640 1 -- 172.21.15.161:0/496078277 >> 172.21.15.161:0/496078277 conn(0x7f63c4070390 msgr2=0x7f63c406f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:12.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.930+0000 7f63c9800640 1 -- 172.21.15.161:0/496078277 shutdown_connections 2024-01-18T00:48:12.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.930+0000 7f63c9800640 1 -- 172.21.15.161:0/496078277 wait complete. 2024-01-18T00:48:12.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.934+0000 7f63c9800640 1 Processor -- start 2024-01-18T00:48:12.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.934+0000 7f63c9800640 1 -- start start 2024-01-18T00:48:12.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.934+0000 7f63c9800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63c40ca2f0 0x7f63c40acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:12.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.934+0000 7f63c9800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c4153780 0x7f63c41567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:12.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.934+0000 7f63c9800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63c4159620 0x7f63c40b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:12.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.934+0000 7f63c9800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c40afc80 con 0x7f63c4153780 2024-01-18T00:48:12.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.934+0000 7f63c9800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c41ef100 con 0x7f63c4159620 2024-01-18T00:48:12.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.934+0000 7f63c9800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c40cb130 con 0x7f63c40ca2f0 2024-01-18T00:48:12.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.934+0000 7f63c2000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c4153780 0x7f63c41567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:12.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.938+0000 7f63c2a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63c40ca2f0 0x7f63c40acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:12.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.938+0000 7f63c2a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63c40ca2f0 0x7f63c40acc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:36924/0 (socket says 172.21.15.161:36924) 2024-01-18T00:48:12.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.938+0000 7f63c2a00640 1 -- 172.21.15.161:0/3898394286 learned_addr learned my addr 172.21.15.161:0/3898394286 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:48:12.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.942+0000 7f63c2000640 1 -- 172.21.15.161:0/3898394286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63c40ca2f0 msgr2=0x7f63c40acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:12.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.942+0000 7f63c2000640 1 --2- 172.21.15.161:0/3898394286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63c40ca2f0 0x7f63c40acc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:12.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.942+0000 7f63c2000640 1 -- 172.21.15.161:0/3898394286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63c4159620 msgr2=0x7f63c40b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:12.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.942+0000 7f63c2000640 1 --2- 172.21.15.161:0/3898394286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63c4159620 0x7f63c40b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:12.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.942+0000 7f63c2000640 1 -- 172.21.15.161:0/3898394286 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63bc009b30 con 0x7f63c4153780 2024-01-18T00:48:12.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.946+0000 7f63c2000640 1 --2- 172.21.15.161:0/3898394286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c4153780 0x7f63c41567e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00c360 tx=0x7f63ac00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:12.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.950+0000 7f63baa00640 1 -- 172.21.15.161:0/3898394286 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac003600 con 0x7f63c4153780 2024-01-18T00:48:12.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.950+0000 7f63c9800640 1 -- 172.21.15.161:0/3898394286 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c40cb410 con 0x7f63c4153780 2024-01-18T00:48:12.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.950+0000 7f63c9800640 1 -- 172.21.15.161:0/3898394286 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c41ef6a0 con 0x7f63c4153780 2024-01-18T00:48:12.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.950+0000 7f63c9800640 1 -- 172.21.15.161:0/3898394286 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c40746a0 con 0x7f63c4153780 2024-01-18T00:48:12.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.954+0000 7f63baa00640 1 -- 172.21.15.161:0/3898394286 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f63ac007030 con 0x7f63c4153780 2024-01-18T00:48:12.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:12.954+0000 7f63baa00640 1 -- 172.21.15.161:0/3898394286 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac007440 con 0x7f63c4153780 2024-01-18T00:48:13.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:13.254+0000 7f63baa00640 1 -- 172.21.15.161:0/3898394286 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f63ac0075a0 con 0x7f63c4153780 2024-01-18T00:48:13.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:13.258+0000 7f63baa00640 1 --2- 172.21.15.161:0/3898394286 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f639c066870 0x7f639c068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:13.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:13.258+0000 7f63c2a00640 1 --2- 172.21.15.161:0/3898394286 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f639c066870 0x7f639c068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:13.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:13.258+0000 7f63c2a00640 1 --2- 172.21.15.161:0/3898394286 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f639c066870 0x7f639c068d30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f63b4001960 tx=0x7f63b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:13.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:13.270+0000 7f63baa00640 1 -- 172.21.15.161:0/3898394286 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6834+0+0 (secure 0 0 0) 0x7f63ac054a60 con 0x7f63c4153780 2024-01-18T00:48:13.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:13.274+0000 7f63baa00640 1 -- 172.21.15.161:0/3898394286 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f63ac050da0 con 0x7f63c4153780 2024-01-18T00:48:13.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:13.482+0000 7f63c9800640 1 -- 172.21.15.161:0/3898394286 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f63c40c7be0 con 0x7f63c4153780 2024-01-18T00:48:14.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.450+0000 7f63baa00640 1 -- 172.21.15.161:0/3898394286 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f63ac021020 con 0x7f63c4153780 2024-01-18T00:48:14.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.450+0000 7f63c9800640 1 -- 172.21.15.161:0/3898394286 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f639c066870 msgr2=0x7f639c068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:14.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.450+0000 7f63c9800640 1 --2- 172.21.15.161:0/3898394286 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f639c066870 0x7f639c068d30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f63b4001960 tx=0x7f63b4009040 comp rx=0 tx=0).stop 2024-01-18T00:48:14.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.450+0000 7f63c9800640 1 -- 172.21.15.161:0/3898394286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c4153780 msgr2=0x7f63c41567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:14.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.450+0000 7f63c9800640 1 --2- 172.21.15.161:0/3898394286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c4153780 0x7f63c41567e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00c360 tx=0x7f63ac00c820 comp rx=0 tx=0).stop 2024-01-18T00:48:14.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.450+0000 7f63c9800640 1 -- 172.21.15.161:0/3898394286 shutdown_connections 2024-01-18T00:48:14.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.450+0000 7f63c9800640 1 --2- 172.21.15.161:0/3898394286 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f639c066870 0x7f639c068d30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:14.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.450+0000 7f63c9800640 1 --2- 172.21.15.161:0/3898394286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63c4159620 0x7f63c40b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:14.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.450+0000 7f63c9800640 1 --2- 172.21.15.161:0/3898394286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c4153780 0x7f63c41567e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:14.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.450+0000 7f63c9800640 1 --2- 172.21.15.161:0/3898394286 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63c40ca2f0 0x7f63c40acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:14.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.450+0000 7f63c9800640 1 -- 172.21.15.161:0/3898394286 >> 172.21.15.161:0/3898394286 conn(0x7f63c4070390 msgr2=0x7f63c40c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:14.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.454+0000 7f63c9800640 1 -- 172.21.15.161:0/3898394286 shutdown_connections 2024-01-18T00:48:14.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.454+0000 7f63c9800640 1 -- 172.21.15.161:0/3898394286 wait complete. 2024-01-18T00:48:14.475 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-18T00:48:14.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.630+0000 7f68d5a00640 1 Processor -- start 2024-01-18T00:48:14.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.630+0000 7f68d5a00640 1 -- start start 2024-01-18T00:48:14.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.630+0000 7f68d5a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f68d0070f40 0x7f68d015b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:14.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.630+0000 7f68d5a00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f68d00c9330 0x7f68d01511e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:14.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.630+0000 7f68d5a00640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d00b2330 con 0x7f68d0071320 2024-01-18T00:48:14.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.630+0000 7f68d5a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d00c7d80 con 0x7f68d0070f40 2024-01-18T00:48:14.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.630+0000 7f68d5a00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d00c8060 con 0x7f68d00c9330 2024-01-18T00:48:14.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.630+0000 7f68cea00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f68d0070f40 0x7f68d015b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:14.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.634+0000 7f68cea00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f68d0070f40 0x7f68d015b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57260/0 (socket says 172.21.15.161:57260) 2024-01-18T00:48:14.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.634+0000 7f68cea00640 1 -- 172.21.15.161:0/3380882865 learned_addr learned my addr 172.21.15.161:0/3380882865 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:48:14.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.634+0000 7f68ce000640 1 --2- 172.21.15.161:0/3380882865 >> v2:172.21.15.190:3300/0 conn(0x7f68d00c9330 0x7f68d01511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:14.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.638+0000 7f68cea00640 1 -- 172.21.15.161:0/3380882865 >> v2:172.21.15.190:3300/0 conn(0x7f68d00c9330 msgr2=0x7f68d01511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:14.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.638+0000 7f68cea00640 1 --2- 172.21.15.161:0/3380882865 >> v2:172.21.15.190:3300/0 conn(0x7f68d00c9330 0x7f68d01511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:14.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.638+0000 7f68cea00640 1 -- 172.21.15.161:0/3380882865 >> v1:172.21.15.190:6789/0 conn(0x7f68d0071320 legacy=0x7f68d00ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:14.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.638+0000 7f68cea00640 1 -- 172.21.15.161:0/3380882865 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d00c8340 con 0x7f68d0070f40 2024-01-18T00:48:14.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.642+0000 7f68cea00640 1 --2- 172.21.15.161:0/3380882865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d0070f40 0x7f68d015b2e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f68d006fe00 tx=0x7f68c001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39201b9ff1962bd server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:14.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.646+0000 7f68cd600640 1 -- 172.21.15.161:0/3380882865 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c00a89b0 con 0x7f68d0070f40 2024-01-18T00:48:14.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.646+0000 7f68cd600640 1 -- 172.21.15.161:0/3380882865 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f68c00a8b10 con 0x7f68d0070f40 2024-01-18T00:48:14.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.646+0000 7f68cd600640 1 -- 172.21.15.161:0/3380882865 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c00b0440 con 0x7f68d0070f40 2024-01-18T00:48:14.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.650+0000 7f68d5a00640 1 -- 172.21.15.161:0/3380882865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d0070f40 msgr2=0x7f68d015b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:14.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.650+0000 7f68d5a00640 1 --2- 172.21.15.161:0/3380882865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d0070f40 0x7f68d015b2e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f68d006fe00 tx=0x7f68c001ecb0 comp rx=0 tx=0).stop 2024-01-18T00:48:14.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.650+0000 7f68d5a00640 1 -- 172.21.15.161:0/3380882865 shutdown_connections 2024-01-18T00:48:14.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.650+0000 7f68d5a00640 1 --2- 172.21.15.161:0/3380882865 >> v2:172.21.15.190:3300/0 conn(0x7f68d00c9330 0x7f68d01511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:14.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.650+0000 7f68d5a00640 1 --2- 172.21.15.161:0/3380882865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d0070f40 0x7f68d015b2e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:14.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.650+0000 7f68d5a00640 1 -- 172.21.15.161:0/3380882865 >> 172.21.15.161:0/3380882865 conn(0x7f68d006ad40 msgr2=0x7f68d006f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:14.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.650+0000 7f68d5a00640 1 -- 172.21.15.161:0/3380882865 shutdown_connections 2024-01-18T00:48:14.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.650+0000 7f68d5a00640 1 -- 172.21.15.161:0/3380882865 wait complete. 2024-01-18T00:48:14.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.650+0000 7f68d5a00640 1 Processor -- start 2024-01-18T00:48:14.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.650+0000 7f68d5a00640 1 -- start start 2024-01-18T00:48:14.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.654+0000 7f68d5a00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68d0070f40 0x7f68d00cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:14.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.654+0000 7f68d5a00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68d0071320 0x7f68d006cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:14.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.654+0000 7f68d5a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d00c9330 0x7f68d01f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:14.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.654+0000 7f68d5a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d0157210 con 0x7f68d00c9330 2024-01-18T00:48:14.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.654+0000 7f68d5a00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d014eff0 con 0x7f68d0070f40 2024-01-18T00:48:14.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.654+0000 7f68d5a00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d014faa0 con 0x7f68d0071320 2024-01-18T00:48:14.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.654+0000 7f68cf400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d00c9330 0x7f68d01f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:14.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.654+0000 7f68cea00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68d0070f40 0x7f68d00cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:14.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.654+0000 7f68cf400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d00c9330 0x7f68d01f25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57276/0 (socket says 172.21.15.161:57276) 2024-01-18T00:48:14.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.654+0000 7f68ce000640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68d0071320 0x7f68d006cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:14.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.654+0000 7f68cf400640 1 -- 172.21.15.161:0/430212881 learned_addr learned my addr 172.21.15.161:0/430212881 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:48:14.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.662+0000 7f68cf400640 1 -- 172.21.15.161:0/430212881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68d0071320 msgr2=0x7f68d006cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:14.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.662+0000 7f68cf400640 1 --2- 172.21.15.161:0/430212881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68d0071320 0x7f68d006cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:14.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.662+0000 7f68cf400640 1 -- 172.21.15.161:0/430212881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68d0070f40 msgr2=0x7f68d00cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:14.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.662+0000 7f68cf400640 1 --2- 172.21.15.161:0/430212881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68d0070f40 0x7f68d00cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:14.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.662+0000 7f68cf400640 1 -- 172.21.15.161:0/430212881 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00094d0 con 0x7f68d00c9330 2024-01-18T00:48:14.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.662+0000 7f68cf400640 1 --2- 172.21.15.161:0/430212881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d00c9330 0x7f68d01f25b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f68c800c7b0 tx=0x7f68c800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:14.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.670+0000 7f68c6a00640 1 -- 172.21.15.161:0/430212881 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c8003d90 con 0x7f68d00c9330 2024-01-18T00:48:14.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.670+0000 7f68c6a00640 1 -- 172.21.15.161:0/430212881 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f68c800ce60 con 0x7f68d00c9330 2024-01-18T00:48:14.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.670+0000 7f68c6a00640 1 -- 172.21.15.161:0/430212881 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c80052d0 con 0x7f68d00c9330 2024-01-18T00:48:14.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.670+0000 7f68d5a00640 1 -- 172.21.15.161:0/430212881 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d00cd6b0 con 0x7f68d00c9330 2024-01-18T00:48:14.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.670+0000 7f68d5a00640 1 -- 172.21.15.161:0/430212881 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d014f200 con 0x7f68d00c9330 2024-01-18T00:48:14.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.670+0000 7f68d5a00640 1 -- 172.21.15.161:0/430212881 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d00cd840 con 0x7f68d00c9330 2024-01-18T00:48:14.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.938+0000 7f68c6a00640 1 -- 172.21.15.161:0/430212881 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f68c8005430 con 0x7f68d00c9330 2024-01-18T00:48:14.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.938+0000 7f68c6a00640 1 --2- 172.21.15.161:0/430212881 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f68a8066890 0x7f68a8068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:14.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.938+0000 7f68cea00640 1 --2- 172.21.15.161:0/430212881 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f68a8066890 0x7f68a8068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:14.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.942+0000 7f68cea00640 1 --2- 172.21.15.161:0/430212881 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f68a8066890 0x7f68a8068d50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f68c00b2000 tx=0x7f68c00aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:14.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.950+0000 7f68c6a00640 1 -- 172.21.15.161:0/430212881 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6834+0+0 (secure 0 0 0) 0x7f68c8054d10 con 0x7f68d00c9330 2024-01-18T00:48:14.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:14.950+0000 7f68c6a00640 1 -- 172.21.15.161:0/430212881 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f68c8051050 con 0x7f68d00c9330 2024-01-18T00:48:15.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:15.110+0000 7f68d5a00640 1 -- 172.21.15.161:0/430212881 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f68d014f4e0 con 0x7f68d00c9330 2024-01-18T00:48:16.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.030+0000 7f68c6a00640 1 -- 172.21.15.161:0/430212881 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7f68c8017070 con 0x7f68d00c9330 2024-01-18T00:48:16.031 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_metadata' removed 2024-01-18T00:48:16.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.030+0000 7f68d5a00640 1 -- 172.21.15.161:0/430212881 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f68a8066890 msgr2=0x7f68a8068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:16.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.030+0000 7f68d5a00640 1 --2- 172.21.15.161:0/430212881 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f68a8066890 0x7f68a8068d50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f68c00b2000 tx=0x7f68c00aa070 comp rx=0 tx=0).stop 2024-01-18T00:48:16.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.030+0000 7f68d5a00640 1 -- 172.21.15.161:0/430212881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d00c9330 msgr2=0x7f68d01f25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:16.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.030+0000 7f68d5a00640 1 --2- 172.21.15.161:0/430212881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d00c9330 0x7f68d01f25b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f68c800c7b0 tx=0x7f68c800cc70 comp rx=0 tx=0).stop 2024-01-18T00:48:16.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.030+0000 7f68d5a00640 1 -- 172.21.15.161:0/430212881 shutdown_connections 2024-01-18T00:48:16.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.030+0000 7f68d5a00640 1 --2- 172.21.15.161:0/430212881 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f68a8066890 0x7f68a8068d50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:16.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.030+0000 7f68d5a00640 1 --2- 172.21.15.161:0/430212881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d00c9330 0x7f68d01f25b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:16.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.030+0000 7f68d5a00640 1 --2- 172.21.15.161:0/430212881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68d0071320 0x7f68d006cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:16.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.030+0000 7f68d5a00640 1 --2- 172.21.15.161:0/430212881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68d0070f40 0x7f68d00cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:16.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.030+0000 7f68d5a00640 1 -- 172.21.15.161:0/430212881 >> 172.21.15.161:0/430212881 conn(0x7f68d006ad40 msgr2=0x7f68d014c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:16.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.034+0000 7f68d5a00640 1 -- 172.21.15.161:0/430212881 shutdown_connections 2024-01-18T00:48:16.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.034+0000 7f68d5a00640 1 -- 172.21.15.161:0/430212881 wait complete. 2024-01-18T00:48:16.055 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-18T00:48:16.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.246+0000 7f8ce0600640 1 Processor -- start 2024-01-18T00:48:16.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.246+0000 7f8ce0600640 1 -- start start 2024-01-18T00:48:16.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.246+0000 7f8ce0600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8cd80cb390 0x7f8cd80cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:16.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.246+0000 7f8ce0600640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8cd806dc40 0x7f8cd806e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:16.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.246+0000 7f8ce0600640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd806e5d0 con 0x7f8cd81518e0 2024-01-18T00:48:16.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.246+0000 7f8ce0600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd81578c0 con 0x7f8cd80cb390 2024-01-18T00:48:16.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.246+0000 7f8ce0600640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd80c7770 con 0x7f8cd806dc40 2024-01-18T00:48:16.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.250+0000 7f8cdd200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8cd80cb390 0x7f8cd80cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:16.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.250+0000 7f8cdd200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8cd80cb390 0x7f8cd80cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57288/0 (socket says 172.21.15.161:57288) 2024-01-18T00:48:16.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.250+0000 7f8cdd200640 1 -- 172.21.15.161:0/284174633 learned_addr learned my addr 172.21.15.161:0/284174633 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:48:16.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.250+0000 7f8cde600640 1 --2- 172.21.15.161:0/284174633 >> v2:172.21.15.190:3300/0 conn(0x7f8cd806dc40 0x7f8cd806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:16.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.250+0000 7f8cdd200640 1 -- 172.21.15.161:0/284174633 >> v2:172.21.15.190:3300/0 conn(0x7f8cd806dc40 msgr2=0x7f8cd806e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:16.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.250+0000 7f8cdd200640 1 --2- 172.21.15.161:0/284174633 >> v2:172.21.15.190:3300/0 conn(0x7f8cd806dc40 0x7f8cd806e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:16.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.250+0000 7f8cdd200640 1 -- 172.21.15.161:0/284174633 >> v1:172.21.15.190:6789/0 conn(0x7f8cd81518e0 legacy=0x7f8cd80c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:16.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.250+0000 7f8cdd200640 1 -- 172.21.15.161:0/284174633 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8157b80 con 0x7f8cd80cb390 2024-01-18T00:48:16.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.254+0000 7f8cdd200640 1 --2- 172.21.15.161:0/284174633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd80cb390 0x7f8cd80cb800 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8cd815bbc0 tx=0x7f8cc001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92f50303db9d142 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:16.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.258+0000 7f8cd7e00640 1 -- 172.21.15.161:0/284174633 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00a89b0 con 0x7f8cd80cb390 2024-01-18T00:48:16.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.258+0000 7f8cd7e00640 1 -- 172.21.15.161:0/284174633 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8cc00a8b10 con 0x7f8cd80cb390 2024-01-18T00:48:16.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.258+0000 7f8cd7e00640 1 -- 172.21.15.161:0/284174633 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00b0440 con 0x7f8cd80cb390 2024-01-18T00:48:16.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.262+0000 7f8ce0600640 1 -- 172.21.15.161:0/284174633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd80cb390 msgr2=0x7f8cd80cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:16.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.262+0000 7f8ce0600640 1 --2- 172.21.15.161:0/284174633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd80cb390 0x7f8cd80cb800 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8cd815bbc0 tx=0x7f8cc001ecb0 comp rx=0 tx=0).stop 2024-01-18T00:48:16.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.262+0000 7f8ce0600640 1 -- 172.21.15.161:0/284174633 shutdown_connections 2024-01-18T00:48:16.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.262+0000 7f8ce0600640 1 --2- 172.21.15.161:0/284174633 >> v2:172.21.15.190:3300/0 conn(0x7f8cd806dc40 0x7f8cd806e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:16.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.262+0000 7f8ce0600640 1 --2- 172.21.15.161:0/284174633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd80cb390 0x7f8cd80cb800 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:16.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.262+0000 7f8ce0600640 1 -- 172.21.15.161:0/284174633 >> 172.21.15.161:0/284174633 conn(0x7f8cd806aae0 msgr2=0x7f8cd806aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:16.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.262+0000 7f8ce0600640 1 -- 172.21.15.161:0/284174633 shutdown_connections 2024-01-18T00:48:16.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.262+0000 7f8ce0600640 1 -- 172.21.15.161:0/284174633 wait complete. 2024-01-18T00:48:16.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.262+0000 7f8ce0600640 1 Processor -- start 2024-01-18T00:48:16.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.262+0000 7f8ce0600640 1 -- start start 2024-01-18T00:48:16.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.262+0000 7f8ce0600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd806dc40 0x7f8cd81e5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:16.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.262+0000 7f8ce0600640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cd80cb390 0x7f8cd81e6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:16.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.262+0000 7f8ce0600640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8cd81518e0 0x7f8cd81ef110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:16.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.262+0000 7f8ce0600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd81f2680 con 0x7f8cd806dc40 2024-01-18T00:48:16.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.262+0000 7f8ce0600640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8155750 con 0x7f8cd81518e0 2024-01-18T00:48:16.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.262+0000 7f8ce0600640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80c1d80 con 0x7f8cd80cb390 2024-01-18T00:48:16.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.266+0000 7f8cdd200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cd80cb390 0x7f8cd81e6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:16.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.266+0000 7f8cde600640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8cd81518e0 0x7f8cd81ef110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:16.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.266+0000 7f8cdd200640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cd80cb390 0x7f8cd81e6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.161:36938/0 (socket says 172.21.15.161:36938) 2024-01-18T00:48:16.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.266+0000 7f8cdd200640 1 -- 172.21.15.161:0/1518884563 learned_addr learned my addr 172.21.15.161:0/1518884563 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:48:16.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.266+0000 7f8cddc00640 1 --2- 172.21.15.161:0/1518884563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd806dc40 0x7f8cd81e5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:16.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.270+0000 7f8cddc00640 1 -- 172.21.15.161:0/1518884563 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cd80cb390 msgr2=0x7f8cd81e6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:16.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.270+0000 7f8cddc00640 1 --2- 172.21.15.161:0/1518884563 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cd80cb390 0x7f8cd81e6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:16.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.270+0000 7f8cddc00640 1 -- 172.21.15.161:0/1518884563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8cd81518e0 msgr2=0x7f8cd81ef110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:16.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.270+0000 7f8cddc00640 1 --2- 172.21.15.161:0/1518884563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8cd81518e0 0x7f8cd81ef110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:16.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.270+0000 7f8cddc00640 1 -- 172.21.15.161:0/1518884563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc00094d0 con 0x7f8cd806dc40 2024-01-18T00:48:16.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.274+0000 7f8cddc00640 1 --2- 172.21.15.161:0/1518884563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd806dc40 0x7f8cd81e5ed0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8cc800c3e0 tx=0x7f8cc800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:16.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.278+0000 7f8cd5600640 1 -- 172.21.15.161:0/1518884563 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8011790 con 0x7f8cd806dc40 2024-01-18T00:48:16.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.278+0000 7f8cd5600640 1 -- 172.21.15.161:0/1518884563 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8cc80118f0 con 0x7f8cd806dc40 2024-01-18T00:48:16.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.278+0000 7f8cd5600640 1 -- 172.21.15.161:0/1518884563 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8011d00 con 0x7f8cd806dc40 2024-01-18T00:48:16.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.278+0000 7f8ce0600640 1 -- 172.21.15.161:0/1518884563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd81f2890 con 0x7f8cd806dc40 2024-01-18T00:48:16.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.278+0000 7f8ce0600640 1 -- 172.21.15.161:0/1518884563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd81f2e50 con 0x7f8cd806dc40 2024-01-18T00:48:16.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.278+0000 7f8ce0600640 1 -- 172.21.15.161:0/1518884563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd80746a0 con 0x7f8cd806dc40 2024-01-18T00:48:16.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.298+0000 7f8cd5600640 1 -- 172.21.15.161:0/1518884563 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f8cc801c460 con 0x7f8cd806dc40 2024-01-18T00:48:16.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.298+0000 7f8cd5600640 1 --2- 172.21.15.161:0/1518884563 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8cb0066890 0x7f8cb0068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:16.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.298+0000 7f8cdd200640 1 --2- 172.21.15.161:0/1518884563 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8cb0066890 0x7f8cb0068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:16.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.302+0000 7f8cdd200640 1 --2- 172.21.15.161:0/1518884563 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8cb0066890 0x7f8cb0068d50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8cc001ecf0 tx=0x7f8cc00aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:16.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.302+0000 7f8cd5600640 1 -- 172.21.15.161:0/1518884563 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6396+0+0 (secure 0 0 0) 0x7f8cc8055990 con 0x7f8cd806dc40 2024-01-18T00:48:16.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.546+0000 7f8cd5600640 1 -- 172.21.15.161:0/1518884563 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f8cc8051cd0 con 0x7f8cd806dc40 2024-01-18T00:48:16.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:16.750+0000 7f8ce0600640 1 -- 172.21.15.161:0/1518884563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8cd80711c0 con 0x7f8cd806dc40 2024-01-18T00:48:17.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.238+0000 7f8cd5600640 1 -- 172.21.15.161:0/1518884563 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8cc8011e60 con 0x7f8cd806dc40 2024-01-18T00:48:17.239 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data' removed 2024-01-18T00:48:17.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.238+0000 7f8ce0600640 1 -- 172.21.15.161:0/1518884563 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8cb0066890 msgr2=0x7f8cb0068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:17.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.238+0000 7f8ce0600640 1 --2- 172.21.15.161:0/1518884563 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8cb0066890 0x7f8cb0068d50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8cc001ecf0 tx=0x7f8cc00aa070 comp rx=0 tx=0).stop 2024-01-18T00:48:17.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.238+0000 7f8ce0600640 1 -- 172.21.15.161:0/1518884563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd806dc40 msgr2=0x7f8cd81e5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:17.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.238+0000 7f8ce0600640 1 --2- 172.21.15.161:0/1518884563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd806dc40 0x7f8cd81e5ed0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8cc800c3e0 tx=0x7f8cc800c8a0 comp rx=0 tx=0).stop 2024-01-18T00:48:17.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.242+0000 7f8ce0600640 1 -- 172.21.15.161:0/1518884563 shutdown_connections 2024-01-18T00:48:17.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.242+0000 7f8ce0600640 1 --2- 172.21.15.161:0/1518884563 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7f8cb0066890 0x7f8cb0068d50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:17.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.242+0000 7f8ce0600640 1 --2- 172.21.15.161:0/1518884563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8cd81518e0 0x7f8cd81ef110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:17.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.242+0000 7f8ce0600640 1 --2- 172.21.15.161:0/1518884563 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cd80cb390 0x7f8cd81e6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:17.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.242+0000 7f8ce0600640 1 --2- 172.21.15.161:0/1518884563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd806dc40 0x7f8cd81e5ed0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:17.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.242+0000 7f8ce0600640 1 -- 172.21.15.161:0/1518884563 >> 172.21.15.161:0/1518884563 conn(0x7f8cd806aae0 msgr2=0x7f8cd8150af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:17.243 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.242+0000 7f8ce0600640 1 -- 172.21.15.161:0/1518884563 shutdown_connections 2024-01-18T00:48:17.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.242+0000 7f8ce0600640 1 -- 172.21.15.161:0/1518884563 wait complete. 2024-01-18T00:48:17.268 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-01-18T00:48:17.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.406+0000 7fb648800640 1 Processor -- start 2024-01-18T00:48:17.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.406+0000 7fb648800640 1 -- start start 2024-01-18T00:48:17.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.406+0000 7fb648800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb640150480 0x7fb6400c5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:17.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.406+0000 7fb648800640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb6400bffb0 0x7fb640156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:17.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.406+0000 7fb648800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6400726a0 0x7fb6400cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:17.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.406+0000 7fb648800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb640071960 con 0x7fb640150480 2024-01-18T00:48:17.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.406+0000 7fb648800640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb640156720 con 0x7fb6400bffb0 2024-01-18T00:48:17.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.406+0000 7fb648800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb640071bb0 con 0x7fb6400726a0 2024-01-18T00:48:17.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.410+0000 7fb645e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb640150480 0x7fb6400c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:17.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.410+0000 7fb645e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb640150480 0x7fb6400c5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57316/0 (socket says 172.21.15.161:57316) 2024-01-18T00:48:17.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.410+0000 7fb645e00640 1 -- 172.21.15.161:0/4099962593 learned_addr learned my addr 172.21.15.161:0/4099962593 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:48:17.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.410+0000 7fb645400640 1 --2- 172.21.15.161:0/4099962593 >> v2:172.21.15.190:3300/0 conn(0x7fb6400bffb0 0x7fb640156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:17.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.410+0000 7fb646800640 1 --2- 172.21.15.161:0/4099962593 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6400726a0 0x7fb6400cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:17.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.410+0000 7fb645e00640 1 -- 172.21.15.161:0/4099962593 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6400726a0 msgr2=0x7fb6400cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:17.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.410+0000 7fb645e00640 1 --2- 172.21.15.161:0/4099962593 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6400726a0 0x7fb6400cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:17.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.410+0000 7fb645e00640 1 -- 172.21.15.161:0/4099962593 >> v2:172.21.15.190:3300/0 conn(0x7fb6400bffb0 msgr2=0x7fb640156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:17.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.410+0000 7fb645e00640 1 --2- 172.21.15.161:0/4099962593 >> v2:172.21.15.190:3300/0 conn(0x7fb6400bffb0 0x7fb640156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:17.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.410+0000 7fb645e00640 1 -- 172.21.15.161:0/4099962593 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb640071e90 con 0x7fb640150480 2024-01-18T00:48:17.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.418+0000 7fb645e00640 1 --2- 172.21.15.161:0/4099962593 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb640150480 0x7fb6400c5990 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb640070820 tx=0x7fb63001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f43a943a95b85c server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:17.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.422+0000 7fb644a00640 1 -- 172.21.15.161:0/4099962593 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6300a89b0 con 0x7fb640150480 2024-01-18T00:48:17.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.422+0000 7fb644a00640 1 -- 172.21.15.161:0/4099962593 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb6300a8b10 con 0x7fb640150480 2024-01-18T00:48:17.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.422+0000 7fb644a00640 1 -- 172.21.15.161:0/4099962593 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6300b0440 con 0x7fb640150480 2024-01-18T00:48:17.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.422+0000 7fb648800640 1 -- 172.21.15.161:0/4099962593 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb640150480 msgr2=0x7fb6400c5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:17.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.422+0000 7fb648800640 1 --2- 172.21.15.161:0/4099962593 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb640150480 0x7fb6400c5990 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb640070820 tx=0x7fb63001ecf0 comp rx=0 tx=0).stop 2024-01-18T00:48:17.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.422+0000 7fb648800640 1 -- 172.21.15.161:0/4099962593 shutdown_connections 2024-01-18T00:48:17.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.422+0000 7fb648800640 1 --2- 172.21.15.161:0/4099962593 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6400726a0 0x7fb6400cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:17.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.422+0000 7fb648800640 1 --2- 172.21.15.161:0/4099962593 >> v2:172.21.15.190:3300/0 conn(0x7fb6400bffb0 0x7fb640156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:17.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.422+0000 7fb648800640 1 --2- 172.21.15.161:0/4099962593 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb640150480 0x7fb6400c5990 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:17.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.422+0000 7fb648800640 1 -- 172.21.15.161:0/4099962593 >> 172.21.15.161:0/4099962593 conn(0x7fb64006aae0 msgr2=0x7fb64006aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:17.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.422+0000 7fb648800640 1 -- 172.21.15.161:0/4099962593 shutdown_connections 2024-01-18T00:48:17.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.422+0000 7fb648800640 1 -- 172.21.15.161:0/4099962593 wait complete. 2024-01-18T00:48:17.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.426+0000 7fb648800640 1 Processor -- start 2024-01-18T00:48:17.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.426+0000 7fb648800640 1 -- start start 2024-01-18T00:48:17.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.426+0000 7fb648800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6400726a0 0x7fb640154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:17.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.426+0000 7fb648800640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6400bffb0 0x7fb640154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:17.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.426+0000 7fb648800640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb640150480 0x7fb640158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:17.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.426+0000 7fb648800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64014d830 con 0x7fb6400726a0 2024-01-18T00:48:17.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.426+0000 7fb648800640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb640157500 con 0x7fb640150480 2024-01-18T00:48:17.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.426+0000 7fb648800640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6401f0220 con 0x7fb6400bffb0 2024-01-18T00:48:17.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.426+0000 7fb645e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6400726a0 0x7fb640154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:17.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.426+0000 7fb645e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6400726a0 0x7fb640154900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57326/0 (socket says 172.21.15.161:57326) 2024-01-18T00:48:17.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.426+0000 7fb645e00640 1 -- 172.21.15.161:0/1202887718 learned_addr learned my addr 172.21.15.161:0/1202887718 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-01-18T00:48:17.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.426+0000 7fb645400640 1 --2- 172.21.15.161:0/1202887718 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6400bffb0 0x7fb640154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:17.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.426+0000 7fb646800640 1 --2- 172.21.15.161:0/1202887718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb640150480 0x7fb640158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:17.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.430+0000 7fb645e00640 1 -- 172.21.15.161:0/1202887718 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6400bffb0 msgr2=0x7fb640154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:17.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.430+0000 7fb645e00640 1 --2- 172.21.15.161:0/1202887718 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6400bffb0 0x7fb640154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:17.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.430+0000 7fb645e00640 1 -- 172.21.15.161:0/1202887718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb640150480 msgr2=0x7fb640158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:17.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.430+0000 7fb645e00640 1 --2- 172.21.15.161:0/1202887718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb640150480 0x7fb640158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:17.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.430+0000 7fb645e00640 1 -- 172.21.15.161:0/1202887718 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6300094d0 con 0x7fb6400726a0 2024-01-18T00:48:17.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.434+0000 7fb645e00640 1 --2- 172.21.15.161:0/1202887718 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6400726a0 0x7fb640154900 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb63001d3a0 tx=0x7fb63001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:17.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.438+0000 7fb63e000640 1 -- 172.21.15.161:0/1202887718 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6300ba600 con 0x7fb6400726a0 2024-01-18T00:48:17.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.438+0000 7fb63e000640 1 -- 172.21.15.161:0/1202887718 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb6300ba780 con 0x7fb6400726a0 2024-01-18T00:48:17.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.438+0000 7fb63e000640 1 -- 172.21.15.161:0/1202887718 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6300bab50 con 0x7fb6400726a0 2024-01-18T00:48:17.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.438+0000 7fb648800640 1 -- 172.21.15.161:0/1202887718 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb640157750 con 0x7fb6400726a0 2024-01-18T00:48:17.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.438+0000 7fb648800640 1 -- 172.21.15.161:0/1202887718 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb640157d10 con 0x7fb6400726a0 2024-01-18T00:48:17.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.438+0000 7fb648800640 1 -- 172.21.15.161:0/1202887718 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6400746a0 con 0x7fb6400726a0 2024-01-18T00:48:17.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.458+0000 7fb63e000640 1 -- 172.21.15.161:0/1202887718 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fb6300bacb0 con 0x7fb6400726a0 2024-01-18T00:48:17.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.458+0000 7fb63e000640 1 --2- 172.21.15.161:0/1202887718 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb618066890 0x7fb618068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:17.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.458+0000 7fb645400640 1 --2- 172.21.15.161:0/1202887718 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb618066890 0x7fb618068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:17.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.458+0000 7fb645400640 1 --2- 172.21.15.161:0/1202887718 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb618066890 0x7fb618068d50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb64015a660 tx=0x7fb628008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:17.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.690+0000 7fb63e000640 1 -- 172.21.15.161:0/1202887718 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fb6300f43e0 con 0x7fb6400726a0 2024-01-18T00:48:17.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.690+0000 7fb63e000640 1 -- 172.21.15.161:0/1202887718 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fb6300f0720 con 0x7fb6400726a0 2024-01-18T00:48:17.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:17.842+0000 7fb648800640 1 -- 172.21.15.161:0/1202887718 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb6400b04d0 con 0x7fb6400726a0 2024-01-18T00:48:17.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-01-18T00:48:17.986 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2024-01-18T00:48:17.986 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-01-18T00:48:18.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:18.254+0000 7fb63e000640 1 -- 172.21.15.161:0/1202887718 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7fb6300b5070 con 0x7fb6400726a0 2024-01-18T00:48:18.255 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data_ec' removed 2024-01-18T00:48:18.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:18.254+0000 7fb648800640 1 -- 172.21.15.161:0/1202887718 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb618066890 msgr2=0x7fb618068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:18.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:18.254+0000 7fb648800640 1 --2- 172.21.15.161:0/1202887718 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb618066890 0x7fb618068d50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb64015a660 tx=0x7fb628008040 comp rx=0 tx=0).stop 2024-01-18T00:48:18.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:18.254+0000 7fb648800640 1 -- 172.21.15.161:0/1202887718 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6400726a0 msgr2=0x7fb640154900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:18.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:18.254+0000 7fb648800640 1 --2- 172.21.15.161:0/1202887718 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6400726a0 0x7fb640154900 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb63001d3a0 tx=0x7fb63001ba90 comp rx=0 tx=0).stop 2024-01-18T00:48:18.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:18.254+0000 7fb648800640 1 -- 172.21.15.161:0/1202887718 shutdown_connections 2024-01-18T00:48:18.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:18.254+0000 7fb648800640 1 --2- 172.21.15.161:0/1202887718 >> [v2:172.21.15.161:6800/272458188,v1:172.21.15.161:6801/272458188] conn(0x7fb618066890 0x7fb618068d50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:18.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:18.254+0000 7fb648800640 1 --2- 172.21.15.161:0/1202887718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb640150480 0x7fb640158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:18.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:18.254+0000 7fb648800640 1 --2- 172.21.15.161:0/1202887718 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6400bffb0 0x7fb640154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:18.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:18.254+0000 7fb648800640 1 --2- 172.21.15.161:0/1202887718 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6400726a0 0x7fb640154900 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:18.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:18.254+0000 7fb648800640 1 -- 172.21.15.161:0/1202887718 >> 172.21.15.161:0/1202887718 conn(0x7fb64006aae0 msgr2=0x7fb640159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:18.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:18.258+0000 7fb648800640 1 -- 172.21.15.161:0/1202887718 shutdown_connections 2024-01-18T00:48:18.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-18T00:48:18.258+0000 7fb648800640 1 -- 172.21.15.161:0/1202887718 wait complete. 2024-01-18T00:48:18.293 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-18T00:48:18.293 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-18T00:48:18.293 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:48:18.302 INFO:tasks.ceph.mds.a.smithi161.stderr:2024-01-18T00:48:18.294+0000 b9ce640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 31189) UID: 0 2024-01-18T00:48:18.304 INFO:tasks.ceph.mds.a.smithi161.stderr:2024-01-18T00:48:18.294+0000 b9ce640 -1 mds.a *** got signal Terminated *** 2024-01-18T00:48:24.394 INFO:tasks.ceph.mds.a:Stopped 2024-01-18T00:48:24.394 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-18T00:48:24.394 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:48:24.394 INFO:tasks.ceph.mds.c:Stopped 2024-01-18T00:48:24.394 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-01-18T00:48:24.394 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:48:24.395 INFO:tasks.ceph.mds.e:Stopped 2024-01-18T00:48:24.395 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-18T00:48:24.395 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:48:24.418 INFO:tasks.ceph.mds.b.smithi190.stderr:2024-01-18T00:48:24.394+0000 b9ce640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 31825) UID: 0 2024-01-18T00:48:24.418 INFO:tasks.ceph.mds.b.smithi190.stderr:2024-01-18T00:48:24.394+0000 b9ce640 -1 mds.b *** got signal Terminated *** 2024-01-18T00:48:24.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-01-18T00:48:24.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2024-01-18T00:48:24.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~7s 2024-01-18T00:48:24.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2024-01-18T00:48:30.498 INFO:tasks.ceph.mds.b:Stopped 2024-01-18T00:48:30.498 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-18T00:48:30.498 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:48:30.498 INFO:tasks.ceph.mds.d:Stopped 2024-01-18T00:48:30.498 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-01-18T00:48:30.499 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:48:30.522 INFO:tasks.ceph.mds.f.smithi190.stderr:2024-01-18T00:48:30.498+0000 b9ce640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i f (PID: 31829) UID: 0 2024-01-18T00:48:30.523 INFO:tasks.ceph.mds.f.smithi190.stderr:2024-01-18T00:48:30.498+0000 b9ce640 -1 mds.f *** got signal Terminated *** 2024-01-18T00:48:30.907 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-01-18T00:48:30.907 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2024-01-18T00:48:30.907 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-01-18T00:48:30.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-01-18T00:48:36.600 INFO:tasks.ceph.mds.f:Stopped 2024-01-18T00:48:36.600 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-18T00:48:36.601 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-18T00:48:36.601 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:48:36.602 INFO:tasks.ceph.osd.0.smithi161.stderr:2024-01-18T00:48:36.601+0000 7f84d7c00640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 27500) UID: 0 2024-01-18T00:48:36.602 INFO:tasks.ceph.osd.0.smithi161.stderr:2024-01-18T00:48:36.601+0000 7f84d7c00640 -1 osd.0 35 *** Got signal Terminated *** 2024-01-18T00:48:42.703 INFO:tasks.ceph.osd.0:Stopped 2024-01-18T00:48:42.703 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-18T00:48:42.703 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:48:42.704 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-01-18T00:48:42.705+0000 7f902be00640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 27501) UID: 0 2024-01-18T00:48:42.704 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-01-18T00:48:42.705+0000 7f902be00640 -1 osd.1 36 *** Got signal Terminated *** 2024-01-18T00:48:43.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-01-18T00:48:48.805 INFO:tasks.ceph.osd.1:Stopped 2024-01-18T00:48:48.805 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-18T00:48:48.806 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:48:48.806 INFO:tasks.ceph.osd.2.smithi161.stderr:2024-01-18T00:48:48.805+0000 7fcb68a00640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 27504) UID: 0 2024-01-18T00:48:48.807 INFO:tasks.ceph.osd.2.smithi161.stderr:2024-01-18T00:48:48.805+0000 7fcb68a00640 -1 osd.2 38 *** Got signal Terminated *** 2024-01-18T00:48:49.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-01-18T00:48:49.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-01-18T00:48:54.907 INFO:tasks.ceph.osd.2:Stopped 2024-01-18T00:48:54.907 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-18T00:48:54.907 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:48:54.909 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-01-18T00:48:54.909+0000 7f658a800640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 27506) UID: 0 2024-01-18T00:48:54.909 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-01-18T00:48:54.909+0000 7f658a800640 -1 osd.3 39 *** Got signal Terminated *** 2024-01-18T00:48:55.543 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-01-18T00:48:55.543 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-01-18T00:49:01.010 INFO:tasks.ceph.osd.3:Stopped 2024-01-18T00:49:01.010 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-18T00:49:01.010 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:01.012 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-01-18T00:49:01.013+0000 7f2d48905640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 28189) UID: 0 2024-01-18T00:49:01.012 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-01-18T00:49:01.013+0000 7f2d48905640 -1 osd.4 40 *** Got signal Terminated *** 2024-01-18T00:49:01.449 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-01-18T00:49:01.449 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-01-18T00:49:07.112 INFO:tasks.ceph.osd.4:Stopped 2024-01-18T00:49:07.113 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-18T00:49:07.113 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:07.114 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-01-18T00:49:07.113+0000 7f096103b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 28191) UID: 0 2024-01-18T00:49:07.114 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-01-18T00:49:07.113+0000 7f096103b640 -1 osd.5 41 *** Got signal Terminated *** 2024-01-18T00:49:07.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-01-18T00:49:07.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-01-18T00:49:12.962 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-01-18T00:49:12.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-01-18T00:49:13.215 INFO:tasks.ceph.osd.5:Stopped 2024-01-18T00:49:13.216 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-18T00:49:13.216 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:13.217 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-01-18T00:49:13.217+0000 7fb4e66d3640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 28192) UID: 0 2024-01-18T00:49:13.217 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-01-18T00:49:13.217+0000 7fb4e66d3640 -1 osd.6 42 *** Got signal Terminated *** 2024-01-18T00:49:18.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-01-18T00:49:18.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-01-18T00:49:19.317 INFO:tasks.ceph.osd.6:Stopped 2024-01-18T00:49:19.318 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-18T00:49:19.318 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:19.319 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-01-18T00:49:19.317+0000 7f145edf7640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 28194) UID: 0 2024-01-18T00:49:19.319 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-01-18T00:49:19.317+0000 7f145edf7640 -1 osd.7 42 *** Got signal Terminated *** 2024-01-18T00:49:24.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-01-18T00:49:24.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-01-18T00:49:25.420 INFO:tasks.ceph.osd.7:Stopped 2024-01-18T00:49:25.420 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-18T00:49:25.420 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-18T00:49:25.420 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:25.421 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-18T00:49:25.420+0000 7f5c94000640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 27390) UID: 0 2024-01-18T00:49:25.421 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-01-18T00:49:25.420+0000 7f5c94000640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-01-18T00:49:25.479 INFO:tasks.ceph.mgr.y:Stopped 2024-01-18T00:49:25.480 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-18T00:49:25.480 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:25.508 INFO:tasks.ceph.mgr.x:Stopped 2024-01-18T00:49:25.508 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-18T00:49:25.509 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-18T00:49:25.509 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:25.530 INFO:tasks.ceph.mon.a.smithi161.stderr:2024-01-18T00:49:25.524+0000 a369640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 27385) UID: 0 2024-01-18T00:49:25.530 INFO:tasks.ceph.mon.a.smithi161.stderr:2024-01-18T00:49:25.524+0000 a369640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-01-18T00:49:29.275 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-01-18T00:49:29.275 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-01-18T00:49:31.609 INFO:tasks.ceph.mon.a:Stopped 2024-01-18T00:49:31.610 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-18T00:49:31.610 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:31.644 INFO:tasks.ceph.mon.b.smithi190.stderr:2024-01-18T00:49:31.612+0000 a369640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 27863) UID: 0 2024-01-18T00:49:31.649 INFO:tasks.ceph.mon.b.smithi190.stderr:2024-01-18T00:49:31.612+0000 a369640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-01-18T00:49:34.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-01-18T00:49:34.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-01-18T00:49:37.712 INFO:tasks.ceph.mon.b:Stopped 2024-01-18T00:49:37.712 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-18T00:49:37.712 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:37.728 INFO:tasks.ceph.mon.c.smithi190.stderr:2024-01-18T00:49:37.712+0000 a369640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 27866) UID: 0 2024-01-18T00:49:37.728 INFO:tasks.ceph.mon.c.smithi190.stderr:2024-01-18T00:49:37.712+0000 a369640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2024-01-18T00:49:39.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-01-18T00:49:39.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-01-18T00:49:43.813 INFO:tasks.ceph.mon.c:Stopped 2024-01-18T00:49:43.813 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-18T00:49:43.814 DEBUG:teuthology.orchestra.run.smithi161:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-01-18T00:49:43.847 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi161.front.sepia.ceph.com 2024-01-18T00:49:43.847 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-18T00:49:44.169 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi161.front.sepia.ceph.com 2024-01-18T00:49:44.169 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-18T00:49:44.367 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi161.front.sepia.ceph.com 2024-01-18T00:49:44.368 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-18T00:49:44.379 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-01-18T00:49:44.547 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi161.front.sepia.ceph.com 2024-01-18T00:49:44.547 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-18T00:49:44.748 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi190.front.sepia.ceph.com 2024-01-18T00:49:44.749 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-18T00:49:44.993 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi190.front.sepia.ceph.com 2024-01-18T00:49:44.994 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-18T00:49:45.182 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi190.front.sepia.ceph.com 2024-01-18T00:49:45.183 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-18T00:49:45.348 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi190.front.sepia.ceph.com 2024-01-18T00:49:45.348 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-18T00:49:45.508 INFO:tasks.ceph:Archiving mon data... 2024-01-18T00:49:45.509 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519259/data/mon.a.tgz 2024-01-18T00:49:45.510 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2024-01-18T00:49:45.519 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.DhksiiTp2i 2024-01-18T00:49:45.520 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.DhksiiTp2i 2024-01-18T00:49:45.646 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.DhksiiTp2i 2024-01-18T00:49:45.726 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.DhksiiTp2i is 373KB 2024-01-18T00:49:45.792 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.DhksiiTp2i 2024-01-18T00:49:45.801 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519259/data/mon.b.tgz 2024-01-18T00:49:45.801 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2024-01-18T00:49:45.808 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.NnRdRtvXC9 2024-01-18T00:49:45.808 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.NnRdRtvXC9 2024-01-18T00:49:45.931 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.NnRdRtvXC9 2024-01-18T00:49:45.995 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.NnRdRtvXC9 is 388KB 2024-01-18T00:49:46.053 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.NnRdRtvXC9 2024-01-18T00:49:46.058 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519259/data/mon.c.tgz 2024-01-18T00:49:46.058 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2024-01-18T00:49:46.103 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.MrC1ZwfKeq 2024-01-18T00:49:46.104 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.MrC1ZwfKeq 2024-01-18T00:49:46.233 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.MrC1ZwfKeq 2024-01-18T00:49:46.296 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.MrC1ZwfKeq is 388KB 2024-01-18T00:49:46.313 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.MrC1ZwfKeq 2024-01-18T00:49:46.318 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-18T00:49:46.318 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-18T00:49:46.321 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-18T00:49:46.666 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_PossiblyLost calloc __trans_list_add 2024-01-18T00:49:46.859 INFO:tasks.ceph:Archiving crash dumps... 2024-01-18T00:49:46.861 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519259/remote/smithi161/crash 2024-01-18T00:49:46.862 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-18T00:49:46.883 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519259/remote/smithi190/crash 2024-01-18T00:49:46.884 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-18T00:49:46.897 INFO:tasks.ceph:Shutting down logrotate 2024-01-18T00:49:46.898 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_PossiblyLost calloc __trans_list_add During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 257, in ceph_log logrotater.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 222, in end self.thread.get() File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi161 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-01-18T00:49:46.899 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-18T00:49:46.907 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_PossiblyLost calloc __trans_list_add During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 257, in ceph_log logrotater.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 222, in end self.thread.get() File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi161 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-01-18T00:49:46.911 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-18T00:49:46.911 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-18T00:49:46.932 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-18T00:49:47.013 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-18T00:49:47.023 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-18T00:49:47.023 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-18T00:49:47.027 DEBUG:teuthology.orchestra.run.smithi190:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-18T00:49:47.042 INFO:teuthology.orchestra.run.smithi190.stdout: remote refid st t when poll reach delay offset jitter 2024-01-18T00:49:47.042 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================== 2024-01-18T00:49:47.042 INFO:teuthology.orchestra.run.smithi190.stdout:*hv01.front.sepi 44.4.53.2 2 u 368 512 377 0.211 +1.051 0.099 2024-01-18T00:49:47.042 INFO:teuthology.orchestra.run.smithi190.stdout:+hv02.front.sepi 63.231.80.2 3 u 437 512 377 0.184 -2.192 0.237 2024-01-18T00:49:47.042 INFO:teuthology.orchestra.run.smithi190.stdout:+hv03.front.sepi 74.6.168.72 3 u 417 512 377 0.167 -1.553 0.138 2024-01-18T00:49:47.042 INFO:teuthology.orchestra.run.smithi190.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-01-18T00:49:47.043 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2024-01-18T00:49:47.043 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2024-01-18T00:49:47.043 INFO:teuthology.orchestra.run.smithi161.stdout:*hv01.front.sepi 44.4.53.2 2 u 23 256 377 0.211 +0.539 0.137 2024-01-18T00:49:47.043 INFO:teuthology.orchestra.run.smithi161.stdout:+hv02.front.sepi 63.231.80.2 3 u 71 256 377 0.167 -2.881 0.098 2024-01-18T00:49:47.044 INFO:teuthology.orchestra.run.smithi161.stdout:+hv03.front.sepi 74.6.168.72 3 u 48 256 377 0.162 -2.176 0.214 2024-01-18T00:49:47.044 INFO:teuthology.orchestra.run.smithi161.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-01-18T00:49:47.045 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-18T00:49:47.056 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-18T00:49:47.057 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-18T00:49:47.065 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-18T00:49:47.074 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-18T00:49:47.083 INFO:teuthology.task.internal:Duration was 14717.850474 seconds 2024-01-18T00:49:47.083 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-18T00:49:47.092 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-18T00:49:47.092 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-18T00:49:47.095 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-18T00:49:47.184 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-18T00:49:47.184 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2024-01-18T00:49:47.184 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-18T00:49:47.205 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi190.front.sepia.ceph.com 2024-01-18T00:49:47.205 DEBUG:teuthology.orchestra.run.smithi190:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-18T00:49:47.214 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-18T00:49:47.214 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-18T00:49:47.248 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-18T00:49:47.564 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-18T00:49:47.564 DEBUG:teuthology.orchestra.run.smithi161:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-18T00:49:47.567 DEBUG:teuthology.orchestra.run.smithi190:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-18T00:49:47.640 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-18T00:49:47.649 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-18T00:49:47.650 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-18T00:49:47.671 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-18T00:49:47.684 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-18T00:49:47.695 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-18T00:49:47.717 DEBUG:teuthology.orchestra.run.smithi190:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-18T00:49:47.730 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2024-01-18T00:49:47.739 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = core 2024-01-18T00:49:47.751 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-18T00:49:47.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-18T00:49:47.800 DEBUG:teuthology.orchestra.run.smithi190:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-18T00:49:47.805 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-18T00:49:47.805 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-18T00:49:47.815 INFO:teuthology.task.internal:Transferring archived files... 2024-01-18T00:49:47.816 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519259/remote/smithi161 2024-01-18T00:49:47.816 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-18T00:49:47.868 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519259/remote/smithi190 2024-01-18T00:49:47.869 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-18T00:49:47.889 INFO:teuthology.task.internal:Removing archive directory... 2024-01-18T00:49:47.889 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-18T00:49:47.912 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-18T00:49:47.937 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-18T00:49:47.955 INFO:teuthology.task.internal:Not uploading archives. 2024-01-18T00:49:47.955 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-18T00:49:47.970 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-18T00:49:47.971 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-18T00:49:47.974 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-18T00:49:47.979 INFO:teuthology.orchestra.run.smithi161.stdout: 658071 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 18 00:49 /home/ubuntu/cephtest 2024-01-18T00:49:47.984 INFO:teuthology.orchestra.run.smithi190.stdout: 524292 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 18 00:49 /home/ubuntu/cephtest 2024-01-18T00:49:47.986 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-18T00:49:48.002 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-18T00:49:48.013 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi161 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-01-18T00:49:48.013 INFO:teuthology.nuke:Checking targets against current locks 2024-01-18T00:49:48.039 DEBUG:teuthology.nuke:shortname: smithi161 2024-01-18T00:49:48.039 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-18T00:49:48.063 DEBUG:teuthology.nuke:shortname: smithi190 2024-01-18T00:49:48.063 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-18T00:49:48.066 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519259', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 20:33:10.520172', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCFeRXVyQi8037FG5pYx64D+ttT6fno9jm3W/UyT4g7VB+mjbzOEgJBGbBfvRrHdz3HH/KZN/uXXBARJyY5VNvc='} 2024-01-18T00:49:48.088 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519259', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 20:33:10.518410', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPACka/qChOqhnfuphJXksaCCVdZNZiliJFEnQ5I68xbpN2+6WRPFeWy09PR1xKOyaG+Zs7DXUR2GTgcZqY+vvg='} 2024-01-18T00:49:48.116 INFO:teuthology.orchestra.console.smithi161:Power off 2024-01-18T00:49:48.116 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T00:49:48.138 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-01-18T00:49:48.138 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T00:49:48.153 INFO:teuthology.orchestra.console.smithi190:Power off 2024-01-18T00:49:48.154 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T00:49:48.162 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-01-18T00:49:48.175 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2024-01-18T00:49:48.175 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T00:49:48.196 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2024-01-18T00:49:52.163 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T00:49:52.197 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T00:49:52.272 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-01-18T00:49:52.306 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2024-01-18T00:49:56.275 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T00:49:56.307 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T00:49:56.386 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-01-18T00:49:56.415 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2024-01-18T00:49:56.487 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-01-18T00:49:56.516 INFO:teuthology.orchestra.console.smithi190:Power off completed 2024-01-18T00:49:56.620 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 064ffc2b249f42d6c6a333d6e6f3d5392519ee92 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/valgrind} duration: 14717.850473880768 failure_reason: 'Command failed on smithi161 with status 3: ''sudo logrotate /etc/logrotate.d/ceph-test.conf''' flavor: default owner: scheduled_leonidus@teuthology status: fail success: false 2024-01-18T00:49:56.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T00:49:56.695 INFO:teuthology.run:FAIL